Dr. Haiyun He from the National University of Singapore was invited to give an online academic report in the afternoon of October 25th, 2022. The theme is "Information - Theoretic Characterizationofthe Generalization Error for Iterative Semi - Supervised Learning". The report was hosted by Lin Zhou, a professor from the School of Cyber Science and Technology, Beihang University. More than 20 professors and students participated in the report online.

       In the presentation, Dr. He first introduced the mathematical model of statistical inference using supervised learning and the concept of generalization error in the model. Dr. He points out that the method of upper and lower boundary of the generalization error is derived in the traditional literature cannot well explain generalization error and data probability distribution and the relationship between the training process, Dr. He USES principle of information theory, based on the generated pseudo tag iteration a semi-supervised learning algorithm provides precise expression for the generalization error, and its concrete into a binary gaussian mixture model. Subsequently, Dr. He proved that the addition of unlabeled data improved the generalization ability of the training model when the variance was not too large. When the variance is relatively large, that is, the data is difficult to distinguish, normalization can reduce the generalization error.

In the lecture, Dr. He answered some questions from professors and students in detail. After the lecture, Dr. He had an in-depth exchange and discussion with the professors and students on the following research direction.

【 Brief Introduction of the Speaker 】

       Dr. Haiyun He is currently a postdoctoral research fellow at the Department of Electrical and Computer Engineering, National University of Singapore. She received her PhD from the Department of Electrical and Computer Engineering, National University of Singapore in September 2022. Prior to that, she received a Master's degree from the School of Electrical and Computer Engineering at the National University of Singapore in 2017 and a Bachelor's degree in Engineering from Beijing University of Aeronautics and Astronautics in 2016. Her research interests include information theory, statistical learning, machine learning and related applications.