Dr. Yelin Kim

Yelin Kim

Human-centered speech and video processing, affective computing, multimodal signal processing, machine learning

The World Within Reach
Yelin Kim
Assistant Professor
 

College of Engineering and Applied Sciences
Department: Electrical and Computer Engineering

Address:
LI 090B
Phone:
518-442-5081
View: Personal page

 

Introduction

Dr. Yelin Kim is an Assistant Professor in the Department of Computer Engineering at the University at Albany, State University of New York, and a director of the Inspire lab (Backronym: Interaction Sensing and Perception in Real Environment). 

Education

Ph.D., Electrical Engineering: Systems, University of Michigan, Ann Arbor, 2016


MS, Electrical Engineering: Systems, University of Michigan, Ann Arbor, 2013

BS, Electrical and Computer Engineering, Seoul National University, South Korea, 2011

Research Interests

Dr. Kim’s research is in the area of human-centered and affective computing, developing systems and devices for automatic sensing, quantification, and interpretation of affective and social signals during interactive communication. Her research builds upon techniques from diverse areas, including machine learning, multimodal (speech and video) signal processing, computer vision, and behavioral science.

Publications

Selected Publications:  

For details on publications, click https://yelinkim.com/publications/

Yelin Kim and Emily Mower Provost. “ISLA: Temporal Segmentation and Labeling for Audio-Visual Emotion Recognition.” IEEE Transactions on Affective Computing (IEEE TAC ’17), 2017.

Yelin Kim and Emily Mower Provost. “Emotion Recognition During Speech Using Dynamics of Multiple Regions of the Face.” ACM Transactions on Multimedia Computing, Communications and Applications (ACM TOMM), Special Issue on ACM Multimedia Best Papers. 12:1(article 25), 2015, pp.25:1–25:23.

Yelin Kim, Jixu Chen, Ming-Ching Chang, Xin Wang, Emily Mower Provost, and Siwei Lyu. "Modeling Transition Patterns Between Events for Temporal Human Action Segmentation and Classification." [patent filed; U.S. Serial No. 14/702,229] (Acceptance rate: 12%)

Yelin Kim and Emily Mower Provost. "Say Cheese vs. Smile: Reducing Speech-Related Variability for Facial Emotion Recognition." Proceedings of the ACM International Conference on Multimedia (ACM MM). Florida, USA, November, 2014, pp. 27-36. (Acceptance rate: 19%) Best Student Paper Award

Yelin Kim, Honglak Lee, and Emily Mower Provost. "Deep Learning for Robust Feature Generation in Audio-Visual Emotion Recognition." IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Vancouver, British Columbia, Canada. May, 2013, pp. 3687-3691.

Yelin Kim and Emily Mower Provost. "Emotion Recognition During Speech Using Dynamics of Multiple Regions of the Face." ACM Transactions on Multimedia Computing, Communications and Applications (ACM TOMM), Special Issue on Extended Best Papers from ACM Multimedia, October, 2015, pp.25:1--25:23. Invited Journal. 

Yelin Kim, Jixu Chen, Ming-Ching Chang, Xin Wang, Emily Mower Provost, and Siwei Lyu. "Modeling Transition Patterns Between Events for Temporal Human Action Segmentation and Classification." IEEE International Conference on Automatic Face and Gesture Recognition (FG), Ljubljana, Slovenia, May, 2015, pp. 1-8. [patent filed; U.S. Serial No. 14/702,229] (Acceptance rate: 12%) 

Yelin Kim and Emily Mower Provost. "Say Cheese vs. Smile: Reducing Speech-Related Variability for Facial Emotion Recognition." Proceedings of the ACM International Conference on Multimedia (ACM MM). Florida, USA, November, 2014, pp. 27-36. (Acceptance rate: 19%) Best Student Paper Award

Yelin Kim, Honglak Lee, and Emily Mower Provost. "Deep Learning for Robust Feature Generation in Audio-Visual Emotion Recognition." IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Vancouver, British Columbia, Canada. May, 2013, pp. 3687-3691.  

Yelin Kim and Emily Mower Provost. "Emotion Classification via Utterance-Level Dynamics: A Pattern-Based Approach to Characterizing Affective Expressions." IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Vancouver, British Columbia, Canada. May, 2013, pp.3677-3681.

Selected Awards

Google Faculty Research Award, 2018

Faculty Research Award, SUNY-A, 2017–2019

Best Student Paper Award, ACM Multimedia, 2014 (lead author)

Korean Government KETEP Scholarship, 2011–2013

Qualcomm Scholarship, 2011

Professional Activities

Conference Organizer

ACM International Conference on Multimodal Interaction (ICMI) 2018: Doctoral Consortium Co-Chair

IEEE International Conference on Automatic Face and Gesture Recognition (FG) 2018: Publicity Co-Chair

IEEE Conference on Affective Computing and Intelligent Interaction (ACII) 2017: Doctoral Consortium Co-Chair (received NSF Award IIS:1743034)

Workshop Organizer

IEEE FG 2018 First Workshop on Large-scale Emotion Recognition and Analysis (LERA) : Co-Chair

NSF Proposal Review Panelist

Computer & Information Science & Engineering (CISE), 2017, 2018

Program Committee

Senior PC Member, ACM ICMI, 2018

PC Member, PETRA, 2017

Review Services

IEEE Transactions on Affective Computing (TAC)

IEEE Transactions on Multimedia

Journal of Artificial Intelligence Research (JAIR)

Speech Communication – Elsevier

IEEE Robotics and Automation Letters (RA-L)

Computer Speech and Language

ACM International Conference on Multimedia (MM)

ACM International Conference on Multimodal Interaction (ICMI)

Membership

Institute of Electrical and Electronics Engineer (IEEE)

Association for Computing Machinery (ACM)

International Speech Communication Association (ISCA)

Awards and Honors

Google Faculty Research Award, 2018

Faculty Research Award, SUNY-A, 2017–2019

Best Student Paper Award, ACM Multimedia, 2014 (lead author)

Korean Government KETEP Scholarship, 2011–2013

Qualcomm Scholarship, 2011