研究方向:
人工智能大模型, 深度学习, 图像与语音处理,情感计算,计算机视觉,机器学习。重点研究人工智能大模型在各个领域中的应用。
课题组每周开展组会进行研讨,为学生提供细致的指导。所指导的很多学生发表多篇SCI论文。
培养的毕业生就业去向包括华为、网易、海康、中兴、中国电信、中国移动、苏州公安局、无锡公安局、中国银行、南京银行等国内知名企业和事业单位等。
欢迎对人工智能方向感兴趣,且勤奋自律、有进取心的同学报考,特别欢迎具有一定编程动手能力的同学。感兴趣的同学可通过邮件 yanjingjie@njupt.edu.cn 或者手机电话:15905167423 联系。
主持的科研项目:
1、国家自然科学面上项目:基于深度学习的表情、语音和姿态多模态情感识别研究
2、国家自然科学青年基金:基于人脸表情、身体姿态和语音的多模态情感识别方法研究
3、江苏省自然科学青年基金:基于Harris空时特征和特征层融合的表情和姿态双模态情感识别方法研究
4、江苏省高校自然科学基金面上项目:基于语音和表情的双模态情感识别研究
5、国家博士后基金:基于视频的表情和姿态双模态情感识别研究
参与的科研项目:
1、国家973项目:网络海量可视媒体智能处理的理论与方法
2、国家自然科学基金重点项目:基于视频分析的儿童行为研究
代表性论文:
1. Jingjie Yan, Guanming Lu, Xiaonan Li,
Wenming Zheng_, Chengwei Huang,Zhen Cui, Yuan Zong, Mengying Chen, Qiang Hao,
Yi Liu, Jindu Zhu, Haibo Li, , “FENP: A Database of
Neonatal Facial Expression for Pain Analysis,” IEEE
Transaction on Affective Computing. 2023 (情感计算领域TOP期刊)
2. Jingjie Yan, Chengkun Du, Na Li, et al. Spatio-temporal graph
Bert network for EEG emotion recognition. Biomedical Signal Processing and
Control, 2025, 104: 107576((脑电情感识别领域TOP期刊))
3. Jingjie Yan, Wenming Zheng, Qinxu Xu, Guanming Lu, Haibo Li,
and Bei Wang, “Sparse kernel reduced-rank regression for
bimodal emotion recognition from facial expression and speech,” IEEE Transaction on Multimedia, vol. 18, No. 7, pp. 1319-1329, Jul.
2016.( 图像多媒体领域TOP期刊 )
4. Jinsheng Wei, Wei Peng, Guanming Lu, Yante Li, Jingjie
Yan, and Guoying Zhao. Geometric Graph Representation with Learnable Graph
Structure and Adaptive AU Constraint for Micro-Expression Recognition, IEEE
Transactions on Affective Computing. 2023. (情感计算领域TOP期刊)
5. Jingjie Yan, Yuebo Yue, et al.
Multi-Representation Joint Dynamic Domain Adaptation Network for Cross-Database
Facial Expression Recognition. Electronics, 2024, 13(8): 1470. (SCI 收录)
6. Jingjie Yan, Peiyuan Li, Chengkun Du, et
al. Multimodal Emotion Recognition Based on Facial Expressions, Speech, and
Body Gestures. Electronics (2079-9292), 2024, 13(18). (SCI 收录)
7. Jingjie Yan, Haihua Li, Fengfeng Xu, et
al. Speech Emotion Recognition Based on Temporal-Spatial Learnable Graph
Convolutional Neural Network. Electronics, 2024, 13(11): 2010. (SCI 收录)
8. Guanming
Lu, Haoxia Chen, Jinsheng Wei, Xiaonan Li, Xianlan Zheng, Hongyao Leng, Yimo
Lou, Jingjie Yan. Video-based neonatal pain expression recognition with
cross-stream attention. Multimedia Tools and Applications, 1-24. 2023. (SCI 收录)
9. Jinsheng
Wei, Guanming Lu, Jingjie Yan, Yuan Zong. Learning Two Groups of Discriminative
Features for Micro-expression Recognition[J]. Neurocomputing, 2022, 479:22-36 (SCI 收录)
10. Jinsheng
Wei, Guanming Lu, Jingjie Yan. A comparative study on movement feature in
different directions for micro-expression recognition[J]. Neurocomputing, 2021,
449:159-171 (SCI 收录)
11. Jinsheng Wei, Guanming Lu, Jingjie Yan, Huaming Liu.
Micro-expression recognition using local binary pattern from five intersecting planes[J].
Multimedia Tools and Applications, 2022. (SCI 收录)
12.
Jingjie Yan, Bojie Yan, Ruiyu Liang, Guanming Lu, Haibo Li, Shipeng Xie, “Facial Expression Recognition via Regression-based Robust Locality
Preserving Projections,” IEICE Transactions on
Information and Systems, Vol. E101-D, No.2, pp., 2018. (SCI 收录)
13. Jingjie Yan, Bei Wang, Ruiyu Liang, “A Novel Bimodal Emotion Database From Physiological Signals and
Facial Expression,” IEICE Transactions on Information
and Systems, Vol.E101-D, No.7 pp.1976 -1979, 2018 (SCI 收录)
14 Jingjie Yan, Guanming Lu, Xiaodong Bai, Haibo Li, Ning Sun,
Ruiyu Liang, “A Novel Supervised Bimodal Emotion Recognition
Approach Based on Facial Expression and Body Gesture,”
IEICE Transactions on Fundamentals of Electronics, Communications and Computer
Sciences, Vol.E101-A, No.11, pp. 2003-2006, Nov. 2018 (SCI 收录)
15. Jingjie Yan, Wenming Zheng, Minghai Xin, Jingwei Yan, “Integrating Facial Expression and Body Gesture in Videos for Emotion
Recognition”, IEICE Transactions on Information and
Systems, Vol. E95-D, No.3, pp. 610-613, 2014. (SCI 收录)
16. Jingjie Yan, Wenming Zheng, Xiaoyan Zhou, Zhijian Zhao, “Sparse 2-D Canonical Correlation Analysis via Low Rank Matrix
Approximation for Feature Extraction,” IEEE Signal
Processing Letters, Vol.19, No.1, pp.51-54, 2012. (SCI 收录)
17. Jingjie Yan, Wenming Zheng, Minghai Xin, Jingwei Yan, “Facial Expression Recognition Based on Sparse Locality Preserving
Projection”, IEICE Transactions on Fundamentals of
Electronics, Communications and Computer Sciences, Vol. E97-A, No.7, pp.
1650-1653, 2014. (SCI 收录)
18. Jingjie Yan, Xiaolan Wang, Weiyi Gu, Lili Ma, “Speech Emotion Recognition Based on Sparse Representation”, Archives of Acoustics, Vol. 38, No.4, pp. 465-470, 2013. (SCI 收录)
19. 闫静杰 卢官明,李海波,王珊珊, “基于人脸表情和语音的双模态情感识别”,南京邮电大学学报(自然科学版),Vol.38, No.1, pp.60-65, 2018.
20. 闫静杰,郑文明,辛明海,邱伟,“表情和姿态的双模态情感识别”,中国图像图形学报,Vol.18, No.9, pp. 1101-1106, 2013.
部分专利
1、 闫静杰,顾晓娜,李娜,李同霞,基于时空特征融合的多模态情感识别方法,ZL 2021 1 1360121.3
2、 李娜,闫静杰,顾晓娜,李同霞,李海波,一种基于时空图模型的脑电情感识别方法,ZL 2021 1 1366669.9
3、闫静杰,朱康,朱宇康,吕方惠,卢官明,李海波,基于增强卷积和空时LSTM网络的双模态情感识别方法,CN111401116B,2022.08.26
4、闫静杰,朱康,宋宇康,吕方惠,李娜,卢官明,一种基于稀疏监督最小二乘多类核典型相关分析的多模态情感识别方法,CN112101401B,2022.08.26
5、闫静杰,朱康,宋宇康,吕方惠,顾晓娜,卢官明,一种基于监督最小二乘多类核典型相关分析的多模态情感特征融合方法,CN111950592B,2022.09.23
6、吕方惠,闫静杰,李海波,朱康,宋宇康,卢官明,基于双流卷积神经网络的新生儿疼痛表情识别方法,CN111401117B,2022.08.26
7、卢官明,孔凯霆,李晓南,闫静杰,卢峻禾,一种基于移动终端的新生儿疼痛评估方法,CN108363969B,2022.08.26
8、卢官明,汪洋,卢峻禾,闫静杰,一种基于轻量化卷积神经网络的图像识别方法及系统,CN111242180B,2022.07.29
9、朱娜、卢官明、闫静杰,一种基于多核学习的多模态情感识别方,CN106250855B,2022.01.28
10、卢官明; 周小洁; 李晓南; 闫静杰; 卢峻禾,一种由粗到精的新生儿面部检测方法与系统,CN110309816B,2021.06.11
11、王力谦,邵文泽,葛琦,闫静杰,一种利用时空照度图的低照度彩色视频增强方法,CN108898566B,2022.05.17
12、张文静,卢官明,闫静杰,李海波,基于深度学习的人群高兴程度识别方法,CN106803069B,2021.02.09
13、卢官明,王诗韵,闫静杰,卢峻禾,一种基于多层次特征深度学习的人脸检测方法及系统,CN108363962B,2021.01.26
14、魏金生,卢官明,刘华明,闫静杰,李海波,基于VAE-GAN与相似块搜索的人脸图像修复方法及装置,CN109903236B,2020.12.18
15、徐嵚嵛、卢官明、闫静杰,基于鉴别局部保持投影的多模态情感特征融合方法, CN106096642B, 2020.11.13
16、卢官明,郭迪,闫静杰,卢峻禾,一种基于3D卷积神经网络的双模态情感识别方法及系统,CN108596039B,2020.05.05
17、朱金朵、卢官明、李晓南、闫静杰、李海波,基于双通道特征深度学习的新生儿疼痛表情识别方法,CN106682616B,2020.04.21
18、袁亮,卢官明,闫静杰,基于深度神经网络的语音情感识别方法,CN106782602B,2020.03.17
19、卢官明、杨成、闫静杰,一种基于 3D 卷积神经网络的微表情识别方法,CN106570474B, 2019.06.28
20、程晓、卢官明、闫静杰,一种基于遗传算法的多模态情感特征融合方法,CN106096641B,2019.03.01