About Me

Main informations about me


My name is Meng Liu (刘萌). I am currently a Professor with the School of Computer Science and Technology, Shandong Jianzhu University. I received the Ph.D. degree from Shandong University, Qingdao China, advised by Prof. Baoquan Chen and Prof. Liqiang Nie. My research focused on multimedia computing and information retrieval. I obtained my M.S. degree in Computational Mathematics from Dalian University of Technology, China, in 2016. I did an internship at the National University of Singapore from 2017 to 2018, advised by Prof. Tat-Seng Chua.

  mengliu.sdu@gmail.com                               Google Scholar

Education

My Education
Shandong University, Qingdao, China (Sep 2016 - Dec 2019)
  • Doctor of Philosophy (Ph.D), Computer Science and Technology
  • Advisor: Prof. Baoquan Chen and Prof. Liqiang Nie
Dalian University of Technology, Dalian, China (Sep 2013 - Jun 2016)            
  • Master of Science (M.S), Computational Mathematics
  • Advisor: Prof. Xiuping Liu
Henan University, Kaifeng, China (Sep 2009 - Jun 2013)            
  • Bachelor of Science (B.S), Mathematics and Applied Mathematics
  • Graduated with Excellent Thesis Award

Experience

My Experience
National University of Singapore, NUS, Singapore (Oct 2017 - Oct 2018)            
  • Position: Research Intern, in NEXT++, School of Computing
  • Cross-modal Moment Retrieval in videos via Language.

News

My latest news

 [2024/06] Win the First Place of Ego Schema challenge and Second Place of Ego-NLQ challenge in CVPR 2024.

 [2024/06] One paper was accepted by IEEE TCSVT.

 [2024/06] One paper was accepted by ACM ToMM.

 [2024/05] One paper was accepted by ICML.

 [2024/04] One paper was accepted by ACM TOIS.

 [2024/04] One paper was accepted by ACM SIGIR.

 [2024/03] Two papers were accepted by ACM ToMM.

 [2023/11] Guided students to participate in the Shengteng AI Innovation Competition 2023 Jinan Regional Finals, winning the Silver Award in the Developer Kit Innovation Track.

 [2023/11] Guided student to win the Third Prize at the 2023 Xinchuang and Digital Economy Postdoctoral Haihe Academic Event.

 [2023/10] One paper was accepted by IEEE TIP.

 [2023/09] One paper was accepted by IEEE TPAMI.

 [2023/08] Four papers were accepted by ACM MM 2023.

Publications

My latest works

In the Year of 2024:


Zhicheng Sheng, Fan Liu, Meng Liu, Feng Zheng, Liqiang Nie, “Open-set Synthesis for Free-viewpoint Human Body Reenactment of Novel Poses”, IEEE TCSVT, 2024.

Meng Liu*, Da Li, Yongqiang Li, Xuemeng Song, Liqiang Nie, “Audio-Semantic Enhanced Pose-Driven Talking Head Generation”, IEEE TCSVT, 2024.

Yuanyuan Wang, Meng Liu*, Xuemeng Song, Liqiang Nie, “Harnessing Representative Spatial-Temporal Information for Video Question Answering”, ACM ToMM, 2024.

Haoyu Zhang, Meng Liu*, Zixin Liu, Xuemeng Song, Yaowei Wang, Liqiang Nie, “Multi-Factor Adaptive Vision Selection for Egocentric Video Question Answering”, ICML, 2024.

Haitao Shi, Meng Liu*, Xiaoxuan Mu, Xuemeng Song, Yupeng Hu, and Liqiang Nie, “Breaking Through the Noisy Correspondence: A Robust Model for Image-Text Matching”, ACM TOIS, 2024.

Haoqiang Lin, Haokun Wen, Xuemeng Song, Meng Liu, Yupeng Hu, and Liqiang Nie, “Fine-grained Textual Inversion network for Zero-Shot Composed Image Retrieval”, ACM SIGIR, 2024.

Hao Zhang, Meng Liu*, Yuan Qi, Yang Ning, Shunbo Hu, Liqiang Nie, and Wenyin Zhang, “Efficient Brain Tumor Segmentation with Lightweight Separable Spatial Convolutional Network”, ACM TOMM, 2024.

Panpan Zhang, Meng Liu*, Xuemeng Song, Da Cao, Zan Gao, Liqiang Nie, “Universal Relocalizer for Weakly Supervised Referring Expression Grounding”, ACM TOMM, 2024.

In the Year of 2023:


Zhicheng Sheng, Liqiang Nie,Meng Liu, Yinwei Wei, Zan Gao, “Towards Fine-Grained Talking Face Generation”, IEEE TIP, 2023.

Haoyu Zhang, Meng Liu*, Yuhong Li, Ming Yan, Zan Gao, Xiaojun Chang, Liqiang Nie, “Attribute-Guided Collaborative Learning for Partial Person Re-Identification”, IEEE TPAMI, 2023.

Meng Liu, Fenglei Zhang, Xin Luo, Fan Liu, Yinwei Wei, Liqiang Nie, “Advancing Video Question Answering with a Multi-modal and Multi-layer Question Enhancement Network”, ACM MM, 2023.

Meng Liu, Yongqiang Li, Shuyan Zhai, Weili Guan, Liqiang Nie, “Towards Realistic Conversational Head Generation: A Comprehensive Framework for Lifelike Video Synthesis”, ACM MM, 2023.

Yunxiao Wang, Meng Liu*, Zhe Li, Yupeng Hu, Xin Luo, Liqiang Nie, “Unlocking the Power of Multimodal Learning for Emotion Recognition in Conversation”, ACM MM, 2023.

Zaijing Li, Ting-En Lin, Yuchuan Wu, Meng Liu, Fengxiao Tang, Ming Zhao, Yongbin Li, “UniSA: Unified Generative Framework for Sentiment Analysis”, ACM MM, 2023.

Meng Liu, Di Zhou, Jie Guo, Xin Luo, Zan Gao, Liqiang Nie, “Semantic-aware Contrastive Learning with Proposal Suppression for Video Semantic Role Grounding”, IEEE TCSVT, 2023.

Zan Gao, Peng Chen, Tao Zhuo, Meng Liu, Lei Zhu, Meng Wang, Shengyong Chen, “A Semantic Perception and CNN-Transformer Hybrid Network for Occluded Person Re-identification”, IEEE TCSVT, 2023.

Dengtian Lin, Liqiang Jing, Xuemeng Song, Meng Liu, Teng Sun, Liqiang Nie, “Adapting Generative Pretrained Language Model for Open-domain Multimodal Sentence Summarization”, ACM SIGIR, 2023.

Yan Wang, Xin Luo, Zhen-Duo Chen, Peng-Fei Zhang, Meng Liu, Xin-Shun Xu, “FedVMR: A New Federated Learning Method for Video Moment Retrieval”, ICASSP 2023, 2023.

Yuanyuan Wang, Meng Liu*, Jianlong Wu, Liqiang Nie, “Multi-Granularity Interaction and Integration Network for Video Question Answering”, IEEE TCSVT, 2023.

Shuyan Zhai, Meng Liu*, Yongqiang Li, Zan Gao, Lei Zhu, Liqiang Nie, “Talking Face Generation With Audio-Deduced Emotional Landmarks”, IEEE TNNLS, 2023.

Leigang Qu, Meng Liu, Wenjie Wang, Zhedong Zheng, Liqiang Nie, Tat-Seng Chua, “Learnable Pillar-based Re-ranking for Image-Text Retrieval”, ACM SIGIR, 2023.

Hui Liu, Shanshan Li, Jicheng Zhu, Kai Deng, Meng Liu, Liqiang Nie, “DDIFN: A Dual-discriminator Multi-modal Medical Image Fusion Network”, ACM TOMM, 2023.

Yupeng Hu, Kun Wang, Meng Liu, Haoyu Tang, Liqiang Nie, “Semantic Collaborative Learning for Cross-Modal Moment Localization”, ACM TOIS, 2023.

In the Year of 2022:


Fenglei Zhang, Da Li, Shenghua Li, Weili Guan, Meng Liu*, “A Lightweight Tire Tread Image Classification Network”, IEEE VCIP, 2022.

Chuanfa Tian, Meng Liu*, Di Zhou, “Preference-Aware Modality Representation and Fusion for Micro-video Recommendation”, PRCV, 2022.

Xianjing Han, Xuemeng Song, Xingning Dong, Yinwei Wei, Meng Liu, Liqiang Nie, “Dbiased-p: Dual-biased Predicate Predictor for Unbiased Scene Graph Generation”, IEEE TMM, 2022.

Meng Liu, Shuyan Zhai, Yongqiang Li, Weili Guan, Liqiang Nie, “A Baseline for ViCo Conversational Head Generation Challenge”, ACM MM, 2022.

Meng Liu, Liqiang Nie, Yunxiao Wang, Meng Wang, Yong Rui, “A Survey on Video Moment Localization”, ACM Computing Surveys, ACM CSUR, 2022.

Yunxiao Wang, Meng Liu*, Yinwei Wei, Zhiyong Cheng, Yinglong Wang, Liqiang Nie, “Siamese Alignment Network for Weakly Supervised Video Moment Retrieval”, IEEE TMM, 2022.

Weili Guan, Xuemeng Song, Haoyu Zhang, Meng Liu, Chung-Hsing Yeh, Xiaojun Chang,”Bi-directional Heterogeneous Graph Hashing towards Efficient Outfit Recommendation”, ACM MM, 2022.

Zan Gao, Hongwei Wei, Weili Guan, Weizhi Nie, Meng Liu, Meng Wang,”Multigranular Visual-Semantic Embedding for Cloth-Changing Person Re-identification”, ACM MM, 2022.

In the Year of 2021:


Shengjing Tian, Bin Liu, Hongchen Tan, Jun Liu, Meng Liu, Xiuping Liu, “Deep Supervised Descent Method With Multiple Seeds Generation for 3-D Tracking in Point Cloud”, IEEE TII, 2021.

Shengjing Tian, Xiuping Liu, Meng Liu, Yuhao Bian, Junbin Gao, Baocai Yin, “Learning the Incremental Warp for 3D Vehicle Tracking in LiDAR Point Clouds”, Remote Sensing, 2021.

Zan Gao, Yuxiang Shao, Weili Guan, Meng Liu, Zhiyong Cheng, Shengyong Chen, “A Novel Patch Convolutional Neural Network for View-based 3D Model Retrieval”, ACM MM, 2021.

Haoyu Zhang, Meng Liu*, Zan Gao, Xiaoqiang Lei, Yinglong Wang, Liqiang Nie, “Multimodal dialog system: Relational Graph-based Context-aware Question Understanding”, ACM MM, 2021.

Yudong Han, Yangyang Guo, Jianhua Yin, Meng Liu*, Yupeng Hu, Liqiang Nie, “Focal and Composed Vision-semantic Modeling for Visual Question Answering”, ACM MM, 2021.

Xiao Zhang, Meng Liu*, Jianhua Yin, Zhaochun Ren, Liqiang Nie,”Question Tagging via Graph-guided Ranking”, ACM TOIS, 2021.

Leigang Qu, Meng Liu*, Jianlong Wu, Zan Gao, Liqiang Nie, “Dynamic Modality Interaction Modeling for Image-Text Retrieval”, ACM SIGIR, 2021. (Best Student Paper)

Yupeng Hu, Liqiang Nie, Meng Liu*, Kun Wang, Yinglong Wanga, Xiansheng Hua, “Coarse-to-Fine Semantic Alignment for Cross-modal Moment Localization”, IEEE TIP, 2021.

Yupeng Hu, Meng Liu*, Xiaobin Su, Zan Gao, Liqiang Nie, “Video Moment Localization via Deep Cross-Modal Hashing”, IEEE TIP, 2021.

Yawen Zeng, Da Cao, Xiaochi Wei, Meng Liu, Zhou Zhao, Zheng Qin, “Multi-Modal Relational Graph for Cross-Modal Video Moment Retrieval”, IEEE CVPR, 2021.

Yuchao Liu, Meng Liu, Jianhua Yin, “Toward community answer selection by jointly static and dynamic user expertise modeling”, APSIPA Transactions on Signal and Information Processing, 2021.

Before 2021:


Leigang Qu, Meng Liu*, Da Cao, Liqiang Nie, Qi Tian, “Context-Aware Multi-View Summarization Network for Image-Text Matching”, ACM MM, 2020.

Da Cao, Yawen Zeng, Meng Liu, Xiangnan He, Meng Wang, Zheng Qin, “STRONG: Spatio-Temporal Reinforcement Learning for Cross-Modal Video Moment Localization”, ACM MM, 2020.

Meng Liu, Leigang Qu, Liqiang Nie, Maofu Liu, Lingyu Duan, Baoquan Chen, “Iterative Local-Global Collaboration Learning Towards One-Shot Video Person Re-Identification”, IEEE TIP, 2020.

Hongchen Tan, Xiuping Liu, Meng Liu, Baocai Yin, Xin Li, “KT-GAN: Knowledge-Transfer Generative Adversarial Network for Text-to-Image Synthesis”, IEEE TIP, 2020.

Haoyu Tang, Jihua Zhu, Meng Liu, Zan Gao, Zhiyong Cheng, “Frame-wise Cross-modal Match for Video Moment Retrieval”, IEEE TMM, 2020.

Shengjing Tian, Xiuping Liu, Meng Liu, Shuhua Li and Baocai Li, “Siamese Tracking Network with Informative Enhanced Loss”, IEEE TMM, 2020.

Changfeng Sun, Han Liu, Meng Liu*, Zhaochun Ren, Tian Gan and Liqiang Nie, “LARA: Attribute-to-feature Adversarial Learning for Item Cold-start Recommendation”, ACM WSDM, 2020.

Mengmeng Li, Tian Gan, Meng Liu, Zhiyong Cheng, Jianhua Yin and Liqiang Nie, “Long-tail Hashtag Recommendation for Micro-videos with Graph Convolutional Network”, ACM CIKM, 2019.

Hao Jiang, Wenjie Wang, Meng Liu, Liqiang Nie, Ling-Yu Duan and Changsheng Xu, “Market2Dish: A Health-aware Food Recommendation System”, ACM MM, 2019.

Tian Gan, Shaokun Wang, Meng Liu, Xumeng Song, Yiyang Yao and Liqiang Nie, “Seeking Micro-influencers for Brand Promotion”, ACM MM, 2019.

Yongqi Li, Meng Liu, Jianhua Yin, Chaoran Cui, Xin-Shun Xu and Liqiang Nie, “Routing Micro-videos via A Temporal Graph-guided Recommendation System”, ACM MM, 2019.

Liqiang Nie, Meng Liu, Xuemeng Song, “Multimodal Learning toward Micro-Video Understanding”, Synthesis Lectures on Image, Video, and Multimedia Processing, (book), 2019.

Xiang Wang, Xiangnan He, Yixin Cao, Meng Liu, Tat-Seng Chua, “KGAT: Knowledge Graph Attention Network for Recommendation”, ACM KDD, 2019.

Meng Liu, Liqiang Nie, Xiang Wang, Qi Tian, Baoquan Chen, “Online Data Organizer: Micro-video Categorization by Structure-guided Multimodal Dictionary Learning”, IEEE TIP, 2019.

Jichao Zhang, Yezhi Shu, Songhua Xu, Gongze Cao, Fan Zhong, Meng Liu, Xueying Qin, “Sparsely Grouped Multi-Task Generative Adversarial Networks for Facial Attribute Manipulation”, ACM MM, 2018.

Meng Liu, Xiang Wang, Liqiang Nie, Baoquan Chen, Tat-Seng Chua, “Attentive Moment Retrieval in Videos”, ACM SIGIR, 2018.

Meng Liu, Xiang Wang, Liqiang Nie, Qi Tian, Baoquan Chen, Tat-Seng Chua, “Cross-modal Moment Localization in Videos”, ACM MM, 2018.

Meng Liu, Liqiang Nie, Meng Wang, Baoquan Chen, “Towards Micro-video Understanding by Joint Sequential-Sparse Modeling”, ACM MM, 2017.

Grants

My Grants

NSFC, Multi-modal explicit relationship modeling for micro-video analysis, 2021-01–2023-12

NSFC, Research on Cross-modal Video Moment Localization for Complex Application Scenarios, 2024-01–2027-12

Professional Services

Professional Services

Conference Reviewer for the International Conference on Multimedia Modeling, ACM Conference on Multimedia, Pacific-Rim Conference on Multimedia, CVPR, AAAI, COLING, ICCV, and WSDM.

Journal Reviewer for Information Sciences, Journal of Visual Communication and Image Representation, Multimedia Systems Journal, Pattern Recognition, IEEE Transactions on Image Processing, Journal of Electronic Imaging, IEEE Transactions on Knowledge and Data Engineering, and IEEE Transactions on Multimedia.

Honors & Awards

My Awards'Information

CVPR Ego-Schema Challenge First Place, 2024

CVPR Ego-NLQ Challenge Second Place, 2024

ACM MM Conversational Head Generation Challenge Track1 The First Place, 2023

ACM MM Conversational Head Generation Challenge Track1 Bronze Award and People’s Selection Awards, 2022

ACM MM Conversational Head Generation Challenge Track2 Silver Medal, 2022

Outstanding Reviewer Award for IEEE TMM, 2021

ACM SIGIR Best Student Paper Award, 2021

ACM China Council SIGMM Chapter Doctoral Dissertation Award, 2020

Shandong Association of Artificial Intelligence Excellent Doctoral Dissertation Award, 2020

ACM SIGIR 18 Student Travel Grant, 2018

ACM MM 18 Student Travel Grant, 2018

Outstanding Graduate Student at Shandong University, 2018

First Class Doctoral Academic Scholarship at Shandong University, 2018

Huawei Scholarship at Shandong University, 2018

ACM MM 17 Student Travel Grant, 2017

Doctoral Academic Scholarship at Shandong University, 2017

Outstanding Graduates at Dalian University of Technology, 2016

National Scholarship, 2015

Dalian University of Technology Scholarship, 2013-2016