Xiangteng He 何相腾

Peking University

Email: hexiangteng AT pku.edu.cn

Google Scholar

Biography

I received Ph.D. degree from Wangxuan Institute of Computer Technology, Peking University in 2020 (advised by Prof. Yuxin Peng), and B.E degree from College of Computer Science, Nankai University in 2014 (advised by Prof. Jufeng Yang). I have authored more than 30 papers, including IJCV, TIP, TMM, TCSVT, CVPR, ICCV, ICDE, ACM MM, ACM SIGIR, IJCAI and AAAI. My research interests include fine-grained visual analysis, video retrieval, multi-modal content analysis. I was one of the recipients of 2020 CCF (China Computer Federation) Outstanding Doctoral Dissertation Award and 2018 Baidu Scholarship, and awarded Young Elite Scientists Sponsorship Program by CAST in 2022.

I am actively seeking collaborations, please do not hesitate to shoot me an email.

Call for papers


The 12th Workshop on Fine-Grained Visual Categorization, CVPR 2025. This year, FGVC12 will have two paper tracks and a nectar track:
  • 1. Proceeding track: 8-page papers that will appear in the official CVPR workshop proceedings
  • 2. Non-archival track: 4-page extended abstracts
  • 3. Nectar track: already published work

    • Papers in track 1 and 2 will be reviewed. They will showcase new work, along with applications of fine-grained learning. Submission will be via CMT. Please take a look at the different deadlines.

    News

  • 2025-01-03: Very honored to serve as SPC in IJCAI 2025.
  • 2024-12-21: Co-organizing the FGVC12 workshop at CVPR 2025.
  • 2024-12-10: One paper is accepted by AAAI 2025. Congrats to Peng Wu !
  • 2024-09-02: One paper is accepted by IEEE TIP. Congrats to Hongbo Sun!
  • 2024-08-25: One paper is accepted by ACM TOMM. Congrats to Zhaoda Ye!
  • 2024-04-17: One paper is accepted by IJCAI 2024. Congrats to Hongbo Sun!
  • 2024-04-12: One paper is accepted by ACM TOMM. Congrats to Ruoyan Pi!
  • 2024-02-21: One paper is accepted by IEEE TIP. Congrats to Peng Wu !
  • 2024-01-17: Very honored to win MIR Outstanding Reviewer Award in 2023.
  • 2023-12-25: Very honored to receive the Academic Innovation Award from Tencent WeChat (腾讯微信犀牛鸟专项研究计划学术创新奖).
  • 2023-12-24: Co-organizing the FGVC11 workshop at CVPR 2024.
  • 2023-12-09: One papers is accepted by AAAI 2024. Congrats to Yanzhe Chen!
  • 2023-12-01: One papers is accepted by ICDE 2024. Congrats to Hulingxiao He!
  • 2023-10-16: One papers is accepted by IEEE TMM 2023. Congrats to Hongbo Sun!
  • 2023-07-26: Four papers are accepted by ACM MM 2023. Congrats to Hongbo Sun, Zijun Deng, and Yanzhe Chen!
  • 2023-07-14: One paper is accepted by ICCV 2023. Congrats to Yulin Pan!
  • 2023-03-07: One paper is accepted by ACM TOMM. Congrats to Zijun Deng!
  • 2023-02-28: One paper is accepted by CVPR 2023. Congrats to HsiaoYuan Hsu!
  • 2023-01-10: Co-organizing the FGVC10 workshop at CVPR 2023.
  • 2023-01-03: One paper is accepted by ACM TOMM. Congrats to Duoduo Feng!
  • 2022-11-29: Invited to serve as Area Chair in ICME 2023.
  • 2022-10-25: Awarded Young Elite Scientists Sponsorship Program by CAST（中国科协青年人才托举工程项目）.
  • 2022-07-20: I give a talk “Fine-grained Cross-media Categorization and Retrieval” at ChinaMM 2022 .
  • 2022-07-08: One paper is accepted by Chinese Journal of Electronics (《电子学报》英文版). Congrats to Zhaoda Ye!
  • 2022-07-01: One paper is accepted by ACM MM 2022. Congrats to Hongbo Sun!
  • 2022-03-31: One paper is accepted by ACM SIGIR 2022.
  • 2022-01-05: Co-organizing the FGVC9 workshop at CVPR 2022.

    • Selected Publications

    2025

    1. Peng Wu, Wanshun Su, Xiangteng He, Peng Wang, Yanning Zhang, "VarCMP: Adapting Cross-Modal Pre-Training Models for Video Anomaly Retrieval", AAAI Conference on Artificial Intelligence (AAAI), Philadelphia, Pennsylvania, USA, February 25 – March 4, 2025. (Accept)

    2. Zhaoda Ye, Xiangteng He and Yuxin Peng, "RaT2IGen: Relation-aware Text-to-image Generation via Learnable Prompt", ACM Transactions on Multimedia Computing, Communications and Applications (TOMM), 2025. (Accept)

    2024

    1. Hongbo Sun, Xiangteng He, Jinglin Xu, Yuxin Peng, "SIM-OFE: Structure Information Mining and Object-aware Feature Enhancement for Fine-Grained Visual Categorization", IEEE Transactions on Image Processing (TIP), Vol. 33, pp. 5312-5326, Sep. 2024. [PDF]

    2. Hongbo Sun, Jiahuan Zhou, Xiangteng He, Jinglin Xu and Yuxin Peng, "FineFMPL: Fine-grained Feature Mining Prompt Learning for Few-Shot Class Incremental Learning", International Joint Conference on Artificial Intelligence (IJCAI), pp. 1299-1307, Jeju, South Korea, August 3-9, 2024. [PDF] [Code]

    3. Ruoyan Pi, Peng Wu, Xiangteng He*, Yuxin Peng, "EOGT: Video Anomaly Detection with Enhanced Object Information and Global Temporal Dependency", ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 20, No. 10, pp. 1-21, Sep. 2024. [PDF]

    4. Hulingxiao He, Xiangteng He*, Yuxin Peng, Zifei Shan, Xin Su, "Firzen: Firing Strict Cold-Start Items with Frozen Heterogeneous and Homogeneous Graphs for Recommendation", IEEE International Conference on Data Engineering (ICDE), pp. 4657-4670, Utrecht, Netherlands, May 13 - 16th, 2024. [PDF] [Code] [Introduction]

    5. Peng Wu, Jing Liu, Xiangteng He, Yuxin Peng, Peng Wang, Yanning Zhang, "Toward Video Anomaly Retrieval From Video Anomaly Detection: New Benchmarks and Model", IEEE Transactions on Image Processing (TIP), Vol. 33, pp. 2213-2225, Mar. 2024. [PDF] [Datasets]

    6. Hongbo Sun, Xiangteng He, Yuxin Peng, "HCL: Hierarchical Consistency Learning for Webly Supervised Fine-Grained Recognition", IEEE Transactions on Multimedia (TMM), Vol.26, pp. 5108-5119, Mar. 2024. [PDF] [Code] [Introduction]

    7. Yanzhe Chen, Huasong Zhong, Xiangteng He, Yuxin Peng, Jiahuan Zhou, Lele Cheng, "FashionERN: Enhance-and-Refine Network for Composed Fashion Image Retrieval", AAAI Conference on Artificial Intelligence (AAAI), Vol. 38, No. 2, pp. 1228-1236, Vancouver, Canada, February 20 - 27, 2024. [PDF]

    2023

    1. Hongbo Sun, Xiangteng He, Jiahuan Zhou, Yuxin Peng, "Fine-Grained Visual Prompt Learning of Vision-Language Models for Image Recognition", ACM Multimedia Conference (ACM MM), pp. 5828–5836, Ottawa, Canada, Oct.29 - Nov.3, 2023. [PDF] [Introduction]

    2. Yanzhe Chen, Huasong Zhong, Xiangteng He, Yuxin Peng, Lele Cheng, "Real20M: A Large-scale E-commerce Dataset for Cross-domain Retrieval", ACM Multimedia Conference (ACM MM), pp. 4939–4948, Ottawa, Canada, Oct.29 - Nov.3, 2023. [PDF] [Introduction]

    3. Zijun Deng, Xiangteng He, Yuxin Peng, Xiongwei Zhu, Lele Cheng, "MV-Diffusion: Motion-aware Video Diffusion Model", ACM Multimedia Conference (ACM MM), pp. 7255-7263, Ottawa, Canada, Oct.29 - Nov.3, 2023. [PDF] [Introduction]

    4. Zijun Deng, Xiangteng He, Yuxin Peng, "Efficiency-optimized Video Diffusion Models", ACM Multimedia Conference (ACM MM), pp. 7295-7303, Ottawa, Canada, Oct.29 - Nov.3, 2023. [PDF] [Introduction]

    5. Yulin Pan, Xiangteng He*, Biao Gong, Yiliang Lv, Yujun Shen, Yuxin Peng, Deli Zhao*, "Scanning Only Once: An End-to-end Framework for Fast Temporal Grounding in Long Videos", International Conference of Computer Vision (ICCV), pp. 13767-13777, Paris, France, Oct. 2-6, 2023. [PDF] [SUPP] [Code]

    6. Zijun Deng, Xiangteng He, Yuxin Peng, "LFR-GAN: Local Feature Refinement based Generative Adversarial Network for Text-to-Image Generation", ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 19, No. 6, pp. 1-18, Jul. 2023. [PDF] [Code] [Introduction]

    7. HsiaoYuan Hsu, Xiangteng He, Yuxin Peng, Hao Kong, Qing Zhang, "PosterLayout: A New Benchmark and Approach for Content-Aware Visual-Textual Presentation Layout", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6018-6026, Vancouver, Canada, Jun. 18-22, 2023. [PDF] [Code] [Dataset] [Introduction]

    8. Duoduo Feng, Xiangteng He, Yuxin Peng, "MKVSE: Multimodal Knowledge Enhanced Visual-Semantic Embedding for Image-Text Retrieval", ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 19, No. 5, pp. 1–21, Mar. 2023. [PDF] [Code] [Introduction]

    2022

    1. Hongbo Sun, Xiangteng He, Yuxin Peng, "SIM-Trans: Structure Information Modeling Transformer for Fine-grained Visual Categorization", ACM Multimedia Conference (ACM MM), pp. 5853–5861, Lisbon, Portugal, Oct. 10-14, 2022. [PDF] [PPT] [Code]

    2. Xiangteng He#, Yulin Pan#, Mingqian Tang, Yiliang Lv, Yuxin Peng, "Learn from Unlabeled Videos for Near-duplicate Video Retrieval", ACM SIGIR Conference on Research and Development in Information Retrieval (ACM SIGIR), pp. 1002-1011, Madrid, Spain, Jul. 11-15, 2022. [PDF] [PPT] [Introduction]

    2021

    1. Peng Wu, Xiangteng He*, Mingqian Tang, Yiliang Lv, Jing Liu*, "HANet: Hierarchical Alignment Networks for Video-Text Retrieval", ACM Multimedia Conference (ACM MM), pp. 3518–3527, Chengdu, China, Oct. 20-24, 2021. [PDF] [Code]

    2. Zhen Han, Xiangteng He*, Mingqian Tang, Yiliang Lv, "Video Similarity and Alignment Learning on Partial Video Copy Detection", ACM Multimedia Conference (ACM MM), pp. 4165–4173, Chengdu, China, Oct. 20-24, 2021. [PDF] [Project]

    2020

    1. Xiangteng He, Yuxin Peng, "Fine-grained Visual-textual Representation Learning", IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 30, No. 2, pp. 520-531, Feb. 2020. [PDF]

    2019

    1. Xiangteng He, Yuxin Peng, Liu Xie, "A New Benchmark and Approach for Fine-grained Cross-media Retrieval", ACM Multimedia Conference (ACM MM), pp. 1740-1748, Nice, France, Oct. 21-25, 2019. [PDF] [Dataset] [Code] [Introduction]

    2. Xiangteng He, Yuxin Peng, Junjie Zhao, "Which and How Many Regions to Gaze: Focus Discriminative Regions for Fine-grained Visual Categorization", International Journal of Computer Vision (IJCV), Vol. 127, No. 9, pp. 1235-1255, Sep. 2019. [PDF]

    3. Xiangteng He, Yuxin Peng, Junjie Zhao, "Fast Fine-grained Image Classification via Weakly Supervised Discriminative Localization", IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 29, No. 5, pp. 1394-1407, May. 2019. [PDF] [Code]

    2018

    1. Xiangteng He, Yuxin Peng, "Only Learn One Sample: Fine-Grained Visual Categorization with One Sample Training", ACM Multimedia Conference (ACM MM), pp. 1372-1380, Seoul, Korea, Oct. 22-26, 2018. [PDF]

    2. Xiangteng He, Yuxin Peng, Junjie Zhao, "StackDRL: Stacked Deep Reinforcement Learning for Fine-grained Visual Categorization", International Joint Conference on Artificial Intelligence (IJCAI), pp. 741-747, Stockholm, Sweden, Jul. 13-19, 2018. [PDF]

    3. Yuxin Peng, Xiangteng He, Junjie Zhao, "Object-Part Attention Model for Fine-grained Image Classification", IEEE Transactions on Image Processing (TIP), Vol. 27, No. 3, pp. 1487-1500, Mar. 2018. [PDF] [Code] (This work was the highly cited paper by ESI, which received enough citations to place it in the top 1% of its academic field.)

    2017

    1. Xiangteng He, Yuxin Peng, Junjie Zhao, "Fine-grained Discriminative Localization via Saliency-guided Faster R-CNN", ACM Multimedia Conference (ACM MM), pp. 627-635, Mountain View, CA, USA, Oct. 23-27, 2017. [PDF] [Code]

    2. Xiangteng He, Yuxin Peng, "Fine-grained Image Classification via Combining Vision and Language", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5994-6002, Honolulu, Hawaii, USA, Jul. 21-26, 2017. [PDF]

    3. Xiangteng He, Yuxin Peng, "Weakly Supervised Learning of Part Selection Model with Spatial Constraints for Fine-grained Image Classification", AAAI Conference on Artificial Intelligence (AAAI), pp. 4075-4081, San Francisco, California, USA, Feb. 4–9, 2017. [PDF]

    Honors

  • Academic Innovation Award from Tencent WeChat (腾讯微信犀牛鸟专项研究计划学术创新奖), 2023
  • Young Elite Scientists Sponsorship Program by CAST, 2022.
  • CCF (China Computer Federation) Outstanding Doctoral Dissertation Award (10 in total), 2020.
  • Excellent Doctorate Dissertation Award of Peking University, 2020.
  • Excellent Graduates of Beijing, 2020.
  • Excellent Graduates of Peking University, 2020.
  • Huawei Scholarship, 2019.
  • Baidu Scholarship (6 in China, 10 in total of the world), 2018.
  • National Scholarship (Top 1), 2018.
  • Chancellor's Scholarship of Peking University, 2018.
  • Top 10 Outstanding Academic Students, School of EECS, Peking University, 2018.
  • Huawei Scholarship, 2017.