Xiangteng He 何相腾

University of British Columbia (UBC)

Email: xiangteng.he AT ubc.ca

Google Scholar

Biography

I am a Postdoctoral Researcher in the Department of Computer Science at UBC, working with Prof. Leonid Sigal. Previously, I served as an Assistant Research Professor at Peking University. Prior to academia, I spent a wonderful year in Alibaba DAMO Academy as a Senior Algorithm Engineer. I received Ph.D. degree from Peking University, and B.E degree from Nankai University. My research interests include fine-grained multi-modal analysis, vision-language models, and their applications (e.g., medical imaging).

Looking for strong graduate/undergraduate students to collaborate. Please reach out if you are interested.

News

  • 2025-06-25: One paper is accepted by ICCV 2025. Congrats to Yulin Pan!
  • 2025-05-03: Very honored to serve as SPC in ECAI 2025.
  • 2025-01-03: Very honored to serve as SPC in IJCAI 2025.
  • 2024-12-21: Co-organizing the FGVC12 workshop at CVPR 2025.
  • 2024-12-10: One paper is accepted by AAAI 2025. Congrats to Peng Wu !
  • 2024-09-02: One paper is accepted by IEEE TIP. Congrats to Hongbo Sun!
  • 2024-08-25: One paper is accepted by ACM TOMM. Congrats to Zhaoda Ye!
  • 2024-04-17: One paper is accepted by IJCAI 2024. Congrats to Hongbo Sun!
  • 2024-04-12: One paper is accepted by ACM TOMM. Congrats to Ruoyan Pi!
  • 2024-02-21: One paper is accepted by IEEE TIP. Congrats to Peng Wu !
  • 2024-01-17: Very honored to win MIR Outstanding Reviewer Award in 2023.
  • 2023-12-25: Very honored to receive the Academic Innovation Award from Tencent WeChat (腾讯微信犀牛鸟专项研究计划学术创新奖).
  • 2023-12-24: Co-organizing the FGVC11 workshop at CVPR 2024.
  • 2023-12-09: One papers is accepted by AAAI 2024. Congrats to Yanzhe Chen!
  • 2023-12-01: One papers is accepted by ICDE 2024. Congrats to Hulingxiao He!
  • 2023-10-16: One papers is accepted by IEEE TMM 2023. Congrats to Hongbo Sun!
  • 2023-07-26: Four papers are accepted by ACM MM 2023. Congrats to Hongbo Sun, Zijun Deng, and Yanzhe Chen!
  • 2023-07-14: One paper is accepted by ICCV 2023. Congrats to Yulin Pan!
  • 2023-03-07: One paper is accepted by ACM TOMM. Congrats to Zijun Deng!
  • 2023-02-28: One paper is accepted by CVPR 2023. Congrats to HsiaoYuan Hsu!
  • 2023-01-10: Co-organizing the FGVC10 workshop at CVPR 2023.
  • 2023-01-03: One paper is accepted by ACM TOMM. Congrats to Duoduo Feng!
  • 2022-11-29: Invited to serve as Area Chair in ICME 2023.

    • Publications

    2025

    1. Yulin Pan, Xiangteng He*, Chaojie Mao, Zhen Han, Zeyinzi Jiang, Jingfeng Zhang, Yu Liu, "ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editing", International Conference on Computer Vision (ICCV), Honolulu, Hawai'i, USA, October 19 – 23, 2025. [Project] [PDF]

    2. Zhaoda Ye, Xiangteng He, Yuxin Peng, "RaT2IGen: Relation-aware Text-to-image Generation via Learnable Prompt", ACM Transactions on Multimedia Computing, Communications and Applications (TOMM), Vol. 21, Issue 5, Article No. 151, pp. 1 - 19, May 2025. [PDF]

    3. Peng Wu, Wanshun Su, Xiangteng He, Peng Wang, Yanning Zhang, "VarCMP: Adapting Cross-Modal Pre-Training Models for Video Anomaly Retrieval", AAAI Conference on Artificial Intelligence (AAAI), Vol. 39, No. 8, pp. 8423-8431, Philadelphia, Pennsylvania, USA, February 25 – March 4, 2025. [PDF]

    2024

    1. Hongbo Sun, Xiangteng He, Jinglin Xu, Yuxin Peng, "SIM-OFE: Structure Information Mining and Object-aware Feature Enhancement for Fine-Grained Visual Categorization", IEEE Transactions on Image Processing (TIP), Vol. 33, pp. 5312-5326, Sep. 2024. [PDF]

    2. Hongbo Sun, Jiahuan Zhou, Xiangteng He, Jinglin Xu, Yuxin Peng, "FineFMPL: Fine-grained Feature Mining Prompt Learning for Few-Shot Class Incremental Learning", International Joint Conference on Artificial Intelligence (IJCAI), pp. 1299-1307, Jeju, South Korea, August 3-9, 2024. [PDF] [Code]

    3. Ruoyan Pi, Peng Wu, Xiangteng He*, Yuxin Peng, "EOGT: Video Anomaly Detection with Enhanced Object Information and Global Temporal Dependency", ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 20, Issue 10, Article No. 320, pp. 1-21, Sep. 2024. [PDF]

    4. Hulingxiao He, Xiangteng He*, Yuxin Peng, Zifei Shan, Xin Su, "Firzen: Firing Strict Cold-Start Items with Frozen Heterogeneous and Homogeneous Graphs for Recommendation", IEEE International Conference on Data Engineering (ICDE), pp. 4657-4670, Utrecht, Netherlands, May 13 - 16th, 2024. [PDF] [Code] [Introduction]

    5. 邓梓焌, 何相腾, 彭宇新, "文本到视频生成：研究现状、进展和挑战", 电子学报, Vol.46, pp. 1632-1644, May. 2024. [PDF]

    6. Peng Wu, Jing Liu, Xiangteng He, Yuxin Peng, Peng Wang, Yanning Zhang, "Toward Video Anomaly Retrieval From Video Anomaly Detection: New Benchmarks and Model", IEEE Transactions on Image Processing (TIP), Vol. 33, pp. 2213-2225, Mar. 2024. [PDF] [Datasets]

    7. Hongbo Sun, Xiangteng He, Yuxin Peng, "HCL: Hierarchical Consistency Learning for Webly Supervised Fine-Grained Recognition", IEEE Transactions on Multimedia (TMM), Vol.26, pp. 5108-5119, Mar. 2024. [PDF] [Code] [Introduction]

    8. Yanzhe Chen, Huasong Zhong, Xiangteng He, Yuxin Peng, Jiahuan Zhou, Lele Cheng, "FashionERN: Enhance-and-Refine Network for Composed Fashion Image Retrieval", AAAI Conference on Artificial Intelligence (AAAI), Vol. 38, No. 2, pp. 1228-1236, Vancouver, Canada, February 20 - 27, 2024. [PDF] [Code]

    2023

    1. Hongbo Sun, Xiangteng He, Jiahuan Zhou, Yuxin Peng, "Fine-Grained Visual Prompt Learning of Vision-Language Models for Image Recognition", ACM Multimedia Conference (ACM MM), pp. 5828–5836, Ottawa, Canada, Oct.29 - Nov.3, 2023. [PDF] [Introduction]

    2. Yanzhe Chen, Huasong Zhong, Xiangteng He, Yuxin Peng, Lele Cheng, "Real20M: A Large-scale E-commerce Dataset for Cross-domain Retrieval", ACM Multimedia Conference (ACM MM), pp. 4939–4948, Ottawa, Canada, Oct.29 - Nov.3, 2023. [PDF] [Code] [Dataset] [Introduction]

    3. Zijun Deng, Xiangteng He, Yuxin Peng, Xiongwei Zhu, Lele Cheng, "MV-Diffusion: Motion-aware Video Diffusion Model", ACM Multimedia Conference (ACM MM), pp. 7255-7263, Ottawa, Canada, Oct.29 - Nov.3, 2023. [PDF] [Introduction]

    4. Zijun Deng, Xiangteng He, Yuxin Peng, "Efficiency-optimized Video Diffusion Models", ACM Multimedia Conference (ACM MM), pp. 7295-7303, Ottawa, Canada, Oct.29 - Nov.3, 2023. [PDF] [Introduction]

    5. Yulin Pan, Xiangteng He*, Biao Gong, Yiliang Lv, Yujun Shen, Yuxin Peng, Deli Zhao*, "Scanning Only Once: An End-to-end Framework for Fast Temporal Grounding in Long Videos", International Conference of Computer Vision (ICCV), pp. 13767-13777, Paris, France, Oct. 2-6, 2023. [PDF] [SUPP] [Code]

    6. HsiaoYuan Hsu, Xiangteng He, Yuxin Peng, "DensityLayout: Density-conditioned Layout GAN for Visual-textual Presentation Designs", International Conference on Image and Graphics (ICIG), pp. 187–199, Nanjing, China, Sep.22 - 24, 2023. [PDF]

    7. Zijun Deng, Xiangteng He, Yuxin Peng, "LFR-GAN: Local Feature Refinement based Generative Adversarial Network for Text-to-Image Generation", ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 19, Issue 6, Article No. 207, pp. 1-18, Jul. 2023. [PDF] [Code] [Introduction]

    8. HsiaoYuan Hsu, Xiangteng He, Yuxin Peng, Hao Kong, Qing Zhang, "PosterLayout: A New Benchmark and Approach for Content-Aware Visual-Textual Presentation Layout", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6018-6026, Vancouver, Canada, Jun. 18-22, 2023. [PDF] [Code] [Dataset] [Introduction]

    9. Duoduo Feng, Xiangteng He, Yuxin Peng, "MKVSE: Multimodal Knowledge Enhanced Visual-Semantic Embedding for Image-Text Retrieval", ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 19, Issue 5, Article No. 162, pp. 1–21, Mar. 2023. [PDF] [Code] [Introduction]

    2022

    1. Ruoyan Pi, Xiangteng He, Yuxin Peng, "Weakly Supervised Video Anomaly Detection with Temporal and Abnormal Information", Chinese Conference on Pattern Recognition and Computer Vision (PRCV), pp. 594–608, Shenzhen, China, Nov. 4-7, 2022. [PDF]

    2. Hongbo Sun, Xiangteng He, Yuxin Peng, "SIM-Trans: Structure Information Modeling Transformer for Fine-grained Visual Categorization", ACM Multimedia Conference (ACM MM), pp. 5853–5861, Lisbon, Portugal, Oct. 10-14, 2022. [PDF] [PPT] [Code]

    3. Zhaoda Ye, Xiangteng He, Yuxin Peng, "Unsupervised Cross-media Hashing Learning via Knowledge Graph", Chinese Journal of Electronics (CJE), Vol. 31, No. 6, pp. 1081–1091, Oct. 2022. [PDF]

    4. Xiangteng He#, Yulin Pan#, Mingqian Tang, Yiliang Lv, Yuxin Peng, "Learn from Unlabeled Videos for Near-duplicate Video Retrieval", ACM SIGIR Conference on Research and Development in Information Retrieval (ACM SIGIR), pp. 1002-1011, Madrid, Spain, Jul. 11-15, 2022. [PDF] [PPT] [Introduction]

    2021

    1. Peng Wu, Xiangteng He*, Mingqian Tang, Yiliang Lv, Jing Liu*, "HANet: Hierarchical Alignment Networks for Video-Text Retrieval", ACM Multimedia Conference (ACM MM), pp. 3518–3527, Chengdu, China, Oct. 20-24, 2021. [PDF] [Code]

    2. Zhen Han, Xiangteng He*, Mingqian Tang, Yiliang Lv, "Video Similarity and Alignment Learning on Partial Video Copy Detection", ACM Multimedia Conference (ACM MM), pp. 4165–4173, Chengdu, China, Oct. 20-24, 2021. [PDF] [Project]

    2020

    1. Junjie Zhao, Xiangteng He, Yuxin Peng, "Attribute Hierarchy based Multi-task Learning for Fine-grained Image Classification", Neurocomputing, Vol. 395, pp. 150-159, Jun. 2020. [PDF]

    2. Xiangteng He, Yuxin Peng, "Fine-grained Visual-textual Representation Learning", IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 30, No. 2, pp. 520-531, Feb. 2020. [PDF]

    2019

    1. Xiangteng He, Yuxin Peng, Liu Xie, "A New Benchmark and Approach for Fine-grained Cross-media Retrieval", ACM Multimedia Conference (ACM MM), pp. 1740-1748, Nice, France, Oct. 21-25, 2019. [PDF] [Dataset] [Code] [Introduction]

    2. Xiangteng He, Yuxin Peng, Junjie Zhao, "Which and How Many Regions to Gaze: Focus Discriminative Regions for Fine-grained Visual Categorization", International Journal of Computer Vision (IJCV), Vol. 127, No. 9, pp. 1235-1255, Sep. 2019. [PDF]

    3. Xiangteng He, Yuxin Peng, Junjie Zhao, "Fast Fine-grained Image Classification via Weakly Supervised Discriminative Localization", IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 29, No. 5, pp. 1394-1407, May. 2019. [PDF] [Code]

    2018

    1. Xiangteng He, Yuxin Peng, "Multi-attention Guided Activation Propagation in CNNs", Chinese Conference on Pattern Recognition and Computer Vision (PRCV), pp. 16-27, Guangzhou, China, Nov. 23-26, 2018. [PDF]

    2. Xiangteng He, Yuxin Peng, "Only Learn One Sample: Fine-Grained Visual Categorization with One Sample Training", ACM Multimedia Conference (ACM MM), pp. 1372-1380, Seoul, Korea, Oct. 22-26, 2018. [PDF]

    3. Xiangteng He, Yuxin Peng, Junjie Zhao, "StackDRL: Stacked Deep Reinforcement Learning for Fine-grained Visual Categorization", International Joint Conference on Artificial Intelligence (IJCAI), pp. 741-747, Stockholm, Sweden, Jul. 13-19, 2018. [PDF]

    4. Yuxin Peng, Xiangteng He, Junjie Zhao, "Object-Part Attention Model for Fine-grained Image Classification", IEEE Transactions on Image Processing (TIP), Vol. 27, No. 3, pp. 1487-1500, Mar. 2018. [PDF] [Code]

    2017

    1. Xiangteng He, Yuxin Peng, Junjie Zhao, "Fine-grained Discriminative Localization via Saliency-guided Faster R-CNN", ACM Multimedia Conference (ACM MM), pp. 627-635, Mountain View, CA, USA, Oct. 23-27, 2017. [PDF] [Code]

    2. Xiangteng He, Yuxin Peng, "Fine-grained Image Classification via Combining Vision and Language", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5994-6002, Honolulu, Hawaii, USA, Jul. 21-26, 2017. [PDF]

    3. Xiangteng He, Yuxin Peng, "Weakly Supervised Learning of Part Selection Model with Spatial Constraints for Fine-grained Image Classification", AAAI Conference on Artificial Intelligence (AAAI), pp. 4075-4081, San Francisco, California, USA, Feb. 4–9, 2017. [PDF]

    Honors

  • Academic Innovation Award from Tencent WeChat (腾讯微信犀牛鸟专项研究计划学术创新奖), 2023
  • Young Elite Scientists Sponsorship Program by CAST, 2022.
  • CCF (China Computer Federation) Outstanding Doctoral Dissertation Award (10 in total), 2020.
  • Excellent Doctorate Dissertation Award of Peking University, 2020.
  • Excellent Graduates of Beijing, 2020.
  • Excellent Graduates of Peking University, 2020.
  • Baidu Scholarship (6 in China, 10 in total of the world), 2018.
  • National Scholarship (Top 1), 2018.
  • Chancellor's Scholarship of Peking University, 2018.
  • Top 10 Outstanding Academic Students, School of EECS, Peking University, 2018.