Kaihua Tang

About Me

I’m a researcher and applied scientist at Huawei Singapore Research Center. My current work mainly includes Large Vision-Language Model accelerating and development for autonomous vehicles and other smart devices. Before I joined the industry, I received my Ph.D. degree from the School of Computer Science and Engineering at Nanyang Technological University in 2021, advised by Prof. Hanwang Zhang. During my Ph.D., I worked on computer vision, especially vision language tasks and distribution bias problem. I’m also honored to be selected as one of the world’s top 2% scientists based on these research. Prior to the Ph.D. study, I obtained my dual-master degrees in Computer Science from the joint programme of Shanghai Jiao Tong University, advised by Prof. Lizhuang Ma and Waseda University, advised by Prof. Sei-Ichiro Kamata. My B.E. degree is received in Computer Science from the IEEE Pilot Class at Shanghai Jiao Tong University (SJTU) in 2015.

News

[Feb. 2025] I’m writing a Large-(Vision)-Language Model tutorial for chinese researchers and engineers Github Link, Zhihu Link.
[Jan. 2025] I received the Huawei Quality Star Award based on my Vision-Language Model accelerating project.
[Seq. 2024] I was selected as one of the world’s top 2% scientists (7566 out of 399064 in Artificial Intelligence).
[Mar. 2024] I received the Huawei Outstanding New Employee Award 2023 & Future Star Award 2023.
[Oct. 2023] Our developed on-device LLM for smart home terminals was released at the China Mobile Global Partners Conference 2023.
[Sep. 2023] One Paper was accepted to NeurIPS 2023.
[Jul. 2022] We are organizing the 2st Causality in Vision Workshop at ECCV 2022.
[Jul. 2022] I was recognized as an outstanding reviewer (Top 10%) for ICML 2022.
[Jul. 2022] Three Papers (One Oral) were accepted to ECCV 2022.
[Dec. 2021] I passed my Ph.D. thesis defense. Thanks for all the helps in the past 3 years.
[May. 2021] I received the Silver Award in 2021 PREMIA Best Student Paper Award.
[Mar. 2021] I received the 2021 Alibaba Outstanding Interns in Academic Cooperation award.
[Mar. 2021] We organized the 1st Causality in Vision Workshop at CVPR 2021.
[Jan. 2021] Two Papers were accepted to CVPR 2021.

Selected Publications [Google Scholar]

NeurIPS

Generalized logit adjustment: Calibrating fine-tuned models by removing label bias in foundation models

Beier Zhu, Kaihua Tang, Qianru Sun, Hanwang Zhang

Conference on Neural Information Processing Systems (NeurIPS), 2023.

PDF Code

ECCV

Invariant Feature Learning for Generalized Long-Tailed Classification

Kaihua Tang, Mingyuan Tao, Jiaxin Qi, Zhenguang Liu, Hanwang Zhang

European Conference on Computer Vision (ECCV), 2022.

PDF Code Project Page BibTex

ECCV

Identifying Hard Noise in Long-Tailed Sample Distribution

Xuanyu Yi, Kaihua Tang, Xian-Sheng Hua, Joo-Hwee Lim, Hanwang Zhang

European Conference on Computer Vision (ECCV), 2022.

PDF Code BibTex Oral Presentation

ECCV

Class Is Invariant to Context and Vice Versa: On Learning Invariance for Out-Of-Distribution Generalization

Jiaxin Qi, Kaihua Tang, Qianru Sun, Xian-Sheng Hua, Hanwang Zhang

European Conference on Computer Vision (ECCV), 2022.

PDF Code BibTex

CVPR

Distilling Causal Effect of Data in Class-Incremental Learning

Xinting Hu, Kaihua Tang, Chunyan Miao, Xian-Sheng Hua, Hanwang Zhang

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

PDF Code BibTex

CVPR

Counterfactual VQA: A Cause-Effect Look at Language Bias

Yulei Niu, Kaihua Tang, Hanwang Zhang, Zhiwu Lu, Xian-Sheng Hua, Ji-Rong Wen

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

PDF Code BibTex

NeurIPS

Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal Effect

Kaihua Tang, Jianqiang Huang, Hanwang Zhang

Conference on Neural Information Processing Systems (NeurIPS), 2020.

PDF Code BibTex 516 Github Stars • 229 Citations

CVPR

Unbiased Scene Graph Generation from Biased Training

Kaihua Tang, Yulei Niu, Jianqiang Huang, Jiaxin Shi, Hanwang Zhang

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.

PDF Code BibTex Oral Presentation • 836 Github Stars • 257 Citations

CVPR

Learning to Segment the Tail

Xinting Hu, Yi Jiang, Kaihua Tang, Hanwang Zhang, Chunyan Miao, Jingyuan Chen

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.

PDF Code BibTex

CVPR

Learning to Compose Dynamic Tree Structures for Visual Contexts

Kaihua Tang, Hanwang Zhang, Baoyuan Wu, Wenhan Luo, Wei Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.

PDF Code BibTex Best Paper Finalists [45/5160] • Oral Presentation • 280 Citations

CVPR

Auto-Encoding Scene Graphs for Image Captioning

Xu Yang, Kaihua Tang, Hanwang Zhang, Jianfei Cai

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.

PDF Code BibTex Oral Presentation • 556 Citations

Awards

Outstanding Reviewer (Top 10%), ICML, 2022
2021 Alibaba Outstanding Interns in Academic Cooperation, Alibaba Group, 2021
2021 & 2019 PREMIA Best Student Paper Award, 2nd Place, PREMIA, 2021 & 2019
CVPR 2019 Best Paper Finalists, 2019
Honorable Judge Award, The 5th Cloud Programming World Cup, FORUM8 Tokyo, 2017
Waseda Partial Tuition-Waiver Scholarship for International Students (10/300), Waseda University, 2015
IPS special scholarship for international students, Waseda University, 2014
Monbukagakusho Honors Scholarship for International Students, JASSO, 2014
Emerging Talent Award, The 1st Cloud Programming World Cup, FORUM8 Tokyo, 2013

Academic Services

Organizing Committees

1st Causality in Vision Workshop at CVPR 2021

2st Causality in Vision Workshop at ECCV 2022

Talks and Blogs

Invited Talk : To TechBeat, Hosted by TechBeat AI Community, Online Sharing, 2022.10

Invited Talk : To Kuaishou, Recommendation System Group, Beijing, 2021.07

Invited Talk : To Fudan University, Department of CS, Hosted by Asso Prof.Jingjing Chen, Shanghai, 2021.07

Invited Talk : To The Lab for Media Search (LMS), NUS, 2021.06

Invited Talk : To VALSE Webinar (volume 20-29), Hosted by Prof.Meng Yang, Online, 2020.12

Invited Talk : To Causal AI Reading Group, Jointly Hosted by Swarma Club and BAAI Hub, 2020.12

Invited Talk : To Jishi Community, Hosted by Jishi Team, BiliBili, 2020.12

Invited Talk : To Alibaba Group, Hosted by Tianchi Team from Alibaba Cloud, Hangzhou, China, 2020.11

Invited Talk : To Jiantao Jiao's Lab, Hosted by Ph.D. Banghua Zhou, UC Berkeley, 2020.10

Blogs : Sharing Research Experiences at Zhihu, Language: Chinese

Paper Review

CVPR, ECCV, ICCV, WACV, NeurIPS, ICLR, ICML, AAAI, TPAMI

Projects

Scene Graph Benchmark in Pytorch (835 Github Stars)

This project aims to provide a new codebase for Scene Graph Generation (SGG). It is built on top of the well-known maskrcnn-benchmark. Moreover, I included all the exsiting metrics: R@K, mR@K, ngR@K, zR@K, to benchmark the SGG.

Long-Tailed Recognition in Pytorch (516 Github Stars)

This project provides a strong single-stage baseline for Long-Tailed Classification, Detection, and Instance Segmentation (under LVIS dataset). This project can be easily generalized to other tasks with unbalanced datasets.

VQA2.0 Recent Approachs 2018 in Pytorch (273 Github Stars)

An open-source visual question answering (VQA) codebase built on top of the bottom-up-attention-vqa. It integrates several popular VQA papers published in 2018.

Indie Game Development

Out of interest, I independently developed several mobile games on Iphone. They have been downloaded over 10k times on Apple store in half a year.

Experience

Alibaba, DAMO Academy, Research Intern (2019.7 - 2021.11)

Tencent, AI Lab, Research Intern (2018.3 - 2018.6)

Mihoyo, Software Engineer Intern (2017.4 - 2017.12)

Mobile Game Development Using Unity 3D.

Toshiba, Research & Development Intern (2015.8 - 2015.9)

Speech Lab Intern, SJTU (2014.3 - 2014.9)

28th ACM-MM Volunteer, Seattle, USA (2020.10)

Received Volunteer Appreciation Certification in the 2020 ACM Multimedia for joining the organization of online presentation.

YAPM Summer Volunteer, Yunnan Province, China (2014.7 - 2014.8)

Youth Ambassador Program for Minorities (TECC Organization) is determined to help the youth generation of minorities in remote area of China to inherit and protect their cultures.