Publications

Kaikai An, Shuzheng Si, Helan Hu, Haozhe Zhao, Yuchi Wang, Qingyan Guo, Baobao Chang (2024). [ArXiv] Rethinking Semantic Parsing for Large Language Models: Enhancing LLM Performance with Semantic Hints. Arxiv.

Cite

Runyi Yu, Tianyu He, Ailing Zeng, Yuchi Wang, Junliang Guo, Xu Tan, Chang Liu, Jie Chen, Jiang Bian (2024). [ArXiv] Make Your Actor Talk: Generalizable and High-Fidelity Lip Sync with Motion and Appearance Disentanglement. Arxiv.

PDF Cite Demo Page

Yuchi Wang, Junliang Guo, Jianhong Bai, Runyi Yu, Tianyu He, Xu Tan, Xu Sun, Jiang Bian (2024). [ArXiv] InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation. Arxiv.

PDF Cite Code Demo Page

Yuchi Wang, Shuhuai Ren, Rundong Gao, Linli Yao, Qingyan Guo, Kaikai An, Jianhong Bai, Xu Sun (2024). [NAACL 2024] LaDiC: Are Diffusion Models Really Inferior to Autoregressive Counterparts for Image-to-Text Generation?. NAACL 2024.

PDF Cite Code

Jianhong Bai, Tianyu He, Yuchi Wang, Junliang Guo, Haoji Hu, Zuozhu Liu, Jiang Bian (2024). [ArXiv] UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editing. Arxiv.

PDF Cite Code Demo Page

Liang Chen, Yichi Zhang, Shuhuai Ren, Haozhe Zhao, Zefan Cai, Yuchi Wang, Peiyi Wang, Xiangdi Meng, Tianyu Liu, Baobao Chang (2024). [Findings of ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain. Arxiv.

PDF Cite Code Dataset

Tianyu He, Junliang Guo, Runyi Yu, Yuchi Wang, Jialiang Zhu, Kaikai An, Leyi Li, Xu Tan, Chunyu Wang, Han Hu, HsiangTao Wu, Sheng Zhao, Jiang Bian (2023). [ICLR 2024] GAIA: Zero-shot Talking Avatar Generation. ICLR 2024.

PDF Cite Demo Page (Anonymous version)

Liang Chen, Yichi Zhang, Shuhuai Ren, Haozhe Zhao, Zefan Cai, Yuchi Wang, Peiyi Wang, Tianyu Liu, Baobao Chang (2023). [FMDM@NeurIPS 2023] Towards end-to-end embodied decision making via multi-modal large language model: Explorations with gpt4-vision and beyond. FMDM@NeurIPS 2023.

PDF Cite Code Dataset

Yi Liu, Yuchi Wang, Lei Li, Shicheng Li, Ruihan Bao, Keiko Harimoto, Xu Sun (2023). LLMs as Trustworthy Financial Advisors: Rationalizing Multimodal Stock Movement Prediction with Chain-of-Thought. Arxiv.

Cite