AudioGPT
Paper: AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head GitHub Link Publisher: Arxiv Author Affiliation: Zhejiang University & Peking University & Carn...
MM-LLMs
MiniGPT-4
Paper: MINIGPT-4:ENHANCING VISION-LANGUAGE UNDERSTANDING WITH ADVANCED LARGE LANGUAGE MODELS GitHub Link Publisher: Arxiv Author Affiliation: King Abdullah University of Science and Techno...
MiniGPT-4’s IT
Paper: MINIGPT-4:ENHANCING VISION-LANGUAGE UNDERSTANDING WITH ADVANCED LARGE LANGUAGE MODELS GitHub Link Publisher: Arxiv Author Affiliation: King Abdullah University of Science and Techno...
LLaVA
Paper: Visual Instruction Tuning GitHub Link Publisher: NeurIPS 2023 Author Affiliation: University of Wisconsin–Madison & Microsoft Research & Columbia University Functional Div...
LLaVA’s IT
Paper: Visual Instruction Tuning GitHub Link Publisher: NeurIPS 2023 Author Affiliation: University of Wisconsin–Madison & Microsoft Research & Columbia University Type ...
HuggingGPT
Paper: HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face GitHub Link Publisher: Arxiv Author Affiliation: Zhejiang University & Microsoft Research Asia Functi...
VSR
Paper: Visual Spatial Reasoning Project Link Publisher: TACL Author Affiliation: University of Cambridge
LLaVA-Bench (In-the-Wild)
Paper: Visual Spatial Reasoning Project Link Publisher: TACL Author Affiliation: University of Cambridge
MM-REACT
Paper: MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action GitHub Link Publisher: Arxiv Author Affiliation: Microsoft Azure AI Functional Division Understanding ...
GPT-4
Paper: GPT-4 Technical Report GitHub Link: None Publisher: Arxiv Author Affiliation: OpenAI Functional Division Understanding Generation Design Division ...