An benchmark for evaluating the capabilities of large vision-language models (LVLMs)
-
Updated
Nov 17, 2023 - Python
An benchmark for evaluating the capabilities of large vision-language models (LVLMs)
Gemini Pro, your do-it-all AI tool, translates languages, sparks creativity, and answers questions, all while efficiently running on devices from phones to data centers, making it accessible for developers and businesses to unlock AI's potential.
Talk2BEV: Language-Enhanced Bird's Eye View Maps (Accepted to ICRA'24)
[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strategy.
This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
Code and data for the ACL 2024 Findings paper "Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning"
ShareGPT4Omni: Towards Building Omni Large Multi-modal Models with Comprehensive Multi-modal Annotations
Multi-Agent VQA: Exploring Multi-Agent Foundation Models on Zero-Shot Visual Question Answering
✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
Advances in recent large vision language models (LVLMs)
🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
[ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.
The Paper List of Large Multi-Modality Model, Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.
A curated list of recent and past chart understanding work based on our survey paper: From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models.
Curated papers on Large Language Models in Healthcare and Medical domain
Official Repository of Multi-Object Hallucination in Vision-Language Models
Add a description, image, and links to the large-vision-language-models topic page so that developers can more easily learn about it.
To associate your repository with the large-vision-language-models topic, visit your repo's landing page and select "manage topics."