Camera Guidance for Vision-Language Models

Right This Way: When a photo can’t answer the question, our models tell blind users how to move the camera. Training on our label-free synthetic data raised open vision-language models by up to 16 points, and the best model beat GPT-4o.

Dates: November 2023 – May 2024

Venue: NeurIPS 2024

Camera Guidance for Vision-Language Models

Resources

People

Alumni