Hello Colleagues,
Imagine you're shopping for dinner at your favourite grocery store wearing AI glasses. You scan the shelves looking for the right ingredients. You ask, “Which of these pasta is gluten-free?”—and in seconds, your AI assistant provides an accurate answer, cross-referencing product labels and trusted sources. No guesswork. No misinformation. Just reliable, real-time knowledge at your fingertips.
This is the potential of AI-powered wearable devices. But today’s Vision Large Language Models (VLLMs) still struggle with providing accuracy, context, and real-time information. That’s where you come in.
The Meta CRAG-MM Challenge for KDD Cup 2025 is pushing the boundaries of multi-modal, multi-turn Retrieval-Augmented Generation (RAG) for wearable AI. Join the challenge to build AI that sees, understands, and retrieves knowledge—without hallucinating.
Why This Challenge Matters
Despite advances in AI, VLLMs still generate hallucinated answers—especially when handling long-tail knowledge, multi-step reasoning, or real-world images.
The Meta CRAG-MM Benchmark introduces a rigorous test for multi-modal retrieval and reasoning, helping to ensure AI models can accurately process images, retrieve external information, and handle smooth, multi-turn conversations.
What Makes CRAG-MM Unique?
Real-world wearable AI focus – Uses real-world images from Ray-Ban Meta glasses across 14 diverse domains
Multi-modal + Multi-turn challenge – Evaluate AI across single-turn and multi-turn question-answering
Complex question types – Tests reasoning, aggregation, and retrieval beyond simple fact lookup
$33,000 in prizes – Compete for the grand prize and recognition at KDD Cup 2025.
Challenge Timeline
Warm up phase begins March 24, 2025 – Open to all teams
Phase 1 begins Apr 5, 2025 – Open to all teams
Phase 2 begins May 11, 2025 – Top-performing teams advance
Winners announced August 5, 2025 at KDD Cup 2025 in Toronto
Get Started Today!
Register now: https://www.aicrowd.com/challenges/meta-crag-mm-challenge-2025
Join the community: Connect with others on our Community Forum & Discord
Read the rules: https://www.aicrowd.com/challenges/meta-crag-mm-challenge-2025/challenge...
All The Best,
Team AIcrowd
NO PURCHASE NECESSARY TO ENTER/WIN. Open to individuals who are 18 + age of majority and meet the full eligibility requirements in the full Rules. Open 3/17/2025 23:55 UTC through 6/1/2025 23:55 UTC. Void where prohibited. Subject to full Rules at https://www.aicrowd.com/challenges/meta-crag-mm-challenge-2025/challenge.... See Rules for prize details and values. Sponsor: Meta Platforms, Inc. 1 Hacker Way, Menlo Park, California 94025 (for US entrants) or Meta Ireland Limited, 4 Grand Canal Square, Dublin 2, Ireland (for all other entrants).