Advanced Agent Evaluation Runner for GAIA Benchmark

Instructions:

  1. Clone this space to your account.
  2. Add HUGGINGFACEHUB_API_TOKEN as a Space Secret under the "Settings" tab of your duplicated Space. This is crucial for the agent to use the Hugging Face Inference API.
  3. Modify the BasicAgent class in app.py to refine its logic, add more tools (like a calculator or file reader), and optimize its prompting to improve GAIA scores.
  4. Log in to your Hugging Face account using the button below. This uses your HF username for submission.
  5. Click 'Run Evaluation & Submit All Answers' to fetch questions, run your agent, submit answers, and see your score.

Disclaimers: The submission process can take time as the agent processes multiple questions. This setup provides a foundational framework; continuous improvement in agent logic and tool integration is key to higher GAIA scores. Consider strategies like answer caching or asynchronous processing for larger benchmarks.

Questions and Agent Answers