Advanced Agent Evaluation Runner for GAIA Benchmark
Instructions:
- Clone this space to your account.
- Add
HUGGINGFACEHUB_API_TOKENas a Space Secret under the "Settings" tab of your duplicated Space. This is crucial for the agent to use the Hugging Face Inference API. - Modify the
BasicAgentclass inapp.pyto refine its logic, add more tools (like a calculator or file reader), and optimize its prompting to improve GAIA scores. - Log in to your Hugging Face account using the button below. This uses your HF username for submission.
- Click 'Run Evaluation & Submit All Answers' to fetch questions, run your agent, submit answers, and see your score.
Disclaimers: The submission process can take time as the agent processes multiple questions. This setup provides a foundational framework; continuous improvement in agent logic and tool integration is key to higher GAIA scores. Consider strategies like answer caching or asynchronous processing for larger benchmarks.
Questions and Agent Answers