cxcscmu/IdeaTaste
IdeaTaste - A benchmark for research taste: let LLM agents propose research ideas, then check how many of them the research area actually went on to do.
GitHub repository with 32 stars and 3 forks.
Language: Python
Topics: ai-scientists, benchmark, evaluation, evaluation-framework, evaluation-metrics, idea-generation, llm, llm-agents, machine-learning, nlp