jacklanda/SemanticQA
[ACL 2026 Oral] Revisiting a Pain in the Neck: A Semantic Reasoning Benchmark for Language Models
GitHub repository with 9 stars and 1 forks.
Language: Python
Topics: benchmark, reasoning, semantics
[ACL 2026 Oral] Revisiting a Pain in the Neck: A Semantic Reasoning Benchmark for Language Models
GitHub repository with 9 stars and 1 forks.
Language: Python
Topics: benchmark, reasoning, semantics
2026-06-05: 9 stars and 1 forks.
๐ The hardest search benchmark in the wild โ vague, multi-turn, proactive. 200 long-horizon tasks with persona-driven progressive disclosure, scored by verifiable schema-free knowledge-graph evaluation. No vibes, just triplet F1.
GitHub repository with 780 stars and 9 forks.
Trending score: 1.88; stars gained: +102; forks gained: +0.
Language: Python
Topics: agentic-ai, benchmark, llm, proactive-agent, search, search-agent
AMD Strix Halo local LLM guide: direct 100.0 t/s 30B Qwen MoE on Ryzen AI MAX+ 395 / Radeon 8060S. Setup, benchmarks, raw evidence.
GitHub repository with 91 stars and 4 forks.
Trending score: 0.98; stars gained: +7; forks gained: +0.
Language: Python
Topics: amd, benchmark, gfx1151, inference, llama-cpp, llm
ฯ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
GitHub repository with 1,273 stars and 328 forks.
Trending score: 0.92; stars gained: +7; forks gained: +1.
Language: Python
Topics: benchmark, llm, ai, language-model-agent, conversational-agents
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
GitHub repository with 7,061 stars and 784 forks.
Trending score: 0.91; stars gained: +4; forks gained: +1.
Language: Python
Topics: benchmark, chatgpt, evaluation, large-language-model, llama2, llama3
MTEB: Massive Text Embedding Benchmark
GitHub repository with 3,290 stars and 618 forks.
Trending score: 0.84; stars gained: +4; forks gained: +1.
Language: Python
Topics: benchmark, clustering, information-retrieval, sentence-transformers, sts, text-embedding
SpatialBench: Is Your Spatial Foundation Model an All-Round Player?
GitHub repository with 93 stars and 0 forks.
Trending score: 0.74; stars gained: +5; forks gained: +0.
Language: Python
Topics: 3d-reconstruction, spatial-foundation-model, benchmark
The agent that grows with you
GitHub repository with 181,765 stars and 31,185 forks.
Trending score: 5.95; stars gained: +1,867; forks gained: +361.
Language: Python
Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.
GitHub repository with 13,361 stars and 853 forks.
Trending score: 5.69; stars gained: +2,829; forks gained: +175.
Language: Python
Topics: agent, ai, anthropic, compression, context-engineering, context-window
Academic Research Skills for Claude Code: research โ write โ review โ revise โ finalize
GitHub repository with 27,484 stars and 2,256 forks.
Trending score: 5.52; stars gained: +1,079; forks gained: +89.
Language: Python
Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review
GitHub repository with 30,029 stars and 4,231 forks.
Trending score: 4.88; stars gained: +688; forks gained: +114.
Language: Python
Turn any technical book PDF into a Claude Code skill โ ready to study, reference, and use while you work.
GitHub repository with 4,250 stars and 534 forks.
Trending score: 4.88; stars gained: +476; forks gained: +68.
Language: Python
An opinionated list of Python frameworks, libraries, tools, and resources
GitHub repository with 301,371 stars and 28,044 forks.
Trending score: 4.60; stars gained: +518; forks gained: +24.
Language: Python
Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools
MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research ยท ๆต่งๅจ้่ฟ่ก็ๅฎๅๆจกๆๅจ ยท Browser-hosted Android Simulator ยท Verifiable Evaluation ยท Scalable Online RL Training
GitHub repository with 519 stars and 82 forks.
Trending score: 3.00; stars gained: +33; forks gained: +4.
Language: TypeScript
Topics: agent, agents, ai, android, automation, benchmark
๐ The hardest search benchmark in the wild โ vague, multi-turn, proactive. 200 long-horizon tasks with persona-driven progressive disclosure, scored by verifiable schema-free knowledge-graph evaluation. No vibes, just triplet F1.
GitHub repository with 780 stars and 9 forks.
Trending score: 1.88; stars gained: +102; forks gained: +0.
Language: Python
Topics: agentic-ai, benchmark, llm, proactive-agent, search, search-agent
Minecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)
GitHub repository with 244 stars and 17 forks.
Trending score: 1.14; stars gained: +13; forks gained: +0.
Language: TypeScript
Topics: ai, benchmark, llm, nlp, voxel, comparison-benchmarks
AMD Strix Halo local LLM guide: direct 100.0 t/s 30B Qwen MoE on Ryzen AI MAX+ 395 / Radeon 8060S. Setup, benchmarks, raw evidence.
GitHub repository with 91 stars and 4 forks.
Trending score: 0.98; stars gained: +7; forks gained: +0.
Language: Python
Topics: amd, benchmark, gfx1151, inference, llama-cpp, llm
ฯ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
GitHub repository with 1,273 stars and 328 forks.
Trending score: 0.92; stars gained: +7; forks gained: +1.
Language: Python
Topics: benchmark, llm, ai, language-model-agent, conversational-agents
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
GitHub repository with 7,061 stars and 784 forks.
Trending score: 0.91; stars gained: +4; forks gained: +1.
Language: Python
Topics: benchmark, chatgpt, evaluation, large-language-model, llama2, llama3