langchain-ai/langsmith-sdk

LangSmith Client SDK Implementations

GitHub repository with 919 stars and 246 forks.

Language: Python

Topics: evaluation, language-model, observability

Open provider repository

Latest metric snapshot

2026-06-05: 919 stars and 246 forks.

Similar repositories

  1. 1. crimeacs/auto-improve

    GAN-style self-improvement loop for any text artifact: mutate, grade with a SEPARATE model, keep only verified wins (pairwise-judged), revert the rest. The git history is the improvement log.

    GitHub repository with 18 stars and 1 forks.

    Trending score: 0.48; stars gained: +2; forks gained: +0.

    Language: Python

    Topics: ai-agents, developer-tools, evaluation, gan, gemini, generative-ai

  2. 2. meituan-longcat/WBench

    WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation

    GitHub repository with 118 stars and 3 forks.

    Trending score: 0.47; stars gained: +2; forks gained: +0.

    Language: Python

    Topics: evaluation, worldmodel

  3. 3. outsourc-e/bench-loop

    Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.

    GitHub repository with 32 stars and 6 forks.

    Trending score: 0.46; stars gained: +2; forks gained: +0.

    Language: Python

    Topics: agent, benchmark, cli, evaluation, llm, local-llm

  4. 4. karlmehta/trustmodel

    Score any AI for trust — Eval, Monitor, Govern. 10 trust dimensions, one free API key (5 credits / $500).

    GitHub repository with 7 stars and 0 forks.

    Trending score: 0.33; stars gained: +1; forks gained: +0.

    Language: Python

    Topics: ai, ai-safety, compliance, evaluation, fairness, guardrails

  5. 5. strands-agents/evals

    A comprehensive evaluation framework for AI agents and LLM applications.

    GitHub repository with 133 stars and 36 forks.

    Trending score: 0.33; stars gained: +1; forks gained: +0.

    Language: Python

    Topics: agentic, agentic-ai, ai, evaluation, machine-learning, python

  6. 6. arthur-ai/arthur-engine

    Make AI work for Everyone - Monitoring and governing for your AI/ML

    GitHub repository with 82 stars and 10 forks.

    Trending score: 0.24; stars gained: +0; forks gained: +0.

    Language: Python

    Topics: agentic, benchmarking, evaluation, genai, guardrails, llm

Trending in Python

  1. 1. NousResearch/hermes-agent

    The agent that grows with you

    GitHub repository with 182,340 stars and 31,270 forks.

    Trending score: 5.95; stars gained: +1,867; forks gained: +361.

    Language: Python

    Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude

  2. 2. chopratejas/headroom

    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

    GitHub repository with 14,053 stars and 885 forks.

    Trending score: 5.69; stars gained: +2,829; forks gained: +175.

    Language: Python

    Topics: agent, ai, anthropic, compression, context-engineering, context-window

  3. 3. Imbad0202/academic-research-skills

    Academic Research Skills for Claude Code: research → write → review → revise → finalize

    GitHub repository with 27,548 stars and 2,267 forks.

    Trending score: 5.52; stars gained: +1,079; forks gained: +89.

    Language: Python

    Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review

  4. 4. rohitg00/ai-engineering-from-scratch

    Learn it. Build it. Ship it for others.

    GitHub repository with 28,711 stars and 4,695 forks.

    Trending score: 5.32; stars gained: +1,261; forks gained: +238.

    Language: Python

    Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course

  5. 5. vinta/awesome-python

    An opinionated list of Python frameworks, libraries, tools, and resources

    GitHub repository with 301,427 stars and 28,046 forks.

    Trending score: 4.60; stars gained: +518; forks gained: +24.

    Language: Python

    Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools

  6. 6. langchain-ai/langchain

    The agent engineering platform.

    GitHub repository with 138,587 stars and 22,961 forks.

    Trending score: 4.53; stars gained: +171; forks gained: +31.

    Language: Python

    Topics: agents, ai, ai-agents, anthropic, chatgpt, deepagents

Trending topic: evaluation

  1. 1. langwatch/langwatch

    The platform for LLM evaluations and AI agent testing

    GitHub repository with 3,288 stars and 320 forks.

    Trending score: 2.05; stars gained: +6; forks gained: +0.

    Language: TypeScript

    Topics: ai, analytics, datasets, dspy, evaluation, gpt

  2. 2. crimeacs/auto-improve

    GAN-style self-improvement loop for any text artifact: mutate, grade with a SEPARATE model, keep only verified wins (pairwise-judged), revert the rest. The git history is the improvement log.

    GitHub repository with 18 stars and 1 forks.

    Trending score: 0.48; stars gained: +2; forks gained: +0.

    Language: Python

    Topics: ai-agents, developer-tools, evaluation, gan, gemini, generative-ai

  3. 3. meituan-longcat/WBench

    WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation

    GitHub repository with 118 stars and 3 forks.

    Trending score: 0.47; stars gained: +2; forks gained: +0.

    Language: Python

    Topics: evaluation, worldmodel

  4. 4. outsourc-e/bench-loop

    Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.

    GitHub repository with 32 stars and 6 forks.

    Trending score: 0.46; stars gained: +2; forks gained: +0.

    Language: Python

    Topics: agent, benchmark, cli, evaluation, llm, local-llm

  5. 5. karlmehta/trustmodel

    Score any AI for trust — Eval, Monitor, Govern. 10 trust dimensions, one free API key (5 credits / $500).

    GitHub repository with 7 stars and 0 forks.

    Trending score: 0.33; stars gained: +1; forks gained: +0.

    Language: Python

    Topics: ai, ai-safety, compliance, evaluation, fairness, guardrails

  6. 6. strands-agents/evals

    A comprehensive evaluation framework for AI agents and LLM applications.

    GitHub repository with 133 stars and 36 forks.

    Trending score: 0.33; stars gained: +1; forks gained: +0.

    Language: Python

    Topics: agentic, agentic-ai, ai, evaluation, machine-learning, python