llm-council

Source

• Source kind: github-repository
• URL: https://github.com/karpathy/llm-council
• Discovery source: https://github.com/karpathy/llm-council
• License: NOASSERTION
• Distribution policy: public-summary-local-archive-only
• Public mirror status: summary-only
• Content hash: 9f8ddb301b126536d1043935efc33a18365072c5e0d6f83ceec70fda96b435cb
• First seen: 2026-05-15
• Last changed: 2026-05-15

Classification

• Primary category: Research automation / agentic science
• Corpus source note: 2026-05-15-karpathy-public-corpus
• Project taxonomy: karpathy-project-taxonomy
• Idea map: karpathy-idea-map
• Topic hub: karpathy-public-work

Summary

LLM Council !$1 The idea of this repo is that instead of asking a question to your favorite LLM provider (e.g. OpenAI GPT 5.1, Google Gemini 3.0 Pro, Anthropic Claude Sonnet 4.5, xAI Grok 4, eg.c), you can group them into your “LLM Council”. This repo is a simple, local web app that essentially looks like ChatGPT except it uses OpenRouter to send your query to multiple LLMs, it then asks them to review and rank each other’s work, and finally a Chairman LLM produces the final response. In a bit more detail, here is what happens when you submit a query: 1. Stage 1: First opinions . The user query is given to all LL…

What This Teaches

• How Karpathy frames autonomous research loops, experiment iteration, and AI-assisted discovery.
• Useful for designing agent workflows that improve through concrete experiments instead of one-off prompting.

Why It Matters

This is high-priority for Vipin because it informs agent workflows, paper digestion, wiki maintenance, and autonomous research loops.

Repository Snapshot

• Full name: karpathy/llm-council
• Default branch: master
• HEAD: 92e1fccb1bdcf1bab7221aa9ed90f9dc72529131
• Stars at crawl: 18787
• Forks at crawl: 3629
• File count: 39
• README path: README.md
• License path: “
• Created: 2025-11-22T23:24:14Z
• Updated: 2026-05-15T21:24:41Z
• Pushed: 2025-11-22T23:35:21Z

Top-Level Structure

• frontend: 24
• [root]: 9
• backend: 6

File Extension Profile

• .css: 7
• .jsx: 7
• .py: 7
• .js: 3
• .md: 3
• .gitignore: 2
• .json: 2
• .svg: 2
• .html: 1
• .jpg: 1
• .lock: 1
• .python-version: 1

Tags / Release-Like Markers

• No git tags found in the shallow local clone.

Sample File Tree

• .gitignore
• .python-version
• backend/__init__.py
• backend/config.py
• backend/council.py
• backend/main.py
• backend/openrouter.py
• backend/storage.py
• CLAUDE.md
• frontend/.gitignore
• frontend/eslint.config.js
• frontend/index.html
• frontend/package.json
• frontend/package-lock.json
• frontend/public/vite.svg
• frontend/README.md
• frontend/src/api.js
• frontend/src/App.css
• frontend/src/App.jsx
• frontend/src/assets/react.svg
• frontend/src/components/ChatInterface.css
• frontend/src/components/ChatInterface.jsx
• frontend/src/components/Sidebar.css
• frontend/src/components/Sidebar.jsx
• frontend/src/components/Stage1.css
• frontend/src/components/Stage1.jsx
• frontend/src/components/Stage2.css
• frontend/src/components/Stage2.jsx
• frontend/src/components/Stage3.css
• frontend/src/components/Stage3.jsx
• frontend/src/index.css
• frontend/src/main.jsx
• frontend/vite.config.js
• header.jpg
• main.py
• pyproject.toml
• README.md
• start.sh
• uv.lock

Public Handling Notes

• EXTRACTED: This page records public metadata and a source-grounded summary.
• INFERRED: Full local preservation, when available, is for private/local use unless a license or explicit source policy makes public redistribution safe.
• Do not treat this page as permission to republish unlicensed source text or code wholesale.