Skip to content
All systems operational0 AI providers monitored, polled every 2 minutes
Live status

Last Updated: September 23, 2026

Best Open Source LLMs in 2026

The strongest open-source LLMs in 2026 are Xiaomi's MiMo-V2.6-Pro (September 21, 2026, MIT, and the top open-weights score on the independent Artificial Analysis Intelligence Index at 46), DeepSeek V4.1 Flash (September 2026, a 552B backbone with only 8B active per token in prefill, MIT, and ahead of DeepSeek's own V4 Pro on most agentic coding benchmarks), Moonshot's Kimi K3 (the largest open-weight model published, at 2.8T total parameters with 104B active), DeepSeek V4 Pro and Z.ai's GLM-5.3-Flash (near-frontier quality under plain MIT terms), and Qwen3.8-27B and Meta's Muse Glimmer 30B (two of the most capable models that fit on a single GPU). Most can be run locally with tools like Ollama, vLLM, or Hugging Face Transformers, given enough hardware.

The gap between open source and proprietary language models has narrowed dramatically. Models you can download and run yourself now compete with (and in some cases surpass) the APIs you pay for. This guide covers the best open source LLMs available right now, including how they compare, what licenses they use, and how to actually run them.

Comparison Table

ModelParametersContextLicenseArchitecture
MiMo-V2.6-Pro1.02T total1,048,576 tokensMITMixture of Experts (MoE), natively omnimodal with text, image, video, and audio input
Ternary Bonsai 2 27B27.36B262K tokensApache 2.0Qwen3.8 27B architecture unchanged, ternary weights with FP16 group scaling and a blockwise Hadamard rotation
Atria Dawn Preview744B total256K tokensMITMixture of Experts (MoE) built on the GLM-5.2 foundation, FP8 weights
GLM-5.3 Flash320B total1M tokensMITMixture of Experts (MoE), hybrid linear plus sparse attention (IndexPool, mHC)
Qwen3.8-Flash-Next125B total262K native, extensible to 1M with YaRNqwen-community-1.0Mixture of Experts (MoE) with Gated DeltaNet, Qwen Sparse Attention, and n-gram embedding
Kimi K32.8T total1M tokensKimi K3 LicenseMixture of Experts (MoE), native MXFP4
Laguna S 2.1118B total1M tokensOpenMDW-1.1Mixture of Experts (MoE)
Muse Glimmer 30B29.6B dense131,072 tokensApache 2.0Dense Causal Transformer with Perception Encoder
Llama 4 Scout109B total10M tokensLlama 4 Community LicenseMixture of Experts (MoE)
Llama 4 Maverick400B total1M tokensLlama 4 Community LicenseMixture of Experts (MoE)
DeepSeek V4.1 Flash552B backbone1,048,576 tokensMITMixture of Experts (MoE) with a Causal Encoder-Decoder (CED) layout
DeepSeek V4 Pro1.6T total1M tokensMITMixture of Experts (MoE) with Hybrid Attention
DeepSeek V4 Flash284B total1M tokensMITMixture of Experts (MoE) with Hybrid Attention
MiniMax M3428B total1M tokensMiniMax Community LicenseMixture of Experts (MoE) with MiniMax Sparse Attention
LongCat-2.01.6T total1M tokens (native)MITMixture of Experts (MoE) with dynamic activation
Mistral Large 3675B total256K tokensApache 2.0Granular Mixture of Experts (MoE) with a 2.5B vision encoder
Mistral Small 4119B total256K tokensApache 2.0Mixture of Experts (MoE), 128 experts with 4 active
Qwen3.8-27B27.78B dense262K tokensApache 2.0Dense Transformer, native vision-language
Phi-414B16K tokensMITDense Transformer
Gemma 431B dense256K tokens (128K on E2B and E4B)Apache 2.0Dense and Mixture of Experts variants, hybrid local and global attention
Command A+218B total128K input / 64K max generationApache 2.0Mixture of Experts (MoE)
Command R+104B128K tokensCC-BY-NC (non-commercial); commercial license availableDense Transformer

Detailed Model Reviews

MiMo-V2.6-Pro

Xiaomi

1.02T total (42B active per token; the MiMo-V2.6-Flash sibling is 309B total with 15B active) | 1,048,576 tokens context | Mixture of Experts (MoE), natively omnimodal with text, image, video, and audio input | MIT | Released: September 2026

Highlights

  • +Top open-weights score on the Artificial Analysis Intelligence Index at 46, level with Grok 4.7 (independent)
  • +Vals Index 59.47 percent for Pro and 59.58 for Flash, both ahead of DeepSeek V4.1 Flash at 57.86 (independent)
  • +DeepSWE v1.1 at 71.9 and Terminal-Bench 2.1 at 89.9, with Flash at 67.9 and 87.6 (vendor-reported)
  • +Text, image, video, and audio input in one model, with up to 131,072 output tokens
  • +API at $0.435/$0.87 per 1M tokens with cached input at $0.0036; Flash is $0.14/$0.28, both unchanged from V2.5
  • +MIT weights on Hugging Face as XiaomiMiMo/MiMo-V2.6-Pro-RL and XiaomiMiMo/MiMo-V2.6-Flash-RL

Best For

The highest-scoring open-weight model on the Artificial Analysis Intelligence Index as of late September 2026, and the pick for omnimodal agents that read video and audio in the same run under plain MIT terms. MiMo-V2.6-Flash, released the same day, scores fractionally higher on the Vals Index (59.58 against 59.47) at about a third of the Pro rate, so test Flash first if cost or cluster size matters.

Considerations

The long-horizon terminal gap to the closed frontier is still visible: Terminal-Bench 4.0 sits at 34.9 for Pro and 28.8 for Flash, against 66.4 for Claude Opus 5.5 on Anthropic's table (all vendor-reported). Xiaomi's 82.0 computer-use figure is on OSWorld-Verified, a different task set from OSWorld 2.0, so do not compare it with OSWorld 2.0 numbers elsewhere on this page. At 1.02T total parameters the Pro model is a cluster deployment rather than a workstation one, so most teams will meet it through Xiaomi's API or a host. A Pro-UltraSpeed tier serves the same model faster at ten times the Pro price.

Ternary Bonsai 2 27B

PrismML

27.36B (24.35B language backbone, 2.54B embeddings and LM head, 0.47B vision tower) | 262K tokens context | Qwen3.8 27B architecture unchanged, ternary weights with FP16 group scaling and a blockwise Hadamard rotation | Apache 2.0 | Released: September 2026

Highlights

  • +A 5.93 GB file against 53.80 GB in FP16, about 9.1x smaller, running on a 16 GB laptop or one 24 GB GPU
  • +Every weight is -1, 0, or +1 with one FP16 scale per group of 128, landing at 1.76 effective bits per weight
  • +Retains 98.2 percent of the parent model average across 20 benchmarks, 83.9 against 85.4 (vendor-reported)
  • +Beats an IQ2_XXS build of the same model by a wide margin: AIME26 95.83 against 78.6, LiveCodeBench v6 90.07 against 70.05
  • +142.5 tokens per second on an RTX 5090 and 46.8 on an M5 Max at batch size 1

Best For

Running a genuinely capable multimodal 27B on hardware you already own. This is the clearest local-inference release of the month, and the Apache 2.0 license plus GGUF and MLX builds mean there is no gate between reading about it and running it.

Considerations

The 98.2 percent is an average and the losses are not evenly spread. Long-horizon agent work is where the compression bites: Terminal-Bench 2.1 drops to 52.8 from 69.7 and SWE-bench Verified to 60.8 from 80.6, roughly 75 percent retention, and both sit outside the 20-benchmark average. Knowledge and reasoning retains 96.9 percent and vision 96.3. Stock llama.cpp cannot load PTQ1_0 or PQ2_0, so you need PrismML's fork or its MLX runtime, and low reasoning effort is not supported. Every figure is PrismML's own and has not been independently reproduced.

Atria Dawn Preview

Shanghai AI Laboratory

744B total (Mixture of Experts) | 256K tokens context | Mixture of Experts (MoE) built on the GLM-5.2 foundation, FP8 weights | MIT | Released: September 2026

Highlights

  • +MIT weights on a 744B agentic model, one of the most permissive licenses at that scale
  • +Built for long-horizon research agents: continuous environmental understanding, tool use, and multistep completion
  • +Targets carrying scientific work from a paper to executable experiments, reproducible metrics, and an inspectable report
  • +Published on Hugging Face and ModelScope with no blog post and no paper on release day
  • +The technical report followed on arXiv three days later with more than 140 authors

Best For

Research groups building autonomous experiment loops who need the weights rather than an endpoint, and anyone studying how a large agentic MoE is trained, since the report is unusually detailed for a Chinese lab release.

Considerations

Preview is in the name. There was no independent evaluation at launch and the lab published evaluation results on its own site rather than through a third party. At 744B parameters in FP8 this is not laptop hardware: it is a cluster model, so most people will meet it through a host rather than self-hosting. The GLM-5.2 foundation also means its lineage traces back to Z.ai, one of six labs named in the September 8, 2026 joint CISA, NSA, and FBI distillation advisory, which is a procurement question rather than a technical one.

GLM-5.3 Flash

Z.ai (Zhipu AI)

320B total (roughly 18B active per token, 45 layers) | 1M tokens context | Mixture of Experts (MoE), hybrid linear plus sparse attention (IndexPool, mHC) | MIT | Released: August 2026

Highlights

  • +First natively multimodal GLM-5: text, image, and video in one stack rather than a bolted-on vision head
  • +Plain MIT weights on Hugging Face at zai-org/GLM-5.3-Flash, published on release day
  • +DeepSWE 63.4 against GLM-5.2 at 46.2 and AutomationBench 48.8 against 26.2 (vendor-reported)
  • +Roughly 3.0x less attention compute and a 4.4x smaller KV cache than text GLM-5.3
  • +List pricing of $0.15 input and $0.50 output per 1M tokens, about a tenth of GLM-5.3 on input

Best For

Multimodal coding and computer-use loops at flash pricing, and any team that wants a capable vision-language agent on unambiguous MIT terms at 18B active parameters.

Considerations

Every published score is self-reported by Z.ai on the launch post, with no independent run yet. The 50 percent launch promotion ended on September 9, 2026, so the $0.15/$0.50 list rate is the number to budget. Thinking cannot be disabled, since thinking.type accepts enabled only, which means short prompts still pay reasoning tokens. And do not confuse it with text-only GLM-5.3, a different 753B model at $1.40/$4.40. BabyVision at 53.4 trails Gemini 3.7 Flash at 70.9, which is the clearest published weakness.

Qwen3.8-Flash-Next

Alibaba

125B total (6B active per token) plus a 51B n-gram embedding table and a 4B MTP layer | 262K native, extensible to 1M with YaRN context | Mixture of Experts (MoE) with Gated DeltaNet, Qwen Sparse Attention, and n-gram embedding | qwen-community-1.0 | Released: August 2026

Highlights

  • +Only 6B parameters activated per token, among the lowest active counts of any capable open model this year
  • +The 51B n-gram table indexes 20 million bigrams and trigrams and can sit in system RAM instead of GPU memory
  • +Explicit preview of the architecture that will underpin Qwen4
  • +DeepSWE 1.1 at 58.7 and SWE-bench Pro at 62.5, ahead of DeepSeek-V4-Flash-0731 at 54.4 and 56.0 (vendor-reported)
  • +Alibaba claims it beats the 397B Qwen3.7-Plus at roughly one ninth the training cost

Best For

Self-hosting shops that want a multimodal agent with a very low active-parameter count, and teams that want an early read on the Qwen4 architecture before the full release.

Considerations

This is labeled experimental and Alibaba says so. The license is a custom qwen-community-1.0, not the plain Apache 2.0 that covers Qwen3.8-27B, so read it before commercial deployment. All benchmark figures are self-reported on the Hugging Face card, NL2Repo-Bench regresses to 48.1 against DeepSeek at 54.2, and OSWorld 2.0 sits at 19.4, still close to a coin flip on full task success. It is also easy to confuse with the hosted Qwen3.8-Flash on QwenCloud, which is a different product at $0.16/$0.47 with a 1M default window.

Kimi K3

Moonshot AI

2.8T total (104B active per token, 896 experts, 16 routed plus 2 shared) | 1M tokens context | Mixture of Experts (MoE), native MXFP4 | Kimi K3 License | Released: July 2026

Highlights

  • +Largest open-weight model ever shipped at 2.8 trillion parameters
  • +Strongest open-weight GPQA Diamond result on record at 93.5 percent (vendor-reported)
  • +Scored 1,679 points on Frontend Code Arena, ahead of Claude Fable 5
  • +Native vision alongside text, with a 1M token context window
  • +API pricing at $3.00 input (or $0.30 on a cache hit) and $15.00 output per 1M tokens

Best For

Teams that want the closest open-weight model to the proprietary frontier for general knowledge work, science reasoning, and visual tasks, and are content to reach it through a hosted API.

Considerations

Open weights and self-hostable are two different claims here. K3 ships natively in MXFP4 with no FP16 checkpoint, and even at 4-bit it needs roughly 1,450GB of accelerator memory before the KV cache, so it wants eight B200-class cards. Most usage routes through hosted inference, and calls to Moonshot's own API are processed under Chinese jurisdiction. Moonshot is also the subject of a July 2026 US government distillation and export-control accusation that remains contested.

Laguna S 2.1

poolside

118B total (roughly 8B active per token) | 1M tokens context | Mixture of Experts (MoE) | OpenMDW-1.1 | Released: July 2026

Highlights

  • +Only about 8B active parameters, so a small team can genuinely self-host it
  • +70.2 percent on Terminal-Bench 2.1 in thinking mode and 78.5 percent on SWE-Bench Multilingual
  • +Weights on Hugging Face day one, no waitlist and no delayed drop
  • +Hosted pricing of $0.10 input and $0.20 output per 1M tokens, among the cheapest anywhere
  • +poolside published every unedited benchmark trajectory and disclosed its own harness

Best For

Cost-sensitive agentic coding at volume, terminal and shell automation, and any team that actually intends to run the weights rather than call someone else's endpoint.

Considerations

This is a coding specialist, not a general assistant: text and code only, no vision. The headline Terminal-Bench number comes from poolside's own harness, which the company disclosed openly, but it still has not been reproduced by an independent party. As poolside's first major public model it has no production track record yet.

Muse Glimmer 30B

Meta

29.6B dense (including a 1.8B vision encoder) | 131,072 tokens context | Dense Causal Transformer with Perception Encoder | Apache 2.0 | Released: August 2026

Highlights

  • +Plain Apache 2.0, with none of the scale-based carve-outs in the Llama 4 Community License
  • +Distilled from Muse Spark and built for agents that run locally without cloud access
  • +76.0 on SWE-Bench Verified, 51.2 on SWE-Bench Pro, and 83.5 on GPQA Diamond at high reasoning (Meta-reported)
  • +Text and image input, so agents can read screenshots, charts, and documents
  • +Meta says 4-bit weights shrink the language model under 20 GB, fitting a 24 GB or 32 GB card with room for the KV cache

Best For

Always-on local agents and private multimodal workflows on a single GPU. It is the most capable open-weight model Meta has published, and the natural upgrade for teams running Llama 4 today.

Considerations

All scores come from Meta's own model card. The 131K context window is short next to the 1M windows elsewhere on this list, so it suits long-running loops better than whole-repository passes. The weights live under the meta-models organization on Hugging Face rather than meta-llama, which matters if you script downloads. Meta's larger Muse Spark models are sold through a paid API and have not been released as open weights.

Llama 4 Scout

Meta

109B total (17B active per token, 16 experts) | 10M tokens context | Mixture of Experts (MoE) | Llama 4 Community License | Released: April 2025

Highlights

  • +Enormous 10M token context window
  • +Competitive with GPT-4o on many benchmarks
  • +Efficient MoE architecture keeps inference costs low
  • +Supports 12 languages natively
  • +Multimodal: handles text and images

Best For

Long-context applications, multilingual tasks, and general-purpose use where you need a strong all-around model with exceptional context length.

Considerations

The Llama 4 Community License is permissive for most uses but has restrictions for very large-scale commercial deployments (700M+ monthly active users). The 10M context window requires significant memory.

Llama 4 Maverick

Meta

400B total (17B active per token, 128 experts) | 1M tokens context | Mixture of Experts (MoE) | Llama 4 Community License | Released: April 2025

Highlights

  • +Meta's largest open-weight model by total parameters
  • +Native 1M token context window
  • +Good for complex multi-step tasks
  • +Multimodal with strong image understanding

Best For

Teams already standardized on the Llama ecosystem that want a large multimodal MoE with a 1M context window.

Considerations

Requires significant hardware to run (multi-GPU setup). Same license restrictions as Scout. It has aged quickly: our benchmark data shows 24.0 on SWE-bench Verified, against 76.0 for Meta's own Muse Glimmer 30B, so newer open models are the better pick for agentic coding.

DeepSeek V4.1 Flash

DeepSeek

552B backbone (8B active per token in prefill, 16B in decode) | 1,048,576 tokens context | Mixture of Experts (MoE) with a Causal Encoder-Decoder (CED) layout | MIT | Released: September 2026

Highlights

  • +DeepSeek's own comparison puts it ahead of V4 Pro on most agentic and coding rows, though V4 Pro keeps the higher GPQA Diamond score (92.4 to 90.9)
  • +GPQA Diamond 90.9, Terminal-Bench 2.1 at 90.6, DeepSWE v1.1 at 74.2 (all vendor-reported)
  • +Causal Encoder-Decoder design activates only 8B parameters per token during prefill
  • +Native multimodal vision in a 552B open-weight model
  • +MIT license with weights on Hugging Face
  • +API at $0.30/$1.20 per 1M peak, halving to $0.15/$0.60 off-peak

Best For

The strongest open-weight release of September 2026 and the clearest case that the cheap tier has caught the flagship tier. At 8B active parameters in prefill it is far more deployable than V4 Pro or Kimi K3, and DeepSeek's own table shows it beating the 1.6T V4 Pro on Terminal-Bench 2.1, DeepSWE, and CyberGym. Best pick for agentic coding and terminal work on MIT terms.

Considerations

Every headline number is vendor-reported with no independent evaluation yet, and the win over V4 Pro is not across the board: V4 Pro still scores higher on GPQA Diamond and Humanity's Last Exam in DeepSeek's own table. On the API it is served as deepseek-flash, which replaced the retired deepseek-v4-flash endpoint. The API price doubles during peak windows (Monday to Friday, 01:00 to 04:00 and 06:00 to 10:00 UTC), so a workload that cannot schedule itself should budget $0.30/$1.20 rather than the off-peak rate. The widely quoted $0.003 figure is the off-peak cache-hit price and applies only to reused context. Self-hosting 552B backbone parameters still needs real infrastructure even at 8B active.

DeepSeek V4 Pro

DeepSeek

1.6T total (49B active per token) | 1M tokens context | Mixture of Experts (MoE) with Hybrid Attention | MIT | Released: April 2026

Highlights

  • +Near-frontier performance: 80.6% on SWE-bench Verified
  • +MIT license allows unrestricted commercial use
  • +Native 1M token context window
  • +Hybrid Attention architecture for better long-context recall
  • +Open weights stay downloadable under MIT; the DeepSeek API retired the model on September 14, 2026 and routes deepseek-v4-pro calls to V4.1 Flash

Best For

The largest MIT-licensed model in the DeepSeek line, and still its top GPQA Diamond scorer. Near-frontier coding and reasoning at a fraction of proprietary pricing, for teams that want unrestricted license freedom, which Kimi K3 and Laguna S 2.1 do not offer.

Considerations

The 1.6T parameter model requires multi-GPU infrastructure to self-host. It is no longer served on DeepSeek's own API: since 04:00 UTC on September 14, 2026, deepseek-v4-pro requests route to V4.1 Flash at V4.1 Flash rates until a V4.1 Pro ships, so hosted access now means a third-party provider. V4.1 Flash is cheaper and ahead on most agentic benchmarks, so check it first.

DeepSeek V4 Flash

DeepSeek

284B total (13B active per token) | 1M tokens context | Mixture of Experts (MoE) with Hybrid Attention | MIT | Released: April 2026

Highlights

  • +Open weights on Hugging Face, including a July 2026 refresh (DeepSeek-V4-Flash-0731)
  • +Native 1M token context window
  • +Strong performance for its active parameter count
  • +MIT license, same as V4 Pro
  • +Efficient enough to run on smaller GPU setups

Best For

Self-hosted, cost-sensitive workloads where you need 1M context on a budget and already have V4 Flash validated in production. Classification, summarization, and batch processing tasks where V4 Pro is overkill.

Considerations

DeepSeek has retired the deepseek-v4-flash API endpoint and routes it to V4.1 Flash, so V4 Flash is no longer available on DeepSeek's own API. V4.1 Flash beats it on nearly every row of DeepSeek's own comparison table, so new projects should start there.

MiniMax M3

MiniMax

428B total (roughly 23B active per token) | 1M tokens context | Mixture of Experts (MoE) with MiniMax Sparse Attention | MiniMax Community License | Released: June 2026

Highlights

  • +MiniMax Sparse Attention cuts per-token compute at 1M context to roughly 1/20th of M2
  • +Claimed 59% on SWE-Bench Pro and 83.5 on BrowseComp
  • +Multimodal input: text, image, and video
  • +API pricing at $0.30/$1.20 per 1M tokens, among the cheapest at this tier
  • +Weights now published on Hugging Face (MiniMaxAI/MiniMax-M3)

Best For

Cost-sensitive agentic coding and browser-agent workloads that need very long context, through the API or on a small cluster now that the weights are downloadable.

Considerations

Launch benchmarks were run on MiniMax infrastructure with agent scaffolding (Claude Code, Mini-SWE-Agent, Terminus), so treat them as unverified until independent results appear. The license is a custom community license, not Apache or MIT: any commercial use requires a prominent "Built with MiniMax M3" notice plus a one-time notice to MiniMax, and products above $20 million in yearly revenue need prior written authorization.

LongCat-2.0

Meituan

1.6T total (33 to 56B active per token, dynamic) | 1M tokens (native) context | Mixture of Experts (MoE) with dynamic activation | MIT | Released: June 2026

Highlights

  • +Fully MIT licensed on GitHub and Hugging Face
  • +Dynamic activation of 33 to 56 billion parameters per token, adjusting to task difficulty
  • +Purpose-built for agentic coding: code understanding, generation, and execution in agent workflows
  • +Self-reported 59.5 on SWE-Bench Pro, ahead of Gemini 3.1 Pro, GPT-5.5, and Claude Opus 4.6 by Meituan's measure
  • +First trillion-parameter release trained end-to-end on a 50,000-card domestic Chinese compute cluster
  • +Pretrained on 30T+ tokens spanning Chinese, English, multilingual, and code data

Best For

Sovereign or geopolitically sensitive deployments where domestic-chip provenance matters, and agentic coding workloads with variable per-token difficulty that benefit from dynamic activation.

Considerations

Launch benchmarks are self-reported; independent verification is still pending. At 1.6T total parameters, self-hosting inference at meaningful throughput requires multi-GPU or multi-node infrastructure. A preview version had been running quietly on OpenRouter and longcat.ai for weeks before the announcement, so hosted access is easier than self-host on day one.

Mistral Large 3

Mistral AI

675B total (41B active per token) | 256K tokens context | Granular Mixture of Experts (MoE) with a 2.5B vision encoder | Apache 2.0 | Released: December 2025

Highlights

  • +Apache 2.0 weights for a frontier-scale European model
  • +Multilingual across dozens of languages, including major European and Asian languages
  • +Image input alongside text
  • +Native function calling and JSON output
  • +Mistral says the FP8 build runs on a single node of B200s or H200s

Best For

European language applications and enterprise use cases where a permissive license and a European vendor both matter. Also strong for tool-using and function-calling applications.

Considerations

At 675B total parameters it needs a full multi-GPU node even in FP8, or an NVFP4 build on a node of H100s or A100s. For lighter deployments, Mistral Small 4 covers much of the same feature set at a fraction of the size.

Mistral Small 4

Mistral AI

119B total (6.5B active per token) | 256K tokens context | Mixture of Experts (MoE), 128 experts with 4 active | Apache 2.0 | Released: March 2026

Highlights

  • +Only 6.5B parameters active per token, so it serves quickly
  • +One model for instruct, reasoning, and coding work, with reasoning effort set per request
  • +Text and image input
  • +Native function calling and JSON output
  • +Apache 2.0 license

Best For

Applications where speed and cost matter more than absolute capability. Great for tool-using agents, classification tasks, and high-throughput workloads.

Considerations

Despite the Small name this is a 119B model, so the full weights need server-class GPU memory even though only 6.5B parameters fire per token. Mistral publishes an NVFP4 checkpoint to cut that footprint.

Qwen3.8-27B

Alibaba

27.78B dense | 262K tokens context | Dense Transformer, native vision-language | Apache 2.0 | Released: August 2026

Highlights

  • +Apache 2.0 with no size or usage carve-outs, unusual at this capability level
  • +Natively multimodal out of the box: text, images, and hour-scale video
  • +Terminal-Bench 2.1 rises from 63.4 to 73.0 against Qwen3.6-27B (vendor-reported)
  • +OSWorld-Verified jumps from 63.9 to 84.3 and DeepSWE 1.1 from 13.3 to 42.2
  • +Fits on a single high-memory card at 4-bit, so one workstation runs it

Best For

The strongest locally deployable multimodal model near 30 billion parameters. Best pick for teams that want vision and video understanding on their own hardware under a permissive license, without the multi-GPU bill that DeepSeek V4 Pro or Kimi K3 demand.

Considerations

Every score above comes from Alibaba's own model card and has not been independently reproduced. It is a dense 27B model, so it will not match 1T-class MoE flagships on hardest-case reasoning. The 262K context window is generous for the size but well short of the 1M windows elsewhere on this list.

Phi-4

Microsoft

14B | 16K tokens context | Dense Transformer | MIT | Released: December 2024

Highlights

  • +Outstanding performance for its small size
  • +Strong math and reasoning capabilities
  • +Runs on consumer hardware (even laptops)
  • +MIT license allows unrestricted use
  • +Trained on high-quality synthetic data

Best For

On-device applications, edge computing, and scenarios where you need good reasoning in a small package. Excellent for math-heavy tasks and as a component in larger systems.

Considerations

Limited context window (16K). Knowledge cutoff may miss recent events. Less capable than larger models for open-ended creative tasks.

Gemma 4

Google DeepMind

31B dense (also E2B, E4B, 12B, and a 26B A4B MoE) | 256K tokens (128K on E2B and E4B) context | Dense and Mixture of Experts variants, hybrid local and global attention | Apache 2.0 | Released: April 2026

Highlights

  • +Apache 2.0, replacing the custom Gemma Terms of Use that covered earlier generations
  • +Five sizes, from on-device E2B up to a 31B dense model
  • +Text and image input on every size, with audio on E2B, E4B, and 12B
  • +84.3 percent on GPQA Diamond for the 31B, against 42.4 for Gemma 3 27B (Google-reported)
  • +The 26B A4B MoE activates about 4B parameters per token and runs almost as fast as a 4B model

Best For

Fine-tuning experiments, mobile and edge applications, and single-GPU deployments. E2B and E4B target phones and laptops, while the 12B, 26B A4B, and 31B fit consumer GPUs and workstations.

Considerations

All benchmark figures come from Google's own model card. The small E2B and E4B models cap context at 128K, and even the 256K ceiling on the larger sizes is well short of the 1M windows elsewhere on this list. The MoE variant is fast, but its memory footprint still reflects all 26B parameters.

Command A+

Cohere

218B total (25B active per token) | 128K input / 64K max generation context | Mixture of Experts (MoE) | Apache 2.0 | Released: May 2026

Highlights

  • +Fully Apache 2.0 licensed (Cohere's first), unrestricted commercial use
  • +Multimodal reasoning: text and image input, native tool use
  • +Runs on a single NVIDIA B200 or two H100s at W4A4 quantization
  • +Lossless quantization across BF16, FP8, and W4A4 on Hugging Face
  • +48 language coverage, with new tokenizer that cuts tokens 16 to 20% in Arabic, Korean, and Japanese
  • +Artificial Analysis Intelligence Index of 37; MMMU 75.1%, MathVista 80.6%

Best For

Enterprises that need sovereign, self-hostable AI with native citations and RAG, plus a permissive license for production. Strong fit for agentic workflows across regulated industries (financial services, healthcare, public sector).

Considerations

Trails the strongest Chinese open MoEs (DeepSeek V4 Pro, GLM, MiniMax) on the broadest general-intelligence benchmarks. Best paired with Cohere's North platform if you want the integrated agentic workspace. API pricing for the hosted version was not published at launch.

Command R+

Cohere

104B | 128K tokens context | Dense Transformer | CC-BY-NC (non-commercial); commercial license available | Released: April 2024

Highlights

  • +Purpose-built for RAG (Retrieval-Augmented Generation)
  • +Excellent at grounding responses in provided documents
  • +Strong citation and attribution capabilities
  • +Good multilingual support (10+ languages)
  • +Reliable tool use and function calling

Best For

RAG applications where you need the model to carefully reference and cite source documents. Enterprise search, knowledge bases, and document Q&A.

Considerations

Superseded by Command A+ in May 2026, which is Apache 2.0 and multimodal. Keep Command R+ in mind only for existing deployments; new projects should default to Command A+.

How to Run LLMs Locally

Running an LLM on your own hardware gives you full control, complete privacy, zero per-request costs, and the ability to customize models to your needs. Here are the main tools for local deployment:

Ollama

The easiest way to run LLMs locally. Ollama provides a simple command-line interface that handles downloading, configuring, and running models. One command to install, one command to run. It supports Mac, Linux, and Windows, and works with most popular open source models.

# Install Ollama, then:

ollama run qwen3.8:27b

ollama run muse-glimmer:30b

ollama run llama4:scout

Best for: Getting started quickly, personal use, development and testing.
Hardware needed: 8GB+ RAM for small models (7B), 16GB+ for medium (14B), 32GB+ for large (70B+).

vLLM

A high-performance inference engine designed for production serving. vLLM uses PagedAttention and other optimizations to achieve much higher throughput than naive implementations. It provides an OpenAI-compatible API, making it a drop-in replacement for proprietary APIs.

pip install vllm

vllm serve Qwen/Qwen3.8-27B

Best for: Production deployments, high-throughput serving, multi-user applications.
Hardware needed: NVIDIA GPU(s) with enough VRAM for the model. A100 or H100 recommended for large models.

llama.cpp

A C/C++ inference engine that runs LLMs on CPUs (and GPUs). It is the foundation that many other tools (including Ollama) build on. llama.cpp is known for its aggressive quantization support, allowing you to run large models on surprisingly modest hardware by reducing precision from 16-bit to 4-bit or even 2-bit.

# Install from llama.app, or build from github.com/ggml-org/llama.cpp, then:

llama cli -hf ggml-org/Qwen3.5-0.8B-GGUF

llama serve -hf ggml-org/Qwen3.5-0.8B-GGUF

Best for: Maximum hardware flexibility, running on CPUs, edge devices, and older hardware.
Hardware needed: Any modern computer. Performance scales with available RAM and CPU/GPU resources.

Hugging Face Transformers

The standard Python library for working with language models. Transformers gives you full control over model loading, inference, fine-tuning, and deployment. It is more code-heavy than the other options but offers maximum flexibility for custom workflows.

Best for: Research, fine-tuning, custom inference pipelines, and integration into Python applications.
Hardware needed: NVIDIA GPU strongly recommended. CPU inference is possible but slow for large models.

Quick recommendation: If you just want to try running a model locally, start with Ollama. It is by far the simplest option. If you need to serve a model in production, use vLLM. If you need to run on a CPU or want maximum quantization options, use llama.cpp.

How to Choose the Right Model

The best model depends entirely on your use case, hardware, and requirements. Here is a decision framework:

If you need the best overall performance

Start with MiMo-V2.6-Pro (MIT, and the top open-weights score on the independent Artificial Analysis Intelligence Index), DeepSeek V4.1 Flash (MIT, and the strongest agentic coding scores DeepSeek has published), or Kimi K3 (the top open-weight GPQA Diamond result on record, at 93.5). If you want the largest MIT-licensed option, DeepSeek V4 Pro is still a strong pick. All four need multi-GPU infrastructure to self-host, and apart from the MiMo-V2.6 index results their headline scores are vendor-reported.

If you need to run on limited hardware

Qwen3.8-27B (Apache 2.0) or Muse Glimmer 30B (Apache 2.0) are your best bets: both are multimodal and fit on a single GPU with 4-bit weights. Gemma 4 12B and Phi-4 (14B) are lighter still, the Gemma 4 26B A4B MoE runs almost as fast as a 4B model, and Gemma 4 E2B and E4B are built for phones and laptops.

If you need long context

Llama 4 Scout still has the largest context window on this list at 10M tokens. A 1M window is now common among newer open models, including MiMo-V2.6-Pro, DeepSeek V4.1 Flash, Kimi K3, Laguna S 2.1, and MiniMax M3, which uses sparse attention to keep 1M-context compute down.

If you need the most permissive license

MIT covers MiMo-V2.6-Pro and Flash, DeepSeek V4.1 Flash, DeepSeek V4 Pro, GLM-5.3-Flash, LongCat-2.0, and Phi-4. Apache 2.0 covers Qwen3.8-27B, Muse Glimmer 30B, Gemma 4, Mistral Large 3, Mistral Small 4, and Command A+. Both allow commercial use without scale thresholds. Llama 4 is permissive for most uses but has a threshold for very large-scale deployments, and Kimi K3 and MiniMax M3 ship under custom licenses you should read first.

If you need strong coding capabilities

DeepSeek V4.1 Flash posts the highest Terminal-Bench 2.1 and DeepSWE scores of any model on this list that publishes them (vendor-reported). Laguna S 2.1 is the dedicated coding specialist that a small team can actually self-host at about 8B active parameters, and GLM-5.3-Flash adds vision for computer-use loops under MIT terms.

If you need RAG and document grounding

Command A+ is Cohere's current RAG-focused open model, with native citations and a plain Apache 2.0 license. It supersedes Command R+, which was built for the same grounding workflows but ships under a non-commercial license for the open weights.

Understanding Licenses

"Open source" means different things depending on who you ask. In the LLM world, models range from fully open (MIT/Apache) to "open weights" with restrictions. Here is a quick guide:

LicenseCommercial UseModificationKey RestrictionModels
MITYesYesNoneMiMo-V2.6-Pro and Flash, DeepSeek V4.1 Flash, DeepSeek V4 Pro, GLM-5.3-Flash, LongCat-2.0, Phi-4
Apache 2.0YesYesNone (must include notice)Qwen3.8-27B, Muse Glimmer 30B, Gemma 4, Mistral Large 3, Mistral Small 4, Command A+
Llama 4 CommunityYes*Yes700M+ MAU requires Meta licenseLlama 4 Scout, Maverick
Custom model licensesVariesVariesRead each one: MiniMax M3, for example, requires attribution and notice for commercial useKimi K3, MiniMax M3, Qwen3.8-Flash-Next
CC-BY-NCNo*YesNon-commercial only (need separate license)Command R+

Always verify the current license terms on the model's official page before deploying in production. License terms can change between model versions.

Open Source vs Proprietary: When to Use Which?

Open source models are not always the right choice, and proprietary APIs are not always the wrong one. Here is a realistic assessment:

Choose Open Source When

  • + Data privacy is critical (healthcare, legal, finance)
  • + You need to fine-tune for a specific domain
  • + High-volume usage would make API costs prohibitive
  • + You need full control over the model and its behavior
  • + Regulatory requirements demand on-premise deployment
  • + You want to avoid vendor lock-in

Choose Proprietary APIs When

  • + You need the absolute best performance
  • + You do not want to manage infrastructure
  • + Your usage volume is moderate
  • + You need to move fast and iterate quickly
  • + You want built-in safety and moderation
  • + Budget for infrastructure engineers is limited

Many teams use a hybrid approach: proprietary APIs for the most demanding tasks and open source models for high-volume, lower-complexity work. For current API pricing across all providers, check our AI API Pricing Guide. You can also compare all models (both open and proprietary) on our model tracker.

Frequently Asked Questions

What is the best open-source LLM?

There is no single winner. Xiaomi's MiMo-V2.6-Pro posts the top open-weights score on the independent Artificial Analysis Intelligence Index (46), DeepSeek V4.1 Flash and Moonshot's Kimi K3 lead the published agentic and reasoning benchmarks among open-weight models, DeepSeek V4 Pro and GLM-5.3-Flash are the strongest options under plain MIT terms, and Qwen3.8-27B and Meta's Muse Glimmer 30B are the best picks that fit on a single GPU. Most of these scores are vendor-reported, so test on your own workload.

Can I run LLMs on my own computer?

Yes. Tools like Ollama make it easy to run models locally. Smaller models (7B-13B parameters) run well on consumer GPUs. Larger models need more powerful hardware or quantization.

Are open-source LLMs as good as ChatGPT?

The gap is now small on many benchmarks. Kimi K3 reports 93.5 on GPQA Diamond and DeepSeek V4.1 Flash reports 90.9, against 96.0 for OpenAI's GPT-6 Astra (all vendor-reported). Proprietary models still lead on the hardest agentic work, such as computer use on OSWorld 2.0, where Claude Opus 5 reports 70.6 against 58.3 for Kimi K3, and long-horizon terminal work on Terminal-Bench 4.0, where MiMo-V2.6-Pro reports 34.9 against 66.4 on Anthropic's table for Claude Opus 5.5.

What license do open-source LLMs use?

Licenses vary. DeepSeek, MiMo-V2.6, GLM-5.3-Flash, LongCat-2.0, and Phi-4 use MIT. Qwen3.8-27B, Gemma 4, Muse Glimmer 30B, Mistral Large 3, and Mistral Small 4 use Apache 2.0. Llama 4 uses the Llama 4 Community License (free for most uses), and Kimi K3 and MiniMax M3 ship under custom licenses with extra conditions. Always check the specific license for commercial use.

Related Guides