Last Updated: November 2, 2026
Best Open Source LLMs in 2026
The strongest open-source LLMs in 2026 are Xiaomi's MiMo-V2.6-Pro (September 21, 2026, MIT, and the top open-weights score on the independent Artificial Analysis Intelligence Index at 46 as of late September), DeepSeek V4.1 Flash (a 552B backbone with only 8B active per token in prefill, MIT, refreshed with the V4.1-Flash-1017 weights on October 17, and ahead of DeepSeek's own V4 Pro on most agentic coding benchmarks), Moonshot's Kimi K3 (the largest open-weight model published, at 2.8T total parameters with 104B active), DeepSeek V4 Pro and Z.ai's GLM-5.3-Flash (near-frontier quality under plain MIT terms), and Qwen3.8-27B and Meta's Muse Glimmer 30B (two of the most capable models that fit on a single GPU). October added Reflection's Beam (501B, Apache 2.0, no access gate), the Arabic-first Jais 3 family (Apache 2.0), and Meta's 816B Muse Spark Open, which ships under a custom license with a $20 million revenue clause. Raw capability and license freedom do not always line up, so weigh both. Most can be run locally with tools like Ollama, vLLM, or Hugging Face Transformers, given enough hardware.
The gap between open source and proprietary language models has narrowed dramatically. Models you can download and run yourself now compete with (and in some cases surpass) the APIs you pay for. This guide covers the best open source LLMs available right now, including how they compare, what licenses they use, and how to actually run them.
Comparison Table
| Model | Parameters | Context | License | Architecture |
|---|---|---|---|---|
| Reflection Beam | 501B total | 1M tokens | Apache 2.0 | Mixture of Experts (MoE), text only |
| Muse Spark Open | 816B total | 1M tokens | Muse Model License | Mixture of Experts (MoE), natively multimodal |
| Jais 3 375B-A23B | 375B total | 512K tokens | Apache 2.0 | Mixture of Experts (MoE), Arabic-first |
| MiMo-V2.6-Pro | 1.02T total | 1,048,576 tokens | MIT | Mixture of Experts (MoE), natively omnimodal with text, image, video, and audio input |
| Ternary Bonsai 2 27B | 27.36B | 262K tokens | Apache 2.0 | Qwen3.8 27B architecture unchanged, ternary weights with FP16 group scaling and a blockwise Hadamard rotation |
| Atria Dawn Preview | 744B total | 256K tokens | MIT | Mixture of Experts (MoE) built on the GLM-5.2 foundation, FP8 weights |
| GLM-5.3 Flash | 320B total | 1M tokens | MIT | Mixture of Experts (MoE), hybrid linear plus sparse attention (IndexPool, mHC) |
| Qwen3.8-Flash-Next | 125B total | 262K native, extensible to 1M with YaRN | qwen-community-1.0 | Mixture of Experts (MoE) with Gated DeltaNet, Qwen Sparse Attention, and n-gram embedding |
| Kimi K3 | 2.8T total | 1M tokens | Kimi K3 License | Mixture of Experts (MoE), native MXFP4 |
| Laguna S 2.1 | 118B total | 1M tokens | OpenMDW-1.1 | Mixture of Experts (MoE) |
| Muse Glimmer 30B | 29.6B dense | 131,072 tokens | Apache 2.0 | Dense Causal Transformer with Perception Encoder |
| Llama 4 Scout | 109B total | 10M tokens | Llama 4 Community License | Mixture of Experts (MoE) |
| Llama 4 Maverick | 400B total | 1M tokens | Llama 4 Community License | Mixture of Experts (MoE) |
| DeepSeek V4.1 Flash | 552B backbone | 1,048,576 tokens | MIT | Mixture of Experts (MoE) with a Causal Encoder-Decoder (CED) layout |
| DeepSeek V4 Pro | 1.6T total | 1M tokens | MIT | Mixture of Experts (MoE) with Hybrid Attention |
| DeepSeek V4 Flash | 284B total | 1M tokens | MIT | Mixture of Experts (MoE) with Hybrid Attention |
| MiniMax M3 | 428B total | 1M tokens | MiniMax Community License | Mixture of Experts (MoE) with MiniMax Sparse Attention |
| LongCat-2.0 | 1.6T total | 1M tokens (native) | MIT | Mixture of Experts (MoE) with dynamic activation |
| Mistral Large 4 | About 1T total | 1M tokens | Mistral Ecosystem Open-Weight License (modified MIT) | Granular Mixture of Experts (MoE) with 128 routed experts and 1 shared expert |
| Mistral Large 3 | 675B total | 256K tokens | Apache 2.0 | Granular Mixture of Experts (MoE) with a 2.5B vision encoder |
| Mistral Small 4 | 119B total | 256K tokens | Apache 2.0 | Mixture of Experts (MoE), 128 experts with 4 active |
| Qwen3.8-27B | 27.78B dense | 262K tokens | Apache 2.0 | Dense Transformer, native vision-language |
| Phi-4 | 14B | 16K tokens | MIT | Dense Transformer |
| Gemma 4 | 31B dense | 256K tokens (128K on E2B and E4B) | Apache 2.0 | Dense and Mixture of Experts variants, hybrid local and global attention |
| Command A+ | 218B total | 128K input / 64K max generation | Apache 2.0 | Mixture of Experts (MoE) |
| Command R+ | 104B | 128K tokens | CC-BY-NC (non-commercial); commercial license available | Dense Transformer |
Detailed Model Reviews
Reflection Beam
Reflection501B total (23B active per token) | 1M tokens context | Mixture of Experts (MoE), text only | Apache 2.0 | Released: October 2026
Highlights
- +Weights released October 16, 2026 under plain Apache 2.0, with no access form or approval step
- +501B total parameters with only 23B active per token
- +1M token context window
- +Reflection's own API is free during its public beta
Best For
Teams that want a large text model with nothing between the download and production: no access gate, no revenue clause, and no license terms beyond the standard Apache notice. It is the newest large option for anyone whose legal team only signs off on Apache 2.0 or MIT.
Considerations
Text only, so it is no help for screenshot, chart, or video agents. We do not yet track an independent benchmark score for it, so the capability case rests on Reflection's own claims for now. The free API is a beta with no published price after it ends, and at 501B total parameters self-hosting still means a multi-GPU node.
Muse Spark Open
Meta816B total (42B active per token) | 1M tokens context | Mixture of Experts (MoE), natively multimodal | Muse Model License | Released: October 2026
Highlights
- +Released October 15, 2026 at 816B total parameters with 42B active, about twice the size of Llama 4 Maverick
- +Natively multimodal with a 1M token context window
- +Hosted by third-party providers at $1.25/$4.25 per 1M tokens; Meta does not serve it on its own Model API
- +Weights on Hugging Face behind an access form with manual approval
Best For
Teams that want a large multimodal Meta model with long context on their own infrastructure, and that are comfortable working under a custom license rather than Apache 2.0 or MIT.
Considerations
Open weights here does not mean a permissive license. The Muse Model License requires attribution, and model-as-a-service businesses above $20 million in revenue over 12 months must notify Meta and sign a separate agreement, so a hosting company should read it before building on it. Early independent results are weak on agentic terminal work: Vals scores it 6.57 on Terminal-Bench 4.0 (October 18, 2026 board), against 31.82 for DeepSeek V4.1-Flash-1017, so test it on your workload before treating it as a frontier model.
Jais 3 375B-A23B
MBZUAI IFM and Inception42375B total (23B active per token; the largest of six Jais 3 models) | 512K tokens context | Mixture of Experts (MoE), Arabic-first | Apache 2.0 | Released: October 2026
Highlights
- +Six Apache 2.0 models released October 15, 2026, topping out at 375B total with 23B active
- +Arabic-first, from MBZUAI's Institute of Foundation Models with Inception42
- +512K token context window
- +Text, code, tool use, and reasoning
Best For
Arabic-language products and regional deployments that want an Arabic-first model under plain Apache 2.0, with smaller sizes in the same family for lighter hardware.
Considerations
There is no hosted API, so you either run it yourself or wait for a third-party host. We do not yet track an independent benchmark score for it. For English-first coding or agent work, the general-purpose models on this list are the safer place to start.
MiMo-V2.6-Pro
Xiaomi1.02T total (42B active per token; the MiMo-V2.6-Flash sibling is 309B total with 15B active) | 1,048,576 tokens context | Mixture of Experts (MoE), natively omnimodal with text, image, video, and audio input | MIT | Released: September 2026
Highlights
- +Top open-weights score on the Artificial Analysis Intelligence Index at 46 as of late September 2026, level with Grok 4.7 (independent)
- +Vals Index 59.47 percent for Pro and 59.58 for Flash at launch, both ahead of DeepSeek V4.1 Flash at 57.86 (independent, September 2026)
- +DeepSWE v1.1 at 71.9 and Terminal-Bench 2.1 at 89.9, with Flash at 67.9 and 87.6 (vendor-reported)
- +Text, image, video, and audio input in one model, with up to 131,072 output tokens
- +API at $0.435/$0.87 per 1M tokens with cached input at $0.0036; Flash is $0.14/$0.28, both unchanged from V2.5
- +MIT weights on Hugging Face as XiaomiMiMo/MiMo-V2.6-Pro-RL and XiaomiMiMo/MiMo-V2.6-Flash-RL
Best For
The highest-scoring open-weight model on the Artificial Analysis Intelligence Index as of late September 2026, and the pick for omnimodal agents that read video and audio in the same run under plain MIT terms. MiMo-V2.6-Flash, released the same day, scores fractionally higher on the Vals Index (59.58 against 59.47) at about a third of the Pro rate, so test Flash first if cost or cluster size matters.
Considerations
The long-horizon terminal gap to the closed frontier is still visible: Terminal-Bench 4.0 sits at 34.9 for Pro and 28.8 for Flash, against 66.4 for Claude Opus 5.5 on Anthropic's table (all vendor-reported). Vals' independent Terminal-Bench 4.0 runs put Pro at 31.31 and Flash at 24.24, against 65.15 for Opus 5.5. Xiaomi's 82.0 computer-use figure is on OSWorld-Verified, a different task set from OSWorld 2.0, so do not compare it with OSWorld 2.0 numbers elsewhere on this page. At 1.02T total parameters the Pro model is a cluster deployment rather than a workstation one, so most teams will meet it through Xiaomi's API or a host. A Pro-UltraSpeed tier serves the same model faster at ten times the Pro price.
Ternary Bonsai 2 27B
PrismML27.36B (24.35B language backbone, 2.54B embeddings and LM head, 0.47B vision tower) | 262K tokens context | Qwen3.8 27B architecture unchanged, ternary weights with FP16 group scaling and a blockwise Hadamard rotation | Apache 2.0 | Released: September 2026
Highlights
- +A 5.93 GB file against 53.80 GB in FP16, about 9.1x smaller, running on a 16 GB laptop or one 24 GB GPU
- +Every weight is -1, 0, or +1 with one FP16 scale per group of 128, landing at 1.76 effective bits per weight
- +Retains 98.2 percent of the parent model average across 20 benchmarks, 83.9 against 85.4 (vendor-reported)
- +Beats an IQ2_XXS build of the same model by a wide margin: AIME26 95.83 against 78.6, LiveCodeBench v6 90.07 against 70.05
- +142.5 tokens per second on an RTX 5090 and 46.8 on an M5 Max at batch size 1
Best For
Running a genuinely capable multimodal 27B on hardware you already own. It was one of the clearest local-inference releases of September 2026, and the Apache 2.0 license plus GGUF and MLX builds mean there is no gate between reading about it and running it.
Considerations
The 98.2 percent is an average and the losses are not evenly spread. Long-horizon agent work is where the compression bites: Terminal-Bench 2.1 drops to 52.8 from 69.7 and SWE-bench Verified to 60.8 from 80.6, roughly 75 percent retention, and both sit outside the 20-benchmark average. Knowledge and reasoning retains 96.9 percent and vision 96.3. Stock llama.cpp cannot load PTQ1_0 or PQ2_0, so you need PrismML's fork or its MLX runtime, and low reasoning effort is not supported. Every figure is PrismML's own and has not been independently reproduced.
Atria Dawn Preview
Shanghai AI Laboratory744B total (Mixture of Experts) | 256K tokens context | Mixture of Experts (MoE) built on the GLM-5.2 foundation, FP8 weights | MIT | Released: September 2026
Highlights
- +MIT weights on a 744B agentic model, one of the most permissive licenses at that scale
- +Built for long-horizon research agents: continuous environmental understanding, tool use, and multistep completion
- +Targets carrying scientific work from a paper to executable experiments, reproducible metrics, and an inspectable report
- +Published on Hugging Face and ModelScope with no blog post and no paper on release day
- +The technical report followed on arXiv three days later with more than 140 authors
Best For
Research groups building autonomous experiment loops who need the weights rather than an endpoint, and anyone studying how a large agentic MoE is trained, since the report is unusually detailed for a Chinese lab release.
Considerations
Preview is in the name. There was no independent evaluation at launch and the lab published evaluation results on its own site rather than through a third party. At 744B parameters in FP8 this is not laptop hardware: it is a cluster model, so most people will meet it through a host rather than self-hosting. The GLM-5.2 foundation also means its lineage traces back to Z.ai, one of six labs named in the September 8, 2026 joint CISA, NSA, and FBI distillation advisory, which is a procurement question rather than a technical one.
GLM-5.3 Flash
Z.ai (Zhipu AI)320B total (roughly 18B active per token, 45 layers) | 1M tokens context | Mixture of Experts (MoE), hybrid linear plus sparse attention (IndexPool, mHC) | MIT | Released: August 2026
Highlights
- +First natively multimodal GLM-5: text, image, and video in one stack rather than a bolted-on vision head
- +Plain MIT weights on Hugging Face at zai-org/GLM-5.3-Flash, published on release day
- +DeepSWE 63.4 against GLM-5.2 at 46.2 and AutomationBench 48.8 against 26.2 (vendor-reported)
- +Roughly 3.0x less attention compute and a 4.4x smaller KV cache than text GLM-5.3
- +List pricing of $0.15 input and $0.50 output per 1M tokens, about a tenth of GLM-5.3 on input
Best For
Multimodal coding and computer-use loops at flash pricing, and any team that wants a capable vision-language agent on unambiguous MIT terms at 18B active parameters.
Considerations
Every published score is self-reported by Z.ai on the launch post, with no independent run yet. The 50 percent launch promotion ended on September 9, 2026, so the $0.15/$0.50 list rate is the number to budget. Thinking cannot be disabled, since thinking.type accepts enabled only, which means short prompts still pay reasoning tokens. And do not confuse it with text-only GLM-5.3, a different 753B model at $1.40/$4.40. BabyVision at 53.4 trails Gemini 3.7 Flash at 70.9 on the launch table (Google has since deprecated 3.7 Flash), which is the clearest published weakness.
Qwen3.8-Flash-Next
Alibaba125B total (6B active per token) plus a 51B n-gram embedding table and a 4B MTP layer | 262K native, extensible to 1M with YaRN context | Mixture of Experts (MoE) with Gated DeltaNet, Qwen Sparse Attention, and n-gram embedding | qwen-community-1.0 | Released: August 2026
Highlights
- +Only 6B parameters activated per token, among the lowest active counts of any capable open model this year
- +The 51B n-gram table indexes 20 million bigrams and trigrams and can sit in system RAM instead of GPU memory
- +Explicit preview of the architecture that will underpin Qwen4
- +DeepSWE 1.1 at 58.7 and SWE-bench Pro at 62.5, ahead of DeepSeek-V4-Flash-0731 at 54.4 and 56.0 (vendor-reported)
- +Alibaba claims it beats the 397B Qwen3.7-Plus at roughly one ninth the training cost
Best For
Self-hosting shops that want a multimodal agent with a very low active-parameter count, and teams that want an early read on the Qwen4 architecture before the full release.
Considerations
This is labeled experimental and Alibaba says so. The license is a custom qwen-community-1.0, not the plain Apache 2.0 that covers Qwen3.8-27B, so read it before commercial deployment. All benchmark figures are self-reported on the Hugging Face card, NL2Repo-Bench regresses to 48.1 against DeepSeek at 54.2, and OSWorld 2.0 sits at 19.4, still close to a coin flip on full task success. It is also easy to confuse with the hosted Qwen3.8-Flash on QwenCloud, which is a different product at $0.16/$0.47 with a 1M default window.
Kimi K3
Moonshot AI2.8T total (104B active per token, 896 experts, 16 routed plus 2 shared) | 1M tokens context | Mixture of Experts (MoE), native MXFP4 | Kimi K3 License | Released: July 2026
Highlights
- +Largest open-weight model ever shipped at 2.8 trillion parameters
- +Strongest open-weight GPQA Diamond result on record at 93.5 percent (vendor-reported)
- +Scored 1,679 points on Frontend Code Arena, ahead of Claude Fable 5
- +Native vision alongside text, with a 1M token context window
- +API pricing at $3.00 input (or $0.30 on a cache hit) and $15.00 output per 1M tokens
Best For
Teams that want the closest open-weight model to the proprietary frontier for general knowledge work, science reasoning, and visual tasks, and are content to reach it through a hosted API.
Considerations
Open weights and self-hostable are two different claims here. K3 ships natively in MXFP4 with no FP16 checkpoint, and even at 4-bit it needs roughly 1,450GB of accelerator memory before the KV cache, so it wants eight B200-class cards. Most usage routes through hosted inference, and calls to Moonshot's own API are processed under Chinese jurisdiction. Moonshot is also the subject of a July 2026 US government distillation and export-control accusation that remains contested.
Laguna S 2.1
poolside118B total (roughly 8B active per token) | 1M tokens context | Mixture of Experts (MoE) | OpenMDW-1.1 | Released: July 2026
Highlights
- +Only about 8B active parameters, so a small team can genuinely self-host it
- +70.2 percent on Terminal-Bench 2.1 in thinking mode and 78.5 percent on SWE-Bench Multilingual
- +Weights on Hugging Face day one, no waitlist and no delayed drop
- +Hosted pricing of $0.10 input and $0.20 output per 1M tokens, among the cheapest anywhere
- +poolside published every unedited benchmark trajectory and disclosed its own harness
Best For
Cost-sensitive agentic coding at volume, terminal and shell automation, and any team that actually intends to run the weights rather than call someone else's endpoint.
Considerations
This is a coding specialist, not a general assistant: text and code only, no vision. The headline Terminal-Bench number comes from poolside's own harness, which the company disclosed openly, but it still has not been reproduced by an independent party. As poolside's first major public model it has no production track record yet.
Muse Glimmer 30B
Meta29.6B dense (including a 1.8B vision encoder) | 131,072 tokens context | Dense Causal Transformer with Perception Encoder | Apache 2.0 | Released: August 2026
Highlights
- +Plain Apache 2.0, with none of the scale-based carve-outs in the Llama 4 Community License
- +Distilled from Muse Spark and built for agents that run locally without cloud access
- +76.0 on SWE-Bench Verified, 51.2 on SWE-Bench Pro, and 83.5 on GPQA Diamond at high reasoning (Meta-reported)
- +Text and image input, so agents can read screenshots, charts, and documents
- +Meta says 4-bit weights shrink the language model under 20 GB, fitting a 24 GB or 32 GB card with room for the KV cache
Best For
Always-on local agents and private multimodal workflows on a single GPU. It is the Meta open-weight model to pick for a single GPU, and the natural upgrade for teams running Llama 4 today.
Considerations
All scores come from Meta's own model card. The 131K context window is short next to the 1M windows elsewhere on this list, so it suits long-running loops better than whole-repository passes. The weights live under the meta-models organization on Hugging Face rather than meta-llama, which matters if you script downloads. Meta's much larger Muse Spark Open (816B total) ships under the custom Muse Model License rather than Apache 2.0, while Muse Spark 1.3 and Muse Wonder remain API-only.
Llama 4 Scout
Meta109B total (17B active per token, 16 experts) | 10M tokens context | Mixture of Experts (MoE) | Llama 4 Community License | Released: April 2025
Highlights
- +Enormous 10M token context window
- +Competitive with GPT-4o on many benchmarks
- +Efficient MoE architecture keeps inference costs low
- +Supports 12 languages natively
- +Multimodal: handles text and images
Best For
Long-context applications, multilingual tasks, and general-purpose use where you need a strong all-around model with exceptional context length.
Considerations
The Llama 4 Community License is permissive for most uses but has restrictions for very large-scale commercial deployments (700M+ monthly active users). The 10M context window requires significant memory.
Llama 4 Maverick
Meta400B total (17B active per token, 128 experts) | 1M tokens context | Mixture of Experts (MoE) | Llama 4 Community License | Released: April 2025
Highlights
- +Meta's largest open-weight model by total parameters until Muse Spark Open (816B) arrived in October 2026
- +Native 1M token context window
- +Good for complex multi-step tasks
- +Multimodal with strong image understanding
Best For
Teams already standardized on the Llama ecosystem that want a large multimodal MoE with a 1M context window.
Considerations
Requires significant hardware to run (multi-GPU setup). Same license restrictions as Scout. It has aged quickly: our benchmark data shows 24.0 on SWE-bench Verified, against 76.0 for Meta's own Muse Glimmer 30B, so newer open models are the better pick for agentic coding.
DeepSeek V4.1 Flash
DeepSeek552B backbone (8B active per token in prefill, 16B in decode) | 1,048,576 tokens context | Mixture of Experts (MoE) with a Causal Encoder-Decoder (CED) layout | MIT | Released: September 2026
Highlights
- +DeepSeek's own comparison puts it ahead of V4 Pro on most agentic and coding rows, though V4 Pro keeps the higher GPQA Diamond score (92.4 to 90.9)
- +GPQA Diamond 90.9, Terminal-Bench 2.1 at 90.6, DeepSWE v1.1 at 74.2 (all vendor-reported)
- +Causal Encoder-Decoder design activates only 8B parameters per token during prefill
- +Native multimodal vision in a 552B open-weight model
- +MIT license with weights on Hugging Face, including the dated V4.1-Flash-1017 update published October 17, 2026
- +V4.1-Flash-1017 scores 31.82 on Vals' independent Terminal-Bench 4.0 board (October 18, 2026)
- +API at $0.30/$1.20 per 1M peak, halving to $0.15/$0.60 off-peak, unchanged by the 1017 update
Best For
The strongest open-weight release of September 2026 and the clearest case that the cheap tier has caught the flagship tier. At 8B active parameters in prefill it is far more deployable than V4 Pro or Kimi K3, and DeepSeek's own table shows it beating the 1.6T V4 Pro on Terminal-Bench 2.1, DeepSWE, and CyberGym. Best pick for agentic coding and terminal work on MIT terms.
Considerations
Most headline numbers are vendor-reported. The main independent read so far is Vals' Terminal-Bench 4.0 board, where the 1017 update scores 31.82 against 65.15 for Claude Opus 5.5, so the gap to the closed frontier on long-horizon terminal work is still wide. The win over V4 Pro is not across the board either: V4 Pro still scores higher on GPQA Diamond and Humanity's Last Exam in DeepSeek's own table. On the API it is served as deepseek-flash, which replaced the retired deepseek-v4-flash endpoint. The API price doubles during peak windows (Monday to Friday, 01:00 to 04:00 and 06:00 to 10:00 UTC), so a workload that cannot schedule itself should budget $0.30/$1.20 rather than the off-peak rate. The widely quoted $0.003 figure is the off-peak cache-hit price and applies only to reused context. Self-hosting 552B backbone parameters still needs real infrastructure even at 8B active.
DeepSeek V4 Pro
DeepSeek1.6T total (49B active per token) | 1M tokens context | Mixture of Experts (MoE) with Hybrid Attention | MIT | Released: April 2026
Highlights
- +Near-frontier performance: 80.6% on SWE-bench Verified
- +MIT license allows unrestricted commercial use
- +Native 1M token context window
- +Hybrid Attention architecture for better long-context recall
- +Open weights stay downloadable under MIT; the DeepSeek API retired the model on September 14, 2026 and routes deepseek-v4-pro calls to V4.1 Flash
Best For
The largest MIT-licensed model in the DeepSeek line, and still its top GPQA Diamond scorer. Near-frontier coding and reasoning at a fraction of proprietary pricing, for teams that want unrestricted license freedom, which Kimi K3 and Laguna S 2.1 do not offer.
Considerations
The 1.6T parameter model requires multi-GPU infrastructure to self-host. It is no longer served on DeepSeek's own API: since 04:00 UTC on September 14, 2026, deepseek-v4-pro requests route to V4.1 Flash at V4.1 Flash rates until a V4.1 Pro ships, so hosted access now means a third-party provider. V4.1 Flash is cheaper and ahead on most agentic benchmarks, so check it first.
DeepSeek V4 Flash
DeepSeek284B total (13B active per token) | 1M tokens context | Mixture of Experts (MoE) with Hybrid Attention | MIT | Released: April 2026
Highlights
- +Open weights on Hugging Face, including a July 2026 refresh (DeepSeek-V4-Flash-0731)
- +Native 1M token context window
- +Strong performance for its active parameter count
- +MIT license, same as V4 Pro
- +Efficient enough to run on smaller GPU setups
Best For
Self-hosted, cost-sensitive workloads where you need 1M context on a budget and already have V4 Flash validated in production. Classification, summarization, and batch processing tasks where V4 Pro is overkill.
Considerations
DeepSeek has retired the deepseek-v4-flash API endpoint and routes it to V4.1 Flash, so V4 Flash is no longer available on DeepSeek's own API. V4.1 Flash beats it on nearly every row of DeepSeek's own comparison table, so new projects should start there.
MiniMax M3
MiniMax428B total (roughly 23B active per token) | 1M tokens context | Mixture of Experts (MoE) with MiniMax Sparse Attention | MiniMax Community License | Released: June 2026
Highlights
- +MiniMax Sparse Attention cuts per-token compute at 1M context to roughly 1/20th of M2
- +Claimed 59% on SWE-Bench Pro and 83.5 on BrowseComp
- +Multimodal input: text, image, and video
- +API pricing at $0.30/$1.20 per 1M tokens, among the cheapest at this tier
- +Weights now published on Hugging Face (MiniMaxAI/MiniMax-M3)
Best For
Cost-sensitive agentic coding and browser-agent workloads that need very long context, through the API or on a small cluster now that the weights are downloadable.
Considerations
Launch benchmarks were run on MiniMax infrastructure with agent scaffolding (Claude Code, Mini-SWE-Agent, Terminus), so treat them as unverified until independent results appear. The license is a custom community license, not Apache or MIT: any commercial use requires a prominent "Built with MiniMax M3" notice plus a one-time notice to MiniMax, and products above $20 million in yearly revenue need prior written authorization.
LongCat-2.0
Meituan1.6T total (33 to 56B active per token, dynamic) | 1M tokens (native) context | Mixture of Experts (MoE) with dynamic activation | MIT | Released: June 2026
Highlights
- +Fully MIT licensed on GitHub and Hugging Face
- +Dynamic activation of 33 to 56 billion parameters per token, adjusting to task difficulty
- +Purpose-built for agentic coding: code understanding, generation, and execution in agent workflows
- +Self-reported 59.5 on SWE-Bench Pro, ahead of Gemini 3.1 Pro, GPT-5.5, and Claude Opus 4.6 by Meituan's measure
- +First trillion-parameter release trained end-to-end on a 50,000-card domestic Chinese compute cluster
- +Pretrained on 30T+ tokens spanning Chinese, English, multilingual, and code data
Best For
Sovereign or geopolitically sensitive deployments where domestic-chip provenance matters, and agentic coding workloads with variable per-token difficulty that benefit from dynamic activation.
Considerations
Launch benchmarks are self-reported; independent verification is still pending. At 1.6T total parameters, self-hosting inference at meaningful throughput requires multi-GPU or multi-node infrastructure. A preview version had been running quietly on OpenRouter and longcat.ai for weeks before the announcement, so hosted access is easier than self-host on day one.
Mistral Large 4
Mistral AIAbout 1T total (about 52B active per token) | 1M tokens context | Granular Mixture of Experts (MoE) with 128 routed experts and 1 shared expert | Mistral Ecosystem Open-Weight License (modified MIT) | Released: October 2026
Highlights
- +Open weights released October 29, 2026, three weeks after the public preview
- +Ungated Hugging Face repo with text and image input
- +Artificial Analysis Coding Agent Index of 48 percent, effectively tied with GLM-5.3 at 47 percent fewer tokens per task (vendor-reported)
- +About 41 percent on Terminal-Bench 4.0 (vendor-reported, not independently reproduced)
- +Hosted API at $0.70/$2.10 per 1M tokens for teams that do not want to serve it themselves
Best For
Teams that want a frontier-scale European model they can run themselves, including agentic coding and long-context work on multi-GPU Blackwell nodes.
Considerations
The hardware bar is high: the FP8 release needs about 1TB of VRAM, and even the official NVFP4 checkpoint needs about 520GB across four B200s. The license is MIT with one condition, so running a model-as-a-service business on it requires a separate commercial license from Mistral. Internal use does not.
Mistral Large 3
Mistral AI675B total (41B active per token) | 256K tokens context | Granular Mixture of Experts (MoE) with a 2.5B vision encoder | Apache 2.0 | Released: December 2025
Highlights
- +Apache 2.0 weights for a frontier-scale European model
- +Multilingual across dozens of languages, including major European and Asian languages
- +Image input alongside text
- +Native function calling and JSON output
- +Mistral says the FP8 build runs on a single node of B200s or H200s
Best For
European language applications and enterprise use cases where a permissive license and a European vendor both matter. Also strong for tool-using and function-calling applications.
Considerations
At 675B total parameters it needs a full multi-GPU node even in FP8, or an NVFP4 build on a node of H100s or A100s. For lighter deployments, Mistral Small 4 covers much of the same feature set at a fraction of the size. Mistral deprecated the hosted mistral-large-2512 endpoint on October 31, 2026, with retirement on April 30, 2027, in favor of Mistral Large 4. The Apache 2.0 weights are unaffected.
Mistral Small 4
Mistral AI119B total (6.5B active per token) | 256K tokens context | Mixture of Experts (MoE), 128 experts with 4 active | Apache 2.0 | Released: March 2026
Highlights
- +Only 6.5B parameters active per token, so it serves quickly
- +One model for instruct, reasoning, and coding work, with reasoning effort set per request
- +Text and image input
- +Native function calling and JSON output
- +Apache 2.0 license
Best For
Applications where speed and cost matter more than absolute capability. Great for tool-using agents, classification tasks, and high-throughput workloads.
Considerations
Despite the Small name this is a 119B model, so the full weights need server-class GPU memory even though only 6.5B parameters fire per token. Mistral publishes an NVFP4 checkpoint to cut that footprint.
Qwen3.8-27B
Alibaba27.78B dense | 262K tokens context | Dense Transformer, native vision-language | Apache 2.0 | Released: August 2026
Highlights
- +Apache 2.0 with no size or usage carve-outs, unusual at this capability level
- +Natively multimodal out of the box: text, images, and hour-scale video
- +Terminal-Bench 2.1 rises from 63.4 to 73.0 against Qwen3.6-27B (vendor-reported)
- +OSWorld-Verified jumps from 63.9 to 84.3 and DeepSWE 1.1 from 13.3 to 42.2
- +Fits on a single high-memory card at 4-bit, so one workstation runs it
Best For
The strongest locally deployable multimodal model near 30 billion parameters. Best pick for teams that want vision and video understanding on their own hardware under a permissive license, without the multi-GPU bill that DeepSeek V4 Pro or Kimi K3 demand.
Considerations
Every score above comes from Alibaba's own model card and has not been independently reproduced. It is a dense 27B model, so it will not match 1T-class MoE flagships on hardest-case reasoning. The 262K context window is generous for the size but well short of the 1M windows elsewhere on this list.
Phi-4
Microsoft14B | 16K tokens context | Dense Transformer | MIT | Released: December 2024
Highlights
- +Outstanding performance for its small size
- +Strong math and reasoning capabilities
- +Runs on consumer hardware (even laptops)
- +MIT license allows unrestricted use
- +Trained on high-quality synthetic data
Best For
On-device applications, edge computing, and scenarios where you need good reasoning in a small package. Excellent for math-heavy tasks and as a component in larger systems.
Considerations
Limited context window (16K). Knowledge cutoff may miss recent events. Less capable than larger models for open-ended creative tasks.
Gemma 4
Google DeepMind31B dense (also E2B, E4B, 12B, and a 26B A4B MoE) | 256K tokens (128K on E2B and E4B) context | Dense and Mixture of Experts variants, hybrid local and global attention | Apache 2.0 | Released: April 2026
Highlights
- +Apache 2.0, replacing the custom Gemma Terms of Use that covered earlier generations
- +Five sizes, from on-device E2B up to a 31B dense model
- +Text and image input on every size, with audio on E2B, E4B, and 12B
- +84.3 percent on GPQA Diamond for the 31B, against 42.4 for Gemma 3 27B (Google-reported)
- +The 26B A4B MoE activates about 4B parameters per token and runs almost as fast as a 4B model
Best For
Fine-tuning experiments, mobile and edge applications, and single-GPU deployments. E2B and E4B target phones and laptops, while the 12B, 26B A4B, and 31B fit consumer GPUs and workstations.
Considerations
All benchmark figures come from Google's own model card. The small E2B and E4B models cap context at 128K, and even the 256K ceiling on the larger sizes is well short of the 1M windows elsewhere on this list. The MoE variant is fast, but its memory footprint still reflects all 26B parameters.
Command A+
Cohere218B total (25B active per token) | 128K input / 64K max generation context | Mixture of Experts (MoE) | Apache 2.0 | Released: May 2026
Highlights
- +Fully Apache 2.0 licensed (Cohere's first), unrestricted commercial use
- +Multimodal reasoning: text and image input, native tool use
- +Runs on a single NVIDIA B200 or two H100s at W4A4 quantization
- +Lossless quantization across BF16, FP8, and W4A4 on Hugging Face
- +48 language coverage, with new tokenizer that cuts tokens 16 to 20% in Arabic, Korean, and Japanese
- +Artificial Analysis Intelligence Index of 37; MMMU 75.1%, MathVista 80.6%
Best For
Enterprises that need sovereign, self-hostable AI with native citations and RAG, plus a permissive license for production. Strong fit for agentic workflows across regulated industries (financial services, healthcare, public sector).
Considerations
Trails the strongest Chinese open MoEs (DeepSeek V4 Pro, GLM, MiniMax) on the broadest general-intelligence benchmarks. Best paired with Cohere's North platform if you want the integrated agentic workspace. API pricing for the hosted version was not published at launch.
Command R+
Cohere104B | 128K tokens context | Dense Transformer | CC-BY-NC (non-commercial); commercial license available | Released: April 2024
Highlights
- +Purpose-built for RAG (Retrieval-Augmented Generation)
- +Excellent at grounding responses in provided documents
- +Strong citation and attribution capabilities
- +Good multilingual support (10+ languages)
- +Reliable tool use and function calling
Best For
RAG applications where you need the model to carefully reference and cite source documents. Enterprise search, knowledge bases, and document Q&A.
Considerations
Superseded by Command A+ in May 2026, which is Apache 2.0 and multimodal. Keep Command R+ in mind only for existing deployments; new projects should default to Command A+.
How to Run LLMs Locally
Running an LLM on your own hardware gives you full control, complete privacy, zero per-request costs, and the ability to customize models to your needs. Here are the main tools for local deployment:
Ollama
The easiest way to run LLMs locally. Ollama provides a simple command-line interface that handles downloading, configuring, and running models. One command to install, one command to run. It supports Mac, Linux, and Windows, and works with most popular open source models.
# Install Ollama, then:
ollama run qwen3.8:27b
ollama run muse-glimmer:30b
ollama run llama4:scout
Best for: Getting started quickly, personal use, development and testing.
Hardware needed: 8GB+ RAM for small models (7B), 16GB+ for medium (14B), 32GB+ for large (70B+).
vLLM
A high-performance inference engine designed for production serving. vLLM uses PagedAttention and other optimizations to achieve much higher throughput than naive implementations. It provides an OpenAI-compatible API, making it a drop-in replacement for proprietary APIs.
pip install vllm
vllm serve Qwen/Qwen3.8-27B
Best for: Production deployments, high-throughput serving, multi-user applications.
Hardware needed: NVIDIA GPU(s) with enough VRAM for the model. A100 or H100 recommended for large models.
llama.cpp
A C/C++ inference engine that runs LLMs on CPUs (and GPUs). It is the foundation that many other tools (including Ollama) build on. llama.cpp is known for its aggressive quantization support, allowing you to run large models on surprisingly modest hardware by reducing precision from 16-bit to 4-bit or even 2-bit.
# Install from llama.app, or build from github.com/ggml-org/llama.cpp, then:
llama cli -hf ggml-org/Qwen3.5-0.8B-GGUF
llama serve -hf ggml-org/Qwen3.5-0.8B-GGUF
Best for: Maximum hardware flexibility, running on CPUs, edge devices, and older hardware.
Hardware needed: Any modern computer. Performance scales with available RAM and CPU/GPU resources.
Hugging Face Transformers
The standard Python library for working with language models. Transformers gives you full control over model loading, inference, fine-tuning, and deployment. It is more code-heavy than the other options but offers maximum flexibility for custom workflows.
Best for: Research, fine-tuning, custom inference pipelines, and integration into Python applications.
Hardware needed: NVIDIA GPU strongly recommended. CPU inference is possible but slow for large models.
Quick recommendation: If you just want to try running a model locally, start with Ollama. It is by far the simplest option. If you need to serve a model in production, use vLLM. If you need to run on a CPU or want maximum quantization options, use llama.cpp.
How to Choose the Right Model
The best model depends entirely on your use case, hardware, and requirements. Here is a decision framework:
If you need the best overall performance
Start with MiMo-V2.6-Pro (MIT, and the top open-weights score on the independent Artificial Analysis Intelligence Index as of late September), DeepSeek V4.1 Flash (MIT, the strongest agentic coding scores DeepSeek has published, and 31.82 on Vals' independent Terminal-Bench 4.0 board for the October 17 update), or Kimi K3 (the top open-weight GPQA Diamond result on record, at 93.5). If you want the largest MIT-licensed option, DeepSeek V4 Pro is still a strong pick. All four need multi-GPU infrastructure to self-host, and apart from the MiMo-V2.6 index results and the Vals runs their headline scores are vendor-reported. Meta's new Muse Spark Open is the biggest new name, but it scored 6.57 on the same Vals board and its custom license adds conditions, so it is not an automatic upgrade.
If you need to run on limited hardware
Qwen3.8-27B (Apache 2.0) or Muse Glimmer 30B (Apache 2.0) are your best bets: both are multimodal and fit on a single GPU with 4-bit weights. Gemma 4 12B and Phi-4 (14B) are lighter still, the Gemma 4 26B A4B MoE runs almost as fast as a 4B model, and Gemma 4 E2B and E4B are built for phones and laptops.
If you need long context
Llama 4 Scout still has the largest context window on this list at 10M tokens. A 1M window is now common among newer open models, including MiMo-V2.6-Pro, DeepSeek V4.1 Flash, Kimi K3, Reflection Beam, Muse Spark Open, Laguna S 2.1, and MiniMax M3, which uses sparse attention to keep 1M-context compute down.
If you need the most permissive license
MIT covers MiMo-V2.6-Pro and Flash, DeepSeek V4.1 Flash, DeepSeek V4 Pro, GLM-5.3-Flash, LongCat-2.0, and Phi-4. Apache 2.0 covers Reflection Beam, Jais 3, Qwen3.8-27B, Muse Glimmer 30B, Gemma 4, Mistral Large 3, Mistral Small 4, and Command A+. Both allow commercial use without scale thresholds. Llama 4 is permissive for most uses but has a threshold for very large-scale deployments, and Kimi K3, MiniMax M3, and Muse Spark Open ship under custom licenses you should read first. The tradeoff is real: Kimi K3, the largest open model and a top GPQA Diamond scorer, sits under a custom license, while the plain MIT and Apache 2.0 options give up some peak capability in exchange for no revenue thresholds and no access forms. Mistral Large 4 uses a modified MIT license that requires a separate commercial license for model-as-a-service businesses.
If you need strong coding capabilities
DeepSeek V4.1 Flash posts the highest Terminal-Bench 2.1 and DeepSWE scores of any model on this list that publishes them (vendor-reported), and its October 17 update scores 31.82 on Vals' independent Terminal-Bench 4.0 board. Laguna S 2.1 is the dedicated coding specialist that a small team can actually self-host at about 8B active parameters, and GLM-5.3-Flash adds vision for computer-use loops under MIT terms.
If you need RAG and document grounding
Command A+ is Cohere's current RAG-focused open model, with native citations and a plain Apache 2.0 license. It supersedes Command R+, which was built for the same grounding workflows but ships under a non-commercial license for the open weights.
Understanding Licenses
"Open source" means different things depending on who you ask. In the LLM world, models range from fully open (MIT/Apache) to "open weights" with restrictions. Here is a quick guide:
| License | Commercial Use | Modification | Key Restriction | Models |
|---|---|---|---|---|
| MIT | Yes | Yes | None | MiMo-V2.6-Pro and Flash, DeepSeek V4.1 Flash, DeepSeek V4 Pro, GLM-5.3-Flash, LongCat-2.0, Phi-4 |
| Apache 2.0 | Yes | Yes | None (must include notice) | Reflection Beam, Jais 3, Qwen3.8-27B, Muse Glimmer 30B, Gemma 4, Mistral Large 3, Mistral Small 4, Command A+ |
| Llama 4 Community | Yes* | Yes | 700M+ MAU requires Meta license | Llama 4 Scout, Maverick |
| Custom model licenses | Varies | Varies | Read each one: MiniMax M3, for example, requires attribution and notice for commercial use, and Muse Spark Open requires attribution plus a separate Meta agreement for hosting businesses above $20M in revenue | Kimi K3, MiniMax M3, Qwen3.8-Flash-Next, Muse Spark Open |
| CC-BY-NC | No* | Yes | Non-commercial only (need separate license) | Command R+ |
Always verify the current license terms on the model's official page before deploying in production. License terms can change between model versions.
Open Source vs Proprietary: When to Use Which?
Open source models are not always the right choice, and proprietary APIs are not always the wrong one. Here is a realistic assessment:
Choose Open Source When
- + Data privacy is critical (healthcare, legal, finance)
- + You need to fine-tune for a specific domain
- + High-volume usage would make API costs prohibitive
- + You need full control over the model and its behavior
- + Regulatory requirements demand on-premise deployment
- + You want to avoid vendor lock-in
Choose Proprietary APIs When
- + You need the absolute best performance
- + You do not want to manage infrastructure
- + Your usage volume is moderate
- + You need to move fast and iterate quickly
- + You want built-in safety and moderation
- + Budget for infrastructure engineers is limited
Many teams use a hybrid approach: proprietary APIs for the most demanding tasks and open source models for high-volume, lower-complexity work. For current API pricing across all providers, check our AI API Pricing Guide. You can also compare all models (both open and proprietary) on our model tracker.
Frequently Asked Questions
What is the best open-source LLM?
There is no single winner. Xiaomi's MiMo-V2.6-Pro posted the top open-weights score on the independent Artificial Analysis Intelligence Index (46) as of late September, DeepSeek V4.1 Flash (updated October 17 as V4.1-Flash-1017) and Moonshot's Kimi K3 lead the published agentic and reasoning benchmarks among open-weight models, DeepSeek V4 Pro and GLM-5.3-Flash are the strongest options under plain MIT terms, Reflection's Beam is the newest large Apache 2.0 option, and Qwen3.8-27B and Meta's Muse Glimmer 30B are the best picks that fit on a single GPU. Meta's larger Muse Spark Open is open weights under a custom license, not a permissive one. Most of these scores are vendor-reported, so test on your own workload.
Can I run LLMs on my own computer?
Yes. Tools like Ollama make it easy to run models locally. Smaller models (7B-13B parameters) run well on consumer GPUs. Larger models need more powerful hardware or quantization.
Are open-source LLMs as good as ChatGPT?
The gap is now small on many benchmarks. Kimi K3 reports 93.5 on GPQA Diamond and DeepSeek V4.1 Flash reports 90.9, against 96.0 for OpenAI's GPT-6 Astra (all vendor-reported). Proprietary models still lead on the hardest agentic work, such as computer use on OSWorld 2.0, where Claude Opus 5 reports 70.6 against 58.3 for Kimi K3, and long-horizon terminal work. On Vals' independent Terminal-Bench 4.0 board (October 18, 2026), Claude Opus 5.5 scores 65.15 against 31.82 for DeepSeek V4.1-Flash-1017 and 6.57 for Meta's Muse Spark Open.
What license do open-source LLMs use?
Licenses vary. DeepSeek, MiMo-V2.6, GLM-5.3-Flash, LongCat-2.0, and Phi-4 use MIT. Reflection Beam, Jais 3, Qwen3.8-27B, Gemma 4, Muse Glimmer 30B, Mistral Large 3, and Mistral Small 4 use Apache 2.0. Llama 4 uses the Llama 4 Community License (free for most uses), and Kimi K3, MiniMax M3, Mistral Large 4, and Meta's Muse Spark Open ship under custom licenses with extra conditions. Always check the specific license for commercial use.