Skip to content
All systems operational0 AI providers monitored, polled every 2 minutes
Live status

Last Updated: November 2, 2026

Best Open Source LLMs in 2026

The strongest open-source LLMs in 2026 are Xiaomi's MiMo-V2.6-Pro (September 21, 2026, MIT, and the top open-weights score on the independent Artificial Analysis Intelligence Index at 46 as of late September), DeepSeek V4.1 Flash (a 552B backbone with only 8B active per token in prefill, MIT, refreshed with the V4.1-Flash-1017 weights on October 17, and ahead of DeepSeek's own V4 Pro on most agentic coding benchmarks), Moonshot's Kimi K3 (the largest open-weight model published, at 2.8T total parameters with 104B active), DeepSeek V4 Pro and Z.ai's GLM-5.3-Flash (near-frontier quality under plain MIT terms), and Qwen3.8-27B and Meta's Muse Glimmer 30B (two of the most capable models that fit on a single GPU). October added Reflection's Beam (501B, Apache 2.0, no access gate), the Arabic-first Jais 3 family (Apache 2.0), and Meta's 816B Muse Spark Open, which ships under a custom license with a $20 million revenue clause. Raw capability and license freedom do not always line up, so weigh both. Most can be run locally with tools like Ollama, vLLM, or Hugging Face Transformers, given enough hardware.

The gap between open source and proprietary language models has narrowed dramatically. Models you can download and run yourself now compete with (and in some cases surpass) the APIs you pay for. This guide covers the best open source LLMs available right now, including how they compare, what licenses they use, and how to actually run them.

Comparison Table

ModelParametersContextLicenseArchitecture
Reflection Beam501B total1M tokensApache 2.0Mixture of Experts (MoE), text only
Muse Spark Open816B total1M tokensMuse Model LicenseMixture of Experts (MoE), natively multimodal
Jais 3 375B-A23B375B total512K tokensApache 2.0Mixture of Experts (MoE), Arabic-first
MiMo-V2.6-Pro1.02T total1,048,576 tokensMITMixture of Experts (MoE), natively omnimodal with text, image, video, and audio input
Ternary Bonsai 2 27B27.36B262K tokensApache 2.0Qwen3.8 27B architecture unchanged, ternary weights with FP16 group scaling and a blockwise Hadamard rotation
Atria Dawn Preview744B total256K tokensMITMixture of Experts (MoE) built on the GLM-5.2 foundation, FP8 weights
GLM-5.3 Flash320B total1M tokensMITMixture of Experts (MoE), hybrid linear plus sparse attention (IndexPool, mHC)
Qwen3.8-Flash-Next125B total262K native, extensible to 1M with YaRNqwen-community-1.0Mixture of Experts (MoE) with Gated DeltaNet, Qwen Sparse Attention, and n-gram embedding
Kimi K32.8T total1M tokensKimi K3 LicenseMixture of Experts (MoE), native MXFP4
Laguna S 2.1118B total1M tokensOpenMDW-1.1Mixture of Experts (MoE)
Muse Glimmer 30B29.6B dense131,072 tokensApache 2.0Dense Causal Transformer with Perception Encoder
Llama 4 Scout109B total10M tokensLlama 4 Community LicenseMixture of Experts (MoE)
Llama 4 Maverick400B total1M tokensLlama 4 Community LicenseMixture of Experts (MoE)
DeepSeek V4.1 Flash552B backbone1,048,576 tokensMITMixture of Experts (MoE) with a Causal Encoder-Decoder (CED) layout
DeepSeek V4 Pro1.6T total1M tokensMITMixture of Experts (MoE) with Hybrid Attention
DeepSeek V4 Flash284B total1M tokensMITMixture of Experts (MoE) with Hybrid Attention
MiniMax M3428B total1M tokensMiniMax Community LicenseMixture of Experts (MoE) with MiniMax Sparse Attention
LongCat-2.01.6T total1M tokens (native)MITMixture of Experts (MoE) with dynamic activation
Mistral Large 4About 1T total1M tokensMistral Ecosystem Open-Weight License (modified MIT)Granular Mixture of Experts (MoE) with 128 routed experts and 1 shared expert
Mistral Large 3675B total256K tokensApache 2.0Granular Mixture of Experts (MoE) with a 2.5B vision encoder
Mistral Small 4119B total256K tokensApache 2.0Mixture of Experts (MoE), 128 experts with 4 active
Qwen3.8-27B27.78B dense262K tokensApache 2.0Dense Transformer, native vision-language
Phi-414B16K tokensMITDense Transformer
Gemma 431B dense256K tokens (128K on E2B and E4B)Apache 2.0Dense and Mixture of Experts variants, hybrid local and global attention
Command A+218B total128K input / 64K max generationApache 2.0Mixture of Experts (MoE)
Command R+104B128K tokensCC-BY-NC (non-commercial); commercial license availableDense Transformer

Detailed Model Reviews

Reflection Beam

Reflection

501B total (23B active per token) | 1M tokens context | Mixture of Experts (MoE), text only | Apache 2.0 | Released: October 2026

Highlights

  • +Weights released October 16, 2026 under plain Apache 2.0, with no access form or approval step
  • +501B total parameters with only 23B active per token
  • +1M token context window
  • +Reflection's own API is free during its public beta

Best For

Teams that want a large text model with nothing between the download and production: no access gate, no revenue clause, and no license terms beyond the standard Apache notice. It is the newest large option for anyone whose legal team only signs off on Apache 2.0 or MIT.

Considerations

Text only, so it is no help for screenshot, chart, or video agents. We do not yet track an independent benchmark score for it, so the capability case rests on Reflection's own claims for now. The free API is a beta with no published price after it ends, and at 501B total parameters self-hosting still means a multi-GPU node.

Muse Spark Open

Meta

816B total (42B active per token) | 1M tokens context | Mixture of Experts (MoE), natively multimodal | Muse Model License | Released: October 2026

Highlights

  • +Released October 15, 2026 at 816B total parameters with 42B active, about twice the size of Llama 4 Maverick
  • +Natively multimodal with a 1M token context window
  • +Hosted by third-party providers at $1.25/$4.25 per 1M tokens; Meta does not serve it on its own Model API
  • +Weights on Hugging Face behind an access form with manual approval

Best For

Teams that want a large multimodal Meta model with long context on their own infrastructure, and that are comfortable working under a custom license rather than Apache 2.0 or MIT.

Considerations

Open weights here does not mean a permissive license. The Muse Model License requires attribution, and model-as-a-service businesses above $20 million in revenue over 12 months must notify Meta and sign a separate agreement, so a hosting company should read it before building on it. Early independent results are weak on agentic terminal work: Vals scores it 6.57 on Terminal-Bench 4.0 (October 18, 2026 board), against 31.82 for DeepSeek V4.1-Flash-1017, so test it on your workload before treating it as a frontier model.

Jais 3 375B-A23B

MBZUAI IFM and Inception42

375B total (23B active per token; the largest of six Jais 3 models) | 512K tokens context | Mixture of Experts (MoE), Arabic-first | Apache 2.0 | Released: October 2026

Highlights

  • +Six Apache 2.0 models released October 15, 2026, topping out at 375B total with 23B active
  • +Arabic-first, from MBZUAI's Institute of Foundation Models with Inception42
  • +512K token context window
  • +Text, code, tool use, and reasoning

Best For

Arabic-language products and regional deployments that want an Arabic-first model under plain Apache 2.0, with smaller sizes in the same family for lighter hardware.

Considerations

There is no hosted API, so you either run it yourself or wait for a third-party host. We do not yet track an independent benchmark score for it. For English-first coding or agent work, the general-purpose models on this list are the safer place to start.

MiMo-V2.6-Pro

Xiaomi

1.02T total (42B active per token; the MiMo-V2.6-Flash sibling is 309B total with 15B active) | 1,048,576 tokens context | Mixture of Experts (MoE), natively omnimodal with text, image, video, and audio input | MIT | Released: September 2026

Highlights

  • +Top open-weights score on the Artificial Analysis Intelligence Index at 46 as of late September 2026, level with Grok 4.7 (independent)
  • +Vals Index 59.47 percent for Pro and 59.58 for Flash at launch, both ahead of DeepSeek V4.1 Flash at 57.86 (independent, September 2026)
  • +DeepSWE v1.1 at 71.9 and Terminal-Bench 2.1 at 89.9, with Flash at 67.9 and 87.6 (vendor-reported)
  • +Text, image, video, and audio input in one model, with up to 131,072 output tokens
  • +API at $0.435/$0.87 per 1M tokens with cached input at $0.0036; Flash is $0.14/$0.28, both unchanged from V2.5
  • +MIT weights on Hugging Face as XiaomiMiMo/MiMo-V2.6-Pro-RL and XiaomiMiMo/MiMo-V2.6-Flash-RL

Best For

The highest-scoring open-weight model on the Artificial Analysis Intelligence Index as of late September 2026, and the pick for omnimodal agents that read video and audio in the same run under plain MIT terms. MiMo-V2.6-Flash, released the same day, scores fractionally higher on the Vals Index (59.58 against 59.47) at about a third of the Pro rate, so test Flash first if cost or cluster size matters.

Considerations

The long-horizon terminal gap to the closed frontier is still visible: Terminal-Bench 4.0 sits at 34.9 for Pro and 28.8 for Flash, against 66.4 for Claude Opus 5.5 on Anthropic's table (all vendor-reported). Vals' independent Terminal-Bench 4.0 runs put Pro at 31.31 and Flash at 24.24, against 65.15 for Opus 5.5. Xiaomi's 82.0 computer-use figure is on OSWorld-Verified, a different task set from OSWorld 2.0, so do not compare it with OSWorld 2.0 numbers elsewhere on this page. At 1.02T total parameters the Pro model is a cluster deployment rather than a workstation one, so most teams will meet it through Xiaomi's API or a host. A Pro-UltraSpeed tier serves the same model faster at ten times the Pro price.

Ternary Bonsai 2 27B

PrismML

27.36B (24.35B language backbone, 2.54B embeddings and LM head, 0.47B vision tower) | 262K tokens context | Qwen3.8 27B architecture unchanged, ternary weights with FP16 group scaling and a blockwise Hadamard rotation | Apache 2.0 | Released: September 2026

Highlights

  • +A 5.93 GB file against 53.80 GB in FP16, about 9.1x smaller, running on a 16 GB laptop or one 24 GB GPU
  • +Every weight is -1, 0, or +1 with one FP16 scale per group of 128, landing at 1.76 effective bits per weight
  • +Retains 98.2 percent of the parent model average across 20 benchmarks, 83.9 against 85.4 (vendor-reported)
  • +Beats an IQ2_XXS build of the same model by a wide margin: AIME26 95.83 against 78.6, LiveCodeBench v6 90.07 against 70.05
  • +142.5 tokens per second on an RTX 5090 and 46.8 on an M5 Max at batch size 1

Best For

Running a genuinely capable multimodal 27B on hardware you already own. It was one of the clearest local-inference releases of September 2026, and the Apache 2.0 license plus GGUF and MLX builds mean there is no gate between reading about it and running it.

Considerations

The 98.2 percent is an average and the losses are not evenly spread. Long-horizon agent work is where the compression bites: Terminal-Bench 2.1 drops to 52.8 from 69.7 and SWE-bench Verified to 60.8 from 80.6, roughly 75 percent retention, and both sit outside the 20-benchmark average. Knowledge and reasoning retains 96.9 percent and vision 96.3. Stock llama.cpp cannot load PTQ1_0 or PQ2_0, so you need PrismML's fork or its MLX runtime, and low reasoning effort is not supported. Every figure is PrismML's own and has not been independently reproduced.

Atria Dawn Preview

Shanghai AI Laboratory

744B total (Mixture of Experts) | 256K tokens context | Mixture of Experts (MoE) built on the GLM-5.2 foundation, FP8 weights | MIT | Released: September 2026

Highlights

  • +MIT weights on a 744B agentic model, one of the most permissive licenses at that scale
  • +Built for long-horizon research agents: continuous environmental understanding, tool use, and multistep completion
  • +Targets carrying scientific work from a paper to executable experiments, reproducible metrics, and an inspectable report
  • +Published on Hugging Face and ModelScope with no blog post and no paper on release day
  • +The technical report followed on arXiv three days later with more than 140 authors

Best For

Research groups building autonomous experiment loops who need the weights rather than an endpoint, and anyone studying how a large agentic MoE is trained, since the report is unusually detailed for a Chinese lab release.

Considerations

Preview is in the name. There was no independent evaluation at launch and the lab published evaluation results on its own site rather than through a third party. At 744B parameters in FP8 this is not laptop hardware: it is a cluster model, so most people will meet it through a host rather than self-hosting. The GLM-5.2 foundation also means its lineage traces back to Z.ai, one of six labs named in the September 8, 2026 joint CISA, NSA, and FBI distillation advisory, which is a procurement question rather than a technical one.

GLM-5.3 Flash

Z.ai (Zhipu AI)

320B total (roughly 18B active per token, 45 layers) | 1M tokens context | Mixture of Experts (MoE), hybrid linear plus sparse attention (IndexPool, mHC) | MIT | Released: August 2026

Highlights

  • +First natively multimodal GLM-5: text, image, and video in one stack rather than a bolted-on vision head
  • +Plain MIT weights on Hugging Face at zai-org/GLM-5.3-Flash, published on release day
  • +DeepSWE 63.4 against GLM-5.2 at 46.2 and AutomationBench 48.8 against 26.2 (vendor-reported)
  • +Roughly 3.0x less attention compute and a 4.4x smaller KV cache than text GLM-5.3
  • +List pricing of $0.15 input and $0.50 output per 1M tokens, about a tenth of GLM-5.3 on input

Best For

Multimodal coding and computer-use loops at flash pricing, and any team that wants a capable vision-language agent on unambiguous MIT terms at 18B active parameters.

Considerations

Every published score is self-reported by Z.ai on the launch post, with no independent run yet. The 50 percent launch promotion ended on September 9, 2026, so the $0.15/$0.50 list rate is the number to budget. Thinking cannot be disabled, since thinking.type accepts enabled only, which means short prompts still pay reasoning tokens. And do not confuse it with text-only GLM-5.3, a different 753B model at $1.40/$4.40. BabyVision at 53.4 trails Gemini 3.7 Flash at 70.9 on the launch table (Google has since deprecated 3.7 Flash), which is the clearest published weakness.

Qwen3.8-Flash-Next

Alibaba

125B total (6B active per token) plus a 51B n-gram embedding table and a 4B MTP layer | 262K native, extensible to 1M with YaRN context | Mixture of Experts (MoE) with Gated DeltaNet, Qwen Sparse Attention, and n-gram embedding | qwen-community-1.0 | Released: August 2026

Highlights

  • +Only 6B parameters activated per token, among the lowest active counts of any capable open model this year
  • +The 51B n-gram table indexes 20 million bigrams and trigrams and can sit in system RAM instead of GPU memory
  • +Explicit preview of the architecture that will underpin Qwen4
  • +DeepSWE 1.1 at 58.7 and SWE-bench Pro at 62.5, ahead of DeepSeek-V4-Flash-0731 at 54.4 and 56.0 (vendor-reported)
  • +Alibaba claims it beats the 397B Qwen3.7-Plus at roughly one ninth the training cost

Best For

Self-hosting shops that want a multimodal agent with a very low active-parameter count, and teams that want an early read on the Qwen4 architecture before the full release.

Considerations

This is labeled experimental and Alibaba says so. The license is a custom qwen-community-1.0, not the plain Apache 2.0 that covers Qwen3.8-27B, so read it before commercial deployment. All benchmark figures are self-reported on the Hugging Face card, NL2Repo-Bench regresses to 48.1 against DeepSeek at 54.2, and OSWorld 2.0 sits at 19.4, still close to a coin flip on full task success. It is also easy to confuse with the hosted Qwen3.8-Flash on QwenCloud, which is a different product at $0.16/$0.47 with a 1M default window.

Kimi K3

Moonshot AI

2.8T total (104B active per token, 896 experts, 16 routed plus 2 shared) | 1M tokens context | Mixture of Experts (MoE), native MXFP4 | Kimi K3 License | Released: July 2026

Highlights

  • +Largest open-weight model ever shipped at 2.8 trillion parameters
  • +Strongest open-weight GPQA Diamond result on record at 93.5 percent (vendor-reported)
  • +Scored 1,679 points on Frontend Code Arena, ahead of Claude Fable 5
  • +Native vision alongside text, with a 1M token context window
  • +API pricing at $3.00 input (or $0.30 on a cache hit) and $15.00 output per 1M tokens

Best For

Teams that want the closest open-weight model to the proprietary frontier for general knowledge work, science reasoning, and visual tasks, and are content to reach it through a hosted API.

Considerations

Open weights and self-hostable are two different claims here. K3 ships natively in MXFP4 with no FP16 checkpoint, and even at 4-bit it needs roughly 1,450GB of accelerator memory before the KV cache, so it wants eight B200-class cards. Most usage routes through hosted inference, and calls to Moonshot's own API are processed under Chinese jurisdiction. Moonshot is also the subject of a July 2026 US government distillation and export-control accusation that remains contested.

Laguna S 2.1

poolside

118B total (roughly 8B active per token) | 1M tokens context | Mixture of Experts (MoE) | OpenMDW-1.1 | Released: July 2026

Highlights

  • +Only about 8B active parameters, so a small team can genuinely self-host it
  • +70.2 percent on Terminal-Bench 2.1 in thinking mode and 78.5 percent on SWE-Bench Multilingual
  • +Weights on Hugging Face day one, no waitlist and no delayed drop
  • +Hosted pricing of $0.10 input and $0.20 output per 1M tokens, among the cheapest anywhere
  • +poolside published every unedited benchmark trajectory and disclosed its own harness

Best For

Cost-sensitive agentic coding at volume, terminal and shell automation, and any team that actually intends to run the weights rather than call someone else's endpoint.

Considerations

This is a coding specialist, not a general assistant: text and code only, no vision. The headline Terminal-Bench number comes from poolside's own harness, which the company disclosed openly, but it still has not been reproduced by an independent party. As poolside's first major public model it has no production track record yet.

Muse Glimmer 30B

Meta

29.6B dense (including a 1.8B vision encoder) | 131,072 tokens context | Dense Causal Transformer with Perception Encoder | Apache 2.0 | Released: August 2026

Highlights

  • +Plain Apache 2.0, with none of the scale-based carve-outs in the Llama 4 Community License
  • +Distilled from Muse Spark and built for agents that run locally without cloud access
  • +76.0 on SWE-Bench Verified, 51.2 on SWE-Bench Pro, and 83.5 on GPQA Diamond at high reasoning (Meta-reported)
  • +Text and image input, so agents can read screenshots, charts, and documents
  • +Meta says 4-bit weights shrink the language model under 20 GB, fitting a 24 GB or 32 GB card with room for the KV cache

Best For

Always-on local agents and private multimodal workflows on a single GPU. It is the Meta open-weight model to pick for a single GPU, and the natural upgrade for teams running Llama 4 today.

Considerations

All scores come from Meta's own model card. The 131K context window is short next to the 1M windows elsewhere on this list, so it suits long-running loops better than whole-repository passes. The weights live under the meta-models organization on Hugging Face rather than meta-llama, which matters if you script downloads. Meta's much larger Muse Spark Open (816B total) ships under the custom Muse Model License rather than Apache 2.0, while Muse Spark 1.3 and Muse Wonder remain API-only.

Llama 4 Scout

Meta

109B total (17B active per token, 16 experts) | 10M tokens context | Mixture of Experts (MoE) | Llama 4 Community License | Released: April 2025

Highlights

  • +Enormous 10M token context window
  • +Competitive with GPT-4o on many benchmarks
  • +Efficient MoE architecture keeps inference costs low
  • +Supports 12 languages natively
  • +Multimodal: handles text and images

Best For

Long-context applications, multilingual tasks, and general-purpose use where you need a strong all-around model with exceptional context length.

Considerations

The Llama 4 Community License is permissive for most uses but has restrictions for very large-scale commercial deployments (700M+ monthly active users). The 10M context window requires significant memory.

Llama 4 Maverick

Meta

400B total (17B active per token, 128 experts) | 1M tokens context | Mixture of Experts (MoE) | Llama 4 Community License | Released: April 2025

Highlights

  • +Meta's largest open-weight model by total parameters until Muse Spark Open (816B) arrived in October 2026
  • +Native 1M token context window
  • +Good for complex multi-step tasks
  • +Multimodal with strong image understanding

Best For

Teams already standardized on the Llama ecosystem that want a large multimodal MoE with a 1M context window.

Considerations

Requires significant hardware to run (multi-GPU setup). Same license restrictions as Scout. It has aged quickly: our benchmark data shows 24.0 on SWE-bench Verified, against 76.0 for Meta's own Muse Glimmer 30B, so newer open models are the better pick for agentic coding.

DeepSeek V4.1 Flash

DeepSeek

552B backbone (8B active per token in prefill, 16B in decode) | 1,048,576 tokens context | Mixture of Experts (MoE) with a Causal Encoder-Decoder (CED) layout | MIT | Released: September 2026

Highlights

  • +DeepSeek's own comparison puts it ahead of V4 Pro on most agentic and coding rows, though V4 Pro keeps the higher GPQA Diamond score (92.4 to 90.9)
  • +GPQA Diamond 90.9, Terminal-Bench 2.1 at 90.6, DeepSWE v1.1 at 74.2 (all vendor-reported)
  • +Causal Encoder-Decoder design activates only 8B parameters per token during prefill
  • +Native multimodal vision in a 552B open-weight model
  • +MIT license with weights on Hugging Face, including the dated V4.1-Flash-1017 update published October 17, 2026
  • +V4.1-Flash-1017 scores 31.82 on Vals' independent Terminal-Bench 4.0 board (October 18, 2026)
  • +API at $0.30/$1.20 per 1M peak, halving to $0.15/$0.60 off-peak, unchanged by the 1017 update

Best For

The strongest open-weight release of September 2026 and the clearest case that the cheap tier has caught the flagship tier. At 8B active parameters in prefill it is far more deployable than V4 Pro or Kimi K3, and DeepSeek's own table shows it beating the 1.6T V4 Pro on Terminal-Bench 2.1, DeepSWE, and CyberGym. Best pick for agentic coding and terminal work on MIT terms.

Considerations

Most headline numbers are vendor-reported. The main independent read so far is Vals' Terminal-Bench 4.0 board, where the 1017 update scores 31.82 against 65.15 for Claude Opus 5.5, so the gap to the closed frontier on long-horizon terminal work is still wide. The win over V4 Pro is not across the board either: V4 Pro still scores higher on GPQA Diamond and Humanity's Last Exam in DeepSeek's own table. On the API it is served as deepseek-flash, which replaced the retired deepseek-v4-flash endpoint. The API price doubles during peak windows (Monday to Friday, 01:00 to 04:00 and 06:00 to 10:00 UTC), so a workload that cannot schedule itself should budget $0.30/$1.20 rather than the off-peak rate. The widely quoted $0.003 figure is the off-peak cache-hit price and applies only to reused context. Self-hosting 552B backbone parameters still needs real infrastructure even at 8B active.

DeepSeek V4 Pro

DeepSeek

1.6T total (49B active per token) | 1M tokens context | Mixture of Experts (MoE) with Hybrid Attention | MIT | Released: April 2026

Highlights

  • +Near-frontier performance: 80.6% on SWE-bench Verified
  • +MIT license allows unrestricted commercial use
  • +Native 1M token context window
  • +Hybrid Attention architecture for better long-context recall
  • +Open weights stay downloadable under MIT; the DeepSeek API retired the model on September 14, 2026 and routes deepseek-v4-pro calls to V4.1 Flash

Best For

The largest MIT-licensed model in the DeepSeek line, and still its top GPQA Diamond scorer. Near-frontier coding and reasoning at a fraction of proprietary pricing, for teams that want unrestricted license freedom, which Kimi K3 and Laguna S 2.1 do not offer.

Considerations

The 1.6T parameter model requires multi-GPU infrastructure to self-host. It is no longer served on DeepSeek's own API: since 04:00 UTC on September 14, 2026, deepseek-v4-pro requests route to V4.1 Flash at V4.1 Flash rates until a V4.1 Pro ships, so hosted access now means a third-party provider. V4.1 Flash is cheaper and ahead on most agentic benchmarks, so check it first.

DeepSeek V4 Flash

DeepSeek

284B total (13B active per token) | 1M tokens context | Mixture of Experts (MoE) with Hybrid Attention | MIT | Released: April 2026

Highlights

  • +Open weights on Hugging Face, including a July 2026 refresh (DeepSeek-V4-Flash-0731)
  • +Native 1M token context window
  • +Strong performance for its active parameter count
  • +MIT license, same as V4 Pro
  • +Efficient enough to run on smaller GPU setups

Best For

Self-hosted, cost-sensitive workloads where you need 1M context on a budget and already have V4 Flash validated in production. Classification, summarization, and batch processing tasks where V4 Pro is overkill.

Considerations

DeepSeek has retired the deepseek-v4-flash API endpoint and routes it to V4.1 Flash, so V4 Flash is no longer available on DeepSeek's own API. V4.1 Flash beats it on nearly every row of DeepSeek's own comparison table, so new projects should start there.

MiniMax M3

MiniMax

428B total (roughly 23B active per token) | 1M tokens context | Mixture of Experts (MoE) with MiniMax Sparse Attention | MiniMax Community License | Released: June 2026

Highlights

  • +MiniMax Sparse Attention cuts per-token compute at 1M context to roughly 1/20th of M2
  • +Claimed 59% on SWE-Bench Pro and 83.5 on BrowseComp
  • +Multimodal input: text, image, and video
  • +API pricing at $0.30/$1.20 per 1M tokens, among the cheapest at this tier
  • +Weights now published on Hugging Face (MiniMaxAI/MiniMax-M3)

Best For

Cost-sensitive agentic coding and browser-agent workloads that need very long context, through the API or on a small cluster now that the weights are downloadable.

Considerations

Launch benchmarks were run on MiniMax infrastructure with agent scaffolding (Claude Code, Mini-SWE-Agent, Terminus), so treat them as unverified until independent results appear. The license is a custom community license, not Apache or MIT: any commercial use requires a prominent "Built with MiniMax M3" notice plus a one-time notice to MiniMax, and products above $20 million in yearly revenue need prior written authorization.

LongCat-2.0

Meituan

1.6T total (33 to 56B active per token, dynamic) | 1M tokens (native) context | Mixture of Experts (MoE) with dynamic activation | MIT | Released: June 2026

Highlights

  • +Fully MIT licensed on GitHub and Hugging Face
  • +Dynamic activation of 33 to 56 billion parameters per token, adjusting to task difficulty
  • +Purpose-built for agentic coding: code understanding, generation, and execution in agent workflows
  • +Self-reported 59.5 on SWE-Bench Pro, ahead of Gemini 3.1 Pro, GPT-5.5, and Claude Opus 4.6 by Meituan's measure
  • +First trillion-parameter release trained end-to-end on a 50,000-card domestic Chinese compute cluster
  • +Pretrained on 30T+ tokens spanning Chinese, English, multilingual, and code data

Best For

Sovereign or geopolitically sensitive deployments where domestic-chip provenance matters, and agentic coding workloads with variable per-token difficulty that benefit from dynamic activation.

Considerations

Launch benchmarks are self-reported; independent verification is still pending. At 1.6T total parameters, self-hosting inference at meaningful throughput requires multi-GPU or multi-node infrastructure. A preview version had been running quietly on OpenRouter and longcat.ai for weeks before the announcement, so hosted access is easier than self-host on day one.

Mistral Large 4

Mistral AI

About 1T total (about 52B active per token) | 1M tokens context | Granular Mixture of Experts (MoE) with 128 routed experts and 1 shared expert | Mistral Ecosystem Open-Weight License (modified MIT) | Released: October 2026

Highlights

  • +Open weights released October 29, 2026, three weeks after the public preview
  • +Ungated Hugging Face repo with text and image input
  • +Artificial Analysis Coding Agent Index of 48 percent, effectively tied with GLM-5.3 at 47 percent fewer tokens per task (vendor-reported)
  • +About 41 percent on Terminal-Bench 4.0 (vendor-reported, not independently reproduced)
  • +Hosted API at $0.70/$2.10 per 1M tokens for teams that do not want to serve it themselves

Best For

Teams that want a frontier-scale European model they can run themselves, including agentic coding and long-context work on multi-GPU Blackwell nodes.

Considerations

The hardware bar is high: the FP8 release needs about 1TB of VRAM, and even the official NVFP4 checkpoint needs about 520GB across four B200s. The license is MIT with one condition, so running a model-as-a-service business on it requires a separate commercial license from Mistral. Internal use does not.

Mistral Large 3

Mistral AI

675B total (41B active per token) | 256K tokens context | Granular Mixture of Experts (MoE) with a 2.5B vision encoder | Apache 2.0 | Released: December 2025

Highlights

  • +Apache 2.0 weights for a frontier-scale European model
  • +Multilingual across dozens of languages, including major European and Asian languages
  • +Image input alongside text
  • +Native function calling and JSON output
  • +Mistral says the FP8 build runs on a single node of B200s or H200s

Best For

European language applications and enterprise use cases where a permissive license and a European vendor both matter. Also strong for tool-using and function-calling applications.

Considerations

At 675B total parameters it needs a full multi-GPU node even in FP8, or an NVFP4 build on a node of H100s or A100s. For lighter deployments, Mistral Small 4 covers much of the same feature set at a fraction of the size. Mistral deprecated the hosted mistral-large-2512 endpoint on October 31, 2026, with retirement on April 30, 2027, in favor of Mistral Large 4. The Apache 2.0 weights are unaffected.

Mistral Small 4

Mistral AI

119B total (6.5B active per token) | 256K tokens context | Mixture of Experts (MoE), 128 experts with 4 active | Apache 2.0 | Released: March 2026

Highlights

  • +Only 6.5B parameters active per token, so it serves quickly
  • +One model for instruct, reasoning, and coding work, with reasoning effort set per request
  • +Text and image input
  • +Native function calling and JSON output
  • +Apache 2.0 license

Best For

Applications where speed and cost matter more than absolute capability. Great for tool-using agents, classification tasks, and high-throughput workloads.

Considerations

Despite the Small name this is a 119B model, so the full weights need server-class GPU memory even though only 6.5B parameters fire per token. Mistral publishes an NVFP4 checkpoint to cut that footprint.

Qwen3.8-27B

Alibaba

27.78B dense | 262K tokens context | Dense Transformer, native vision-language | Apache 2.0 | Released: August 2026

Highlights

  • +Apache 2.0 with no size or usage carve-outs, unusual at this capability level
  • +Natively multimodal out of the box: text, images, and hour-scale video
  • +Terminal-Bench 2.1 rises from 63.4 to 73.0 against Qwen3.6-27B (vendor-reported)
  • +OSWorld-Verified jumps from 63.9 to 84.3 and DeepSWE 1.1 from 13.3 to 42.2
  • +Fits on a single high-memory card at 4-bit, so one workstation runs it

Best For

The strongest locally deployable multimodal model near 30 billion parameters. Best pick for teams that want vision and video understanding on their own hardware under a permissive license, without the multi-GPU bill that DeepSeek V4 Pro or Kimi K3 demand.

Considerations

Every score above comes from Alibaba's own model card and has not been independently reproduced. It is a dense 27B model, so it will not match 1T-class MoE flagships on hardest-case reasoning. The 262K context window is generous for the size but well short of the 1M windows elsewhere on this list.

Phi-4

Microsoft

14B | 16K tokens context | Dense Transformer | MIT | Released: December 2024

Highlights

  • +Outstanding performance for its small size
  • +Strong math and reasoning capabilities
  • +Runs on consumer hardware (even laptops)
  • +MIT license allows unrestricted use
  • +Trained on high-quality synthetic data

Best For

On-device applications, edge computing, and scenarios where you need good reasoning in a small package. Excellent for math-heavy tasks and as a component in larger systems.

Considerations

Limited context window (16K). Knowledge cutoff may miss recent events. Less capable than larger models for open-ended creative tasks.

Gemma 4

Google DeepMind

31B dense (also E2B, E4B, 12B, and a 26B A4B MoE) | 256K tokens (128K on E2B and E4B) context | Dense and Mixture of Experts variants, hybrid local and global attention | Apache 2.0 | Released: April 2026

Highlights

  • +Apache 2.0, replacing the custom Gemma Terms of Use that covered earlier generations
  • +Five sizes, from on-device E2B up to a 31B dense model
  • +Text and image input on every size, with audio on E2B, E4B, and 12B
  • +84.3 percent on GPQA Diamond for the 31B, against 42.4 for Gemma 3 27B (Google-reported)
  • +The 26B A4B MoE activates about 4B parameters per token and runs almost as fast as a 4B model

Best For

Fine-tuning experiments, mobile and edge applications, and single-GPU deployments. E2B and E4B target phones and laptops, while the 12B, 26B A4B, and 31B fit consumer GPUs and workstations.

Considerations

All benchmark figures come from Google's own model card. The small E2B and E4B models cap context at 128K, and even the 256K ceiling on the larger sizes is well short of the 1M windows elsewhere on this list. The MoE variant is fast, but its memory footprint still reflects all 26B parameters.

Command A+

Cohere

218B total (25B active per token) | 128K input / 64K max generation context | Mixture of Experts (MoE) | Apache 2.0 | Released: May 2026

Highlights

  • +Fully Apache 2.0 licensed (Cohere's first), unrestricted commercial use
  • +Multimodal reasoning: text and image input, native tool use
  • +Runs on a single NVIDIA B200 or two H100s at W4A4 quantization
  • +Lossless quantization across BF16, FP8, and W4A4 on Hugging Face
  • +48 language coverage, with new tokenizer that cuts tokens 16 to 20% in Arabic, Korean, and Japanese
  • +Artificial Analysis Intelligence Index of 37; MMMU 75.1%, MathVista 80.6%

Best For

Enterprises that need sovereign, self-hostable AI with native citations and RAG, plus a permissive license for production. Strong fit for agentic workflows across regulated industries (financial services, healthcare, public sector).

Considerations

Trails the strongest Chinese open MoEs (DeepSeek V4 Pro, GLM, MiniMax) on the broadest general-intelligence benchmarks. Best paired with Cohere's North platform if you want the integrated agentic workspace. API pricing for the hosted version was not published at launch.

Command R+

Cohere

104B | 128K tokens context | Dense Transformer | CC-BY-NC (non-commercial); commercial license available | Released: April 2024

Highlights

  • +Purpose-built for RAG (Retrieval-Augmented Generation)
  • +Excellent at grounding responses in provided documents
  • +Strong citation and attribution capabilities
  • +Good multilingual support (10+ languages)
  • +Reliable tool use and function calling

Best For

RAG applications where you need the model to carefully reference and cite source documents. Enterprise search, knowledge bases, and document Q&A.

Considerations

Superseded by Command A+ in May 2026, which is Apache 2.0 and multimodal. Keep Command R+ in mind only for existing deployments; new projects should default to Command A+.

How to Run LLMs Locally

Running an LLM on your own hardware gives you full control, complete privacy, zero per-request costs, and the ability to customize models to your needs. Here are the main tools for local deployment:

Ollama

The easiest way to run LLMs locally. Ollama provides a simple command-line interface that handles downloading, configuring, and running models. One command to install, one command to run. It supports Mac, Linux, and Windows, and works with most popular open source models.

# Install Ollama, then:

ollama run qwen3.8:27b

ollama run muse-glimmer:30b

ollama run llama4:scout

Best for: Getting started quickly, personal use, development and testing.
Hardware needed: 8GB+ RAM for small models (7B), 16GB+ for medium (14B), 32GB+ for large (70B+).

vLLM

A high-performance inference engine designed for production serving. vLLM uses PagedAttention and other optimizations to achieve much higher throughput than naive implementations. It provides an OpenAI-compatible API, making it a drop-in replacement for proprietary APIs.

pip install vllm

vllm serve Qwen/Qwen3.8-27B

Best for: Production deployments, high-throughput serving, multi-user applications.
Hardware needed: NVIDIA GPU(s) with enough VRAM for the model. A100 or H100 recommended for large models.

llama.cpp

A C/C++ inference engine that runs LLMs on CPUs (and GPUs). It is the foundation that many other tools (including Ollama) build on. llama.cpp is known for its aggressive quantization support, allowing you to run large models on surprisingly modest hardware by reducing precision from 16-bit to 4-bit or even 2-bit.

# Install from llama.app, or build from github.com/ggml-org/llama.cpp, then:

llama cli -hf ggml-org/Qwen3.5-0.8B-GGUF

llama serve -hf ggml-org/Qwen3.5-0.8B-GGUF

Best for: Maximum hardware flexibility, running on CPUs, edge devices, and older hardware.
Hardware needed: Any modern computer. Performance scales with available RAM and CPU/GPU resources.

Hugging Face Transformers

The standard Python library for working with language models. Transformers gives you full control over model loading, inference, fine-tuning, and deployment. It is more code-heavy than the other options but offers maximum flexibility for custom workflows.

Best for: Research, fine-tuning, custom inference pipelines, and integration into Python applications.
Hardware needed: NVIDIA GPU strongly recommended. CPU inference is possible but slow for large models.

Quick recommendation: If you just want to try running a model locally, start with Ollama. It is by far the simplest option. If you need to serve a model in production, use vLLM. If you need to run on a CPU or want maximum quantization options, use llama.cpp.

How to Choose the Right Model

The best model depends entirely on your use case, hardware, and requirements. Here is a decision framework:

If you need the best overall performance

Start with MiMo-V2.6-Pro (MIT, and the top open-weights score on the independent Artificial Analysis Intelligence Index as of late September), DeepSeek V4.1 Flash (MIT, the strongest agentic coding scores DeepSeek has published, and 31.82 on Vals' independent Terminal-Bench 4.0 board for the October 17 update), or Kimi K3 (the top open-weight GPQA Diamond result on record, at 93.5). If you want the largest MIT-licensed option, DeepSeek V4 Pro is still a strong pick. All four need multi-GPU infrastructure to self-host, and apart from the MiMo-V2.6 index results and the Vals runs their headline scores are vendor-reported. Meta's new Muse Spark Open is the biggest new name, but it scored 6.57 on the same Vals board and its custom license adds conditions, so it is not an automatic upgrade.

If you need to run on limited hardware

Qwen3.8-27B (Apache 2.0) or Muse Glimmer 30B (Apache 2.0) are your best bets: both are multimodal and fit on a single GPU with 4-bit weights. Gemma 4 12B and Phi-4 (14B) are lighter still, the Gemma 4 26B A4B MoE runs almost as fast as a 4B model, and Gemma 4 E2B and E4B are built for phones and laptops.

If you need long context

Llama 4 Scout still has the largest context window on this list at 10M tokens. A 1M window is now common among newer open models, including MiMo-V2.6-Pro, DeepSeek V4.1 Flash, Kimi K3, Reflection Beam, Muse Spark Open, Laguna S 2.1, and MiniMax M3, which uses sparse attention to keep 1M-context compute down.

If you need the most permissive license

MIT covers MiMo-V2.6-Pro and Flash, DeepSeek V4.1 Flash, DeepSeek V4 Pro, GLM-5.3-Flash, LongCat-2.0, and Phi-4. Apache 2.0 covers Reflection Beam, Jais 3, Qwen3.8-27B, Muse Glimmer 30B, Gemma 4, Mistral Large 3, Mistral Small 4, and Command A+. Both allow commercial use without scale thresholds. Llama 4 is permissive for most uses but has a threshold for very large-scale deployments, and Kimi K3, MiniMax M3, and Muse Spark Open ship under custom licenses you should read first. The tradeoff is real: Kimi K3, the largest open model and a top GPQA Diamond scorer, sits under a custom license, while the plain MIT and Apache 2.0 options give up some peak capability in exchange for no revenue thresholds and no access forms. Mistral Large 4 uses a modified MIT license that requires a separate commercial license for model-as-a-service businesses.

If you need strong coding capabilities

DeepSeek V4.1 Flash posts the highest Terminal-Bench 2.1 and DeepSWE scores of any model on this list that publishes them (vendor-reported), and its October 17 update scores 31.82 on Vals' independent Terminal-Bench 4.0 board. Laguna S 2.1 is the dedicated coding specialist that a small team can actually self-host at about 8B active parameters, and GLM-5.3-Flash adds vision for computer-use loops under MIT terms.

If you need RAG and document grounding

Command A+ is Cohere's current RAG-focused open model, with native citations and a plain Apache 2.0 license. It supersedes Command R+, which was built for the same grounding workflows but ships under a non-commercial license for the open weights.

Understanding Licenses

"Open source" means different things depending on who you ask. In the LLM world, models range from fully open (MIT/Apache) to "open weights" with restrictions. Here is a quick guide:

LicenseCommercial UseModificationKey RestrictionModels
MITYesYesNoneMiMo-V2.6-Pro and Flash, DeepSeek V4.1 Flash, DeepSeek V4 Pro, GLM-5.3-Flash, LongCat-2.0, Phi-4
Apache 2.0YesYesNone (must include notice)Reflection Beam, Jais 3, Qwen3.8-27B, Muse Glimmer 30B, Gemma 4, Mistral Large 3, Mistral Small 4, Command A+
Llama 4 CommunityYes*Yes700M+ MAU requires Meta licenseLlama 4 Scout, Maverick
Custom model licensesVariesVariesRead each one: MiniMax M3, for example, requires attribution and notice for commercial use, and Muse Spark Open requires attribution plus a separate Meta agreement for hosting businesses above $20M in revenueKimi K3, MiniMax M3, Qwen3.8-Flash-Next, Muse Spark Open
CC-BY-NCNo*YesNon-commercial only (need separate license)Command R+

Always verify the current license terms on the model's official page before deploying in production. License terms can change between model versions.

Open Source vs Proprietary: When to Use Which?

Open source models are not always the right choice, and proprietary APIs are not always the wrong one. Here is a realistic assessment:

Choose Open Source When

  • + Data privacy is critical (healthcare, legal, finance)
  • + You need to fine-tune for a specific domain
  • + High-volume usage would make API costs prohibitive
  • + You need full control over the model and its behavior
  • + Regulatory requirements demand on-premise deployment
  • + You want to avoid vendor lock-in

Choose Proprietary APIs When

  • + You need the absolute best performance
  • + You do not want to manage infrastructure
  • + Your usage volume is moderate
  • + You need to move fast and iterate quickly
  • + You want built-in safety and moderation
  • + Budget for infrastructure engineers is limited

Many teams use a hybrid approach: proprietary APIs for the most demanding tasks and open source models for high-volume, lower-complexity work. For current API pricing across all providers, check our AI API Pricing Guide. You can also compare all models (both open and proprietary) on our model tracker.

Frequently Asked Questions

What is the best open-source LLM?

There is no single winner. Xiaomi's MiMo-V2.6-Pro posted the top open-weights score on the independent Artificial Analysis Intelligence Index (46) as of late September, DeepSeek V4.1 Flash (updated October 17 as V4.1-Flash-1017) and Moonshot's Kimi K3 lead the published agentic and reasoning benchmarks among open-weight models, DeepSeek V4 Pro and GLM-5.3-Flash are the strongest options under plain MIT terms, Reflection's Beam is the newest large Apache 2.0 option, and Qwen3.8-27B and Meta's Muse Glimmer 30B are the best picks that fit on a single GPU. Meta's larger Muse Spark Open is open weights under a custom license, not a permissive one. Most of these scores are vendor-reported, so test on your own workload.

Can I run LLMs on my own computer?

Yes. Tools like Ollama make it easy to run models locally. Smaller models (7B-13B parameters) run well on consumer GPUs. Larger models need more powerful hardware or quantization.

Are open-source LLMs as good as ChatGPT?

The gap is now small on many benchmarks. Kimi K3 reports 93.5 on GPQA Diamond and DeepSeek V4.1 Flash reports 90.9, against 96.0 for OpenAI's GPT-6 Astra (all vendor-reported). Proprietary models still lead on the hardest agentic work, such as computer use on OSWorld 2.0, where Claude Opus 5 reports 70.6 against 58.3 for Kimi K3, and long-horizon terminal work. On Vals' independent Terminal-Bench 4.0 board (October 18, 2026), Claude Opus 5.5 scores 65.15 against 31.82 for DeepSeek V4.1-Flash-1017 and 6.57 for Meta's Muse Spark Open.

What license do open-source LLMs use?

Licenses vary. DeepSeek, MiMo-V2.6, GLM-5.3-Flash, LongCat-2.0, and Phi-4 use MIT. Reflection Beam, Jais 3, Qwen3.8-27B, Gemma 4, Muse Glimmer 30B, Mistral Large 3, and Mistral Small 4 use Apache 2.0. Llama 4 uses the Llama 4 Community License (free for most uses), and Kimi K3, MiniMax M3, Mistral Large 4, and Meta's Muse Spark Open ship under custom licenses with extra conditions. Always check the specific license for commercial use.

Related Guides