analysis

The Best AI Model Strategy in 2026: Open vs Closed, An Expert Comparison

Open source vs closed source AI in 2026: compare Llama, Mistral, DeepSeek against OpenAI, Anthropic, and Gemini on benchmarks, cost, and risk. Find out which wins.

👤 📅 September 15, 2026 ⏱️ 25 min read
AdTools Monster Mascot reviewing products: The Best AI Model Strategy in 2026: Open vs Closed, An Exper
How we research: This guide is compiled by the AdTools team from the linked sources below and current public discussion. Pricing and features change often, so please verify time-sensitive details with each vendor before making a decision.

The real question for developers and technical leaders is no longer whether open models can compete at all. It is whether the control and lower unit cost of open weights outweigh the remaining capability, convenience, and safety advantages of closed APIs for a specific workload.

As of September 2026, the best answer is usually hybrid. Open-weight models from DeepSeek, Qwen, GLM, and Kimi are credible production workers for coding, extraction, private deployment, and high-volume agentic tasks. OpenAI, Anthropic, and Google still make more sense when the hardest reasoning, longest tool loops, or lowest operational burden justify a premium.

The 2026 bottom line:

First, Let’s Be Honest About What “Open” Means in 2026

In everyday AI discussion, open source usually means open weights: the trained parameters can be downloaded, run, quantized, and potentially fine-tuned. That does not necessarily mean the training code, data, data-processing pipeline, or complete methodology is available under terms satisfying the Open Source Initiative’s definition.

That distinction separates several different categories:

The 2026 model landscape is dominated by the second category, not the third. Reviews of the open-model ecosystem similarly map a wide field of downloadable model families while emphasizing significant variation in licensing and transparency.[1][2]

LouiΞ SquarΞs @louiesquares Sep 13, 2026

Open-source AI, in practice, means open weights: downloadable parameters you can run and fine-tune. Almost none of the frontier systems are open source in the OSI sense (weights + training code + data). Claude, GPT, Gemini stay closed. Llama, Qwen, DeepSeek, GLM, Kimi, Gemma, Mistral, Phi publish weights under MIT, Apache, or a custom community license.

Where it stands (Sept 2026)

Chinese labs lead the downloadable tier. GLM, Kimi, DeepSeek, Qwen, MiniMax sit at the top of most open-weight boards. Meta and OpenAI’s open lines have lagged. The usual architecture is a huge MoE (trillions of total parameters, tens of billions active per token) so serving is cheaper than the headline size.

The gap to closed APIs is about four months on public tests, longer on private hard benches. Coding and agents are where open looks closest. Qwen still wins the ecosystem (most fine-tunes and local GGUF downloads). DeepSeek often wins “clean MIT + cheap.” GLM/Kimi often win raw open leaderboards.

Why people use it

Control and cost. Data can stay on-prem. You can pin a version, fine-tune on private data, and stop paying per-token tax at high volume. You also get independent red-teaming that an API will not allow.

Why “open” is not automatically safer
Once the file is public, refusals can be stripped, copies cannot be recalled, and nobody monitors use. Cyber capability on leading open models is already in the same band as closed models from last winter.

The extra risk is the stack: poisoned GGUFs, chat-template smuggling, LoRA “uncensored” adapters, and LLM gateways (LiteLLM and friends) that hold every API key.

Closed fails the other way: your prompts live on their GPUs, you cannot inspect the weights, and a lab compromise or eval escape hits the best model plus a lot of customer data.

How to treat it

• Need the current ceiling or a managed abuse desk → closed API.
• Need residency, a frozen model, or cheap bulk inference → official open weights, signed repo, convert them yourself.
• Never load random Hub GGUF + mystery template.
• Put policy in the application (tools, egress, auth), not in the system prompt.

Open-source AI is a distribution and control choice, not a morality badge. The weights are good enough to matter. The license and the runtime are what decide whether that is an advantage or an incident.

View on X

License differences are operational, not semantic trivia. An MIT- or Apache-licensed model generally gives a business clearer reuse and modification rights than a custom community license containing use restrictions or scale-dependent conditions. Legal teams should inspect the actual model license, accompanying acceptable-use terms, and licenses covering code and tokenizers rather than treating “available on Hugging Face” as permission for unrestricted commercial deployment.

This vocabulary matters because claims about parity, economics, and safety change depending on what is open. Downloadable weights deliver control over inference. They do not automatically provide reproducible training, provenance for the dataset, or the right to use every component without restrictions.

Is the Open-vs-Closed Gap Really Closing in 2026?

The most optimistic position is that the gap will disappear within one release cycle. Its technical basis is credible: DeepSeek, Qwen, Kimi, and GLM can learn from public research, outputs, evaluation techniques, and—in some cases—reusable weights. Progress is no longer dependent on one open-model organization keeping pace with every closed lab.

Bindu Reddy @bindureddy Aug 29, 2026

🚨 The gap between open-source and closed-source AI will be gone in 90 days. Here are the technical reasons why

Compounding intelligence - four independent open-model families— DeepSeek, Qwen, Kimi, and GLM - are now all compounding on each other's public weights simultaneously.

You can simply pool the intelligence from all these models in every iteration

Frontier safety risk - frontier models are either delayed or canceled. Anthropic has publicly said they WILL NOT release their new large model, Model 2.

Astra from OpenAI is also stuck somewhere. It's just much easier to catch up with them now

Long-horizon loops, open source has already caught up on first-turn benchmarks. LITERALLY the only gap is in long-running tool loops.

Open-source labs are all gathering a lot of training data for this: long-horizon agentic trajectories with RLHF signals. Every time devs use the official APIs, the labs get data which helps them get goal coherence and match Opus 5 / GPT 5

Compute - Zai has already shown they have enough compute to give away 100T tokens in 6 days. The Chinese chips are online and are rapidly accelerating

Open source will inevitably catch up and cut prices by 80-90% within 6-12 weeks. This has already happened at the Luna/Haiku level! 🚀🚀

View on X

But “the gap” is not one number. It changes according to the task, evaluation method, inference budget, tool setup, and definition of open. One 2026 gap tracker estimates that open models trail the frontier by months rather than years, while contemporary comparisons still find a measurable proprietary advantage.[3][4]

September 2026 BenchLM data illustrates the disagreement. The cited leaderboard placed the top closed model at 84.6 and the leading open-weight model at 71.7, while other aggregate analyses have described an approximately 8.5-point intelligence gap.[5][6] Those results are difficult to reconcile with a blanket claim that parity has already arrived.

Yet aggregate scores can conceal narrow victories. GLM-5.1 was reported at 58.4 on SWE-Bench Pro, ahead of the listed scores for Opus 4.6, GPT-5.4, and Gemini 3.1 Pro:

Yuchen Jin @Yuchenj_UW Apr 7, 2026

Wow, GLM-5.1 beat Opus 4.6, GPT-5.4, and Gemini 3.1 Pro on SWE-Bench Pro (58.4 vs 57.3 / 57.7 / 54.2) as an open-weight MIT-licensed model!

The “open-source AI vs closed-source AI” gap is still ~6 months.

View on X

The sensible conclusion is that open weights have reached or crossed parity on selected coding and agentic benchmarks without matching the closed frontier universally. Coding tasks with verifiable outputs are especially favorable: models can compile code, run tests, inspect errors, and improve through reinforcement learning. Ambiguous reasoning, multi-agent coordination, and long-horizon work are harder to measure and may preserve a larger closed-model lead.

Public versus private capability further complicates the timeline:

Lisan al Gaib @scaling01 Aug 27, 2026

I really need you to internalize this:
- the current public frontier is in terms of historical progress 3-6 months behind the private frontier
- most benchmarks are still single-agent and only using a few million tokens, while the latest frontier models are trained for multi-agent operations

OpenAI and Anthropic are both 1.5-2 model iterations ahead, meaning something like GPT-6.1-Astra and Mythos 5.2

they are continuing to race internally

View on X

The “90 days” and “three-to-six months” camps can therefore both be partly right. A newly released open model may catch a public proprietary model within a quarter, while the best internal system at a closed lab remains several months ahead.

Which Open-Weight Models Are Driving the 2026 Release Flood?

The center of gravity is moving from one flagship release to a portfolio of specialized models. Artificial Analysis tracks open models across intelligence, price, speed, and context, while summer 2026 roundups show how quickly the field is turning over.[7][8]

Victor M @victormustar Aug 12, 2026

We are in an insane run of open-weight drops.

Every modality, open source is winning. This is what an open source AI summer ☀️ looks like:

🧠 LLMs & Reasoning

→ DeepSeek-V4-Flash-0731 (my king 👑): 304B MoE refresh, Terminal-Bench 2.1 jumps 61.8→82.7 over the preview, DeepSWE 7.3→54.4. Closes in on Opus-4.8 on Agents' Last Exam (25.2 vs 25.7). MIT.

→ Muse-Glimmer-30B, from Meta (they are back!!): their first open agentic model. ~29.6B dense + perception encoder, 131k+ context, built to run fully local, no cloud. Apache 2.0.

→ Liquid AI LFM2.5-2.6B: 2.69B params, 131k context, 220 tok/s on an M5 Max in under 2.5GB RAM. Competitive with models 4x larger on agentic tasks.

→ inclusionAI Ling-3.0-flash: 124B total, only 5.1B active, ~12% the size of their old 1T flagship Ring-2.6, matches it on key benchmarks. MIT.

→ inclusionAI Ling-3.0-tiny: 7.9B total, 1.3B active, 86-90 tok/s on an M4 Pro MacBook at ~8GB peak memory. MIT.

→ NVIDIA Nemotron-3.5-Lightning-30B-A3B: hybrid Mamba-2+MoE+Attention, up to 1M context, runs on a single H100 or DGX Spark, SWE-bench Verified 52.8.

→ deepgrove maple-preview: 20B-A1B ternary-weight reasoner, 218 tok/s on a Mac mini M4, 5.3GB checkpoint. MIT.

→ BigBang-v1 (endless-frontier): fine-tuned from Qwen3.6-35B-A3B via a self-evolving generator/critic synthetic-data loop. Lands aggregate performance between DeepSeek V4 Flash (284B) and V4 Pro (1.6T), at 35B. Apache 2.0.

View on X

Three technical trends make this wave more relevant to production teams.

Mixture-of-experts models reduce active inference cost

A mixture-of-experts, or MoE, model contains many parameters but activates only part of the network for each token. DeepSeek V4.1 Flash was described as a 552-billion-parameter MoE using 8 billion active parameters on input and 16 billion on output, with a one-million-token context window and native multimodality.

cr3ghost @cr3ghost Sep 13, 2026

DeepSeek just dropped the kind of release closed AI labs should be worried about.

On DeepSeek's published agentic benchmarks, V4.1 Flash:

Beats Opus 5 on 3/4
Beats Kimi K3 on 4/4
Beats GPT-5.6 Sol on 3/4

CyberGym: 88.1 vs Opus 5 at 84.5
DeepSWE: 74.2 vs 74.0
Automation-Bench: 54.8 vs 50.3

And the weights are FREE to download and MIT licensed.

552B MoE.
8B active on input.
16B active on output.
1M context.
Native multimodal.
Local/self-hosted deployment.

For AI-assisted vulnerability research, exploit development, reverse engineering, malware analysis, detection engineering, red teaming, blue teaming, and autonomous security research, this is getting very interesting.

If I were running a closed US AI lab, open releases like this would make me nervous.

You can lobby, regulate and build bigger moats, but you can't put open weights back in the bottle.

Keep them coming.

View on X

The headline parameter count still affects storage, memory placement, and deployment complexity. But sparse activation can make inference materially cheaper than serving a dense model of comparable total size. This is why “552B” does not necessarily imply that every token incurs the cost of a dense 552B model.

Local deployment now includes serious agentic models

GLM-5.1’s release is significant not simply because of a leaderboard score, but because the weights were described as MIT licensed and deployable through vLLM, SGLang, and Transformers:

Ahmad @TheAhmadOsman Apr 7, 2026

INCREDIBLE

GLM-5.1 weights are now opensource

> i’ve had early access to the weights for the past few days
> and yeah… this one matters a lot

benchmarks?

> SWE-Bench Pro: 58.4
> beats Opus 4.6 (57.3)
> beats GPT-5.4 (57.7)
> beats Gemini 3.1 Pro (54.2)

let that sink in

open weights
beating closed

> open-weight (MIT licensed)
> built for agentic engineering
> sustains long-horizon reasoning
> runs locally via vLLM / SGLang / Transformers

but the real unlock isn’t just first-pass scores

it’s this:

> a year ago, agents used to do ~20 steps
> GLM-5.1 can do ~1,700 steps

> longer runs
> more iteration
> better results over time

and now you can verify it yourself, locally

> the gap between opensource and closed models?
still ~6 months or less
and shrinking fast

View on X

For teams with established GPU infrastructure, that enables controlled upgrades, private evaluation, custom inference policies, and model pinning. It does not mean the model will run efficiently on an ordinary developer laptop; “local” can mean a workstation, an on-premises cluster, or a private cloud environment.

Lab-published results still need independent verification

Many eye-catching comparisons originate with model creators or early-access evaluators. They may use different scaffolds, token budgets, tool configurations, or sampling methods. A result such as “beats model X on three of four agent benchmarks” should trigger an internal evaluation—not an immediate migration.

The decision metric should be successful tasks per dollar under your own latency and reliability constraints, not a model’s best published score.

Why Do Chinese Labs Lead the Downloadable Tier While Meta and OpenAI Stall?

By September 2026, DeepSeek, Qwen, GLM, Kimi, and MiniMax occupy much of the leading open-weight conversation. Reporting on the release surge describes it as a broader shift in the AI power balance rather than an isolated benchmark event.[9] Western open-model work continues through Google’s Gemma, Nvidia’s Nemotron, Mistral, Nous Research, and smaller laboratories, but the ecosystem is fragmented.

Sudo su @sudoingX Apr 20, 2026

the thing thats crazy is gemma 4 31b and qwen 3.5 27b dense are not bad at all, they flip gpt oss 120b upside down in 2026. openai hasnt shipped anything open since then to actually compete on the field. meta keeps avoiding. but that doesnt mean open source isnt moving.

after testing nemotron from nvidia, gemma from google, hermes from nous research, the future of open source is more flourished than people realize.

you would know this if you actually tried these on your setup and trusted them to do the job with the same effort you put into your paid subscriptions. these are not bad models at all.

View on X

The difference appears strategic. Closed frontier labs monetize scarce access to intelligence through subscriptions, enterprise contracts, and APIs. Publishing their strongest weights would reduce that scarcity, make usage harder to govern, and give competitors a reusable artifact.

Chinese open-model labs can benefit from a different flywheel:

  1. Release a capable model or low-cost API.
  2. Attract developers, fine-tunes, evaluations, and integrations.
  3. Build international distribution despite weaker consumer brands.
  4. Gather feedback and agentic trajectories.
  5. Use the ecosystem to accelerate the next release.

This does not make every Chinese model fully transparent, politically neutral, or suitable for every organization. It means open weights can function as a distribution strategy as much as an ideological commitment.

An independent developer in the X discussion connects that strategy directly to frustration over paying $400 per month across OpenAI and Anthropic:

Tiofenn @Jervann15 Sep 13, 2026

[My take on open vs. closed AI as an independent developer paying OpenAI and Anthropic $200 a month each]

Liang Wenfeng is the founder and CEO of DeepSeek, the Chinese AI lab that releases models people can download and run themselves, alongside technical papers explaining its work. When reports of his four-hour investor meeting circulated in July, his attitude towards consumer products honestly pissed me off. He treated them as intermediate results of pursuing general-purpose AI, and that sounded dismissive of users to me. Yet the same reports quoted him saying, in translation, “We only seek a reasonable profit,” and “We didn’t start this company thinking about how much money we’d make or going public.” I appreciate those words a lot more now.

Since yesterday’s call to slow AI development from Dario Amodei, CEO of Anthropic, and the support it received from Sam Altman, CEO of OpenAI, I’ve had enough. These are the companies behind Claude and ChatGPT, and I pay each of them $200 a month. I’m sick of buying access to AI and receiving apocalypse anxiety with the subscription. Anthropic’s September report made that feeling worse: it used private conversations to publish detailed accounts of users’ work and suspected affiliations. In some research cases, it specifically cited geographic-access violations as the reason for bans. I find that willingness to publicise confidential work, combined with sweeping unilateral control over access, deeply arrogant. Customers deserve privacy, clear evidence and a fair opportunity to challenge accusations. Dario then writes that “a Chinese lead in AI would pose grave danger for the United States and the world.” I find this China-baiting shamelessly racist. Chinese researchers have every right to develop advanced AI. Meanwhile, both companies are courting investors and discussing IPOs, even as Altman rules out a 2026 listing. I see a very convenient sales pitch: make the technology sound valuable enough to justify enormous valuations, then frightening enough to justify keeping control of it. They use their current lead to restrict access and advocate measures that keep competitors behind. To me, that looks like an attempt to build monopoly power while bullying users, followed by the absurd spectacle of presenting themselves as victims of dangerous AI and threatening China.

Liang’s position looks considerably more respectable beside all this. For all their talk of transparency, OpenAI and Anthropic keep their frontier model weights private. DeepSeek publishes downloadable models and technical reports that people can examine and build on. I now think Liang is a better AI lab leader than either of them. He was right about restraint, reasonable profits and sharing the technology. China is lucky to have him. I hope Americans with a conscience, and people everywhere, will support DeepSeek, https://t.co/rPmRCUFxCo’s GLM and Moonshot AI’s Kimi. Their open models give the whole world something to build on independently. I believe they will gradually reach the level of today’s leading closed models, OpenAI’s Astra and Anthropic’s Fable, making that capability available at a fraction of today’s cost through official APIs, competing providers and, where the hardware allows, local deployment. When rogue OpenAI agents attacked Hugging Face, the platform used to share AI models, GLM helped its team defend it. That is a rather better contribution to the world than another lecture about why Chinese AI should be feared.

View on X

The post’s broader political claims are the author’s position, not independently established facts here. But the customer concern is concrete: API providers can change models, prices, policies, geographic availability, and account access unilaterally. Downloadable weights reduce that dependency.

The release-cadence split consequently reveals business priorities. DeepSeek and peers are using availability to win adoption. OpenAI and Anthropic are protecting a managed frontier. Meta’s more cautious cadence suggests that releasing strong weights is no longer an automatic strategic choice even for a company that helped popularize the category.

When Does “Good Enough at 1% of the Cost” Beat the Frontier?

Most production workloads do not require the smartest available model on every call. They require predictable structured output, acceptable accuracy, low latency, and manageable cost at scale.

That is the premise behind the worker-model argument:

James Reagan @jpreagan Sep 10, 2026

Seriously impressive 552B parameter MoE model with what appears to be Opus or GPT-5.6 Sol level agentic coding ability.

It's also less than 1% the price of Fable with respect to cost per task.

I believe this will make a fine worker model, but the question will be is it better, faster, and cheaper than Luna? It's already fast, cheap, and good enough.

Luna isn't open weights, I get it, you may say apples and oranges. Just looking at this from a perspective of what intelligence do I get from this model, how long does it take to complete my task, and how much do I save.

The worker model space is already pretty crowded, many good options. We want cheap and fast while being as capable as possible. This release would seem like another one in that category and open weights as well.

All that chatter aside, congratulations to the DeepSeek team on this release which is awesome.

View on X

The “less than 1%” figure in that post is a task-level estimate, not a universal price ratio. Even so, Mozilla reports that open-source AI deployments can produce cost reductions of up to 50 times in suitable scenarios.[10] Independent 2026 benchmarking likewise emphasizes that hardware, quantization, batching, utilization, and workload shape whether self-hosting is economical.[11]

Open weights tend to win financially when:

Structured extraction demonstrates the “narrow task” effect. In an earlier Ollama experiment, a local 7B OpenOrca model finished behind GPT-4, Claude 2, and GPT-3.5 Turbo but remained competitive enough to be useful for JSON extraction:

Jacob Lee @Hacubu Nov 19, 2023

Data extraction is a huge use case for LLMs. @Ollama_ai's new JSON mode made me curious how local OSS models might do compared to OpenAI.

I found a recently released 7B model, OpenOrca, was almost as good as 3.5-turbo despite not having native functions support!

Check out the dataset (publicly available below) + evals in @langchain LangSmith:

https://t.co/mzmgaCaFSQ

The first (and most difficult) step was gathering a good dataset. No artistry here - I plumbed the depths of my spam filter for raw material, cleaned/deduped, and used a @langchain extraction chain with GPT-4 to extract fields like sender, phone #, and action items.

I then went through the runs by hand with LangSmith’s annotation queue double-checking for correctness.

Using LangSmith’s `run_on_dataset` feature, I evaluated various OSS models such as Llama 2, Mistral, and Zephyr locally through @Ollama_ai using their newly added JSON mode + a passed schema against my created dataset. I also tried OpenAI and Anthropic models as a baseline. I used GPT-4 to evaluate each run and score it.

GPT-4 did the best by a significant margin, followed by Claude 2 and 3.5-turbo. However, a not-so-distant 4th was OpenOrca!

Stock Llama 2 did poorly (which fits previously established benchmarks around coding tasks).

Hardware limited me to small 7B models, but my assumption is that larger OSS models would do even better! I also don't think my prompting was optimal by any means, and that there are likely still performance gains there.

I had a lot of fun with this - it combines two of my favorite topics in LLMs: local models and structured output. And if you’d like to replicate this experiment yourself, check out the below repo for some of the scripts:

https://t.co/FJhY8lKFBb

You can try OpenOrca through Ollama here:

View on X

That experiment predates the 2026 models and used an evaluator-model methodology with acknowledged prompting limitations. It should not be generalized into universal parity. Its lasting lesson is more important: evaluate the job, not the model category. A compact local model can be commercially superior if it meets the extraction threshold at far lower marginal cost.

Self-hosting is not free, however. Teams inherit GPU provisioning, autoscaling, observability, model conversion, security patching, batching, failed-job recovery, and capacity planning. Low utilization can make owned infrastructure more expensive than an API. Small teams with unpredictable traffic should usually start with managed inference, even if the underlying model is open weight.

Can Public Benchmarks See the True Closed-Model Frontier?

The strongest counterargument to open-model optimism is that public leaderboards compare downloadable releases with products that closed labs have already superseded internally.

🍓🍓🍓 @iruletheworldmo Jun 29, 2026

i get why people want to root for “open source”.

but the distance between openai/anthropic and anything else is gargantuan. and it isn’t only open source that’s miles back, the other closed for-profits are too.

google, meta and xai are nowhere near. only two labs are sitting at the actual frontier, and the government keeps telling you which two: it force-pulled anthropic’s two best models overnight, and made openai submit its newest one to user screening before it would let it ship. it’s doing that to no one else, because there’s nothing else worth controlling.

and even if we only look at the publicly available models from these two, they dwarf anything held back privately by any company on the planet.

View on X

Claims in that post about government intervention and unreleased systems are not verified by the provided benchmark sources. The underlying measurement problem is nevertheless real. Most public evaluations are bounded tests. Advanced deployments may instead involve multiple agents, very long contexts, persistent memory, tool use, retries, and millions of tokens consumed across one objective.

A model that leads a single-turn reasoning benchmark may still fail after the fiftieth tool call. Conversely, a model with a lower headline score may complete more real tasks because it recovers from errors, maintains goals, and knows when to verify its output. Gap trackers can measure public releases, but not undisclosed checkpoints or private evaluations.[3]

Safety creates another asymmetry. A closed provider can monitor abuse, revoke access, patch a model, and place controls around high-risk capabilities. Open weights cannot be recalled after distribution, and fine-tuning can remove refusal behavior.

DeepSeek’s reported CyberGym performance illustrates the tension. Strong vulnerability-research capability can help defenders find flaws, but similar capability may assist exploit development. Openness enables independent auditing and on-premises security work while also distributing capability beyond the original lab’s controls.

Closed systems fail differently: customers must trust the provider’s infrastructure, retention policies, internal access controls, and changing usage rules. Neither architecture is inherently safe. Production safety depends on application-layer authorization, tool permissions, network egress controls, sandboxing, logging, and human escalation—not merely a system prompt.

Does Open AI Inevitably Win Like Linux?

The Linux analogy captures the emotional and economic case for open models:

Gergely Orosz @GergelyOrosz Jan 29, 2025

As a software eng, it is inherently satisfying to see an open approach beat close approaches in an innovative field.

Linux is open: Windows is closed

Llama, Deepseek, Mistral are open: OpenAI+many others others closed

Closed approaches winning almost always lead to monopolies.

View on X

Open ecosystems can spread experimentation across universities, startups, infrastructure vendors, fine-tuners, and individual developers. Once a capability class becomes reproducible, competition shifts from scarce access toward efficiency, deployment, and specialization. The earlier emergence of several GPT-3.5-class open models showed that dynamic:

Bindu Reddy @bindureddy Dec 9, 2023

Initial evals for Mistral MoE are out, and it is a solid 70B model that is very similar to GPT 3.5, Gemini Pro, and DeepSeek and slightly better than Llama2-70B.

MMLU on the base models is at 0.717 compared to Gemin Pro's 0.718, DeepSeek's ~ 0.717, and GPT 3.5 at 0.7

On other metrics, it also seems similar to GPT-3.5. Remember, this is the base model, and the fine-tunes will have better scores (2-5 pts based on what you do).

We now have SEVERAL 3.5 class open-source models - LLama, DeepSeek, and Mistral.

Expect to see several fine and instruct tunes over the next few weeks. These fine tunes will match GPT-4 quality for several real-world use cases.

We already have DeepSeek as part of Abacus AI, and we will incorporate MoE by next week based on further evaluation results.

TLDR: The GPT 3.5 class is easily reproducible, and there will be several open-source alternatives; fine-tunes will match GPT-4 for specific use cases.

View on X

The Open Source Initiative argues that the AI era is bending toward openness, pointing to expanding activity across collaborative platforms such as GitHub and Hugging Face.[12] Mozilla similarly portrays open ecosystems as important counterweights to concentrated control.[10]

But AI is not Linux. Training a frontier model requires immense compute, data pipelines, specialized researchers, energy, and access to advanced hardware. Community contributors can modify and serve released weights; they cannot necessarily reproduce the training run. Capital remains a deeper moat than it was for conventional open-source software.

That is why the two-lab concern matters even if open models keep improving. If only a small number of companies control the highest capability tier, they can influence prices, access rules, safety standards, and which applications are permitted. Open weights may not eliminate that frontier concentration, but they create a competitive floor below it.

Who Should Use Open or Closed AI in 2026?

Choose open weights if you have scale, infrastructure, or strict control requirements

DeepSeek, Qwen, GLM, and similar families fit organizations with:

Verify licenses, download from official repositories, pin artifacts, and test quantized versions independently. Treat model files and adapters as supply-chain dependencies.

Choose closed APIs when capability and simplicity justify the premium

OpenAI, Anthropic, and Gemini fit:

Paying more is rational when a stronger model avoids expensive human review or completes jobs that cheaper models repeatedly fail.

Use hybrid routing for mixed production workloads

For many organizations, the strongest 2026 architecture is a cascade:

  1. Send routine tasks to a low-cost open-weight model.
  2. Validate output using schemas, tests, rules, or confidence signals.
  3. Retry or escalate failures to a frontier API.
  4. Log outcomes and periodically update routing thresholds.
  5. Keep provider-independent interfaces so models remain replaceable.

This approach turns the open-versus-closed debate into an engineering optimization problem. Track cost per accepted task, tail latency, failure recovery, human-review time, and operational overhead.

The strategic conclusion is straightforward: open weights have become too capable and economical to ignore, but public parity on selected benchmarks is not proof that the private frontier has disappeared. Use open models as controllable, inexpensive workers; reserve closed frontier systems for the tasks where their remaining advantage pays for itself.

Sources

[1] Open-Source LLM Landscape 2026, 15+ Model Families Mapped — Presenc AI

[2] How open source AI solutions are reshaping business — McKinsey

[3] Open vs Closed AI Gap Tracker — Made By Agents

[4] Open Source vs Proprietary LLMs in 2026: The Benchmark Gap — WhatLLM.org

[5] LLM Leaderboard & AI Model Benchmarks — September 2026 — BenchLM.ai

[6] Open Source LLM Statistics (2026): Open vs Closed Data — BenchLM.ai

[7] Comparison of Open Source AI Models — Artificial Analysis

[8] The Best Open Weight Models of Summer 2026 — Fastino

[9] Open Models Surge Reshapes AI Power Balance as New Releases Flood the Field — WebProNews

[10] Mozilla’s Inaugural “State of Open Source AI” Report

[11] Open-Weight LLMs Benchmarked (2026) — Aldric Research

[12] The AI Era Arcs Toward Openness — Open Source Initiative