Category: Open-weight models

This category contains 112 pages.

  • AFM-4.5B · The first from-scratch Arcee Foundation Model: a 4.5B-parameter enterprise-focused open-weight LLM trained on 8 trillion tokens, later extended to a 64K context window.
  • ALBERT · A 2019 parameter-efficient variant of BERT from Google Research that used factorized embeddings and cross-layer parameter sharing to cut model size.
  • Alpaca · Stanford's March 2023 instruction-tuned LLaMA-7B, built for under $600 of synthetic data; proved frontier-adjacent assistants could be replicated for pocket change.
  • Aya · Cohere For AI's open multilingual model family (2024-2025), built with thousands of volunteer contributors to extend instruction-tuned LLMs beyond English.
  • BLIP · Salesforce Research's vision-language pre-training family (2022-2023), whose BLIP-2 Q-Former popularized bridging frozen image encoders to frozen LLMs.
  • BLOOM · BigScience's 176-billion-parameter open-access multilingual language model, released in July 2022 as a large-scale collaborative science project coordinated by Hugging Face.
  • Cerebras-GPT · Cerebras's March 2023 family of seven open compute-optimal GPT models (111M to 13B), trained on The Pile to demonstrate its wafer-scale hardware.
  • ChatGLM · Zhipu AI and Tsinghua's 2023 bilingual open-weight chat assistant line, launched with the locally runnable ChatGLM-6B.
  • CLIP · OpenAI's January 2021 contrastive vision-language model that learns image classification from natural-language supervision and became a standard component in text-to-image systems.
  • Code Llama · Meta AI's August 2023 family of open-weight code-specialized language models derived from Llama 2, released in 7B to 70B sizes.
  • Comma (models) · Pair of 7-billion-parameter open-weight language models released in June 2025 by EleutherAI and Common Pile collaborators, trained solely on the openly licensed Common Pile v0.1 corpus.
  • Command (models) · Cohere's enterprise model line; Command R (2024) made retrieval-augmented generation and tool use the product, and Command A (2025) optimized for two-GPU serving.
  • DBRX · Databricks' March 2024 open-weight mixture-of-experts language model, with 132 billion total and 36 billion active parameters.
  • DeepSeek (model family) · DeepSeek's open-weight model line, known for efficiency innovations (MLA, DeepSeekMoE) and the R1 reasoning model.
  • DeepSeek LLM · DeepSeek's first general-purpose open-weight language model series (7B and 67B), released in late 2023 and accompanied by a scaling-laws study.
  • DeepSeek-Coder-V2 · DeepSeek's June 2024 open-weight mixture-of-experts code model, developer-reported as competitive with closed frontier models on coding benchmarks.
  • DeepSeek-R1 · DeepSeek's January 2025 open-weight reasoning model; matched o1-class results with a published RL recipe and triggered a global market repricing.
  • DeepSeek-V2 · DeepSeek's May 2024 open MoE that introduced multi-head latent attention and DeepSeekMoE; started China's LLM price war.
  • DeepSeek-V3 · DeepSeek's December 2024 open-weight flagship: 671B-parameter MoE reporting frontier quality from a ~$5.6M disclosed final training run.
  • DeepSeek-V3.1 · DeepSeek's August 2025 hybrid open-weight model that merged thinking and non-thinking modes into a single checkpoint, succeeding both DeepSeek-V3 and DeepSeek-R1.
  • Devstral · Mistral AI's open-weight agentic coding model line, launched May 2025 with All Hands AI and tuned for software-engineering agent workflows.
  • DistilBERT · Hugging Face's 2019 distilled version of BERT: roughly 40% smaller and 60% faster while retaining about 97% of BERT's language-understanding performance.
  • ELECTRA · A 2020 Google Research and Stanford encoder model pre-trained with replaced token detection, reaching BERT-class quality at a fraction of the compute.
  • ELMo · 2018 contextualized word embedding model from AI2 and the University of Washington, built on a bidirectional LSTM language model.
  • Falcon (models) · The UAE Technology Innovation Institute's open model line; Falcon 180B was 2023's largest open release, and Falcon Mamba pioneered open SSM scale.
  • Flan-T5 · Google's October 2022 family of instruction-finetuned T5 models, released openly in five sizes and a standard baseline for instruction-tuning research.
  • FLUX · Black Forest Labs' family of rectified flow transformer text-to-image models, launched in August 2024 with open-weight and proprietary variants.
  • Gemma · Google DeepMind's open-weight line drawing on Gemini research: Gemma 1 (2024) through the multimodal Gemma 3 (2025).
  • GLM (model family) · Zhipu AI's model line, from the GLM-130B open release of 2022 through the agentic GLM-4.5/5 generation.
  • GLM-130B · A 130-billion-parameter open bilingual (English-Chinese) language model released by Tsinghua University and Zhipu AI in August 2022.
  • GLM-4 · Zhipu AI's January 2024 flagship language model generation, spanning a proprietary API flagship and later open-weight GLM-4-9B variants.
  • GLM-4.5 · Zhipu AI's July 2025 open-weight mixture-of-experts model, positioned as a unified agentic, reasoning, and coding foundation model.
  • GLM-4.6 · Zhipu AI's late-2025 open-weight mixture-of-experts model, an agentic-coding-focused successor to GLM-4.5 with a 200K-token context window.
  • GLM-5 · Zhipu AI's February 2026 open-weight frontier model: a 744B-parameter mixture-of-experts LLM released under the MIT license, followed by the GLM-5.2 update in June 2026.
  • GPT-1 · OpenAI's June 2018 Generative Pre-trained Transformer, the 117-million-parameter model that established the pretrain-then-finetune recipe behind the GPT series.
  • GPT-J · EleutherAI's June 2021 open-weight 6-billion-parameter autoregressive language model, an early open alternative to GPT-3-class systems.
  • GPT-Neo · EleutherAI's March 2021 family of open-source autoregressive language models (up to 2.7 billion parameters), an early public replication of the GPT-3 design.
  • GPT-NeoX-20B · EleutherAI's February 2022 open-source 20-billion-parameter autoregressive language model, at release the largest publicly available dense model with fully open weights.
  • gpt-oss · OpenAI's August 2025 open-weight models (120B and 20B MoE, Apache 2.0), its first open weights since GPT-2.
  • Grok-1 · xAI's first model (November 2023); its March 2024 open-weights drop, a 314B MoE under Apache 2.0, was then the largest open release.
  • Hunyuan · Tencent's model line: the open Hunyuan-Large MoE (2024), the leading open video model HunyuanVideo, and the Apache-2.0 Hunyuan 3.0 (2026).
  • Hunyuan 3.0 · Tencent's July 2026 open-weight flagship: a 295B-parameter mixture-of-experts model with 21B active parameters and a 256K context window, released under Apache 2.0.
  • HunyuanVideo · Tencent's December 2024 open-weight text-to-video generation model, a roughly 13-billion-parameter diffusion transformer released with code and weights.
  • IBM Granite · IBM's family of open-weight enterprise language models, spanning dense, mixture-of-experts, code, and hybrid Mamba/transformer variants.
  • IDEFICS · Hugging Face's August 2023 open reproduction of DeepMind's Flamingo: an 80B open-weight visual language model trained only on public data.
  • InternLM · Shanghai AI Laboratory's open-weight language model series, spanning the original 2023 release through InternLM2, InternLM2.5, and InternLM3.
  • InternVL · Shanghai AI Laboratory's open-weight vision-language model family, launched December 2023 and iterated through InternVL 1.5, 2, 2.5, and 3.
  • Jamba · AI21 Labs' 2024 hybrid: the first production-scale model interleaving Transformer attention with Mamba state-space layers.
  • Kimi (model family) · Moonshot AI's model line: the long-context Kimi assistant, k1.5 reasoning, and the trillion-parameter open-weight K2 series.
  • Kimi K2 · Moonshot AI's July 2025 trillion-parameter open-weight MoE; put open weights at the agentic frontier and introduced the MuonClip optimizer.
  • Kimi K3 · Moonshot AI's July 2026 flagship: a 2.8-trillion-parameter MoE, the largest open-weight release to date, with the Kimi Delta Attention architecture.
  • LFM (models) · Liquid AI's model line: the proprietary non-Transformer LFM1 generation (2024) and the open-weight LFM2/LFM2.5 edge families built on hybrid convolution-attention blocks.
  • Ling (models) · Ant Group's open-weight mixture-of-experts model family (Bailing line), notable for frontier-scale training partly on Chinese domestic accelerators.
  • LLaMA · Meta's February 2023 research models (7B-65B); their prompt leak seeded the open-source LLM ecosystem.
  • Llama (model family) · Meta's open-weight model line; the LLaMA leak of 2023 seeded the modern open-source LLM ecosystem.
  • Llama 2 · Meta's July 2023 openly licensed models (7B-70B) with RLHF chat variants; made open weights an official corporate strategy.
  • Llama 3 · Meta's 2024 generation: 8B/70B in April, the 405B frontier-scale release in July; the herd paper documented open training at frontier scale.
  • Llama 3.1 · Meta AI's July 2024 open-weight model family (8B, 70B, 405B), whose 405B variant was widely described as the first open-weight model competitive with frontier closed systems.
  • Llama 3.2 · Meta AI's September 2024 Llama release adding small on-device text models (1B, 3B) and the family's first vision-capable models (11B, 90B).
  • Llama 3.3 · Meta AI's December 2024 open-weight 70B instruct model, developer-reported to approach Llama 3.1 405B quality at a fraction of the serving cost.
  • Llama 4 · Meta's April 2025 MoE generation (Scout, Maverick; Behemoth unreleased); a mixed reception that preceded Meta's Superintelligence Labs reorganization.
  • LLaVA · The 2023 open vision-language recipe: a frozen vision encoder bridged to an open LLM with GPT-4-generated instruction data.
  • LongCat · Meituan's open MoE line: LongCat-Flash (560B, 2025) and LongCat-2.0 (1.6T, 2026), trained entirely on Chinese accelerators.
  • Magistral · Mistral AI's first reasoning model line, released in June 2025 as the open-weight Magistral Small (24B) and the proprietary Magistral Medium.
  • MiMo · Xiaomi's open model line: reasoning-first small models (MiMo-7B, 2025) scaled to the frontier checkpoints that led OpenRouter usage in 2026.
  • MiniMax-M1 · MiniMax's June 2025 open-weight hybrid-attention reasoning model, developer-reported as the first large-scale open-weight model combining lightning attention with mixture-of-experts.
  • MiniMax-M2 · MiniMax's October 2025 open-weight mixture-of-experts model aimed at agentic and coding workflows, released under the MIT license.
  • MiniMax-Text-01 · MiniMax's January 2025 open-weight language model, notable for its hybrid lightning-attention architecture and developer-reported 4-million-token context window.
  • Mistral (model family) · Mistral AI's model line: efficient open-weight releases (Mistral 7B, Mixtral) alongside commercial Large and specialist models.
  • Mistral 7B · Mistral AI's September 2023 debut model: a 7.3-billion-parameter open-weight language model that outperformed larger Llama 2 variants.
  • Mistral Large · Mistral AI's flagship proprietary language model line, launched February 2024 and updated in July 2024 as the 123-billion-parameter Mistral Large 2.
  • Mistral Small · Mistral AI's mid-size model line, launched February 2024 and later released open-weight, positioned for low-latency deployment below Mistral Large.
  • Mixtral 8x22B · Mistral AI's April 2024 sparse mixture-of-experts model with about 141B total and 39B active parameters, released under Apache 2.0.
  • Mixtral 8x7B · Mistral AI's December 2023 sparse MoE, the first widely deployed open mixture-of-experts model; dropped as a magnet link before any announcement.
  • Molmo · Ai2's September 2024 family of open-weight vision-language models trained on the human-annotated PixMo dataset rather than synthetic captions distilled from proprietary systems.
  • Moondream (model family) · The tiny-VLM line from M87 Labs: Moondream 1 (2024) through the MoE Moondream 3 Preview, built for edge and high-volume vision work.
  • MPT (models) · MosaicML's 2023 open-weight MPT line (7B and 30B), an early commercially usable alternative to research-only LLaMA licenses.
  • Nemotron · NVIDIA's family of open-weight language models, best known for the June 2024 Nemotron-4 340B release aimed at synthetic data generation.
  • OLMo · AI2's fully open model line: weights, data, code, and checkpoints all public; the scientific control group of the LLM era.
  • OPT · Meta AI's May 2022 suite of open decoder-only language models, from 125M to 175B parameters, released with weights, code, and a candid training logbook.
  • PaliGemma · Google's open vision-language model of May 2024, pairing a SigLIP vision encoder with a Gemma language decoder and designed for fine-tuning on downstream tasks.
  • Phi (model family) · Microsoft's small-model line built on the 'textbooks are all you need' thesis: curated and synthetic data over parameter count.
  • Pixtral · Mistral AI's first natively multimodal model line, opened in September 2024 with the Apache-2.0 Pixtral 12B vision-language model.
  • Pythia · EleutherAI's April 2023 suite of 16 open-weight language models (70M-12B parameters) with released training checkpoints, built for research on training dynamics and interpretability.
  • Qwen (model family) · Alibaba's open-weight model line; by 2025 the most-downloaded and most-fine-tuned base family in the open ecosystem.
  • Qwen 1 · Alibaba Cloud's first generation of Qwen large language models (2023), released as open-weight checkpoints from 1.8B to 72B parameters.
  • Qwen2 · Alibaba's June 2024 open-weight model series spanning 0.5B to 72B parameters, including one mixture-of-experts variant.
  • Qwen2.5 · Alibaba's September 2024 open-weight model series (0.5B to 72B), trained on a developer-reported 18 trillion tokens and widely used as a base for fine-tunes and reasoning distillations.
  • Qwen2.5-VL · Alibaba's January 2025 open-weight vision-language model series (3B to 72B) with document parsing, object grounding, long-video understanding, and GUI-agent capabilities.
  • Qwen3 · Alibaba's April 2025 open-weight model family introducing hybrid thinking and non-thinking modes across dense and mixture-of-experts variants.
  • Qwen3-Coder · Alibaba's July 2025 open-weight agentic coding model, a 480B-parameter mixture-of-experts specialist derived from the Qwen3 family.
  • Qwen3-Coder-Next · Alibaba Qwen team's February 2026 open-weight coding model, an ultra-sparse 80B hybrid-attention MoE tuned for coding agents and local development.
  • QwQ-32B · Alibaba Qwen team's open-weight 32B reasoning model, previewed in November 2024 and released in March 2025 with developer-reported parity to much larger reasoners.
  • RoBERTa · Facebook AI's July 2019 replication study of BERT that showed the original model was significantly undertrained, setting new benchmark records with an optimized pretraining recipe.
  • RWKV · Community-built linear-attention RNN trained like a Transformer; the open ecosystem's longest-running alternative-architecture project.
  • Seed-OSS · ByteDance Seed's August 2025 open-weight 36B dense language model family, notable for a long native context window and a user-controllable thinking budget.
  • Segment Anything · Meta AI's April 2023 promptable image segmentation model (SAM), released with the 1.1-billion-mask SA-1B dataset.
  • SmolLM · Hugging Face's family of small open-weight language models (135M to 3B parameters), launched in July 2024 and built on openly documented training corpora.
  • Stable Diffusion · Open-weight latent diffusion text-to-image model family released in August 2022 by Stability AI with CompVis and Runway, spanning v1 through Stable Diffusion 3.5.
  • StarCoder · BigCode's open code models (2023-2024), trained on the consent-audited Stack corpus; the open-governance benchmark for code LLMs.
  • T5 · Google's 2019 Text-to-Text Transfer Transformer, an open-weight encoder-decoder family that cast every NLP task as text-to-text.
  • Trinity (model family) · Arcee AI's open-weight sparse mixture-of-experts line: edge-scale Nano, agent-focused Mini, the 400B Trinity Large, and a Thinking reasoning branch.
  • Trinity Large · Arcee AI's 400B-parameter sparse mixture-of-experts flagship, trained from scratch on 17 trillion tokens and released in January 2026; widely described as the largest open-weight model from a US lab to that date.
  • Trinity Large Thinking · Arcee AI's April 2026 open-weight reasoning model: an Apache 2.0 variant of the 400B-parameter Trinity Large, post-trained with SFT and RL for long-horizon agent and tool-use workloads.
  • Trinity Mini · Arcee AI's 26B-parameter sparse mixture-of-experts model (3B active) for agents and tool orchestration, released open-weight under Apache 2.0 in December 2025.
  • Trinity Nano · Arcee AI's 6B-parameter sparse mixture-of-experts model (about 1B active per token) with a 128K context window, aimed at edge, embedded, and offline deployments.
  • Tulu 3 · Ai2's November 2024 family of openly post-trained Llama 3.1 derivatives, released with its full recipe and known for introducing reinforcement learning with verifiable rewards (RLVR).
  • Vicuna · March 2023 open chatbot from the LMSYS team, fine-tuned from LLaMA on shared ChatGPT conversations and a catalyst for LLM-as-a-judge evaluation.
  • Whisper · OpenAI's open-source speech recognition model of September 2022, trained on 680,000 hours of weakly supervised multilingual audio.
  • XLNet · A June 2019 generalized autoregressive pretraining model from Google Brain and Carnegie Mellon University that outperformed BERT on many benchmarks.
  • YaLM-100B · Yandex's June 2022 open 100-billion-parameter GPT-like language model, at release the largest dense model with freely downloadable Apache 2.0 weights.
  • Yi (model family) · 01.AI's family of bilingual open-weight language models, launched in November 2023 with Yi-6B and Yi-34B and later extended by Yi-1.5 and the proprietary Yi-Large.