Added, by axis
Axes with the most records come first. A record that spans several axes is counted once, under its main axis.
⑲6 records
On-Device & Local Inference
- Aug 31, 2026HUMAIN, Qualcomm — Unveiled the Horizon Ultra AI PC at LEAP 2026 (Riyadh) — based on the Snapdragon X2 Elite (18-core Oryon CPU, Adreno GPU, Hexagon NPU), it spreads AI work across the CPU, GPU and NPU. Enterprise purchases of the Windows version begin on Sep 20, 2026; a HUMAIN OS version is planned for 2027. The press release gives no NPU TOPS figure or price SourceA Saudi sovereign wealth fund affiliate puts forward an on-device AI PC as the endpoint of a sovereign AI stack — a phase in which local inference becomes an item of geopolitical procurement
- May 19, 2026Google (AI Edge) — LiteRT-LM generally available (GA) — added a native Swift API for iOS and a WebGPU-accelerated JavaScript API. Supports Android CPU, OpenCL GPU and NPU, iOS Metal and browser WebGPU. With Gemma 4: 52 tok/s decode on Android GPU, 56 tok/s on iOS GPU, 76 tok/s on the web on a MacBook Pro M4 Max, up to 2.2× with Multi-Token Prediction, 607MB of memory on iOS SourceThe stage at which an on-device runtime covers not just mobile OSes but browsers with the same stack. Figures are the vendor's own measurements
- May 5, 2026Google (Chrome) — Opened the Prompt API to the web in Chrome 148 stable — for extensions it has been stable since Chrome 138. Web pages access the browser's built-in Gemini Nano directly, with support for text, image and audio input and for constraining responses with regular expressions and JSON schemas. Requirements: 22GB of free space, and more than 4GB of VRAM or 16GB of RAM and 4 or more cores SourceA stable-channel case of an on-device model exposed as a web platform API rather than an app. Responsibility for model distribution and storage management passes to the browser vendor
- Nov 28, 2025Liquid AI — Published the LFM2 technical report — expanded to a 350M–8.3B family (dense 350M, 700M, 1.2B, 2.6B; MoE 8.3B total / 1.5B active), pretrained on 10–12T tokens, 32K context. Describes the design as coming from a hardware-in-the-loop architecture search under edge latency and memory constraints. LFM2-2.6B scored 79.56% on IFEval and 82.41% on GSM8K SourceA follow-up document to the July release. A case of an on-device family having public documentation at the level of a technical report
⑩5 records
Safety, Alignment & Interpretability
- Sep 2, 2026Google — Announced the Fairwind program — provides Gemini 3.8 Flash Cyber and CodeMender, after screening, only to governments, national cyber authorities, critical infrastructure operators and large platforms. Requires, as conditions of participation, access limited to in-house security teams and multi-factor authentication. Said it has more than 650 partners and has given more than $100 million in cumulative cybersecurity support through Google.org, of which $36 million has been allocated to 35 cyber clinics SourceInstitutionalizes an access-control approach that deploys dual-use offense-and-defense models only to vetted defenders
- Sep 1, 2026OpenAI — Published "Path to Astra: critical capabilities and frontier safeguards" — announced that Astra is the company's first model to meet the Critical capability threshold for cybersecurity under the Preparedness Framework. Defines Critical as the ability (1) to discover and develop working zero-day exploits against hardened real-world systems without human intervention, or (2) to plan and execute novel attack strategies against hardened targets end to end when given only high-level goals. In response, it deployed stronger refusal of harmful requests (91.5% by its own measurement, vs 59% for the previous version), system-level cyber-misuse classifiers, real-time monitoring and blocking, and initial access restrictions, and explained that it delayed some development stages to strengthen safeguards SourceThe first case of the top tier of a company's own risk framework actually being triggered. A reference point for checking whether declarative thresholds lead to concrete measures such as deployment delays and access restrictions, and the point at which frontier cyber capability turned into a policy issue
- Sep 1, 2026xAI — Published "Biosecurity at the frontier" — describes Grok 4.6's biosecurity safeguards (refusal training, inference-time protections, behavioral controls) and cites third-party evaluation by LatchBio (BioSecBench-Refusal, BioSecBench-Surveillance). Company claims: an average of 62.1% on the refusal benchmarks, the highest among the models tested; refusal of 59.2% of adversarial tasks and completion of 64.8% of benign biology tasks. Pledges expanded pre-deployment testing, more third-party evaluation and improved post-deployment monitoring for future models SourceA case of a frontier lab publishing biosecurity refusal rates in numbers and naming an external evaluator — though it is the company's own post, and there is no independent replication
- Sep 1, 2026Anthropic — Announced Enterprise Frontier Safeguards (EFS) — an approach that performs automated misuse detection (cyberattacks, credential theft, development of harmful capabilities) without Anthropic staff viewing the data, in a zero data retention configuration where logs are kept in cloud accounts owned by the customer (AWS, Azure, Google Cloud) and the customer manages the encryption keys and access policies. Developed with more than 100 enterprise customers and rolled out in stages from fall 2026. Aimed at the data retention requirements of regulated industries such as finance, healthcare, law and government SourceA design answer to the point where demands for data sovereignty clashed with misuse monitoring. If a structure that makes safety monitoring work outside the vendor's servers becomes standard, the barrier to adopting frontier models in regulated industries is redefined as a problem of deployment architecture
⑪5 records
Model Architecture & Training Methods
- Sep 3, 2026Sergii Kozyrev, Davyd Maiboroda — Minima released — to test the practice, in early community 4-bit quantizations of the hybrid LLM Qwen3.8-27B (48 GDN layers, 16 attention layers), of leaving the GDN blocks — especially the decay and write-strength gates — at 8/16 bits for fear of accumulating recurrent error, applies NVFP4 W4A4 to all 496 linear layers. Reports that it matches BF16 within the range of seed noise (an average of -0.52 across 5 tasks) on 4K/32K perplexity, MMLU-Pro, GSM8K, AIME'25, GPQA-Diamond, LiveCodeBench and 64K RULER retrieval, while at 17.5 GiB it is the smallest of those compared and its prefill is 14–19% faster. Also fixes the global-scale mismatch that arises when a kernel that fuses modules into a single GEMM serves NVFP4 checkpoints calibrated per module SourceOverturns the conventional wisdom that "errors in recurrent state accumulate over long contexts", arguing that the recurrent half of a hybrid LLM is in fact the easier half to quantize, and offers four mechanistic explanations, including that NVFP4's 16-element block scaling localizes extreme outliers in the residual stream and that the delta-rule recurrence keeps injected noise flat across 32K tokens. Figures are as reported by the authors.
- Sep 1, 2026Shaowen Wang et al. — SMELT released — points out that evaluations of looped transformers, which repeat a block of shared layers to increase effective depth, usually compare at a fixed model size and so mix up architectural advantage with extra FLOPs; presents a recipe (Sparse MoE Transformer, middle layers Loop Twice) that runs the middle half of an MoE transformer's layers twice while matching all three budgets — FLOPs per token, total non-embedding parameters and KV cache. Scaled to four sizes of up to 54B non-embedding parameters and fitted Chinchilla-style scaling laws separately for each architecture SourceA study that judges, at the level of scaling laws, whether depth reuse (looping) still pays off once budgets are strictly matched. In the authors' own reporting, it saves 6.8–18.0% of training FLOPs at the compute-optimal frontier; the gains are largest on code and grow with sample length and the number of in-context examples; and it offers a mechanistic analysis showing that the second visit reduces attention sinks and reallocates attention mass to content-relevant tokens.
- Aug 31, 2026Zihan Qiu et al. (Alibaba Qwen) — On the Design of Qwen3.8-Next Architecture released — describes the design of Qwen3.8-Flash-Next, a sparse MoE model with 125B parameters and 6B active per token, plus a 51B n-gram embedding table kept off the accelerator. It combines a layer-wise hybrid of Gated DeltaNet (GDN) and global attention, with full attention in only one of every four layers, with Qwen Sparse Attention and Gated Residual, and evaluates each design change along three axes: its effect on loss and downstream benchmarks, on training, prefill and decode costs, and on optimal hyperparameters SourceA case of a frontier open-weight model disclosing the rationale for its architecture choices ablation by ablation. In the authors' own reporting, loss and downstream accuracy do not always move together, and combining this architecture with the Muon optimizer pushes the optimal learning rate and batch size upward, making batch-size warmup unnecessary and greatly improving stability in stress tests.
- Aug 28, 2026Alexia Jolicoeur-Martineau, Rhea Sanjay Sukthanker, Pashmina Cameron, Emy Gervais — Sliding-window beats linear attention released — points out that the line of research retrofitting existing LLMs with linear attention has never been properly compared with simpler baselines, and reports that sliding-window attention (SWA) with sinks matches or beats post-trained linear-attention models across several LLMs and a range of downstream tasks. On long-context reasoning tasks such as Needle-in-a-Haystack and BABILong, SWA performed 2–10 times better than linear attention; it claims that SWA needs no post-training, is very fast and uses less memory SourceA rebuttal paper that sets a baseline — "a sliding window that needs no post-training is enough" — against the strand of linear-attention retrofits that had been in the spotlight as a fix for quadratic scaling. The authors conclude that linear-attention models will catch up with SWA only if trained from scratch or put through extensive post-training. Figures are as reported by the authors.
⑱5 records
AI Infrastructure Software
- Sep 1, 2026Guowei Wang et al. — AInfer-PD released — points out that in agentic RL each trajectory proceeds asynchronously, alternating between generation and environment interaction over multiple turns, so the coexistence of prefill (P) and decode (D) becomes a persistent property of rollouts rather than a one-off prompt-processing event; extends in-place P/D multiplexing to distributed MoE rollouts. It coordinates the order of P/D collective communication across ranks and gives DeepEP's P and D paths independent communication state, making concurrent execution of interleaved ADP/ATP and DeepEP paths safe while sharing model weights and KV storage. Reports that on single-node prefill-heavy workloads it cut rollout completion time by 7.1–22.5% versus the same engine with P/D multiplexing turned off and by 24.8–32.9% versus SGLang, and on 2 nodes by 18.0–35.3% and 18.3–31.8% respectively SourceA strand that, instead of P/D disaggregation, which requires separate device pools and KV-cache transfers, overlaps P and D on the same devices by isolating only collective-communication order and state while sharing weights and KV. It is also a case of the serving-infrastructure bottleneck moving from inference services to RL rollouts. Figures are as reported by the authors.
- Jan 21, 2026PyTorch Foundation — PyTorch 2.10 released — varlen_attn() variable-length attention (forward and backward, A100+ BF16/FP16), torchinductor combo-kernel horizontal fusion, cuSOLVER DnXgeev general eigenvalue decomposition, torch.compile honoring use_deterministic_mode and the introduction of DebugMode, and Python 3.14 support. Announced that TorchScript will be replaced by torch.export. 536 contributors and 4,160 commits since 2.9. From 2026 the release cycle shortens from quarterly to every 2 months SourceThe point at which numerical reproducibility (determinism, tensor-hashing debugging) made the release headline. A sign that the training stack is moving from a performance race to a debuggability phase
- Oct 22, 2025PyTorch (Meta) — Helion beta released — compiles a Python-embedded DSL into autotuned Triton kernels. An attention kernel takes 30 lines in Helion versus 120 in Triton; geometric-mean speedup over eager of 3.27× on B200 (torch.compile 2.7×, hand-written Triton 1.76×), and 2.37× on MI350X (MI350 series) SourceJust as Triton abstracted CUDA by one level, Helion abstracts Triton by one more. The next layer in the lineage of kernel authoring
- Oct 22, 2025PyTorch (Meta) — Monarch released — a distributed framework that uses a single controller instead of SPMD to treat a cluster like an array. Separates the control plane (messaging) from the data plane (RDMA). In the VERL integration it scaled from 16 to 2,048 H200 GPUs; with the torchft integration, injecting a failure every 3 minutes on 240 H100 GPUs, recovery was 60% faster than a full SLURM restart (90 seconds on average for process failures, 2.5 minutes for machine failures) SourceThe point at which the single-controller model proposed by Google's Pathways in 2022 entered the core PyTorch lineage. TorchTitan becomes an actor inside Monarch, and torchforge is built on top of Monarch
⑥4 records
Reasoning Models & the AGI Debate
- Sep 4, 2026Anthropic — Published "Formalizing Fermat's Last Theorem" — formalized Wiles's proof of Fermat's Last Theorem in Lean using an internal general-purpose research model described as roughly on par with Claude Fable 5.1. Reports that it took 11 days, about 6 billion output tokens and 13 million lines of Lean code, proving 30,300 theorems (29,500 of them used in the final proof), and states that Lean checked it using only the 3 standard axioms. Many Claude agents collaborated on Prove2Me, a collaborative formalization platform designed by Tianyi Peng's team at Columbia, and it states that Kevin Buzzard (Imperial), who had led the Lean community's FLT formalization, reviewed it and confirmed it as the first end-to-end machine-checked proof of FLT. It follows the simplified exposition by Darmon, Diamond and Taylor rather than Wiles's original paper SourceA claim that an agent swarm carried out, in a short time, a large formalization project that the human community had been pursuing over a span of years. Because the output is a checkable artifact (a Lean proof), it can, unlike a benchmark, be rechecked externally — making it, among claims of autonomous research, a case that is relatively easy to check
- Sep 3, 2026OpenAI — Released GPT-6 Astra. On company benchmarks, claims 97.6% on FrontierMath Tier 4 (v2), 99.9% on ARC-AGI-3, 96.0% on GPQA Diamond, 57.9% on Terminal-Bench 4.0, 72.6% on OSWorld 2.0, 92.7% on ScreenSpot-Pro and 100% on ExploitBench. Long contexts of 512K–1M tokens were tested; API pricing is $10 per 1M input tokens and $50 for output, and a fast mode at 2x speed costs 2x as much. Rolled out to a limited set of organizations on the day, then expanding to ChatGPT Plus, Pro, Business and Enterprise; available on the OpenAI API, Azure and AWS Bedrock. A GPT-6 Astra Pro variant exists for Pro, Business and Enterprise SourceThe start of the GPT-6 generation. Released the same week as Anthropic's Fable 5.1 with the same price tag of $10/$50 per 1M tokens, so frontier pricing has effectively converged, and the center of benchmark competition shifts to computer use, cyber and agentic coding
- Sep 2, 2026Google DeepMind — Gemini 3.8 Flash and 3.8 Flash Cyber released — company claims: 54.9% on HLE-Verified, 47.2% patch pass@1 on CWE-Bench, a success rate above 70% in internal evaluations across 20 languages, and 2.6 times as many correct patches as competing models in an evaluation by the Chrome security team. Pricing is $0.75 per 1M input tokens and $3.75 for output, an introductory price through Dec 31, 2026. Available in AI Studio, Android Studio, the Gemini API, Gemini Enterprise, the Gemini app and Search SourceSecurity-specific derivative models are split off as official variants of the frontier lineup — vulnerability detection and patching become an independent axis of the model family
- Sep 1, 2026Anthropic — Released Claude Fable 5.1 and Claude Mythos 5.1. On company benchmarks, claims 52.6% for Fable 5.1 on agentic scientific research (Terminal-Bench Science 0.1) (Fable 5: 24.7%), 55.8% for Fable 5.1 and 60.9% for Mythos 5.1 on agentic coding (Terminal-Bench 4.0), and 60.9% (no tools) and 65.0% (with tools) on Humanity's Last Exam. Pricing is the same as Fable 5 at $10 per 1M input tokens and $50 for output, but cache reads were cut by 75% to $0.25 per 1M tokens, which it claims lowers costs by about 25% for typical workloads and by up to about 45% for complex coding and highly agentic work. Mythos 5.1 is available only to vetted cyber defenders and life scientists, and is currently limited to US organizations SourceThe competitive axis for frontier models shifts from coding to autonomous scientific research. Tiered deployment that opens the top model only to screened users has hardened into a product line, and the fact that the price cut comes from the cache-read rate rather than from performance shows that long-running agent loops are at the center of billing
⑭4 records
Physical World & Real-World Impact
- Sep 3, 2026OpenAI — Announced "Daybreak for Frontline Defenders" — expands Daybreak, which lets approved public- and private-sector defenders use advanced AI for cyber defense, into a $1 billion global initiative. It consists of Daybreak Blue, based on the flagship model, and Daybreak Red, a dedicated cyber model for sensitive and technically demanding work. It prioritizes under-resourced organizations such as water and power grid operators, state and local governments, regional and community banks, nonprofits and open-source maintainers; explains that thousands of defenders at 2,000 approved organizations already use it, and that it is distributed through the Daybreak Defense Network of more than 35 partner products and services SourceA defense-side correction of the asymmetry, coming the same week as the declaration of Critical cyber capability. An approach that offsets the risk of offensive capability not only through access control but through subsidies for defenders, with a frontier lab stepping into the role of supplier for critical infrastructure security
- Sep 3, 2026Google DeepMind, Google Research — WeatherNext 3 released — 5km resolution for surface variables, hourly forecasts (previously every 6 hours), and real-time geostationary satellite data instead of physics simulation. Company claims: precipitation forecasts improved by up to 60% against IMERG, 30% against MRMS and 10% against rain gauges. Cites Brightband's independent real-time evaluation as finding it the most accurate. Applied to Search, the Gemini app, Maps, the Maps Platform Weather API and Earth Engine, with data provided through BigQuery, Earth Engine and GCS SourceAI weather models move beyond research demos to become the default forecasts in consumer products and commercial APIs
- Sep 1, 2026OpenAI — Expanded ChatGPT's connections to medical data — through an Epic integration, connects electronic health records (EHR) for ChatGPT for Healthcare organizations and eligible Enterprise customers, and offers US clinicians, as ChatGPT for Clinicians, a Healthcare Public Data plugin bundling 9 official sources including ClinicalTrials.gov, CMS Coverage, RxNorm, DailyMed and PubMed. The company claims it worked with physicians across 60 countries, 49 languages and 26 specialties, that 99.1% of 4,363 physician-reviewed responses were rated safe, and that more than 93% of answers to clinical questions were rated good or better for accuracy. Supports HIPAA BAAs, role-based access, SSO and audit logs SourceA stage at which general-purpose chatbots connect directly to regulated medical record systems. The front line of context connection (RAG, connectors) has moved from the public web into regulated data, while the safety evidence still relies on the vendor's own evaluation
- Aug 26, 2026Anthropic — Released external research results and aggregate data through Anthropic Insights — aggregate data drawn from about 250,000 conversations from April–May 2026 was published on Hugging Face. Researchers have no access to the original conversations and receive only privacy-reviewed aggregate outputs, and the agreement includes a clause allowing them to publish results unfavorable to Anthropic. Review rights are limited to privacy, assistance with policy violations, confidentiality and research accuracy, and Imperial College London carries out a third-party privacy audit. Categories in which policy violations come to light are partially redacted, under 5% SourceA case of opening an external checking channel into a structure in which vendors monopolize data on actual usage. The design spells out the freedom-to-publish clause and the third-party audit in order to set it apart from vendors' self-reporting
Showing 24 here; there are 21 more, including 9 other axes. Open the Advanced page to see them all.
How this relates to the main moduleThis page holds
only what was added that week. For the whole story, open
the main module — it is
one latest edition, revised every week, while weekly editions
stay as they were.