The next age of LLMs? Dev gets a small LLM running at 10 tokens a second locally on a $10 microcontroller

https://www.techradar.com/author/rahim-amir· Aug 7, 2026 · 7:35 PM UTC ·10 min read · 0 reactions · 0 comments · 5 views

#next #llms #gets #small #running

TL;DR · WeSearch summary

Dev gets a small LLM running at 10 tokens a second locally on a $10 microcontroller News By Rahim Amir Published 7 August 2026 28.9M-parameter model runs on a microcontroller costing less than $10 When you purchase through links on our site, we may earn an affiliate commission. An ESP32-S3 offers 512 KB of SRAM and 8 MB of PSRAM that is woefully inadequate at first glance.Quantization closes the first part of the gap: dropping the weights to four-bit precision trades a little accuracy for a 75% reduction, bringing 60MB down to 14.9MB. You will receive a confirmation email shortly."},"failureMessage":"There was a problem.

Key facts

▪Dev gets a small LLM running at 10 tokens a second locally on a $10 microcontroller News By Rahim Amir Published 7 August 2026 28.9M-parameter model runs on a microcontroller costing less than $10 When you purchase through links on our site
▪An ESP32-S3 offers 512 KB of SRAM and 8 MB of PSRAM that is woefully inadequate at first glance.Quantization closes the first part of the gap: dropping the weights to four-bit precision trades a little accuracy for a 75% reduction, bringing
▪You will receive a confirmation email shortly."},"failureMessage":"There was a problem.

About this source

TechRadar publishes from United Kingdom and files mainly under tech. We currently carry 1,847 of its stories.

All TechRadar coverage →

Original article

TechRadar · https://www.techradar.com/author/rahim-amir

Read full at TechRadar →

Story provenance

Source · retrieval · rights · ranking — open for full record

inspect →

Attribution is not the same as permission. This drawer separates discovery metadata, excerpts, WeSearch-generated summaries, reuse status, and whether the publisher receives the visit. Nothing here claims a legal grant the publisher has not made.

Record

Original publisher	TechRadar
Canonical URL	https://www.techradar.com/pro/the-next-age-of-llms-dev-gets-a-small-llm-running-at-10-tokens-a-second-locally-on-a-usd10-microcontroller
Publication time	Fri, 07 Aug 2026 19:35:00 +0000
Retrieval time	2026-08-07T19:40:44.836Z
Last seen	2026-08-07T19:40:44.836Z
Headline source	Publisher (no WeSearch rewrite)
Excerpt source	publisher body
Excerpt method	First ~120 words (~800 chars) of extracted publisher body, fair-use limited.
Summary	WeSearch · cerebras-chat (WeSearch summarizer)
Summary source text	contentText
Citation coverage	Summary is a WeSearch-generated derivative; primary citation is the original publisher URL.
Cluster	KIFpHesR_N1k · 1 stories
Cluster logic	Grouped by semantic title/content similarity across sources within a rolling window. Same-publisher template collisions are excluded from coverage comparison.
Ranking reason	Story pages are not engagement-ranked. Hub feeds use recency, with optional source-diversified chronological ordering (cap consecutive stories per source). No personalized ranking.
Publisher visit	Yes — open original
Substitutes article?	No — link-out required for full text

Rights status (four layers)

Publisher-declared

No publisher-confirmed rights record for this source yet.

Machine-readable

No source-specific machine-readable restriction detected beyond the public feed.

WeSearch interpretation

WeSearch declared handling (basis: Derived from the published RSS/Atom feed). This is WeSearch policy, not a legal grant on the publisher's behalf.

Unknown

Retrieval and training permissions are not asserted unless the publisher confirms them.

WeSearch handling by dimension

Indexing	May the item be indexed (stored, ranked, made findable)?	Allowed
Snippet	May a short excerpt of the publisher's text be shown?	Allowed
AI summary	May WeSearch generate its own short summary of the article?	Limited
Retrieval / RAG	May the content be exposed for third-party retrieval-augmented generation?	Not asserted
Model training	May the content be used to train AI models?	Not asserted
Commercial reuse	May the content be reused commercially?	Not permitted

Basis: Derived from the published RSS/Atom feed. Contact: [email protected]. Reviewed: 2026-07-24.

Open original publisher → Source rights JSON → Machine-readable provenance → Rights framework → WESEARCH-STORY-PROVENANCE-V1

Opening excerpt (first ~120 words) tap to expand

Pro The next age of LLMs? Dev gets a small LLM running at 10 tokens a second locally on a $10 microcontroller News By Rahim Amir Published 7 August 2026 28.9M-parameter model runs on a microcontroller costing less than $10 When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works. (Image credit: Pixabay) Copy link Facebook X Whatsapp Reddit Pinterest Flipboard Threads Email Share this article 0 Join the conversation Follow us Add us as a preferred source on Google Newsletter Subscribe to our newsletter A developer has a 28.9-million-parameter model generating TinyStories-style text at 9.88 tokens per second, fully offline, on a $10 microcontrollerIt was achieved by fitting a language model on a chip with 512KB of RAM by leaving most of it in…

Excerpt limited to ~120 words for fair-use compliance. The full article is at TechRadar.

Anonymous · no account needed

Discussion

0 comments