Benchmarking AI with Stanislav Khromov

In this episode, Stanislav Khromov joins the Svelte Radio team to discuss his work on Svelte Bench, a
benchmarking tool that scientifically measures how well different LLMs understand and write Svelte 5 code.

The conversation explores the challenges of AI-assisted coding with Svelte 5, the development of the official
Svelte MCP (Model Context Protocol) that provides LLMs with documentation and auto-fixing capabilities, and
the surprising performance differences between major AI providers. Stanislav also shares insights on working
with AI tools, the future of local models, and the economics of AI coding assistants.

Notes
Unpopular Opinions
Picks

Creators and Guests

antony 
Host
antony 
Dad / @SvelteJS maintainer / @SvelteSociety co-founder / Svelte Radio host. Born at 341.57 ppm CO2.
Kevin A. K.
Host
Kevin A. K.
Co-founder of Svelte Society 🌎 Organizer of Svelte Summit 🏔 Host of Svelte Radio 📻
Stanislav
Guest
Stanislav
🇸🇪 Web developer and obscure trivia enjoyer🌱 Find me at https://stanislav.garden/🔵 Starting over on Bluesky
Benchmarking AI with Stanislav Khromov
Broadcast by