FOSDEM 2025 - Low-Level AI Engineering & Hacking Dev Room

Want even more AI plumbing & hacking talks for your FOSDEM trip?

Join our FOSDEM Fringe event: The AI Plumbers Conference on Monday, Feb 3rd in Ghent. Sign up here:

Here are the sessions for Low Level AI Engineering & Hacking Dev Room. You can view this agenda on the official FOSDEM schedule, or download a PDF version.

Event		Speakers	Start	End
Sunday
	Hugging Face ecosystem for Local AI/ ML	VB	09:05	09:30
	The Local AI Rebellion	Justine Tunney	09:30	10:00
	ZML: A High-Performance AI Inference Stack Built for Production and Multi-Accelerator Deployment	Rene Schallner, Guillaume Wenzek	10:00	10:30
	History and advances of quantization in llama.cpp	Tanya Dadasheva, Iwan Kawrakow	10:30	11:00
	quantizing your GGUF models using iterative refinement of the importance matrix	Robert Collins	11:00	11:20
	Apache Arrow: The Great Library Unifier	Matthew Topol	11:20	11:50
	Bringing AI to Wearable Systems: Integrating Vision, Audio, and Sensors on Constrained Hardware	Kris Kersey	11:50	11:55
	How Llamagator helps to implement LLM-as-a-Judge concept on your local machine	Sergy Sergyenko	11:55	12:00
	Compositional LLMs for Assisted competitive coding	Ritwik Agarwal	12:00	12:05
	The Model Openness Framework (MOF)	Arnaud Le Hors	12:05	12:10
	Building AI Applications on Kubernetes: Leveraging Instructlab and the Bee Agent Framework	Martin Hickey, Paul Schweigert	12:10	12:15
	GPUStack: Building a Simple and Scalable Management Experience for Diverse AI Models	Lawrence Li	12:20	12:40
	Self-hosted LLMs at a scale with Paddler	Mateusz Charytoniuk	12:40	13:00
	RamaLama: Making working with AI Models Boring	Eric Curtin	13:00	13:20
	Building AI Applications from your desktop with Podman AI Lab	Cedric Clyburn, Stevan Le Meur	13:20	13:40
	From Supercomputer to Raspberry Pi: Building Open Source Polish Language Models	Bielik Team, Maciej, Pawel Cyrta, Adrian	13:40	13:55
	Tricks Learned from Training Large Open-Source Models	Marcus Edel	13:55	14:10
	Synthetic Data: The Secret Ingredient in Better Language Models	Carol Chen, Cedric Clyburn	14:10	14:25
	LLM Tool use in vLLM	Max de Bayser	14:25	14:40
	Scoping out the Tenstorrent Wormhole	Peter Cawley	14:40	15:00
	Building a new GGML backend: How, Challenges and Oppertunities with Novel Accelerators	Martin Chang	15:00	15:20
	Porting GGML to the NUX Kernel Development Framework.	Gianluca Guida	15:20	15:40
	Accelerating AI with open source hardware and software	William Jones	15:40	16:00
	The bare metal perspective on AMD's GPU ASICs	Jon Chesterfield	16:00	16:20
	wllama: bringing llama.cpp to the web	Xuan-Son Nguyen	16:20	16:40
	Milliwatt sized Machine Learning on microcontrollers with emlearn	Jon Nordby	16:40	17:00

ABOUT FOSDEM

FOSDEM is a non-commercial event organized by the community for the community. It will take place on the weekend of February 1 and 2, 2025, in Brussels, Belgium. Participation is free and open to everyone. Last year, attendance exceeded 8,000 participants.

FOSDEM is free to attend. There is no registration.

USEFUL LINKS

FOSDEM 2025 website
FOSDEM Code of Conduct

ABOUT THE ORGANIZERS

AI Industry Heros

Meet some unsung heroes of the industry who “thanklessly maintain the “load-bearing” technologies powering much of the AI ecosystem

Justine Tunney

Contributor to Llamafile, Llama.cpp, Cosmopolitan and Redbean

Iwan Kawrakow

Contributor to Llama.cpp, IK_Llama.cpp, IK_Llamafile

Organizers

The organizing committee for this devroom

Gianluca Guida

Hypervisors, Operating Systems, Security, Analog Electronics, AI

Jarek Potiuk

Contributor to Apache Airflow. Member of The Apache Software Foundation

JJ Ashgar

Developer Advocate at IBM

Luca Corbucci

PhD Student, KDD Lab

Roman Shaposhnik

CTO & Co-Founder of Ainekko, Co-founder of AIFoundry,
VP of Legal at The Apache Software Foundation

Sanjay Nadhavajhala

Lead AI engineer @ Acorn Labs, Rubra.ai

Tanya Dadasheva

CEO & Co-Founder at Ainekko, Co-founder of AIFoundry

William Jones

AI & Machine Learning Lead at Embecosm

Join our event sponsors

This event is generously sponsored by:

CALL FOR SPONSORS

Contribute to this event

FOSDEM Developer Rooms are free for attendees, and speakers are not paid. Our event is dependent on the generosity of people and organizations. We're looking for contributions such as:

Funding t-shirts or stickers
Sponsoring a speaker's dinner
Catering and drinks during the event
Gifts for speakers

We will be happy to show your sponsorship here and can accommodate displays at the event, such as pop-up banners.

Join the "Low Level AI Engineering & Hacking" Dev Room

Sunday

View Organizers

Become a sponsor