AI@SGMK

We want learn about how AI works, how we can use it and apply it to our work. As a starting point, we'll organize a workshop to kick things off. We will organize further sessions if folks are interested or want to contribute their own topics, demos and presentations.

Sunday, 26th of April 2026 from 13:00 - 15:00 hours at the Bitwäscherei in Zürich

Overview

• AI Hardware - From MCUs to server grade NPUs
• Basic Theory - Neural Networks
• Running AI locally on single board computers
• What's next? Which topics do we want to dive deeper into? When do we plan to do a next session?

AI Hardware

Chrismicro will introduce this workshop series, and will give us an overview of what AI-related hardware is out there, from tiny micro controllers (MCUs), consumer graphics cards (GPU), up to server grade neural processing units (NPU).

Basic Theory

Markus will provide us with the theoretical tools to grasp how neural network operate, so we can start to make sense of all the new acronyms and terms that can make your head spin when dealing with AI.

Running Local AI Inference

Simon / El RIDO will show some practical applications of small LLMs, that we can run locally on single board computers (SBC) with a small NPU. For practical trials, a Radxa Rock 5b, an SBC based on the Rockchip RK3588 chipset with 16 GB of RAM and a NPU with 6 TOPS will be available on site, letting us run local, offline inference using the RKNN-LLM framework in a terminal based chat. For some more bells and whistles, such an SBC or a gaming GPU (300 TOPS and more) can be combined with the Open WebUI dashboard through the ollama-API. This lets us come close to the experiance of cloudbased commercial AI chat solutions.

Planning Future Sessions

We'll collect what topics are of interest to the participants and will try to organize further sessions to dive deeper into the topics or work on concrete applications with the tools at hand. Let's have some fun!