Abstract
Getting started running an LLM on Ubuntu using modern AMD hardware doesn’t have to be
hard. Thanks to the joint efforts between Canonical and AMD the entire ROCm stack is now
available in the Ubuntu archives. To make it accessible, Lemonade server has been modified to utilize the natively packaged stack. Running models has never been easier. I will go over what it took technically to achieve this and give a quick look at how to use Lemonade to utilize your hardware’s potential.
Speaker Bio
Mario Limonciello (@superm1)
Mario is a veteran developer that participates in multiple open-source communities. He is an Ubuntu core developer, Debian developer, Linux kernel maintainer and a fwupd maintainer. He works for AMD and is passionate about providing better experiences for laptop users with modern hardware. He works at all layers of the stack from the firmware up to software that runs in a desktop environment. Ubuntu works well on AMD hardware due to a lot of the work Mario does.
Ken VanDine (@kenvandine)
Ken VanDine is a veteran open-source developer and author with over 30 years of experience building Linux distributions. After beginning his journey with Slackware in 1993 and architecting globally distributed HPC clusters, he translated his passion for purpose-built systems into a 17-year career at Canonical focusing on GNOME, Ubuntu Desktop, and Snap integration. Today, Ken is extending that expertise into local AI development, building applications using the Lemonade SDK.