Inference Snaps

Ubuntu Summit Talks
1

Inference Snaps
Inference Snaps1280×720 170 KB

Title

Inference Snaps

Speaker(s)

Edoardo Barbieri
Farshid Tavakolizadeh

Date and time

2025-10-23T15:00:00Z

Session type

:speech_balloon: Talk (10 minutes)

:question: Questions about this session? Please reply to this topic, top questions may be featured during the live event!

1 Like
4

Are there any other commands to be used for starting the webUI?
Installed and the status doesnt show starting, the ‘http://localhost:8326/v1’ also doesnt have webpage

kunal@kunal-H81U:~$ sudo snap install qwen-vl --channel=latest/beta
qwen-vl (beta) 2.5 from Canonical IoT Labs** installed
kunal@kunal-H81U:~$ qwen-vl status
engine: cpu
endpoints:
    openai: http://localhost:8326/v1
5

Here is the link to the press release and other resources: Introducing silicon-optimized inference snaps

1 Like
6

Open WebUI is a separate client application. We have a guide for setting it up: https://documentation.ubuntu.com/inference-snaps/how-to/configure-openwebui/

The status of the service can now be looked up only using snap commands; please take a look at https://documentation.ubuntu.com/inference-snaps/how-to/manage-snap-services/

4 Likes