Overview
A kiosk or smart display is a full-screen application running on a secure device, with the sole purpose of driving that display to provide specific information or a particular function at that location.
Ubuntu is popular for these applications thanks to its excellent security track record and widespread developer familiarity. We compiled this guide to a reference kiosk architecture to enable anybody, anywhere to make a highly secure kiosk using any of the popular application display frameworks - HTML5/web, X11, or native Wayland.
Since these devices are often left unattended for long periods of time, and run in sensitive environments like airports, hospitals and public areas we also want to raise the bar on security and update management. So this tutorial includes the option to use Ubuntu Core, which is a minimal, self-updating OS for your application to run on.
You can also integrate touchscreen or keyboard capabilities, which enables this tutorial to serve for industrial control interfaces and any environment where user feedback is needed.
What youāll learn
How to create a graphical kiosk on Ubuntu Core running a single full-screen demonstration application. Weāll also discuss the basic architecture and its security benefits.
What youāll need
- An Ubuntu desktop running any current release of Ubuntu or an Ubuntu Virtual Machine on another OS.
- A āTarget Deviceā from one of the following:
-
A device running Ubuntu Core.
This guide shows you how to set up a supported device. If thereās no supported image that fits your needs you can create your own core image. - Using a Virtual Machine (VM) You donāt need to have a physical āTarget Deviceā, you can follow the tutorial with Ubuntu Core in a VM. This guide shows you how to set up an Ubuntu Core VM.
- Using Ubuntu Classic You donāt have to use Ubuntu Core, you can use also a āTarget Deviceā with Ubuntu Classic. Read this guide to understand how to run kiosk snaps on your desktop, as the particular details wonāt be repeated here.
-
A device running Ubuntu Core.
Basic infrastructure
We use Wayland as the primary display interface. We will use Mir to manage the display and support connections from Wayland clients. Snapd will confine the applications and enable Wayland protocol interactions through Mir, securely.
For your display application you have a number of choices, it could be a simple web interface, a native Wayland application, or even a traditional X11 application. Regardless of what your application uses, under the hood we always use Wayland and Mir for secure display management and graphics abstractions. A native Wayland application can talk to that directly without any intermediate translation layer. If your application is a web interface, or an X11 application, then we will show you how to wrap it up to sit on top of Wayland without modifying the application itself to become Wayland compatible.
Your graphics approach largely depends on the toolkit your application uses:
- GTK3/4 and Qt5/6 - have native support for Wayland. This is the simplest case, as the application can talk Wayland to Mir directly.
- GTK2, Qt4, Java - do not have Wayland support This is a more complex case, as the toolkits require a legacy X11 server to function. To enable these applications we will embed a tiny X11 server into your application package, which translates X11 calls to Wayland ones.
- Electron, HTML5, Chromium - do not have Wayland support We will need to use the embedded browser together with a tiny embedded X11 server to handle the translation.
Where we need an X11 server it is much more secure to embed it in the confined snap environment together with the application. The X11 protocol was not designed with security in mind and a malicious application connected to an X11 server can obtain information from other running X11 applications. For instance X11 servers do not protect sensitive information like keystrokes between applications using them. To avoid this, each snapped X11 application should have its own embedded X11 server (Xwayland) which then talks Wayland - a far more secure protocol.
One additional detail to note is how a Wayland client connects to a Wayland server. This is done via Wayland sockets, which need to be shared between client (your app) and server (ubuntu-frame). Snapd has robust and secure ways to provide this kind of communication channel between two snap applications, called āinterfacesā.
Snap interfaces
Snapd provides a large number of interfaces, permitting access to everything from hardware to other services on the system. The entire list is available here:
https://docs.snapcraft.io/reference/interfaces
You can use the snap interfaces command to list the interfaces available on your system, the slots providing them and the plugs consuming them.
For our kiosk application, we will need to plug into at a very minimum the following interfaces:
- opengl - access to OpenGL hardware
- wayland - allows sharing Wayland sockets between server and client
Using snapd interfaces your app can securely connect to Mir using the Wayland protocol and yet remain fully confined.
Demonstration kiosk on Ubuntu Core
This step assumes you have set up your device or VM and have SSHed into it. If you have not done this please see the guilds referenced above in āWhat youāll needā.
Install the āubuntu-frameā snap:
snap install ubuntu-frame
Now you should have a graduated grey screen.
Letās install a web kiosk snap to try it out:
snap install wpe-webkit-mir-kiosk
and you should see something like this:
The website can be changed using the āurlā snap configuration option:
snap set wpe-webkit-mir-kiosk url=https://mir-server.io
Building your own kiosk Snap
As mentioned above, the approach to building a kiosk snap from your application depends on whether your application has native support for Wayland (e.g. uses GTK3/4, Qt5/6 or SDL2), is Electron/HTML5 based, or not (everything else).
We have written up a series of tutorials to address each of these possibilities. We recommend reading the developer guide as it is currently the most comprehensive way to get familiar with what Ubuntu Frame has to offer.