Documentation Overview

  1. Operation documentation
    1. Installation
      1. Run UBOS on a PC (64bit)
      2. Run UBOS from a boot stick on a PC (64bit)
      3. Run UBOS in a VirtualBox virtual machine (64bit)
      4. Run UBOS on an Amazon Web Services EC2 virtual server
      5. Run UBOS on Raspberry Pi 5
      6. Run UBOS on ESPRESSObin
      7. Run UBOS in a Linux container on a PC (64bit)
      8. Run UBOS in an aarch64 Linux container
    2. Setting up your first Site and App
    3. Setting up networking and DNS
    4. How to create a website secured by SSL/TLS
    5. How to set up a website as a Tor hidden service
    6. Managing Sites and Apps
    7. Backup and restore
    8. Upgrading and keeping UBOS current
    9. The UBOS Staff
    10. App-specific notes
      1. Reliably send e-mail via Amazon Web Services’ Simple E-mail Service: amazonses
      2. Static website hosting with rsync-based upload: docroot
      3. Notes on Mastodon
      4. Notes on Nextcloud
      5. Notes on Redirect
      6. Notes on Wordpress
    11. Device-specific Notes
      1. ESPRESSObin
      2. Raspberry Pi
    12. Advanced management
      1. Enabling non-standard package repositories
      2. Migrating from one App to another
      3. Pinning resources
    13. Command reference
    14. FAQ, HOWTOs and Troubleshooting
      1. “Package not found error” when installing a new App or Accessory
      2. A UBOS container comes up degraded
      3. Booting UBOS on a PC starts out fine, but then the screen goes blank
      4. Can I run UBOS in a Docker container?
      5. Can I use UBOS without purchasing a domain name?
      6. Cannot access MySQL database. File missing: /etc/mysql/root-defaults-ubos.cnf
      7. Cannot boot UBOS from boot stick on a PC
      8. Cannot connect to the public internet from a UBOS container
      9. Cannot create a temporary backup; the backup directory is not empty
      10. Failed to create file /sys/devices/system/cpu/microcode/reload
      11. How are the various UBOS images different from each other?
      12. How can I install more than one web App on the same Device?
      13. How do I set up WiFi?
      14. How to enable non-standard Package Repositories
      15. How to get help
      16. How to log into your UBOS Device
      17. How to modify the configuration of your Site
      18. How to report a bug or issue
      19. How to use Pagekite to reach your UBOS Device behind a firewall
      20. How to use SSH
      21. I need a Package that isn’t in UBOS
      22. I need root
      23. I own a domain name, and I’d like to use it for my UBOS Device. How do I do that?
      24. I want to move from one device to another, or from/to the cloud to/from a device
      25. I want to run ssh on a non-standard port
      26. I’m running out of disk space, what now?
      27. Installing a new Package or updating fails with a message about “invalid or corrupted package” or “key is disabled”
      28. Installing a new Package or upgrading fails with a message about “unknown trust”
      29. Is it safe to have my Site accessible from the public web?
      30. My non-English keyboard layout is all screwed up
      31. My SD card is much larger than the UBOS image. How do I use the rest of the space?
      32. Nothing happens when UBOS is supposed to be booting
      33. Problems with “IPv6 Packet Filtering Framework”
      34. UBOS is in a “degraded” state
      35. ubos-admin status reports “Systemd unit … has failed”
      36. Verify your downloaded UBOS image
      37. What is the default “root” password?
      38. What text editor can I use on UBOS?
      39. Why did you derive UBOS Linux from Arch Linux, and what is the relationship between UBOS Linux and Arch?
      40. Why is it called UBOS?
      41. Writing a disk image to a USB stick or SD card
        1. Writing an image to a USB stick or SD card on Linux
        2. Writing an image to a USB stick or SD card on macOS
        3. Writing an image to a USB stick or SD card on Windows
  2. Developer documentation
    1. Developer setup
      1. Developing using Arch Linux on VirtualBox x86_64 with a systemd-nspawn container
      2. Developing using a UTM Arch Linux VM on Apple Silicon computers with UBOS in a systemd-nspawn container
      3. Alternate developer setups
        1. Developing using a systemd-nspawn container (Linux host only)
        2. Developing using Arch Linux using Parallels on Apple Silicon with a systemd-nspawn container
        3. Developing using a UTM Arch Linux VM on Apple x86_64 computers with UBOS in a systemd-nspawn container
    2. Developer tutorials for standalone UBOS apps (not UBOS Mesh)
      1. Build and run your first UBOS standalone App
      2. How to package UBOS standalone Apps built with a variety of languages
        1. Hello World
        2. Glad-I-Was-Here (PHP, Mariadb)
        3. An Accessory for Glad-I-Was-Here (PHP, Mariadb)
        4. Glad-I-Was-Here (PHP, Postgresql)
        5. Glad-I-Was-Here (Python, Mariadb)
    3. UBOS Gears Reference
      1. UBOS Manifest
        1. Structure of the UBOS Manifest
        2. Info section
        3. Roles section
        4. Customization points section
        5. Appinfo section
        6. Accessoryinfo section
        7. Variables available at deploy or undeploy
        8. Functions that may be applied to variables
        9. Creating random values
        10. Scripts in UBOS Manifests
      2. Site JSON
      3. A complex deployment example
      4. UBOS Networking
      5. Allocating and opening up non-default ports
      6. Logging
      7. UBOS state
      8. UBOS Backup format
      9. Format of the App Status JSON
      10. Testing standalone Apps with “webapptest”
      11. Understanding ubos-admin
        1. Command: ubos-admin backup
        2. Command: ubos-admin backupinfo
        3. Command: ubos-admin createsite
        4. Command: ubos-admin deploy
        5. Command: ubos-admin hostid
        6. Command: ubos-admin init-staff
        7. Command: ubos-admin list-data-transfer-protocols
        8. Command: ubos-admin listnetconfigs
        9. Command: ubos-admin listsites
        10. Command: ubos-admin read-configuration-from-staff
        11. Command: ubos-admin restore
        12. Command: ubos-admin setnetconfig
        13. Command: ubos-admin setup-shepherd
        14. Command: ubos-admin showappconfig
        15. Command: ubos-admin shownetconfig
        16. Command: ubos-admin showsite
        17. Command: ubos-admin status
        18. Command: ubos-admin undeploy
        19. Command: ubos-admin update
        20. Command: ubos-admin write-configuration-to-staff
    4. Release channels and UBOS release process
    5. Miscellaneous
      1. Potentially useful infrastructure for standalone Apps
        1. The UBOS rsync server
      2. Middleware-specific notes
        1. Node.js notes
        2. SMTP notes
      3. Setting up an Arch Linux system as a UBOS development system
        1. How to create a UBOS development VM for VirtualBox on x86_64
        2. How to create a UBOS development VM for UTM on x86_64 Apple computers
        3. How to create a UBOS development VM for UTM on Apple Silicon computers
        4. How to create a UBOS development VM for Parallels Desktop on Apple Silicon computers
      4. Creating cloud images
        1. Amazon Web Services EC2
    6. Developer FAQ
      1. Doesn’t apt / dpkg / yum / pacman etc. does what UBOS Gears does already?
      2. Doesn’t puppet / chef / ansible etc. does what UBOS Gears does already?
      3. Doesn’t Docker do what UBOS Gears does already?
      4. Is it possible to run UBOS Gears or Mesh on an operating system other than UBOS Linux?
      5. Can I manage apps packaged as Docker containers with UBOS?
  3. Architecture
  4. Glossary
    1. Accessory
    2. App
    3. AppConfigId
    4. AppConfigItem
    5. AppConfiguration
    6. Arch
    7. Arch Linux
    8. Attribute
    9. blessing
    10. Bot
    11. Context Path
    12. Customization Point
    13. Data Transfer Protocol
    14. Deployment
    15. Depot
    16. Device
    17. Device Class
    18. diet4j module framework
    19. EntityType
    20. Flock
    21. Gradle
    22. Handlebars
    23. History
    24. Home Server
    25. HostId
    26. Hostname
    27. IDE
    28. Installation
    29. LetsEncrypt
    30. mDNS
    31. MeshBase
    32. MeshObject
    33. MeshObjectIdentifier
    34. MeshType
    35. MeshTypeIdentifier
    36. Middleware
    37. Model
    38. Network Configuration
    39. Package
    40. Pagekite
    41. Parallels Desktop
    42. Personal Server
    43. PKGBUILD
    44. Property
    45. PropertyType
    46. Relationship
    47. RelationshipType
    48. Release Channel
    49. Repository
    50. Retention Bucket
    51. Role
    52. RoleAttribute
    53. RoleProperty
    54. RoleType
    55. Rolling Release
    56. Shepherd
    57. Site
    58. Site JSON
    59. Site JSON Template
    60. SiteId
    61. Transaction
    62. Transaction Log
    63. UBOS Gears
    64. UBOS Linux
    65. UBOS Manifest
    66. UBOS Mesh
    67. UBOS Mesh code generator
    68. UBOS Project
    69. UBOS Staff
    70. unblessing
    71. UTM
    72. VirtualBox
    73. VMWare
    74. Wildcard hostname

Variables available at deploy or undeploy

/docs/development/reference-gears/manifest/variables/

When an App or Accessory is deployed or undeployed, the involved scripts, templates and the Manifest JSON may refer to certain symbolic names, also known as variables.

See also Functions that may be applied to variables.

Commonly-used variables

The following symbolic names are currently defined and commonly used by developers when packaging their Apps or Accessories for UBOS. They are listed alphabetically.

${apache2.gname}
Name of the Linux group used for running the Apache web server. This is convenient for setting ownership of files.

Example: http

${apache2.uname}
Name of the Linux user account used for running the Apache web server. This is convenient for setting ownership of files.

Example: http

${appconfig.accessoryids}
The identifiers of all Accessories at this AppConfiguration, separated by commas.

Example: wordpress-plugin-webmention,wordpress-theme-p2

${appconfig.apache2.appconfigfragmentfile}
The name of the Apache2 configuration fragment which may be written by this AppConfiguration.

Example: /etc/httpd/ubos/appconfigs/s753ca4a344f56c38aad05172dee6a53f6647af62/a9f52884fef255d617981fb0a94916bf67bcf64b5.conf

${appconfig.apache2.dir}
The directory in which Apache requires this AppConfiguration’s web server files. No trailing slash.

Example: /ubos/http/sites/s753ca4a344f56c38aad05172dee6a53f6647af62/blog (if the AppConfiguration is at relative path /blog on a Site with SiteId s753ca4a344f56c38aad05172dee6a53f6647af62)

${appconfig.appconfigparsdir}
The directory in which this AppConfiguration’s customization points are stored. This directory contains a subdirectory each for each installable at the AppConfiguration, which in turn contains the files for the customization points.

Example: /ubos/lib/ubos/appconfigpars/a9f52884fef255d617981fb0a94916bf67bcf64b5/

${appconfig.appid}
The identifier of the App at this AppConfiguration.

Example: wordpress

${appconfig.appconfigid}
The identifier of the AppConfiguration as specified in the Site JSON file.

Example: a9f52884fef255d617981fb0a94916bf67bcf64b5

${appconfig.cachedir}
Name of a directory in which this AppConfiguration should cache any data it needs to cache.

Example: /var/cache/a9f52884fef255d617981fb0a94916bf67bcf64b5

${appconfig.context}
Context path for this AppConfiguration as specified in the Site JSON file (or, if not given, the default from the UBOS Manifest). No trailing slash. The root context is a zero-length string.

Examples: /blog or (empty string)

${appconfig.contextnoslashorroot}
Context path for this AppConfiguration as specified in the Site JSON file (or, if not given, the default from the UBOS Manifest), but without either leading or trailing slash. The root context is represented as the string ROOT. This variable makes some Tomcat configuration statements easier.

Examples: blog or ROOT

${appconfig.contextorslash}
Context path for this AppConfiguration as specified in the Site JSON file (or, if not given, the default from the UBOS Manifest). No trailing slash. However, the root context is a single slash. This variable makes some Apache configuration statements easier that usually take a context path without trailing slash, but require a single slash when the context path would otherwise be empty.

Examples: /blog or /

${appconfig.cronjobfile}
If this AppConfiguration needs to define one or more cron jobs, this is the preferred filename it should use for this purpose.

Example: /etc/cron.d/50-a9f52884fef255d617981fb0a94916bf67bcf64b5

${appconfig.datadir}
A directory in which this AppConfiguration should preferably store data (outside of the webserver’s DocumentRoot). No trailing slash. While this variable is pre-defined, the App is responsible for actually creating the directory in its UBOS Manifest.

Example: /ubos/lib/wordpress/a9f52884fef255d617981fb0a94916bf67bcf64b5

${appconfig.mysql.dbhost.maindb}
Database host for the MySQL database whose symbolic name in the UBOS Manifest is maindb. Replace maindb with the symbolic name you used in the UBOS Manifest.

Example: localhost

${appconfig.mysql.dbname.maindb}
Actual name of the MySQL database whose symbolic name in the UBOS Manifest is maindb. Replace maindb with the symbolic name you used in the UBOS Manifest.

Example: database477

${appconfig.mysql.dbport.maindb}
Database port for the MySQL database whose symbolic name in the UBOS Manifest is maindb. Replace maindb with the symbolic name you used in the UBOS Manifest.

Example: 3306

${appconfig.mysql.dbuser.maindb}
Database user for the MySQL database whose symbolic name in the UBOS Manifest is maindb. Replace maindb with the symbolic name you used in the UBOS Manifest.

Example: fred

${appconfig.mysql.dbusercredential.maindb}
Database password for the MySQL database whose symbolic name in the UBOS Manifest is maindb. Replace maindb with the symbolic name you used in the UBOS Manifest.

Example: n0ts0s3cr3t

${appconfig.postgresql.dbhost.maindb}
Database host for the Postgresql database whose symbolic name in the UBOS Manifest is maindb. Replace maindb with the symbolic name you used in the UBOS Manifest.

Example: localhost

${appconfig.postgresql.dbname.maindb}
Actual name of the Postgresql database whose symbolic name in the UBOS Manifest is maindb. Replace maindb with the symbolic name you used in the UBOS Manifest.

Example: database477

${appconfig.postgresql.dbport.maindb}
Database port for the Postgresql database whose symbolic name in the UBOS Manifest is maindb. Replace maindb with the symbolic name you used in the UBOS Manifest.

Example: 3306

${appconfig.postgresql.dbuser.maindb}
Database user for the Postgresql database whose symbolic name in the UBOS Manifest is maindb. Replace maindb with the symbolic name you used in the UBOS Manifest.

Example: fred

${appconfig.postgresql.dbusercredential.maindb}
Database password for the Postgresql database whose symbolic name in the UBOS Manifest is maindb. Replace maindb with the symbolic name you used in the UBOS Manifest.

Example: n0ts0s3cr3t

${appconfig.tcpport.someport}
The port number allocated for the TCP port whose symbolic port name in the UBOS Manifest is someport. Replace someport with the symbolic name you used in the UBOS Manifest.

Example: 5432

${appconfig.tomcat8.contextfile}
The name of the Tomcat8 context configuration file which may be written by this AppConfiguration.

Example: /etc/tomcat8/Catalina/example.com/ROOT.xml

${appconfig.tomcat8.dir}
The directory in which Tomcat requires this AppConfiguration’s application server files. No trailing slash.

Example: /ubos/lib/tomcat8/sites/s753ca4a344f56c38aad05172dee6a53f6647af62/a9f52884fef255d617981fb0a94916bf67bcf64b5

${appconfig.udpport.someport}
The port number allocated for the UDP port whose symbolic port name in the UBOS Manifest is someport. Replace someport with the symbolic name you used in the UBOS Manifest.

Example: 5432

${host.cachedir}
Name of a directory in which to cache data on this device.

Example: /var/cache

${host.tmpdir}
Name of a directory in which to create temporary files. By using this symbolic name, the location of temporarily files can be moved to a partition that has sufficient space (say /ubos/tmp vs /tmp) without impacting Apps.

Example: /ubos/tmp

${hostname}
Name of the current host as returned by the OS. This is often different from ${site.hostname}, which is a virtual host name for a Site.

Example: host-1-2-3-4.example.org

${installable.accessoryinfo.appid}
Only exists for Accessories, not for Apps. The value of the accessoryinfo / appid provided in the Accessory’s UBOS Manifest to identify the App for which this is an Accessory.

Example: wordpress

${installable.accessoryinfo.accessoryid}
Only exists for Accessories, not for Apps. The value of the accessoryinfo / accessoryid provided in the Accessory’s UBOS Manifest to identify the name of the Accessory from the perspective of the App, which may or may not be the same as the package name of the Accessory in UBOS.

Example: p2

${installable.accessoryinfo.accessorytype}
Only exists for Accessories, not for Apps. The value of the accessoryinfo / accessorytype provided in the Accessory’s UBOS Manifest to identify the type of Accessory from the perspective of the App.

Example: theme

${installable.customizationpoints.foo.filename}
Name of a file that contains the value of customization point foo for the App or Accessory in this AppConfiguration, as determined from the UBOS Manifest file and the Site JSON file.

Example: /ubos/lib/ubos/appconfigpars/a12345678901234567890/mypackage/foo

${installable.customizationpoints.foo.value}
The value of customization point foo for the App or Accessory in this AppConfiguration, as determined from the UBOS Manifest file and the Site JSON file.

Example: My daily musings

${now.tstamp}
Timestamp when the current deployment or undeployment run started, in a human-readable, but consistently sortable string. Uses UTC time zone.

Example: 20140923-202018

${now.unixtime}
Timestamp when the current deployment or undeployment run started, in UNIX timestamp format.

Example: 1411503618

${package.codedir}
Directory in which the package’s code should be installed. No trailing slash.

Example: /ubos/share/wordpress

${package.name}
Name of the package currently being installed.

Example: wordpress

${site.admin.credential}
Password for the Site’s administrator account.

Example: s3cr3t

${site.admin.email}
E-mail address of the Site’s administrator.

Example: foo@bar.com

${site.admin.userid}
Identifier of the Site’s administrator account. This identifier does not contain spaces or special characters.

Example: admin

${site.admin.username}
Human-readable name of the Site’s administrator account.

Example: Site administrator (John Smith)

${site.apache2.authgroupfile}
The groups file for HTTP authentication for this Site.

Example: /etc/httpd/ubos/sites/s753ca4a344f56c38aad05172dee6a53f6647af62.groups

${site.apache2.htdigestauthuserfile}
The digest-based user file for HTTP authentication for this Site.

Example: /etc/httpd/ubos/sites/s753ca4a344f56c38aad05172dee6a53f6647af62.htdigest

${site.hostname}
The virtual hostname of the Site to which this AppConfiguration belongs. This is often different from ${hostname}, which is the current host as returned by the OS.

This variable will have value * for Sites whose hostname was given as the Wildcard hostname.

Example: ubosbox.example.org

${site.hostnameorlocalhost}
Same as ${site.hostname} except that in case of a wildcard site, the value will be localhost.
${site.hostnameorwildcard}
Same as ${site.hostname} except that in case of a wildcard site, the value will be __wildcard.
${site.hostnameorsystemhostname}
Same as ${site.hostname} except that in case of a wildcard site, the value will be the system hostname as returned by hostname.
${site.protocol}
The protocol by which this Site is accessed. Valid values are http and https.

Example: http

${site.protocolport}
The port that goes with the protocol by which this Site is accessed. Valid values are 80 and 443.

Example: 80

${site.siteid}
The Site identifier of this Site per the Site JSON file.

Example: s753ca4a344f56c38aad05172dee6a53f6647af62

${site.tomcat8.contextdir}
The Tomcat context directory for this Site. No trailing slash.

Example: /etc/tomcat8/Catalina/ubos.example.org

${tomcat8.gname}
Name of the Linux group used for running the Tomcat application server. This is convenient for setting ownership of files.

Example: tomcat8

${tomcat8.uname}
Name of the Linux user account used for running the Tomcat application server. This is convenient for setting ownership of files.

Example: tomcat8

Other variables

While these symbolic names are defined, their use by developers is not usually required and thus discouraged.

${apache2.appconfigfragmentdir}
Directory that contains Apache configuration file fragments, one per app configuration. You may want to use ${appconfig.apache2.appconfigfragmentfile} instead.

Example: /etc/httpd/ubos/appconfigs

${apache2.sitefragmentdir}
Directory that contains Apache configuration file fragments, one per Site (aka virtual host). You may want to use ${site.apache2.sitefragmentfile} instead.

Example: /etc/httpd/ubos/sites

${apache2.sitesdir}
Directory that contains the Apache DocumentRoots of the various Sites installed on the host. You may want to use ${site.apache2.sitedocumentdir} or ${appconfig.apache2.dir} instead.

Example: /ubos/http/sites

${apache2.ssldir}
Directory that contains SSL information.

Example: /etc/httpd/ubos/ssl

${package.datadir}
Directory in which the package can store data. No trailing slash. You may want to use ${appconfig.datadir} instead.

Example: /ubos/lib/wordpress

${package.manifestdir}
Directory in which packages write their manifests. No trailing slash. You should not need to use this.

Value: /ubos/lib/ubos/manifests

${site.apache2.sitedocumentdir}
The Apache DocumentRoot for this Site. No trailing slash.

Example: /ubos/http/sites/s753ca4a344f56c38aad05172dee6a53f6647af62

${site.apache2.sitefragmentfile}
The Apache configuration file fragment for this Site. No trailing slash. You should not have to use this.

Example: /etc/httpd/ubos/sites/s753ca4a344f56c38aad05172dee6a53f6647af62.conf

${site.tomcat8.sitedocumentdir}
The Tomcat DocumentRoot for this Site. No trailing slash.

Example: /ubos/lib/tomcat8/sites/s753ca4a344f56c38aad05172dee6a53f6647af62

${tomcat8.sitesdir}
Directory that contains the Tomcat DocumentRoots of the various Sites installed on the host. You may want to use ${site.tomcat8.sitedocumentdir} instead.

Example: /ubos/lib/tomcat8/sites