Issues on postmarketOS Status

[Resolved] Infrastructure maintenance

Thu, 14 May 2026 18:00:00 +0000

Announcement - Due to infrastructure maintenance, various services on postmarketos.org (except for gitlab.postmarketos.org) will be unavailable for presumably up to 30 minutes.

Resolved - Two of our infrastructure containers have been successfully updated to Debian 13.

[Resolved] pmaports default branch migration

Sun, 15 Mar 2026 10:46:00 +0000

We are migrating the default pmaports branch. During this time, no binary packages will be built.

More information:

https://postmarketos.org/edge/2026/03/15/pmaports-default-branch-changed
postmarketos-devel IRC/matrix channel
https://docs.postmarketos.org/pmcr/main/0005-default-git-branch-rename.html
https://gitlab.postmarketos.org/postmarketOS/postmarketos/-/issues/122

[Resolved] GitLab is down

Fri, 16 Jan 2026 16:49:00 +0000

gitlab.postmarketos.org is currently down while our host (OSUOSL) performs a datacenter migration. ETA is currently unknown.

[Resolved] GitLab data loss

Thu, 04 Dec 2025 19:00:00 +0000

Due to some problem with the database at the host of our GitLab instance we experience some data loss of gitlab-related information: MRs, comments, and issues. Anything done in GitLab during that period of time might have been lost and have to be recreated. Repository information was not lost.

[Resolved] Connectivity issues to GitLab

Mon, 20 Oct 2025 12:39:00 +0000

We are detecting network connectivity issues from multiple places to gitlab.postmarketos.org, likely caused by intermediate network errors unrelated to our infrastructure. GitLab is managed by OSUOSL in their own hardware, and the service is otherwise up and healthy. We are seeking clarification on possible reasons for the outages.

[Resolved] GitLab is down

Fri, 18 Jul 2025 06:51:00 +0000

gitlab.postmarketos.org is currently down due to unknown reasons. We have contacted OSUOSL who are hosting our GitLab instance.

[Resolved] Scheduled downtime for GitLab instance

Mon, 19 May 2025 17:00:00 +0000

The postmarketOS GitLab instance has an upgrade scheduled for Monday, May 19 @ 17:00 UTC. At least 1 hour of downtime can be expected while this is taking place. Thanks for your patience and happy hacking!

[Resolved] MediaWiki upgrade to 1.43

Tue, 31 Dec 2024 17:20:00 +0000

We’re going to upgrade our Wiki from MediaWiki version 1.39 LTS to 1.43 LTS.

This is estimated to cause a downtime of approximately 30 minutes.

[Resolved] gitlab is down

Thu, 12 Dec 2024 06:22:00 +0000

Unfortunately gitlab.postmarketos.org is currently down. We have notified OSUOSL. It is the middle of the night for them currently, so it will probably take a bit until it comes back online. We are working hard with them to prevent such outages in the future.

UPDATE: an automatic update went wrong, it is up again.

[Resolved] GitLab reboot to increase RAM and CPU

Sun, 08 Dec 2024 17:30:00 +0000

OSUOSL is rebooting gitlab.postmarketos.org to increase RAM and CPU, this should help with making it more reliable.

[Resolved] GitLab doesn't trigger on git pushes

Fri, 06 Dec 2024 08:35:00 +0000

GitLab doesn’t trigger on git pushes currently, which means MRs do not get updated after pushing to a git repository. We have contacted OSUOSL about it.

[Resolved] binary packages not building

Tue, 03 Dec 2024 07:50:00 +0000

Our build manager https://build.postmarketos.org uses https://builds.sr.ht to run build jobs, which currently seems to have problems (jobs aren’t starting). We have reported the problem to the sr.ht IRC.

[Resolved] Our GitLab is down

Mon, 02 Dec 2024 10:00:00 +0000

GitLab is stuck in “Waiting for GitLab to boot”. OSUOSL maintains the instance for us (see blog post), and we have contacted them.

More information: https://gitlab.postmarketos.org/postmarketOS/postmarketos/-/issues/87

[Resolved] HTTP 502: Waiting for GitLab to boot

Thu, 28 Nov 2024 08:00:00 +0000

GitLab is stuck in “Waiting for GitLab to boot”. OSUOSL maintains the instance for us (see blog post), and we have contacted them. Unfortunately it is a public holiday in the US, so it looks like this won’t be resolved today.

UPDATE: OSUOSL resolved it and added additional monitoring, so this should not go unnoticed for so long in the future, if it happens again.

[Resolved] Migration to gitlab.postmarketos.org

Sat, 05 Oct 2024 22:00:00 +0000

(Find updates at the bottom)

On Sunday, 2024-10-06 00:00 CEST, we are migrating from gitlab.com to our self-hosted instance at gitlab.postmarketos.org. It is expected to take the whole day (a test import took 18 hours).

Projects (pmbootstrap, pmaports, etc.) will be read-only during the migration, meaning that you can’t create issues, merge requests or comment on these.
Accounts in gitlab.postmarketos.org will be approved after the migration is done.
Read postmarketos#77 for more information on the migration plan, why we migrate to a self-hosted gitlab instance in the first place and why to that instead of Forgejo, SourceHut, etc.

Update 18:15 CEST:

Transfer is still ongoing for pmaports.git, but has completed for all other repositories.
Mirroring of git repositories to gitlab.com has been set up here.

After the transfer of all repositories has completed, the next steps are as follows.

Set up permissions for Core Contributors, Trusted Contributors, Active Contributors (see team).
Unarchive all imported repositories at gitlab.postmarketos.org. (The repositories at gitlab.com will stay archived.)
Approval of accounts, so https://gitlab.postmarketos.org can be used. It will probably take a few more hours until we reach this point, please be patient.
Various clean up tasks (e.g. recreating epics as milestones, ensuring/fixing push hooks to various sites like postmarketos.org, adjust all repos where we have gitlab.com/postmarketos hardcoded)

Update 23:00 CEST:

Repositories are transferred. The transfer ran into a timeout for 125 merge requests in pmaports.git, those were not transferred. For all old merge requests, we just recommend looking at the archived ones at gitlab.com (we won’t delete them). These also have the proper users associated to comments, which was not possible with the import.
It seems that all issues were imported successfully.
All imported merge requests have been closed (as they are now owned by the “Administrator” user who was used during import). If you had an open merge request that is still relevant, please re-submit it at gitlab.postmarketos.org. We realize that this is inconvenient, but it was not possible to do this differently as users from gitlab.com could not be mapped to users on gitlab.postmarketos.org (even if they already existed and were approved at time of transfer).
Accounts are being approved now. If you just registered, give us some time to review new account requests. We should be able to do it within a day usually.
If you run into any issues, please write in the postmarketos-devel IRC/matrix channel.
Some of the mentioned clean up tasks still need to be done, this will be tracked in postmarketos#77 (now on gitlab.postmarketos.org).

[Resolved] sr.ht outage

Wed, 10 Jan 2024 08:50:00 +0000

Announcement - There is currently a network outage at sr.ht: https://status.sr.ht/issues/2024-01-10-network-outage/

Therefore we currently cannot build new packages for the binary repository, build new images or accept new pmbootstrap patches.

pmbootstrap can be used to build your own packages or images in the meantime: https://wiki.postmarketos.org/wiki/Pmbootstrap

[Resolved] build.postmarketos.org migration

Tue, 09 Jan 2024 18:50:00 +0000

Announcement - Due to migration of the BPO service to a new server, build.postmarketos.org, mirror.postmarketos.org, images.postmarketos.org and pkgs.postmarketos.org won’t be available intermittently.

[Resolved] Mail server is disrupted

Wed, 29 Nov 2023 21:00:00 +0000

Announcement - Due to unexpected complications when moving the Hetzner server to a different account, outgoing emails currently appear to be blocked on the network level. We’re trying to resolve this as soon as possible.

Registration mails from the wiki will currently not arrive.

[Resolved] Mail server maintenance

Wed, 11 Oct 2023 09:50:00 +0000

Announcement - E-Mail server is down for maintenance, registration mails from the wiki will currently not arrive.

[Resolved] Wiki upgrade

Mon, 09 Oct 2023 19:50:00 +0000

Announcement - Due to scheduled maintenance the wiki might not be available while we upgrade the Alpine host to a newer version.

Resolved - The host for Mediawiki has been upgraded to the latest versions, including php and mariadb.

[Resolved] Wiki upgrade

Sun, 08 Oct 2023 12:30:00 +0000

Announcement - Due to scheduled maintenance the wiki might not be available while we upgrade both Mediawiki and the underlying operating system to a newer version.

Resolved - Mediawiki has been successfully updated to the latest LTS version, v1.39.5.

[Resolved] Mirror subdomain gets IPv6 connectivity

Wed, 04 Oct 2023 18:00:00 +0000

Previously our DNS config had an ‘A’ entry for mirror.postmarketos.org. This has now been converted to a ‘CNAME’ which as a side effect means that mirror.postmarketos.org is now resolvable from IPv6. Everything should work the same as over IPv4 (http(s), rsync), but if you experience any issues please let us know!

[Resolved] Mirror and build system migration

Thu, 15 Jun 2023 18:10:00 +0000

The last major component of the postmarketOS infrastructure is being moved to a new host. This runs mirror.postmarketos.org, build.postmarketos.org and pkgs.postmarketos.org. Some downtime is expected during this migration.

[Resolved] DNS migration

Tue, 02 May 2023 23:00:00 +0000

Resolved - The DNS record is fixed, it will take up to 12 hours for the change to update on all DNS providers.

The DNS zone for postmarketos.org is migrate to a new host. The CNAME record for cast.postmarketos.org is pointing to the wrong server.

[Resolved] IPv6 connectivity added

Tue, 06 Jul 2021 11:39:00 +0000

IPv6 connectivity has been enabled on all the postmarketOS services now. This might cause outages if your traffic is suddenly routed over other protocols or one of the services isn’t listening on IPv6

[Resolved] Mediawiki migration and upgrade

Fri, 07 Aug 2020 14:43:00 +0000

Monitoring - Looks like the wiki is fully working, even the mobile view. (16:31 UTC — Aug 7)

Disrupted - Base wiki is up again, now resolving issues with outdated extensions. (16:09 UTC — Aug 7)

The wiki is being migrated to another server and has to be upgraded to the latest release to be able to run on PHP 7.3, due to it being mediawiki this upgrade will take a long while.

[Resolved] Domain registrar move

Mon, 08 Jun 2020 19:35:00 +0000

Resolved - nameserver move is done, everything seems up again.

The domain name postmarketos.org is being moved between registrars and this is causing some issues with nameservers. The issues should resolve itself in an hour.

[Resolved] Server maintenance downtime for disk upgrade

Fri, 19 Apr 2019 12:30:00 +0000

Resolved - Server upgrade was successful

vps4.bramix.nl will be put in maintenance mode for a few minutes for upgrading the disk. During this time the major downtime will be that the wiki will be down and the build server won’t be processing hooks.

[Resolved] IPv6 certificate issue on postmarketos.org

Thu, 22 Nov 2018 00:00:00 +0000

Resolved - It turns out to be an caching issue with the SSL certificates in the backend, causing hosting 4 to have an older certificate than hosting 5. Currently the IPv4 traffic is routed through an DigitalOcean floating IP which sends traffic to hosting 5 and redirecting to hosting 4 when there’s an issue. Since DigitalOcean doesn’t have a floating IP feature for IPv6 and hosting 5 currently isn’t in an IPv6 region those requests are allways served by hosting 4. The certificate on hosting 4 was up to date but HAProxy wasn’t reloaded when the certificates were refreshed causing it to serve pages on IPv6 with an old certificate.

Investigating - Reports are coming in that for some users the certificate has expired and for some users everything works fine.