Resolved -
This incident has been resolved.
Jun 17, 13:28 PDT
Monitoring -
Looks like GitHub API requests are working again!
Jun 17, 13:10 PDT
Identified -
We're seeing an increased number of "No server is currently available to service your request." errors when calling GitHub API. This influences e.g. processing of webhook events (push, pull request) and setting commit statuses.
Resolved -
We have finished cleanup work for the CI/CD Workflows workers. This was maintenance work and workflow runs were running successfully in the meantime. We are marking this incident as resolved.
Jun 12, 14:57 PDT
Update -
We have confirmed CI/CD Workflows are running as well. We believe all services are up and see builds, submissions, and workflows running successfully. However, we're continuing to monitor service health for any aftereffects from the large outage.
Jun 12, 14:14 PDT
Monitoring -
We have verified builds, submissions, updates, and hosting are working as expected. We are testing CI/CD workflows before confirming them as operational. Thank you for your patience.
Jun 12, 13:52 PDT
Update -
We're monitoring the GCP and Cloudflare outages. Several underlying parts of our services are coming back online and parts of our website are up again. However, loading build pages, viewing hosting metrics and update assets, and delivering push notifications are still offline.
Resolved -
This incident has been resolved.
Jun 11, 04:21 PDT
Monitoring -
A fix has been implemented and we are monitoring the results.
Jun 11, 04:01 PDT
Identified -
We are seeing failures when installing Pods. It is caused by underlying failure to download prebuilt Hermes library, in which case Pods try to set up building Hermes from source which may fail.
Jun 11, 03:48 PDT
Resolved -
This incident has been resolved.
Jun 11, 03:09 PDT
Monitoring -
A fix has been implemented and we are monitoring the results.
Jun 11, 02:34 PDT
Identified -
We are seeing failures when installing Pods. It is caused by underlying failure to download prebuilt Hermes library, in which case Pods try to set up building Hermes from source which may fail.
Jun 11, 00:47 PDT