iOS push notification delivery is fully recovered.
Assessing our internal metrics, it appears that a large fraction of iOS push notifications were failing between this evening. If you regularly deliver iOS push notifications we recommend checking your logs and database records for failed deliveries from the last couple of hours.
We'll be creating more aggressive alerts to monitor these delivery rates so we can be notified earlier about future issues.
Posted Apr 10, 2018 - 20:25 PDT
Monitoring
For the past several minutes, error rates of iOS push notification delivery has been 0%.
We're continuing to monitor delivery performance.
Posted Apr 10, 2018 - 20:10 PDT
Investigating
Error rates for notification delivery have become elevated gain, we're investigating.
Posted Apr 10, 2018 - 20:00 PDT
Update
We've restarted the services which were failing, and it appears that push notifications are successfully delivering. We'll continue to monitor the queue while it recovers.
Posted Apr 10, 2018 - 19:59 PDT
Monitoring
We've restarted the services which were failing, and it appears that push notifications are successfully delivering. We'll continue to monitor the queue while it recovers.
Posted Apr 10, 2018 - 19:58 PDT
Identified
Approximately 30% of iOS push notifications are currently failing. We believe we've identified the cause and are currently taking steps to resolve the problem.