Metrics Data Delayed

Incident Report for mux

Resolved

We have resolved the remaining issue with exports, and everything is operating as expected.
Posted Jan 17, 2020 - 00:30 UTC

Update

We continue to work on restoring the export process to full functionality following the issue, which is taking longer than we anticipated. At this time, we expect the exports for Jan 15th to also be delayed, and are working on resolving this as urgently as possible. We will provide another update once the exports have been completed.

All other functionality with Mux Data remains operational.
Posted Jan 16, 2020 - 02:04 UTC

Update

We continue to work on restoring the export process to full functionality following the issue. At this time, we expect the exports for Jan 14th to also be delayed, and are working on resolving this as urgently as possible. We will provide another update once the exports have been completed.

All other functionality with Mux Data remains operational.
Posted Jan 15, 2020 - 00:29 UTC

Update

We are continuing to work on restoring the primary system to full functionality. In the meantime, all functionality should continue to work on the backup as expected, aside from one issue. Data Exports for Jan 13th will be delayed, but will be backfilled when possible.
Posted Jan 14, 2020 - 01:39 UTC

Monitoring

We've switched to a backup system to restore service and are monitoring the temporary solution. We expect no downtime switching back to the primary system.
Posted Jan 13, 2020 - 21:29 UTC

Update

In order to repair the system, we need to temporarily take Mux Data metrics offline.
Posted Jan 13, 2020 - 21:19 UTC

Identified

We've identified an issue that is causing Mux Data metrics to be delayed. Realtime data as well as data before 20:15 UTC is unaffected.
Posted Jan 13, 2020 - 21:04 UTC
This incident affected: Mux Dashboard.