resolved Jul 20, 4:57 PM
We have fully burned the backlog of EU error events ingested during the incident. Latency is normal across all event types.
monitoring Jul 20, 4:09 PM
We are still burning the backlog of EU region error events received during the incident. We are around halfway through the backlog.
monitoring Jul 20, 2:50 PM
The backlog on attachments in our EU region is fully burned, and latency is back to normal. While new error events are being processed with normal latency, we have a backlog of old error events that we are now burning through.
monitoring Jul 20, 2:30 PM
We have implemented a fix for our attachment ingestion issue in our EU region, and are monitoring while the backlog burns. We will update here when latency is back to normal.
identified Jul 20, 1:47 PM
We have implemented a fix for errors and feedback ingestion in our EU region, and latency for those pipelines has returned to normal. We are still working on fixing our attachments ingestion pipeline in EU.
identified Jul 20, 1:19 PM
We have identified the issue causing errors, attachments, and feedback events to have high ingest latency in our EU region and are continuing to work on a fix.
identified Jul 20, 12:24 PM
We have identified the issue causing errors, attachments, and feedback events to have high ingest latency in our EU region and are continuing to work on a fix.
identified Jul 20, 12:10 PM
We have identified the issue causing errors, attachments, and feedback events to have high ingest latency in our EU region and are continuing to work on a fix.
identified Jul 20, 11:41 AM
We have identified the issue causing errors, attachments, and feedback events to have high ingest latency in our EU region and are working on a fix.
investigating Jul 20, 11:11 AM
we are investigating an issue affecting errors ingestion in the DE/EU region
investigating Jul 20, 11:11 AM
we are investigating an issue affecting errors ingestion in the DE/EU region