Update - The Kafka cluster is still operational, but is not back to full capacity and resiliency. Work will continue tomorrow to ensure sufficient capacity, as well as during business hours to resume full Activity Log functionality. We will provide more updates tomorrow and as-needed if there are any changes to availability.
Dec 06, 2025 - 18:18 PST
Dec 06, 2025 - 18:18 PST
Update - We have gotten the Kafka cluster to a stable-enough state, however it will still require remediation before the Activity Log is fully functional and it is back to a level of service sustainable until business hours. We will provide another update in 2 hours or as the situation changes.
Dec 06, 2025 - 16:10 PST
Dec 06, 2025 - 16:10 PST
Update - Ingest has been fully re-enabled, and SLOs and Triggers are now up-to-date.
Dec 06, 2025 - 14:08 PST
Dec 06, 2025 - 14:08 PST
Identified - We have resumed ingest to api.eu1.honeycomb.io as we were able to restore partial service to the Kafka cluster.
Dec 06, 2025 - 13:51 PST
Dec 06, 2025 - 13:51 PST
Update - We are continuing to investigate issues with the Kafka cluster. We will continue providing updates every 2 hours unless there are significant changes.
Dec 06, 2025 - 13:23 PST
Dec 06, 2025 - 13:23 PST
Update - We are continuing to investigate issues with the Kafka cluster.
Dec 06, 2025 - 11:20 PST
Dec 06, 2025 - 11:20 PST
Update - External API access is restored, event ingestion is still impacted
Dec 06, 2025 - 08:15 PST
Dec 06, 2025 - 08:15 PST
Update - We have temporarily disabled event ingestion for the EU Region, in service of restoring full functionality to our EU Kafka fleet. External API access will also be disabled. Additionally, during the ongoing outage, our Service Level Objectives feature has been impacted and down since 12:30 PM Pacific time on Friday, December 5th. SLO data will not be correct until our systems catch up and we rebuild the cache
Dec 06, 2025 - 07:19 PST
Dec 06, 2025 - 07:19 PST
Update - Automated systems are still working to catch up and Activity Log will remain offline until that that completes. We will post another update Saturday whether or not the Activity Log outage has been remediated.
Dec 05, 2025 - 23:30 PST
Dec 05, 2025 - 23:30 PST
Update - Ingest, querying, SLOs, and Trigger alerting is back to normal. Activity Log is still impacted, we have identified the cause and are working to resolve. We are still evaluating the scope of the outage for ingest and expect to have a full answer for that posted during US business hours on Monday.
We will post at least one more update this evening.
Dec 05, 2025 - 16:04 PST
We will post at least one more update this evening.
Dec 05, 2025 - 16:04 PST
Update - We are continuing the investigation after business hours to stabilize ingest and determine what work will be needed to fully recover. Known impact will be updated here as the situation changes. We will post at least one more update this evening.
Dec 05, 2025 - 15:46 PST
Dec 05, 2025 - 15:46 PST
Update - We have identified that 0.23% of datasets are fully affected, and a larger percentage are seeing intermittent ingestion and query failures (500s at the API level). We are also investigating a replication error in our ingestion pipeline.
Dec 05, 2025 - 14:33 PST
Dec 05, 2025 - 14:33 PST
Update - A subset of customer environments may see higher than usual error rates when sending events to api.eu1.honeycomb.io, and notifications for SLOs and Triggers may be delayed for that subset. We are continuing to investigate the issue.
Dec 05, 2025 - 13:19 PST
Dec 05, 2025 - 13:19 PST
Investigating - We are currently investigating this issue.
Dec 05, 2025 - 12:49 PST
Dec 05, 2025 - 12:49 PST
api.honeycomb.io - US1 Event Ingest
Operational
ui.honeycomb.io - US1 Querying
Operational
ui.honeycomb.io - US1 App Interface
Operational
ui.honeycomb.io - US1 Trigger & SLO Alerting
Operational
ui.honeycomb.io - US1 Activity Log
Operational
api.eu1.honeycomb.io - EU1 Event Ingest
Operational
ui.eu1.honeycomb.io - EU1 App Interface
Operational
ui.eu1.honeycomb.io - EU1 Querying
Operational
ui.eu1.honeycomb.io - EU1 Trigger & SLO Alerting
Operational
ui.eu1.honeycomb.io - EU1 Activity Log
Major Outage
www.honeycomb.io
Operational
Sandbox
Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.