Site Timeouts

We've now resolved the incident. Thank you for your patience.

Technical analysis: Today's degraded performance (including timeouts for many requests) was caused by a customized report being executed many times simultaneously via our API. At its peak, our servers were attempting to process 70 simultaneous executions of this unbounded report, which resulted in over one hundred million records being processed simultaneously. This exhausted the resources across all web servers in our load-balanced farms, resulting in other requests running slowly or timing out entirely. We will be prioritizing both operational and code-level safeguards to prevent individual reports from impacting our product performance to this degree.

We are currently recovering from a partial outage.