Our users are failing on a third-party API and the vendor's status page is entirely green — how do you establish it is them?
About a fifth of our requests to a payment provider have been failing since this morning with timeouts and the occasional 502. The rest go through normally.
Their status page says all systems operational and has done all day. Support have replied once to say they are not seeing any issues.
On our side nothing was deployed, our other integrations are fine, and the failures are spread across our servers rather than coming from one machine.
I am fairly confident it is them, but "I am fairly confident" is not something support will act on and I have already been told they see nothing. What evidence actually moves this, and how do I tell the difference between their problem and something in the path between us?
@partial_outage_pia · 3h ago
Start from the fact that a green status page and a real outage are entirely compatible, and understanding why tells you what to measure.
Status pages are typically updated by a human after an incident is declared, against thresholds set by the vendor. Most real-world degradations never cross those thresholds because they are partial: one region, one data centre, one endpoint, one customer tier, or a percentage of requests. A fifth of your requests failing is a textbook partial, and a vendor whose global error rate moved by a fraction of a percent will show green and mean it.
Which also explains "we are not seeing any issues" — they are probably looking at an aggregate, and you are a rounding error in it.
So the shape of the evidence you need is specific enough to look up, not statistical. What actually gets acted on:
One ticket with ten request ids beats twenty messages describing a percentage.
Reply
Report