analytics says 41% activation, my own sql says 26% — which one is lying
Same definition on both sides, or so I thought: signed up and completed the first import within seven days. The product analytics tool says 41%, a query against my own database says 26%.
That is not a rounding difference, it is the difference between a product that works and one that does not. I have spent two evenings on it and found nothing conclusive, and I am now suspicious of every number in the dashboard.
Where does this gap usually come from?
@starschema_sy · 4h ago
Third possibility that nobody has said yet: the seven day window. Your SQL probably applies it strictly from signup timestamp. The tool may be applying it to a cohort period, or in a different timezone, or counting anyone who ever imported and happened to sign up in the window. Timezone alone will move a seven day funnel by a few points.
Read the tool's definition of the funnel step order too. Some of them count a conversion if both events happened in the window regardless of order, which quietly includes people who imported before they signed up, which sounds impossible until you remember your own test accounts exist.
Reply
Report