How FactorPrism® analyzed 50+ million public 311 records to explain what drove the change in New York City's service requests—pinpointing the specific categories and time periods behind the trend, not just the headline number.
New York City's 311 service handles millions of non-emergency calls annually, from noise complaints to pothole reports. With over 50 million records spanning multiple years, the NYC Open Data initiative published this vast dataset for the community to analyze.
Manually working through a dataset this large — testing one category and time slice at a time — is slow and easy to lose subtle, offsetting movements in. Even then, cross-dimension intersections — where two provided categories combine — are easy to miss when you test one slice at a time. We decided to demonstrate how FactorPrism® could explain what drove this change — automatically locating the specific categories and periods behind it.
Using FactorPrism®'s advanced algorithms, we analyzed the period from September 2013 to March 2017—a timeframe showing clear growth trends. Our goal was to understand whether this growth was broad-based across all service types or concentrated in specific categories — and to locate exactly where.
While 311 usage grew 11% overall during the period, this headline number obscured crucial patterns:
FactorPrism® isolated a dramatic spike in pothole complaints in 2014 that was distinct from general street condition issues:
Pothole complaints rose sharply between the baseline and 2014—a localized surge at the pothole complaint type, distinct from the broader street-condition category it rolls up into, that aggregate street-complaint totals would have masked. This type of granular insight allows city planners to understand specific infrastructure failures rather than general trends.
Water system complaints showed clear seasonal movement over time — humps and give-backs the attribution captured rather than averaging away:
What makes these findings remarkable isn't just their value—it's how they were attributed.
FactorPrism®'s algorithms excel at this type of analysis because they separate overlapping effects (the 25% decline in housing complaints was invisible in aggregate data), isolate localized causes (the 2014 pothole surge was distinct from general street trends), and capture movement over time — humps, waves, and give-backs — so an unusually mild winter 2016 shows up as a distinct movement rather than being averaged away.
If FactorPrism® can pinpoint exactly what drove the change across NYC's 50-million-record dataset, it can do the same for the metric that matters in your data:
Separate broad-based category and seasonal movements from product-specific causes — across the product, region, and channel dimensions in your data
Identify which customer segments are actually churning while overall growth looks healthy
Pinpoint exactly which categories and periods drove a change in your operational metrics — so you know where to fix a problem or replicate an improvement
Don't let critical insights stay buried in your data. FactorPrism® pinpoints the specific categories and periods behind a change in a single analysis run.
Get it on Snowflake Marketplace