“The first problem is can I actually trust this data... the second order problem is okay even if you're able to find a reliable source of Benchmark data often times it's too generic... the third order problem is okay even if your benchmarks are accurate and specific enough to be actionable they're only a jumping off point.”

Three problems with bad benchmarks: accuracy, specificity, and actionability — in that order

Carter sequences the three ways benchmarks fail: they're inaccurate (most publicly-available numbers), they're too generic (global averages across all categories), or they're accurate and specific but still just a starting point that can't prescribe actions. The Subscription Value Loop calculator attempts to solve problems one and two by using 30,000+ apps and category/tier filters — but problem three always requires founder judgment.