Here’s Why That BankMyCell iPhone Survey is Flawed

Under a minute read
| Link

An iPhone Survey from BankMyCell has bounced around the Apple blogosphere. It claims that iPhone retention is down 15.2% this year compared to last year. But The Macalope tells us why it’s flawed.

You can’t compare results for different demographies and declare them meaningful. You’re not controlling for anything…The only constant here is the gullibility (or culpability) of the technology press.

If BankMyCell were interested in meaningful results, it would have compared its own results over two years if it couldn’t get CIRP’s demographic breakdown. But it’s clearly not…If the methodology is crap, then you can’t trust the numbers.

That last line is the lesson we can learn from this: If the methodology is flawed, so are the results. You can’t p-hack your way around this one.

Check It Out: Here’s Why That BankMyCell iPhone Survey is Flawed

Here’s Why That BankMyCell iPhone Survey is Flawed

2 Comments Add a comment

  1. wab95

    Hello Andrew:

    Yet another example of bad science (statistical analysis, despite Mark Twain’s assessment https://en.wikipedia.org/wiki/Lies,_damned_lies,_and_statistics, is a science) going nowhere fast or slow.

    Put in terms of pop culture (or classic literature, take your pick), if BankMyCell was Dr Frankenstein, their analysis, far from being an electricity-reanimated monster terrorising the quiet side, would simply be a refried corpse…awaiting reburial.

  2. Lee Dronick

    “The only constant here is the gullibility (or culpability) of the technology press.”

    Also known as the click-bait press.

Add a Comment

Log in to comment (TMO, Twitter, Facebook) or Register for a TMO Account