Consumer Reports Just Slammed Microsoft’s Surface Laptops, but Maybe they Shouldn’t

2 minute read
| Editorial

Consumer Reports dropped its recommended buy rating for Microsoft’s Surface laptops saying 25% have problems within two years of purchase. But instead of putting on my schadenfreude pants and dancing to my Microsoft-toting friends misfortune, I’m questioning Consumer Reports’ reliability.

Microsoft Surface laptop loses Consumer Reports recommend rating

Consumer Reports pulls Microsoft Surface laptop recommend rating

Consumer Reports is an independent organization that reviews washing machines, cars, toasters, computers, and many other products then makes buying recommendations. They said this is the first year enough data was available to rate reliability since Microsoft is a newcomer to the laptop and tablet market.

CR said in a statement, “New studies conducted by the Consumer Reports National Research Center estimate that 25 percent of Microsoft laptops and tablets will present their owners with problems by the end of the second year of ownership.”

The products that lost their recommended status are the Microsoft Surface Laptop (128GB and 256GB versions) and Microsoft Surface Book (128GB and 512GB versions).

The Apple to Surface Comparison

This is the part where Microsoft fans cry foul and Apple fans get smug and say, “You should’ve bought a Mac.” Except maybe we shouldn’t.

CR slammed the Touch Bar MacBook Pro after its release saying battery life was wildly inconsistent and in some cases lasted only a couple hours. Apple fans were up in arms, Microsoft fans gloated, and in the end CR’s testing proved to be problematic.

Instead of testing the laptop’s battery life in more realistic conditions, CR used the developer mode in the Safari web browser to change settings in a way that most users wouldn’t ever do. That triggered an esoteric bug causing erratic battery use, and ultimately CR’s poor rating.

Apple fixed the bug—something most users would never encounter—and CR used a different method for testing battery life. This time CR said the Touch Bar MacBook Pro’s battery consistently performed as expected. Getting to that point, however, required Apple’s help.

Which brings us back to CR pulling its recommended buy rating for the Microsoft Surface laptops. CR said,

A number of survey respondents said they experienced problems with their devices during startup. A few commented that their machines froze or shut down unexpectedly, and several others told CR that the touch screens weren’t responsive enough.

Consumer Reports Methodology

If I’m already questioning CR’s methodology for testing laptops and refused to take its original Touch Bar MacBook Pro rating at face value, it’s only reasonable I do the same for the change in the Surface laptop ratings.

Microsoft isn’t buying into CR’s findings, either. The company responded to the rating change saying, “Microsoft’s real-world return and support rates for past models differ significantly from Consumer Reports’ breakage predictability.”

It’s possible Microsoft is seeing a 25% failure rate on its laptops, just like it’s possible Apple uses batteries that fluctuate inconsistently between 3 and 19 hours of use time. Still, if I’m going to question CR’s methodology when testing something I like I better do the same for other products, too.

I think I’ll leave my schadenfreude pants in the closet for now.

9
Leave a Reply

Please Login to comment
9 Comment threads
0 Thread replies
0 Followers
 
Most reacted comment
Hottest comment thread
9 Comment authors
John KheitjimblockChipMcKskipaqboltar Recent comment authors

This site uses Akismet to reduce spam. Learn how your comment data is processed.

  Subscribe  
newest oldest most voted
Notify of
John Kheit
Member
John Kheit

Super article Jeff. It’s time this piece of crap rag died the death of irrelevance it so deserves. Heck, if mac and windows folks can come together on this, maybe our union still has a chance

jimblock
Member
jimblock

As boltar and ChipMcK said above, Consumer Reports long-term reliability testing is NOT done in house, but is based on their annual survey which is sent to all CR subscribers. So it has nothing to do with CR’s in-house testing results, (which I also often disagree with). The real issues (if any) are whether CR subscribers who respond to their survey are typical users of the products, and whether the consumer’s perceived problems are real problems or not. Filling out a CR survey is time consuming, and many will skip it. Those who have had real or perceived problems are… Read more »

ChipMcK
Member
ChipMcK

The nay-sayers missed that 25% of the responders REPORTED problems.
CR is just the messenger of the news, bad or good.

skipaq
Member
skipaq

Jeff, this is a very fair and balanced review of CR’s findings. I would hope they ran their findings by Microsoft before going public. It has been more than twenty years since I trusted or read anything that CR published.

boltar
Member
boltar

There is a difference between initial quality/performance assessment and long-term reliability. If you’ve ever looked at Consumer appliance reviews, you know that they use and test new devices for the initial review and collect longer-term info from their subscribers who purchase for long-term reliability info. The long term info is harder to come by and frequently can’t be sorted out to specific model numbers. But there are very few sources for long-term reliability info. CR’s numbers may have some systematic bias — someone could make an argument that their source population is old and not tech-savvy, perhaps — but they… Read more »

wab95
Member
wab95

Consumer Reports is an independent organization that reviews washing machines, cars, toasters, computers, and many other products then makes buying recommendations.

But not toaster fridges? Perhaps CR are just out of their depth here.

Jest aside, this is the kind of balanced analysis and perspective one comes to expect here at TMO, an asset that should never be taken for granted, and a key reason I continue to enjoy this site.

Member
Rick Allen

The whole thing is just another click-bait headline. CR has lost all relevance in the Laptop testing that they do. I have not seen any other organization or written material that has led me to believe that Surface products are failure prone. Its clearly a shameless attention grab in the hopes that someone might still think they have anything to say

Jamie
Member
Jamie

Their recommendations have definitely been spurious for awhile, now. Though to be fair, Windows laptops require about a kajillion times more attention and maintenance to get there than Apple’s products, I have seen a great many last for a very long time. I don’t see why the Surface line should be any different.

Bryan Chaffin
Editor
Bryan Chaffin

Yep.