September 2024

The appeal of fitness-tracking smartwatches is that they have all the answers. They turn our squishy bodies’ inscrutable secrets into hard numbers we can plainly read and analyze. But we would be fooling ourselves if we believed that our smartwatches always tell the truth. According to a new scientific analysis, not only do wearables often get things wrong, it may not be possible to ever really know how accurate they are.

This isn’t going to be shocking news to longtime Lifehacker readers. We’ve discussed the fact that some smartwatch metrics are more reliable than others, and that calorie burn is one of the less accurate ones. On the other hand, heart rate variability shows different raw numbers from one device to another, but the major recovery-focused devices all manage to capture the same rough trend—if you trust my homebrew study with a sample size of one.

So what do we know about the accuracy of the smartwatches on the market, and why is it so hard to answer that question? That’s the problem that the recent analysis, from a group of sports scientists and data scientists in Ireland, set out to answer. It’s an umbrella review—a study of studies of studies—that aimed to collect all the relevant published data on consumer wearables. Here’s some of what they learned.

Studies are out of date as soon as they’re published

You would think somebody at Apple or Garmin or Fitbit would do extensive studies of their technology before releasing it to the public. And they probably do, internally, but their goal is launching and selling a product—not validating the accuracy of their product relative to others.

So the studies we have are generally done by scientists, and they begin after the wearables hit the market. It usually takes at least two years to conduct a study on a brand-new smartwatch and get it published. By then, that smartwatch isn’t so brand-new anymore.

This new analysis, published in July of 2024, used the most current meta-analyses available, which in turn used the most recent studies they had available. And which models of fitness watches did those include? I looked through the supplemental tables for the newest models of each major brand. They included:

Fitbit’s Charge 4 (the Charge 6 launched last year)
Apple Watch Series 6 (the most recent is Series 9, again launched last year alongside the Ultra 2)
Garmin’s Fenix 5 (the Fenix 8 just came out)
Garmin’s Forerunner 245 (still popular, to be fair, but the 255 and 265 have been launched since then; the 265 is a year and a half old already)
Oura’s generation 2 ring (it’s up to gen3 now)
Whoop 3.0 (the current model is 4.0)

So if you want to know how the Apple Watch Ultra 2 compares to the Charge 6, or the Forerunner 265, or Whoop 4.0, you’ll have to wait a few more years—and by that point, everything will have gone up another version number or two.

Accuracy studies aren’t done in consistent ways

The studies are also so varied that it’s hard to compare them to each other, even if you’re interested in learning about older models of devices. The umbrella review found that most of their studies underestimated heart rate and overestimated sleep time, for example, but the authors concluded that they can’t really say wearables in general overestimate and underestimate these things. The studies were too different from each other, each evaluating a handful of devices and rarely using the same gold-standard metrics to compare them against.

“This umbrella review reveals the intricate variability across devices, outcomes, user contexts and reference standards,” the authors wrote, “making a definitive assessment of wearables’ accuracy challenging.” In other words: we don’t have the data to answer the questions you ask when you go shopping for a new device.

Which metrics fared the best and worst?

Still, if we can take the results with some huge grains of salt, I think it’s still worth looking at what the umbrella review found. These are some commonalities, although we definitely can’t say they’re universally true:

Heart rate was usually correct to within +/- 3% of the true value. That’s not bad, but still, a window of 6% is kind of a lot when you may be trying to keep your heart rate within a 10-point zone.
Heart rate variability was “very good to excellent” when readings were taken at rest, but accuracy dropped when readings were taken in motion.
Energy expenditure (calorie burn) wasn’t great, which we already knew. Sometimes devices underestimated by 21%, sometimes they overestimated by 14%.
Step counts were also pretty variable, ranging from 9% less than the actual number, to 12% more.
Sleep duration was usually overestimated, and sleep latency (how long it takes you to fall asleep) was usually underestimated.

It’s more important to ask if something is useful than if it’s accurate

I honestly don’t judge wearables on whether they’re accurate, only on whether they’re useful. You may remember from my comparison of Whoop, Garmin, and Oura that each of the three devices reported different raw numbers for resting heart rate and heart rate variability, but they were all able to track the same trend, giving me arguably useful information about when my body was well-rested and well-recovered, versus when it wasn’t.

That eye toward usefulness is why I try to steer people away from paying attention to their calorie burn. If you truly want to know how many calories to eat to maintain your weight, you’re best off tracking how many calories you eat alongside tracking your weight. Similarly, instead of blindly following a watch’s estimate of whether you’re in zone 2 when you exercise, you can use other cues like your breathing and your internal monologue (“oh god when will this be over?”) to tell how hard you’re working.

Even though we can’t verify the accuracy of every tracker, I do know that accuracy is important to most people who go shopping for smartwatches and fitness trackers, so I’ll continue covering it, where appropriate. A GPS-enabled watch should show you the street you’re actually running on, and a heart rate sensor shouldn’t confuse your running cadence with your heart rate. But the most important questions to ask about a wearable are not whether its metrics are accurate, but whether they are useful even knowing that they may be inaccurate.

Tomorrow, Sept. 5, will be one of the few official Stuff Your Kindle Day events of the year. Stuff Your Kindle Day is an author-organized event that happens four times a year where people can download mainly romance and romance-adjacent books for free and to keep. The event first started in 2014 when author Zoe York wanted to promote her books as well as some other authors on her website, Romance Bookworms. The event has grown exponentially since then; today, you can choose from over 2,000 titles in different genres to read on a variety of e-readers (not just Kindle, as the name would suggest).

How to get free e-books on Stuff Your Kindle Day

The list of e-books that will be free during the event is already out, but they won’t be free until the event starts. Stuff Your Kindle Day only lasts 24 hours, so make sure to know what you want to get and how to get it.

First, go to the official website and select the “free books” tab. Then select the type of e-book retailer you use (if you don’t use one, you can click on any of them). Then, you’ll be presented with a long list of titles filtered by category. Each book will have the title, author, a brief synopsis, and hyperlinks to the retailer you selected previously.

Here are some of the categories available:

If you chose Amazon as your retailer, make sure you’re not being redirected to the phone application because you won’t see the free book option; instead, use the web browser Amazon page (or just do it on your computer). Also, make sure you’re not clicking the Kindle Unlimited ”read for free” button, as that will direct you to start a Kindle Unlimited subscription; instead, click the “buy now for free” button to send the book directly to the Kindle linked to your account.

You’ll know you did it right when you see a “Thanks, [your name]!” order summary saying the e-book is being auto-delivered to the Kindle Cloud Reader. Click the “Read now in Kindle Cloud Reader” button on the order summary to start reading your e-book.

Who can get free books on Stuff Your Kindle Day?

Anyone can get free books on Stuff Your Kindle Day. You don’t need an e-reader, to be an Amazon Prime member, or have any type of subscription. You can read them on your phone or laptop as well. However, if you’re looking for one of the best Kindles to take full advantage of this day, consider the Kindle Scribe for $339.99 on Amazon. If you’re looking for a cheaper alternative, consider the Kindle for $99.99 on Amazon. You can read about all your other Kindle options here.

Mets assistant GM Ian Levin leaving organization at end of season

Why Steph is motivated by doubt of Warriors’ title chances this season

Bill Belichick joins Instagram, and Tom Brady is among his first follows

Dodgers vs. Angels Best bets: Odds, predictions, recent stats, and trends for September 4

You’ll Never Know How Accurate Your Fitness Tracker Is, and That’s OK

Studies are out of date as soon as they’re published

Accuracy studies aren’t done in consistent ways

Which metrics fared the best and worst?

It’s more important to ask if something is useful than if it’s accurate

Thousands of E-books Are Free Tomorrow for ‘Stuff Your Kindle Day’

How to get free e-books on Stuff Your Kindle Day

Who can get free books on Stuff Your Kindle Day?

Grizzlies GG Jackson to be reevaluated in three months following foot surgery

Mets ace Kodai Senga throws off mound as he works toward potential return

Bryce Harper leaves Phillies-Blue Jays game after getting hit by pitch on elbow

Bryce Harper leaves Phillies-Blue Jays game after getting hit by pitch on elbow