The Shortcut

Share this post

CNET's AI writer can't do basic math

www.theshortcut.com

Discover more from The Shortcut

The Shortcut is the #1 consumer tech publication on Substack, designed to be your one-stop editorial guide to simplify your life. More than just PS5 restock information, we also cover news, reviews and provide best-in-class buying guides.
Over 134,000 subscribers
Continue reading
Sign in

CNET's AI writer can't do basic math

The AI engine used by CNET has made some pretty fundamental errors

Callum Bains
Jan 18, 2023
4
Share this post

CNET's AI writer can't do basic math

www.theshortcut.com
Share
The CNET logo
(Credit: CNET)

โžก๏ธ The Shortcut Skinny: AI errors

  • ๐Ÿ˜ CNET has made multiple corrections to an AI-generated article

  • โž• The financial explainer piece contained several basic mathematical errors

  • ๐Ÿ”Ž CNET said all AI-generated content had been fact-checked and reviewed

  • ๐ŸŽ“ But the AIโ€™s intelligence may have been overestimated

CNET has issued multiple corrections to an article that was written using AI assistance after the piece was found to contain five major inaccuracies about the very topic it was supposed to explain.

The article was produced as an explainer about compound interest but now includes a hefty addendum at the bottom outlining several errors that were made by the AI engine and passed undetected by human fact-checkers. The errors include:

  • Suggesting a savings account containing $10,000 with a 3% compound interest rate would accrue $10,300 in interest after one year. The real earned interest would amount to only $300

  • Making a similar error in a later example

  • Wrongly stating that one-year CD accounts only compound annually, when the rates they compound at varies

  • Mistakenly stating how much a person would have to pay on a car loan with an interest rate of 4% over five years

  • Confusing APR (the rate of interest someone is charged when borrowing money) with APY (the rate of interest someone will earn when saving money)

    The Shortcut is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.

CNET has been using AI to generate content for the last couple of months, initially publishing articles under the inconspicuous โ€œCNET Money Staffโ€ byline. The fact they were written using AI was largely hidden from view, and readers at first had to hover their cursor over an articleโ€™s byline to reveal a message that stated whether it had been produced using โ€œautomation technologyโ€.

The tech news site published 75 articles using AI before others caught on. Reactions from readers and writers were largely critical of the practice, prompting CNET editor-in-chief Connie Guglielmo to publish a statement arguing the team was trying โ€œto see if the tech can help our busy staff of reporters and editors with their job to cover topics from a 360-degree perspectiveโ€.

She added that every post was โ€œreviewed, fact-checked and edited by an editor with topical expertiseโ€ before going live, and every post now has an editorโ€™s name next to the generic CNET Money byline.ย 

But they apparently werenโ€™t checked rigorously enough. Not only did the inaccuracies in the AI-generated compound interest article slip through the cracks, but they were also only corrected after competing tech news outlet Futurism alerted CNET to the errors.

In a statement sent to VICE, CNET seemed to place the blame on the human fact-checkers handling the story, saying it is now โ€œactively reviewing all our AI-assisted pieces to make sure no further inaccuracies made it through the editing process, as humans make mistakes, too.โ€

Even the best writers and editors occasionally fall foul of factual errors, typos and grammatical errors, and human fact-checkers reading the work of AI engines should be no different. But CNETโ€™s bungle is a sharp reminder that even robots arenโ€™t infallible. AI-generated content might sound like the way of the future, but perhaps the future is a ways off yet.

4
Share this post

CNET's AI writer can't do basic math

www.theshortcut.com
Share
Comments
Top
New
Community

No posts

Ready for more?

ยฉ 2023 Matt Swider
Privacy โˆ™ Terms โˆ™ Collection notice
Start WritingGet the app
Substack is the home for great writing