AI Is Expensive. A Search On Google's Chatbot Bard Costs The Company 10 Times More Than A Regular One, Which Could Amount To Several Billion Dollars.
- Alphabet chairman John Hennessy said an AI chatbot search costs 10 times more than a regular one, per Reuters.
- Analysts expect Google to incur billions in extra AI costs over the next several years.
- That's because a chatbot query requires more computing power and electricity than a typical search.
Something is loading.
Thanks for signing up!
Access your favorite topics in a personalized feed while you're on the go. Download the app
Talking to Google's chatbot Bard may cost the company more than just a faulty reveal.
John Hennessy, the chairman of Google's parent company Alphabet, said that a search on AI, like its chatbot Bard, can cost the company 10 times more than a normal keyword search, according to an interview with Reuters. That's because a search through an AI-language model requires more computing power — specifically chips — and electricity than a typical search.
Analysts say the extra costs can amount to billions of dollars over the span of years, Reuters reported.
The projected costs of AI search varies. Some analysts say Google would incur an extra $6 billion dollars by 2024 if it responded to half of its search queries with 50-word answers from an AI chatbot, per Reuters. Other analysts expect Google to rack up an additional $3 billion dollars by integrating the chatbot into its search engine, Reuters reported.
Google did not respond to Insider's immediate request for comment before publication.
These potential expenses would come head-to-head with Google's plans to reduce costs amid challenging economic conditions.
Just weeks after Google laid off 12,000 employees earlier this year, Alphabet's CFO Ruth Porat said in the firm's latest earnings call that the company will spend $500 million to reduce office space and up to $2.3 billion in severance packages. Lavish office perks will also be eliminated.
To reduce its AI-related costs, Google said it will run its chatbot with a "smaller version" of its LaMDA AI model, per Reuters. Inference costs — the expenses associated with how a chatbot generates responses — must also drop, Hennessy said, calling it "a couple year problem at worst"
Still, it's not clear how companies intend to lower AI's costs without losing accuracy, Naveen Rao, a former exec at Intel who oversaw its AI products division, told Reuters.
"How you cull (parameters away) most effectively, that's still an open question," Rao said.
State Police Search For Hit-and-run Driver After Man Killed Walking On I-95 In Needham
State Police search for hit-and-run driver after man killed walking on I-95 in Needham
State Police search for hit-and-run driver after man killed walking on I-95 in Needham 00:21
NEEDHAM - Massachusetts State Police are looking for a hit-and-run driver who killed a man on Interstate 95 early Friday morning.
Troopers got a call about a person walking in the breakdown lane of 95 south in Needham near exit 33 shortly after 1 a.M.
State Police said when a trooper arrived in the area, the man had been hit and the vehicle involved was gone. He died at the scene. He was later identified as 28-year-old Justin Kelley of Canton.
"Troopers located potential debris evidence at the scene that may have come from the vehicle that struck the man," State Police spokesman Dave Procopio said in a statement. "The debris was collected for further analysis."
Procopio said the crash was probably not weather-related.
No other information is available at this point in the investigation.
