element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • Community Hub
    Community Hub
    • What's New on element14
    • Feedback and Support
    • Benefits of Membership
    • Personal Blogs
    • Members Area
    • Achievement Levels
  • Learn
    Learn
    • Ask an Expert
    • eBooks
    • element14 presents
    • Learning Center
    • Tech Spotlight
    • STEM Academy
    • Webinars, Training and Events
    • Learning Groups
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • Technology Groups
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents Projects
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • Project Groups
  • Products
    Products
    • Arduino
    • Avnet Boards Community
    • Dev Tools
    • Manufacturers
    • Multicomp Pro
    • Product Groups
    • Raspberry Pi
    • RoadTests & Reviews
  • Store
    Store
    • Visit Your Store
    • Choose another store...
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
  • Settings
Artificial Intelligence and Machine Learning
  • Technologies
  • More
Artificial Intelligence and Machine Learning
Blog The True Power Cost of Artificial Intelligence is Shocking
  • Blog
  • Forum
  • Documents
  • Events
  • Polls
  • Files
  • Members
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
Artificial Intelligence and Machine Learning requires membership for participation - click to join
  • Share
  • More
  • Cancel
Group Actions
  • Group RSS
  • More
  • Cancel
Engagement
  • Author Author: Catwell
  • Date Created: 20 Oct 2023 7:39 PM Date Created
  • Views 2929 views
  • Likes 7 likes
  • Comments 9 comments
  • research
  • artificial intelligence
  • cabeatwell
  • ai
  • data center
  • power
  • energy
  • innovation
Related
Recommended

The True Power Cost of Artificial Intelligence is Shocking

Catwell
Catwell
20 Oct 2023

image

(Image Credit: geralt/pixabay)

I thought crypto mining was bad…

Now that AI is advancing In varying fields like coding, driving, etc., many people have expressed concern about its power consumption potential in the future. In a recent peer-reviewed analysis, Alex de Vries explained how AI applications, with widespread adoption, could consume more power than certain countries. It states that by 2027, AI servers could use 85 to 134 Twh per year. That’s the same amount used by Sweden, the Netherlands, and Argentina annually. 

We’ve seen how generative AI tools, like ChatGPT, rapidly increased in popularity over the past year. And training these AI programs that process large amounts of data makes them power-hungry in the first place. For example, Hugging Face’s text-generative AI tool ate up 433 MWh while it underwent training. That’s enough to power forty average homes in the US for one year. While running, the AI tools also demand a lot of computer power per operation, which consumes energy. In this case, ChatGPT would need 564 MWh daily just to run constantly.

Nowadays, there’s a worldwide call to improve AI tools’ efficiencies to reduce energy costs. But the Jevons’ Paradox, which suggests that more efficient technology requires higher demand for resources, may get in the way. Google is a perfect example of this as it incorporates AI-generative tools in its email and AI-powered search engine capabilities.

Consider that 9 billion Google searches take place every day. According to de Vries’ estimates, integrating AI into every search would potentially require 29.2 TWh of power. That’s the same amount of electricity Ireland consumes per year.

Last year, data centers powering computers like Google’s search engine and Amazon’s cloud consumed 1% to 1.3% of the world’s power. That doesn’t take cryptocurrency mining, which ate up an additional 0.4%, into consideration. We can’t exactly measure how much energy AI uses since companies only mention how many special chips run the software. As a result, de Vries used NVIDIA A100 server sales projections to calculate the energy consumption.

He references a projection that estimates NVIDIA could ship 1.5 million A100 servers by 2027. He then multiplied 1.5 million by the servers’ energy consumption. Several cautionary notes came up as a result. For instance, server cooling would use up more energy, even if customers don’t use the servers at 100% capacity.

Have a story tip? Message me at: http://twitter.com/Cabe_Atwell

  • Sign in to reply
  • beacon_dave
    beacon_dave over 1 year ago in reply to DAB

    There were several cases in the news last year but from what I could see, none appear to have been successful; but for one of them, I believe that the judge allowed them to have another go at presenting their case.

    They may have been more successful if they had told the AI to produce an artwork that was very similar in appearance to a piece of known work that had been in the training set. In court you would then have two fixed and tangible pieces of work to compare - the original work (with a known author) and the AI generated work which would look near identical to the original work to the human eye.

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • beacon_dave
    beacon_dave over 1 year ago in reply to dougw

    Some of these have already been in use out there for some time, but up until now generally with the human still somewhere in the loop. Sometimes for the better, sometimes for the worse.

    Where it might get interesting is if you end up invoking high-frequency type algorithms by removing the slow human from the loop. You could see runaway type scenarios with interesting consequences.

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • DAB
    DAB over 1 year ago in reply to dougw

    I just saw an article on the first lawsuit against OpenAI claiming they violated copyright law by using published material to train the AI net. Let the games begin, once the lawyers sense money, they will begin filing trivial lawsuits just to see what they can get from an out of court settlement.

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • dougw
    dougw over 1 year ago in reply to DAB

    AI lawyers. AI judges, AI doctors. AI politicians. AI engineers....there is good reason to be worried.

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • DAB
    DAB over 1 year ago in reply to Catwell

    You are probably correct, but just wait until the lawsuits start, then you will see some really fancy footwork.

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
>
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2025 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

ICP 备案号 10220084.

Follow element14

  • X
  • Facebook
  • linkedin
  • YouTube