Why is AI expensive? Understanding Tokens, GPUs, and Energy.
All those chips use electricity. Training a large AI model can use as much energy as a small town uses in a year.
This is why "Green AI" (making AI more efficient) is a huge topic of research.