If you’re so smart why don’t you come up with a way to do it under 100 watts???
Also this is training them not using them. Using an ai consumes significantly less power than the process to train it sort of like how humans take more to learn than to put something in practice.
Yeap. They are trying to train the AI quickly, not over the course of 18 years.
Also, it’s early still early for these AI/LLM tools. The first few iterations of things are generally not very efficient. After you can prove it works, THEN you can make improvements to it, make it more efficient, etc.
However, I think that the approach of feeding in more power instead of optimizing it is the wrong approach. I feel Microsoft could get further ahead of it could find ways to train models more efficiently 🤷
Mega corporations should not be allowed to use nuclear power plants purely for themselves.
Also, if you need that much power to do something bthat a human brain does with under 100 watts, I really think you’re doing it wrong
If you’re so smart why don’t you come up with a way to do it under 100 watts???
Also this is training them not using them. Using an ai consumes significantly less power than the process to train it sort of like how humans take more to learn than to put something in practice.
Yeap. They are trying to train the AI quickly, not over the course of 18 years.
Also, it’s early still early for these AI/LLM tools. The first few iterations of things are generally not very efficient. After you can prove it works, THEN you can make improvements to it, make it more efficient, etc.
However, I think that the approach of feeding in more power instead of optimizing it is the wrong approach. I feel Microsoft could get further ahead of it could find ways to train models more efficiently 🤷
People tend to forgot the millions of years of horribly inefficient evolution it took to develop the human brain.