How Machine Learning Changed Computer Architecture Design (David Patterson) | AI Clips with Lex

TPUs before they were a household term! Very telling little chat you clipped here...😮🤔😊

Why not simply standardize FPGAs and have the OS allocate areas of your chips to applications, then you can have software that come with their own hardware accelerators. Imagine an mp3 library coming with its own DSP chip design, or a crypto library with its own specialized hardware. And if you run out of FPGA floor space, your OS can then simulate the rest of it on the CPU, kinda like the trade-off between physical RAM and swapfile. Sounds like a good idea, but is probably a massive standardization effort across the entire industry and probably the economics of it all don't make sense at the moment. My bet is that in the future we'll see more reconfigurable hardware integrated with the software. Then you really have a thing that you can go ahead and optimize, and it will benefit everyone.

Seems like they should be talking about GPUs towards the end. Not sure why it didn't come up.

Machines that write our programs-- YES!

why does this guy swallow cud every 10 seconds?

Tenserflow and PyTorch aren't "languages"!!! They are frameworks or librarys.

Seems like ML will only advance us so far. Ultimately we need a new architecture or semiconductor tech breakthrough to revive Moore's law in some form. Otherwise we have plateaud, and that, while not the end of the world, is quite disappointing.