fprox floating point
floating-point-8-an-introduction-to-efficient-lower-precision-ai-training/
"“Data is being created in a lot of different places, and that data has its own gravity: It’s going to cost you money and time to move it,” Tso explains. “That means the end state is a distributed cloud that reaches out to edge devices and servers. You have to bring the cloud to the data, not the data to the cloud.” Cloudian-helps-data-storage-keep-up-with-ai-revolution
Machine Learning in Computational biology
Task specification - " writing concrete chunks of code/comments myself and in the right part of the code is a high bandwidth way of communicating "task specification" to the LLM, i.e. it's primarily about task specification bits - it takes too many bits and too much latency to communicate what I want in text, and it's faster to just demonstrate it in the code and in the right place. "