Tuesday, August 26, 2025

Monday, August 25, 2025

Task specification

 Task specification - " writing concrete chunks of code/comments myself and in the right part of the code is a high bandwidth way of communicating "task specification" to the LLM, i.e. it's primarily about task specification bits - it takes too many bits and too much latency to communicate what I want in text, and it's faster to just demonstrate it in the code and in the right place. "


AI cheatsheet

Japanese afshinea/stanford-cme-295

Encryption of data from your prompt to LLM and cloud

From chatgpt: 

User Device

   |

   |  📡 TLS 1.3

   v

API Gateway / CDN

   |

   |  🔒 mTLS (optional)

   v

LLM Frontend (e.g., OpenAI API)

   |

   |  🔐 Internal encrypted service calls (gRPC, mTLS)

   v

LLM Core Services (Tokenizer, Model, Storage, Cache)

   |

   |  💾 At-rest encryption via AES-256

   v

Cloud Storage / Logs / Backups (with KMS/HSM)