Scaling Compute on Context — Jack Morris, Engram
Scaling Compute on Context addresses how to give LLMs deep expertise from private data when public scaling fails. It reviews methods like KV compaction and distillation to achieve self-improvement.
Read article