Topic
All digests tagged Tokenization
Suggested route
Move from earlier context through the available material to the newest signals. This route is a reading aid, not a difficulty ranking.
LLM inference is the process of running a trained model against new input. It involves tokenization, continuous batching, and two phases: compute-bound prefill and memory bandwidth-bound decode.
Read article
Discover how merchants can accept payments initiated by AI agents using protocols like ACP and UCP. Learn about MCP apps, tokenization, and the trade-offs between embedded and external checkout flows.
Read article
The LLM recommender is predicted to be one of the biggest consumer applications of AI. By using Semantic IDs, content can be compressed from 10,000 tokens to 10, enabling highly efficient, steerable feeds.
Read article
This deep dive covers loading pre-trained LLMs (Qwen3), implementing autoregressive text generation in PyTorch, and optimizing performance using KV caching and torch.compile for maximum inference speed.
Read article
This guide details loading pre-trained LLMs (like Qwen3) and optimizing text generation through tokenization, KV caching, and torch.compile. Learn how to achieve high tokens/second throughput for reasoning models.
Read article