notebooks – Jonathan Chang’s Blog

MIST Bench: Building the MIST robot from Pantheon

Using AI to build a robot inspired by the animated series Pantheon

Agent-Environment Middleware

Composing agents with Agent-Environment Middleware (AEM)

LLMProc: Thinking in Processes, Not Agents

LLMProc introduces a process-based approach to LLM applications, drawing inspiration from Unix systems.

Maximizing PyTorch Throughput with FastAPI

Techniques to optimize your PyTorch inference server for maximum throughput using FastAPI, asyncio, and CUDA’s asynchronous execution APIs

Additive Rotary Embedding - A Competitive Alternative to RoPE

A competitive variant of rotary position embedding (RoPE) with interesting properties

Exploring the Effective Rank of Projection Weights in Attention

Disclaimer: Most of the code are written by GPT/Copilot, and is not optimized for presentation.