Alex Xi's Notes
Search
Search
Dark mode
Light mode
Tag: attention
8 items with this tag.
Jul 06, 2026
tweet-sparse-attention-anns
attention
sparse-attention
anns
retrieval
architecture
Jul 06, 2026
tweet-subq-sub-quadratic-llm
architecture
attention
long-context
efficiency
Jul 06, 2026
vllm-triton-attention-backend
vllm
triton
attention
inference
gpu-kernels
Jul 06, 2026
tweet-flashattention-most-innovative
flashattention
infrastructure
attention
memory
io-awareness
Jul 06, 2026
differential-transformer
differential-attention
transformer
architecture
attention
Jul 06, 2026
how-attention-residuals-work
transformers
attention
architecture
Jul 06, 2026
attention-wrong-norm
attention
transformers
architecture
normalization
sequence-length
Jul 06, 2026
context-rot-chroma
context-engineering
context-window
performance
attention