Alex Xi's Notes

Tag: transformers

4 items with this tag.

  • Jul 06, 2026

    tweet-transformer-circuits-mental-model

    • transformers
    • interpretability
    • circuits
  • Jul 06, 2026

    how-attention-residuals-work

    • transformers
    • attention
    • architecture
  • Jul 06, 2026

    lilian-weng-transformer-inference

    • inference
    • transformers
    • optimization
    • efficiency
    • llm
  • Jul 06, 2026

    attention-wrong-norm

    • attention
    • transformers
    • architecture
    • normalization
    • sequence-length