Tweet: Building Spectre
@gabepereyra on building Spectre — likely related to speculative decoding or a new agent/inference system.
Connections
- Transformer Inference Optimization — inference optimization techniques
@gabepereyra on building Spectre — likely related to speculative decoding or a new agent/inference system.