Why Output Tokens Cost 4x More Than Input
Input tokens are cheap. Output tokens are expensive. The physics of transformer inference explains why, and what you can do about it.
1 post tagged with "pricing"
Input tokens are cheap. Output tokens are expensive. The physics of transformer inference explains why, and what you can do about it.