#comparison

2 posts tagged with "comparison"

Jul 5, 2025

Both quantize to INT4. AWQ is faster to quantize. GPTQ sometimes has better quality. When does each win?

May 14, 2025

H100 spot at $0.15/1M tokens. A100 on-demand at $0.40/1M. API at $1.00/1M. Here's the full comparison.