All Tags

#awq

1 post tagged with "awq"

When to Use AWQ vs GPTQ

Both quantize to INT4. AWQ is faster to quantize. GPTQ sometimes has better quality. When does each win?