When to Use AWQ vs GPTQ
Both quantize to INT4. AWQ is faster to quantize. GPTQ sometimes has better quality. When does each win?
1 post tagged with "gptq"
Both quantize to INT4. AWQ is faster to quantize. GPTQ sometimes has better quality. When does each win?