I think the 8B+ question was about parameter count (8 billion+ parameters), not ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		dragonwriter 7 months ago \| parent \| context \| favorite \| on: Chatterbox TTS I think the 8B+ question was about parameter count (8 billion+ parameters), not quantization level (8 bits per weight).

vunderba 7 months ago [–]

Yeah I should have been more specific - Qwen 8b at a 5_K_M quant worked very well.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact