Maybe this wasn't here when you looked at it, but maybe try Python 3.11?

> We developed and tested Chatterbox on Python 3.11 on Debain 11 OS; the versions of the dependencies are pinned in pyproject.toml to ensure consistency.