Task
Audio To Audio
Note: For full-duplex (real-time) inference, use the 8-bit variant instead. 4-bit quantization degrades PersonaPlex response quality significantly — INT8 is both 30% faster (112ms vs 158ms/step) and produces coherent responses where INT4 generates garbled output.
Note: For full-duplex (real-time) inference, use the 8-bit variant instead. 4-bit quantization degrades PersonaPlex response quality significantly — INT8 is both 30% faster (112ms vs 158ms/step) and produces coherent responses where INT4 generates garbled output.