There are a lot of good VAD open source models that are easily configurable, and can be integrating in a day or 2 - checkout the silero vad model

Llama by FB is under a non-commercial license not a GPL license, so I assume you are using a different base model, what model is that?

The reference inference code is GPL.

https://github.com/facebookresearch/llama/blob/main/LICENSE

This isn't a new model, it's just new code.

So who cares if its GPL licensed it can never be put into production

The GPL allows for commercial use. Just adhere to the license.

You probably should care if you integrate the inference code in other software packages that aren’t GPL licensed.

ah i see so Its just a new way to run inference on the non commercial model