This is a good initiative, and an excellent initial batch. A great use of management fees!
I'm struggling to think of additional ones because I feel like this covers everyone I would've suggested (particularly TheBloke, vLLM and oobabooga).
Edit, some ideas for future grant recipients would be:
* MLC LLM
* ExLlama
* An open source fork of text-generation-inference
* AutoGPTQ
This is a good initiative, and an excellent initial batch. A great use of management fees!
I'm struggling to think of additional ones because I feel like this covers everyone I would've suggested (particularly TheBloke, vLLM and oobabooga).
Edit, some ideas for future grant recipients would be:
* MLC LLM
* ExLlama
* An open source fork of text-generation-inference
* AutoGPTQ