If you manage to get into the GPT-3 beta, I'd love to work on that with you :D.
For simple models, English -> OpenSCAD sounds like it's doable given the things I've seen on Twitter and for normal modeling, GPT-3 would probably make an excellent intent recognizer for voice commands.
The GPT-3 beta is something every programmer and their dog wants to get into these days and most of us can't. It's a really impressive new language processing neural network that people have managed to train to (among many other things) generate code from an English description of the program. If it can do that, it might be able to generate some reasonably complex Constructive Solid Geometry models and even something like MEL commands in Maya.
Greg, OpenAI's CTO, occasionally manually lets people in if they convince him of their use case (or, as one guy did, plant a bunch of trees in his name) in an email (gdb@openai.com). It might be worth shooting him a message explaining the idea. From what I've heard, once you have a key, it's mostly a matter of feeding the model examples until it does what you want.
For simple models, English -> OpenSCAD sounds like it's doable given the things I've seen on Twitter and for normal modeling, GPT-3 would probably make an excellent intent recognizer for voice commands.