The use cases we see are (i) assisting researchers in creating scientific figures from scratch (sketching them om paper is usually easy but actually developing them can be daunting), and (ii) enabling semantic edits to existing figures stored in lower-level formats by synthesizing high-level graphics programs that generate them.
When I am teaching online, I write on a digital board. Lots of math, figures here and there. I have attempted to convert some of my lectures into written notes in the past. Something like this would help quite a lot with the conversion.
Would be insane to have an end to end product. One that transcribes my audio, at the same time annotating it with the equations and figures I have drawn on the whiteboard.
As a teacher who regularly rips off large expressions from textbooks and test generators with MathPix, this would allow me to also capture diagrams into my exercises.
Yeah, I think that's one of the primary use cases. As a researcher I've looked at using Tikz in the past but it's a nontrivial learning curve. Something like this seems useful to at least get a starting point to tweak.
Would someone feed the model a hand drawn scientific figure and it would output the TeX to create the figure digitally?