A better approach would be a solution based on an Allwinner V3S or S3, since they have DRAM embedded in them. For example, the Lichee Pi Zero [1] is 45mmx25mm (instead of ~25mm^2 for the VoCore) but with a USB and a microSD slot on the PCB.

[1] https://licheepizero.us/