I don't see any reasons why a silicon valley startup couldn't. Lots of small bank startups sprout up all over the country. Also, Simple.com was a startup (they are now part of a very large bank) that got FDIC insurance through a partner bank.