There are a lot of individual circumstances, but generally:

Prison is where people who are convicted of felonies (crimes worthy of >1 year in custodial sentence) are sent. Jails are where people awaiting trial, or convicted of misdemeanors (crimes worthy of <1 year in custodial sentence) are sent.