I had this exact problem with RCS on my Android phone. I didn't realize that it had been enabled by default at first. Since I don't want to use it, I disabled it once I noticed -- but then a couple of the people I had been texting with could no longer receive my texts.

I didn't know how to resolve it at the time and it only got fixed for me after I replaced my phone and got a new phone number.