Wouldn't rinsing this filter just throw all the plastic back into the water system?

Depends on how you handle the water. You can evaporate it for example and try to extract the plastics. Or maybe treat it chemically (which might cheaper if the microplastic concentration is higher in water used in cleaning the filter)

You could put it in a landfill instead?