Being apolitical just means that instead of trying to change society you make the best out of it. Of course it makes more sense for privileged people to be apolitical, but plenty of people without privilege are apolitical as well.
Examples of apolitical people who doesn't fit your description: Illegal immigrants who try to keep theirs heads down and just work, women who adopt a conservative role instead of fighting it, slaves who picked cotton instead of making a fuzz, Gays who pretended to be straight and even married etc.
If you think a bit, being political is almost always more work than not being political. So it is mostly very privileged people who engage in it. The rest are just trying to get by, they don't have the time or energy to spare being political.
None of these are examples of "apolitical" stances. They are people on the margins who are not able to vocalize what they feel to be in their best interests, either way. To hold an apolitical stance under duress is not really to hold an apolitical stance.
Examples of apolitical people who doesn't fit your description: Illegal immigrants who try to keep theirs heads down and just work, women who adopt a conservative role instead of fighting it, slaves who picked cotton instead of making a fuzz, Gays who pretended to be straight and even married etc.
If you think a bit, being political is almost always more work than not being political. So it is mostly very privileged people who engage in it. The rest are just trying to get by, they don't have the time or energy to spare being political.