There's a dead reply to my comment that I'd like to address anyway, in a slightly glib manner:
> How hard would it be to remove those bits that ignored non-commercial traffic?
Code-wise? It'd be really easy to add an INSERT that stuffs extra data into another table. But as far as "removing the bits that ignore non-commercial traffic", none of the non-commercial traffic would be in the datasets provided by the various federal agencies (whose acronyms I forget).
Performance-wise? The whole thing is a giant mass of Oracle PL/SQL that can barely keep up with the commercial traffic. If we tried processing all non-commercial traffic through the scoring algorithms etc, the whole house of cards would fall down :D
> How hard would it be to remove those bits that ignored non-commercial traffic?
Code-wise? It'd be really easy to add an INSERT that stuffs extra data into another table. But as far as "removing the bits that ignore non-commercial traffic", none of the non-commercial traffic would be in the datasets provided by the various federal agencies (whose acronyms I forget).
Performance-wise? The whole thing is a giant mass of Oracle PL/SQL that can barely keep up with the commercial traffic. If we tried processing all non-commercial traffic through the scoring algorithms etc, the whole house of cards would fall down :D