I think the person I responded to was talking about actual bias from the judges knowing the order, not about this study.
Yes, this study would absolutely be suspect if the order is not random. I was saying I am not sure if the order being based on severity would bias the judges, since my assumption would be that judges are aware of severity directly and don’t need to rely on ordering to deduce it.
Yes, this study would absolutely be suspect if the order is not random. I was saying I am not sure if the order being based on severity would bias the judges, since my assumption would be that judges are aware of severity directly and don’t need to rely on ordering to deduce it.