Yes, but it's not much. To stay with the example given above, group delay is less than 1 ms at 48 kHz fs, largely indepedent of oversampling factor (2-8).