Phillips is fine until you’ve used torx. The problem is needing to press the driver down into the head as well as turning it as opposed to only needing to turn it with a torxI can think of a couple reasons. First, inertia. And a better reason, a single #2 Phillips is the proper driver for #5 thru #12 machine screws and will work in a pinch on larger.
Seems to me that the dislike of Phillips screws would be better directed at crappy/abused drivers and the mixing up of Phillips, Reed & Prince, and JIS tools and fasteners.