I realize this is an older thread but the issue of a larger carb wasn't really addressed.
When you increase the venturi diameter, you decrease the intake charge velocity given the same volume of air is passing through it but it has more space to occupy. This reduces natural supercharging (pulse wave stacking as the intake slams shut causes a high pressure zone behind the piston due to the mass of the intake charge trying to keep it's velocity), and also reduces the responsiveness of the venturi itself to correctly meter the fuel as the charge has a lower vacuum signal across the jets.
There's a big difference in having enough carb and having too much. Too much carb causes more problems than not having enough (assuming you're not so under fed as to run lean). Since these are tuned for WOT more than anything, the midrange isn't as much of an issue like it is with cars, but there's a lot of folks running 750cfm Holley's who'd be far better served with a 650 given the engine they've got it on. Being able to dial in enough fuel for a given bore diameter is likely the problem with smaller chainsaw carbs rather than them acting as some kind of restriction; but that's just a slightly educated guess as I have no experience with the little carbs beyond turning the needles.