If the indoor system is a closed system (assuming so?), I think I would suspect the OWB side of the HX to get gunked up before the indoor side. A closed pressurized system will seldom present any issues if its kept closed so oxygen can't keep appearing into it - whereas an open OWB is pretty well exposed to it all the time, and makeup water would keep introducing more fresh O2 & water with minerals.
I haven't had to clean my HXs yet, but I put them in with the ability to easily flush, with shut off valves & drain valves I could hook hoses to. If I ever found myself having to do that, I'm just planning to recirc some CLR solution through the HX with a small pump - like a drill pump or whatever I could find at the time. Not sure the CLR is the best thing to use - but that's what I was thinking.
If you can get some temp measuring done at all your ins & outs, that should help narrow down a possible problem.