I agree ---contact the COR.
Unfortunately, few CORs have much of an idea of what they can and should be doing.
As a COR myself, I led opposition to an ineffective District Chair and District Commissioner. BSA rules REQUIRE that a district nominating committee recommend district leaders each year, although this requirement is widely ignored. However, as a COR I did insist on a district nominating committee be appointed, and they found new and highly effective leadership for the district.
In Scouting, pretty much all adult leaders quit. It mostly just a matter of how long it becomes before people get exhausted and can't do their job any more.
I began as an adult leader in 1981, and I'm getting darned exhausted myself. I've been shedding various jobs in recent years so I could do what was left competently. I expect to continue that pattern some more.