Yes I agree, that with the long hold on the button I no longer have that reason, but do find it extremely inconvenient to have to remove the hearing aids to switch BT sources, the reason mentioned by the original poster.
“It’s Always Something!” LOL!