Switching POVs doesn't bother me as long as it's clear from the start that's what the author intended, with different sections/paragraphs from different POVs. But reading a story where it's ONLY from one POV and then to suddenly switch for just one thing in the middle of the story is very irritating. I like a little bit of consistency.

*shrugs*