Vex

verb: to annoy, irritate, puzzle, confuse

The old man who loved his peace and quiet was vexed by his neigbor's loud music.

Synonyms: annoy, bother, chafe, exasperate, irk, nettle, peeve, provoke