If my neighbor or colleague at work does not pray.

In congregation at the mosque and does not pray jumu'ah.

Is it permissible for us to dislike him for the sake of the religion? Yes, if he does not pray jumu'ah, yes.

Jumu'ah is an individual obligation on every Muslim.

Adult, sane, and able.

So this person is accountable and must pray jumu'ah. Of course, if he does not pray jumu'ah, he should be disliked for the sake of Allah the Blessed and Exalted, and Allah knows best.