Quick summary:
If an integer represents a number, i.e. int x = 72, prefer performing only arithmetic manipulations on this field.
If an integer represents a bitfield, i.e. int x = 0x000001f5, prefer performing only bitwise manipulations on this field.