To hold one's nose to the grindstone

to oppress one; to keep one in a condition of servitude.
See under Grindstone.

See also: Grindstone, Nose