To stick by

To adhere closely to; to be firm in supporting
To be troublesome by adhering.
- Davenant.

See also: Stick, Stick