To stick by

To adhere closely to; to be firm in supporting
To be troublesome by adhering.
- Davenant.

See also: Stick, Stick

Webster's Revised Unabridged Dictionary, published 1913 by G. & C. Merriam Co.