To leave one to himself

to withdraw from him; to let him take his own course.

See also: Himself

Webster's Revised Unabridged Dictionary, published 1913 by G. & C. Merriam Co.