Can a liquid exert pressure sideways?

Yes, Liquid exert pressure in all direction.