Two hollowed out rocks, one behind the player house in the Waterfront.  One outside the Imperial prison close to the bridge going to the market palace.

The containers will supply you with a good quantities of supplies to get you started.  There are some weapons, armor and health items for your protection.