This view near the entrance to the Balconies Caves shows basically how the "caves" form from large boulders undercut by the stream. The caves in Pinnacles are erosional caves in volcanic bedrock, unlike most caverns that form from the dissolution of limestone underground.