Authorities allege the man entered a Collins Street business earlier on Saturday while armed with a knife and stole items before boarding the tram to flee.
Police were notified and instructed the driver to keep tram doors closed, as the man appeared to threaten a nearby woman in attempts to negotiate with police.
Police have charged a man with armed robbery, false imprisonment, assault and threats to kill.