Police said a verbal threat had been made to staff.
The man was charged with using threatening language and remanded in custody to appear in court today or tomorrow.
He had left the building, prompting police to close the office and clear all members of the public from the building before he was found.
Police said such incidents were taken very seriously and they were responding appropriately.