Eight fire trucks are at a multi-level office building in central Wellington where smoke has been detected inside.
Earlier smoke was seen coming out of the top of the Featherston Street building, which houses communication giant Spark.
Assistant commander Steve Hudson said fire crews responded to a "fire alarm activation in the building" at around 10.20am on Wednesday.
The origin of the fire was a computer switch cabinet, he said.
It has been contained on the seventh floor.
Hudson said crews were now carrying out "ventilation" checks and making sure there was no further fire-spread in the building.
People should be able to return to other levels of the building shortly.
Spark said there was minimal disruption to its services as a result of the fire.
It said there was an impacted cell tower, but overlapping coverage from other sites meant Spark customers were still able to use its services.