The man shouted out as he was handcuffed and led away by officers with West Midlands Police, just a short distance from where 1,000 people had gathered in the city's main Victoria Square.
As he was taken away in a riot van in Edmund Street, which runs behind Birmingham's council house, a police sergeant could be seen carrying away what appeared to be a bat and a hatchet.
Speakers who had been paying tribute to the Manchester victims were interrupted by the man's loud protests, from down a side street.
Police, including armed response officers, then cleared the square a short time later.
The force's chief constable David Thompson - who had been attending the vigil in an official capacity - witnessed some of the incident.
He confirmed the evacuation of the square, in front of the council house, had been a precaution.