Observations of narrow radio-emitting filaments near the Galactic center have been interpreted in previous studies as evidence of a pervasive vertical (i.e., perpendicular to the Galactic plane) milligauss magnetic field in the central ~150 pc of the Galaxy. A simple cylindrically symmetric model for the equilibrium in this central region is proposed in which horizontal (i.e., parallel to the Galactic plane) magnetic fields embedded in an annular band of partially ionized molecular material of radius ~150 pc are wrapped around vertical magnetic fields threading low-density hot plasma. The central vertical magnetic field, which has a pressure that significantly exceeds the thermal pressure of the medium, is confined by the weight of the molecular material. The stability of this equilibrium is studied indirectly by analyzing a uniformly rotating cylinder of infinite extent along the z-axis in cylindrical coordinates (r,θ,z), with low-density plasma and an axial magnetic field at r < 150 pc, high-density plasma and an azimuthal field at r > 150 pc, and a gravitational acceleration g* ∝ r directed in the -Equation or symbol description not available direction. Simple profiles are assumed for the density ρ, pressure p, and field strength B, with the sound speed and Alfvén speeds ∝r within the dense plasma. The density profile and gravity tend to destabilize the plasma, but the plasma tends to be stabilized by rotation and magnetic tension—since the interface between the high- and low-density plasmas cannot be perturbed without bending either the horizontal or vertical field. Normal modes proportional to eEquation or symbol description not available with kz = 0 and m ≠ 0 are studied. Such modes neither bend nor compress the axial field at r < 150 pc but allow compressions of the dense plasma along the azimuthal magnetic field that enhance the destabilizing role of gravity. It is shown analytically that when β = 8πp/B2 is small and the dense plasma is supported against gravity primarily by rotation, the necessary and sufficient condition for stability to kz = 0 modes is |g| < 2|Ω|a, where g = g* - Ω2r is the effective gravity, Ω is the uniform angular velocity, and a is the sound speed in the dense plasma. Since the effective gravity is determined by the degree to which magnetic (and to a lesser degree pressure) forces support the dense plasma, the stability criterion gives an upper limit on the strength of the axial magnetic field, which is ~1 mG for Galactic center parameters.