Recent numerical relativity simulations have shown that the emission of gravitational waves during the merger of two supermassive black holes (SMBHs) delivers a kick to the final hole, with a magnitude as large as 4000 km s⁻¹. We study the motion of SMBHs ejected from galaxy cores by such kicks and the effects on the stellar distribution using high-accuracy direct N-body simulations. Following the kick, the motion of the SMBH exhibits three distinct phases. (1) The SMBH oscillates with decreasing amplitude, losing energy via dynamical friction at each core passage. Chandrasekhar's theory accurately reproduces the motion of the SMBH if 2 ln Λ 3 and if the changing core density is taken into account. (2) When the amplitude of the motion has fallen to roughly the core radius, the SMBH and core begin to exhibit oscillations about their common center of mass. These oscillations decay with a time constant that is at least 10 times longer than predicted by Chandrasekhar's formula. (3) Eventually, the SMBH reaches thermal equilibrium with the stars. The time for the SMBH's oscillations to damp to the Brownian level is as long as ~1 Gyr in the brightest galaxies. The longevity of the oscillations makes this mechanism competitive with others proposed to explain double or offset nuclei. Ejection of SMBHs also results in a lowered density of stars near the galaxy center; mass deficits as large as five times the SMBH mass can be produced. We compare the N-body density profiles with luminosity profiles of early-type galaxies in Virgo and show that even the largest observed cores can be reproduced by the kicks. Implications for displaced AGNs and helical radio structures are discussed.