Highly c-axis-oriented aluminum nitride (AlN) films were deposited by reactive rf magnetron sputtering on molybdenum (Mo) films for film bulk acoustic wave resonators (FBARs). We investigated the effect of underlayer materials on the crystalline qualities of AlN/Mo bilayers. AlN/Mo bilayers were sputter-deposited on silicon, silicon dioxide and AlN underlayers under the same sputtering conditions. The results revealed that the AlN underlayer markedly improves Mo film quality, and this greatly affects the orientation of the upper AlN film. By applying the AlN underlayer, we obtained a full width at half maximum of 2.3° from the X-ray diffraction rocking curve of the AlN film grown on a Mo film. We propose that the large surface energy of AlN is the reason the AlN underlayer improves the quality of the Mo films. In the FBAR with the AlN underlayer, a quality factor of 800 and an effective electromechanical coupling coefficient of 5.7% were achieved.