Arsenic (As) is a human carcinogen, and arsenic contamination in groundwater is a worldwide public health concern. Arsenic-affected areas are found in many places but are reported mostly in agricultural farmlands, yet the interaction of fertilizers, microorganisms, and arsenic mobilization in arsenic-contaminated aquifers remains uncharacterized. This study investigates the effects of fertilizers and bacteria on the mobilization of arsenic in two arsenic-contaminated aquifers. We performed microcosm experiments using arsenic-contaminated sediments and amended with inorganic nitrogenous or phosphorus fertilizers for 1 and 4 months under aerobic and anaerobic conditions. The results show that microcosms amended with 100 mg/L phosphorus fertilizers (dipotassium phosphate), but not nitrogenous fertilizers (ammonium sulfate), significantly increase aqueous As(III) release in arsenic-contaminated sediments under anaerobic condition. We also show that concentrations of iron, manganese, potassium, sodium, calcium, and magnesium are increased in the aqueous phase and that the addition of dipotassium phosphate causes a further increase in aqueous iron, potassium, and sodium, suggesting that multiple metal elements may take part in the arsenic release process. Furthermore, microbial analysis indicates that the dominant microbial phylum is shifted from α-proteobacteria to β- and γ-proteobacteria when the As(III) is increased and phosphate is added in the aquifer. Our results provide evidence that both phosphorus fertilizers and microorganisms can mediate the release of arsenic to groundwater in arsenic-contaminated sediments under anaerobic condition. Our study suggests that agricultural activity such as the use of fertilizers and monitoring phosphate concentration in groundwater should be taken into consideration for the management of arsenic in groundwater.