To control the O content and further improve the glass forming ability and mechanical properties of Zr(-Ti)-Cu-Ni-Al metallic glasses, Y, Gd, La and Ce are added into the alloys based on the mechanism of strong interaction between O and rare earth elements. Metallic glasses are prepared by the copper mold casting method. The glass forming ability and microstructure of the alloys are studied by Differential Scanning Calorimetry (DSC), X-ray Diffraction (XRD) and Transmission Electron Microscopy (TEM), and the mechanical properties and corresponding fracture modes are investigated by quasi-static compressive tests and Scanning Electron Microscope (SEM). The results show that the addition of Y improves the glass forming ability greatly. Bulk metallic glasses with the diameter over 10 mm can be prepared under relatively low vacuum. The compressive strength is up to 1900 MPa.