If you remove the air pump you disable the emissions system. You will also need to remove the cats, and use a dual belt pulley on the alternator. You need the dual belt pulley so the single belt won't slip on the water pump.
There won't be a gain in performance from removing the air pump, though there is from removing the cats.