The Mercury ice might last for billions of years, if Mercury did not suffer constant meteoric bombardment. After billions of years, the ice would be gone.