Yes, when adequate power is restored to the UPS and is within the operating voltage range of the UPS, it will revert to passing utility power to connected electronics.
To get the best power available, your UPS should be plugged directly into the wall outlet. Plugging your UPS into a surge protector may cause the UPS to go to the battery often when it usually should remain offline.