ALL CLEAR: Services have been restored as of 11:45pm ET.
Please see the below announcement for important information regarding an emergency maintenance window for NRAO-hosted IT services in Charlottesville, Virginia.
Description of Issue
NRAO’s Enterprise IT (EIT) and Facilities departments are scheduling an emergency maintenance window for the Edgemont Road Data Center on Monday, September 28 at 3pm MT, 5pm ET for 6 hours for emergency electrical repairs.EIT will begin to take servers offline at 5pm ET, and will bring them back online after the electrical work is complete.
Service Impact
Impacted remotely-accessible services:
- All compute and login servers at NRAO’s Charlottesville location will be unavailable (including CV post nodes and guest-login.cv.nrao.edu services)
- Web services hosted in Charlottesville will be unavailable and you can expect to be redirected to a “service offline for maintenance” page for the duration of the maintenance window.
Impacted in-person services (for those with access to Stone Hall):
- Keycard access to doors may be affected, and access to Stone Hall may be limited to physical keys for the maintenance duration.
- Desktop phone services at Charlottesville locations (Stone Hall and the CDL) will be unavailable during the maintenance window
- Internet services at Edgemont Road will be unavailable.
Estimated time of Resolution
Monday, September 28th at 9pm MT, 11pm ET.
Recommendations for Action
We recommend that you stop non-essential workloads that are running in the Edgemont Road Data Center as soon as possible to avoid interrupted jobs during this maintenance window. We also recommend powering off your Linux workstations prior to the maintenance window to avoid system instability. EIT staff will be unable to assist with powering on workstations outside of the server room after the maintenance window is complete, as EIT will be continuing to work on system cleanup and recovery on Tuesday.
Once EIT has sent an “all clear” announcement after services are back online, you can begin to resubmit reservations as normal and power back on Linux workstations. If you are unsure if your workloads are running on affected EIT infrastructure, please reach out to the help desk at helpdesk@nrao.edu.
Follow Up
We will send an update Monday, September 28th, by 3:00 PM MT, 5:00 PM ET, with a maintenance start-time notice, and with any updates we have on the situation. We will also follow up with an “all clear” announcement after the maintenance work is completed and services are restored.
