At approximately 2PM Thursday, June 20, ‘cvfiler’ experienced a disk failure which impact the performance of one the volumes. This impact was severe enough to bring Unix and Exchange email services to a halt. Email services were down until around 5PM when the volume stabilized (after a power-cycle) and stale lock issues were resolved.

We are currently working with NetApp to verify the cause of the failure and determine if further maintenance is needed to reduce the possibility of a recurring failure.

Update: There was another brief outage on Friday at 3PM but services were restored shortly thereafter. At this time we believe the filer is stable but we are still investigating the root cause of the issue with the system vendor.