We are beginning the process of continuing the upgrades to HUEY and Scrooge. We are beginning again with HUEY and will move on to Scrooge. Just as yesterday, access to mailboxes through Exchange will be interrupted until the upgrade is complete. Each server is scheduled to take about 4 hours.
Update 1:37 AM Eastern: The imaging of the OS on HUEY was successful. We are in the process of moving the database and beginning work on Scrooge
Update 3:18 AM Eastern: The DB copy on HUEY is still in progress and is about half way completed. Since the information is being written to a new RAID volume, the copy process must write to all disks in the array. Scrooge has about 35 minutes on the OS image.
Update 4:42 AM Eastern: The DB copy has begun on HUEY and windows estimates 2.5 hours for completion. We are about to begin the image of Scrooge
Update 5:00 AM Eastern: The DB copy completed on HUEY and service has been restored. Scrooge is committing the backup image to the new server and should be ready for the database copy in 30 minutes.
Update 7:44 AM Eastern: All upgrades were a stunning success. The upgrade to HUEY is complete and the databases were moved. Scrooge is on the new hardware, however the databases copy was taking longer than our allowed threshold. We’ve moved the old database drives to the new server and will complete the DB move either tonight or over the weekend.
Service is expected to be operational by 8AM Eastern, but may be slightly reduced until 8:30 as both servers process pending mail.
Update 8:08 AM Eastern: As a precautionary action we are running a chkdsk on the Scrooge DB drives to ensure they will be able to serve clients without issue. The scan is already 30 minutes in and should be completing by 9AM.
Update 8:55 AM Eastern: We are going to let the chkdsk run until 9:30 AM Eastern before we look into switching to the backup drive. We appreciate our partners patience as this upgrade will provide clients with a smoother Exchange experience.
Update 9:25 AM Eastern: Running a quick reboot in HUEY to correct the system time clock
Update 9:32 AM Eastern: The reboot on HUEY completed and the information store is coming online. If any clients experience mail “disappearing” after it shows up as new, please check the mail from Yesterday in Outlook as the time on the server was one day behind.
Update 10:00 AM Eastern: The chkdsk on the drive is on the final stage, currently at 30%. The server should be 100% operational by 10:30 AM. Canceling the chkdsk was not optional as the other drive presented the same issue as the original.
Update 10:22 AM Eastern: The chkdsk is currently at 50%. This changes the final time to a more realistic 11AM. Customers needing instant access to their mail should utilize LiveArchive until the upgrades are complete. The upgrades were not scheduled to last past 9AM, however we needed to complete the physical migration today.
Update 10:58 AM Eastern: chkdsk is currently at 80% and looks like the slow down was due to a couple logical corrupted free-space allocation blocks.
Update 11:50 AM Eastern: The physical upgrade is complete and service is 100% operational.