During the first half of March we will be performing upgrades to the LOUIE network which include adding mailbox servers, phasing out older servers, upgrading Exchange to SP2, and most importantly, DAG redesign.
On the first week (March 5th-9th 2012) we will add two new mailbox servers for LOUIE (one intended to phase out LOUIEMBOX1).
On the second week (March 12th – 16th 2012) we will create a new DAG for LOUIE and add two new mailbox databases into the DAG. Throughout the week users hosted on LOUIEMBOX1 will be moved to the new databases in the DAG. Finally once all users are moved from LOUIEMBOX1 we will begin replicating public folder content to the new mailbox servers.
All changes are intended to be transparent to users and should not interrupt service access.
Tonight beginning at 10:30 PM Eastern we will be performing the following maintenance
- Rockerduck Load Balancer
- Increasing physical resources. Restart required.
- Clients will be disconnected from their mailboxes for up to 5 minutes.
- LiveArchive: Los Angeles SP2
- Installing Service Pack 2 on Exchange 2010
- Client access will not be affected as we are currently running LiveArchive out of Dallas.
This weekend (02/24/12 – 02/25/12 19:00 Eastern [00:00 GMT]) we will be performing SP2 upgrades to the Europe Exchange 2010 Cluster: Della. Upgrade to Exchange 2010 SP2 will be performed on all passive nodes in Della. Upon successful upgrade clients will be moved from the active server to a passive node. . This upgrade is not expected to impact customer access however, there will be critical changes prior to the upgrade.
· New load balancer will be activated across the passive nodes.
· IP address for cas.della.exchangedefender.com will be modified to the new load balancer (Expected to be 18.104.22.168)
On Friday evening users on the active node will be moved to the passive nodes. The switch over from active to passive should be transparent to users.
Unfortunately BES services may be interrupted as BES does not detect and handle upgrades seamlessly. If BES service is interrupted we will work on restoring service after SP2 has been successfully applied.
Update 3:05 AM: Exchange 2010 SP2 has successfully been applied to DELLA.
This Friday (02/18/12) beginning at 07:00 Eastern (-5 GMT) [Saturday, 23:00 NSW] we will be upgrading the Exchange 2010 cluster Matilda to SP2. Clients should expect to see minimal downtime as services are restarted. Maintenance is expected to last one hour.
Update 2/17/12 6:50 AM Eastern: We are preparing the server for installation of SP2. We are expecting to begin the installation around 7:30 AM.
Update 2/17/12 7:30 AM Eastern: We are beginning the installation of SP2 on matilda.
Update 2/18/12 8:55 AM Eastern: SP2 installation has completed. We are testing services to verify a successful installation.
Update 9:07 AM Eastern: The installation was successfully verified.
During the week of Feb 4 - Feb 11th 2012 the ExchangeDefender staff performed various upgrades to our ExchangeDefender service and to our Hosted Exchange network for ROCKERDUCK. The upgrades included additional nodes for ExchangeDefender, installation of additional power and a replacement VPN router for ROCKERDUCK internal communication (active directory, exchange services, etc).
Unfortunately during the upgrade process we encountered various issues in which some cases affected about half the clients on ROCKERDUCK.
On February 9th RDMBOX2 lost heartbeat communication with the DAG which prompted the passive mailbox database copies on ROCKERDUCK:LA to actively mount the database. Failover to Los Angeles kept client mailbox access available but prompted issues with Active Sync users with redirection requests and with mail delivery. The issue was completely resolved by 2PM Eastern and only affected users on RDDB8 and RDDB13.
On February 10th and 11th Rockerduck EDGE servers experienced issues with inbound and outbound mail flow. The issue was quickly identified as an issue with a corrupted Exchange 2010 SP2 install on the EDGE servers. After reapplying the update mail flow was resumed and service was fully restored.
Although we made a lot of headway on our maintenance schedule this weekend there were a few tasks that were unable to be completed and have been rescheduled for tonight and next weekend.
Tonight we will replace the VPN device for ROCKERDUCK internal communication. The VPN device upgrade will bring a more responsive experience for users in accessing their mailboxes.
Next weekend we will be testing the rockerduck failover procedure. Currently we have this on schedule for Saturday at 1am Eastern.
Both maintenance tonight and next weekend (2/17 – 2/19) will not interrupt clients from accessing their mailboxes.
Our primary DC will be performing maintenance this weekend as outlined below:
EVENT ID: COLO402112012-NM
WINDOW START TIME: 1:00 AM CST
ESTIMATED END TIME: 4:00 AM CST
SERVICES/EQUIPMENT: Colo4 IP Plus/Value Network
PURPOSE OF WORK: Hardware maintenance/code upgrade
IMPACT OF WORK: Momentary loss of connectivity as the IP Plus primary router is rebooted to accomodate code upgrade.
Colo4 will be performing hardware maintenance and a software image upgrade. A reboot of the router will be required.
IP Plus/Value customers can expect a brief period of connectivity loss while the router is rebooted.