⚠ Careful with Maintenance Window
It might bite you
Maintenance Window now in Preview
(at the time of writing)
On 2nd March 2021, Microsoft announced a long-awaited feature, at least by me, to give choice over when OS and SQL patching occurs behind-the-scenes in Azure SQL Managed Instance. Before this feature, Microsoft would patch the Virtual Cluster supporting Managed Instances outside of regular business hours in the region your Managed Instance is located.
You now get two additional options:
- Weekday window, 10PM to 6AM local time Monday – Thursday
- Weekend window, 10PM to 6AM local time Friday - Sunday
- Daily, 5PM - 8AM local time every day of the week
This could mean that if you are using the system default maintenance window and had any long running transactions open, they would get disconnected and rolled back. This can be very inconvenient for loading a data warehouse daily, for example. Usually when a Managed Instance fails over it takes less than 30 seconds, typically around 8, so the outage is small, however it does disconnect any existing transactions. This is similar to how Availability groups work in SQL Server with a command like:
Users requesting this feature
I had users requesting this feature because they wanted uninterrupted daily loading of the warehouse and didn’t want to have to deal with unpredictable failover events.
After reading the announcement I decided to try it out, because users were requesting it, but I didn’t read the entire documentation on the Microsoft documentation site 🙄. Therefore I didn’t see this part of the docs:
Little did I know but changing your maintenance window does the following:
- Creates a new virtual cluster! (because it’s using SQL Server new code)
- Begins a scaling operation to move the entire managed instance into the new virtual cluster
- Will change the IP address of the Managed Instance
- The process can take hours (5+ in my case)
Scaling operations should normally be done during a maintenance window (oh, the irony), because disconnection events happen as the instance is moved to new virtual machines. Although the managed instance is available during this event, some things are not possible, for example, restoring a managed database.
If the managed instance is behind an IP based firewall then the public endpoint (if configured) will become unavailable as the IP address changes. Anyone that manages and deploys managed instances should know that URL based firewalls should be used for public endpoints, or even better, use private endpoints (my preferred approach).
Changing your maintenance window does not simply adjust a schedule in Microsoft. It will:
- Create a new virtual cluster
- Move your managed instance to the new virtual cluster
- Take hours to do it.
- Prevent some operations to take place like restoring a database
- Likely change the IP address of the public endpoint of the Managed Instance as a result of moving to a new virtual cluster with a new listener