On January 19, 2016, social messaging giant Twitter experienced a global outage because someone uploaded some faulty code as part of a software update. The site was offline for nearly 8 hours before administrators managed to isolate and fix the problem. That same month, Office 365 users were separated from their email accounts due to a buggy update on Microsoft’s end.
These are both major outages, and probably cost both companies a mint, and they’re anything but unprecedented. See, it isn’t just faulty hardware, unskilled employees, or a lack of preparedness that can bring your data center to its knees. A faulty software update – something as simple as a few misplaced lines of code – can cause an entire facility to go offline for an extended period of time.
If you’d like a more recent example, consider an update that Microsoft pushed to Windows 10 this past December, which broke DHCP and knocked several users offline until they rebooted. Sure, these are consumer rigs we’re talking about, but the basic premise is the same. Faulty software is just as much a danger as faulty hardware.
And given that even a single minute of downtime can cost an average of $7900 USD, it’s critical that you take the necessary measures to ensure that software and firmware don’t cripple your infrastructure.
There are a few things you’ll need to do, in that regard. First, you need to ensure your facility is fully redundant, and dont push updates to all hardware at once. For example, when a new firmware update is available for your switches, push it to a few devices at a time, and test them extensively – if there are any critical problems, better you find them before they cause downtime.
Monitoring is also important. Keep an eye out for performance abnormalities that could indicate a gllitch or bottleneck, and be ready to take action if you find something. No software is entirely free of bugs, after all, and knowing how (and where) to look for them can be a life-saver.
Alternatively, you could just host with Liberty Center One. We’ll handle software updates and upgrades, and leave you free to focus on your business. Learn more here.