What Happens When Your
Resiliency Plan Fails?
Are there flaws to your resiliency plan? Answer the following questions to help build a stronger plan for your business.
2. What is the financial impact of infrastructure failure or extended loss of power?
3. Do you have a strategic risk mitigation plan?
4. Has key infrastructure maintenance been delayed due to enterprise competition for capital?
5. Do you have aging infrastructure and have you analyzed its remaining useful life?
- Uninterruptable power supplies (UPS)
- Backup generators
- Solar and/or wind with battery storage
- Distributed energy systems
Outages are, by definition, unplanned downtime
Many businesses invest in resilience systems and have business continuity plans in place to help ensure ongoing and uninterrupted operations. These businesses recognize the cost of downtime and have made the necessary investments to curtail losses. When these systems work as designed, meaning everything starts up and runs exactly when needed, your continuity plans are validated.
Worst-Case Scenario – Your Resilience System Fails to Start or Stops Running
- Why would this scenario happen?
- Does it ever happen?
- How can you guard against this scenario?
What’s Missing in Many Continuity Plans?
Lack of Testing and Maintenance
Research On Failures During Outages
Generator Failure Caused Outages
- Several generators at a data center failed to start during a grid outage. Many of the web’s most popular destinations were offline for several hours. The data center uses a flywheel UPS system – rather than batteries – to provide “ride-through” electricity to keep servers online until the diesel generators can automatically start up and begin powering the facilities. The generators had to be started manually, which was delayed until staff could respond. Several major customers were affected. (Reference)
- During a severe storm, power from the utility was knocked out. One of the data centers hosted clients indicated that a UPS system initially functioned but failed with the switch from battery to generators. The outage, even though the company had invested in a resilience solution, required two to three hours to recover. (Reference)
- A very large data center suffered an outage that took more than two hours to restore. In this case, a module on one of the UPS systems failed. The data center had to replace power supplies in servers, replace firewalls, reconfigure switches and manually log on to servers to get them to boot properly. (Reference)
- Backup generator failure leaves Pomona students in the dark. Power was lost in dorms, dining halls, academic and administrative buildings for hours. The failure had a cascading effect that required the shutdown of the feeder that provided power to part of the campus. (Reference)
Ways to Reduce Your Exposure to Energy Resilience System Failure
- Controls “not in auto”
- Ran out of fuel
- Battery failure
- High fuel alarm
- Oil, fuel or coolant leaks
- Breaker trip
- Low coolant levels and temp alarms
- Air in the fuel system
Consider Outsourcing Energy Resilience System Testing and Maintenance
Successful businesses are increasingly outsourcing facility and energy services. By choosing to work with a dedicated energy services team, you can free up resources to better concentrate on key proficiencies and grow the bottom line.
- Help provide experience and assist you with risk management: We can provide technical and equipment knowledge to help your business perform better. By outsourcing certain components of your business to a team with the proper skillsets and knowledge of the responsibilities, you’ll help mitigate potential risks and problems.
- Using proven technology and dedicated resources: The continuous operation of your business requires clean, reliable and constant power. Power interruptions can result in lost sales, products and revenue. We help dedicate resources to maintain your equipment and provide warranties for the term of the agreement.