Systems and methods for using virtual or augmented reality with data center operations or cloud infrastructure

By applying virtual reality and augmented reality technologies in data centers, combined with data center operational data, to provide real-time visualization and remote collaboration, the problem of excessive manual intervention and low efficiency in data center operations is solved, enabling more efficient on-site diagnosis and problem solving.

CN114787875BActive Publication Date: 2025-12-12ORACLE INT CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202080065214.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-10-15
Filing Date
2020-10-15
Publication Date
2025-12-12
Estimated Expiration
2040-10-15

AI Technical Summary

Technical Problem

The operation, monitoring, maintenance and upgrading of modern data centers require a lot of human intervention, and operators have limited knowledge of problem areas and tasks, leading to long power outages and inefficiency.

Method used

By employing virtual reality and augmented reality technologies, combined with data center operational data, it provides real-time visualization and remote collaboration, improving the efficiency of on-site diagnostics, operations, monitoring, maintenance, and repair.

Benefits of technology

By leveraging virtual reality and augmented reality technologies, data center operators can identify and resolve issues more quickly and accurately, reducing human intervention, improving operational efficiency, and minimizing power outage time.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114787875B_ABST
    Figure CN114787875B_ABST
Patent Text Reader

Abstract

According to embodiments, described herein is a system and method for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services. The method utilizes virtual reality and / or augmented reality and insights from various sources of data describing the operations of a data center, including data center analytics, to facilitate on-site diagnostics, operations, monitoring, maintenance, repair, health predictions, and remote collaboration, tending to increase the efficiency of managing and operating a data center. According to embodiments, the system can operate with VR / AR devices that can be provided as VR / AR headsets, or other devices that include sensors that measure the location, position, and movement of data center operators within a cloud infrastructure or data center environment, and can display visualizations associated with physical devices of the data center environment, including information from other sources, as appropriate, useful for performing data center operations.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] COPYRIGHT NOTICE

[0002] A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.

[0003] CLAIM OF PRIORITY

[0004] This application claims priority to U.S. Provisional Patent Application No. 62 / 915,422, filed October 15, 2019, entitled “SYSTEM AND METHOD FOR USE OF VIRTUAL OR AUGMENTED REALITY WITH CLOUD INFRASTRUCTURE SERVICES AND DATA CENTER OPERATIONS,” which is incorporated herein by reference. TECHNICAL FIELD

[0005] Embodiments described herein generally relate to the management of computer data centers that support cloud computing environments, and in particular to the use of virtual reality and / or augmented reality to support data center operations or the management of cloud infrastructure services. BACKGROUND

[0006] Modern computer data centers range in size from small data halls or data cages that can have a few 100kW power racks to large data centers that span several football fields with power demands in the tens of MW.

[0007] As the size, complexity, and scale of data centers grow, the operation, monitoring, maintenance, and updating of such data centers requires a large amount of operator human intervention on a 24x7 basis throughout the year.

[0008] Data center (human) operators, once notified via an alarm, work to identify the problem area, isolate the incident, or perform complex tasks including repair and maintenance, often with limited knowledge about the root cause. Resolving the problem can require those operators to make multiple long trips between a headquarters and the affected area, including communication with operations command centers, or with subject matter experts who can help identify and resolve the problem.

[0009] As a result, long outages in data centers and longer recovery times are fairly common, and often require intervention from several teams working across geographic boundaries through lengthy runbooks or written process documents.

[0010] Better insight into the root cause and the ability to take action on-site based on changes or repair protocols would be useful to improve the operational efficiency of such data center or cloud computing environments. SUMMARY

[0011] According to embodiments, a system and method for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services is described herein. The method utilizes virtual reality and / or augmented reality, and insight from various sources of data describing the operation of a data center, including data center analytics, to facilitate on-site diagnosis, operations, monitoring, maintenance, repair, health prediction, and remote collaboration, tending to improve the efficiency of managing and running a data center. According to embodiments, the system can operate with VR / AR devices that can be provided as VR / AR headsets, or other devices that include sensors that measure the location, position, and movement of data center operators within a cloud infrastructure or data center environment, and can display visualizations associated with physical devices of the data center environment, including information from other sources, as appropriate, useful for performing data center operations. BRIEF DESCRIPTION OF DRAWINGS

[0012] Figure 1 An example representation of a physical layout of a data center is illustrated according to embodiments.

[0013] Figure 2 An example ticket tracking system for use with data center operations is illustrated according to embodiments.

[0014] Figure 3 An example of a typical data center operations life cycle is illustrated according to embodiments.

[0015] Figure 4 An example system for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services is illustrated according to embodiments.

[0016] Figure 5 An example system for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services is illustrated according to embodiments.

[0017] Figure 6 A further example system for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services is illustrated according to embodiments.

[0018] Figure 7 A further example system for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services is illustrated according to embodiments.

[0019] Figure 8 Example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are further illustrated according to embodiments.

[0020] Figure 9 Example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are further illustrated according to embodiments.

[0021] Figure 10 Example visualizations provided by using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are further illustrated according to embodiments.

[0022] Figure 11 Another example visualization according to embodiments is illustrated.

[0023] Figure 12 Another example visualization according to embodiments is illustrated.

[0024] Figure 13 Another example visualization according to embodiments is illustrated.

[0025] Figure 14 Examples of devices such as VR / AR (computer) devices that can be provided as VR / AR headsets, tablets, mobile devices, phones, or other types of devices are illustrated according to embodiments.

[0026] Figure 15 Example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are further illustrated according to embodiments.

[0027] Figure 16 Example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are further illustrated according to embodiments.

[0028] Figure 17 Example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are further illustrated according to embodiments.

[0029] Figure 18 Example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are further illustrated according to embodiments.

[0030] Figure 19 Example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are further illustrated according to embodiments.

[0031] Figure 20 Example processes for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are illustrated in accordance with embodiments. DETAILED DESCRIPTION

[0032] As described above, as the size, complexity, and scale of data centers grow, the operation, monitoring, maintenance, and updating of such data centers requires a large amount of operator human intervention on a 24x7 basis. Data center (human) operators, upon being notified via an alert, work to identify the problem area, isolate the incident, or perform complex tasks including repair and maintenance, often with limited knowledge about the root problem. Resolving the problem can require those operators to make multiple long trips between a headquarters and the affected area, including intervention with operations command centers, or with subject matter experts who can help identify and resolve the problem.

[0033] In accordance with embodiments, a system and method for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services is described herein.

[0034] The method utilizes virtual reality and / or augmented reality, and insights from various sources of data describing the operation of a data center, including data center analytics, to facilitate on-site diagnosis, operations, monitoring, maintenance, repair, health prediction, and remote collaboration, tending to improve the efficiency of managing and running a data center.

[0035] In accordance with embodiments, the system can operate with VR / AR devices that can be provided as VR / AR headsets, or other devices that include sensors that measure the location, position, and movement of data center operators within a cloud infrastructure or data center environment, and can display visualizations associated with physical devices of the data center environment, including information from other sources useful for performing data center operations where appropriate.

[0036] Introduction to data centers, layouts, and life cycles

[0037] Cloud infrastructure service providers (e.g., Oracle Corporation) build and operate data centers in different geographic regions throughout the world. An important function of such cloud infrastructure service providers is to maximize the accessibility and availability of infrastructure resources to customers, such as, for example, the number of available and functioning server cores, the amount of available and / or filled data storage, and network physical and virtual connectivity to the data center that provides low latency accessibility to data and software applications.

[0038] These considerations are typically measured with a service level agreement (SLA) that requires, for example, 99.9% availability, or an annual allowed downtime that can be measured in minutes.

[0039] Figure 1 An example representation of a physical layout of a data center according to an embodiment is illustrated.

[0040] As Figure 1 illustrated, within a typical cloud infrastructure or data center environment, physical computer resources are tightly organized in rows and columns of racks in a data hall. Racks are arranged in rows and columns, and have inter-rack and intra-rack cabling infrastructure. In addition, power distribution units (PDUs), circuit breakers, air handlers, and cooling units are typically part of the physical layout.

[0041] Racks containing computing servers, storage, database machines, switches, networking equipment are generally interconnected with various different inter-rack cables (e.g., direct attach copper (DAC) and fiber optic cables), as well as structured fiber optic intra-rack cable types, and also with power transmission units to the racks.

[0042] A typical large data center can have thousands of racks, each with 42 rack units (as an example). The maximum rating of power delivered to each rack is either 15 kVA or 24 kVA, typically. Tens of thousands to hundreds of thousands of servers and storage units, and tens of thousands of switches are common in a typical data center. In addition, the number of intra-rack and inter-rack cables and data ports scale by a factor of about 30 to 100 times. Each switch can have over 50 interfaces. Each interface can have 10-100 or more object identifiers (OIDs) strings. Information is therefore available from hundreds of millions of such strings within a data center. The complexity and scale at the individual rack and device level is enormous.

[0043] At these scales, hardware and software failures are quite common. To ensure high availability, data centers are architected to be highly resilient to both hardware and software redundancy. Hardware failure rates at the field replaceable unit (FRU) level can occur at a rate of between 1 in 1000 and 1 in 10,000 per day. Since the number of FRUs deployed within each rack is very large, this can translate to several racks per day in a data center being affected, requiring field attention to minimize downtime.

[0044] Running an efficient data center requires continuous monitoring of sensor information in real-time (or near real-time) to track the health of each rack and constituent elements within those racks. Information can be retrieved via a pull model (such as using SNMP or APIs), or via a push model using streaming telemetry. Data center infrastructure management tools, including custom built environments, help with both SNMP and streaming telemetry. Such tools provide an overall view of the data center at a very fine level of granularity. An operations command center can then rely on this data and use several dashboards to monitor, assess information and take action based on the information, for example, by using a ticket tracking system.

[0045] Figure 2 An example ticket tracking system for use with data center operations according to an embodiment is illustrated.

[0046] As Figure 2 illustrated, whenever a problem is detected, a data center operator can be notified via an alert, in response to which they can walk back and forth several times to the affected column and row in the data hall, identify the rack and corresponding server or other device, and follow the necessary operations manual to perform the identification, isolation, repair, maintenance, decommissioning, and / or debugging steps as needed. A data center operator can spend a large portion of their daily time resolving such problems.

[0047] Figure 3 An example of a typical data center operations life cycle according to an embodiment is illustrated.

[0048] As Figure 3 illustrated, operator involvement in such tasks spans the entire life cycle 100, from data center installation and initial commissioning, to daily operations, to end of life.

[0049] Due to the scale and volume of equipment they handle daily - moving back and forth several times from office to warehouse to data hall while transporting equipment for repair, replacement, or maintenance - high precision operator contact is necessary. A significant amount of time is spent analyzing data (away from the problem area), then locating the problem area. There are opportunities for missteps that exacerbate the problem, and further increase downtime. Additionally, there is a significant amount of manual contact in all of these steps.

[0050] As data centers begin to automate steps to address the above problems, it is desirable to provide each operator with additional information that helps in all aspects and improves daily operations efficiency.

[0051] Virtual and Augmented Reality

[0052] Generally described, virtual reality (VR) provides a simulated experience that can be similar to, or wholly different from, the real / physical world.

[0053] A virtual reality system can use a device such as a wearable VR / AR headset that merges display screens to produce images and sound that simulate a user's physical presence in a virtual environment. A person using a virtual reality device is able to move around in the virtual environment and interact with virtual objects or features within that environment.

[0054] Generally described, augmented reality (AR) provides a form of virtual reality that supplements information that a user sees in the real / physical world with additional computer-generated content.

[0055] An augmented reality system can use a device such as a VR / AR headset to produce images that augment a user's perception of the real / physical environment, for example, by layering computer-generated data or information over a display of the real / physical environment. To accomplish this, an augmented reality system generally performs registration of the displayed computer-generated data or information with the actual coordinates of the real / physical environment.

[0056] According to various embodiments, a VR / AR device can include a global positioning system (GPS) sensor, an accelerometer, or other sensors that measure a user's position, orientation, and movement within a real / physical environment, and can be provided as a VR / AR headset as described above, for example. According to various other embodiments, other types of VR / AR computer devices can be used, such as, for example, Oculus, Magic Leap, HoloLens, VR glasses, a handheld or wearable computer, a tablet or pad computer device, or a smartphone.

[0057] VR / AR with data center / cloud infrastructure services

[0058] According to embodiments, the methods described herein leverage virtual reality and / or augmented reality, and insights from various sources of data describing operation of a data center (including data center analytics) to facilitate on-site diagnosis, operation, monitoring, maintenance, repair, health prediction, and remote collaboration, tending to improve efficiency of managing and operating a data center.

[0059] According to embodiments, the system can operate with a VR / AR device that can be provided as a VR / AR headset, or other device that includes sensors that measure a data center operator's position, orientation, and movement within a cloud infrastructure or data center environment, and can display visualizations associated with physical devices of the data center environment (including, where appropriate, information from other sources useful for performing data center operations).

[0060] Figure 4 Example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are illustrated according to embodiments.

[0061] like Figure 4 As shown, according to an embodiment, the data center 110 or cloud infrastructure service environment may include physical data center equipment, servers, racks, sensors or other devices 112; these are accessible to the data center customer 114 who may be associated with customer requirements or service level agreements 116.

[0062] According to an embodiment, the data center may include a VR / AR framework 120, which enables the use of virtual reality and / or augmented reality in conjunction with data center operations and cloud infrastructure services.

[0063] According to an embodiment, the VR / AR framework can receive real-time (or near-real-time) signals 122, measurements, analyses, or other data from physical data center equipment, servers, racks, sensors, or other devices, or associated with physical data center equipment, servers, racks, sensors, or other devices, and receive other information or data 124 via a data aggregation layer or component 126.

[0064] According to an embodiment, examples of sources of the other information or data may include, for example, a ticketing tracking system (database) 130, a data center layout (database) 132, or a knowledge management database 134.

[0065] According to an embodiment, the system can be accessed via a VR / AR (computer) device 140, which can be provided as a VR / AR headset as described above, the headset including device hardware 142 (e.g., processor, memory) and sensors for measuring the location, orientation, and movement of a data center operator 150 in a real / physical environment (e.g., cloud infrastructure or data center environment).

[0066] According to an embodiment, when a data center operator is working within a cloud infrastructure or data center environment, they use a VR / AR-enabled interaction 160, whereby the VR / AR (computer) device can communicate with the data center VR / AR framework and display a visualization 170 associated with the physical device of the cloud infrastructure or data center environment.

[0067] For example, according to an embodiment, the visualization display may include an elevation view of the rack, blade, slot, or other data center device to be inspected, or an overlay thereof, which serves as a protective measure against working on the wrong rack / blade.

[0068] According to embodiments, the apparatus can display a map of the data center with information provided in the line of sight of the data center operator, so that they do not have to look at multiple screens to find that information.

[0069] According to embodiments, the data aggregation layer or component also enables data to be transferred between the data center and other locations, e.g., via the network / cloud 180, e.g., to transfer information to one or more (remote) data center experts 182, and / or to receive assistance from one or more (remote) data center experts 182.

[0070] According to embodiments, the system enables data center operators to conduct data center operations 190, including, e.g., facilitating on-site diagnosis, operations, monitoring, maintenance, repair, health prediction, and remote collaboration.

[0071] According to embodiments, the system operates as a converged system, and can utilize an event-driven model in a dynamic manner. For example, displayed information can be updated in real-time or near real-time to reflect what the data center operator actually sees.

[0072] According to embodiments, the information can include data center related analytics, e.g., describing what is the problem that has occurred with a particular data center component; whether there has been a constant temperature rise, or something else has occurred.

[0073] According to embodiments, information can be gathered from a plurality of other systems or sources, and then filtered or otherwise processed to exclude unwanted information, and to provide focused information to the data center operator.

[0074] According to embodiments, the system can utilize additional sources of information, such as knowledge management articles, and can improve the utility of data center analytics over time.

[0075] According to embodiments, the system can utilize artificial intelligence (AI) models to determine focused analytics and insights to provide to the data center operator.

[0076] According to embodiments, the VR / AR framework can be made extensible, e.g., to plug into various apparatus telemetry drivers.

[0077] According to embodiments, each data center process can have an associated Service Level Agreement (SLA) specifying how quickly a particular problem should be fixed. In such an example, the data center team might need to modify the data center to support a specific SLA; for instance, a data center technician wearing VR glasses could be signaled that a particular rack might be malfunctioning and about to miss its SLA, and then take appropriate action. Such a scenario can be associated with an appropriate visual warning of the situation (e.g., a depiction of flames).

[0078] Figure 5 Example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are illustrated according to embodiments.

[0079] like Figure 5 As shown, according to an embodiment, the VR / AR framework can receive real-time (or near-real-time) signals, measurements, analyses, or other data from, or associated with, physical data center equipment, servers, racks, sensors, or other devices, and receive additional information or data via a data aggregation layer or component. The system can be accessed via a VR / AR (computer) device, such as a VR / AR headset including sensors that measure the location, orientation, and movement of data center operators within the data center environment.

[0080] Figure 6 Further examples of example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are illustrated below.

[0081] like Figure 6 As shown, according to an embodiment, when a data center operator is working within a cloud infrastructure or data center environment, using VR / AR-enabled interaction, a VR / AR (computer) device can display a visualization associated with the physical data center environment.

[0082] Figure 7 Further examples of example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services are illustrated below.

[0083] like Figure 7 As shown, according to an embodiment, the visualization display may include an elevation view of the rack, blade, slot or other data center equipment to be inspected, or an overlay on the elevation view.

[0084] Figure 8 Further examples of example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services, according to embodiments, are illustrated.

[0085] As shown, according to various embodiments, other types of VR / AR computer devices can be used, such as, for example, tablet or pad-like computer devices or smart phones, where the visual display can include an elevation view of the displayed rack, blade, slot or other data center device being inspected, or overlaid on top of such an elevation view. Figure 8

[0086] Figure 9 Further example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services according to embodiments are illustrated.

[0087] As shown, according to embodiments, the data aggregation layer or component also enables data to be transferred between the data center and other locations via, for example, a network / cloud, to transfer information to and / or receive assistance from one or more (remote) data center experts. Figure 9 Example visual displays

[0088]

[0089] Example visual displays provided by using virtual reality and / or augmented reality with data center operations and cloud infrastructure services according to embodiments are illustrated. Figures 10-13 Using VR / AR with data center operations

[0090] According to embodiments, the addition of VR / AR features can be used to improve the efficiency and productivity of data center operators. For example, each data center operator can be equipped with a VR / AR device to use on the data center premises, especially when away from the data center office headquarters.

[0091] According to embodiments, by adding VR and AR features in the data center, each operator can have instant access to many properties in their data center operations space that can then be manipulated.

[0092] For example, according to embodiments, these can include construction specific details about each area and available domain (AD), such as physical layout; halls; cages; columns and rows with different rack SKUs; rack lifting devices; rack equipment and ports; fiber backbone, connected optical and copper cables, and management port interfaces; meet me room locations and ports, cross connects and mapped physical ports, fiber entry diversity, Autonet / Cutsheet / identifiers; floor PDU / rPDU; IP addresses; air handlers, chillers, pumps, humidifiers, lighting, UPS, breakers, and redundancy brands / models / locations.

[0093] ​​

[0094] According to embodiments, by providing this repository of information available on-demand via VR / AR-capable devices, all information and tools needed for immersive interventions needed for maintenance, troubleshooting, and service are truly at the fingertips of the data center operator.

[0095] According to embodiments, the use of VR / AR devices provides additional dimensions to the data center operator and eliminates the need for data center operators to travel long distances to and from headquarters. For example, the VR / AR features enable data center operators to overlay physical information with virtual information and take action based on those information not only on-site but also in a continuous operating mode. They will no longer operate in a warning-based interruption-driven mode.

[0096] Figure 14 An example of a VR / AR (computer) device that can be provided as a VR / AR headset according to embodiments is illustrated.

[0097] As Figure 14 illustrated, according to embodiments, one or more, or multiple visualizations associated with cloud infrastructure or data center environment physical devices can be displayed in the VR / AR (computer) device.

[0098] Figure 15 An example system for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services according to embodiments is further illustrated.

[0099] As Figure 15 illustrated, according to embodiments, a VR / AR framework can receive real-time (or near real-time) signals, metrics, analytics, or other data from or associated with physical data center equipment, servers, racks, sensors, or other devices, and receive other information or data via a data aggregation layer or component. The system can be accessed via a VR / AR (computer) device, such as a VR / AR headset that includes sensors that measure the location, orientation, and movement of the data center operator within the data center environment.

[0100] Figure 16 An example system for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services according to embodiments is further illustrated.

[0101] As Figure 16 illustrated, according to embodiments, when a data center operator is working within a cloud infrastructure or data center environment, using VR / AR-enabled interactions, the VR / AR (computer) device can display visualizations associated with the physical data center environment.

[0102] Figure 17 Further examples of example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services, according to embodiments, are illustrated.

[0103] like Figure 17 As shown, according to an embodiment, the visualization display may include an elevation view of the rack, blade, slot or other data center equipment to be inspected, or an overlay on the elevation view.

[0104] Figure 18 Further examples of example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services, according to embodiments, are illustrated.

[0105] like Figure 18 As shown, according to various embodiments, other types of VR / AR computer devices may be used, such as, for example, tablet or cushion-shaped computer devices or smartphones, wherein the visualization display may include an elevation view of the rack, blade, slot or other data center device to be inspected, or an overlay on the elevation view.

[0106] Figure 19 Further examples of example systems for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services, according to embodiments, are illustrated.

[0107] like Figure 19 As shown, according to an embodiment, the visualization may include, for example, data center analytics and insights that can be used to improve data center health diagnostics and predictions.

[0108] Figure 20 The following illustrations illustrate a process for using virtual reality and / or augmented reality in conjunction with data center operations and cloud infrastructure services, according to embodiments.

[0109] like Figure 20 As shown, according to an embodiment, the process or method may include, in step 260, providing a VR / AR framework that enables the use of virtual reality and / or augmented reality with data center operations and cloud infrastructure services.

[0110] In step 262, the VR / AR framework receives real-time (or near-real-time) signals from physical data center equipment, servers, racks, sensors, or other physical devices, and receives other information or data via a data aggregation layer or component.

[0111] In step 264, the system is accessible via a VR / AR device that includes sensors that measure the location, orientation, and movement of data center operators within the cloud infrastructure or data center environment.

[0112] At step 266, while the data center operator is working within the cloud infrastructure or data center environment, the VR / AR device displays visualizations or other information associated with physical devices of the cloud infrastructure or data center environment.

[0113] Technical Advantages

[0114] Examples of various technical advantages provided by the AR / VR methods as described herein include that, according to embodiments, the data center operator can, for example:

[0115] Instantly access the problem site and zoom in, for example, on the problem server or port.

[0116] Accurately identify the fine-grained location of the FRU that is problematic.

[0117] Log into the device as needed to immediately initiate a troubleshooting sequence from his / her AR-enabled device.

[0118] Compare last known good vs. bad state, read signatures and past events from the FRU, e.g., Integrated Lights Out Manager (ILOM) messages, rack power distribution unit (rPDU) information, and then take the necessary follow-up steps on-site.

[0119] Obtain detailed assessments of the rack and surrounding environment that are not part of any alerts, and feed that information back into the system, or produce alerts in real-time (or near real-time) when a problem is detected or the system becomes aware of an impending failure pattern.

[0120] Trigger a switch in the switch to a redundant device or a different path for traffic to ensure uninterrupted traffic flow.

[0121] Initiate changes in repair / maintenance workflows based on observations and use of runbooks.

[0122] Run scripts for diagnostic / repair / restoration / verification work.

[0123] Verify the status of amber light indicators up close and any discrepancies with the device, and compare what the internal machine reports as green / amber (both light states, real and false light status) in the VR / AR state.

[0124] Perform shutdowns, disconnects, connections, and restarts before or after many of the above sequences have been initiated, and use the VR / AR-enabled device to initiate and complete sequences of power-on and rack boot-up steps.

[0125] Using AR to optimize the work performed by data center operators, including minimizing touch points with AR device capabilities.

[0126] Easily identify contextual differences between asset information visible to them in the facility and asset information recorded in the central system, and drive auditable corrective updates.

[0127] For on-hand operations, prioritize contextual information available in the facility over conflicting information provided by the central facility and asset information systems.

[0128] Optimize workflows for receiving new assets within the data center for alignment within, for example, data center infrastructure management (DCIM) and / or asset management services.

[0129] Use of VR / AR in providing data center analytics

[0130] According to embodiments, the addition of data center analytics and insights can also be used, for example, to improve data center health diagnostics and predictions.

[0131] For example, according to embodiments, while walking around the data center hall and cages, a data center operator can gather insights about typical data center parameters, such as: rack temperature, server and port blades, temperature, rack level power consumption, power supply usage, surges, outages, SLA violations on dropped packets or frames, cable cuts or faults, hardware faults (including field replaceable unit (FRU) faults), spikes in traffic, or power outages. Many of these are continuously monitored via dashboards upstream in the centralized command center, while some are local to the data center.

[0132] According to embodiments, a data center operator can integrate SNMP or streaming telemetry from the physical data center space, and feed the information for analysis (both health diagnostics and long term predictions).

[0133] Within the VR / AR space, a data center operator can review dashboards on demand, see trends, estimate health and status, and use specific AR configured execution menus to launch some maintenance steps.

[0134] Having this analytics information can enhance the overall awareness of the surrounding environment, such as when some localized areas within the data center start showing signs of rising temperatures due to an impending equipment malfunction or poor air circulation or obstruction of cool air to some racks. This type of information is typically not available in a warning-based intervention state.

[0135] Additionally, the use of AR / VR analysis based information gathering enables data center operators to learn about problems by walking around the data center while wearing AR / VR enabled devices, and / or information can be collected during routine walk-throughs and provided as almost continuous dumps into a streaming collector.

[0136] According to embodiments, AR / VR and analytics methods can be used to assist in the remote management of data centers. A virtual representation of the physical data center space, where all details about the deployed fleet are available (both from a local sense and a global perspective across all data centers), enables remote management, enabling off-site engineers to assess, monitor, and troubleshoot data center problems either independently or in cooperation with on-site operators.

[0137] According to various embodiments, the teachings herein can be conveniently implemented using one or more conventional general purpose or specialized computing devices, machines, or microprocessors, including one or more processors, memories, and / or computer readable media programmed according to the teachings of the present disclosure. As will be readily apparent to those skilled in the software art, the present teachings can be readily implemented in software using object-oriented programming techniques, procedure programming techniques, and / or artificial intelligence techniques.

[0138] In some embodiments, the teachings herein can include a computer program product which is a non-transitory computer readable storage medium having instructions stored thereon / in which can be used to program a computer to implement any of the processes of the present teachings. Examples of such a storage medium can include, but are not limited to, a hard disk drive, a hard disk, a hard drive, a fixed disk, or other electromechanical data storage device, a floppy diskette, an optical disk, a DVD, a CD-ROM, a microdrive, and a magneto-optical disk, ROM, RAM, EPROM, EEPROM, DRAM, VRAM, flash memory devices, a magnetic or optical card, nanosystems, or other types of storage media or memory devices suitable for storing instructions and / or data.

[0139] The foregoing description is provided for purposes of illustration and description. It is not intended to be exhaustive or to limit the scope of the disclosure to the precise form disclosed. Many modifications and variations are possible in light of this disclosure.

[0140] Embodiments were chosen and described in order to best illustrate principles of the teachings and their practical application to thereby enable others skilled in the art to best utilize various embodiments and with various modifications as are suited to the particular use contemplated. It is intended that the scope of the teachings be defined by the claims and their equivalents.

Claims

1. A system for using virtual reality (VR) and / or augmented reality (AR) with data center operations and cloud infrastructure services, comprising: a VR / AR framework provided within a data center, the VR / AR framework enabling the use of virtual reality and / or augmented reality with data center operations and cloud infrastructure services; a data aggregation layer or component that enables the receipt of data or information associated with physical data center equipment from sources including one or more of a ticket tracking system database, a data center layout database, or a knowledge management database, and enables the transmission of data between the data center and other locations via a network or cloud to transmit information to and / or receive assistance from one or more remote data center experts; wherein the VR / AR framework receives real-time or near real-time signals from physical data center equipment, servers, racks, sensors, or other physical devices, and receives other information or data via the data aggregation layer or component; wherein the system is accessible via a VR / AR device that includes sensors that measure the location, position, and movement of a data center operator within a cloud infrastructure or data center environment; and wherein the system operates in a dynamic manner, including information displayed that can be updated in real-time or near real-time to reflect what the data center operator sees, wherein the VR / AR device displays visualizations or other information associated with physical devices of the cloud infrastructure or data center environment as the data center operator works within the cloud infrastructure or data center environment, including information from other sources that are useful for performing data center operations where appropriate.

2. The system of claim 1, wherein the visualizations include a displayed elevation view of racks, blades, slots, or other physical devices of a data center being examined.

3. The system of claim 1, wherein the information includes data center related analytics that describe problems that have occurred with particular data center components.

4. The system of claim 1, wherein the information is gathered from a plurality of other systems or sources and then filtered or otherwise processed to provide focused information to the data center operator.

5. A method for using virtual reality and / or augmented reality with data center operations and cloud infrastructure services, comprising: providing a VR / AR framework within a data center, the VR / AR framework enabling the use of virtual reality and / or augmented reality with data center operations and cloud infrastructure services; wherein the VR / AR framework receives real-time or near real-time signals from physical data center equipment, servers, racks, sensors, or other physical devices, and receives other information or data via a data aggregation layer or component that enabling receipt of data or information associated with physical data center equipment from sources including one or more of a ticket tracking system database, a data center layout database, or a knowledge management database, and enabling data to be communicated between the data center and other locations via a network or cloud to communicate information to and / or receive assistance from one or more remote data center experts; wherein the system is accessible via a VR / AR device that includes sensors that measure the location, position, and movement of a data center operator within a cloud infrastructure or data center environment; and wherein the system operates in a dynamic manner, including information displayed that can be updated in real-time or near real-time to reflect what the data center operator sees, displays at the VR / AR device visualizations or other information associated with physical equipment of the cloud infrastructure or data center environment as the data center operator works within the cloud infrastructure or data center environment, including information from other sources as appropriate that are useful to perform data center operations.

6. The method of claim 5, wherein the visualizations include a displayed elevational view of racks, blades, slots, or other physical equipment of the data center being examined.

7. The method of claim 5, wherein the information includes data center related analytics that describe problems that have occurred with particular data center components.

8. The method of claim 5, wherein the information is gathered from a plurality of other systems or sources and then filtered or otherwise processed to provide focused information to the data center operator.

9. A non-transitory computer readable storage medium comprising instructions stored thereon that, when read and executed by one or more computers, cause the one or more computers to perform a method comprising: providing a VR / AR framework within a data center that enables virtual reality and / or augmented reality to be used with data center operations and cloud infrastructure services; wherein the VR / AR framework receives real-time or near real-time signals from physical data center equipment, servers, racks, sensors, or other physical equipment, and receives other information or data via a data aggregation layer or component that enables receipt of data or information associated with physical data center equipment from sources including one or more of a ticket tracking system database, a data center layout database, or a knowledge management database, and enables data to be communicated between the data center and other locations via a network or cloud to communicate information to and / or receive assistance from one or more remote data center experts; wherein the system is accessible via a VR / AR device that includes sensors that measure the location, position, and movement of a data center operator within a cloud infrastructure or data center environment; and wherein the system operates in a dynamic manner, including information displayed that can be updated in real-time or near real-time to reflect what the data center operator sees, displays at the VR / AR device visualizations or other information associated with physical equipment of the cloud infrastructure or data center environment as the data center operator works within the cloud infrastructure or data center environment, including information from other sources as appropriate that are useful to perform data center operations. wherein the system operates in a dynamic manner, including information displayed that can be updated in real-time or near real-time to reflect what the data center operator sees as the data center operator works within the cloud infrastructure or data center environment, displays at the VR / AR device visualizations or other information associated with physical devices of the cloud infrastructure or data center environment, including in appropriate cases information from other sources useful for performing data center operations.

10. The non-transitory computer readable storage medium of claim 9, wherein the visualizations include a displayed isometric view of racks, blades, slots, or other physical devices of a data center being inspected.

11. The non-transitory computer readable storage medium of claim 9, wherein the information includes data center related analytics that describe problems that have occurred with particular data center components.

12. The non-transitory computer readable storage medium of claim 9, wherein the information is gathered from a plurality of other systems or sources and then filtered or otherwise processed to provide focused information for the data center operator.

Citation Information

Patent Citations

  • Virtual reality and augmented reality for industrial automation

    CN108073277A

  • Data center operation and maintenance management device and system

    CN108833141A