AR Virtual Machine Management via Marker Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing AR-based operations management systems for servers cannot allow operation over the video image, and there is a need for a system that can manage virtual machines in a server virtualization environment, which is not adequately addressed by current technologies.

Innovation Solution

A virtual machine management system that includes a video image acquisition unit, a marker information storage device, a display unit, an acceptance unit, and an instruction unit, which recognize machine identifying markers on physical servers, acquire and display information about executable operations, and send operation instructions to the management apparatus, enabling operations on virtual machines displayed on a captured video image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If AR-based operations management systems display information over video images of physical servers, then information visibility is improved, but operational capability is lost

Engineering Contradiction:
Improveinformation visibilityVSAvoidoperational capability
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent introduces a marker information storage device as an intermediary component that stores correspondence between markers and physical servers. This mediator enables the system to bridge the gap between visual information (video images with markers) and operational control (server management functions), allowing both information display and operational capability to coexist.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the operation interface by allowing users to operate on virtual machines represented in the AR display rather than directly on the physical server. The marker identification system segments the physical server space into identifiable regions, enabling virtualized operation interfaces to be superimposed on physical hardware without interfering with each other.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If virtual machine management is performed through traditional management consoles, then operational control is maintained, but spatial awareness and ease of operation are reduced

Engineering Contradiction:
Improvespatial awarenessVSAvoidmanagement interface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent transitions from two-dimensional management console interfaces to three-dimensional spatial interaction through AR. Users can point and operate on virtual machine representations in physical space, adding a spatial dimension to the management interface. This dimensional change improves ease of operation by enabling intuitive spatial awareness while the marker information storage device manages the complexity of mapping between physical and virtual identifiers.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If live migration of virtual machines is implemented, then system flexibility is improved, but mapping information management complexity increases

Engineering Contradiction:
Improvesystem flexibilityVSAvoidmapping information management
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The marker information storage device automatically maintains the correspondence between markers and physical servers without requiring manual intervention. As virtual machines migrate between physical servers, the system self-updates the mapping information stored in the marker information storage device, reducing management complexity while enabling flexible live migration operations.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS8924968B2System and method of managing virtual machine, and control apparatus, method and program
Publication Date: 2014.12.30 NEC CORP
  • US8924968B2 patent drawing
  • US8924968B2 patent drawing
  • US8924968B2 patent drawing

AI summary

A virtual machine management system includes an image capturing unit (30) which captures video image of a physical server (10); a marker information storage unit (102) which stores therein a marker (14) and the physical server (10) associated with each other; a display unit (46) which recognizes the marker (14) from the video image, acquires information regarding executable operations with respect to the physical server (10) and the virtual server (12) from a management apparatus (20), and displays the acquired information on a screen together with the video image of the physical server (10); an identification unit (114) which identifies the physical server (10) based on the marker (14), referring to the marker information storage unit (102); an operation acceptance unit (48) which accepts, on the screen, an operation instruction directed to the physical server (10) and the virtual server (12); and an instruction unit (132) which sends the operation instruction to the management apparatus (20).