Human-computer interaction system and method for data center, and device
Through the human-computer interaction system in the data center, the perception and data processing unit is used to identify interactive actions, perform action feature matching and display control, which solves the problem of complex display screen operation and improves operation and maintenance efficiency and experience.
Patent Information
- Application Number
- PCT/CN2024/109208
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-27
- Filing Date
- 2024-08-01
- Publication Date
- 2025-10-02
AI Technical Summary
The human-computer interaction on the display screens in data centers is complex and inconvenient, resulting in low operation and maintenance accuracy and efficiency, and a poor human-computer interaction experience.
A human-computer interaction system for a data center is provided, which includes a perception and data processing unit, a feature matching unit, an interface construction unit, and a display unit. By perceiving the action feature information of the interaction object, action matching and display screen control are performed, thereby simplifying the human-computer interaction process.
It improves the accuracy and efficiency of the operation and maintenance process, enhances the human-computer interaction experience, and realizes flexible display screen switching and rich operation and maintenance information presentation.
Smart Images

Figure CN2024109208_02102025_PF_FP_ABST
Abstract
Description
Human-computer interaction system, method and equipment for data center
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on March 27, 2024, with application number 202410371901.5 and invention name “Human-computer interaction system, method and equipment for data center”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of information technology, and in particular to a human-computer interaction system, method, and device for a data center. Background Art
[0003] As the variety and number of devices in data centers continue to increase, users need to access data center ...
[0004] For example, currently, there are several common approaches to addressing the difficulty of operating large screens or switching display content: one is to use polling to display different information screens; another is to control switching via a mouse or keyboard; and yet another is to use a large touchpad or touch-sensitive device in combination with the screen. The first approach makes it difficult for users to flexibly change or interact with the display locally; the second approach is difficult to deploy and use on-site due to limited space in the equipment room and near the screen, and lack of comfortable operating space for personnel; the third approach is costly due to its wide touch range. It cannot touch areas beyond the human touch range in height and width, and the restricted area increases with screen size. Touching the screen at close range can cause visual discomfort and a poor user experience.
[0005] It can be seen that the relevant solutions have the problem of complex and inconvenient human-computer interaction. The operation and maintenance process cannot effectively present key information or proprietary information, and cannot respond to alarms and troubleshoot faults in a timely manner, resulting in low operation and maintenance accuracy and efficiency, and a poor human-computer interaction experience.
[0006] Summary of the Invention
[0007] The present application provides a human-computer interaction system, method and equipment for a data center, which is used to solve the technical problems in the prior art that the human-computer interaction of display screens in data centers is complex and inconvenient, resulting in low operation and maintenance accuracy and efficiency, and poor human-computer interaction experience.
[0008] In a first aspect, the present application provides a human-computer interaction system for a data center, comprising: a communication connection perception and data processing unit, a feature matching unit, an interface construction unit, and a display unit;
[0009] The sensing and data processing unit is used to obtain the interactive action of the interactive object and determine the action feature information of the interactive action;
[0010] The feature matching unit is configured to perform action matching based on the action feature information and preset feature information to obtain a feature matching result, wherein the preset feature information is obtained by calculating the action features of a preset interactive action;
[0011] The interface construction unit is used to determine interface information according to the feature matching result, wherein the interface information includes a display screen and a specified action, and the specified action has a corresponding relationship with the display screen;
[0012] The display unit is configured to present the display screen corresponding to the designated action according to the designated action.
[0013] In one possible design, the perception and data processing unit includes: a perception module and a data processing module;
[0014] The perception module is used to detect the posture information of the interactive object to perceive the interactive action according to the posture information;
[0015] The data processing module is used to perform the action feature calculation on the interactive action to obtain the action feature information.
[0016] In a possible design, the perception module and the data processing module are separate modules or integrated modules.
[0017] In one possible design, the perception module includes at least one of an infrared detector, a camera device, and a radar.
[0018] In one possible design, the camera device includes dual lenses or multiple lenses; the radar includes a millimeter wave radar or a laser radar.
[0019] In one possible design, the preset interaction action includes a user preset action and / or a big data interaction action, and the big data interaction action is obtained according to a default action database.
[0020] In one possible design, the preset interactive action includes at least one of a user gesture, a user body posture, or a user facial expression.
[0021] In one possible design, the display screen includes at least one or more of a home page screen, an operation and maintenance page, an alarm page, a power consumption ratio display page, and a power distribution status of the data center;
[0022] The designated action includes at least one or more of separating the hands, opening the hands, sliding the upper limbs, making a fist with one hand, raising the thumb, or user-defined actions.
[0023] In one possible design, the human-computer interaction system is an integrated display screen including the perception and data processing unit, the feature matching unit, the interface construction unit, and the display unit.
[0024] In a second aspect, the present application provides a human-computer interaction method for a data center, which is applied to any possible human-computer interaction system provided in the first aspect, wherein the human-computer interaction system includes a communication-connected perception and data processing unit, a feature matching unit, an interface construction unit, and a display unit; the method includes:
[0025] The sensing and data processing unit acquires the interactive action of the interactive object and determines action feature information of the interactive action;
[0026] The feature matching unit performs action matching based on the action feature information and preset feature information to obtain a feature matching result, wherein the preset feature information is obtained by calculating the action features of a preset interactive action;
[0027] The interface construction unit determines interface information according to the feature matching result, wherein the interface information includes a display screen and a designated action, and the designated action corresponds to the display screen;
[0028] The display unit presents the display screen corresponding to the designated action according to the designated action.
[0029] In a third aspect, the present application provides an electronic device, comprising: a processor, and a memory communicatively connected to the processor;
[0030] The memory stores computer-executable instructions;
[0031] The processor executes the computer-executable instructions stored in the memory to implement the possible human-computer interaction method for a data center provided in the second aspect.
[0032] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the possible human-computer interaction method of the data center provided in the second aspect.
[0033] In a fifth aspect, the present application provides a computer program product, comprising computer-executable instructions, which, when executed by a processor, are used to implement the possible human-computer interaction method for a data center provided in the second aspect.
[0034] The present application provides a human-computer interaction system, method, and device for a data center, the human-computer interaction system comprising a communication-connected perception and data processing unit, a feature matching unit, an interface construction unit, and a display unit. The perception and data processing unit can obtain an interactive action of an interactive object and determine action feature information based on the interactive action. The feature matching unit can match the action feature information with preset feature information to obtain a feature matching result. The preset feature information is obtained by calculating the action feature of the preset interactive action. The interface construction unit can determine interface information based on the feature matching result. The interface information includes a display screen and a specified action, and the specified action has a corresponding relationship with the display screen. The display unit can present the display screen corresponding to the specified action according to the specified action. The human-computer interaction system for a data center provided in an embodiment of the present application identifies the interactive action by the perception and data processing unit to determine the action feature information. The feature matching unit matches the action feature information with the preset feature information to a feature matching result corresponding to the interactive action. The interface construction unit determines the display screen and the specified action corresponding to the display screen based on the feature matching result. The display unit then presents the display screen corresponding to the specified action according to the specified action. The human-computer interaction process is simple, convenient, and effective in presenting the screen content during the operation and maintenance process, greatly improving the on-site operation and maintenance efficiency and interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0036] FIG1 is a schematic diagram of the structure of a human-computer interaction system for a data center provided by an embodiment of the present application;
[0037] FIG2 is a schematic diagram of interactive actions and display screen switching provided by an embodiment of the present application;
[0038] FIG3 is a schematic diagram of a display screen effect provided by an embodiment of the present application;
[0039] FIG4 is a schematic diagram of another display screen effect provided by an embodiment of the present application;
[0040] FIG5 is a flow chart of a human-computer interaction method for a data center provided in an embodiment of the present application;
[0041] FIG6 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0042] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of methods and apparatus consistent with certain aspects of the present application, as detailed in the appended claims.
[0043] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the numbers used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can, for example, be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0044] Currently, there are several common approaches to addressing the difficulty of operating large screens or switching display content: one is to use polling to display different information screens; another is to control switching via a mouse or keyboard; and yet another is to use a large touchpad or touch-sensitive device in combination with the screen. The first solution makes it difficult for users to flexibly change or interact with the display locally; the second solution is difficult to deploy and use on-site due to limited space in the computer room and near the screen, and the lack of comfortable operating space for personnel; the third solution is expensive due to the large touch range, and areas outside the human touch range cannot be touched in height and width. Furthermore, the restricted area increases with screen size, and close contact in front of the screen can cause visual discomfort and a poor user experience. As can be seen, these solutions suffer from complex and inconvenient human-computer interaction. The operation and maintenance process cannot effectively present key or proprietary information, and cannot respond to alarms and troubleshoot problems in a timely manner, resulting in low operation and maintenance accuracy and efficiency, and a poor human-computer interaction experience.
[0045] In response to the above-mentioned problems existing in the prior art, the present application provides a human-computer interaction system, method and equipment for a data center. The inventive concept of the human-computer interaction system for a data center provided by the present application is that: first, the perception and data processing unit in the human-computer interaction system collects the interactive actions of the interactive objects and determines the action feature information of the interactive actions, and then the feature matching unit in the human-computer interaction system matches the action feature information based on the preset feature information to obtain the feature matching result, and then the interface construction unit in the human-computer interaction system determines the corresponding display screen and its specified action based on the feature matching result, so that the display unit in the human-computer interaction system presents the display screen corresponding to the specified action according to the specified action, thereby realizing the control of the display unit presenting and switching the display screen based on the interactive action, simplifying the complexity of human-computer interaction and increasing the convenience, and can enrich the operation and maintenance information that can be presented on the display screen, thereby improving the efficiency and accuracy of the maintenance and management work of the data center and the interactive experience.
[0046] Figure 1 is a schematic diagram of the structure of a human-computer interaction system for a data center provided in an embodiment of the present application. As shown in Figure 1, the human-computer interaction system 10 for a data center provided in an embodiment of the present application may include: a perception and data processing unit 11, a feature matching unit 12, an interface construction unit 13, and a display unit 14.
[0047] Among them, the perception and data processing unit 11, the feature matching unit 12, the interface construction unit 13 and the display unit 14 are communicatively connected.
[0048] In one possible design, the perception and data processing unit 11 may include a perception module 111 and a data processing module 112. The perception module 111 may detect the posture information of the interactive object, and then perceive the interactive action of the interactive object based on the posture information, so that the perception and data processing unit 11 obtains the interactive action of the interactive object. The data processing module 112 may perform motion feature calculations on the interactive action to obtain motion feature information. In other words, the data processing module 112 may perform computational analysis on the motion data of the interactive action to calculate and analyze the motion feature information indicating the interactive action. The data processing module 112 performs motion feature calculations so that the perception and data processing unit 11 can determine the motion feature information of the interactive action.
[0049] Among them, the action feature calculation is the corresponding algorithm that can calculate and analyze the action data of interactive actions, such as the behavior recognition method based on unsupervised learning, the behavior recognition method based on convolutional neural network, or the behavior recognition method based on recurrent neural network and some extended models, etc. The specific content of the algorithm is not limited in the embodiments of this application.
[0050] In some embodiments, the perception module 111 and the data processing module 112 can be separate modules or integrated modules. A separate module means that the perception module 111 and the data processing module 112 are physically separate devices, while an integrated module means that the perception module 111 and the data processing module 112 are physically integrated devices. The embodiments of the present application do not limit the physical form of the perception module 111 and the data processing module 112.
[0051] In one possible design, the sensing module 111 may include at least one of an infrared detector, a camera, and a radar. The camera may include a dual-lens or multi-lens camera, and the radar may include a millimeter-wave radar or a laser radar. The embodiments of the present application do not limit the specific forms of the camera and radar.
[0052] In some embodiments, the interactive object may include an operation and maintenance personnel, and the interactive action of the interactive object may include at least one of a user gesture, a user body posture, or a user facial expression. The posture information of the interactive object detected by the perception module 111 may include posture changes presented by the interactive object, and the posture changes may be caused by the gestures, body postures, facial expressions, etc. of the interactive object. In one possible design, the perception module 11 may be a non-contact perception device, for example, a corresponding perception device capable of obtaining the movement coordinates of a human hand in a human-computer interaction system.
[0053] As shown in Figure 1, the perception and data processing unit 11 is communicatively connected with the feature matching unit 12. The action feature information of the interactive action determined by the perception and data processing unit 11 will be transmitted to the feature matching unit 12. The feature matching unit 12 will perform action matching on the received action feature information and the preset feature information stored therein, so as to match the target feature information corresponding to the interactive action from the preset feature information, that is, to obtain the feature matching result.
[0054] The preset feature information includes action feature information obtained by calculating the action features of preset interactive actions. Preset interactive actions may include user preset actions and / or big data interactive actions. User preset actions are actions customized according to the interactive behavior habits of operation and maintenance personnel. User preset actions may be at least one of user gestures, user body postures, or user facial expressions derived from the gesture habits, body posture habits, or facial expression habits of users such as operation and maintenance personnel. Big data interactive actions are obtained based on a default action database, which stores a large number of various actions such as user gestures, user body postures, or user facial expressions.
[0055] From the above description, it can be seen that the feature matching result is actually the action matching of the feature matching unit 12, which matches the action feature information corresponding to the interactive action from the preset feature information based on the action feature information of the interactive action, and defines the matched action feature information as the target feature information, and the preset feature information includes the target feature information.
[0056] In actual working conditions, the feature matching unit 12 can perform action matching through fuzzy matching, and the accuracy of fuzzy matching can be set according to the interaction accuracy requirements of the actual working conditions. The embodiment of the present application does not limit the specific content of the accuracy.
[0057] Continuing with reference to Figure 1, the feature matching unit 12 is in communication with the interface construction unit 13. The feature matching unit 12 transmits the feature matching result to the interface construction unit 13. The interface construction unit 13 obtains the interface information corresponding to the target feature information based on the feature matching result. The interface information includes the action corresponding to the target feature information and the display screen corresponding to the action. Since the target feature information is the action feature information matched from the preset feature information, and the preset feature information is the action feature information obtained by calculating the action feature of the preset interactive action, the target feature information corresponds to an action in the preset interactive action. The action corresponding to the target feature is the action in the interface information. The action is defined as a designated action. In other words, the designated action is the corresponding action of the target feature information in the preset interactive action. Based on the source of the preset interactive action, it can be determined that the designated action comes from the interactive behavior habits of the operation and maintenance personnel and / or the default action database.
[0058] In addition, the designated action has a corresponding relationship with its display screen, that is, the designated action corresponds to its own display screen, and the designated action is obtained based on the interactive action matching of the interactive object. Therefore, the interactive object can switch the display screen by changing the interactive action.
[0059] For example, the specified action may include at least one or more of the following: spreading the hands, opening the hands, sliding the upper limbs, clenching a fist, raising the thumb, or user-defined actions. The display screen may include at least one or more of the following: the home page of the data center, the operation and maintenance page, the alarm page, the power consumption ratio display page, and the power distribution status. It should be noted that the specific content of the specified action and the display screen is only for illustrative purposes and is not intended to limit it. In actual working conditions, the specified action and display screen may include more other actions or content according to actual conditions.
[0060] The correspondence between the specified action and the display screen can be mapped by itself, and this embodiment of the present application does not limit this. For example, the specified action is to separate the hands, and the corresponding display screen is the home page screen, that is, when the specified action matched by the interactive action is to separate the hands, the home page screen is displayed; the display screen corresponding to the specified action of sliding the right arm left and right is to turn the pages up and down; the display screen corresponding to the specified action of making a fist with one hand is an alarm page, that is, when the specified action matched by the interactive action is to make a fist with one hand, the alarm page is presented; the display screen corresponding to the specified action of putting up the thumbs up is the power consumption ratio display page, and the power consumption ratio display page is, for example, the power consumption ratio (Power Usage Effectiveness) interface; the display screen corresponding to the specified action of opening both hands is the power distribution status to present the power distribution line status, which is convenient for operation and maintenance fault diagnosis. In addition, the specified action can also be a user-defined action, or a combination of multiple actions, to achieve polling, aggregation and other presentation effects of different display screens, and this embodiment of the present application does not limit this.
[0061] Furthermore, the interface construction unit 13 is in communication with the display unit 14 , and the interface construction unit 13 transmits the determined interface information to the display unit 14 . The display unit 14 reads the interface information to present a display screen corresponding to the specified action to the interactive object according to the specified action.
[0062] In some embodiments, the display unit 14 includes a terminal screen having a screen display function. Furthermore, the display unit 14 may be a terminal that receives external video signal input, or may have its own processing and graphic display capabilities, so that it can achieve display screen switching by simply communicating with the perception module 111 or the feature matching unit 12. The specific form of the display unit 14 is not limited in this embodiment of the present application.
[0063] The accompanying figure shown in FIG1 illustrates the human-computer interaction system 10 from a functional perspective. In some embodiments, the human-computer interaction system can also be an integrated screen including a camera, or a screen including a perception module, such as a screen with a built-in camera and / or radar device. In actual working conditions, the human-computer interaction system 10 can be an integrated display screen including the functions of a perception and data processing unit, a feature matching unit, an interface construction unit, and a display unit. The embodiments of the present application do not limit the specific form of the human-computer interaction system 10.
[0064] Through the description of the above embodiments, it can be seen that the human-computer interaction system of the data center provided by the embodiment of the present application includes a perception and data processing unit, a feature matching unit, an interface construction unit and a display unit connected in communication. Among them, the perception and data processing unit can obtain the interactive action of the interactive object and determine the action feature information according to the interactive action. The feature matching unit can match the action feature information with the preset feature information to obtain the feature matching result. The preset feature information is obtained by calculating the action feature of the preset interactive action. The interface construction unit can determine the interface information according to the feature matching result. The interface information includes a display screen and a specified action. The specified action has a corresponding relationship with the display screen. The display unit can present the display screen corresponding to the specified action according to the specified action. The perception and data processing unit identifies the interactive action to determine the action feature information. The feature matching unit matches the action feature information with the preset feature information to the feature matching result corresponding to the interactive action. The interface construction unit determines the display screen and the specified action corresponding to the display screen based on the feature matching result. Then, the display unit presents the corresponding display screen according to the specified action. The human-computer interaction process is simple, convenient and effective in presenting the screen content during the operation and maintenance process, greatly improving the on-site operation and maintenance efficiency and interactive experience.
[0065] The human-computer interaction system of the data center provided in the embodiment of the present application can perceive, identify and output the display screen matched by the interaction action to the display screen through the entire interaction action of the perception module, display screen and other components. The data center can be equipped with a system that controls and matches the display screen through the perception of interaction actions. Users such as operation and maintenance personnel can flexibly customize preset interaction actions to correspond to the content to be presented on the display screen, and operation and maintenance personnel can flexibly customize the accuracy of action feature matching to control the interaction accuracy. Figure 2 is a schematic diagram of the interaction action of the operation and maintenance personnel 101 of the data center 100 provided in the embodiment of the present application and the switching of the display screen of the display unit 102.
[0066] In addition, as described above, the specified action can also be a combination of multiple actions to achieve presentation effects such as combination, polling, and aggregation of different display screens. Specifically, different specified actions can be combined to form a combination corresponding to different display screens. For example, Figure 3 is a screen combination between A home page screen, B device management section, C energy consumption analysis section, D environmental information section, and E alarm page section. By changing the specified action of the combination, you can switch to the screen combination between A' device management section, B' home page screen, and C' AI group control section as shown in Figure 4. It can be seen that users can customize the combination of different corresponding screens for display through the free combination of specified actions, thereby enriching the interface display content, increasing the flexibility of the display screen, facilitating the free switching of the display screen, and also adding the function of user-defined interface, improving the user's ability to customize independently. It should be noted that the screen content shown in Figures 3 and 4 is only shown by way of example and is not a limitation on the content of the display screen. In addition, for example, some screen panels in Figures 3 and 4 can be one or more of the home page screen, operation and maintenance page, alarm page, power consumption ratio display page and power distribution status in the above-mentioned display screens, or they can be part of the screen content included in these display screens. The embodiments of the present application do not limit the specific content of the display screen.
[0067] In actual working conditions, the human-computer interaction system of the data center provided in the embodiment of the present application can be built and deployed in the monitoring system of the data center. The embodiment of the present application does not limit the specific deployment of the human-computer interaction system in the data center.
[0068] Figure 5 is a flow chart of a human-computer interaction method for a data center provided in an embodiment of the present application. This human-computer interaction method can be applied to the human-computer interaction system for a data center provided in the above embodiment, wherein the human-computer interaction system includes a communication-connected perception and data processing unit, a feature matching unit, an interface construction unit, and a display unit. As shown in Figure 5, the human-computer interaction method for a data center provided in an embodiment of the present application includes the following steps S101, S102, S103, and S104.
[0069] S101: The perception and data processing unit obtains the interactive action of the interactive object and determines action feature information of the interactive action.
[0070] In one possible design, the perception and data processing unit may include a perception module and a data processing module. The perception module may detect the posture information of an interactive object and, based on the posture information, perceive the interactive action of the interactive object, allowing the perception and data processing unit to obtain the interactive action of the interactive object. The data processing module may calculate the action characteristics of the interactive action to obtain action characteristic information, allowing the perception and data processing unit to determine the action characteristic information of the interactive action.
[0071] S102: The feature matching unit performs action matching based on the action feature information and preset feature information to obtain a feature matching result.
[0072] The preset feature information is obtained by calculating the action features of the preset interactive action.
[0073] The perception and data processing unit is communicatively connected to the feature matching unit. The action feature information of the interactive action determined by the perception and data processing unit will be transmitted to the feature matching unit. The feature matching unit will perform action matching on the received action feature information and the preset feature information stored therein, so as to match the target feature information corresponding to the interactive action from the preset feature information and obtain the feature matching result.
[0074] S103: The interface construction unit determines the interface information according to the feature matching result.
[0075] The interface information includes the display screen and the specified action.
[0076] The feature matching unit is in communication with the interface construction unit. The feature matching unit transmits the feature matching results to the interface construction unit. The interface construction unit obtains interface information corresponding to the target feature information based on the feature matching results. The interface information includes the action corresponding to the target feature information and the display screen corresponding to the action. The action corresponding to the target feature is the action in the interface information, and the action is defined as the designated action.
[0077] The designated action and the display screen have a corresponding relationship, that is, the designated action corresponds to its own display screen.
[0078] S104: The display unit presents a display screen corresponding to the designated action according to the designated action.
[0079] The interface construction unit is in communication with the display unit. The interface construction unit transmits the determined interface information to the display unit. The display unit reads the interface information and presents a display screen corresponding to the specified action to the interactive object according to the specified action.
[0080] The human-computer interaction method for a data center provided in an embodiment of the present application is applied to a human-computer interaction system of a data center. Through the interaction between a sensing and data processing unit, a feature matching unit, an interface construction unit, and a display unit in the human-computer interaction system, the sensing and data processing unit can sense the interactive action of the interactive object to identify the action feature information of the interactive action, and then the feature matching unit matches the action feature information with the preset feature information to obtain the feature matching result corresponding to the interactive action. Then, the interface construction unit determines the display screen and the designated action corresponding to the display screen based on the feature matching result, and finally, the display unit presents the corresponding display screen according to the designated action. Since the preset feature information is obtained by calculating the action features of the preset interactive action, and the preset interactive action can be customized according to the interactive behavior habits of the operation and maintenance personnel, and the designated action determined by the interactive action has a corresponding relationship with the display screen, and the designated action is matched from the preset interactive action, the human-computer interaction method provided in the embodiment of the present application can realize the control and switching of the display screen by matching the action features of the customized action, thereby enriching the information of on-site operation and maintenance, making human-computer interaction simple and convenient, and greatly improving the efficiency and accuracy of the maintenance and management work of the data center.
[0081] FIG6 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. As shown in FIG6 , the electronic device 500 provided in an embodiment of the present application may include: a processor 501 and a memory 502 communicatively connected to the processor 501 .
[0082] The memory 502 is used to store programs. Specifically, the programs may include program codes, and the program codes include computer-executable instructions.
[0083] The memory 502 may include a high-speed RAM memory, and may also include a non-volatile memory (NoN-volatile memory), such as at least one disk memory.
[0084] The processor 501 is configured to execute computer-executable instructions stored in the memory 502 to implement the human-computer interaction method for a data center provided in the above embodiment.
[0085] The processor 501 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.
[0086] Optionally, the memory 502 may be independent or integrated with the processor 501. When the memory 502 is a device independent of the processor 501, the electronic device 500 may further include:
[0087] Bus 503 is used to connect processor 501 and memory 502. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. Buses can be categorized as address buses, data buses, control buses, etc., but this does not mean there is only one bus or only one type of bus.
[0088] Optionally, in a specific implementation, if the memory 502 and the processor 501 are integrated on a chip, the memory 502 and the processor 501 can communicate through an internal interface.
[0089] The present application also provides a computer-readable storage medium, which may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, and other media that can store program codes. Specifically, the computer-readable storage medium stores computer-executable instructions, which are used for each step of the method in the above embodiment.
[0090] The present application also provides a computer program product, including computer execution instructions, which implement the method in the above embodiment when executed by a processor.
[0091] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of the present application and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered merely as exemplary, and the true scope and spirit of the present application are indicated by the claims.
[0092] It should be understood that the present application is not limited to the exact structure described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.
Claims
1. A human-computer interaction system for a data center, characterized in that: include: Communication-connected perception and data processing unit, feature matching unit, interface building unit, and display unit; The sensing and data processing unit is used to obtain the interactive action of the interactive object and determine the action feature information of the interactive action; The feature matching unit is configured to perform action matching based on the action feature information and preset feature information to obtain a feature matching result, wherein the preset feature information is obtained by calculating the action features of a preset interactive action; The interface construction unit is used to determine interface information according to the feature matching result, wherein the interface information includes a display screen and a specified action, and the specified action has a corresponding relationship with the display screen; The display unit is configured to present the display screen corresponding to the designated action according to the designated action.
2. The human-computer interaction system according to claim 1, characterized in that: The perception and data processing unit includes: a perception module and a data processing module; The perception module is used to detect the posture information of the interactive object to perceive the interactive action according to the posture information; The data processing module is used to perform the action feature calculation on the interactive action to obtain the action feature information.
3. The human-computer interaction system according to claim 2, characterized in that: The perception module and the data processing module are separate modules or integrated modules.
4. The human-computer interaction system according to claim 2, characterized in that: The perception module includes at least one of an infrared detector, a camera device and a radar.
5. The human-computer interaction system according to claim 4, characterized in that: The camera device includes dual lenses or multiple lenses; the radar includes millimeter wave radar or laser radar.
6. The human-computer interaction system according to any one of claims 1 to 5, characterized in that: The preset interactive actions include user preset actions and / or big data interactive actions, and the big data interactive actions are obtained according to a default action database.
7. The human-computer interaction system according to claim 6, characterized in that: The preset interactive action includes at least one of a user gesture, a user body posture, or a user facial expression.
8. The human-computer interaction system according to claim 7, characterized in that: The display screen includes at least one or more of the home page screen, operation and maintenance page, alarm page, power consumption ratio display page and power distribution status of the data center; The designated action includes at least one or more of separating the hands, opening the hands, sliding the upper limbs, making a fist with one hand, raising the thumb, or user-defined actions.
9. The human-computer interaction system according to claim 1, characterized in that: The human-computer interaction system is an integrated display screen including the perception and data processing unit, the feature matching unit, the interface construction unit and the display unit.
10. A human-computer interaction method for a data center, characterized in that: A human-computer interaction system for a data center according to any one of claims 1 to 9, the human-computer interaction system comprising a communication-connected perception and data processing unit, a feature matching unit, an interface construction unit, and a display unit; the method comprising: The sensing and data processing unit acquires the interactive action of the interactive object and determines action feature information of the interactive action; The feature matching unit performs action matching based on the action feature information and preset feature information to obtain a feature matching result, wherein the preset feature information is obtained by calculating the action features of a preset interactive action; The interface construction unit determines interface information according to the feature matching result, wherein the interface information includes a display screen and a designated action, and the designated action corresponds to the display screen; The display unit presents the display screen corresponding to the designated action according to the designated action.
11. An electronic device, characterized in that: include: a processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the human-computer interaction method for a data center according to claim 10.
Citation Information
Patent Citations
Human-computer interaction control method and device, electronic equipment and storage medium
CN111309153A
Human-computer interaction method and human-computer interaction equipment
CN111722700A
Interactive display method, device and system based on human body postures
CN114296556A
Interaction method and device, electronic equipment and computer storage medium
CN117289788A
Method and system for navigating through a datacenter hierarchy in a mobile computer device
US20160179798A1