Machine room visualization method and device, equipment and storage medium

Through a multi-modal artificial intelligence system, automatically collects and processes computer room data, recognizes equipment features, and builds a visual interface, which solves the problem of low efficiency of traditional manual monitoring and realizes the efficient construction of computer room visual interface.

CN118968270AInactive Publication Date: 2024-11-15SHENZHEN SMARTCITY TECH DEV GRP CO LTD

Patent Information

Application Number
CN202411406712.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-10
Publication Date
2024-11-15
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The existing computer room monitoring methods require manual detection and data processing, resulting in low efficiency in building visual interfaces.

Method used

A multi-modal artificial intelligence system is adopted to collect image data and environmental parameters of the computer room from different angles through the data acquisition module, and an artificial intelligence module is used to identify equipment features and extract information, and a visual monitoring interface is built.

Benefits of technology

It improves the efficiency of building a visual monitoring interface in the computer room, reduces manual intervention, and improves the level of automation of data processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118968270A_ABST
    Figure CN118968270A_ABST
Patent Text Reader

Abstract

The invention discloses a machine room visualization method, device and equipment and a storage medium, and relates to the technical field of artificial intelligence, the machine room visualization method is applied to a multi-modal artificial intelligence system, and the multi-modal artificial intelligence system comprises a data acquisition module, a data processing module and a processing module, the method comprises the steps that first image data and first environment parameters in a target machine room and first equipment operation parameters of first electronic equipment in the target machine room are collected through a data collection module, and the shooting angles of the first image data are different; performing device feature recognition on each first image data to obtain respective target image data of each first image data, wherein the target image data represents first feature information of each target machine room device in the first image data; and constructing a visual monitoring interface of the target machine room based on the target image data, the first environment parameters and the first equipment operation parameters. The construction efficiency of the machine room visual monitoring interface can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence technology, and in particular to a computer room visualization method, device, equipment and storage medium. Background Art

[0002] With the rapid development of information technology and the continuous expansion of data centers, the stability and operation efficiency of computer rooms, as centralized management areas for key IT infrastructure (such as electronic equipment such as servers, network equipment and storage devices, and equipment such as racks and cabinets), have become the key to ensuring business continuity and data security.

[0003] At present, the common computer room monitoring method is mainly for computer room managers to manually measure the volume and identify the model of each key IT infrastructure in the computer room, obtain relevant detection data, and obtain the equipment operation parameters and computer room environment parameters collected by each sensor module installed in the computer room. Then, the detection data and sensor detection data are manually processed to extract useful information, and the useful information is provided to the corresponding visualization system to generate a visual monitoring interface. However, in this visualization solution, the data collection and data processing process are performed manually, resulting in the problem of low efficiency in building the computer room visualization interface.

[0004] Therefore, how to improve the efficiency of building the visual monitoring interface of the computer room is a problem that needs to be solved urgently. Summary of the invention

[0005] The main purpose of this application is to provide a computer room visualization method, device, equipment and storage medium, aiming to improve the efficiency of building a computer room visualization monitoring interface.

[0006] To achieve the above-mentioned purpose, the present application provides a computer room visualization method, the computer room visualization method comprising: the computer room visualization method is applied to a multimodal artificial intelligence system, the multimodal artificial intelligence system comprises a data acquisition module, and the computer room visualization method comprises: Collecting, by the data acquisition module, first image data and first environmental parameters in the target computer room, and first device operating parameters of first electronic devices in the target computer room, wherein the first image data are shot at different angles; Performing device feature recognition on each of the first image data to obtain target image data of each of the first image data, wherein the target image data represents first feature information of each target computer room device in the first image data; A visual monitoring interface of the target computer room is constructed based on each of the target image data, the first environmental parameters and each of the first equipment operating parameters.

[0007] In one embodiment, the data acquisition module includes a camera unit, an environmental sensor unit, and a device monitoring unit; The step of collecting the first image data and the first environmental parameters in the target computer room and the first device operating parameters of the first electronic devices in the target computer room by the data collection module includes: Using the camera unit to photograph the interior of the target room from different shooting angles to obtain first image data; and Collecting a first environmental parameter in the target computer room by using the environmental sensor unit; and The first device operating parameters of each first electronic device in the target computer room are collected by the device monitoring unit.

[0008] In one embodiment, the multimodal artificial intelligence system further includes a first artificial intelligence module, and the step of performing device feature recognition on each of the first image data to obtain target image data of each of the first image data includes: The first artificial intelligence module is used to perform device feature recognition on each of the first image data to obtain target image data of each of the first image data, wherein the first artificial intelligence module is trained using the second image data in the computer room as model input data and the third image data marked with the real bounding box coordinates, real location coordinates and real model information of each computer room equipment in the second image data as model training labels.

[0009] In one embodiment, the step of constructing a visual monitoring interface of the target computer room based on each of the target image data, the first environmental parameters, and each of the first equipment operating parameters includes: Extracting structured information of each first computer room device in the target computer room from each target image data, wherein the structured information represents the position information of the first computer room device in the target computer room; Determining performance information of each of the first electronic devices based on the operating parameters of each of the first devices, wherein the performance information represents an operating state and operating efficiency of the first electronic devices; A visual monitoring interface of the target computer room is constructed based on each of the structured information, the first environmental parameters and each of the performance information.

[0010] In one embodiment, the multimodal artificial intelligence system further includes a second artificial intelligence module, and the step of extracting the structured information of each first computer room device in the target computer room from each target image data includes: The second artificial intelligence module extracts the structured information of each first computer room device in the target computer room from each target image data, wherein the second artificial intelligence module is trained using each fourth image data in the computer room as model input data and using each real structured information of each second computer room device in the computer room as model training labels, and the fourth image data represents the second feature information of the second computer room device.

[0011] In one embodiment, the multimodal artificial intelligence system further includes a third artificial intelligence module, and the step of determining the performance information of each of the first electronic devices based on the operating parameters of each of the first devices includes: The performance information of each of the first electronic devices is determined based on the operating parameters of each of the first devices through the third artificial intelligence module, wherein the third artificial intelligence module is trained using the second device operating parameters of each of the second electronic devices in the computer room as model input data and using the real performance information of each of the second electronic devices as model training labels.

[0012] In one embodiment, the multimodal artificial intelligence system further includes a fourth artificial intelligence module, and the step of constructing a visual monitoring interface of the target computer room based on each of the structured information, the first environmental parameters, and each of the performance information includes: The fourth artificial intelligence module uses each of the structured information, the first environmental parameters and each of the performance information as context information, and calls the target graphics in the preset image library to construct a visual monitoring interface for the target computer room.

[0013] In addition, to achieve the above-mentioned purpose, the present application also provides a computer room visualization device, which is applied to a multimodal artificial intelligence system, the multimodal artificial intelligence system includes a data acquisition module, and the computer room visualization device includes: A data acquisition module, used for acquiring first image data and first environmental parameters in a target computer room, and first device operating parameters of first electronic devices in the target computer room, wherein the first image data are shot at different angles; An image processing module, configured to perform device feature recognition on each of the first image data to obtain target image data of each of the first image data, wherein the target image data represents first feature information of each target computer room device in the first image data; An interface construction module is used to construct a visual monitoring interface of the target computer room based on each of the target image data, the first environmental parameters and each of the first equipment operating parameters.

[0014] In addition, to achieve the above-mentioned purpose, the present application also provides a storage medium, which is a computer-readable storage medium, and a program for implementing the computer room visualization method is stored on the computer-readable storage medium. The program for implementing the computer room visualization method is executed by a processor to implement the steps of the computer room visualization method as described above.

[0015] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned computer room visualization method when executed by a processor.

[0016] The present application provides a computer room visualization method, which is applied to a multimodal artificial intelligence system, and the multimodal artificial intelligence system includes a data acquisition module. The present application collects each first image data and first environmental parameter in the target computer room, as well as the first device operation parameter of each first electronic device in the target computer room through the data acquisition module, wherein the shooting angles of each first image data collected are different; then, the device feature recognition is performed on each first image data to obtain the target image data of each first image data, wherein the target image data represents the first feature information of each target computer room device in the first image data; finally, a visual monitoring interface of the target computer room is constructed based on each target image data, the first environmental parameter and the first device operation parameter.

[0017] In summary, compared with the traditional method that requires manual execution of data collection and data processing steps, resulting in low efficiency in building a computer room visual monitoring interface, the present application performs data collection and data processing steps by a multimodal artificial intelligence system, and the multimodal artificial intelligence system is also compatible with the visual monitoring interface construction function, thereby improving the efficiency of building a computer room visual monitoring interface. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0020] Figure 1 This is a flow chart of the first embodiment of the computer room visualization method of the present application; Figure 2 A schematic diagram of a process for constructing a visualization monitoring interface for a computer room involved in an embodiment of the computer room visualization method of the present application; Figure 3 This is a schematic diagram of the module structure of the computer room visualization device of this application; Figure 4 This is a schematic diagram of the equipment structure of the hardware operating environment involved in the computer room visualization method in the embodiment of the present application.

[0021] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0022] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0023] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0024] The main solution of the present application is: to collect the first image data and the first environmental parameters in the target computer room, as well as the first device operating parameters of the first electronic devices in the target computer room through the data acquisition module, wherein the shooting angles of the first image data are different; to perform device feature recognition on the first image data to obtain the target image data of the first image data, wherein the target image data represents the first feature information of the target computer room equipment in the first image data; and to construct a visual monitoring interface of the target computer room based on the target image data, the first environmental parameters and the first device operating parameters.

[0025] At present, the common computer room monitoring method is mainly for computer room managers to manually measure the volume and identify the model of each key IT infrastructure in the computer room, obtain relevant detection data, and obtain the equipment operation parameters and computer room environment parameters collected by each sensor module installed in the computer room. Then, the detection data and sensor detection data are manually processed to extract useful information, and the useful information is provided to the corresponding visualization system to generate a visual monitoring interface. However, in this visualization solution, the data collection and data processing process are performed manually, resulting in the problem of low efficiency in building the computer room visualization interface.

[0026] Compared with the traditional method that requires manual execution of data collection and data processing steps, resulting in low efficiency in building a computer room visual monitoring interface, the present application performs data collection and data processing steps by a multimodal artificial intelligence system, and the multimodal artificial intelligence system is also compatible with the visual monitoring interface construction function, thereby improving the efficiency of building a computer room visual monitoring interface.

[0027] It should be noted that the execution subject of the method in each embodiment of the computer room visualization method of this application can be a multimodal artificial intelligence system, or a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or a computer room visualization device that can realize the above functions, etc., and this embodiment does not specifically limit this. The following takes the multimodal artificial intelligence system as the execution subject as an example to illustrate this embodiment and the following embodiments.

[0028] Based on this, this application proposes a computer room visualization method of the first embodiment, please refer to Figure 1 , the computer room visualization method includes steps S10 to S30: Step S10, collecting first image data and first environmental parameters in the target computer room, and first device operating parameters of first electronic devices in the target computer room through the data collection module, wherein the first image data are taken at different angles; It should be noted that artificial intelligence is a new technical science that studies and develops theories, methods, technologies and application systems for simulating, extending and expanding human intelligence, and multimodal artificial intelligence combines many data modes, such as text, photos, videos and audio, to provide a more thorough understanding of the scene. The goal of multimodal artificial intelligence is to compile data from multiple sources to support more accurate and reliable decisions. The multimodal artificial intelligence system of this application includes a data acquisition module, which is used to collect image data, environmental parameters and equipment operating parameters of each electronic device in the computer room. It should be understood that the data acquisition module can be a functional module for collecting various types of data, or a module that is connected to the functional module for collecting various types of data. Among them, each image data in the computer room is collected from different shooting angles. The environmental parameters in the computer room include but are not limited to humidity, temperature, etc. The electronic equipment in the computer room includes but is not limited to servers, network equipment and storage devices, etc. The equipment operating parameters of the electronic equipment include but are not limited to CPU usage, network traffic, system load, power status, interface status, bandwidth usage and storage space usage, etc.

[0029] The data acquisition module collects various image data (hereinafter referred to as first image data for distinction) and environmental parameters (hereinafter referred to as first environmental parameters for distinction) in the current computer room (hereinafter referred to as the target computer room for distinction), as well as equipment operation parameters (hereinafter referred to as first equipment operation parameters for distinction) of each electronic equipment (hereinafter referred to as first electronic equipment for distinction) in the target computer room. It should be noted that each first image data is obtained by photographing the interior of the target computer room from different angles.

[0030] In a feasible implementation manner, the data acquisition module includes a camera unit, an environmental sensor unit and an equipment monitoring unit, and the step S10 may include: Step S101, photographing the interior of a target computer room from different shooting angles by means of the camera unit to obtain first image data; Step S102, collecting a first environmental parameter in the target computer room through the environmental sensor unit; Step S103: collecting first device operating parameters of each first electronic device in the target computer room through the device monitoring unit.

[0031] In this embodiment, the data acquisition module includes a camera unit, an environmental sensor unit and a device monitoring unit, wherein the camera unit includes multiple cameras, and is respectively deployed at various locations inside the target computer room; the environmental sensor unit includes but is not limited to a temperature sensor and a humidity sensor; the device monitoring unit is integrated in each first electronic device in the target computer room, or the device monitoring unit is connected to each first electronic device in communication, and can request to obtain the operating parameters of each first electronic device. Specifically, the interior of the target computer room is photographed from different shooting angles by multiple cameras of the camera unit to obtain each first image data; the first environmental parameters in the target computer room are collected by the environmental sensor unit; and the first device operating parameters of each first electronic device in the target computer room are collected by the device monitoring unit.

[0032] Step S20, performing device feature recognition on each of the first image data to obtain target image data of each of the first image data, wherein the target image data represents first feature information of each target computer room device in the first image data; It should be noted that the equipment in the computer room includes electronic equipment and display equipment (such as racks, cabinets, etc.), and it should be understood that the display equipment is a device that does not have communication capabilities. The characteristic information of the equipment in the computer room includes but is not limited to the bounding box coordinates, location coordinates, and equipment model.

[0033] Device feature recognition is performed on each first image data to obtain target image data corresponding to each first image data, wherein the target image data represents feature information (hereinafter referred to as first feature information for distinction) of each computer room device (hereinafter referred to as target computer room device for distinction) of the first image data.

[0034] It should be understood that, since each first image data is obtained by the camera shooting the interior of the computer room at different positions, each first image data includes part of the computer room equipment in the computer room. For example, if there are five computer room equipment in the target computer room, which are respectively recorded as equipment 1, equipment 2, equipment 3, equipment 4 and equipment 5, then when the camera shoots the interior of the computer room at four different positions, it may obtain image data a including equipment 1, equipment 2 and equipment 3, image data b including equipment 1, equipment 2 and equipment 5, image data c including equipment 1, equipment 2, equipment 3 and equipment 4, and image data d including equipment 4 and equipment 5.

[0035] In this embodiment, the multimodal artificial intelligence system further includes a first artificial intelligence module, and step S20 may include: Step S201, performing device feature recognition on each of the first image data through the first artificial intelligence module to obtain target image data of each of the first image data, wherein the first artificial intelligence module is trained using the second image data in the computer room as model input data and using the third image data marked with the real bounding box coordinates, real position coordinates and real model information of each computer room device in the second image data as model training labels.

[0036] It should be noted that the multimodal artificial intelligence system of the present application also includes an artificial intelligence module for equipment feature recognition (hereinafter referred to as the first artificial intelligence module for distinction), and the first artificial intelligence module can be regarded as a model with equipment feature recognition function. Specifically, the first artificial intelligence module is pre-trained using the image data in the computer room (hereinafter referred to as the second image data for distinction) as the model input data, and the image data marked with the real bounding box coordinates, real position coordinates and real model information of each computer room equipment in the second image data (hereinafter referred to as the third image data for distinction) as the model training label. In addition, it should be understood that the sample image data used in the training process of the artificial intelligence module is collected from computer rooms with different layouts.

[0037] Each first image data is input into the first artificial intelligence module respectively, and the first artificial intelligence module identifies the bounding box coordinates, position coordinates and model information of the target computer room equipment in each first image data, and marks the identified information on the first image data to obtain the target image data corresponding to each first image data. It should be understood that the position coordinates of the computer room equipment in the image data refer to the center coordinates of the bounding box of the computer room equipment.

[0038] Step S30: constructing a visual monitoring interface of the target computer room based on each of the target image data, the first environmental parameters, and each of the first equipment operating parameters.

[0039] Based on each target image data, the first environmental parameter and the first equipment operation parameter, a visual monitoring interface of the target computer room is constructed in combination with a graphical interface design tool and data visualization technology.

[0040] In this way, compared with the traditional method that requires manual execution of data collection and data processing steps, resulting in low efficiency in building a computer room visual monitoring interface, the embodiment of the present application performs data collection and data processing steps by a multimodal artificial intelligence system, and the multimodal artificial intelligence system is also compatible with the visual monitoring interface construction function, thereby improving the efficiency of building a computer room visual monitoring interface.

[0041] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. On this basis, the step S30 may include: Step S301, extracting structured information of each first computer room device in the target computer room from each target image data, wherein the structured information represents the position information of the first computer room device in the target computer room; It should be noted that the structured information of each equipment in the computer room represents the position information of the equipment in the computer room.

[0042] The structured information of each computer room device (hereinafter referred to as the first computer room device for distinction) in the target computer room is extracted from each target image data, wherein the structured information represents the position information of the first computer room device in the target computer room.

[0043] In this embodiment, the multimodal artificial intelligence system further includes a second artificial intelligence module, and step S301 may include: Step S3011, extracting the structured information of each first computer room device in the target computer room from each target image data through the second artificial intelligence module, wherein the second artificial intelligence module is trained using each fourth image data in the computer room as model input data and using each real structured information of each second computer room device in the computer room as model training label, and the fourth image data represents the second feature information of the second computer room device.

[0044] It should be noted that the multimodal artificial intelligence system of the present application also includes an artificial intelligence module for structured information extraction (hereinafter referred to as the second artificial intelligence module for distinction), and the second artificial intelligence module can be regarded as a model capable of structured information extraction. Specifically, the image data that characterizes the characteristic information (hereinafter referred to as the second characteristic information for distinction) of the computer room equipment (hereinafter referred to as the second computer room equipment for distinction) in the computer room is called the fourth image data, and the second artificial intelligence module is pre-trained using the fourth image data in the computer room as the model input data and the real structured information of each second computer room equipment in the computer room as the model training label.

[0045] The target image data are input into the second artificial intelligence module, and the structured information of each first computer room device in the target computer room is output through the second artificial intelligence module.

[0046] Step S302: determining performance information of each of the first electronic devices based on the operating parameters of each of the first devices, wherein the performance information represents the operating state and operating efficiency of the first electronic devices; It should be noted that the performance information of the electronic device can be determined based on the monitored device operating parameters, wherein the performance information represents the operating state and operating efficiency of the electronic device.

[0047] In this embodiment, the multimodal artificial intelligence system further includes a third artificial intelligence module, and step S302 may include: Step S3021, determining the performance information of each of the first electronic devices based on the operating parameters of each of the first devices through the third artificial intelligence module, wherein the third artificial intelligence module is trained using the second device operating parameters of each of the second electronic devices in the computer room as model input data and using the real performance information of each of the second electronic devices as model training labels.

[0048] It should be noted that the multimodal artificial intelligence system of the present application also includes an artificial intelligence module for logical operations (hereinafter referred to as the third artificial intelligence module for distinction), and the third artificial intelligence module can be regarded as a model with logical operation functions. Specifically, the third artificial intelligence module is trained using the equipment operating parameters (hereinafter referred to as the second equipment operating parameters for distinction) of each electronic device in the computer room (hereinafter referred to as the second electronic device for distinction) as model input data, and using the real performance information of each second electronic device as the model training label.

[0049] The collected first device operating parameters of the first electronic device are input into the third artificial intelligence module, and the performance information of the first electronic device is output through the third artificial intelligence module.

[0050] Step S303: construct a visual monitoring interface of the target computer room based on each of the structured information, the first environmental parameters and each of the performance information.

[0051] Based on the structured information of each first computer room device in the target computer room, the first environmental parameters and the performance information of each first electronic device, a visual monitoring interface of the target computer room is constructed.

[0052] In this embodiment, the multimodal artificial intelligence system further includes a fourth artificial intelligence module, and step S303 may include: The fourth artificial intelligence module uses each of the structured information, the first environmental parameters and each of the performance information as context information, and calls the target graphics in the preset image library to construct a visual monitoring interface for the target computer room.

[0053] It should be noted that the multimodal artificial intelligence system of the present application also includes an artificial intelligence module for constructing a visual interface (hereinafter referred to as the fourth artificial intelligence module for distinction).

[0054] The structured information, the first environmental parameter and the performance information are output as context information to the fourth artificial intelligence module, and the fourth artificial intelligence module calls the preset image library based on the context information to automatically generate a visual monitoring image interface of the target computer room and display it to the user.

[0055] For example, Figure 2 The figure shows a schematic diagram of the process of constructing a visual monitoring interface for a computer room, wherein the first image data, the first environmental parameters and the first device operating parameters of each first electronic device in the target computer room are obtained through the data acquisition module; the device feature recognition of each first image data is performed through the first artificial intelligence module to obtain each target image data, and then the second artificial intelligence module is used to determine the structured information of each first computer room device in the target computer room based on each target image data; the third artificial intelligence module is used to determine the performance information of each first electronic device based on each first device operating parameter; and then the fourth artificial intelligence module is used to call the image library based on each structured information, the first environmental parameters and each performance information to construct a visual monitoring interface for the target computer room.

[0056] In this way, the embodiment of the present application analyzes and processes the collected data through the artificial intelligence module, extracts the computer room information used to construct the visual monitoring interface, and inputs the computer room information as context information into the artificial intelligence module used for interface construction, so as to call the graphics library based on the context information, thereby automatically generating a computer room visual monitoring interface, thereby achieving compatibility of the interface construction function and improving the efficiency of visual monitoring interface construction.

[0057] The present application also provides a computer room visualization device, please refer to Figure 3 , the computer room visualization device is applied to a multimodal artificial intelligence system, the multimodal artificial intelligence system includes a data acquisition module, and the computer room visualization device includes: A data acquisition module 10 is used to collect first image data and first environmental parameters in a target computer room, and first device operating parameters of first electronic devices in the target computer room, wherein the first image data are taken at different angles; The image processing module 20 is used to perform device feature recognition on each of the first image data to obtain target image data of each of the first image data, wherein the target image data represents first feature information of each target computer room device in the first image data; The interface construction module 30 is used to construct a visual monitoring interface of the target computer room based on each of the target image data, the first environmental parameters and each of the first equipment operating parameters.

[0058] Optionally, the data acquisition module includes a camera unit, an environmental sensor unit and an equipment monitoring unit, and the data acquisition module 10 is further used for: Using the camera unit to photograph the interior of the target room from different shooting angles to obtain first image data; and Collecting a first environmental parameter in the target computer room by using the environmental sensor unit; and The first device operating parameters of each first electronic device in the target computer room are collected by the device monitoring unit.

[0059] Optionally, the multimodal artificial intelligence system further includes a first artificial intelligence module, and the image processing module 20 is further used to: The first artificial intelligence module is used to perform device feature recognition on each of the first image data to obtain target image data of each of the first image data, wherein the first artificial intelligence module is trained using the second image data in the computer room as model input data and the third image data marked with the real bounding box coordinates, real location coordinates and real model information of each computer room equipment in the second image data as model training labels.

[0060] Optionally, the interface construction module 30 is further used for: Extracting structured information of each first computer room device in the target computer room from each target image data, wherein the structured information represents the position information of the first computer room device in the target computer room; Determining performance information of each of the first electronic devices based on the operating parameters of each of the first devices, wherein the performance information represents an operating state and operating efficiency of the first electronic devices; A visual monitoring interface of the target computer room is constructed based on each of the structured information, the first environmental parameters and each of the performance information.

[0061] Optionally, the multimodal artificial intelligence system further includes a second artificial intelligence module, and the interface construction module 30 is further used to: The second artificial intelligence module extracts the structured information of each first computer room device in the target computer room from each target image data, wherein the second artificial intelligence module is trained using each fourth image data in the computer room as model input data and using each real structured information of each second computer room device in the computer room as model training labels, and the fourth image data represents the second feature information of the second computer room device.

[0062] Optionally, the multimodal artificial intelligence system further includes a third artificial intelligence module, and the interface construction module 30 is further used to: The performance information of each of the first electronic devices is determined based on the operating parameters of each of the first devices through the third artificial intelligence module, wherein the third artificial intelligence module is trained using the second device operating parameters of each of the second electronic devices in the computer room as model input data and using the real performance information of each of the second electronic devices as model training labels.

[0063] Optionally, the multimodal artificial intelligence system further includes a fourth artificial intelligence module, and the interface construction module 30 is further used to: The fourth artificial intelligence module uses each of the structured information, the first environmental parameters and each of the performance information as context information, and calls the target graphics in the preset image library to construct a visual monitoring interface for the target computer room.

[0064] The computer room visualization device provided in the embodiment of the present application adopts the computer room visualization method in the above embodiment, which can solve the technical problem of how to improve the efficiency of building a computer room visualization monitoring interface. Compared with the prior art, the beneficial effects of the computer room visualization device provided in the embodiment of the present application are the same as the beneficial effects of the computer room visualization method provided in the above embodiment, and other technical features in the computer room visualization device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0065] The present application provides a computer room visualization device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the computer room visualization method in the above-mentioned embodiment one.

[0066] Reference below Figure 4 , which shows a schematic diagram of the structure of a computer room visualization device suitable for implementing the embodiment of the present application. The computer room visualization device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4 The computer room visualization device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0067] like Figure 4 As shown, the computer room visualization device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM) 1004. In RAM 1004, various programs and data required for the operation of the computer room visualization device are also stored. The processing device 1001, ROM 1002, and RAM 1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the computer room visualization device to communicate with other devices wirelessly or wired to exchange data. Although the computer room visualization device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0068] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0069] The computer room visualization device provided by the present application adopts the computer room visualization method in the above embodiment, which can solve the technical problem of how to improve the efficiency of building a computer room visualization monitoring interface. Compared with the prior art, the beneficial effects of the computer room visualization device provided by the present application are the same as the beneficial effects of the computer room visualization method provided by the above embodiment, and other technical features in the computer room visualization device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0070] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0071] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0072] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the computer room visualization method in the above-mentioned embodiment.

[0073] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0074] The computer-readable storage medium may be included in the computer room visualization device; or may exist independently without being assembled into the computer room visualization device.

[0075] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the computer room visualization device, the computer room visualization device: collects each first image data and the first environmental parameter in the target computer room, and the first device operating parameters of each first electronic device in the target computer room through the data acquisition module, wherein the shooting angles of each first image data are different; performs device feature recognition on each first image data to obtain the target image data of each first image data, wherein the target image data represents the first feature information of each target computer room device in the first image data; and constructs a visual monitoring interface of the target computer room based on each target image data, the first environmental parameter and the first device operating parameters.

[0076] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0077] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0078] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0079] The readable storage medium provided in the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned computer room visualization method, and can solve the technical problem of how to improve the efficiency of building a computer room visualization monitoring interface. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in the present application are the same as the beneficial effects of the computer room visualization method provided in the above-mentioned embodiment, and will not be repeated here.

[0080] An embodiment of the present application provides a computer program product, including a computer program, which implements the steps of the above-mentioned computer room visualization method when executed by a processor.

[0081] The computer program product provided by this application can improve the efficiency of building a visual monitoring interface for a computer room. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of this application are the same as the beneficial effects of the computer room visualization method provided by the above embodiment, which will not be repeated here.

[0082] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent processing scope of the present application.

Claims

1. A computer room visualization method, characterized in that: The computer room visualization method is applied to a multimodal artificial intelligence system, the multimodal artificial intelligence system includes a data acquisition module, and the computer room visualization method includes: Collecting, by the data acquisition module, first image data and first environmental parameters in the target computer room, and first device operating parameters of first electronic devices in the target computer room, wherein the first image data are shot at different angles; Performing device feature recognition on each of the first image data to obtain target image data of each of the first image data, wherein the target image data represents first feature information of each target computer room device in the first image data; A visual monitoring interface of the target computer room is constructed based on each of the target image data, the first environmental parameters and each of the first equipment operating parameters.

2. The method according to claim 1, characterized in that The data acquisition module includes a camera unit, an environmental sensor unit and an equipment monitoring unit; The step of collecting the first image data and the first environmental parameters in the target computer room and the first device operating parameters of the first electronic devices in the target computer room by the data collection module includes: Using the camera unit to photograph the interior of the target room from different shooting angles to obtain first image data; and Collecting a first environmental parameter in the target computer room by using the environmental sensor unit; and The first device operating parameters of each first electronic device in the target computer room are collected by the device monitoring unit.

3. The method according to claim 1, characterized in that The multimodal artificial intelligence system further includes a first artificial intelligence module, and the step of performing device feature recognition on each of the first image data to obtain target image data of each of the first image data includes: The first artificial intelligence module is used to perform device feature recognition on each of the first image data to obtain target image data of each of the first image data, wherein the first artificial intelligence module is trained using the second image data in the computer room as model input data and the third image data marked with the real bounding box coordinates, real location coordinates and real model information of each computer room equipment in the second image data as model training labels.

4. The method according to claim 1, characterized in that The step of constructing a visual monitoring interface of the target computer room based on each of the target image data, the first environmental parameters and each of the first equipment operating parameters includes: Extracting structured information of each first computer room device in the target computer room from each target image data, wherein the structured information represents the position information of the first computer room device in the target computer room; Determining performance information of each of the first electronic devices based on the operating parameters of each of the first devices, wherein the performance information represents an operating state and operating efficiency of the first electronic devices; A visual monitoring interface of the target computer room is constructed based on each of the structured information, the first environmental parameters and each of the performance information.

5. The method according to claim 4, characterized in that The multimodal artificial intelligence system further includes a second artificial intelligence module, and the step of extracting the structured information of each first computer room device in the target computer room from each target image data includes: The second artificial intelligence module extracts the structured information of each first computer room device in the target computer room from each target image data, wherein the second artificial intelligence module is trained using each fourth image data in the computer room as model input data and using each real structured information of each second computer room device in the computer room as model training labels, and the fourth image data represents the second feature information of the second computer room device.

6. The method according to claim 4, characterized in that The multimodal artificial intelligence system further includes a third artificial intelligence module, and the step of determining the performance information of each of the first electronic devices based on the operating parameters of each of the first devices includes: The performance information of each of the first electronic devices is determined based on the operating parameters of each of the first devices through the third artificial intelligence module, wherein the third artificial intelligence module is trained using the second device operating parameters of each of the second electronic devices in the computer room as model input data and using the real performance information of each of the second electronic devices as model training labels.

7. The method according to claim 4, characterized in that The multimodal artificial intelligence system further includes a fourth artificial intelligence module, and the step of constructing a visual monitoring interface of the target computer room based on each of the structured information, the first environmental parameters, and each of the performance information includes: The fourth artificial intelligence module uses each of the structured information, the first environmental parameters and each of the performance information as context information, and calls the target graphics in the preset image library to construct a visual monitoring interface for the target computer room.

8. A computer room visualization device, characterized in that: The computer room visualization device is applied to a multimodal artificial intelligence system, the multimodal artificial intelligence system includes a data acquisition module, and the computer room visualization device includes: A data acquisition module, used for collecting first image data and first environmental parameters in a target computer room, and first device operating parameters of first electronic devices in the target computer room, wherein the first image data are taken at different angles; An image processing module, configured to perform device feature recognition on each of the first image data to obtain target image data of each of the first image data, wherein the target image data represents first feature information of each target computer room device in the first image data; An interface construction module is used to construct a visual monitoring interface of the target computer room based on each of the target image data, the first environmental parameters and each of the first equipment operating parameters.

9. A computer room visualization device, characterized in that: The computer room visualization device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the computer room visualization method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the computer room visualization method according to any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Machine room remote panoramic monitoring method based on virtual reality technology

    CN110796727A

  • Construction method of multi-task perceptual recognition model and multi-task perceptual recognition method

    CN113963238A

  • AI video identification machine room monitoring system and method based on 5G communication

    CN117041482A

  • Machine room operation state detection method and device, storage medium and electronic equipment

    CN117891234A

  • Power distribution equipment state multi-view image fusion detection method and system

    CN118314091A

Cited By

  • Computer room configuration management system using building information modeling

    TWI904996B