Interaction Method Applicable to Digital Twin Networking

Abstract

The present invention relates to an interaction method applicable to digital twin networking, which includes the following steps: projecting the image captured by the camera onto the screen; performing digital twin matching through the digital twin management system to generate a UI interface and divide the area; endowing functions; docking with the traditional management system for point projection; and triggering functions in the virtual scene and feeding back to the screen. Thus, the screen can be divided into regions through the UI interface, and the virtual scene can be divided into several regions in both the traditional management system and the digital twin project, and grouped correspondence can be achieved. After the scene is divided, the data of each region can be managed separately to meet the matching of valid data in the region. The triggering position of an emergency can be quickly identified, enabling the user to quickly associate the region where the emergency occurs. Thus, the characteristics of the eagle-eye camera can be maximally utilized to obtain an overlooking panoramic state.

Description

Technical Field

[0001] The present invention relates to an interaction method related to digital twin projects and traditional management systems, and in particular to an interaction method suitable for digital twin networking. Background Art

[0002] For the interaction between existing digital twin projects and traditional management systems, it mainly realizes through the interconnection of backend data. For the virtual scenes in digital twins, the effects therein can only be presented through backend data. During implementation, the interaction between the traditional management system and the real scene relies on cameras. Therefore, in order to meet the necessary acquisition, a relatively large number of cameras need to be distributed, and the processing of the scene connection edges needs to be involved, increasing the data processing burden. Moreover, the traditional digital twin scene (virtual scene) can only use the modeling scene as the baseboard, and the camera mostly only has the function of a video pop-up window, with a very low degree of interaction.

[0003] In view of the above-mentioned defects, the present inventor actively conducts research and innovation in order to create an interaction method suitable for digital twin networking, making it more valuable in the industry. Summary of the Invention

[0004] To solve the above technical problems, the object of the present invention is to provide an interaction method suitable for digital twin networking.

[0005] The interaction method suitable for digital twin networking of the present invention includes the following steps:

[0006] Step 1, project the image obtained by the camera onto the screen;

[0007] Step 2, through the digital twin management system, perform digital twin matching, generate a UI interface, and divide the area;

[0008] Step 3, endow functions;

[0009] Step 4, dock with the traditional management system and perform point projection;

[0010] Step 5, trigger the functions in the virtual scene and feedback them to the screen.

[0011] Further, in the above-mentioned interaction method suitable for digital twin networking, in step 1, an eagle-eye camera is selected, and the image of the eagle-eye camera in the overlooking panoramic state is projected onto the screen through pixel flow.

[0012] Furthermore, in the above-mentioned interaction method suitable for digital twin networking, in step 2, align the real scene with the position and angle of the virtual scene on the screen to form a UI interface.

[0013] Furthermore, for the above-mentioned interactive method applicable to digital twin networking, in step 2, in the UI interface, the screen is divided into several regions of the same size, each region represents a real scenario, and the center point of each region is provided with longitude and latitude; the virtual scenario is attached with the coordinates of the virtual scenario constructed by the Unreal Engine, and the coordinates of the virtual scenario are grouped and corresponding to the longitude and latitude of the center point of the region representing the real scenario.

[0014] Furthermore, for the above-mentioned interactive method applicable to digital twin networking, in step 3, the divided regions in the UI interface are given the function of click interaction.

[0015] Furthermore, for the above-mentioned interactive method applicable to digital twin networking, in step 4, after the function in the traditional management system is triggered, the corresponding background sends out longitude and latitude, and through the coordinates of the virtual scenario corresponding to the longitude and latitude, the function trigger point is located in the virtual scenario.

[0016] Still further, for the above-mentioned interactive method applicable to digital twin networking, in step 5, when a function is triggered in the virtual scenario, the triggered position can be located in the real scenario through the longitude and latitude corresponding to the screen coordinates.

[0017] By means of the above solution, the present invention has at least the following advantages:

[0018] 1. The screen can be divided into regions through the UI interface, and the virtual scenario can be divided into several regions in the traditional management system and the digital twin project, and grouping correspondence can be achieved.

[0019] 2. After the scene is divided, the data of each region can be managed separately to meet the matching of valid data in the region.

[0020] 3. The trigger position of an emergency can be quickly identified, enabling the user to quickly associate the region where the emergency occurs.

[0021] 4. The characteristics of the eagle-eye camera can be maximally utilized to obtain an overview panoramic state.

[0022] The above description is only an overview of the technical solution of the present invention. In order to be able to understand the technical means of the present invention more clearly and implement it in accordance with the content of the description, the following is a detailed description of the preferred embodiments of the present invention in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a schematic diagram of the implementation process of the interactive method applicable to digital twin networking. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0024] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following embodiments are used to illustrate the present invention, but are not used to limit the scope of the present invention.

[0025] Such as Figure 1 The interactive method applicable to digital twin networking is characterized in that it includes the following steps:

[0026] Step 1, project the image captured by the camera onto the screen. During implementation, an eagle-eye camera is used. Through pixel stream, the image of the eagle-eye camera in the overlooking panoramic state is transmitted to the digital twin project through the network, and then the digital twin project puts the image data into the UI interface to complete the process from the eagle-eye camera image to the screen. In this way, a relatively comprehensive field of view can be obtained, enabling the screen to obtain the most comprehensive image data. During implementation, the edge distortion of the eagle-eye image does not need to be processed because during subsequent operations, after the grid is divided, only the coordinates of the virtual scene (the virtual scene constructed by the UE engine in this application, also known as the UE scene) at the center point of the grid and the actual longitude and latitude records in reality need to be corresponded, reducing the processing steps and increasing the subsequent matching rate.

[0027] Step 2, through the digital twin management system, perform digital twin matching, generate the UI interface, and divide the area. Specifically, align the real scene with the position and angle of the virtual scene on the screen to form the UI interface. The alignment method is to manually align through the digital twin management system. First, observe the virtual scene divided on the screen, and then find the corresponding position in the real scene and record the longitude, latitude, and angle. The digital twin management system adopted in the present invention is a digital twin derivative system under the current conventional construction, which will not be elaborated here.

[0028] At the same time, in the adopted UI interface, the screen is divided into several regions of the same size according to requirements. Each region represents a real scene, and the center point of each region is provided with longitude and latitude. It is recommended to store all the longitude, latitude, and angles in the backend. Each region divided on the screen is 16:9 because most horizontal screens are 16:9, so that it can ensure adaptability in the horizontal screen mode. If it needs to be applied on the vertical screen port, the screen area needs to be re-divided and then the screen area and the modeling scene position need to be realigned. And during the implementation of the present invention, the virtual scene is attached with the coordinates of the virtual scene constructed by the Unreal Engine, and the coordinates include the XYZ axis data of the Unreal Engine. In this way, the coordinates of the virtual scene can be grouped and corresponded with the longitude and latitude of the center point of the region representing the real scene, completing the data intercommunication.

[0029] Step 3: Function assignment. A UI button can be added to the segmented areas in the UI interface, and any function to be triggered can be bound to this UI button through dynamic notification. At the same time, data intercommunication can be achieved, that is, the functions of the digital twin project and the traditional management system can achieve basic intercommunication. During the implementation, in order to improve the operation convenience, interactive functions are adopted, including hiding the eagle-eye screen, displaying the virtual scene, and jumping to the corresponding position of the clicked screen after clicking the UI. In this way, the operation application requirements after the daily digital twin networking can be realized. At the same time, on the UI button, other functions to be triggered can be triggered by binding event notifications, which can be adjusted according to actual implementation needs and will not be elaborated here.

[0030] Step 4: Connect to the traditional management system and perform point projection. During the implementation, when a function in the traditional management system is triggered, the corresponding background can transmit the longitude and latitude. Then, the function trigger point is located in the virtual scene through the coordinates of the virtual scene corresponding to the longitude and latitude. For example, when a certain camera in the traditional management system detects a fire warning, warning data will be generated at the backend and sent to the digital twin management system through the network. Then, the longitude and latitude in the data are converted into UE scene coordinates and UE screen coordinates through an algorithm. At this time, a flame special effect will be generated at the corresponding position in the virtual scene, and a UI icon will be generated at the corresponding position on the corresponding screen. These all belong to the presentation layer. After the presentation layer is executed, any set function can be triggered.

[0031] Step 5: The function trigger in the virtual scene is feedback to the screen. Specifically, when a function is triggered in the virtual scene, the triggered position can be located in the real scene through the longitude and latitude corresponding to the screen coordinates. In this way, the in-depth connection in space can be completed.

[0032] During the implementation, the scenes corresponding to each area in the virtual scene are managed in blocks, and a management-type Actor is placed in each segmented scene. The data for interacting with the traditional management system in each area is stored in this Actor, and functions such as camera aggregation and data statistics in each area can be realized.

[0033] The working principle of the present invention is as follows:

[0034] The traditional management system discovers events such as warnings, generates data at the backend, and sends it to the digital twin management system through the network. The digital twin management system converts the longitude and latitude in the data into UE screen coordinates and UE scene coordinates, and then triggers functions at the corresponding positions on the screen and in the scene, such as adding icons on the screen and special effects in the scene. If the digital twin management system actively triggers an event, the event and the scene coordinates where the event occurs are converted into longitude and latitude, written as Json and sent to the backend of the traditional management system through the network.

[0035] For example, in a certain place in the real scenario, the corresponding camera detects a car accident. After the traditional management system learns about it, it generates data of the car accident event in the background. After the traditional management system applies this method, the data of the car accident event it generates includes at least the camera number that obtains the car accident information and the longitude and latitude of the car accident location. Then, the traditional management system transmits the data of the car accident event to the digital twin management system through the network. After that, the digital twin management system matches the corresponding camera in the virtual scenario through the camera number, and replaces the icon of the camera with a car accident warning icon. Subsequently, the longitude and latitude of the car accident location are converted into coordinates in the virtual scenario (UE scenario), and car accident special effects are generated in the virtual scenario.

[0036] It can be seen from the above text description and in combination with the attached drawings that after adopting the present invention, the following advantages are possessed:

[0037] 1. The screen can be divided into regions through the UI interface, and the virtual scenario can be divided into several regions in the traditional management system and the digital twin project, and grouping correspondence can be achieved.

[0038] 2. After the scene is divided, the data of each region can be managed separately to meet the matching of valid data in the region.

[0039] 3. It can quickly identify the trigger position of an emergency event, enabling the user to quickly associate with the region where the emergency event occurs.

[0040] 4. It can maximize the utilization of the characteristics of the eagle-eye camera to obtain an overview panoramic state.

[0041] In addition, the orientation or positional relationship described in the present invention is all based on the orientation or positional relationship shown in the attached drawings, which is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or structure referred to must have a specific orientation, or operate in a specific orientation structure. Therefore, it should not be construed as a limitation of the present invention.

[0042] The above are only the preferred embodiments of the present invention and are not used to limit the present invention. It should be noted that for those of ordinary skill in the art in this technical field, without departing from the technical principle of the present invention, several improvements and modifications can still be made, and these improvements and modifications should also be regarded as the protection scope of the present invention.

Claims

1. An interactive method applicable to digital twin networking, characterized in that The steps include the following: Step 1: Project the image captured by the camera onto the screen. Select an eagle-eye camera and project the image of the eagle-eye camera in the overlooking panoramic state onto the screen through pixel stream. The image of the eagle-eye camera does not process edge distortion, but only processes the correspondence between the virtual scene coordinates at the grid center point and the longitude and latitude. Step 2: Through the digital twin management system, perform digital twin matching, generate a UI interface, and divide the area. Align the position and angle of the real scene with the virtual scene on the screen to form a UI interface. The alignment process is to convert the longitude and latitude of the real scene and the virtual scene, and map the coordinates to the virtual scene. In the UI interface, the screen is divided into several areas of the same size, each area represents a real scene, and the center point of each area is set with longitude and latitude. Each area is equipped with a management class Actor for storing data used to interact with the traditional management system in each area, realizing camera aggregation and data statistics. In the UI interface, the ratio of each area is 16:9, and the scene position is re-divided and aligned in the vertical screen mode. The virtual scene is attached with the coordinates of the virtual scene constructed by the Unreal Engine, and the coordinates of the virtual scene are grouped and corresponding to the longitude and latitude of the center point of the area representing the real scene. Step 3: Endow functions. For the divided areas in the UI interface, endow the function of click interaction. The interaction function includes hiding the eagle-eye image, displaying the virtual scene, and jumping to the corresponding position of the clicked image after clicking the UI. Step 4: Connect to the traditional management system and perform point projection. After the function in the traditional management system is triggered, the corresponding background sends out the longitude and latitude, and locates the function trigger point to the virtual scene through the coordinates of the virtual scene corresponding to the longitude and latitude. Step 5: The function trigger in the virtual scene is feedback to the screen. When a function is triggered in the real scene, the triggered position can be located to the virtual scene through the scene coordinates corresponding to the longitude and latitude.

Images