Method and apparatus for establishing a visual scene based on virtual reality technology

Abstract

The application relates to a virtual reality technology-based visual scene establishment method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: combining a plurality of images collected for a target area to obtain a combined image; using virtual reality technology to construct an initial three-dimensional virtual scene of the target area based on the combined image; obtaining device information in the target area, and fusing the device information with the initial three-dimensional virtual scene to obtain a target three-dimensional virtual scene; and establishing a work interaction anchor point in the target three-dimensional virtual scene to obtain a visual application scene to which the target area belongs. The method can improve the visual degree of the scene.

Description

Technical Field

[0001] This application relates to the field of information visualization technology, and in particular to a method, apparatus, computer equipment, storage medium and computer product for creating a visualization scene based on virtual reality technology. Background Technology

[0002] With the development of internet technology, intelligent management of power distribution networks is becoming increasingly sophisticated. However, in the power supply network's generation, transmission, distribution, and consumption stages, power companies have long focused on generation and transmission systems. Compared to these stages, monitoring of distribution and consumption is insufficient, leading to relatively weak collaboration between power distribution, consumption, power management departments, and end-users. Therefore, traditional technologies have developed intelligent distribution network substations for monitoring the distribution network substation environment.

[0003] However, while traditional technologies have monitored environmental information in power distribution rooms and achieved environmental monitoring and management of power distribution areas to a certain extent, they suffer from low levels of scene visualization. Summary of the Invention

[0004] Therefore, it is necessary to provide a method, apparatus, computer equipment, computer-readable storage medium, and computer program product for creating a visualized scene based on virtual reality technology, which can improve the level of scene visualization and address the aforementioned technical problems.

[0005] Firstly, this application provides a method for establishing a visual scene based on virtual reality technology, the method comprising:

[0006] Multiple images collected for the target area are combined to obtain a composite image;

[0007] Based on the combined images, an initial three-dimensional virtual scene of the target area is constructed using virtual reality technology;

[0008] Obtain device information within the target area and fuse the device information with the initial three-dimensional virtual scene to obtain the target three-dimensional virtual scene;

[0009] Establish task interaction anchor points in the target 3D virtual scene to obtain the visualization application scene to which the target area belongs.

[0010] In one embodiment, the plurality of images includes at least a first image, a second image, and a third image;

[0011] The process of combining multiple images acquired targeting a target area to obtain a combined image includes:

[0012] A first image is acquired by acquiring the target area according to the first acquisition cycle;

[0013] A second image is obtained by acquiring the target area according to the second acquisition cycle;

[0014] Extract the identical and different parts from the first and second images, and perform a third image acquisition on the different parts to obtain a third image;

[0015] Based on the first image, the second image, and the third image, determine the real image corresponding to the difference portion;

[0016] By combining the real image and the image of the same part, a composite image is obtained.

[0017] In one embodiment, combining multiple images acquired for a target area to obtain a combined image includes:

[0018] Acquire multiple images of the internal and external environments of the target area;

[0019] Each of the images is stitched together to obtain a combined image.

[0020] In one embodiment, the device information includes the device's size parameters and the device's operating parameters.

[0021] The step of acquiring device information within the target area and fusing the device information with the initial 3D virtual scene to obtain the target 3D virtual scene includes:

[0022] The size parameters of the device are fused with the initial three-dimensional virtual scene to obtain a three-dimensional virtual scene;

[0023] Establish the association between the working parameter information of the device and the corresponding device in the three-dimensional virtual scene to obtain the target three-dimensional virtual scene.

[0024] In one embodiment, establishing task interaction anchor points in the target 3D virtual scene to obtain the visualization application scene to which the target area belongs includes:

[0025] Obtain the position information of each device in the target 3D virtual scene;

[0026] Based on the location information of each device, the trigger position of the operation interaction anchor point of each device is determined, and the visualization application scenario to which the target area belongs is obtained.

[0027] In one embodiment, after obtaining the visualization application scenario to which the target area belongs, the process includes:

[0028] Based on the trigger location, the task interaction anchor point in the visualization application scenario is triggered to obtain the task method of the device corresponding to the task interaction anchor point; the task method is used to guide the interactive object to perform the corresponding task.

[0029] Secondly, this application provides a visualization scene creation device based on virtual reality technology, the device comprising:

[0030] The combined image acquisition module is used to combine multiple images acquired for a target area to obtain a combined image;

[0031] An initial 3D virtual scene construction module is used to construct an initial 3D virtual scene of the target area based on the combined images using virtual reality technology;

[0032] A target 3D virtual scene construction module is used to acquire device information within the target area and fuse the device information with the initial 3D virtual scene to obtain the target 3D virtual scene;

[0033] The visualization application scenario construction module is used to establish operation interaction anchor points in the target 3D virtual scene to obtain the visualization application scenario to which the target area belongs.

[0034] Thirdly, this application provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of the above-described method.

[0035] Fourthly, this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the above-described method.

[0036] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the above-described method.

[0037] The aforementioned visualization scene creation method, device, computer equipment, storage medium, and computer program products based on virtual reality technology combine acquired images and then use virtual reality technology to construct an initial virtual scene from the combined images. This allows two-dimensional planar images to be displayed in three-dimensional form, thereby completing the virtualization of the scene within the target area. By integrating device information with the initial three-dimensional virtual scene, users can quickly obtain information data of interest within the virtual scene without having to actively retrieve or query data, thus improving the visualization level of the scene. By establishing operation interaction anchor points, users can operate the device within the target three-dimensional virtual scene, further enhancing the visualization level of the scene. Attached Figure Description

[0038] Figure 1 This is an application environment diagram of a method for creating a visualization scene based on virtual reality technology in one embodiment.

[0039] Figure 2 This is a flowchart illustrating a method for creating a visualized scene based on virtual reality technology in one embodiment.

[0040] Figure 3 A flowchart illustrating a method for creating a visualized scene based on virtual reality technology in another embodiment;

[0041] Figure 4 A structural block diagram of a visualization scene creation device based on virtual reality technology in one embodiment;

[0042] Figure 5 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0043] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0044] The visualization scene creation method based on virtual reality technology provided in this application embodiment can be applied to, for example... Figure 1 In the application environment shown, terminal 102 communicates with server 104 via a network. A data storage system can store the data that server 104 needs to process. The data storage system can be integrated onto server 104 or placed on the cloud or other network servers. Server 104 combines multiple images collected from the target area to obtain a combined image. Based on the obtained combined image, server 104 uses virtual reality technology to construct an initial 3D virtual scene belonging to the target area. Server 104 also acquires device information for each device within the target area and merges the device information with the constructed initial 3D virtual scene to obtain the target 3D virtual scene. In the constructed target 3D virtual scene, server 104 establishes interactive anchor points that allow interaction with devices within the target area, thereby obtaining the visualization application scene to which the target area belongs. Terminal 102 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices can include smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, etc. Portable wearable devices can include smartwatches, smart bracelets, head-mounted devices, etc. Server 104 can be implemented using a standalone server or a server cluster consisting of multiple servers.

[0045] In one embodiment, such as Figure 2 As shown, a method for creating a visual scene based on virtual reality technology is provided, which can be applied to... Figure 1 Taking the server in the example, the following steps are included:

[0046] Step 202: Combine the multiple images collected for the target area to obtain a combined image.

[0047] The target area refers to the substation of the distribution network area. The multiple images collected are two-dimensional planar images captured from the substation of the distribution network area using a virtual reality image acquisition system. The images mainly show the environmental conditions around and inside the substation.

[0048] Composite images are three-dimensional images obtained by stitching together multiple acquired two-dimensional planar images.

[0049] Optionally, the server can stitch together multiple two-dimensional planar images collected from the area around and inside the power distribution room of the power distribution network area to obtain a three-dimensional composite image representing the environmental conditions of the power distribution room.

[0050] Step 204: Based on the combined images, construct an initial three-dimensional virtual scene of the target area using virtual reality technology.

[0051] Virtual reality (VR) technology uses computer and sensor technologies to create a means of human-computer interaction. It simulates a three-dimensional virtual world, providing users with sensory experiences such as sight, hearing, and touch, allowing them to feel as if they are actually there, and to observe objects in three-dimensional space in a timely and unrestricted manner. The initial three-dimensional virtual scene is a simulation of the real environment using VR technology.

[0052] Optionally, the server uses virtual reality technology to simulate the three-dimensional composite image obtained by stitching together two-dimensional planar images, which can obtain a computer simulation scene of the environmental conditions of the target area, that is, the initial three-dimensional simulation scene.

[0053] Step 206: Obtain device information within the target area and fuse the device information with the initial 3D virtual scene to obtain the target 3D virtual scene.

[0054] The equipment information refers to the dimensions, location, and operating parameters of each piece of equipment within the power distribution room. When the acquired equipment information differs from the information recorded in the instruction manual, the equipment information needs to be re-tested, and the result of this re-test will be the final result. For example, if the dimensions of a transformer obtained by the image acquisition device are incorrect compared to the dimensions recorded in the transformer instruction manual of a third-party system, manual re-testing is required. If the re-test reveals that the actual observed transformer height is correct, but the width recorded in the transformer instruction manual is accurate, the two sets of data will be integrated to obtain the accurate equipment information.

[0055] Optionally, when the server obtains device information for each device within the target area, if the obtained device information is inconsistent with the device information recorded in the instruction manual, the device will be re-detected, and the latest detection result will be used as the final result. The server will then overlay the finally determined device information with the initial 3D virtual scene to fuse the device information and the initial 3D virtual scene, thereby obtaining the target 3D virtual scene after overlaying the data.

[0056] Step 208: Establish operation interaction anchor points in the target 3D virtual scene to obtain the visualization application scene to which the target area belongs.

[0057] Among them, the task interaction anchor point is the anchor point for the interaction between the interactive object and the target 3D virtual scene. The task interaction anchor points are mainly established by the task guidance assistance system. After establishing the task interaction anchor points in the target 3D virtual scene, the task guidance assistance system also establishes a corresponding task library for the tasks that can be triggered by each task interaction anchor point. The task methods corresponding to a single task interaction anchor point in the task library all have trigger actions.

[0058] Optionally, the server establishes an interactive anchor point in the target 3D virtual scene for the interactive object to interact with the target 3D virtual scene, thereby obtaining a visualized application scenario of the interactive object interacting with the virtual scene of the target area.

[0059] In the aforementioned method for establishing a visualized scene based on virtual reality technology, by combining the collected images and then using virtual reality technology to construct an initial virtual scene from the combined images, two-dimensional planar images can be displayed in a three-dimensional form, thereby completing the virtualization of the scene within the target area. By integrating device information with the initial three-dimensional virtual scene, users can quickly obtain information data of interest in the virtual scene without having to actively retrieve or query data, thus improving the visualization of the scene. By establishing operation interaction anchor points, users can operate the device in the target three-dimensional virtual scene, thereby further enhancing the visualization of the scene.

[0060] In one embodiment, the plurality of images includes at least a first image, a second image, and a third image.

[0061] Multiple images acquired targeting a specific area are combined to obtain a composite image, including:

[0062] The first image is obtained by acquiring the first image of the target area according to the first acquisition cycle.

[0063] The target area is acquired in the second acquisition cycle to obtain the second image.

[0064] Extract the identical and different parts from the first and second images, and then perform a third image acquisition on the different parts to obtain the third image.

[0065] Based on the first image, the second image, and the third image, determine the real image corresponding to the difference.

[0066] By combining the real image with images of the same parts, a composite image is obtained.

[0067] The first acquisition cycle and the second acquisition cycle refer to the time interval between acquiring images of the surrounding environment of the target area. Generally, the first acquisition cycle is longer than the second acquisition cycle. For example, the first image acquisition of the target area is carried out once a month, and the second image acquisition of the target area is carried out once every 7 days.

[0068] The first and second images primarily depict the internal and external environments of the target area. The second image also includes captured images of altered environments or objects, as well as security and fire safety conditions within and outside the target area. A linkage control system exists to coordinate and control various working and monitoring devices within the target area, both locally and remotely. Each monitoring device has a separate data interface with the operation guidance auxiliary system that establishes operational interaction anchor points for data sharing. The linkage control system also includes lighting control devices, drainage pump control devices, fan control devices, heater control devices, air conditioning control devices, dehumidifier control devices, fresh air unit control devices, and rodent repellent control devices.

[0069] Optionally, the server performs first image acquisition on the internal and external environments of the target area at a first acquisition cycle interval, thereby obtaining a first image. Then, it performs second image acquisition on the same internal and external environments at a second acquisition cycle interval, thereby obtaining a second image. The server extracts images of the same and different portions from the first and second images acquired at different acquisition cycles, and re-acquires images of the different portions, thereby obtaining a third image. By verifying the first, second, and third images, the server can determine the real image corresponding to the difference between the first and second images. The server then stitches the verified real image with the extracted images of the same portions to obtain a three-dimensional composite image.

[0070] In this embodiment, by performing two or more image acquisitions on the target area, it can be ensured that the acquired images are the same as the real scene, thereby improving the accuracy of the initial three-dimensional virtual scene built based on the combined images.

[0071] In one embodiment, multiple images acquired targeting a target area are combined to obtain a combined image, including:

[0072] Acquire multiple images of the internal and external environments of the target area.

[0073] Each image is stitched together to obtain a composite image.

[0074] Among them, the multiple images of the external environment mainly include the geospatial environment and basic terrain outside the target area.

[0075] Optionally, the server can stitch together multiple two-dimensional planar images collected from the inside and outside of the target area, showing the geospatial environment and basic terrain outside the target area, to obtain a three-dimensional composite image.

[0076] Optionally, when the server collects images of the internal and external environment of the target area, it also monitors and collects information on the temperature and humidity of the target area, the water level in the cable trench, the concentration of sulfur hexafluoride, oxygen and ozone in the target area, and monitors the temperature inside the switch cabinet, the temperature of the wireless cable, the noise around the target area, harmful gases and water leakage in the target area.

[0077] In this embodiment, by stitching together two-dimensional planar images, the two-dimensional planar images can be displayed in a three-dimensional form, thereby providing a three-dimensional combined image for the virtualization of the scene within the target area.

[0078] In one embodiment, the device information includes the device's size parameters and the device's operating parameters.

[0079] Acquire device information within the target area and fuse this device information with the initial 3D virtual scene to obtain the target 3D virtual scene, including:

[0080] The device's dimensional parameters are fused with the initial 3D virtual scene to obtain a 3D virtual scene.

[0081] Establish the association between the working parameter information of the equipment and the corresponding equipment in the 3D virtual scene to obtain the target 3D virtual scene.

[0082] The equipment's operating parameters mainly include transformer temperature, switchgear contact temperature, switchgear partial discharge, low-voltage feeder parameters, and battery parameters.

[0083] Optionally, the server overlays the device's size parameters onto the initial 3D virtual scene, and then fuses the various devices within the target area with the initial 3D virtual scene to obtain a 3D virtual scene that integrates data and images. The server also correlates the operating parameters of devices such as transformer temperature parameters, switchgear contact temperature parameters, switchgear partial discharge parameters, low-voltage feeder parameters, and battery parameters with the corresponding devices in the 3D virtual scene to obtain the target 3D virtual scene.

[0084] In this embodiment, by integrating device information with the initial 3D virtual scene, users can quickly obtain information data of interest in the virtual scene without having to actively retrieve or query data, thus improving the visualization of the scene.

[0085] In one embodiment, such as Figure 3 As shown, interactive anchor points are established in the target 3D virtual scene to obtain the visualization application scene to which the target area belongs, including:

[0086] Step 302: Obtain the position information of each device in the target 3D virtual scene.

[0087] In this context, the position information of each device in the target 3D virtual scene is the same as its position information in the target area. For example, if the position information of device A in the target area is X, then the position information of device A in the target 3D virtual scene is also X.

[0088] Step 304: Based on the location information of each device, determine the trigger position of the operation interaction anchor point of each device to obtain the visualization application scenario to which the target area belongs.

[0089] The trigger position is the location where the interactive object completes its interaction with the device. It can also be understood as the point where the interactive object can trigger the task's interaction anchor point and achieve interaction with the device. When the interactive object interacts with the device at the trigger position, it can only achieve correct interaction by performing the set trigger action. The set trigger action can be a voice message or a set of triggering procedures.

[0090] Visualized application scenarios utilize and integrate various high technologies such as 3D graphics technology, multimedia technology, simulation technology, display technology, and servo technology. With the help of computers and other equipment, they generate a realistic 3D virtual application scenario that provides a multi-sensory experience, including visual, tactile, and olfactory sensations. This allows people in the virtual application scenario to feel as if they are actually there.

[0091] Optionally, the server determines the trigger position of each device in the target 3D virtual scene based on the obtained position information of the device in the target 3D virtual scene. After the trigger positions of all devices are confirmed and set, a visual application scene corresponding to the target area can be obtained.

[0092] In this embodiment, by fixing the trigger position of the work interaction anchor point of the fixed device, it is possible to avoid the interactive object accidentally operating other devices when performing the work, thereby improving the accuracy of triggering the work interaction anchor point to perform the work.

[0093] In one embodiment, after obtaining the visualization application scenario to which the target area belongs, the process includes:

[0094] Based on the trigger location, the task interaction anchor point in the visualization application scenario is triggered, and the task method of the device corresponding to the task interaction anchor point is obtained. The task method is used to guide the interactive object to execute the corresponding task.

[0095] The work mainly includes routine inspections and operations performed according to work permits. Work permits are divided into two types: Type 1 and Type 2. Type 1 work permits mainly include operations requiring complete or partial power outages on high-voltage equipment, operations on secondary systems and lighting circuits, power outages or safety measures for high-voltage equipment, power outages on high-voltage power cables, operations on converter transformers, DC field equipment and valve hall equipment, deactivation of high-voltage DC systems or DC filters, operations on converter valve cooling systems, valve hall air conditioning systems, fire alarm systems and video surveillance systems, and other operations requiring power outages or safety measures for high-voltage equipment. The second type of work permit includes work on control panels and low-voltage distribution panels, distribution boxes, power supply lines, secondary systems and lighting circuits, work using insulating rods, phase comparators and voltage transformers for phasing or using clamp-on ammeters to measure the current in high-voltage circuits, work on the casing of live equipment, work where it is impossible to touch the conductive parts of live equipment, work on high-voltage power cables that do not require power outages, work on converter transformers, DC field equipment and valve hall equipment, work on DC protection control systems, work on converter valve water cooling systems, valve hall air conditioning systems, fire alarm systems and image monitoring systems.

[0096] Optionally, the server can control the interactive object to trigger the device's operation interaction anchor point in the visualization application scenario at the device's trigger location, thereby obtaining the operation method that guides the interactive object to execute the corresponding operation, so that the interactive object can correctly perform the operation on the device.

[0097] In this embodiment, by triggering the task interaction anchor point in the visualization application scenario, the task method for executing the task can be obtained, and the task execution plan of the interactive object can be determined so that the inexperienced interactive object can complete the task correctly.

[0098] This application also provides an application scenario in which the above-described visualization scene establishment method based on virtual reality technology is applied. Specifically, the application of the visualization scene establishment method based on virtual reality technology in this scenario is as follows: A virtual reality image acquisition system is used to acquire images of the internal and external environments of the target area at a sampling frequency of a first acquisition cycle, obtaining a first image. A third-party monitoring system is used to acquire images of the internal and external environments of the target area at a sampling frequency of a second acquisition cycle, obtaining a second image. A data monitoring system is used to verify the first image obtained by the virtual reality image acquisition system and the second image obtained by the third-party monitoring system, extracting the identical and different parts of the first and second images, and then re-acquiring the images of the different parts to obtain a third image. Based on the detection of the first, second, and third images, the real images corresponding to the different parts can be obtained. The real images and the extracted images of the identical parts are then stitched together to create a three-dimensional composite image from two-dimensional planar images. Virtual reality technology is used to virtualize the obtained composite image to obtain an initial three-dimensional virtual scene of the target area. The size parameter information and position information of each device in the target area are obtained and fused with the constructed initial three-dimensional virtual scene to obtain a three-dimensional virtual scene. Next, the working parameter information of equipment such as transformer temperature parameters, switchgear contact temperature parameters, switchgear partial discharge parameters, low-voltage feeder parameters, and battery parameters is established and associated with the corresponding equipment in the 3D virtual scene, thus obtaining the target 3D virtual scene. Based on the position of each device within the target area in the target 3D virtual scene, the trigger position for each device's interactive anchor point is determined. After all device trigger positions are determined and set, a visualized application scene is obtained that allows real-time monitoring of the target area and interactive operation of the equipment. Interactive objects, by completing the set tasks at the trigger positions of each device, trigger the device's interactive anchor point, obtain the device's operation method, and can perform operations on the device according to the operation method.

[0099] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0100] Based on the same inventive concept, this application also provides a virtual reality-based visualization scene creation device for implementing the above-mentioned virtual reality-based visualization scene creation method. The solution provided by this device is similar to the solution described in the above method. Therefore, the specific limitations of one or more virtual reality-based visualization scene creation device embodiments provided below can be found in the limitations of the virtual reality-based visualization scene creation method described above, and will not be repeated here.

[0101] In one embodiment, such as Figure 4 As shown, a visualization scene creation device based on virtual reality technology is provided, comprising:

[0102] The combined image acquisition module 402 is used to combine multiple images acquired for a target area to obtain a combined image.

[0103] The initial 3D virtual scene construction module 404 is used to construct an initial 3D virtual scene of a target area based on combined images using virtual reality technology.

[0104] The target 3D virtual scene construction module 406 is used to acquire device information within the target area and fuse the device information with the initial 3D virtual scene to obtain the target 3D virtual scene.

[0105] The visualization application scenario construction module 408 is used to establish operation interaction anchor points in the target 3D virtual scene to obtain the visualization application scenario to which the target area belongs.

[0106] In one embodiment, the combined image acquisition module includes:

[0107] The first image acquisition unit is used to acquire a first image of the target area according to a first acquisition cycle, thereby obtaining a first image.

[0108] The second image acquisition unit is used to acquire a second image of the target area according to the second acquisition cycle, and obtain a second image.

[0109] The third image acquisition unit is used to extract the same and different parts from the first and second images, and to perform a third image acquisition on the different parts to obtain the third image.

[0110] The real image acquisition unit is used to determine the real image corresponding to the difference portion based on the first image, the second image, and the third image.

[0111] The first combined image acquisition unit is used to combine a real image and an image of the same part to obtain a combined image.

[0112] In one embodiment, the combined image acquisition module includes:

[0113] The image acquisition unit is used to acquire multiple images of the internal and external environments of the target area.

[0114] The second combined image acquisition unit is used to stitch together each image to obtain a combined image.

[0115] In one embodiment, the target 3D virtual scene construction module includes:

[0116] The 3D virtual scene construction unit is used to fuse the device's size parameter information with the initial 3D virtual scene to obtain a 3D virtual scene.

[0117] The target 3D virtual scene construction unit is used to establish the association between the working parameter information of the device and the corresponding device in the 3D virtual scene, so as to obtain the target 3D virtual scene.

[0118] In one embodiment, the visualization application scenario construction module includes:

[0119] The location information acquisition unit is used to acquire the location information of each device in the target 3D virtual scene.

[0120] The visualization application scenario construction unit is used to determine the trigger position of the operation interaction anchor point of each device based on the location information of each device, so as to obtain the visualization application scenario to which the target area belongs.

[0121] In one embodiment, the visualization application scenario construction unit includes:

[0122] The anchor point trigger subunit is used to trigger the job interaction anchor point in the visualization application scenario based on the trigger location, and obtain the job method of the device corresponding to the job interaction anchor point. The job method is used to guide the interaction object to execute the corresponding job.

[0123] The modules in the aforementioned virtual reality-based visualization scene creation device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the corresponding operations of each module.

[0124] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 5As shown, the computer device includes a processor, memory, input / output (I / O) interfaces, and a communication interface. The processor, memory, and I / O interfaces are connected via a system bus, and the communication interface is also connected to the system bus via the I / O interfaces. The processor provides computational and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides the environment for the operating system and computer programs stored in the non-volatile storage media. The database stores composite images, an initial 3D virtual scene, device information, a target 3D virtual scene, interactive anchor points, visualization application scenarios, a first image, a second image, a third image, identical parts, differing parts, real images corresponding to the differing parts, location information of each device in the target 3D virtual scene, trigger locations, and operation method data. The I / O interfaces are used for exchanging information between the processor and external devices. The communication interface is used for communicating with external terminals via a network connection. When executed by the processor, the computer program implements a visualization scene creation method based on virtual reality technology.

[0125] Those skilled in the art will understand that Figure 5 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0126] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0127] Multiple images collected from the target area are combined to obtain a composite image. Based on the composite image, an initial 3D virtual scene of the target area is constructed using virtual reality technology. Equipment information within the target area is acquired and fused with the initial 3D virtual scene to obtain the target 3D virtual scene. Interactive anchor points are established within the target 3D virtual scene to obtain the visualization application scene to which the target area belongs.

[0128] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0129] A first image is acquired by acquiring the target area according to the first acquisition cycle. A second image is acquired by acquiring the target area according to the second acquisition cycle. The similarities and differences between the first and second images are extracted, and a third image is acquired on the differences to obtain a third image. Based on the first, second, and third images, the corresponding ground truth images are determined. The ground truth images and the images of the similarities are combined to obtain a composite image.

[0130] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0131] Acquire multiple images of the internal and external environments of the target area. Stitch these images together to obtain a composite image.

[0132] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0133] The device's dimensional parameters are fused with the initial 3D virtual scene to obtain a 3D virtual scene. The association between the device's operating parameters and the corresponding device in the 3D virtual scene is established to obtain the target 3D virtual scene.

[0134] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0135] Obtain the location information of each device in the target 3D virtual scene. Based on the location information of each device, determine the trigger position of the operation interaction anchor point of each device, and obtain the visualization application scene to which the target area belongs.

[0136] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0137] Based on the trigger location, the task interaction anchor point in the visualization application scenario is triggered, and the task method of the device corresponding to the task interaction anchor point is obtained. The task method is used to guide the interactive object to execute the corresponding task.

[0138] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, performs the following steps:

[0139] Multiple images acquired targeting the target area are combined to obtain a composite image. Based on the composite image, an initial 3D virtual scene of the target area is constructed using virtual reality technology. Device information within the target area is acquired and fused with the initial 3D virtual scene to obtain the target 3D virtual scene.

[0140] Establish operation interaction anchor points in the target 3D virtual scene to obtain the visualization application scene to which the target area belongs.

[0141] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0142] A first image is acquired by acquiring the target area according to the first acquisition cycle. A second image is acquired by acquiring the target area according to the second acquisition cycle. The first image and the second image are then extracted.

[0143] The first, second, and third images are compared to identify the identical and different parts. A third image is then captured of the different parts to obtain the third image. Based on the first, second, and third images, the corresponding real image for the different parts is determined.

[0144] By combining the real image with images of the same parts, a composite image is obtained.

[0145] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0146] Acquire multiple images of the internal and external environments of the target area. Stitch these images together to obtain a composite image.

[0147] 0 In one embodiment, when the computer program is executed by the processor, it further performs the following steps:

[0148] The device's dimensional parameters are fused with the initial 3D virtual scene to obtain a 3D virtual scene. The association between the device's operating parameters and the corresponding device in the 3D virtual scene is established to obtain the target 3D virtual scene.

[0149] In one embodiment, when the computer program is executed by a processor, it further performs the following step: 5. Obtaining the position information of each device in the target 3D virtual scene. Based on the position information of each device,

[0150] Determine the trigger position of the operation interaction anchor point for each device to obtain the visualized application scenario to which the target area belongs.

[0151] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0152] Based on the trigger location, the task interaction anchor point in the visualization application scenario is triggered, and the task method of the device corresponding to the task interaction anchor point is obtained. The task method is used to guide the interactive object to execute the corresponding task.

[0153] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:

[0154] Multiple images collected from the target area are combined to obtain a composite image. Based on the composite image, an initial 3D virtual scene of the target area is constructed using virtual reality technology. Equipment information within the target area is acquired and fused with the initial 3D virtual scene to obtain the target 3D virtual scene. Interactive anchor points are established within the target 3D virtual scene to obtain the visualization application scene to which the target area belongs.

[0155] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0156] A first image is acquired by acquiring the target area according to the first acquisition cycle. A second image is acquired by acquiring the target area according to the second acquisition cycle. The similarities and differences between the first and second images are extracted, and a third image is acquired on the differences to obtain a third image. Based on the first, second, and third images, the corresponding ground truth images are determined. The ground truth images and the images of the similarities are combined to obtain a composite image.

[0157] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0158] Acquire multiple images of the internal and external environments of the target area. Stitch these images together to obtain a composite image.

[0159] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0160] The device's dimensional parameters are fused with the initial 3D virtual scene to obtain a 3D virtual scene. The association between the device's operating parameters and the corresponding device in the 3D virtual scene is established to obtain the target 3D virtual scene.

[0161] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0162] Obtain the location information of each device in the target 3D virtual scene. Based on the location information of each device, determine the trigger position of the operation interaction anchor point of each device, and obtain the visualization application scene to which the target area belongs.

[0163] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0164] Based on the trigger location, the task interaction anchor point in the visualization application scenario is triggered, and the task method of the device corresponding to the task interaction anchor point is obtained. The task method is used to guide the interactive object to execute the corresponding task.

[0165] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data shall comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0166] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0167] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0168] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for establishing a visual scene based on virtual reality technology, characterized in that, The method includes: Multiple images collected for the target area are combined to obtain a composite image; Based on the combined images, an initial three-dimensional virtual scene of the target area is constructed using virtual reality technology; Obtain device information within the target area and fuse the device information with the initial three-dimensional virtual scene to obtain the target three-dimensional virtual scene; Establish task interaction anchor points in the target 3D virtual scene to obtain the visualization application scene to which the target area belongs; The plurality of images includes at least a first image, a second image, and a third image; The process of combining multiple images acquired targeting a target area to obtain a combined image includes: A first image is acquired by acquiring the target area according to the first acquisition cycle; A second image is obtained by acquiring the target area according to the second acquisition cycle; Extract the identical and different parts from the first and second images, and perform a third image acquisition on the different parts to obtain a third image; Based on the first image, the second image, and the third image, determine the real image corresponding to the difference portion; By combining the real image and the image of the same part, a composite image is obtained.

2. The method according to claim 1, characterized in that, The process of combining multiple images acquired targeting a target area to obtain a combined image includes: Acquire multiple images of the internal and external environments of the target area; Each of the images is stitched together to obtain a combined image.

3. The method according to claim 1, characterized in that, The equipment information includes the equipment's size parameters and operating parameters. The step of acquiring device information within the target area and fusing the device information with the initial 3D virtual scene to obtain the target 3D virtual scene includes: The size parameters of the device are fused with the initial three-dimensional virtual scene to obtain a three-dimensional virtual scene; Establish the association between the working parameter information of the device and the corresponding device in the three-dimensional virtual scene to obtain the target three-dimensional virtual scene.

4. The method according to claim 1, characterized in that, The step of establishing interactive anchor points in the target 3D virtual scene to obtain the visualization application scene to which the target area belongs includes: Obtain the position information of each device in the target 3D virtual scene; Based on the location information of each device, the trigger position of the operation interaction anchor point of each device is determined, and the visualization application scenario to which the target area belongs is obtained.

5. The method according to claim 4, characterized in that, After obtaining the visualization application scenario to which the target area belongs, the process includes: Based on the trigger location, the task interaction anchor point in the visualization application scenario is triggered to obtain the task method of the device corresponding to the task interaction anchor point; the task method is used to guide the interactive object to perform the corresponding task.

6. A visualization scene creation device based on virtual reality technology, characterized in that, The device includes: The combined image acquisition module is used to combine multiple images acquired for a target area to obtain a combined image; An initial 3D virtual scene construction module is used to construct an initial 3D virtual scene of the target area based on the combined images using virtual reality technology; A target 3D virtual scene construction module is used to acquire device information within the target area and fuse the device information with the initial 3D virtual scene to obtain the target 3D virtual scene; A visualization application scenario construction module is used to establish operation interaction anchor points in the target 3D virtual scene to obtain the visualization application scenario to which the target area belongs; The combined image acquisition module includes: The first image acquisition unit is used to acquire a first image of the target area according to a first acquisition cycle, thereby obtaining a first image. The second image acquisition unit is used to acquire a second image of the target area according to the second acquisition cycle, and obtain a second image. The third image acquisition unit is used to extract the same and different parts in the first image and the second image, and to perform a third image acquisition on the different parts to obtain the third image; The real image acquisition unit is used to determine the real image corresponding to the difference portion based on the first image, the second image, and the third image; The first combined image acquisition unit is used to combine the real image and images of the same part to obtain the combined image.

7. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 5.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 5.

9. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 5.

Images