Real scene data interaction method and system based on edge calculation

Abstract

The invention belongs to the technical field of data interaction, and provides a real scene data interaction method and system based on edge computing, and the main scheme is that the method comprises the steps: obtaining a real-time distance between a VR operation end and controlled equipment, and judging whether the real-time distance exceeds a preset distance or not; if not, the VR operation end controls to use the first communication link to carry out communication data transmission with the controlled equipment, otherwise, the VR operation end controls to use the second communication link to carry out communication data transmission with the controlled equipment; when the first communication link is used for carrying out communication data transmission with the controlled equipment, the controlled equipment carries out soft compression on the collected image information and then transmits the image information to the VR operation end through the first communication link, and the VR operation end carries out soft decompression and then displays real scene data; and when the second communication link is used for carrying out communication data transmission with the controlled equipment, the controlled equipment carries out hard compression on the acquired image information and then transmits the image information to the VR operation end through the second communication link, and the VR operation end carries out hard decompression and then displays real scene data.

Description

Technical Field

[0001] This invention relates to the field of data interaction technology, and in particular to a data interaction method and system for real-world scenarios based on edge computing. Background Technology

[0002] With the development of VR technology, using VR operating devices for game simulation and military simulation training has become commonplace. Whether for game simulation or military simulation training, it is necessary for the perception data of the controlled device to be transmitted to the VR operating terminal as promptly as possible. To this end, see patent application CN117138329A, which discloses a distributed virtual game design system, which includes: a data processing module for acquiring real information of the user based on a tracking device and processing the real information to obtain virtual information based on a cloud platform server; a resource management module for allocating tasks and memory resources to device nodes based on distributed computing; and a network communication module for transmitting real information and virtual information.

[0003] Therefore, it can be seen that the above-mentioned patent application is based on distributed computing, in which multiple machines work together to complete the computing task, realize the conversion between real information and virtual information, reduce the computing burden of a single device, and can better realize the real-time interaction and computing of VR games. By utilizing distributed storage, computing and network capabilities, system resources can be flexibly allocated, better adapting to the multi-terminal and multi-interaction needs of VR games, reducing data transmission latency, thereby improving the real-time interactivity and data transmission efficiency of VR games.

[0004] However, while cloud-based data processing and transmission can alleviate data processing pressure, in general, when controlled devices (such as drones) and VR operators transmit and process data separately through the cloud platform, the timeliness depends on the powerful data processing performance of the cloud platform because the data needs to be uploaded to the cloud for processing and analysis. This also limits the size of the data to be processed. Typical VR games or VR military simulation training involve large-scale image information, making cloud platform data processing quite demanding. Furthermore, because data transmission using the cloud platform requires transmitting both the image information collected by the controlled device and the control commands from the VR operator separately, the security of data transmission is entirely dependent on the cloud platform manufacturer. Therefore, improvements are still needed in the security and timeliness of data transmission, as well as the reduction of dependence on the cloud platform during data processing, when using VR technology for game simulations or simulated military training. Summary of the Invention

[0005] The purpose of this invention is to provide a method and system for real-world data interaction based on edge computing. It can select appropriate data processing and communication transmission methods based on the real-time distance between the VR operator and the controlled device. This avoids the strong dependence on cloud platforms in traditional solutions, while also ensuring that data processing is stress-free and that data transmission is secure and timely.

[0006] The technical solution adopted by this invention to solve its technical problem is as follows: On the one hand, the present invention provides a real-world data interaction method based on edge computing, comprising the following steps: Obtain the real-time distance between the VR operator and the controlled device, and determine whether it exceeds the preset distance; When the preset distance is not exceeded, the VR operator controls the use of the first communication link to communicate and transmit data with the controlled device; otherwise, the VR operator controls the use of the second communication link to communicate and transmit data with the controlled device. When the VR operator controls the communication data transmission with the controlled device using the first communication link, the controlled device will soft-compress the collected image information and transmit it to the VR operator through the first communication link. The VR operator will then soft-decompress the image information and display the real scene data. When the VR operator uses the second communication link to communicate and transmit data with the controlled device, the controlled device will hard-compress the collected image information and transmit it to the VR operator through the second communication link. The VR operator will then hard-decompress the image information and display the real scene data.

[0007] As a further optimization, the VR operating terminal is configured with a first GPS location acquisition unit, a first processor, a first memory, a second memory, a first communication unit, and a second communication unit; The controlled device is equipped with an image sensing unit, a second GPS location acquisition unit, a second processor, a third memory, and a third communication unit.

[0008] As a further optimization, the VR operating terminal generates control commands for controlling the controlled device through a first processor.

[0009] As a further optimization, before the VR operating terminal generates control commands for controlling the controlled device via the first processor, the following is included: The first GPS location acquisition unit acquires the current location information of the VR operating terminal and transmits the current location information to the first processor; The first processor retrieves the first preset position information of the VR operating terminal from the first memory; After comparing the first preset position information with the current position information, the first processor determines whether to issue an adjustment position command. If it does, the VR operating terminal is moved to the target position, and the position information of the VR operating terminal at the target position is stored in the first memory.

[0010] As a further optimization, before the VR operating terminal generates control commands for controlling the controlled device via the first processor, it also includes: When the VR operator moves to the target location, it attempts to establish a first communication link with the third communication unit of the controlled device through the first communication unit. Once the first communication link is successfully established, the VR operator retrieves the second preset position information of the controlled device and the target position information of the VR operator from the first memory, and transmits them to the second processor through the first communication link. When the second processor receives the second preset location information, the controlled device controls the activation of the second GPS location acquisition unit and the image perception unit. When the second processor receives the target location information from the VR operation terminal, it stores the target location information in the third memory. After the second GPS location acquisition unit and the image perception unit are activated, the second GPS location acquisition unit acquires the real-time location information of the controlled device, and the image perception unit acquires the image information within the perception range.

[0011] As a further optimization, when the second GPS location acquisition unit and the image perception unit are activated, the controlled device notifies the first processor through the first communication link; When the first processor receives a notification from the controlled device, it notifies the user that they can operate the VR operating terminal.

[0012] As a further optimization, when the user operates the VR control terminal, it includes: The first processor receives the operation action and generates a first operation instruction based on the operation action; The first operation instruction is transmitted to the second processor via the first communication link; The second processor executes an action in response to the first operation instruction; The second GPS location acquisition unit acquires the real-time location information of the controlled device, while the image perception unit acquires image information within the perception range. The second processor compares the real-time location information of the controlled device with the target location information of the VR operating terminal stored in the third memory, and determines whether the preset distance is exceeded. If the distance is not exceeded, the first communication link is maintained to transmit communication data with the VR operating terminal; otherwise, the second communication link is started. When the controlled device and the VR operator transmit data through the first communication link, the controlled device will soft-compress the acquired image information and transmit it to the first processor in the VR operator through the first communication link. The first processor will soft-decompress the image information, store it in the first memory, and display it. At the same time, the controlled device will soft-compress the acquired image information and store it in the third memory.

[0013] As a further optimization, when the second processor controls the initiation of the second communication link, it includes: The third communication unit in the second processor attempts to establish a first communication connection with the cloud platform. Once the communication connection is established, the cloud platform establishes a second communication connection with the second communication unit in the VR operating terminal. Once the first and second communication connections are established, the controlled device will perform hardware compression on the acquired image information and transmit it to the cloud platform through the first communication connection. The cloud platform stores the hardware-compressed image information and simultaneously transmits the hardware-compressed image information to the first processor via a second communication connection; The first processor stores the hard-compressed image information into the second memory and then displays it.

[0014] As a further optimization, when storing compressed image information, the first memory, the second memory, the third memory, and the cloud platform delete images sequentially from the latest to the earliest storage time, based on their respective storage performance, until storage balance is achieved.

[0015] On the other hand, the present invention also provides a real-world data interaction system based on edge computing, and a method for real-world data interaction based on edge computing, comprising: The position acquisition and judgment unit is used to acquire the real-time distance between the VR operator and the controlled device, and to determine whether it exceeds the preset distance; Control unit, used for: When the preset distance is not exceeded, the VR operator controls the use of the first communication link to communicate and transmit data with the controlled device; otherwise, the VR operator controls the use of the second communication link to communicate and transmit data with the controlled device. When the VR operator controls the communication data transmission with the controlled device using the first communication link, the controlled device will soft-compress the collected image information and transmit it to the VR operator through the first communication link. The VR operator will then soft-decompress the image information and display the real scene data. When the VR operator uses the second communication link to communicate and transmit data with the controlled device, the controlled device will hard-compress the collected image information and transmit it to the VR operator through the second communication link. The VR operator will then hard-decompress the image information and display the real scene data.

[0016] The beneficial effects of this invention are as follows: This invention can select a suitable first or second communication link based on the distance between the VR operating terminal and the controlled device. Simultaneously, this invention configures corresponding processors on both the VR operating terminal and the controlled device, and performs edge computing and data storage on both the VR operating terminal and the controlled device under different communication links. Since this invention does not entirely rely on the data transmission function of traditional cloud platforms, it ensures timeliness when transmitting data between the VR operating terminal and the controlled device, and eliminates data transmission security risks. Furthermore, since this invention does not entirely rely on the data processing function of traditional cloud platforms, it enables edge computing to be performed separately on both the VR operating terminal and the controlled device, thereby avoiding the data processing pressure of traditional methods that rely solely on cloud platforms for data processing. Attached Figure Description

[0017] Figure 1 This is a flowchart of a real-world data interaction method based on edge computing in Embodiment 1 of the present invention. Detailed Implementation

[0018] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0019] Example 1

[0020] This embodiment provides a real-world data interaction method based on edge computing, and its flowchart is shown below. Figure 1 The method includes the following steps: Obtain the real-time distance between the VR operator and the controlled device, and determine whether it exceeds the preset distance; When the preset distance is not exceeded, the VR operator controls the use of the first communication link to communicate and transmit data with the controlled device; otherwise, the VR operator controls the use of the second communication link to communicate and transmit data with the controlled device. When the VR operator controls the communication data transmission with the controlled device using the first communication link, the controlled device will soft-compress the collected image information and transmit it to the VR operator through the first communication link. The VR operator will then soft-decompress the image information and display the real scene data. When the VR operator uses the second communication link to communicate and transmit data with the controlled device, the controlled device will hard-compress the collected image information and transmit it to the VR operator through the second communication link. The VR operator will then hard-decompress the image information and display the real scene data.

[0021] In this embodiment, two communication links are provided. If the distance between the VR operator and the controlled device is short, they can use the first communication link for direct data connection. In this case, there is no need to use a cloud platform for data processing and transmission, thus ensuring the security and accuracy of data transmission. Conversely, if the distance between the VR operator and the controlled device is long, a second communication link can be used to ensure data transmission between them. Regardless of the chosen communication link, both the VR operator and the controlled device are equipped with edge computing capabilities and compression and decompression functions for different communication links, enabling more timely data transmission without data processing overhead.

[0022] It should be noted that, since VR operating terminals are generally large in size, they typically do not move once their position is determined. Controlled devices (such as drones), on the other hand, require control commands from the VR operating terminal to execute corresponding actions. Therefore, the position of the controlled device is generally not fixed. Existing known wireless communication methods, in order to ensure timely data transmission while minimizing data loss, are limited by communication distance and the communication environment. In this embodiment, whether for game training scenarios or military simulation scenarios, the environment is often manually selected. Therefore, communication distance is a more reliable indicator for wireless data transmission. To sense the distance between the VR operating terminal and the controlled device, corresponding GPS location acquisition units need to be configured for both. Therefore, in this embodiment, the VR operating terminal should be equipped with a first GPS location acquisition unit, a first processor, a first memory, a second memory, a first communication unit, and a second communication unit; the controlled device should be equipped with an image sensing unit, a second GPS location acquisition unit, a second processor, a third memory, and a third communication unit.

[0023] In this embodiment, after selecting the communication link, it is necessary to inform the surrounding image information through the controlled device. Therefore, the controlled device can be configured with an image notification unit, which can be an image sensor group. The distance, installation orientation, and number of the image sensor group can be set and adjusted based on the actual application scenario. This embodiment does not require specific restrictions. At the same time, in order to ensure data processing pressure and data storage pressure, corresponding processors and memory can be configured for the VR operation terminal and the controlled device respectively.

[0024] In this embodiment, since the VR operating terminal is equipped with a first processor, the VR operating terminal can generate control commands for controlling the controlled device through the first processor.

[0025] Specifically, since the location of the VR operating terminal can be selected by the user, it is necessary to obtain the selected target location before the VR operating terminal generates control commands for controlling the controlled device through the first processor. Therefore, in this embodiment, the process before the VR operating terminal generates control commands for controlling the controlled device through the first processor may include: The first GPS location acquisition unit acquires the current location information of the VR operating terminal and transmits the current location information to the first processor; The first processor retrieves the first preset position information of the VR operating terminal from the first memory; After comparing the first preset position information with the current position information, the first processor determines whether to issue an adjustment position command. If it does, the VR operating terminal is moved to the target position, and the position information of the VR operating terminal at the target position is stored in the first memory.

[0026] Here, the target location information of the VR operating terminal stored in the first processor will generally not be changed in the current game simulation or military simulation training scenario. It can be stored in the first memory for the controlled device to call and for subsequent maintenance.

[0027] It should be noted that after the target location on the VR operating terminal is determined, the activity range and location of the controlled device also need to be determined based on the requirements of the usage scenario for subsequent game simulation or military simulation training. Therefore, in this embodiment, before the VR operating terminal generates control commands for controlling the controlled device through the first processor, it also needs to include: When the VR operator moves to the target location, it attempts to establish a first communication link with the third communication unit of the controlled device through the first communication unit. Once the first communication link is successfully established, the VR operator retrieves the second preset position information of the controlled device and the target position information of the VR operator from the first memory, and transmits them to the second processor through the first communication link. When the second processor receives the second preset location information, the controlled device controls the activation of the second GPS location acquisition unit and the image perception unit. When the second processor receives the target location information from the VR operation terminal, it stores the target location information in the third memory. After the second GPS location acquisition unit and the image perception unit are activated, the second GPS location acquisition unit acquires the real-time location information of the controlled device, and the image perception unit acquires the image information within the perception range.

[0028] Here, if the distance between the VR operator and the controlled device is within the communication range and the distance is short, the first communication link can be selected. At this time, both the VR operator and the controlled device can perform data processing and data storage locally, and can communicate and transmit data directly.

[0029] It should be noted that when the controlled device is close to the VR operating terminal, it is necessary to notify the user to conduct game simulation or military simulation training. Therefore, when the second GPS location acquisition unit and image perception unit are activated, the controlled device notifies the first processor through the first communication link. When the first processor receives a notification from the controlled device, it notifies the user that they can operate the VR operating terminal.

[0030] Specifically, since the VR operating terminal is equipped with data processing and output storage functions, both of which are performed locally on the VR operating terminal, when a user operates the VR operating terminal, it can include: The first processor receives the operation action and generates a first operation instruction based on the operation action; The first operation instruction is transmitted to the second processor via the first communication link; The second processor executes an action in response to the first operation instruction; The second GPS location acquisition unit acquires the real-time location information of the controlled device, while the image perception unit acquires image information within the perception range. The second processor compares the real-time location information of the controlled device with the target location information of the VR operating terminal stored in the third memory, and determines whether the preset distance is exceeded. If the distance is not exceeded, the first communication link is maintained to transmit communication data with the VR operating terminal; otherwise, the second communication link is started. When the controlled device and the VR operator transmit data through the first communication link, the controlled device will soft-compress the acquired image information and transmit it to the first processor in the VR operator through the first communication link. The first processor will soft-decompress the image information, store it in the first memory, and display it. At the same time, the controlled device will soft-compress the acquired image information and store it in the third memory.

[0031] Furthermore, when the controlled device is within communication range and gradually moves away from the VR operator, data transmission requires the assistance of a cloud platform. However, even though this embodiment utilizes the cloud platform's data processing and storage functions, the data processing is limited to image information compression and does not involve distributed storage or distributed computing. Therefore, even after establishing a second communication link between the cloud platform and the VR operator and the controlled device, the timeliness and security of data transmission are guaranteed because data compression itself does not depend on the cloud platform's data processing performance. Therefore, in this embodiment, when the second processor initiates the second communication link, it may include: The third communication unit in the second processor attempts to establish a first communication connection with the cloud platform. Once the communication connection is established, the cloud platform establishes a second communication connection with the second communication unit in the VR operating terminal. Once the first and second communication connections are established, the controlled device will perform hardware compression on the acquired image information and transmit it to the cloud platform through the first communication connection. The cloud platform stores the hardware-compressed image information and simultaneously transmits the hardware-compressed image information to the first processor via a second communication connection; The first processor stores the hard-compressed image information into the second memory and then displays it.

[0032] It should be noted that, regardless of the VR operating terminal, the controlled device, or the cloud platform, in order to avoid occupying too much storage resources on each terminal, the stored data can be deleted in an orderly manner according to the storage time, with the storage balance of the corresponding terminals as the benchmark. Therefore, in this embodiment, when storing compressed image information, the first memory, the second memory, the third memory, and the cloud platform can delete data in order from the latest to the earliest storage time based on their respective storage performance, until storage balance is achieved.

[0033] Example 2

[0034] Based on Embodiment 1, this embodiment provides a real-world data interaction system based on edge computing, including: The position acquisition and judgment unit is used to acquire the real-time distance between the VR operator and the controlled device, and to determine whether it exceeds the preset distance; Control unit, used for: When the preset distance is not exceeded, the VR operator controls the use of the first communication link to communicate and transmit data with the controlled device; otherwise, the VR operator controls the use of the second communication link to communicate and transmit data with the controlled device. When the VR operator controls the communication data transmission with the controlled device using the first communication link, the controlled device will soft-compress the collected image information and transmit it to the VR operator through the first communication link. The VR operator will then soft-decompress the image information and display the real scene data. When the VR operator uses the second communication link to communicate and transmit data with the controlled device, the controlled device will hard-compress the collected image information and transmit it to the VR operator through the second communication link. The VR operator will then hard-decompress the image information and display the real scene data.

[0035] As can be seen from the description of Embodiment 1, the application scenario and implementation principle of this embodiment are the same as those of Embodiment 1, so they will not be repeated here.

[0036] The above are merely preferred embodiments of the present invention and are not intended to limit the present invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A real-world data interaction method based on edge computing, characterized in that, Includes the following steps: Obtain the real-time distance between the VR operator and the controlled device, and determine whether it exceeds the preset distance; When the preset distance is not exceeded, the VR operator controls the use of the first communication link to communicate and transmit data with the controlled device; otherwise, the VR operator controls the use of the second communication link to communicate and transmit data with the controlled device. When the VR operator controls the communication data transmission with the controlled device using the first communication link, the controlled device will soft-compress the collected image information and transmit it to the VR operator through the first communication link. The VR operator will then soft-decompress the image information and display the real scene data. When the VR operator uses the second communication link to communicate and transmit data with the controlled device, the controlled device will hard-compress the collected image information and transmit it to the VR operator through the second communication link. The VR operator will then hard-decompress the image information and display the real scene data.

2. The real-world data interaction method based on edge computing according to claim 1, characterized in that, The VR operating terminal is equipped with a first GPS location acquisition unit, a first processor, a first memory, a second memory, a first communication unit, and a second communication unit; The controlled device is equipped with an image sensing unit, a second GPS location acquisition unit, a second processor, a third memory, and a third communication unit.

3. The real-world data interaction method based on edge computing according to claim 2, characterized in that, The VR operating terminal generates control commands for controlling the controlled device through the first processor.

4. The real-world data interaction method based on edge computing according to claim 3, characterized in that, Before the VR operating terminal generates control commands for controlling the controlled device via the first processor, the following steps are included: The first GPS location acquisition unit acquires the current location information of the VR operating terminal and transmits the current location information to the first processor; The first processor retrieves the first preset position information of the VR operating terminal from the first memory; After comparing the first preset position information with the current position information, the first processor determines whether to issue an adjustment position command. If it does, the VR operating terminal is moved to the target position, and the position information of the VR operating terminal at the target position is stored in the first memory.

5. The real-world data interaction method based on edge computing according to claim 3, characterized in that, Before the VR operating terminal generates control commands for controlling the controlled device via the first processor, it also includes: When the VR operator moves to the target location, it attempts to establish a first communication link with the third communication unit of the controlled device through the first communication unit. Once the first communication link is successfully established, the VR operator retrieves the second preset position information of the controlled device and the target position information of the VR operator from the first memory, and transmits them to the second processor through the first communication link. When the second processor receives the second preset location information, the controlled device controls the activation of the second GPS location acquisition unit and the image perception unit. When the second processor receives the target location information from the VR operation terminal, it stores the target location information in the third memory. After the second GPS location acquisition unit and the image perception unit are activated, the second GPS location acquisition unit acquires the real-time location information of the controlled device, and the image perception unit acquires the image information within the perception range.

6. The real-world data interaction method based on edge computing according to claim 5, characterized in that, When the second GPS location acquisition unit and the image sensing unit are activated, the controlled device notifies the first processor through the first communication link; When the first processor receives a notification from the controlled device, it notifies the user that they can operate the VR operating terminal.

7. The real-world data interaction method based on edge computing according to claim 6, characterized in that, When a user interacts with the VR controller, it includes: The first processor receives the operation action and generates a first operation instruction based on the operation action; The first operation instruction is transmitted to the second processor via the first communication link; The second processor executes an action in response to the first operation instruction; The second GPS location acquisition unit acquires the real-time location information of the controlled device, while the image perception unit acquires image information within the perception range. The second processor compares the real-time location information of the controlled device with the target location information of the VR operating terminal stored in the third memory, and determines whether the preset distance is exceeded. If the distance is not exceeded, the first communication link is maintained to transmit communication data with the VR operating terminal; otherwise, the second communication link is started. When the controlled device and the VR operator transmit data through the first communication link, the controlled device will soft-compress the acquired image information and transmit it to the first processor in the VR operator through the first communication link. The first processor will soft-decompress the image information, store it in the first memory, and display it. At the same time, the controlled device will soft-compress the acquired image information and store it in the third memory.

8. The real-world data interaction method based on edge computing according to claim 7, characterized in that, When the second processor initiates the second communication link, it includes: The third communication unit in the second processor attempts to establish a first communication connection with the cloud platform. Once the communication connection is established, the cloud platform establishes a second communication connection with the second communication unit in the VR operating terminal. Once the first and second communication connections are established, the controlled device will perform hardware compression on the acquired image information and transmit it to the cloud platform through the first communication connection. The cloud platform stores the hardware-compressed image information and simultaneously transmits the hardware-compressed image information to the first processor via a second communication connection; The first processor stores the hard-compressed image information into the second memory and then displays it.

9. The real-world data interaction method based on edge computing according to claim 7 or 8, characterized in that, When storing compressed image information, the first memory, the second memory, the third memory, and the cloud platform delete images sequentially from latest to earliest based on their respective storage performance until storage balance is achieved.

10. A real-world scene data interaction system based on edge computing, applied to the real-world scene data interaction method based on edge computing as described in any one of claims 1-9, characterized in that, include: The position acquisition and judgment unit is used to acquire the real-time distance between the VR operator and the controlled device, and to determine whether it exceeds the preset distance; Control unit, used for: When the preset distance is not exceeded, the VR operator controls the use of the first communication link to communicate and transmit data with the controlled device; otherwise, the VR operator controls the use of the second communication link to communicate and transmit data with the controlled device. When the VR operator controls the communication data transmission with the controlled device using the first communication link, the controlled device will soft-compress the collected image information and transmit it to the VR operator through the first communication link. The VR operator will then soft-decompress the image information and display the real scene data. When the VR operator uses the second communication link to communicate and transmit data with the controlled device, the controlled device will hard-compress the collected image information and transmit it to the VR operator through the second communication link. The VR operator will then hard-decompress the image information and display the real scene data.

Images