An edge computing terminal data ar online visualization implementation method

Abstract

The application provides an AR online visualization implementation method for edge computing terminal data, which realizes the mobile visualization of an AR visualization device by connecting the AR visualization device with edge computing terminals corresponding to different real scenes, so that the AR visualization device can always obtain monitoring image data from the corresponding edge computing terminal during the position change of the different real scenes, ensures that the AR visualization device can still realize continuous and stable display operation when moving to different real scenes, and improves the working reliability of the AR visualization device.

Description

Technical Field

[0001] This invention relates to the field of augmented reality display technology, and in particular to a method for realizing AR online visualization of edge computing terminal data. Background Technology

[0002] Augmented Reality (AR) display technology refers to the real-time fusion of virtual and real content to create an interactive display between the virtual and the real world, enhancing the user's viewing experience. Existing AR display devices are all connected to fixed edge computing terminals, overlaying virtual images transmitted from a server terminal onto the environmental images of the real-world environment in which the AR display device is located to achieve the corresponding AR display mode. Thus, AR display devices must be connected to a single, fixed edge computing terminal to function. Currently, AR display devices are mostly head-mounted or glasses-based, worn by users in various real-world scenarios. Once the AR display device leaves the communication coverage area of ​​the fixed edge computing terminal, it will cease to function properly, compromising its ability to maintain stable display operation even when moving through different real-world environments, thus reducing the device's reliability. Summary of the Invention

[0003] To address the shortcomings of existing technologies, this invention provides an AR online visualization method for edge computing terminal data. It involves setting up edge computing terminals corresponding to different real-world scenarios to obtain monitoring image data for each scenario. The method instructs an AR visualization device to search for and connect to these edge computing terminals. Based on the working status of the currently connected edge computing terminals, it feeds back corresponding monitoring image data to the AR visualization device, causing the AR visualization device to enter the appropriate display mode. Based on the real-time relative position information between the AR visualization device and the currently connected edge computing terminals, it determines whether to instruct the AR visualization device to perform an edge computing terminal connection switching operation. After the AR visualization device completes the connection switching, it is instructed to re-acquire and display monitoring image data. By controlling the AR visualization device to communicate with edge computing terminals corresponding to different real-world scenarios, the method ensures that the AR visualization device can consistently obtain monitoring image data from the corresponding edge computing terminals as its location changes in different real-world scenarios. This achieves mobile visibility for the AR visualization device, ensuring continuous and stable display operation even when moving to different real-world scenarios, and improving the operational reliability of the AR visualization device.

[0004] This invention provides a method for implementing AR online visualization of edge computing terminal data, which includes the following steps:

[0005] Step S1: After the AR visual device is started, the AR visual device is instructed to enter the edge computing terminal search mode, so as to establish a communication connection between the AR visual device and the corresponding edge computing terminal; the AR visual device is instructed to send a terminal status identification request to the currently connected edge computing terminal, so as to determine the working status of the currently connected edge computing terminal.

[0006] Step S2: Based on the working status of the currently connected edge computing terminal, instruct the currently connected edge computing terminal to send the corresponding monitoring image data back to the AR visual device; instruct the AR visual device to enter the corresponding display mode based on the received monitoring image data;

[0007] Step S3: Obtain the real-time relative position information between the AR visual device and the currently connected edge computing terminal; based on the real-time relative position information, determine whether to instruct the AR visual device to perform an edge computing terminal connection switching operation;

[0008] Step S4: After the AR visual device completes the edge computing terminal connection switch, instruct the AR visual device to re-acquire and display the monitoring image data.

[0009] Furthermore, in step S1, after the AR visual device is activated, instructing the AR visual device to enter the edge computing terminal search mode, thereby establishing a communication connection between the AR visual device and the corresponding edge computing terminal, specifically includes:

[0010] When the AR visual device is activated, it is instructed to perform an edge computing terminal scanning and search mode to obtain the terminal identity information of all edge computing terminals existing within the preset communication range of the AR visual device.

[0011] The terminal identity information of each of the edge computing terminals is compared with the terminal identity information of the edge computing terminal that the AR visual device last connected to during its most recent operation.

[0012] If the terminal identity information of the last edge computing terminal that was last connected during the most recent operation is the same as the terminal identity information of one of the edge computing terminals, then the AR visual device is instructed to establish a communication connection with the last edge computing terminal that was last connected during the most recent operation.

[0013] If the terminal identity information of the last edge computing terminal connected during the most recent operation is different from the terminal identity information of all edge computing terminals, then the AR visual device is instructed to select one edge computing terminal from all edge computing terminals that meets the predetermined relative position condition or the predetermined communication strength condition for communication connection.

[0014] Furthermore, in step S1, instructing the AR visual device to send a terminal status identification request to the currently connected edge computing terminal to determine the working status of the currently connected edge computing terminal specifically includes:

[0015] The AR visual device is instructed to send a terminal status identification request to the currently connected edge computing terminal in order to obtain the real-time monitoring and shooting status of the currently connected edge computing terminal.

[0016] If the monitoring and shooting status indicates that the currently connected edge computing terminal has completed the corresponding monitoring and shooting task, then the currently connected edge computing terminal is determined to be in the monitoring work completed state.

[0017] If the monitoring and shooting status indicates that the currently connected edge computing terminal has not completed the corresponding monitoring and shooting task, then it is determined that the currently connected edge computing terminal is in a state where the monitoring work is not completed.

[0018] Furthermore, in step S2, instructing the currently connected edge computing terminal to feed back corresponding monitoring image data to the AR visual device based on the working status of the currently connected edge computing terminal specifically includes:

[0019] If the currently connected edge computing terminal is in a state of monitoring work completion, instruct the currently connected edge computing terminal to return all monitoring image data about the monitoring and shooting task to the AR visual device;

[0020] If the currently connected edge computing terminal is in a state where the monitoring work is not completed, instruct the currently connected edge computing terminal to synchronously return the currently obtained real-time monitoring image data to the AR visual device.

[0021] Furthermore, in step S2, instructing the AR visual device to enter the corresponding display mode based on the received monitoring image data specifically includes:

[0022] When the AR visual device receives all the monitoring image data related to the monitoring and shooting task, it converts all the monitoring image data into a three-dimensional image data stream; and instructs the AR visual device to enter a pure virtual image display mode to display a three-dimensional virtual image consistent with the three-dimensional image data stream.

[0023] When the AR visual device receives real-time monitoring image data returned by the currently connected edge computing terminal, it converts the monitoring image data into a three-dimensional image data stream; and instructs the AR visual device to enter the enhanced display image display mode, thereby superimposing the three-dimensional virtual image corresponding to the three-dimensional image data stream onto the three-dimensional environmental image corresponding to the real environment in which the AR visual device is currently located, thereby realizing AR image display.

[0024] Furthermore, in step S3, obtaining the real-time relative position information between the AR visual device and the currently connected edge computing terminal specifically includes:

[0025] The AR visual device is instructed to perform wireless remote sensing positioning detection on the currently connected edge computing terminal to obtain the real-time relative distance between the AR visual device and the currently connected edge computing terminal.

[0026] Furthermore, in step S3, determining whether to instruct the AR visual device to perform an edge computing terminal connection switching operation based on the real-time relative position information specifically includes:

[0027] The real-time relative distance is compared with a preset distance threshold; if the real-time relative distance is greater than or equal to the preset distance threshold, the AR visual device is instructed to perform an edge computing terminal connection switching operation; if the real-time relative distance is less than the preset distance threshold, the AR visual device is instructed to maintain the communication status with the currently connected edge computing terminal.

[0028] Furthermore, in step S4, after the AR visual device completes the edge computing terminal connection switch, instructing the AR visual device to re-acquire and display the monitoring image data specifically includes:

[0029] When the AR visual device is instructed to perform an edge computing terminal connection switching operation, another edge computing terminal that meets the predetermined relative position conditions and / or predetermined communication strength conditions is selected from all the edge computing terminals to perform the communication connection switching.

[0030] After the AR visual device completes the edge computing terminal connection switch, it is instructed to obtain monitoring image data from the other edge computing terminal and enter the corresponding display mode according to the monitoring image data.

[0031] Furthermore, in step S4, when instructing the AR visual device to perform an edge computing terminal connection switching operation, selecting another edge computing terminal from all edge computing terminals that meets predetermined relative position conditions or predetermined communication strength conditions for communication connection switching specifically includes:

[0032] Step S401: Using the following formula (1), select edge computing terminals that simultaneously meet the predetermined relative position condition and the predetermined communication strength condition from among the edge computing terminals.

[0033] A(a)=a×F{F[L(a) <L0]+F[V(a)≥V0]=2} (1)

[0034] In the above formula (1), A(a) represents the value of the a-th element in the edge computing terminal filtering array A; L(a) represents the real-time relative distance between the AR visual device and the a-th edge computing terminal; V(a) represents the communication speed between the AR visual device and the a-th edge computing terminal; L0 represents the preset distance threshold; V0 represents the preset communication speed threshold; F[] represents the judgment function. If the formula in the parentheses is true, the function value of the judgment function is 1; if the formula in the parentheses is false, the function value of the judgment function is 0.

[0035] The obtained edge computing terminal filtering array A is subjected to numerical elimination. The values ​​with a value of 0 in the array are eliminated, and the remaining values ​​are arranged in ascending order to form a new array denoted as B.

[0036] Step S402: If there are edge computing terminals that simultaneously meet the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is selected for communication connection switching based on the real-time relative distance and communication strength with each edge computing terminal using the following formula (2).

[0037]

[0038] In the above formula (2), I represents the optimal edge computing terminal number array when there are edge computing terminals that simultaneously meet the predetermined relative position conditions and the predetermined communication strength conditions; B(i) represents the value of the i-th element in array B; L[B(i)] represents the real-time relative distance between the AR visual device and the B(i)-th edge computing terminal; V[B(i)] represents the communication speed between the AR visual device and the B(i)-th edge computing terminal; size(B) represents the total number of elements in array B. This means substituting the value of i from 1 to size(B) into the expression. Lieutenant General All i values ​​that reach the maximum value are arranged into an array in descending order;

[0039] If there exists an edge computing terminal that simultaneously satisfies the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is the B[I(1)]th edge computing terminal, where I(1) represents the value of the first element in array I;

[0040] Step S403: If there are edge computing terminals that simultaneously meet the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is selected for communication connection switching by using the following formula (3) and weighted calculation based on the real-time relative distance according to the communication strength of each edge computing terminal.

[0041]

[0042] In the above formula (3), M represents the optimal edge computing terminal number array if there is no edge computing terminal that simultaneously satisfies the predetermined relative position condition and the predetermined communication strength condition; n represents the total number of edge computing terminals; This means substituting the values ​​of a from 1 to n into the input. Lieutenant General All i values ​​that reach the maximum value are arranged into an array in descending order;

[0043] If there is no edge computing terminal that simultaneously satisfies the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is the M(1)th edge computing terminal, where M(1) represents the value of the first element in array M.

[0044] Compared to existing technologies, this AR online visualization method for edge computing terminal data involves setting up edge computing terminals corresponding to different real-world scenarios to obtain monitoring image data for each scenario. It instructs the AR visualization device to search for and connect to these edge computing terminals. Based on the working status of the currently connected edge computing terminals, it feeds back the corresponding monitoring image data to the AR visualization device, enabling the AR visualization device to enter the appropriate display mode. Based on the real-time relative position information between the AR visualization device and the currently connected edge computing terminals, it determines whether to instruct the AR visualization device to perform an edge computing terminal connection switch operation. After the AR visualization device completes the connection switch, it is instructed to re-acquire and display monitoring image data. By controlling the AR visualization device to communicate with edge computing terminals corresponding to different real-world scenarios, it ensures that the AR visualization device can always obtain monitoring image data from the corresponding edge computing terminals during location changes in different real-world scenarios. This achieves mobile visibility for the AR visualization device, ensuring continuous and stable display operation even when moving to different real-world scenarios, and improving the operational reliability of the AR visualization device.

[0045] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings.

[0046] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0047] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0048] Figure 1 This is a flowchart illustrating an AR online visualization method for edge computing terminal data provided by the present invention. Detailed Implementation

[0049] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0050] See Figure 1 This is a flowchart illustrating an AR online visualization method for edge computing terminal data provided by an embodiment of the present invention. The AR online visualization method for edge computing terminal data includes the following steps:

[0051] Step S1: After the AR visual device is started, instruct the AR visual device to enter the edge computing terminal search mode, so as to establish a communication connection between the AR visual device and the corresponding edge computing terminal; instruct the AR visual device to send a terminal status identification request to the currently connected edge computing terminal, so as to determine the working status of the currently connected edge computing terminal.

[0052] Step S2: Based on the working status of the currently connected edge computing terminal, instruct the currently connected edge computing terminal to send the corresponding monitoring image data back to the AR visual device; instruct the AR visual device to enter the corresponding display mode based on the received monitoring image data;

[0053] Step S3: Obtain the real-time relative position information between the AR visual device and the currently connected edge computing terminal; based on the real-time relative position information, determine whether to instruct the AR visual device to perform an edge computing terminal connection switching operation;

[0054] Step S4: After the AR visual device completes the edge computing terminal connection switch, instruct the AR visual device to re-acquire and display the monitoring image data.

[0055] The beneficial effects of the above technical solution are as follows: This AR online visualization method for edge computing terminal data sets up edge computing terminals corresponding to different real-world scenarios to obtain monitoring image data for each real-world scenario. It instructs the AR visualization device to search for and connect to the edge computing terminals. Based on the working status of the currently connected edge computing terminals, it feeds back the corresponding monitoring image data to the AR visualization device, thereby enabling the AR visualization device to enter the corresponding display mode. Based on the real-time relative position information between the AR visualization device and the currently connected edge computing terminals, it determines whether to instruct the AR visualization device to perform an edge computing terminal connection switching operation. After the AR visualization device completes the edge computing terminal connection switching, it instructs the AR visualization device to re-acquire and display monitoring image data. By controlling the AR visualization device to communicate with edge computing terminals corresponding to different real-world scenarios, it ensures that the AR visualization device can always obtain monitoring image data from the corresponding edge computing terminals during location changes in different real-world scenarios. This achieves mobile visibility for the AR visualization device, ensuring continuous and stable display operation even when the AR visualization device moves to different real-world scenarios, and improving the operational reliability of the AR visualization device.

[0056] Preferably, in step S1, after the AR visual device is activated, instructing the AR visual device to enter the edge computing terminal search mode, thereby establishing a communication connection between the AR visual device and the corresponding edge computing terminal, specifically includes:

[0057] When the AR visual device is activated, it is instructed to perform an edge computing terminal scanning and search mode to obtain the terminal identity information of all edge computing terminals within the preset communication range of the AR visual device.

[0058] The terminal identity information of each of the edge computing terminals is compared with the terminal identity information of the edge computing terminal that the AR visual device last connected to during its most recent operation.

[0059] If the terminal identity information of the last edge computing terminal that was last connected during the most recent operation is the same as the terminal identity information of one of the edge computing terminals, then the AR visual device is instructed to establish a communication connection with the last edge computing terminal that was last connected during the most recent operation.

[0060] If the terminal identity information of the last edge computing terminal connected during the most recent operation is different from the terminal identity information of all edge computing terminals, the AR visual device is instructed to select one edge computing terminal from all edge computing terminals that meets the predetermined relative position condition or the predetermined communication strength condition for communication connection.

[0061] The beneficial effects of the above technical solution are as follows: In practical work, edge computing terminals can be set up one-to-one in real-world scenes at different locations. Each edge computing terminal can be connected to an edge control camera to monitor and capture the real-world scene at the corresponding location, obtaining corresponding monitoring image data. The AR visual device can be, but is not limited to, a head-mounted AR display or glasses-style AR display. When a user turns on the AR visual device and moves around in different real-world scenes while wearing it, the AR visual device will enter an edge computing terminal search mode, thereby communicating and connecting with a suitable edge computing terminal to obtain corresponding monitoring image data from the edge computing terminal. After entering the edge computing terminal scanning and search mode, the AR visual device will consider all edge computing terminals within a preset communication range as candidate edge computing terminals to be connected to. Then, based on the terminal identity information of the edge computing terminal last connected during the AR visual device's most recent operation, it will instruct the AR visual device to connect to a suitable edge computing terminal. If the edge computing terminal that the AR visual device last connected to during its most recent operation exists among the candidate edge computing terminals for communication connection, then the AR visual device is directly connected to the corresponding edge computing terminal; if the edge computing terminal that the AR visual device last connected to during its most recent operation does not exist among the candidate edge computing terminals for communication connection, then the AR visual device is connected to one of the edge computing terminals. The predetermined relative position condition may be, but is not limited to, the edge computing terminal closest to the AR visual device, and the predetermined communication strength condition may be, but is not limited to, the edge computing terminal with the strongest communication signal to the AR visual device.

[0062] Preferably, in step S1, instructing the AR visual device to send a terminal status identification request to the currently connected edge computing terminal to determine the working status of the currently connected edge computing terminal specifically includes:

[0063] The AR visual device is instructed to send a terminal status identification request to the currently connected edge computing terminal in order to obtain the real-time monitoring and shooting status of the currently connected edge computing terminal.

[0064] If the monitoring status indicates that the currently connected edge computing terminal has completed the corresponding monitoring task, then the currently connected edge computing terminal is determined to be in the monitoring work completed state.

[0065] If the monitoring status indicates that the currently connected edge computing terminal has not completed the corresponding monitoring task, then the currently connected edge computing terminal is determined to be in a state where the monitoring work is not completed.

[0066] The beneficial effects of the above technical solution are as follows: Each edge computing terminal controls its corresponding edge control camera to perform a corresponding monitoring and shooting task on the real scene in which it is located. This monitoring and shooting task can be, but is not limited to, scanning and shooting a predetermined area of ​​the real scene. By instructing the AR visual device to obtain the real-time monitoring and shooting status of the currently connected edge computing terminal (such as the real-time scanning and shooting action of the corresponding edge control camera), it can accurately determine whether the currently connected edge computing terminal has instructed the edge control camera to complete the corresponding monitoring and shooting task, facilitating the subsequent return of appropriate monitoring image data from the currently connected edge computing terminal.

[0067] Preferably, in step S2, instructing the currently connected edge computing terminal to feed back corresponding monitoring image data to the AR visual device based on the working status of the currently connected edge computing terminal specifically includes:

[0068] If the currently connected edge computing terminal is in a state of monitoring work completion, instruct the currently connected edge computing terminal to return all monitoring image data about the monitoring and shooting task to the AR visual device;

[0069] If the currently connected edge computing terminal is in a state where the monitoring work is not completed, instruct the currently connected edge computing terminal to synchronously return the currently obtained real-time monitoring image data to the AR visual device.

[0070] The beneficial effects of the above technical solution are as follows: When the AR visual device is connected to the edge computing terminal, and the corresponding edge computing terminal has completed the corresponding monitoring and shooting task, the edge computing terminal will return all the monitoring image data of the completed monitoring and shooting task to the AR visual device. When the AR visual device is connected to the edge computing terminal, but the corresponding edge computing terminal has not completed the corresponding monitoring and shooting task, the edge computing terminal will synchronously return the currently obtained real-time monitoring image data to the AR visual device.

[0071] Preferably, in step S2, instructing the AR visual device to enter the corresponding display mode based on the received monitoring image data specifically includes:

[0072] When the AR visual device receives all the surveillance image data related to the surveillance shooting task, it converts all the surveillance image data into a three-dimensional image data stream; and instructs the AR visual device to enter a pure virtual image display mode to display a three-dimensional virtual image consistent with the three-dimensional image data stream.

[0073] When the AR visual device receives real-time monitoring image data returned by the currently connected edge computing terminal, it converts the monitoring image data into a three-dimensional image data stream; and instructs the AR visual device to enter the enhanced display image display mode, thereby superimposing the three-dimensional virtual image corresponding to the three-dimensional image data stream onto the three-dimensional environmental image corresponding to the real environment in which the AR visual device is currently located, thereby realizing AR image display.

[0074] The beneficial effects of the above technical solution are as follows: By employing the above method, the AR visual device can be controlled to enter different image display modes depending on whether the edge computing terminal has completed or not completed its monitoring and shooting task. When the edge computing terminal completes its monitoring and shooting task, all monitoring image data is converted into a 3D image data stream, and the AR visual device is instructed to enter a pure virtual image display mode. In this mode, the user can only view the 3D virtual image corresponding to all the monitoring image data through the AR visual device, enabling a review of the scene image of the real scene where the edge computing terminal is located. When the edge computing terminal has not completed its monitoring and shooting task, all monitoring image data is converted into a 3D image data stream, and then the 3D virtual image corresponding to this 3D image data stream is superimposed on the 3D environment image corresponding to the current real environment of the AR visual device. In this mode, the user can simultaneously view the 3D virtual image of both the real scene where the edge computing terminal is located and the real environment of the AR visual device, improving the realism of the AR visual device's image display.

[0075] Preferably, in step S3, obtaining the real-time relative position information between the AR visual device and the currently connected edge computing terminal specifically includes:

[0076] The AR visual device is instructed to perform wireless remote sensing positioning detection on the currently connected edge computing terminal to obtain the real-time relative distance between the AR visual device and the currently connected edge computing terminal.

[0077] The beneficial effects of the above technical solution are as follows: In practical work, the AR visual device can be instructed to send a wireless signal to the currently connected edge computing terminal, and the edge computing terminal can be used to analyze and process the signal strength attenuation of the received wireless signal to determine the real-time relative distance between the AR visual device and the currently connected edge computing terminal. The above wireless remote sensing positioning detection is a conventional distance detection method in this field, and will not be described in detail here.

[0078] Preferably, in step S3, determining whether to instruct the AR visual device to perform an edge computing terminal connection switching operation based on the real-time relative position information specifically includes:

[0079] The real-time relative distance is compared with a preset distance threshold. If the real-time relative distance is greater than or equal to the preset distance threshold, the AR visual device is instructed to perform an edge computing terminal connection switching operation. If the real-time relative distance is less than the preset distance threshold, the AR visual device is instructed to maintain the communication status with the currently connected edge computing terminal.

[0080] The beneficial effects of the above technical solution are as follows: When the real-time relative distance is greater than or equal to a preset distance threshold, it indicates that the AR visual device has left the communication signal coverage range of the edge computing terminal. At this time, the AR visual device is instructed to perform an edge computing terminal connection switching operation to switch to another edge computing terminal. When the real-time relative distance is less than the preset distance threshold, it indicates that the AR visual device is still within the communication signal coverage range of the edge computing terminal. At this time, the AR visual device is instructed to maintain its communication status with the currently connected edge computing terminal, thereby achieving continuous and stable image display of the AR visual device.

[0081] Preferably, in step S4, after the AR visual device completes the edge computing terminal connection switch, instructing the AR visual device to re-acquire and display the monitoring image data specifically includes:

[0082] When the AR visual device is instructed to perform an edge computing terminal connection switching operation, another edge computing terminal that meets the predetermined relative position conditions and / or predetermined communication strength conditions is selected from all the edge computing terminals to perform the communication connection switching.

[0083] Once the AR visual device completes the edge computing terminal connection switch, it is instructed to obtain monitoring image data from the other edge computing terminal and enter the corresponding display mode based on the monitoring image data.

[0084] The beneficial effects of the above technical solution are as follows: In the above manner, when the AR visual device is instructed to perform an edge computing terminal connection switching operation, another edge computing terminal that meets the predetermined relative position conditions or predetermined communication strength conditions is selected from all the edge computing terminals to perform a communication connection switching. At this time, the AR visual device is instructed to re-execute the above steps S2 and S3 for the newly connected edge computing terminal to achieve a stable and continuous display operation of the AR visual device.

[0085] Preferably, in step S4, when instructing the AR visual device to perform an edge computing terminal connection switching operation, selecting another edge computing terminal from all edge computing terminals that meets predetermined relative position conditions or predetermined communication strength conditions for communication connection switching specifically includes:

[0086] Step S401: Using the following formula (1), select edge computing terminals that simultaneously meet the predetermined relative position condition and the predetermined communication strength condition from among the edge computing terminals.

[0087] A(a)=a×F{F[L(a) <L0]+F[V(a)≥V0]=2} (1)

[0088] In the above formula (1), A(a) represents the value of the a-th element in the edge computing terminal filtering array A; L(a) represents the real-time relative distance between the AR visual device and the a-th edge computing terminal; V(a) represents the communication speed between the AR visual device and the a-th edge computing terminal; L0 represents the preset distance threshold; V0 represents the preset communication speed threshold; F[] represents the judgment function. If the formula in the parentheses is true, the function value of the judgment function is 1; if the formula in the parentheses is false, the function value of the judgment function is 0.

[0089] The obtained edge computing terminal filtering array A is subjected to numerical elimination. The values ​​with a value of 0 in the array are eliminated, and the remaining values ​​are arranged in ascending order to form a new array denoted as B.

[0090] Step S402: If there are edge computing terminals that simultaneously meet the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is selected for communication connection switching based on the real-time relative distance and communication strength with each edge computing terminal using the following formula (2).

[0091]

[0092] In the above formula (2), I represents the optimal edge computing terminal number array when there are edge computing terminals that simultaneously meet the predetermined relative position conditions and the predetermined communication strength conditions; B(i) represents the value of the i-th element in array B; L[B(i)] represents the real-time relative distance between the AR visual device and the B(i)-th edge computing terminal; V[B(i)] represents the communication speed between the AR visual device and the B(i)-th edge computing terminal; size(B) represents the total number of elements in array B. This means substituting the value of i from 1 to size(B) into the expression. Lieutenant General All i values ​​that reach the maximum value are arranged into an array in descending order.

[0093] If there exists an edge computing terminal that simultaneously satisfies the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is the B[I(1)]th edge computing terminal, where I(1) represents the value of the first element in array I;

[0094] Step S403: If there are edge computing terminals that simultaneously meet the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is selected for communication connection switching by using the following formula (3) and weighted calculation based on the real-time relative distance according to the communication strength of each edge computing terminal.

[0095]

[0096] In the above formula (3), M represents the optimal edge computing terminal number array if there is no edge computing terminal that simultaneously satisfies the predetermined relative position condition and the predetermined communication strength condition; n represents the total number of edge computing terminals; This means substituting the values ​​of a from 1 to n into the input. Lieutenant General All i values ​​that reach the maximum value are arranged into an array in descending order;

[0097] If there is no edge computing terminal that simultaneously satisfies the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is the M(1)th edge computing terminal, where M(1) represents the value of the first element in array M.

[0098] The beneficial effects of the above technical solution are as follows: Using the above formula (1), edge computing terminals that simultaneously meet the predetermined relative position conditions and predetermined communication strength conditions are selected from the edge computing terminals, thereby screening out high-quality edge computing terminals, which facilitates the subsequent acquisition of the optimal edge computing terminal; then using the above formula (2), the optimal edge computing terminal is selected for communication connection switching based on the real-time relative distance and communication strength of each edge computing terminal, thereby selecting the best edge computing terminal among the high-quality edge computing terminals and ensuring the stability of system communication; then using the above formula (3), the optimal edge computing terminal is selected for communication connection switching based on the communication strength of each edge computing terminal using real-time relative distance weighted calculation, thereby screening out the edge computing terminal with better communication quality that is closer when there is no high-quality edge computing terminal and switching is performed, thus ensuring the reliability of the system.

[0099] As can be seen from the above embodiments, this AR online visualization method for edge computing terminal data sets up edge computing terminals corresponding to different real-world scenarios to obtain monitoring image data for each real-world scenario. It instructs the AR visualization device to search for and communicate with the edge computing terminals. Based on the working status of the currently connected edge computing terminals, it feeds back the corresponding monitoring image data to the AR visualization device, thereby enabling the AR visualization device to enter the corresponding display mode. Based on the real-time relative position information between the AR visualization device and the currently connected edge computing terminals, it determines whether to instruct the AR visualization device to perform an edge computing terminal connection switching operation. After the AR visualization device completes the edge computing terminal connection switching, it instructs the AR visualization device to re-acquire and display monitoring image data. By controlling the AR visualization device to communicate with edge computing terminals corresponding to different real-world scenarios, it ensures that the AR visualization device can always obtain monitoring image data from the corresponding edge computing terminals during location changes in different real-world scenarios. This achieves the mobile visibility of the AR visualization device, ensuring that the AR visualization device can still achieve continuous and stable display operation even when moving to different real-world scenarios, thus improving the working reliability of the AR visualization device.

[0100] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A method for implementing AR online visualization of edge computing terminal data, characterized in that, It includes the following steps: Step S1: After the AR visual device is started, the AR visual device is instructed to enter the edge computing terminal search mode, so as to establish a communication connection between the AR visual device and the corresponding edge computing terminal; the AR visual device is instructed to send a terminal status identification request to the currently connected edge computing terminal, so as to determine the working status of the currently connected edge computing terminal. Step S2: Based on the working status of the currently connected edge computing terminal, instruct the currently connected edge computing terminal to send the corresponding monitoring image data back to the AR visual device; instruct the AR visual device to enter the corresponding display mode based on the received monitoring image data; Step S3: Obtain the real-time relative position information between the AR visual device and the currently connected edge computing terminal; Based on the real-time relative position information, determine whether to instruct the AR visual device to perform an edge computing terminal connection switching operation; Step S4: After the AR visual device completes the edge computing terminal connection switch, instruct the AR visual device to re-acquire and display the monitoring image data; Specifically, in step S1, instructing the AR visual device to send a terminal status identification request to the currently connected edge computing terminal to determine the working status of the currently connected edge computing terminal includes: The AR visual device is instructed to send a terminal status identification request to the currently connected edge computing terminal in order to obtain the real-time monitoring and shooting status of the currently connected edge computing terminal. If the monitoring and shooting status indicates that the currently connected edge computing terminal has completed the corresponding monitoring and shooting task, then the currently connected edge computing terminal is determined to be in the monitoring work completed state. If the monitoring and shooting status indicates that the currently connected edge computing terminal has not completed the corresponding monitoring and shooting task, then it is determined that the currently connected edge computing terminal is in a state where the monitoring work is not completed.

2. The AR online visualization method for edge computing terminal data as described in claim 1, characterized in that: In step S1, after the AR visual device is activated, instructing the AR visual device to enter the edge computing terminal search mode, thereby establishing a communication connection between the AR visual device and the corresponding edge computing terminal, specifically includes: When the AR visual device is activated, it is instructed to perform an edge computing terminal scanning and search mode to obtain the terminal identity information of all edge computing terminals existing within the preset communication range of the AR visual device. The terminal identity information of each of the edge computing terminals is compared with the terminal identity information of the edge computing terminal that the AR visual device last connected to during its most recent operation. If the terminal identity information of the last edge computing terminal that was last connected during the most recent operation is the same as the terminal identity information of one of the edge computing terminals, then the AR visual device is instructed to establish a communication connection with the last edge computing terminal that was last connected during the most recent operation. If the terminal identity information of the last edge computing terminal connected during the most recent operation is different from the terminal identity information of all edge computing terminals, then the AR visual device is instructed to select one edge computing terminal from all edge computing terminals that meets the predetermined relative position condition or the predetermined communication strength condition for communication connection.

3. The AR online visualization method for edge computing terminal data as described in claim 1, characterized in that: In step S2, instructing the currently connected edge computing terminal to send corresponding monitoring image data back to the AR visual device based on the current working status of the edge computing terminal specifically includes: If the currently connected edge computing terminal is in a state of monitoring work completion, instruct the currently connected edge computing terminal to return all monitoring image data about the monitoring and shooting task to the AR visual device; If the currently connected edge computing terminal is in a state where the monitoring work is not completed, instruct the currently connected edge computing terminal to synchronously return the currently obtained real-time monitoring image data to the AR visual device.

4. The AR online visualization method for edge computing terminal data as described in claim 3, characterized in that: In step S2, instructing the AR visual device to enter the corresponding display mode based on the received monitoring image data specifically includes: When the AR visual device receives all the monitoring image data related to the monitoring and shooting task, it converts all the monitoring image data into a three-dimensional image data stream; and instructs the AR visual device to enter a pure virtual image display mode to display a three-dimensional virtual image consistent with the three-dimensional image data stream. When the AR visual device receives real-time monitoring image data returned by the currently connected edge computing terminal, it converts the monitoring image data into a three-dimensional image data stream; and instructs the AR visual device to enter the enhanced display image display mode, thereby superimposing the three-dimensional virtual image corresponding to the three-dimensional image data stream onto the three-dimensional environmental image corresponding to the real environment in which the AR visual device is currently located, thereby realizing AR image display.

5. The AR online visualization method for edge computing terminal data as described in claim 4, characterized in that: In step S3, obtaining the real-time relative position information between the AR visual device and the currently connected edge computing terminal specifically includes: The AR visual device is instructed to perform wireless remote sensing positioning detection on the currently connected edge computing terminal to obtain the real-time relative distance between the AR visual device and the currently connected edge computing terminal.

6. The AR online visualization method for edge computing terminal data as described in claim 5, characterized in that: In step S3, determining whether to instruct the AR visual device to perform an edge computing terminal connection switching operation based on the real-time relative position information specifically includes: The real-time relative distance is compared with a preset distance threshold; if the real-time relative distance is greater than or equal to the preset distance threshold, the AR visual device is instructed to perform an edge computing terminal connection switching operation; if the real-time relative distance is less than the preset distance threshold, the AR visual device is instructed to maintain the communication status with the currently connected edge computing terminal.

7. The AR online visualization method for edge computing terminal data as described in claim 6, characterized in that: In step S4, after the AR visual device completes the edge computing terminal connection switch, instructing the AR visual device to re-acquire and display the monitoring image data specifically includes: When the AR visual device is instructed to perform an edge computing terminal connection switching operation, another edge computing terminal that meets the predetermined relative position conditions and / or predetermined communication strength conditions is selected from all the edge computing terminals to perform the communication connection switching. After the AR visual device completes the edge computing terminal connection switch, it is instructed to obtain monitoring image data from the other edge computing terminal and enter the corresponding display mode according to the monitoring image data.

8. The AR online visualization method for edge computing terminal data as described in claim 7, characterized in that: In step S4, when the AR visual device is instructed to perform an edge computing terminal connection switching operation, selecting another edge computing terminal from all edge computing terminals that meets predetermined relative position conditions or predetermined communication strength conditions for communication connection switching specifically includes: Step S401: Using the following formula (1), select an edge computing terminal that simultaneously meets the predetermined relative position condition and the predetermined communication strength condition from among the edge computing terminals. （1） In the above formula (1), Represents the edge computing terminal filter array The first in Each element value; This indicates that the AR visual device is related to the first... Real-time relative distance between edge computing terminals; This indicates that the AR visual device is related to the first... Communication speed between edge computing terminals; Indicates the preset distance threshold; Indicates the preset communication speed threshold; This represents a conditional function. If the expression within the parentheses is true, the function value is 1; if the expression within the parentheses is false, the function value is 0. Filter the obtained edge computing terminal array Perform numerical elimination by removing elements with a value of 0 from the array, and then forming a new array from the remaining values ​​in ascending order. ; Step S402: If there is an edge computing terminal that simultaneously meets the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is selected for communication connection switching based on the real-time relative distance and communication strength with each edge computing terminal using the following formula (2). （2） In the above formula (2), This represents the optimal edge computing terminal number array given that there exists an edge computing terminal that simultaneously satisfies the predetermined relative position condition and the predetermined communication strength condition. Represents array The first in Each element value; This indicates that the AR visual device is related to the first... Real-time relative distance between edge computing terminals; This indicates that the AR visual device is related to the first... Communication speed between edge computing terminals; Indicates the calculation of the array The total number of elements in the array; Indicates will The value ranges from 1 to Substitute into Lieutenant General All when the maximum value is obtained The values ​​are arranged in descending order to form an array; If an edge computing terminal exists that simultaneously satisfies the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is the [number]. An edge computing terminal, Represents array The first element value in; Step S403: If there are edge computing terminals that simultaneously meet the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is selected for communication connection switching by using the following formula (3) and weighted calculation based on the real-time relative distance according to the communication strength of each edge computing terminal. （3） In the above formula (3), This represents the optimal edge computing terminal number array when there is no edge computing terminal that simultaneously satisfies the predetermined relative position condition and the predetermined communication strength condition. This indicates the total number of edge computing terminals; Indicates will The value ranges from 1 to Substitute into Lieutenant General All when the maximum value is obtained The values ​​are arranged in descending order to form an array; If no edge computing terminal simultaneously meets the predetermined relative position condition and the predetermined communication strength condition, the optimal edge computing terminal is the [number]. An edge computing terminal, Represents array The first element value in the array.

Images