A VR calling method and system based on blockchain technology

Abstract

The present invention is applicable to the field of VR call technology, and provides a VR call method and system based on blockchain technology. The present invention obtains basic background video; obtains environmental shooting data, determines multiple target environmental entities; performs real-time call shooting, obtains call shooting data; obtains the current queue number, calculates the standard processing number; when the current queue number is less than the standard processing number, performs fine rendering edge processing and transmission; when the current queue number is not less than the standard processing number, performs basic rendering edge processing and transmission. It can combine local processing with edge computing, and monitor the data queue and processing performance of local call equipment and network edge equipment. In different states, fine rendering or basic rendering edge processing and transmission are performed respectively, so as to achieve low-latency, high-quality VR calls, effectively avoid call freezes, blurred images and other phenomena, and improve the user's call experience.

Description

Technical Field

[0001] The present invention belongs to the field of VR call technology, and in particular to a VR call method and system based on blockchain technology. Background Art

[0002] VR calls are a communication method that combines virtual reality and uses virtual reality technology to allow users to communicate in a virtual environment, providing a more immersive experience than traditional video calls and enhancing the sense of reality of face-to-face calls.

[0003] In the existing technology, since VR calls have very high requirements for computing resources and communication resources, and the computing resources and communication resources of local call equipment are limited, it is often difficult to achieve low-latency, high-quality VR calls by only processing and transmitting communication data through local call equipment. It is easy to experience call freezes, blurred images, etc., which affects the user's call experience. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide a VR calling method and system based on blockchain technology, aiming to solve the technical problems existing in the prior art mentioned in the background technology.

[0005] The embodiment of the present invention is implemented as follows:

[0006] A VR calling method based on blockchain technology, the method specifically comprising the following steps:

[0007] Based on blockchain technology, a basic background video selected by a user is obtained, and the basic background video is imported into a network edge device;

[0008] Initialize environmental shooting, obtain environmental shooting data, and receive a user's target selection operation, and identify and determine multiple target environmental entities from the environmental shooting data;

[0009] During a VR call on a local call device, real-time call recording is performed, call recording data is obtained, and transmitted to the network edge device;

[0010] Perform periodic data queue monitoring and processing performance monitoring on local call devices and network edge devices, obtain the current queue quantity, calculate the standard processing quantity, and compare the quantity;

[0011] When the current queue number is less than the standard processing number, edge processing and transmission of fine rendering of the basic background video by the call shooting data according to multiple target environment entities;

[0012] When the current queue quantity is not less than the standard processing quantity, the call shooting data is edge processed and transmitted for basic rendering of the basic background video.

[0013] As a further limitation of the technical solution of the embodiment of the present invention, the method of obtaining the basic background video selected by the user based on the blockchain technology and importing the basic background video into the network edge device specifically includes the following steps:

[0014] Receive a background selection request from the user;

[0015] Generate and display a background selection interface according to the background selection request;

[0016] Receiving a background selection operation from a user on the background selection interface;

[0017] Determining a basic background video according to the background selection operation;

[0018] Based on blockchain technology, the basic background video is imported into the network edge device.

[0019] As a further limitation of the technical solution of the embodiment of the present invention, the initializing environment shooting, acquiring environment shooting data, and receiving a user's target selection operation, and identifying and determining multiple target environment entities from the environment shooting data specifically include the following steps:

[0020] Initialize environmental shooting and obtain environmental shooting data;

[0021] Processing the environmental shooting data frame by frame and performing pixel comparison to select representative environmental pictures;

[0022] Interactively displaying the representative environment image and receiving a target selection operation from a user;

[0023] According to the target selection operation, identifying and determining a plurality of target environment entities from the representative environment picture;

[0024] According to the environmental shooting data, feature recognition is performed on a plurality of target environmental entities to obtain a plurality of entity feature data.

[0025] As a further limitation of the technical solution of the embodiment of the present invention, the periodic data queue monitoring and processing performance monitoring of the local call device and the network edge device, obtaining the current queue quantity, calculating the standard processing quantity, and performing quantity comparison specifically include the following steps:

[0026] According to the preset monitoring period, the local call device and the network edge device are monitored for periodic data queues to obtain the current queue quantity;

[0027] According to the preset monitoring cycle, periodic processing performance monitoring is performed on local call equipment and network edge equipment to obtain performance monitoring data;

[0028] Calculating a standard processing quantity based on the performance monitoring data;

[0029] The current queue quantity is compared with the standard processing quantity.

[0030] As a further limitation of the technical solution of the embodiment of the present invention, the calculation formula of the standard processing quantity is:

[0031]

[0032] Among them, L b is the standard processing quantity, λ is the data arrival rate, D t is the local processing delay, D e is the edge processing delay, k is the preset control variable, L q The preset expected number of queues.

[0033] As a further limitation of the technical solution of the embodiment of the present invention, when the number of the current queues is less than the standard processing number, the edge processing and transmission of fine rendering of the basic background video by the call shooting data according to multiple target environment entities specifically includes the following steps:

[0034] When the current queue quantity is less than the standard processing quantity, generating a fine rendering instruction;

[0035] Sending the fine rendering instruction to a network edge device;

[0036] Extracting entity dynamic data of a plurality of target environment entities from the call shooting data according to the plurality of entity feature data;

[0037] Extracting character dynamic data from the call shooting data;

[0038] According to the entity dynamic data and the character dynamic data, fine rendering is performed in the basic background video to generate fine VR call data;

[0039] The detailed VR call data is transmitted to the local call device.

[0040] As a further limitation of the technical solution of the embodiment of the present invention, when the number of the current queues is not less than the standard processing number, edge processing and transmission of the basic rendering of the basic background video by the call shooting data specifically includes the following steps:

[0041] When the current queue quantity is not less than the standard processing quantity, generating a basic rendering instruction;

[0042] Sending the basic rendering instruction to a network edge device;

[0043] Extracting character dynamic data from the call shooting data;

[0044] According to the character dynamic data, basic rendering is performed in the basic background video to generate basic VR call data;

[0045] The basic VR call data is transmitted to the local call device.

[0046] A VR call system based on blockchain technology, the system includes a basic background selection module, an environment shooting processing module, a real-time call shooting module, a quantity comparison processing module, a fine rendering transmission module and a basic rendering transmission module, wherein:

[0047] A basic background selection module is used to obtain a basic background video selected by a user based on blockchain technology, and import the basic background video into a network edge device;

[0048] An environment shooting processing module is used to initialize environment shooting, obtain environment shooting data, and receive a user's target selection operation, and identify and determine multiple target environment entities from the environment shooting data;

[0049] The real-time call shooting module is used to shoot the call in real time during the VR call of the local call device, obtain the call shooting data, and transmit it to the network edge device;

[0050] The quantity comparison processing module is used to monitor the periodic data queue and processing performance of the local call device and the network edge device, obtain the current queue quantity, calculate the standard processing quantity, and perform quantity comparison;

[0051] A fine rendering transmission module, for edge processing and transmitting the basic background video with fine rendering of the call shooting data according to a plurality of target environment entities when the current queue number is less than the standard processing number;

[0052] The basic rendering transmission module is used to perform edge processing and transmission of basic rendering of the call shooting data on the basic background video when the current queue quantity is not less than the standard processing quantity.

[0053] As a further limitation of the technical solution of the embodiment of the present invention, the environment shooting processing module specifically includes:

[0054] An environment shooting unit, used to initialize environment shooting and obtain environment shooting data;

[0055] A picture screening unit, used for performing frame-by-frame processing and pixel comparison on the environmental shooting data to screen representative environmental pictures;

[0056] An interactive display unit, used to interactively display the representative environment image and receive a target selection operation from a user;

[0057] An entity recognition unit, configured to recognize and determine a plurality of target environment entities from the representative environment picture according to the target selection operation;

[0058] The feature recognition unit is used to perform feature recognition on a plurality of target environment entities according to the environment shooting data, and obtain a plurality of entity feature data.

[0059] As a further limitation of the technical solution of the embodiment of the present invention, the quantity comparison processing module specifically includes:

[0060] A queue monitoring unit is used to perform periodic data queue monitoring on local call devices and network edge devices according to a preset monitoring period to obtain the current queue number;

[0061] The performance monitoring unit is used to perform periodic processing performance monitoring on the local call equipment and the network edge equipment according to a preset monitoring period and obtain performance monitoring data;

[0062] A standard calculation unit, used to calculate a standard processing quantity according to the performance monitoring data;

[0063] The quantity comparison unit is used to compare the current queue quantity with the standard processing quantity.

[0064] Compared with the prior art, the present invention has the following beneficial effects:

[0065] The embodiment of the present invention obtains basic background video; obtains environmental shooting data to determine multiple target environmental entities; performs real-time call shooting to obtain call shooting data; obtains the current queue number and calculates the standard processing number; performs fine rendering edge processing and transmission when the current queue number is less than the standard processing number; performs basic rendering edge processing and transmission when the current queue number is not less than the standard processing number. It is able to combine local processing with edge computing, and monitor the data queue and processing performance of local call devices and network edge devices. In different states, fine rendering or basic rendering edge processing and transmission are performed respectively, thereby achieving low-latency, high-quality VR calls, effectively avoiding call freezes, blurred images and other phenomena, and improving the user's call experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] Figure 1 A flowchart of a VR calling method based on blockchain technology provided by an embodiment of the present invention is shown;

[0067] Figure 2 A flowchart of obtaining a basic background video in a method provided by an embodiment of the present invention is shown;

[0068] Figure 3 A flowchart of environmental shooting data processing in the method provided by an embodiment of the present invention is shown;

[0069] Figure 4 A flow chart showing data queue monitoring and processing performance monitoring in a method provided by an embodiment of the present invention is shown;

[0070] Figure 5 A flow chart showing edge processing and transmission of fine rendering in a method provided by an embodiment of the present invention is shown;

[0071] Figure 6 A flowchart showing edge processing and transmission of basic rendering in the method provided by an embodiment of the present invention is shown;

[0072] Figure 7 An application architecture diagram of a VR call system based on blockchain technology provided by an embodiment of the present invention is shown;

[0073] Figure 8 An application architecture diagram of an environment shooting processing module in a system provided by an embodiment of the present invention is shown;

[0074] Fig. 9 The application architecture diagram of the quantity comparison processing module in the system provided by the embodiment of the present invention is shown. DETAILED DESCRIPTION

[0075] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0076] It is understandable that in the existing technology, since VR calls have very high requirements for computing resources and communication resources, and the computing resources and communication resources of local call equipment are limited, it is often difficult to achieve low-latency, high-quality VR calls by only processing and transmitting communication data through local call equipment. It is easy to experience phenomena such as call freezes and blurred images, which affects the user's call experience.

[0077] To solve the above problems, an embodiment of the present invention discloses a VR call method and system based on blockchain technology. Based on blockchain technology, a basic background video selected by a user is obtained, and the basic background video is imported into a network edge device; initialization environment shooting is performed, environment shooting data is obtained, and a target selection operation of the user is received, and multiple target environment entities are identified and determined from the environment shooting data; during a VR call of a local call device, real-time call shooting is performed, call shooting data is obtained, and transmitted to a network edge device; periodic data queue monitoring and processing performance monitoring are performed on the local call device and the network edge device, the current queue number is obtained, the standard processing number is calculated, and the number is compared; when the current queue number is less than the standard processing number, the call shooting data is subjected to edge processing and transmission of fine rendering on the basic background video according to multiple target environment entities; when the current queue number is not less than the standard processing number, the call shooting data is subjected to edge processing and transmission of basic rendering on the basic background video. It can combine local processing with edge computing, and monitor the data queues and processing performance of local call devices and network edge devices. In different states, it can perform edge processing and transmission of fine rendering or basic rendering, thereby achieving low-latency, high-quality VR calls, effectively avoiding call freezes, blurred images and other phenomena, and improving users' call experience.

[0078] Specifically, Figure 1 A flowchart of a VR calling method based on blockchain technology provided by an embodiment of the present invention is shown.

[0079] In a preferred embodiment of the present invention, a VR call method based on blockchain technology comprises the following steps:

[0080] Step S101: Based on blockchain technology, obtain the basic background video selected by the user, and import the basic background video into the network edge device.

[0081] In an embodiment of the present invention, if a user needs to select a video background for a VR call before making a VR call, the user can perform a corresponding request operation on the local call device, upload a background selection request, generate a background selection interface by receiving the user's background selection request, and interactively display the background selection interface on the local call device. The user can perform a background selection operation on the background selection interface, and by receiving the user's background selection operation, the basic background video selected by the user is determined according to the background selection operation, and then based on the blockchain technology, the basic background video stored in the blockchain is obtained, and the basic background video is imported into the network edge device.

[0082] It can be understood that the basic background video is the virtual environment video data selected by the user in the VR call. Different virtual environment video data are stored in the blockchain. Users can select the corresponding virtual environment video data according to the background requirements of the VR call. Specifically, the virtual environment video data can include different types such as outdoor scenery, indoor scenes, animation scenes, and technological scenes.

[0083] Specifically, Figure 2 A flow chart of obtaining a basic background video in the method provided in an embodiment of the present invention is shown.

[0084] Among them, in the preferred embodiment provided by the present invention, the method of obtaining the basic background video selected by the user based on the blockchain technology and importing the basic background video into the network edge device specifically includes the following steps:

[0085] Step S1011: receiving a background selection request from a user.

[0086] Step S1012: Generate and display a background selection interface according to the background selection request.

[0087] Step S1013: receiving a background selection operation from the user in the background selection interface.

[0088] Step S1014: Determine a basic background video according to the background selection operation.

[0089] Step S1015: Based on blockchain technology, the basic background video is imported into the network edge device.

[0090] Furthermore, the VR calling method based on blockchain technology also includes the following steps:

[0091] Step S102: Initialize environment shooting, obtain environment shooting data, receive a user's target selection operation, and identify and determine multiple target environment entities from the environment shooting data.

[0092] In an embodiment of the present invention, an initialization environment is shot for the real environment in which the user is located to obtain environment shooting data, and then the environment shooting data is processed frame by frame according to a preset initialization shooting frame rate to obtain multiple initialization environment pictures, identify and determine the number of picture pixels of the multiple initialization environment pictures, filter and mark the initialization environment picture with the largest number of picture pixels as the representative environment picture, and interactively display the representative environment picture on a local call device. The user can click on the representative environment picture to select the entity he wants to display in the VR call, and then identify and determine multiple target environment entities from the representative environment picture according to the user's click selection, and then perform feature recognition on the multiple target environment entities according to the environment shooting data to obtain multiple entity feature data.

[0093] It can be understood that the target environment entity is an entity that is in the same real environment as the user and that the user wants to display in the VR call, such as furniture, murals, pets, trees, bouquets, etc.

[0094] It can be understood that the entity feature data is appearance feature data such as color, shape, texture, pattern and / or logo of the corresponding target environment entity.

[0095] Specifically, Figure 3 A flow chart of environment shooting data processing in the method provided by an embodiment of the present invention is shown.

[0096] Among them, in the preferred embodiment provided by the present invention, the initialization of environmental shooting, acquisition of environmental shooting data, and receiving the user's target selection operation, and identifying and determining multiple target environmental entities from the environmental shooting data specifically include the following steps:

[0097] Step S1021: Initialize environment shooting and obtain environment shooting data.

[0098] Step S1022: Process the environment shooting data frame by frame and perform pixel comparison to select representative environment pictures.

[0099] Step S1023: interactively display the representative environment image and receive the user's target selection operation.

[0100] Step S1024: According to the target selection operation, a plurality of target environment entities are identified and determined from the representative environment picture.

[0101] Step S1025: perform feature recognition on the plurality of target environment entities according to the environment shooting data to obtain a plurality of entity feature data.

[0102] Furthermore, the VR calling method based on blockchain technology also includes the following steps:

[0103] Step S103: During the VR call process of the local call device, real-time call shooting is performed, the call shooting data is obtained, and transmitted to the network edge device.

[0104] In an embodiment of the present invention, when a user starts a VR call through a local call device, a real-time call shot of the user's real environment is taken, call shot data is obtained, and the call shot data is transmitted to a network edge device in real time.

[0105] Step S104: Perform periodic data queue monitoring and processing performance monitoring on the local call device and the network edge device, obtain the current queue quantity, calculate the standard processing quantity, and compare the quantity.

[0106] In the embodiment of the present invention, according to the preset monitoring cycle, the queue monitoring instruction and the performance monitoring instruction are periodically generated, and then according to the queue monitoring instruction, the data queue of the local call device and the network edge device is monitored to obtain the current queue number, and according to the performance monitoring instruction, the processing performance of the local call device and the network edge device is monitored to obtain the performance monitoring data, and then according to the performance monitoring instruction, the local call device and the network edge device are monitored to obtain the performance monitoring data. Calculate the standard processing quantity, where L b is the standard processing quantity, λ is the data arrival rate, D t is the local processing delay, D e is the edge processing delay, k is the preset control variable, L q The expected number of queues is preset. By comparing the current number of queues with the standard processing number, it is determined whether the current number of queues is less than the standard processing number.

[0107] It is understandable that by deploying computing and storage resources on network edge devices and collaborating with local call devices, data storage, data processing and data storage for VR calls can be performed, wherein the network edge device can be a base station.

[0108] It can be understood that processing performance monitoring is a comprehensive monitoring of the computing resources, communication resources and storage resources of local call equipment and network edge equipment.

[0109] Specifically, Figure 4 A flow chart of data queue monitoring and processing performance monitoring in the method provided by an embodiment of the present invention is shown.

[0110] Among them, in the preferred implementation mode provided by the present invention, the periodic data queue monitoring and processing performance monitoring of the local call device and the network edge device, obtaining the current queue quantity, calculating the standard processing quantity, and performing quantity comparison specifically include the following steps:

[0111] Step S1041: Perform periodic data queue monitoring on the local call device and the network edge device according to a preset monitoring period to obtain the current queue quantity.

[0112] Step S1042: Perform periodic processing performance monitoring on the local call device and the network edge device according to a preset monitoring period to obtain performance monitoring data.

[0113] Step S1043: Calculate the standard processing quantity according to the performance monitoring data.

[0114] Step S1044: compare the current queue quantity with the standard processing quantity.

[0115] Furthermore, the VR calling method based on blockchain technology also includes the following steps:

[0116] Step S105: When the current queue quantity is less than the standard processing quantity, the call shooting data is edge processed and transmitted for fine rendering of the basic background video according to multiple target environment entities.

[0117] In an embodiment of the present invention, when the current number of queues is less than the standard processing number, a fine rendering instruction is generated and sent to a network edge device, and then data processing of the VR call is performed through the network edge device. Based on multiple entity feature data, multiple target environment entities in the call shooting data are dynamically identified, and entity dynamic data of the multiple target environment entities are extracted. At the same time, character dynamic data is extracted from the call shooting data, and based on the entity dynamic data and the character dynamic data, fine rendering of the VR call is performed in the basic background video to generate fine VR call data with dynamic characters and multiple target environment entities in the background environment. The fine VR call data is then transmitted to a local call device. The local call device can transmit the fine VR call data to the target call device with which it is conducting a VR call.

[0118] Specifically, Figure 5 A flow chart of finely rendered edge processing and transmission in the method provided by an embodiment of the present invention is shown.

[0119] Among them, in the preferred implementation manner provided by the present invention, when the number of the current queues is less than the standard processing number, the edge processing and transmission of finely rendering the basic background video by the call shooting data according to multiple target environment entities specifically includes the following steps:

[0120] Step S1051: When the current queue quantity is less than the standard processing quantity, generate a fine rendering instruction.

[0121] Step S1052: Send the fine rendering instruction to a network edge device.

[0122] Step S1053: extracting entity dynamic data of multiple target environment entities from the call shooting data according to multiple entity feature data.

[0123] Step S1054: extracting character dynamic data from the call shooting data.

[0124] Step S1055: Perform fine rendering in the basic background video according to the entity dynamic data and the character dynamic data to generate fine VR call data.

[0125] Step S1056: Transmit the detailed VR call data to a local call device.

[0126] Furthermore, the VR calling method based on blockchain technology also includes the following steps:

[0127] Step S106: When the current queue quantity is not less than the standard processing quantity, edge processing and transmission of the call shooting data for basic rendering of the basic background video are performed.

[0128] In an embodiment of the present invention, when the current number of queues is not less than the standard processing number, a basic rendering instruction is generated and sent to a network edge device, and then data processing of the VR call is performed through the network edge device, and character dynamic data is extracted from the call shooting data. Then, based on the character dynamic data, basic rendering of the VR call is performed in the basic background video to generate basic VR call data with only dynamic characters in the background environment. The basic VR call data is then transmitted to a local call device. The local call device can transmit the basic VR call data to the target call device with which it is conducting a VR call.

[0129] Specifically, Figure 6 A flowchart of edge processing and transmission of basic rendering in the method provided by an embodiment of the present invention is shown.

[0130] Among them, in the preferred implementation manner provided by the present invention, when the number of the current queues is not less than the standard processing number, edge processing and transmission of the basic rendering of the basic background video by the call shooting data specifically includes the following steps:

[0131] Step S1061: When the current queue quantity is not less than the standard processing quantity, generate a basic rendering instruction.

[0132] Step S1062: Send the basic rendering instruction to a network edge device.

[0133] Step S1063: extracting character dynamic data from the call shooting data.

[0134] Step S1064: Perform basic rendering in the basic background video according to the character dynamic data to generate basic VR call data.

[0135] Step S1065: Transmit the basic VR call data to the local call device.

[0136] Furthermore, Figure 7 An application architecture diagram of a VR call system based on blockchain technology provided by an embodiment of the present invention is shown.

[0137] Among them, in another preferred embodiment provided by the present invention, a VR call system based on blockchain technology includes:

[0138] The basic background selection module 101 is used to obtain the basic background video selected by the user based on the blockchain technology, and import the basic background video into the network edge device.

[0139] In an embodiment of the present invention, before making a VR call, if the user needs to select a video background for the VR call, the user can perform a corresponding request operation on the local call device and upload a background selection request. The basic background selection module 101 generates a background selection interface by receiving the user's background selection request, and interactively displays the background selection interface on the local call device. The user can perform a background selection operation on the background selection interface. By receiving the user's background selection operation, the basic background video selected by the user is determined according to the background selection operation, and then based on the blockchain technology, the basic background video stored in the blockchain is obtained, and the basic background video is imported into the network edge device.

[0140] The environment shooting processing module 102 is used to initialize environment shooting, obtain environment shooting data, receive a user's target selection operation, and identify and determine multiple target environment entities from the environment shooting data.

[0141] In an embodiment of the present invention, the environment shooting processing module 102 obtains environment shooting data by initializing environment shooting of the real environment in which the user is located, and then processes the environment shooting data frame by frame according to a preset initialization shooting frame rate to obtain multiple initialization environment pictures, identify and determine the number of picture pixels of the multiple initialization environment pictures, filter and mark the initialization environment picture with the largest number of picture pixels as the representative environment picture, and interactively display the representative environment picture on the local call device. The user can click on the representative environment picture to select the entity he wants to display in the VR call, and then identify and determine multiple target environment entities from the representative environment picture according to the user's click selection, and then perform feature recognition on the multiple target environment entities according to the environment shooting data to obtain multiple entity feature data.

[0142] Specifically, Figure 8 The application architecture diagram of the environment shooting processing module 102 in the system provided by the embodiment of the present invention is shown.

[0143] Among them, in the preferred implementation manner provided by the present invention, the environment shooting processing module 102 specifically includes:

[0144] The environment shooting unit 1021 is used to initialize environment shooting and obtain environment shooting data.

[0145] The picture screening unit 1022 is used to perform frame-by-frame processing and pixel comparison on the environmental shooting data to screen representative environmental pictures.

[0146] The interactive display unit 1023 is used to interactively display the representative environment image and receive the user's target selection operation.

[0147] The entity recognition unit 1024 is used to recognize and determine multiple target environment entities from the representative environment picture according to the target selection operation.

[0148] The feature recognition unit 1025 is used to perform feature recognition on the multiple target environment entities according to the environment shooting data, and obtain multiple entity feature data.

[0149] Furthermore, the VR call system based on blockchain technology also includes:

[0150] The real-time call shooting module 103 is used to perform real-time call shooting during the VR call of the local call device, obtain the call shooting data, and transmit it to the network edge device.

[0151] In an embodiment of the present invention, when a user starts making a VR call through a local call device, the real-time call shooting module 103 shoots the user's real environment in real time, obtains call shooting data, and transmits the call shooting data to the network edge device in real time.

[0152] The quantity comparison processing module 104 is used to perform periodic data queue monitoring and processing performance monitoring on the local call device and the network edge device, obtain the current queue quantity, calculate the standard processing quantity, and perform quantity comparison.

[0153] In the embodiment of the present invention, the quantity comparison processing module 104 periodically generates queue monitoring instructions and performance monitoring instructions according to a preset monitoring period, and then performs data queue monitoring on the local call device and the network edge device according to the queue monitoring instructions to obtain the current queue quantity, and performs processing performance monitoring on the local call device and the network edge device according to the performance monitoring instructions to obtain performance monitoring data, and then performs the performance monitoring data according to the performance monitoring instructions. Calculate the standard processing quantity, where L b is the standard processing quantity, λ is the data arrival rate, D t is the local processing delay, D e is the edge processing delay, k is the preset control variable, L q The expected number of queues is preset. By comparing the current number of queues with the standard processing number, it is determined whether the current number of queues is less than the standard processing number.

[0154] Specifically, Fig. 9 The application architecture diagram of the quantity comparison processing module 104 in the system provided by the embodiment of the present invention is shown.

[0155] Among them, in the preferred implementation manner provided by the present invention, the quantity comparison processing module 104 specifically includes:

[0156] The queue monitoring unit 1041 is used to perform periodic data queue monitoring on the local call device and the network edge device according to a preset monitoring period to obtain the current queue number.

[0157] The performance monitoring unit 1042 is used to perform periodic processing performance monitoring on the local call device and the network edge device according to a preset monitoring period to obtain performance monitoring data.

[0158] The standard calculation unit 1043 is used to calculate the standard processing quantity according to the performance monitoring data.

[0159] The quantity comparison unit 1044 is used to compare the current queue quantity with the standard processing quantity.

[0160] Furthermore, the VR call system based on blockchain technology also includes:

[0161] The fine rendering transmission module 105 is used to perform edge processing and transmission of fine rendering of the basic background video based on the call shooting data according to multiple target environment entities when the current queue number is less than the standard processing number.

[0162] In an embodiment of the present invention, when the current number of queues is less than the standard processing number, the fine rendering transmission module 105 generates a fine rendering instruction and sends the fine rendering instruction to the network edge device, and then performs data processing for the VR call through the network edge device, and dynamically identifies multiple target environment entities in the call shooting data based on multiple entity feature data, extracts entity dynamic data of the multiple target environment entities, and at the same time, extracts character dynamic data from the call shooting data, and performs fine rendering of the VR call in the basic background video based on the entity dynamic data and the character dynamic data, and generates fine VR call data with dynamic characters and multiple target environment entities in the background environment, and then transmits the fine VR call data to the local call device. The local call device can transmit the fine VR call data to the target call device with which it is conducting a VR call, and perform corresponding call data transmission.

[0163] The basic rendering transmission module 106 is used to perform basic rendering edge processing and transmission of the call shooting data to the basic background video when the current queue quantity is not less than the standard processing quantity.

[0164] In an embodiment of the present invention, when the current queue number is not less than the standard processing number, the basic rendering transmission module 106 generates a basic rendering instruction and sends the basic rendering instruction to the network edge device, and then performs data processing for the VR call through the network edge device, extracts character dynamic data from the call shooting data, and then performs basic rendering of the VR call in the basic background video based on the character dynamic data, generates basic VR call data with only dynamic characters in the background environment, and then transmits the basic VR call data to the local call device. The local call device can transmit the basic VR call data to the target call device with which it is conducting a VR call, and then perform corresponding call data transmission.

[0165] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0166] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0167] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A VR calling method based on blockchain technology, characterized in that: The method specifically comprises the following steps: Based on blockchain technology, a basic background video selected by a user is obtained, and the basic background video is imported into a network edge device; Initialize environmental shooting, obtain environmental shooting data, and receive a user's target selection operation, and identify and determine multiple target environmental entities from the environmental shooting data; During a VR call on a local call device, real-time call recording is performed, call recording data is obtained, and transmitted to the network edge device; Perform periodic data queue monitoring and processing performance monitoring on local call devices and network edge devices, obtain the current queue quantity, calculate the standard processing quantity, and compare the quantity; When the current queue number is less than the standard processing number, edge processing and transmission of fine rendering of the basic background video by the call shooting data according to multiple target environment entities; When the current queue quantity is not less than the standard processing quantity, the call shooting data is edge processed and transmitted for basic rendering of the basic background video.

2. The VR calling method based on blockchain technology according to claim 1 is characterized in that: The method of obtaining the basic background video selected by the user based on the blockchain technology and importing the basic background video into the network edge device specifically includes the following steps: Receive a background selection request from the user; Generate and display a background selection interface according to the background selection request; Receiving a background selection operation from a user on the background selection interface; Determining a basic background video according to the background selection operation; Based on blockchain technology, the basic background video is imported into the network edge device.

3. The VR calling method based on blockchain technology according to claim 1 is characterized in that: The initializing environment shooting, acquiring environment shooting data, and receiving a user's target selection operation, and identifying and determining multiple target environment entities from the environment shooting data specifically include the following steps: Initialize environmental shooting and obtain environmental shooting data; Processing the environmental shooting data frame by frame and performing pixel comparison to select representative environmental pictures; Interactively displaying the representative environment image and receiving a target selection operation from a user; According to the target selection operation, identifying and determining a plurality of target environment entities from the representative environment picture; According to the environmental shooting data, feature recognition is performed on a plurality of target environmental entities to obtain a plurality of entity feature data.

4. The VR calling method based on blockchain technology according to claim 1 is characterized in that: The periodic data queue monitoring and processing performance monitoring of the local call device and the network edge device, obtaining the current queue quantity, calculating the standard processing quantity, and performing quantity comparison specifically include the following steps: According to the preset monitoring period, the local call device and the network edge device are monitored for periodic data queues to obtain the current queue quantity; According to the preset monitoring cycle, periodic processing performance monitoring is performed on local call equipment and network edge equipment to obtain performance monitoring data; Calculating a standard processing quantity based on the performance monitoring data; The current queue quantity is compared with the standard processing quantity.

5. The VR calling method based on blockchain technology according to claim 4 is characterized in that: The standard processing quantity is calculated as follows: Among them, L b is the standard processing quantity, λ is the data arrival rate, D t is the local processing delay, D e is the edge processing delay, k is the preset control variable, L q The preset expected number of queues.

6. The VR calling method based on blockchain technology according to claim 3 is characterized in that: When the current queue quantity is less than the standard processing quantity, edge processing and transmission of fine rendering of the basic background video by the call shooting data according to multiple target environment entities specifically include the following steps: When the current queue quantity is less than the standard processing quantity, generating a fine rendering instruction; Sending the fine rendering instruction to a network edge device; Extracting entity dynamic data of a plurality of target environment entities from the call shooting data according to the plurality of entity feature data; Extracting character dynamic data from the call shooting data; According to the entity dynamic data and the character dynamic data, fine rendering is performed in the basic background video to generate fine VR call data; The detailed VR call data is transmitted to the local call device.

7. The VR calling method based on blockchain technology according to claim 1 is characterized in that: When the current queue quantity is not less than the standard processing quantity, edge processing and transmission of basic rendering of the basic background video by the call shooting data specifically includes the following steps: When the current queue quantity is not less than the standard processing quantity, generating a basic rendering instruction; Sending the basic rendering instruction to a network edge device; Extracting character dynamic data from the call shooting data; According to the character dynamic data, basic rendering is performed in the basic background video to generate basic VR call data; The basic VR call data is transmitted to the local call device.

8. A VR call system based on blockchain technology, characterized in that: The system includes a basic background selection module, an environment shooting processing module, a real-time call shooting module, a quantity comparison processing module, a fine rendering transmission module and a basic rendering transmission module, wherein: A basic background selection module is used to obtain a basic background video selected by a user based on blockchain technology, and import the basic background video into a network edge device; An environment shooting processing module is used to initialize environment shooting, obtain environment shooting data, and receive a user's target selection operation, and identify and determine multiple target environment entities from the environment shooting data; The real-time call shooting module is used to shoot the call in real time during the VR call of the local call device, obtain the call shooting data, and transmit it to the network edge device; The quantity comparison processing module is used to monitor the periodic data queue and processing performance of the local call device and the network edge device, obtain the current queue quantity, calculate the standard processing quantity, and perform quantity comparison; A fine rendering transmission module, for edge processing and transmitting the basic background video with fine rendering of the call shooting data according to a plurality of target environment entities when the current queue number is less than the standard processing number; The basic rendering transmission module is used to perform edge processing and transmission of basic rendering of the call shooting data on the basic background video when the current queue quantity is not less than the standard processing quantity.

9. The VR call system based on blockchain technology according to claim 8 is characterized in that: The environment shooting processing module specifically includes: An environment shooting unit, used to initialize environment shooting and obtain environment shooting data; A picture screening unit, used for performing frame-by-frame processing and pixel comparison on the environmental shooting data to screen representative environmental pictures; An interactive display unit, used to interactively display the representative environment image and receive a target selection operation from a user; An entity recognition unit, configured to recognize and determine a plurality of target environment entities from the representative environment picture according to the target selection operation; The feature recognition unit is used to perform feature recognition on a plurality of target environment entities according to the environment shooting data, and obtain a plurality of entity feature data.

10. The VR call system based on blockchain technology according to claim 8, characterized in that: The quantity comparison processing module specifically includes: A queue monitoring unit is used to perform periodic data queue monitoring on local call devices and network edge devices according to a preset monitoring period to obtain the current queue number; The performance monitoring unit is used to perform periodic processing performance monitoring on the local call equipment and the network edge equipment according to a preset monitoring period and obtain performance monitoring data; A standard calculation unit, used to calculate a standard processing quantity according to the performance monitoring data; The quantity comparison unit is used to compare the current queue quantity with the standard processing quantity.

Images