Parameter adjustment method and apparatus, device, and medium

Abstract

Embodiments of the present invention disclose a parameter adjustment method and apparatus, a device, and a medium, which are applied to a first device. The method comprises: in the process of receiving a data frame transmitted by a second device, acquiring first parameter information of the data frame, the first parameter information comprising at least one of a frame loss rate and a transmission delay; and, on the basis of the first parameter information, controlling the second device to adjust second parameter information of the data frame, so that the second device transmits the data frame on the basis of the adjusted second parameter information, the second parameter information comprising at least one of a streaming mode, a bit rate, and a resolution.

Description

Parameter adjustment method, device, equipment and medium

[0001] The present application claims priority to the Chinese patent application No. 202411025983.4, filed on July 29, 2024, and entitled "Parameter adjustment method, device, equipment and medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] Embodiments of the present application relate to the technical field of wearable devices, and more particularly, to a parameter adjustment method, a parameter adjustment device, a first device, and a computer readable storage medium. BACKGROUND

[0003] In the actual use of an augmented reality (AR) device, such as an AR glasses, in order to be able to use rich content resources, the AR glasses usually adopts a streaming technology to cast the content on another device, such as a mobile phone or a PC, to the AR glasses for display. However, when streaming images from the mobile phone or the PC to the AR glasses, various abnormal situations are often encountered, such as interruption of wired connection, instability of wireless connection, increase of transmission delay due to device heating, etc., all of which will cause unstable pictures. SUMMARY

[0004] An object of the present application is to provide a parameter adjustment method, device, equipment and medium.

[0005] According to a first aspect of the present application, there is provided a control method applied to a first device, the method comprising:

[0006] In the process of receiving data frames transmitted by a second device, first parameter information of the data frames is obtained; wherein the first parameter information comprises at least one of a frame loss rate and a transmission delay;

[0007] According to the first parameter information, a second device is controlled to adjust second parameter information of the data frames, so that the second device transmits the data frames based on the adjusted second parameter information; wherein the second parameter information comprises at least one of a streaming mode, a code rate and a resolution.

[0008] Optionally, the first parameter information comprises a frame loss rate,

[0009] The first parameter information of the data frames is obtained in the process of receiving the data frames transmitted by the second device, comprising:

[0010] According to the total data frames transmitted by the second device, a first total weight corresponding to the total data frames is determined;

[0011] determining a second total weight corresponding to the lost data frame according to the lost data frame in the process of transmitting the data frame;

[0012] obtaining the first parameter information according to the first total weight and the second total weight.

[0013] Optionally, the first parameter information comprises a transmission delay,

[0014] The first parameter information is obtained in the process of receiving the data frame transmitted by the second device, comprising:

[0015] The average delay of the heartbeat packet sent to the second device is obtained in the process of receiving the data frame transmitted by the second device.

[0016] The first parameter information is obtained according to the average delay.

[0017] Optionally, the average delay of the heartbeat packet sent to the second device is obtained in the process of receiving the data frame transmitted by the second device, comprising:

[0018] The ith heartbeat packet is sent to the second device in the process of receiving the data frame transmitted by the second device, and a first timestamp of sending the ith heartbeat packet is recorded; wherein the initial value of i is 1.

[0019] The ith heartbeat packet returned by the second device is received, and a second timestamp of receiving the ith heartbeat packet is recorded.

[0020] The bidirectional delay of transmitting the ith heartbeat packet is determined according to the first timestamp and the second timestamp, i is made i+1, and it is judged whether i is less than or equal to p, p being the total number of the heartbeat packets.

[0021] If i is less than or equal to p, the step of sending the ith heartbeat packet to the second device is continued.

[0022] If i is greater than p, the average delay is obtained according to the p bidirectional delays.

[0023] Optionally, the second parameter information comprises a streaming mode, a code rate and a resolution,

[0024] The second parameter information of the data frame is adjusted by the second device according to the first parameter information, comprising:

[0025] If the frame loss rate is greater than a first frame loss rate threshold, and / or the transmission delay is greater than a first delay threshold, a first adjustment request for adjusting the streaming mode is determined and sent to the second device, so that the second device adjusts the current streaming mode.

[0026] In a case that the frame loss rate is less than or equal to the first frame loss rate threshold and greater than a second frame loss rate threshold, and / or, the transmission delay is less than or equal to the first delay threshold and greater than a second delay threshold, a second adjustment request for adjusting the code rate and / or resolution is determined and transmitted to the second device, so that the second device adjusts the code rate and / or resolution.

[0027] Optionally, the method further comprises:

[0028] In a process of receiving the data frame transmitted by the second device, if the transmission of the data frame fails, the current streaming mode is adjusted by the second device.

[0029] Optionally, the method further comprises:

[0030] In a case that the data frame transmitted by the second device is received, the data frame is displayed.

[0031] According to a second aspect of the embodiments of the present application, a parameter adjustment apparatus is provided, which is applied to a first device, and the apparatus comprises:

[0032] The obtaining module is configured to obtain first parameter information of the data frame in a process of receiving the data frame transmitted by the second device, wherein the first parameter information comprises at least one of a frame loss rate and a transmission delay.

[0033] The control module is configured to control the second device to adjust second parameter information of the data frame according to the first parameter information, so that the second device transmits the data frame based on the adjusted second parameter information, wherein the second parameter information comprises at least one of a streaming mode, a code rate and a resolution.

[0034] According to a third aspect of the embodiments of the present application, a first device is provided, which comprises:

[0035] The memory is configured to store executable computer instructions.

[0036] The processor is configured to execute the parameter adjustment method according to the above first aspect according to the control of the executable computer instructions.

[0037] According to a fourth aspect of the embodiments of the present application, a computer readable storage medium is provided, which stores computer instructions, and the computer instructions are run by a processor to execute the parameter adjustment method according to the above first aspect.

[0038] An advantage of the embodiment of the present application is that the first device obtains at least one of the first parameter information of the data frame, such as the frame loss rate and the transmission delay, in the process of receiving the data frame transmitted by the second device, and controls the second device to adjust the second parameter information of the data frame according to the first parameter information of the data frame, the second parameter information including at least one of the streaming mode, the code rate and the resolution, so that the second device transmits the data frame based on the adjusted second parameter information, to ensure the picture stability.

[0039] Other features and advantages of the present application will be made clear to those skilled in the art by the following detailed description of exemplary embodiments of the present application with reference to the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0040] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the application and, together with the description, serve to explain the principles of the application.

[0041] Fig. 1 is a schematic diagram of the hardware configuration of the parameter adjustment system according to the embodiment of the present application;

[0042] Fig. 2 is a schematic diagram of the flow of the parameter adjustment method according to the embodiment of the present application;

[0043] Fig. 3 is a schematic diagram of the interaction between the first device and the second device according to the embodiment of the present application;

[0044] Fig. 4 is a schematic diagram of the interaction between the first device and the second device according to the embodiment of the present application;

[0045] Fig. 5 is a schematic diagram of the flow of the parameter adjustment method according to an example;

[0046] Fig. 6 is a schematic diagram of the flow of the parameter adjustment method according to another example;

[0047] Fig. 7 is a schematic diagram of the principle block of the parameter adjustment device according to the embodiment of the present application;

[0048] Fig. 8 is a schematic diagram of the principle block of the first device according to the embodiment of the present application.

[0049] The implementation, functional features and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0050] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0051] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative positional relationship, motion condition, etc. between components in a certain posture (as shown in the drawings), and if the certain posture changes, the directional indications will also change accordingly.

[0052] In addition, if the embodiments of the present application involve descriptions such as "first", "second", etc., the descriptions of "first", "second", etc. are only for description purposes and cannot be understood as indicating or implying the relative importance of the indicated technical features or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first", "second" can explicitly or implicitly include at least one of the features. In addition, the meaning of "and / or" appearing throughout the text includes three parallel schemes. For example, "A and / or B" includes A scheme, or B scheme, or A and B scheme. In addition, the technical solutions of each embodiment can be combined with each other, but it must be based on the realization of ordinary skilled in the art. When the combination of technical solutions contradicts each other or cannot be realized, it should be considered that the combination of technical solutions does not exist and is not within the protection scope required by the present application.

[0053] <Hardware configuration>

[0054] Figure 1 is a schematic diagram of a hardware configuration of a parameter adjustment system that can be used to implement a parameter adjustment method according to an embodiment. Figure 1 shows a first device 100, a second device 200 and a network 300. The first device 100 can be connected to the network 300. In the network 300, a plurality of servers 301, 302 can be arranged. The network 300 can be a wireless communication network or a wired communication network.

[0055] In an embodiment, as shown in Figure 1, the first device 100 can include a processor 101 and a memory 102. The first device 100 further includes a communication device 103, a display device 104, a user interface 105, a camera 106, an audio / video interface 107 and a sensor 108, etc. In addition, the first device 100 can further include a power management chip 109 and a battery 110, etc.

[0056] The first device 100 can be a head-mounted display device, for example, AR (Augmented Reality) glasses and MR (Mixed Reality) glasses, etc., which are not limited by the embodiments of the present application. The components shown in Figure 1 are only schematic. The first device 100 can include one or more of the components shown in Figure 1, and does not necessarily include all the components shown in Figure 1. The first device 100 shown in Figure 1 is only explanatory and by no means intended to limit the embodiments, applications or uses herein.

[0057] In this embodiment, the memory 102 of the first device 100 is configured to store program instructions for controlling the processor 101 to operate to perform the parameter adjustment method. The skilled person can design the instructions according to the disclosed solutions of the present application. How the instructions control the processor to operate is known in the art, and thus will not be described in detail here.

[0058] In one embodiment, as shown in FIG. 1, the second device 200 can include a processor 201 and a memory 202. The second device 200 further includes a communication device 203, a display device 204, a user interface 205, a camera 206, an audio / video interface 207, and a sensor 208, etc. In addition, the second device 200 can further include a power management chip 209 and a battery 210, etc.

[0059] The second device 200 can be a mobile phone, a laptop, a tablet computer, a palmtop computer, and the embodiments of the present application do not limit this. The components shown in FIG. 1 are merely illustrative. The second device 200 can include one or more of the components shown in FIG. 1, and does not necessarily include all the components in FIG. 1. The second device 200 shown in FIG. 1 is merely explanatory, and is by no means intended to limit the embodiments, applications or uses thereof.

[0060] It should be understood that although FIG. 1 only shows one first device 100 and one second device 200, this does not mean to limit the respective number, and the parameter adjustment system can include multiple first devices 100 and multiple second devices 200.

[0061] In the above description, the skilled person can design the instructions according to the solutions provided by the present application. How the instructions control the processor to operate is known in the art, and thus will not be described in detail here.

[0062] <Method Embodiment>

[0063] FIG. 2 shows a parameter adjustment method according to an embodiment of the present application, which can be implemented by the first device. As shown in FIG. 2, the parameter adjustment method can include the following steps S2100-S2200:

[0064] In step S2100, first parameter information of a data frame transmitted by a second device is obtained in the process of receiving the data frame.

[0065] The first parameter information includes at least one of a frame loss rate and a transmission delay.

[0066] The above frame loss rate is a proportion of data frames lost in the process of the second device transmitting data frames to the first device to total data frames sent. The above transmission delay is a time taken for data frames to be transmitted from the second device to the first device.

[0067] In the embodiment, a streaming connection is established between the first device and the second device, which can be a wireless streaming connection or a wired streaming connection. The wireless streaming connection can be a WIFI connection. It should be noted that the WIFI connection usually transmits data frames based on a User Datagram Protocol (UDP).

[0068] Specifically, when the second device receives a starting instruction for starting the first application, the second device can create a first virtual screen to run the first application in response to the starting instruction, capture data frames of the first virtual screen, encode the captured data frames, and transmit the encoded data frames to the first device through the current streaming mode. When the first device receives the data frames transmitted by the second device, the first device decodes and displays the data frames on a first canvas, and performs data statistics and analysis on the received data frames to obtain a frame loss rate and a transmission delay of the data frames.

[0069] In one embodiment, the first parameter information includes the frame loss rate. The step S2100 of obtaining the first parameter information of the data frames transmitted by the second device can further include: determining a first total weight corresponding to the total data frames transmitted by the second device according to the received total data frames; determining a second total weight corresponding to the data frames lost in the process of transmitting the data frames; and obtaining the first parameter information according to the first total weight and the second total weight.

[0070] It should be noted that the frame loss rate is calculated by using a linear weighted average method, which can eliminate the influence of random frame loss on a dynamic code rate and reduce the influence of historical frame loss on the current frame loss rate.

[0071] In the embodiment, the total data frames transmitted by the second device are n frames, and n is a positive integer greater than 1. The data frames lost in the process of the second device transmitting the data frames are m frames, and m is a positive integer less than or equal to n.

[0072] Generally, the weight of the first data frame transmitted is 1, the weight of the second data frame transmitted is 2, and the weight of the nth data frame transmitted is n. If the total data frames transmitted by the second device are n frames, the first total weight w1 corresponding to the total data frames transmitted by the second device satisfies the following formula: w1 = 1 + 2 + … + n = n(n + 1) / 2 (1)

[0073] wherein 1 is the weight corresponding to the first data frame transmitted, 2 is the weight corresponding to the second data frame transmitted, and n is the weight corresponding to the nth data frame transmitted.

[0074] If the lost data frames in the process of transmitting data frames by the second device are m frames, the second total weight w2 corresponding to the lost data frames in the process of transmitting data frames by the second device satisfies the following formula:

[0075] wherein the lost data frames in the process of transmitting data frames are m frames, and f(i) represents the weight of the ith data frame in the lost m frames.

[0076] Then, the frame loss rate satisfies the following formula:

[0077] For example, if the total data frames transmitted by the second device are 5 frames, i.e., the weight corresponding to the first frame is 1, the weight corresponding to the second frame is 2, the weight corresponding to the third frame is 3, the weight corresponding to the fourth frame is 4, and the weight corresponding to the fifth frame is 5, the first total weight of the 5 data frames transmitted is w1 = 1 + 2 + … + 5 = 5(5 + 1) / 2. If the second frame and the fourth frame are lost, the second total weight of the lost data frames is wherein f(1) represents the weight of the first data frame in the lost two data frames, i.e., the second data frame in the total data frames, and f(2) represents the weight of the second data frame in the lost two data frames, i.e., the fourth data frame in the total data frames.

[0078] In an embodiment, the first parameter information includes a transmission delay, and the step S2100 of obtaining the first parameter information of the data frame transmitted by the second device in the process of receiving the data frame transmitted by the second device can further include steps S2110-S2120:

[0079] In the step S2110, an average delay of the heartbeat packet sent to the second device is obtained in the process of receiving the data frame transmitted by the second device.

[0080] Optionally, the step S2110 of obtaining the average delay of the heartbeat packet sent to the second device in the process of receiving the data frame transmitted by the second device can further include:

[0081] In the process of receiving the data frame transmitted by the second device, the i th heartbeat packet is sent to the second device, and a first timestamp of sending the i th heartbeat packet is recorded; wherein the initial value of i is 1; the i th heartbeat packet returned by the second device is received, and a second timestamp of receiving the i th heartbeat packet is recorded; the bidirectional delay of transmitting the i th heartbeat packet is determined according to the first timestamp and the second timestamp, i is made i+1, and it is judged whether i is less than or equal to p, p being the total number of the heartbeat packets; in the case that i is less than or equal to p, the step of sending the i th heartbeat packet to the second device is continuously executed; in the case that i is greater than p, the average delay is obtained according to the p bidirectional delays.

[0082] Specifically, since the calculation of the transmission delay considers that the time synchronization of the devices at both ends of the stream is needed for the one-way delay, it is relatively more complex, therefore, a method similar to the heartbeat packet is adopted, the first device sends the 1st heartbeat packet to the second device by using the transmission control protocol (TCP), and records the sending timestamp of sending the 1st heartbeat packet. After receiving the 1st heartbeat packet, the second device sends the 1st heartbeat packet back to the first device, the first device receives the 1st heartbeat packet, and records the receiving timestamp of receiving the 1st heartbeat packet, at this time, according to the receiving timestamp and the sending timestamp, the bidirectional delay of the 1st heartbeat packet can be determined, which is denoted as f(1).

[0083] Then, the first device sends the 2nd heartbeat packet to the second device, and records the sending timestamp of sending the 2nd heartbeat packet. After receiving the 2nd heartbeat packet, the second device sends the 2nd heartbeat packet back to the first device, the first device receives the 2nd heartbeat packet, and records the receiving timestamp of receiving the 2nd heartbeat packet, at this time, according to the receiving timestamp and the sending timestamp, the bidirectional delay of the 2nd heartbeat packet can be determined, which is denoted as f(2).

[0084] By analogy, the first device sends the p th heartbeat packet to the second device, and records the sending timestamp of sending the p th heartbeat packet. After receiving the p th heartbeat packet, the second device sends the p th heartbeat packet back to the first device, the first device receives the p th heartbeat packet, and records the receiving timestamp of receiving the p th heartbeat packet, at this time, according to the receiving timestamp and the sending timestamp, the bidirectional delay of the p th heartbeat packet can be determined, which is denoted as f(p).

[0085] After obtaining the p bidirectional delays, the first device can obtain the average delay according to the p bidirectional delays, generally, the average delay t1 satisfies the following formula:

[0086] Wherein, f(j) is the bidirectional delay of the j th heartbeat packet, and p is the total number of the heartbeat packets.

[0087] Step S2120, obtaining the first parameter information according to the average time delay.

[0088] In this step S2120, the first device can take the average time delay as the transmission time delay, i.e., the transmission time delay

[0089] After performing the above step S2100, obtaining the first parameter information of the data frame transmitted by the second device in the process of receiving the data frame, the following step S2200 is entered:

[0090] Step S2200, controlling the second device to adjust the second parameter information of the data frame according to the first parameter information, so that the second device transmits the data frame based on the adjusted second parameter information.

[0091] The second parameter information includes at least one of a streaming mode, a code rate and a resolution.

[0092] In an optional embodiment, the second parameter information includes a streaming mode, a code rate and a resolution. The step S2200 of controlling the second device to adjust the second parameter information of the data frame according to the first parameter information can further include the following steps S2210-S2220:

[0093] Step S2210, determining a first adjustment request for adjusting the streaming mode and sending it to the second device when the frame loss rate is greater than a first frame loss rate threshold and / or the transmission time delay is greater than a first time delay threshold, so that the second device adjusts the current streaming mode.

[0094] The first frame loss rate threshold can be set according to the actual scene, which is not limited in the embodiment.

[0095] The first time delay threshold can also be set according to the actual scene, which is not limited in the embodiment.

[0096] Specifically, the priority of switching the streaming mode is higher than that of switching the code rate or the resolution. When the frame loss rate is greater than the first frame loss rate threshold and / or the transmission time delay is greater than the first time delay threshold, the first device sends a first adjustment request for adjusting the streaming mode to the second device. After receiving the first adjustment request, the second device can adjust the current streaming mode and transmit the data frame based on the adjusted streaming mode. For example, if the current streaming mode is a wired streaming mode, the wired streaming mode can be adjusted to a wireless streaming mode, such as WIFI.

[0097] Step S2220, in the case that the frame loss rate is less than or equal to the first frame loss rate threshold and greater than a second frame loss rate threshold, and / or the transmission delay is less than or equal to the first delay threshold and greater than a second delay threshold, a second adjustment request for adjusting the code rate and / or resolution is determined and sent to the second device, so that the second device adjusts the code rate and / or resolution.

[0098] The second frame loss rate threshold can be set according to an actual scene, which is not limited in the embodiment.

[0099] The second delay threshold can also be set according to an actual scene, which is not limited in the embodiment.

[0100] Specifically, in the case that the frame loss rate is less than or equal to the first frame loss rate threshold and greater than the second frame loss rate threshold, and / or the transmission delay is less than or equal to the first delay threshold and greater than the second delay threshold, the first device sends a second adjustment request for adjusting the code rate or resolution to the second device. After receiving the second adjustment request, the second device can adjust the current code rate and / or current resolution, and encode and transmit data frames based on the adjusted code rate and / or resolution.

[0101] It should be noted that the above embodiment is only illustrative, and can be set according to actual needs, for example, in the case that the frame loss rate and the transmission delay are both very large, the streaming mode, the code rate and the resolution can be adjusted at the same time.

[0102] According to the embodiment of the application, the first device obtains at least one of the first parameter information of the data frames, such as the frame loss rate and the transmission delay, during receiving the data frames transmitted by the second device, and controls the second device to adjust the second parameter information of the data frames according to the first parameter information of the data frames, the second parameter information including at least one of the streaming mode, the code rate and the resolution, so that the second device transmits the data frames based on the adjusted second parameter information, to ensure the stability of the picture.

[0103] On the one hand, switching between wired and wireless can avoid phenomena such as streaming interruption or picture freezing caused by network jitter due to abnormal conditions. On the other hand, dynamic code rate and resolution can dynamically reduce picture quality under the condition of limited bandwidth and delay, and maintain picture stability. The two characteristics interact with each other to maintain the stability of the picture, and maintain the stability of the frame rate and the delay as much as possible under the premise of ensuring the clarity of the picture.

[0104] In one embodiment, the parameter adjustment method of the embodiment of the application further includes: in the process of receiving the data frames transmitted by the second device, if the data frame transmission fails, adjusting the current streaming mode by the second device.

[0105] Specifically, in the process of encoding the captured data frame by the second device and transmitting the data frame to the first device through the current streaming mode, if the data frame fails to be transmitted, the second device can actively adjust the current streaming mode. For example, if the current streaming mode is a wired streaming mode, the wired streaming mode can be adjusted to a wireless streaming mode, for example, the wired streaming mode is adjusted to WIFI.

[0106] <Example 1>

[0107] Next, taking the first device as an AR glasses and the second device as a mobile phone as an example, a parameter adjustment method of an example is shown, referring to FIG. 3 and FIG. 5, the parameter adjustment method comprises:

[0108] Step 301, the mobile phone receives a start instruction of starting the first application, in response to the start instruction, a first virtual screen is created to run the first application, and a data frame of the first virtual screen is captured.

[0109] Step 302, the mobile phone encodes the captured data frame through an encoder.

[0110] Step 303, the mobile phone transmits the data frame to the AR glasses through a communication module.

[0111] Step 304, the mobile phone detects whether the data frame is successfully sent, if yes, step 401 is executed, otherwise, step 305 is executed.

[0112] Step 305, the mobile phone switches the streaming mode, and continues to execute step 303.

[0113] Step 401, the AR glasses receive the data frame through the communication module, on the one hand, the AR glasses decode the data frame through a decoder and display the data frame through a display screen. On the other hand, the AR glasses calculate the frame loss rate according to the received data frame, and send a heartbeat packet to the mobile phone through a TCP connection to calculate the transmission delay.

[0114] Step 402, the AR glasses send a first adjustment request of adjusting the streaming mode to the mobile phone when the frame loss rate is greater than a first frame loss rate threshold and / or the transmission delay is greater than a first delay threshold, and execute step 305.

[0115] <Example 2>

[0116] Next, taking the first device as an AR glasses and the second device as a mobile phone as an example, a parameter adjustment method of an example is shown, referring to FIG. 4 and FIG. 6, the parameter adjustment method comprises:

[0117] Step 501, the mobile phone receives a start instruction of starting the first application, in response to the start instruction, a first virtual screen is created to run the first application, and a data frame of the first virtual screen is captured.

[0118] Step 502, the mobile phone encodes the captured data frame through an encoder.

[0119] Step 503, the mobile phone transmits the data frame to the AR glasses through a communication module.

[0120] Step 504, the mobile phone detects whether the data frame is successfully transmitted, if yes, step 601 is executed, otherwise, step 505 is executed.

[0121] Step 505, the mobile phone switches the streaming mode and continues to execute step 503.

[0122] Step 601, the AR glasses receive the data frame through a communication module. On one hand, the AR glasses decode the data frame through a decoder and display the data frame through a display screen. On the other hand, the AR glasses calculate the frame loss rate according to the received data frame and send a heartbeat packet to the mobile phone through a TCP connection to calculate the transmission delay.

[0123] Step 602, the AR glasses send a second adjustment request for adjusting the code rate and / or resolution to the mobile phone when the frame loss rate is less than or equal to a first frame loss rate threshold and greater than a second frame loss rate threshold, and / or the transmission delay is less than or equal to a first delay threshold and greater than a second delay threshold.

[0124] Step 506, the mobile phone receives the second adjustment request, adjusts the code rate and / or resolution, and re-executes step 502.

[0125] <Device Embodiment>

[0126] Fig. 7 is a schematic diagram of a parameter adjustment device according to an embodiment. Referring to Fig. 7, the parameter adjustment device 700 includes an acquisition module 710 and a control module 720.

[0127] The acquisition module 710 is configured to acquire first parameter information of a data frame transmitted by a second device during reception of the data frame, wherein the first parameter information includes at least one of a frame loss rate and a transmission delay.

[0128] The control module 720 is configured to control the second device to adjust second parameter information of the data frame according to the first parameter information, so that the second device transmits the data frame based on the adjusted second parameter information, wherein the second parameter information includes at least one of a streaming mode, a code rate, and a resolution.

[0129] In one embodiment, the first parameter information comprises a frame loss rate, the obtaining module 710 is configured to determine a first total weight corresponding to total data frames according to the total data frames transmitted by the second device; determine a second total weight corresponding to lost data frames according to the lost data frames in the process of transmitting the data frames; and obtain the first parameter information according to the first total weight and the second total weight.

[0130] In one embodiment, the first parameter information comprises a transmission delay, the obtaining module 710 is configured to obtain an average delay of heartbeat packets sent to the second device in the process of receiving data frames transmitted by the second device; and obtain the first parameter information according to the average delay.

[0131] In one embodiment, the obtaining module 710 is configured to send an i th heartbeat packet to the second device and record a first time stamp of sending the i th heartbeat packet in the process of receiving data frames transmitted by the second device; wherein the initial value of i is 1; receive the i th heartbeat packet returned by the second device and record a second time stamp of receiving the i th heartbeat packet; determine a two-way delay of transmitting the i th heartbeat packet according to the first time stamp and the second time stamp, and make i = i + 1, and judge whether i is less than or equal to p, p being the total number of the heartbeat packets; continue to send the i th heartbeat packet to the second device in the case that i is less than or equal to p; and obtain the average delay according to the two-way delays of p in the case that i is greater than p.

[0132] In one embodiment, the second parameter information comprises a streaming mode, a code rate and a resolution, the control module 720 is configured to determine a first adjustment request for adjusting the streaming mode and send it to the second device to make the second device adjust the current streaming mode in the case that the frame loss rate is greater than a first frame loss rate threshold and / or the transmission delay is greater than a first delay threshold; and determine a second adjustment request for adjusting the code rate and / or the resolution and send it to the second device to make the second device adjust the code rate and / or the resolution in the case that the frame loss rate is less than or equal to the first frame loss rate threshold and greater than a second frame loss rate threshold and / or the transmission delay is less than or equal to the first delay threshold and greater than a second delay threshold.

[0133] In one embodiment, the control module 720 is configured to adjust the current streaming mode through the second device in the process of receiving data frames transmitted by the second device if the data frame transmission fails.

[0134] In one embodiment, the apparatus 700 further comprises a display module (not shown in the figure).

[0135] The display module is configured to display the data frame if the data frame transmitted by the second device is received.

[0136] According to the embodiment of the present application, the first device obtains at least one of the first parameter information of the data frame, such as the frame loss rate and the transmission delay, during receiving the data frame transmitted by the second device, and controls the second device to adjust the second parameter information of the data frame according to the first parameter information of the data frame, the second parameter information including at least one of the streaming mode, the code rate and the resolution, so that the second device transmits the data frame based on the adjusted second parameter information, to ensure the picture stability.

[0137] <Device Embodiment>

[0138] Fig. 8 is a schematic diagram of the hardware structure of the first device according to an embodiment. As shown in Fig. 8, the first device 800 includes a processor 810 and a memory 820.

[0139] The memory 820 can be used to store executable computer instructions.

[0140] The processor 810 can be used to control the execution of the parameter adjustment method according to the executable computer instructions.

[0141] The first device 800 can be the first device 100 shown in Fig. 1.

[0142] In another embodiment, the first device 800 can include the above parameter adjustment apparatus 700.

[0143] In one embodiment, each module of the above parameter adjustment apparatus 700 can be realized by running the computer instructions stored in the memory 820 by the processor 810.

[0144] <Computer-readable storage medium>

[0145] The embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions, and the computer instructions are run by the processor to execute the control method provided by the embodiment of the present application.

[0146] The present application can be a system, a method, and / or a computer program product. The computer program product can include a computer readable storage medium having computer readable program instructions stored therein, and the computer readable program instructions are used to cause a processor to implement various aspects of the present application.

[0147] Computer readable storage media can be tangible storage media which can retain and store instructions for use by an instruction execution device. Computer readable storage media can be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer readable storage media include the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.

[0148] Computer readable program instructions described herein can be downloaded to respective computing / processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and / or a wireless network. The network can comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and / or edge servers. A network adapter card or network interface in each computing / processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing / processing device.

[0149] Computer readable program instructions for carrying out operations of the present application can be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate array (FPGA), or programmable logic array (PLA) can execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present application.

[0150] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0151] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include random access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or nonvolatile memory, or a suitable combination of the different types of computer readable storage media. The computer readable program instructions can also be downloaded to a computer, other programmable data processing apparatus, or other device from a computer readable storage medium or to an external computer or external storage device via a data signal that can be transmitted for example via a wired medium or a wireless medium such as the Internet or Wireless Application Protocol (WAP) signaling.

[0152] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0153] The flow diagrams and the block diagrams in the drawings are presented to illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to the present application. In this regard, each block in the flow diagrams and the block diagrams can represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical functions ("instructions"). In some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks can sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustrations, and combinations thereof, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and

[0154] The above-mentioned embodiments of the application are only intended to illustrate the present application, not to limit the present application.

[0155] Those skilled in the art can clearly understand the above-mentioned embodiment method can be realized by means of software and the necessary general hardware platform, of course, also can be through hardware, but in many cases the former is the better embodiment. Based on such understanding, the technical solutions of the present application essentially or say the part of the prior art to make contributions can be embodied in the form of software products, the computer software product is stored in the above-mentioned storage medium (such as ROM / RAM, magnetic disc, optical disc), including several instructions to make a terminal device (may be a mobile phone, computer, server, television, or network equipment, etc.) executes the method of various embodiments of the present application.

[0156] The above-mentioned is only the preferred embodiment of the present application, not therefore limit the patent scope of the present application, all in the inventive concept of the present application, using the present application specification and the equivalent structure transformation of the drawing contents, or direct / indirectly applied in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A parameter adjustment method, characterized by, Applied to a first device, the method comprises: In the process of receiving a data frame transmitted by a second device, obtaining first parameter information of the data frame; Wherein, the first parameter information comprises at least one of frame loss rate and transmission delay; According to the first parameter information, the second device adjusts the second parameter information of the data frame, so that the second device transmits the data frame based on the adjusted second parameter information; wherein, the second parameter information comprises at least one of streaming mode, code rate and resolution. The first parameter information includes frame loss rate, and the first parameter information of the data frame is obtained in the process of receiving the data frame transmitted by the second device, comprising:

2. The method of claim 1, wherein, According to the total data frame received by the second device, determine the first total weight corresponding to the total data frame; According to the data frame lost in the process of transmitting the data frame, determine the second total weight corresponding to the lost data frame; According to the first total weight and the second total weight, the first parameter information is obtained. The first parameter information includes transmission delay, 3. The method of claim 1, wherein, The first parameter information of the data frame is obtained in the process of receiving the data frame transmitted by the second device, comprising: In the process of receiving the data frame transmitted by the second device, the average delay of the heartbeat packet sent to the second device is obtained; According to the average delay, the first parameter information is obtained. The average delay of the heartbeat packet sent to the second device is obtained in the process of receiving the data frame transmitted by the second device, comprising:

4. The method of claim 3, wherein, In the process of receiving the data frame transmitted by the second device, the i-th heartbeat packet is sent to the second device, and the first time stamp of sending the i-th heartbeat packet is recorded; wherein, the initial value of i is 1; The second device returns the i-th heartbeat packet, and the second time stamp of receiving the i-th heartbeat packet is recorded; According to the first time stamp and the second time stamp, the two-way delay of transmitting the i-th heartbeat packet is determined, i is made i+1, and it is judged whether i is less than or equal to p, p is the total number of the heartbeat packet; In the case of i less than or equal to p, continue to execute the step of sending the i-th heartbeat packet to the second device; In the case of i greater than p, the average delay is obtained according to the two-way delay of p. The second parameter information includes streaming mode, code rate and resolution, 5. The method of claim 1, wherein, According to the first parameter information, the second device adjusts the second parameter information of the data frame, comprising: In the case of the frame loss rate being greater than the first frame loss rate threshold, and / or the transmission delay being greater than the first delay threshold, the first adjustment request for adjusting the streaming mode is determined and sent to the second device, so that the second device adjusts the current streaming mode; ​ In a case that the frame loss rate is less than or equal to the first frame loss rate threshold and greater than a second frame loss rate threshold, and / or, the transmission delay is less than or equal to the first delay threshold and greater than a second delay threshold, a second adjustment request for adjusting the code rate and / or resolution is determined and sent to the second device, so that the second device adjusts the code rate and / or resolution.

6. The method of claim 1, wherein, The method further comprises: In a process of receiving a data frame transmitted by the second device, if the data frame transmission fails, adjusting a current streaming mode by the second device.

7. The method of claim 1, wherein, The method further comprises: In a case that the data frame transmitted by the second device is received, displaying the data frame.

8. A parameter adjustment apparatus characterized by comprising: The apparatus is applied to a first device, and the apparatus comprises: An obtaining module, configured to obtain first parameter information of a data frame transmitted by a second device in a process of receiving the data frame, wherein the first parameter information comprises at least one of a frame loss rate and a transmission delay; A control module, configured to control the second device to adjust second parameter information of the data frame according to the first parameter information, so that the second device transmits the data frame based on the adjusted second parameter information, wherein the second parameter information comprises at least one of a streaming mode, a code rate and a resolution.

9. A first device, comprising: The first device comprises: A memory, configured to store executable computer instructions; A processor, configured to execute the parameter adjustment method according to any one of claims 1-7 according to control of the executable computer instructions. 10.A computer readable storage medium, having computer instructions stored thereon, wherein the computer instructions are run by a processor to execute the parameter adjustment method according to any one of claims 1-7.

Images