Audio and video data processing method, device and equipment

Abstract

The application provides an audio and video data processing method, device and equipment, and relates to digital image processing technology. The method comprises the following steps: receiving an audio and video session request sent by a first device; wherein the audio and video session request comprises a preferred resolution supported by the first device; searching for a first target resolution matched with the preferred resolution in a preset resolution information set, and sending the first target resolution to the first device; wherein the first target resolution represents the resolution of an audio and video session between the first device and a second device. According to the method, the called party can determine the first target resolution in priority through the preferred resolution carried by the calling party, and realize the audio and video session according to the first target resolution, thereby improving the audio quality of the audio and video call and solving the technical problem of low audio quality of the audio and video call.

Description

Technical Field

[0001] This application relates to digital image processing technology, and more particularly to an audio and video data processing method, apparatus, and device. Background Technology

[0002] Currently, users can conduct audio and video conversations through the offer / answer negotiation mechanism in the Session Description Protocol (SDP).

[0003] In the prior art, when users conduct audio and video conversations, the calling party initiates an audio and video conversation request to the called party. The audio and video conversation request includes the maximum resolution supported by the calling party. Upon receiving the audio and video conversation request, the called party matches the maximum resolution in the audio and video conversation request, as well as other resolutions below the maximum resolution, with the resolutions in its local resolution set to obtain the target resolution. The target resolution is then sent to the calling party, thereby realizing the audio and video conversation between users based on the target resolution.

[0004] However, in the existing technology, when realizing audio and video calls between users, the target resolution can only be determined by the called party. There may be cases where the target resolution determined by the called party is low, which will result in low audio quality of the audio and video calls. Summary of the Invention

[0005] This application provides an audio and video data processing method, apparatus, and device to solve the technical problem of low audio quality in audio and video calls.

[0006] In a first aspect, this application provides an audio and video data processing method applied to a second device; the method includes:

[0007] Receive an audio / video session request sent by a first device; wherein the audio / video session request includes a preferred resolution supported by the first device;

[0008] A first target resolution that matches the preferred resolution is found within a preset set of resolution information, and the first target resolution is sent to the first device; wherein, the first target resolution represents the resolution of the audio and video session between the first device and the second device.

[0009] Furthermore, the audio / video session request also includes the maximum resolution supported by the first device; the method further includes:

[0010] If no first target resolution matching the preferred resolution is found in the preset resolution information set, then a matching information set is generated based on the maximum resolution and other resolutions below the maximum resolution.

[0011] The maximum resolution and other resolutions below the maximum resolution in the set of information to be matched are matched with a preset set of resolution information to obtain a matching second target resolution.

[0012] The second target resolution is sent to the first device; wherein the second target resolution represents the resolution of the audio and video session between the first device and the second device.

[0013] Further, the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched are matched with a preset resolution information set to obtain a matching second target resolution, including:

[0014] According to the preset matching order, the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched are matched with the preset resolution information set in turn to obtain the matched second target resolution.

[0015] Furthermore, the preferred resolution is less than the maximum resolution.

[0016] Secondly, this application provides an audio and video data processing method, applied to a first device; the method includes:

[0017] Send an audio / video session request to a second device; wherein the audio / video session request includes a preferred resolution supported by the first device, and the preferred resolution is used by the second device to determine a first target resolution;

[0018] The device receives the first target resolution sent by the second device; wherein the first target resolution represents the resolution of the audio and video session between the first device and the second device.

[0019] Furthermore, the audio / video session request also includes the maximum resolution supported by the first device, the maximum resolution being used by the second device to determine the second target resolution; the method further includes:

[0020] If the first target resolution sent by the second device is not received, then the second target resolution sent by the second device is received; wherein, the second target resolution represents the resolution of the audio and video session between the first device and the second device; the second target resolution is obtained by matching a preset resolution information set with the maximum resolution in the matching information set and other resolutions below the maximum resolution, and the matching information set is determined based on the maximum resolution and other resolutions below the maximum resolution.

[0021] Furthermore, the second target resolution is obtained by matching the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched with a preset resolution information set in a preset matching order.

[0022] Furthermore, the preferred resolution is less than the maximum resolution.

[0023] Thirdly, this application provides an audio / video data processing apparatus for use in a second device; the apparatus includes:

[0024] A receiving unit is configured to receive an audio / video session request sent by a first device; wherein the audio / video session request includes a preferred resolution supported by the first device;

[0025] The first matching unit is used to find a first target resolution that matches the preferred resolution within a preset resolution information set;

[0026] A first transmitting unit is configured to transmit the first target resolution to the first device; wherein the first target resolution characterizes the resolution of the audio and video session between the first device and the second device.

[0027] Furthermore, the audio / video session request also includes the maximum resolution supported by the first device; the apparatus further includes:

[0028] The generation unit is used to generate a set of matching information based on the maximum resolution and other resolutions below the maximum resolution if no first target resolution matching the preferred resolution is found in the preset resolution information set.

[0029] The second matching unit is used to match the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched with a preset resolution information set to obtain a matching second target resolution.

[0030] The second transmitting unit is configured to transmit the second target resolution to the first device; wherein the second target resolution characterizes the resolution of the audio and video session between the first device and the second device.

[0031] Furthermore, the second matching unit is specifically used for:

[0032] According to the preset matching order, the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched are matched with the preset resolution information set in turn to obtain the matched second target resolution.

[0033] Furthermore, the preferred resolution is less than the maximum resolution.

[0034] Fourthly, this application provides an audio / video data processing apparatus, applied to a first device; the apparatus includes:

[0035] A sending unit is configured to send an audio / video session request to a second device; wherein the audio / video session request includes a preferred resolution supported by the first device, and the preferred resolution is used by the second device to determine a first target resolution;

[0036] A first receiving unit is configured to receive the first target resolution sent by the second device; wherein the first target resolution characterizes the resolution of the audio and video session between the first device and the second device.

[0037] Furthermore, the audio / video session request also includes a maximum resolution supported by the first device, the maximum resolution being used by the second device to determine a second target resolution; the apparatus further includes:

[0038] The second receiving unit is configured to receive a second target resolution sent by the second device if the first target resolution is not received from the second device; wherein the second target resolution represents the resolution of the audio and video session between the first device and the second device; the second target resolution is obtained by matching a preset resolution information set with the maximum resolution in the matching information set and other resolutions below the maximum resolution, and the matching information set is determined based on the maximum resolution and other resolutions below the maximum resolution.

[0039] Furthermore, the second target resolution is obtained by matching the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched with a preset resolution information set in a preset matching order.

[0040] Furthermore, the preferred resolution is less than the maximum resolution.

[0041] Fifthly, this application provides a second device, including a memory and a processor, wherein the memory stores a computer program that can run on the processor, and the processor executes the computer program to implement the method described in the first aspect above.

[0042] In a sixth aspect, this application provides a first device, including a memory and a processor, wherein the memory stores a computer program executable on the processor, and the processor executes the computer program to implement the method described in the second aspect.

[0043] In a seventh aspect, this application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the method described in the first aspect.

[0044] Eighthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the method described in the first aspect.

[0045] This application provides an audio and video data processing method, apparatus, and device, which receives an audio and video session request sent by a first device. The audio and video session request includes a preferred resolution supported by the first device. A first target resolution matching the preferred resolution is searched within a preset resolution information set, and then sent to the first device. The first target resolution represents the resolution of the audio and video session between the first device and a second device. In this solution, since the received audio and video session request includes the preferred resolution supported by the first device, the second device can prioritize matching the preferred resolution within the preset resolution information set and send the matched first target resolution to the first device. This allows the audio and video session between the first device (i.e., the calling party) and the second device (i.e., the called party) to be realized through the first target resolution. Therefore, the called party can prioritize determining the first target resolution based on the preferred resolution carried by the calling party and realize the audio and video session according to the first target resolution, thereby improving the audio quality of audio and video calls and solving the technical problem of low audio quality in audio and video calls. Attached Figure Description

[0046] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0047] Figure 1 A flowchart illustrating an audio / video data processing method provided in an embodiment of this application;

[0048] Figure 2 A flowchart illustrating another audio / video data processing method provided in an embodiment of this application;

[0049] Figure 3 A flowchart illustrating another audio / video data processing method provided in this application embodiment;

[0050] Figure 4 A flowchart illustrating another audio / video data processing method provided in an embodiment of this application;

[0051] Figure 5 This is a schematic diagram of the structure of an audio and video data processing device provided in an embodiment of this application;

[0052] Figure 6 A schematic diagram of another audio and video data processing device provided in the embodiments of this application;

[0053] Figure 7 A schematic diagram of the structure of another audio and video data processing device provided in an embodiment of this application;

[0054] Figure 8 A schematic diagram of another audio / video data processing device provided in an embodiment of this application;

[0055] Figure 9 This is a schematic diagram of the structure of a second device provided in an embodiment of this application;

[0056] Figure 10 This is a schematic diagram of the structure of a first device provided in an embodiment of this application;

[0057] Figure 11 A schematic diagram illustrating a scenario for an audio / video data processing method provided in an embodiment of this application;

[0058] Figure 12 This is a block diagram of an electronic device provided in an embodiment of this application.

[0059] The accompanying drawings have illustrated specific embodiments of this disclosure, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this disclosure to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0060] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure.

[0061] In one example, users can conduct audio and video conversations through the offer / answer negotiation mechanism in the Session Description Protocol (SDP). In existing technology, when users conduct audio and video conversations, the calling party initiates an audio / video conversation request to the called party. This request includes the maximum resolution supported by the calling party. Upon receiving the request, the called party matches the maximum resolution and other resolutions below the maximum resolution in the request with resolutions in its local resolution set to obtain a target resolution. This target resolution is then sent to the calling party, thus establishing the audio and video conversation between users. However, in existing technology, since the target resolution can only be determined by the called party, the target resolution determined by the called party may be low, leading to low audio quality in the audio and video call.

[0062] This application provides an audio and video data processing method, apparatus, and device, which aims to solve the above-mentioned technical problems in the prior art.

[0063] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0064] Figure 1 This application provides a flowchart illustrating an audio / video data processing method applied to a second device. Figure 1 As shown, the method includes:

[0065] 101. Receive an audio / video session request sent by the first device; wherein the audio / video session request includes a preferred resolution supported by the first device.

[0066] For example, the first and second devices can conduct audio and video sessions through the offer / answer negotiation mechanism in the Session Description Protocol (SDP). These audio and video sessions include VoIP, video chat, video surveillance, video return, service distribution, and teleconferencing. Device resolutions include 1080P, and resolutions below 1080P such as 720P, D1, and Common Intermediate Format (CIF). Specifically, 1080P has a resolution of 1920×1080, 720P has a resolution of 1280×720, D1 = 720×576 pixels, and CIF = 352×288 pixels. D1 is a standard display format for digital television systems. When conducting an audio / video session, if the first device is the calling party in the audio / video session and the second device is the called party, the first device sends an audio / video session request to the second device. The audio / video session request includes the preferred resolution supported by the first device itself. The preferred resolution is the optimal resolution determined by the first device based on its own local bandwidth, or it is a resolution that the user specifies as the preferred choice. When the second device receives the audio / video session request sent by the first device, it obtains the preferred resolution in the audio / video session request.

[0067] For example, when conducting an audio / video session, the first device sends an audio / video session request to the second device. The audio / video session request includes the preferred resolution 720P supported by the first device itself. The preferred resolution 720P is the optimal resolution determined by the first device based on its own local bandwidth. When the second device receives the audio / video session request sent by the first device, it obtains the preferred resolution 720P in the audio / video session request.

[0068] 102. Find a first target resolution that matches the preferred resolution within a preset resolution information set, and send the first target resolution to the first device; wherein, the first target resolution represents the resolution of the audio and video session between the first device and the second device.

[0069] For example, the preset resolution information set is a set of resolutions supported by the second device itself, which is pre-set by the second device. The resolution information set includes at least one resolution supported by the local bandwidth of the second device. The second device matches the preferred resolution with multiple resolutions in the resolution information set, finds a first target resolution that matches the preferred resolution, and sends the first target resolution to the first device. When the first device receives the first target resolution, an audio / video session is established between the first device and the second device, and the resolution of the audio / video session is the first target resolution.

[0070] For example, if the preferred resolution in the audio / video session request (i.e., SDP offer) is 720P, the second device matches the preferred resolution 720P with multiple resolutions in the resolution information set, finds a first target resolution 720P that matches the preferred resolution 720P, and sends the first target resolution 720P to the first device. This means the second device carries the first target resolution 720P for this audio / video session in its 2000K SDP answer. The first target resolution 720P is the negotiated resolution obtained by the second device based on the preferred resolution. When the first device receives the first target resolution 720P, the audio / video session between the first and second devices is established, and the resolution of the audio / video session is the first target resolution 720P.

[0071] In this embodiment, an audio / video session request sent by a first device is received; wherein the audio / video session request includes a preferred resolution supported by the first device. A first target resolution matching the preferred resolution is searched within a preset resolution information set, and the first target resolution is sent to the first device; wherein the first target resolution represents the resolution of the audio / video session between the first device and the second device. In this solution, since the received audio / video session request includes the preferred resolution supported by the first device, the second device can prioritize matching the preferred resolution within the preset resolution information set and send the matched first target resolution to the first device. Thus, an audio / video session between the first device (i.e., the calling party) and the second device (i.e., the called party) can be achieved through the first target resolution. Therefore, the called party can prioritize determining the first target resolution based on the preferred resolution carried by the calling party and achieve an audio / video session based on the first target resolution, thereby improving the audio quality of audio / video calls and solving the technical problem of low audio quality in audio / video calls.

[0072] Figure 2 A flowchart illustrating another audio / video data processing method provided in this application embodiment, applied to a second device; as shown Figure 2 As shown, the method includes:

[0073] 201. Receive an audio / video session request sent by the first device; wherein the audio / video session request includes a preferred resolution supported by the first device.

[0074] For example, this step can be referred to Figure 1 Step 101 in the above will not be repeated. In addition, an example of the method for setting the preferred resolution for the first device is as follows;

[0075] The SDP format now includes a new field, preferfmt:

[0076] a = fmtp:104profile-id = 1; level-id = 150; preferfmt = 150; / / H.265 format, in this example level-id / preferfmt / supportedfmt all correspond to 4K resolution.

[0077] a = fmtp:100profile-level-id = 42e033; preferfmt = 29; / / H264 format, the level-id carried by preferfmt indicates that 1080 is preferred.

[0078] The `preferfmt` field indicates the preferred resolution. It is used in the calling INVITE message for video surveillance, backhaul, and distribution services. It represents the resolution that the user wants to choose first. Value: Preferred resolution, only one level-id needs to be filled in.

[0079] 202. Find a first target resolution that matches the preferred resolution within a preset resolution information set, and send the first target resolution to the first device; wherein, the first target resolution represents the resolution of the audio and video session between the first device and the second device.

[0080] For example, this step can be referred to Figure 1 Step 102 in the text will not be repeated here.

[0081] 203. The audio and video session request also includes the maximum resolution supported by the first device; if no first target resolution matching the preferred resolution is found in the preset resolution information set, a matching information set is generated based on the maximum resolution and other resolutions below the maximum resolution.

[0082] In one example, a resolution lower than the maximum resolution is preferred.

[0083] For example, the audio / video session request also includes the maximum resolution supported by the first device, and preferably a resolution smaller than the maximum resolution. If the second device does not find a first target resolution that matches the preferred resolution in the preset resolution information set, then the maximum resolution and other resolutions below the maximum resolution are all determined as resolutions to be matched, and a matching information set is generated based on the maximum resolution and other resolutions below the maximum resolution.

[0084] For example, the preferred resolution of the first device is 720P, and the maximum resolution of the first device is 1080P. The resolution information set of the second device includes D1. Since D1 in the resolution information set does not match the preferred resolution 720P, the second device does not find a first target resolution that matches the preferred resolution 720P in the preset resolution information set. Therefore, the maximum resolution 1080P of the first device and other resolutions below the maximum resolution 1080P are all determined as the information set to be matched.

[0085] 204. Match the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched with the preset resolution information set to obtain the matched second target resolution.

[0086] In one example, according to a preset matching order, the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched are matched with the preset resolution information set in turn to obtain the matched second target resolution.

[0087] For example, the preset matching order can be a pre-defined priority order of resolutions, such as a matching order from highest to lowest priority. The second device can match the highest resolution and other resolutions below the highest resolution in the set of information to be matched with the preset resolution information set in descending order of priority until a matching second target resolution is obtained. Once the matching second target resolution is obtained, the matching stops.

[0088] For example, the first device's set of information to be matched includes 1080P, D1, and CIF. 1080P has a resolution of 1920×1080, 720P has a resolution of 1280×720, D1 = 720×576 pixels, and CIF = 352×288 pixels. The second device's resolution information set includes D1. The second device can match the highest resolution 1080P in the set of information to be matched with the preset resolution information set according to the matching order from largest to smallest. Since there is no 1080P in the resolution information set, it is necessary to continue to match D1 in the set of information to be matched with the preset resolution information set. Since there is D1 in the resolution information set, the second target resolution D1 is obtained.

[0089] 205. Send the second target resolution to the first device; wherein the second target resolution represents the resolution of the audio and video session between the first device and the second device.

[0090] For example, the second device sends the second target resolution to the first device. When the first device receives the second target resolution, it initiates an audio and video session between the first device and the second device. The resolution of the audio and video session is the second target resolution.

[0091] For example, if the second target resolution has been determined to be D1 in step 204, then the second target resolution D1 is sent to the first device. When the first device receives the second target resolution D1, an audio and video session is opened between the first device and the second device. The resolution of the audio and video session is the first target resolution of 720P.

[0092] In this embodiment, an audio / video session request sent by a first device is received; wherein the audio / video session request includes a preferred resolution supported by the first device. A first target resolution matching the preferred resolution is searched within a preset resolution information set, and the first target resolution is sent to the first device; wherein the first target resolution represents the resolution of the audio / video session between the first device and the second device. The audio / video session request also includes a maximum resolution supported by the first device; if no first target resolution matching the preferred resolution is found in the preset resolution information set, a matching information set is generated based on the maximum resolution and other resolutions below the maximum resolution. The maximum resolution and other resolutions below the maximum resolution in the matching information set are matched with the preset resolution information set to obtain a matching second target resolution. The second target resolution is sent to the first device; wherein the second target resolution represents the resolution of the audio / video session between the first device and the second device. Therefore, the called party can preferentially determine the first target resolution based on the preferred resolution carried by the calling party, and realize the audio / video session based on the first target resolution, thereby improving the audio quality of the audio / video call and solving the technical problem of low audio quality in audio / video calls.

[0093] Figure 3 A flowchart illustrating another audio / video data processing method provided in this application embodiment, applied to a first device; as shown Figure 3 As shown, it includes:

[0094] 301. Send an audio / video session request to the second device; wherein the audio / video session request includes a preferred resolution supported by the first device, and the preferred resolution is used by the second device to determine the first target resolution.

[0095] 302. Receive the first target resolution sent by the second device; wherein the first target resolution represents the resolution of the audio and video session between the first device and the second device.

[0096] The solution in this embodiment can be found in the technical solution of the above method. The specific implementation process and technical principles are the same, and will not be repeated here.

[0097] Figure 4 This is a flowchart illustrating another audio / video data processing method provided in an embodiment of this application, applied to a first device; as follows: Figure 4As shown, the method includes:

[0098] 401. Send an audio / video session request to the second device; wherein the audio / video session request includes a preferred resolution supported by the first device, and the preferred resolution is used by the second device to determine a first target resolution.

[0099] 402. Receive the first target resolution sent by the second device; wherein the first target resolution represents the resolution of the audio and video session between the first device and the second device.

[0100] 403. The audio / video session request also includes the maximum resolution supported by the first device, which is used by the second device to determine the second target resolution; if the first target resolution is not received from the second device, the second target resolution sent by the second device is received; wherein, the second target resolution represents the resolution of the audio / video session between the first device and the second device; the second target resolution is obtained by matching the maximum resolution and other resolutions below the maximum resolution in the matching information set with a preset resolution information set, which is determined based on the maximum resolution and other resolutions below the maximum resolution.

[0101] In one example, the second target resolution is obtained by matching the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched with the preset resolution information set in a preset matching order.

[0102] In one example, a resolution lower than the maximum resolution is preferred.

[0103] The solution in this embodiment can be found in the technical solution of the above method. The specific implementation process and technical principles are the same, and will not be repeated here.

[0104] Figure 5 This application provides a schematic diagram of the structure of an audio / video data processing device, applied to a second device; as shown. Figure 5 As shown, the device includes:

[0105] The receiving unit 51 is configured to receive an audio / video session request sent by the first device; wherein the audio / video session request includes a preferred resolution supported by the first device.

[0106] The first matching unit 52 is used to find a first target resolution that matches the preferred resolution within a preset resolution information set.

[0107] The first transmitting unit 53 is used to transmit the first target resolution to the first device; wherein the first target resolution represents the resolution of the audio and video session between the first device and the second device.

[0108] The apparatus in this embodiment can execute the technical solutions in the above method. Its specific implementation process and technical principles are the same, and will not be repeated here.

[0109] Figure 6 This is a schematic diagram of another audio and video data processing device provided in an embodiment of this application. Figure 5 Based on the illustrated embodiments, as Figure 6 As shown, the audio / video session request also includes the maximum resolution supported by the first device; the device also includes:

[0110] The generation unit 61 is used to generate a set of information to be matched based on the maximum resolution and other resolutions below the maximum resolution if no first target resolution matching the preferred resolution is found in the preset resolution information set.

[0111] The second matching unit 62 is used to match the maximum resolution and other resolutions below the maximum resolution in the information set to be matched with a preset resolution information set to obtain the matched second target resolution.

[0112] The second transmitting unit 63 is used to transmit the second target resolution to the first device; wherein the second target resolution represents the resolution of the audio and video session between the first device and the second device.

[0113] In one example, the second matching unit 62 is specifically used for:

[0114] According to the preset matching order, the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched are matched with the preset resolution information set in turn to obtain the matched second target resolution.

[0115] In one example, a resolution lower than the maximum resolution is preferred.

[0116] The apparatus in this embodiment can execute the technical solutions in the above method. Its specific implementation process and technical principles are the same, and will not be repeated here.

[0117] Figure 7 This is a schematic diagram of another audio / video data processing device provided in an embodiment of this application, applied to the first device; as shown below. Figure 7 As shown, the device includes:

[0118] The sending unit 71 is used to send an audio / video session request to the second device; wherein the audio / video session request includes a preferred resolution supported by the first device, and the preferred resolution is used by the second device to determine a first target resolution.

[0119] The first receiving unit 72 is used to receive a first target resolution sent by the second device; wherein the first target resolution represents the resolution of the audio and video session between the first device and the second device.

[0120] The apparatus in this embodiment can execute the technical solutions in the above method. Its specific implementation process and technical principles are the same, and will not be repeated here.

[0121] Figure 8 This is a schematic diagram of the structure of another audio and video data processing device provided in the embodiments of this application. Figure 7 Based on the illustrated embodiments, as Figure 8 As shown, the audio / video session request also includes a maximum resolution supported by the first device, which is used by the second device to determine a second target resolution; the device also includes:

[0122] The second receiving unit 81 is configured to receive the second target resolution sent by the second device if the first target resolution is not received from the second device; wherein the second target resolution represents the resolution of the audio and video session between the first device and the second device; the second target resolution is obtained by matching a preset resolution information set with the maximum resolution and other resolutions below the maximum resolution in the matching information set, and the matching information set is determined based on the maximum resolution and other resolutions below the maximum resolution.

[0123] In one example, the second target resolution is obtained by matching the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched with the preset resolution information set in a preset matching order.

[0124] In one example, a resolution lower than the maximum resolution is preferred.

[0125] The apparatus in this embodiment can execute the technical solutions in the above method. Its specific implementation process and technical principles are the same, and will not be repeated here.

[0126] Figure 9 This is a schematic diagram of the structure of a second device provided in an embodiment of this application, such as... Figure 9 As shown, the second device includes: a memory 91 and a processor 92.

[0127] The memory 91 stores a computer program that can run on the processor 92.

[0128] The processor 92 is configured to perform the methods provided in the embodiments described above.

[0129] The second device also includes a receiver 93 and a transmitter 94. The receiver 93 is used to receive instructions and data sent by an external device, and the transmitter 94 is used to send instructions and data to an external device.

[0130] Figure 10 This is a schematic diagram of the structure of a first device provided in an embodiment of this application, as shown below. Figure 10 As shown, the first device includes: a memory 101 and a processor 102.

[0131] The memory 101 stores a computer program that can run on the processor 102.

[0132] The processor 102 is configured to perform the methods provided in the embodiments described above.

[0133] The first device also includes a receiver 103 and a transmitter 104. The receiver 103 is used to receive instructions and data sent by an external device, and the transmitter 104 is used to send instructions and data to an external device.

[0134] For example, Figure 11 This is a schematic diagram of a scenario for an audio / video data processing method provided in an embodiment of this application.

[0135] Figure 12 This is a block diagram of an electronic device provided in an embodiment of this application. The electronic device may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0136] Device 1100 may include one or more of the following components: processing component 1102, memory 1104, power supply component 1106, multimedia component 1108, audio component 1110, input / output (I / O) interface 1112, sensor component 1114, and communication component 1116.

[0137] Processing component 1102 typically controls the overall operation of device 1100, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 1102 may include one or more processors 1120 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 1102 may include one or more modules to facilitate interaction between processing component 1102 and other components. For example, processing component 1102 may include a multimedia module to facilitate interaction between multimedia component 1108 and processing component 1102.

[0138] Memory 1104 is configured to store various types of data to support the operation of device 1100. Examples of such data include instructions for any application or method operating on device 1100, contact data, phonebook data, messages, pictures, videos, etc. Memory 1104 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0139] Power supply component 1106 provides power to various components of device 1100. Power supply component 1106 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 1100.

[0140] Multimedia component 1108 includes a screen that provides an output interface between device 1100 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 1108 includes a front-facing camera and / or a rear-facing camera. When device 1100 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0141] Audio component 1110 is configured to output and / or input audio signals. For example, audio component 1110 includes a microphone (MIC) configured to receive external audio signals when device 1100 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 1104 or transmitted via communication component 1116. In some embodiments, audio component 1110 also includes a speaker for outputting audio signals.

[0142] I / O interface 1112 provides an interface between processing component 1102 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0143] Sensor assembly 1114 includes one or more sensors for providing state assessments of various aspects of device 1100. For example, sensor assembly 1114 may detect the on / off state of device 1100, the relative positioning of components such as the display and keypad of device 1100, changes in the position of device 1100 or a component of device 1100, the presence or absence of user contact with device 1100, the orientation or acceleration / deceleration of device 1100, and temperature changes of device 1100. Sensor assembly 1114 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1114 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 1114 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0144] Communication component 1116 is configured to facilitate wired or wireless communication between device 1100 and other devices. Device 1100 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 1116 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 1116 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0145] In an exemplary embodiment, the apparatus 1100 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0146] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1104 including instructions, which can be executed by a processor 1120 of the device 1100 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0147] This application also provides a non-transitory computer-readable storage medium, which, when the instructions in the storage medium are executed by the processor of an electronic device, enables the electronic device to perform the methods provided in the above embodiments.

[0148] This application also provides a computer program product, which includes: a computer program stored in a readable storage medium, at least one processor of an electronic device can read the computer program from the readable storage medium, and the at least one processor executes the computer program to cause the electronic device to perform the solution provided in any of the above embodiments.

[0149] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0150] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for processing audio and video data, characterized in that, Applied to a second device; the method includes: Receive an audio / video session request sent by a first device; wherein the audio / video session request includes the preferred resolution and the maximum resolution supported by the first device, the preferred resolution being the optimal resolution determined by the first device based on its own local bandwidth, or the resolution that the user wishes to prioritize. A first target resolution matching the preferred resolution is found within a preset resolution information set, and the first target resolution is sent to the first device; wherein, the first target resolution represents the resolution of the audio and video session between the first device and the second device, and the resolution information set includes at least one resolution supported by the local bandwidth of the second device itself; If no first target resolution matching the preferred resolution is found in the preset resolution information set, then a matching information set is generated based on the maximum resolution and other resolutions below the maximum resolution. According to a preset matching order, the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched are matched with a preset resolution information set in sequence to obtain a second target resolution; the second target resolution is sent to the first device; wherein, the second target resolution represents the resolution of the audio and video session between the first device and the second device.

2. The method according to claim 1, characterized in that, The preferred resolution is less than the maximum resolution.

3. A method for processing audio and video data, characterized in that, Applied to a first device; the method includes: Send an audio / video session request to the second device; wherein, the audio / video session request includes a preferred resolution and a maximum resolution supported by the first device, the preferred resolution is used by the second device to determine a first target resolution, the preferred resolution is the optimal resolution determined by the first device based on its own local bandwidth, or the resolution that the user wants to prioritize, and the maximum resolution is used by the second device to determine a second target resolution; Receive the first target resolution sent by the second device; wherein the first target resolution represents the resolution of the audio and video session between the first device and the second device; If the first target resolution sent by the second device is not received, then the second target resolution sent by the second device is received; wherein, the second target resolution represents the resolution of the audio and video session between the first device and the second device; the second target resolution is obtained by matching the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched with a preset resolution information set according to a preset matching order, wherein the set of information to be matched is determined based on the maximum resolution and other resolutions below the maximum resolution.

4. The method according to claim 3, characterized in that, The preferred resolution is less than the maximum resolution.

5. An audio and video data processing device, characterized in that, Applied to a second device; the device includes: A receiving unit is configured to receive an audio / video session request sent by a first device; wherein the audio / video session request includes a preferred resolution and a maximum resolution supported by the first device, the preferred resolution being the optimal resolution determined by the first device based on its own local bandwidth, or a resolution specified by the user that they wish to prioritize. The first matching unit is used to find a first target resolution that matches the preferred resolution within a preset resolution information set; A first transmitting unit is configured to transmit the first target resolution to the first device; wherein the first target resolution characterizes the resolution of the audio and video session between the first device and the second device, and the resolution information set includes at least one resolution supported by the local bandwidth of the second device itself; The generation unit is used to generate a set of matching information based on the maximum resolution and other resolutions below the maximum resolution if no first target resolution matching the preferred resolution is found in the preset resolution information set. The second matching unit is used to match the maximum resolution and other resolutions below the maximum resolution in the set of information to be matched with the preset resolution information set according to the preset matching order, so as to obtain the matched second target resolution. The second transmitting unit is configured to transmit the second target resolution to the first device; wherein the second target resolution characterizes the resolution of the audio and video session between the first device and the second device.

6. The apparatus according to claim 5, characterized in that, The preferred resolution is less than the maximum resolution.

7. An audio and video data processing device, characterized in that, Applied to a first device; the device includes: A sending unit is used to send an audio / video session request to a second device; wherein, the audio / video session request includes a preferred resolution and a maximum resolution supported by the first device, the preferred resolution is used by the second device to determine a first target resolution, the preferred resolution is the optimal resolution determined by the first device based on its own local bandwidth, or a resolution that the user specifies as preferred; the maximum resolution is used by the second device to determine a second target resolution. A first receiving unit is configured to receive the first target resolution sent by the second device; wherein the first target resolution characterizes the resolution of the audio and video session between the first device and the second device; The second receiving unit is configured to receive a second target resolution sent by the second device if the first target resolution is not received from the second device; wherein the second target resolution represents the resolution of the audio and video session between the first device and the second device; the second target resolution is obtained by matching the maximum resolution and other resolutions below the maximum resolution in a preset matching order with a preset resolution information set, wherein the information set to be matched is determined based on the maximum resolution and other resolutions below the maximum resolution.

8. The apparatus according to claim 7, characterized in that, The preferred resolution is less than the maximum resolution.

9. A second device, characterized in that, The method includes a memory and a processor, wherein the memory stores a computer program that can run on the processor, and the processor executes the computer program to implement the method of any one of claims 1-2.

10. A first device, characterized in that, The method includes a memory and a processor, wherein the memory stores a computer program that can run on the processor, and the processor executes the computer program to implement the method of any one of claims 3-4.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-2, or to implement the method as described in any one of claims 3-4.

12. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method of any one of claims 1-2, or implements the method of any one of claims 3-4.

Images