A data processing method, device and electronic equipment

Abstract

Embodiments of the present application disclose a data processing method, which comprises: obtaining at least one channel of multimedia data collected by at least one multimedia data collection module; performing first processing on the at least one channel of multimedia data to obtain at least one channel of candidate multimedia data; and performing second processing on the at least one channel of candidate multimedia data to obtain target multimedia data capable of being output; wherein the multimedia data collection module is not an electronic device, and the processing algorithms used by the electronic device to perform the first processing and the second processing are at least partially different. Embodiments of the present application also disclose a data processing device and an electronic device.

Description

TECHNICAL FIELD

[0001] The present application relates to the data processing technology in the field of data processing, and particularly relates to a data processing method and device and electronic equipment. BACKGROUND

[0002] With the wide application of multimedia technology, the processing of multimedia data is particularly important. When processing multimedia data, a fixed built-in processing algorithm is usually used by a collection module to perform single processing on the multimedia data, and the processed multimedia data is output. However, when processing multimedia data in this way, the flexibility is low and the quality of the processed multimedia data is poor. SUMMARY

[0003] The technical solution of the present application is implemented as follows:

[0004] A data processing method applied to an electronic device, the method comprising:

[0005] obtaining at least one piece of multimedia data collected by at least one multimedia data collection module;

[0006] performing first processing on the at least one piece of multimedia data to obtain at least one piece of candidate multimedia data;

[0007] performing second processing on the at least one piece of candidate multimedia data to obtain target multimedia data capable of being output;

[0008] wherein the multimedia data collection module is not the electronic device, and the processing algorithms used by the electronic device to perform the first processing and the second processing are at least partially different.

[0009] In the above solution, the obtaining of the at least one piece of multimedia data collected by the at least one multimedia data collection module comprises at least one of the following:

[0010] in response to determining that a target user object has a first relative position relationship with the electronic device, obtaining at least one piece of multimedia data collected by a multimedia data collection component of the electronic device and at least one piece of multimedia data collected by at least one multimedia data collection module;

[0011] in response to determining that a target user object has a second relative position relationship with the electronic device, obtaining at least one piece of multimedia data collected by at least one multimedia data collection module, wherein the distance between at least one multimedia data collection module and the target user object is smaller than the distance between the electronic device and the target user object under the second relative position relationship;

[0012] Obtaining relative position information between the target use object and the at least one multimedia data collection module, and obtaining at least one piece of multimedia data collected by a target multimedia data collection module determined based on the relative position information.

[0013] In the above scheme, in a case where one piece of multimedia data is obtained,

[0014] The first processing of the at least one piece of multimedia data to obtain at least one piece of candidate multimedia data includes at least one of the following:

[0015] Obtaining attribute information of the piece of multimedia data, and performing first processing on the piece of multimedia data based on the attribute information by using a corresponding processing algorithm or a corresponding processing component to obtain first candidate multimedia data, wherein the processing component is configured with at least one processing algorithm.

[0016] Obtaining environment information of a space environment in which the piece of multimedia data is generated, and performing first processing on the piece of multimedia data based on the environment information by using a corresponding processing algorithm or a corresponding processing component to obtain first candidate multimedia data, wherein the processing component is configured with at least one processing algorithm.

[0017] In the above scheme, the second processing of the at least one piece of candidate multimedia data to obtain target multimedia data that can be output includes at least one of the following:

[0018] Performing second processing on the first candidate multimedia data based on the attribute information to obtain the target multimedia data.

[0019] Performing evaluation on the first candidate multimedia data, and performing second processing on the first candidate multimedia data based on an evaluation result to obtain the target multimedia data.

[0020] Obtaining user portrait information of a target use object, and performing second processing on the first candidate multimedia data based on the user portrait information to obtain the target multimedia data.

[0021] Obtaining configuration information of a target output component, and performing second processing on the first candidate multimedia data based on the configuration information to obtain the target multimedia data, wherein the target output component is a component used for outputting the target multimedia data.

[0022] In the above scheme, in a case where at least two pieces of multimedia data are obtained,

[0023] The first processing of the at least one piece of multimedia data to obtain at least one piece of candidate multimedia data includes at least one of the following:

[0024] Obtain the attribute information of each multimedia data stream, and perform a first processing on each multimedia data stream based on the attribute information using a determined processing algorithm or processing unit to obtain at least two candidate multimedia data streams. The processing unit has at least one built-in processing algorithm, and the processing algorithms corresponding to each multimedia data stream may be the same or different, and the processing units corresponding to each multimedia data stream are different.

[0025] Obtain environmental information of the spatial environment that generates each channel of multimedia data, and perform a first processing on each channel of multimedia data based on the environmental information using a corresponding processing algorithm or a corresponding processing component to obtain at least two candidate multimedia data channels. The processing component has at least one processing algorithm built in, and the processing algorithms corresponding to each channel of multimedia data may be the same or different, and the processing components corresponding to each channel of multimedia data are different.

[0026] The source information of each multimedia data stream is obtained, and each multimedia data stream is subjected to a first processing based on the source information using a determined processing algorithm or processing component to obtain at least two candidate multimedia data streams. The processing component has at least one built-in processing algorithm, and the processing algorithm and processing component are different for each multimedia data stream.

[0027] In the above scheme, the second processing of the at least one candidate multimedia data to obtain the target multimedia data that can be output includes at least one of the following:

[0028] The at least two candidate multimedia data streams are spliced ​​together to obtain the target multimedia data.

[0029] The at least two candidate multimedia data streams are fused to obtain the target multimedia data.

[0030] The at least two candidate multimedia data streams are edited to obtain the target multimedia data;

[0031] Based on the attribute information, the candidate multimedia data for each channel is differentiated to obtain the target multimedia data;

[0032] Each candidate multimedia data stream is evaluated, and based on the evaluation results, the candidate multimedia data stream is differentiated to obtain the target multimedia data.

[0033] Obtain user profile information of the target user, and perform differential processing on each candidate multimedia data based on the user profile information to obtain the target multimedia data;

[0034] Obtaining configuration information of a target output component, performing differential processing on each candidate multimedia data based on the configuration information to obtain the target multimedia data, wherein the target output component is a component for outputting the target multimedia data.

[0035] Obtaining target requirement information, performing single or unified processing on each candidate multimedia data based on the target requirement information to obtain the target multimedia data, wherein the target requirement information is from the electronic device or from a remote device in communication connection with the electronic device.

[0036] In the above scheme, in the case of obtaining at least one multimedia data collected by a multimedia data collection component of an electronic device and at least one multimedia data collected by at least one multimedia data collection module,

[0037] The first processing on the at least one multimedia data to obtain at least one candidate multimedia data comprises at least one of the following:

[0038] Obtaining identification information of the multimedia data collection module, performing first processing on the multimedia data collected by the multimedia data collection module based on the identification information with a corresponding processing algorithm or a corresponding processing component to obtain at least one second candidate multimedia data, and the processing component is configured with at least one processing algorithm;

[0039] Obtaining position information of the multimedia data collection module, performing first processing on the multimedia data collected by the multimedia data collection module based on the position information with a determined processing algorithm or processing component to obtain at least one second candidate multimedia data, and the processing component is configured with at least one processing algorithm;

[0040] Correspondingly, the second processing on the at least one candidate multimedia data to obtain the target multimedia data capable of being output comprises:

[0041] Performing first processing on the at least one multimedia data collected by the multimedia data collection component to obtain at least one third candidate multimedia data, and performing second processing on the at least one second candidate multimedia data and the at least one third candidate multimedia data to obtain the target multimedia data.

[0042] The above scheme further comprises at least one of the following:

[0043] The electronic device obtains the multimedia data collected by the multimedia data collection module through a wireless radio frequency module;

[0044] The data amount received by the electronic device through the wireless radio frequency module is the same as the data amount collected by the multimedia data collection module;

[0045] The multimedia data comprises at least one of audio data, image data and video data.

[0046] A data processing apparatus, the apparatus comprising:

[0047] An acquisition unit configured to obtain at least one multimedia data collected by at least one multimedia data collection module;

[0048] A first processing unit configured to perform first processing on the at least one multimedia data to obtain at least one candidate multimedia data;

[0049] A second processing unit configured to perform second processing on the at least one candidate multimedia data to obtain target multimedia data capable of being outputted;

[0050] The multimedia data collection module is not an electronic device, and the processing algorithms configured by the first processing unit and the second processing unit are at least partially different.

[0051] An electronic device, the electronic device comprising:

[0052] At least one first processing component capable of establishing connection with the at least one multimedia data collection module to perform first processing on at least one multimedia data collected by the multimedia data collection module to obtain at least one candidate multimedia data;

[0053] A second processing component connected with the at least one first processing component and configured to perform second processing on the at least one candidate multimedia data to obtain target multimedia data capable of being outputted;

[0054] The multimedia data collection module is not the electronic device, and the processing algorithms configured by the first processing component and the second processing component are at least partially different.

[0055] A computer readable storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the steps of the data processing method.

[0056] The data processing method, device and electronic equipment provided by the embodiments of the present application obtain at least one piece of multimedia data collected by at least one multimedia data collection module; perform first processing on the at least one piece of multimedia data to obtain at least one piece of candidate multimedia data; perform second processing on the at least one piece of candidate multimedia data to obtain target multimedia data that can be output; wherein the multimedia data collection module is not part of the electronic equipment, and the processing algorithms used by the electronic equipment to perform the first processing and the second processing are at least partially different; in this way, different processing algorithms can be used to first perform the first processing on the at least one piece of multimedia data, and then perform the second processing on the at least one piece of candidate multimedia data obtained after the first processing, to obtain the target multimedia data, thereby improving the flexibility of processing the multimedia data, and improving the quality of the target multimedia data obtained through the two times of processing, thereby solving the problem of low flexibility and poor quality of the processed multimedia data in the related art when processing the multimedia data. BRIEF DESCRIPTION OF DRAWINGS

[0057] Figure 1 A flowchart of a data processing method provided by an embodiment of the present application;

[0058] Figure 2 A flowchart of another data processing method provided by an embodiment of the present application;

[0059] Figure 3 A flowchart of another data processing method provided by an embodiment of the present application;

[0060] Figure 4 A flowchart of a data processing method provided by another embodiment of the present application;

[0061] Figure 5 A structural diagram of a data processing device provided by an embodiment of the present application;

[0062] Figure 6 A structural diagram of an electronic equipment provided by an embodiment of the present application;

[0063] Figure 7 A structural diagram of another electronic equipment provided by an embodiment of the present application;

[0064] Figure 8 A structural diagram of a multimedia data collection module and an electronic equipment provided by an embodiment of the present application. DETAILED DESCRIPTION

[0065] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application.

[0066] It should be understood that the specific embodiments described herein are merely exemplary and do not limit the application.

[0067] The embodiment of the application provides a data processing method, which can be applied to an electronic device, as shown in the figure, the method comprises the following steps: Figure 1

[0068] Step 101, obtaining at least one multimedia data collected by at least one multimedia data collection module.

[0069] Each multimedia data collection module comprises a wireless radio frequency sending component and a plurality of multimedia data collection components; the plurality of multimedia data collection components form a data collection array; each multimedia data collection module collects one piece of multimedia data; and the multimedia data collection module is not part of the electronic device.

[0070] In the embodiment of the application, the electronic device can receive one piece of multimedia data sent by the wireless radio frequency sending component in each multimedia data collection module; the multimedia data collection module can comprise an audio data collection module and / or an image data collection module; the audio data collection module comprises a microphone array formed by a plurality of microphone components and a wireless radio frequency sending component; and the image data collection module comprises a camera array formed by a plurality of cameras and a wireless radio frequency sending component. The number of multimedia data collection modules is the same as the number of pieces of multimedia data.

[0071] Specifically, the electronic device can send an acquisition instruction for acquiring multimedia data to at least one multimedia data collection module; each multimedia data collection module can send multimedia data to the electronic device based on the received acquisition instruction; of course, each multimedia data collection module can also receive a trigger operation of a user, and each multimedia data collection module sends multimedia data to the electronic device when it is in a working state based on the trigger operation of the user. The electronic device can receive the multimedia data sent by each multimedia data collection module through a wireless radio frequency module on the electronic device. The multimedia data comprises at least one of audio data, image data and video data.

[0072] Step 102, performing first processing on the at least one piece of multimedia data to obtain at least one piece of candidate multimedia data.

[0073] In the embodiment of the application, first processing can be performed on each piece of multimedia data to obtain one piece of candidate multimedia data corresponding to each piece of multimedia data. The algorithms used for performing first processing on each piece of multimedia data can be the same or different.

[0074] ​Specifically, a first target processing algorithm corresponding to each piece of multimedia data can be determined, and the multimedia data is first processed based on the first target processing algorithm to obtain at least one piece of candidate multimedia data; the first target processing algorithm can be determined from a plurality of first processing algorithms used for first processing according to at least one of attribute information of the multimedia data, environment information of a space environment in which the multimedia data is generated, and source information of the multimedia data, and the first target processing algorithm can include a single processing algorithm or a processing algorithm set formed by a plurality of processing algorithms.

[0075] In a feasible implementation, the multimedia data can be audio data, and the first processing of the multimedia data can be at least one of echo cancellation, noise reduction, positioning, and enhancement of the audio data; in another feasible implementation, the multimedia data can be image data, and the first processing of the multimedia data can be at least one of denoising, image recognition, image enhancement, super-resolution, blurring (mosaic), background removal, and beautification of the image data.

[0076] Step 103, performing second processing on the at least one piece of candidate multimedia data to obtain target multimedia data that can be output.

[0077] The multimedia data acquisition module is not part of the electronic device, and the processing algorithms used for the first processing and the second processing performed by the electronic device are at least partially different. The algorithm used for the first processing of the multimedia data is a first target processing algorithm, the algorithm used for the second processing of the candidate multimedia data obtained after the first processing is a second target processing algorithm, and the second target processing algorithm can include a single processing algorithm or a processing algorithm set formed by a plurality of processing algorithms. The first target processing algorithm and the second target processing algorithm are different. The second target processing algorithm used for the second processing of each piece of candidate multimedia data can be the same or different.

[0078] In the embodiments of the present application, the second target processing algorithm corresponding to each piece of multimedia data can be determined from a plurality of second processing algorithms used for second processing according to at least one of attribute information of each piece of multimedia data, an evaluation result obtained by evaluating the first candidate multimedia data, user portrait information of a target user, and configuration information of a target output component. Then, the corresponding piece of multimedia data can be second processed using the second target processing algorithm to obtain target multimedia data. The second processing includes at least one of splicing processing, fusion processing, editing processing, differential processing, single processing, and unified processing.

[0079] In a feasible implementation, the second target processing algorithm can be a screening algorithm and / or a fusion algorithm.

[0080] The data processing method provided in the embodiments of this application obtains at least one channel of multimedia data acquired by at least one multimedia data acquisition module; performs a first processing on the at least one channel of multimedia data to obtain at least one channel of candidate multimedia data; and performs a second processing on the at least one channel of candidate multimedia data to obtain target multimedia data that can be output. The multimedia data acquisition module is not an electronic device, and the processing algorithms used by the electronic device to perform the first and second processing are at least partially different. Thus, different processing algorithms can be used to first process at least one channel of multimedia data, and then perform a second processing on the at least one channel of candidate multimedia data obtained after the first processing to obtain the target multimedia data. This improves the flexibility of multimedia data processing and enhances the quality of the obtained target multimedia data through two processing steps, solving the problems of low flexibility and poor quality of processed multimedia data in related technologies.

[0081] Based on the foregoing embodiments, embodiments of this application provide a data processing method, referring to... Figure 2 As shown, the method includes the following steps:

[0082] Step 201: Obtain at least one channel of multimedia data acquired by at least one multimedia data acquisition module.

[0083] It should be noted that step 201 can be achieved by at least one of steps a1 to a3:

[0084] Step a1: In response to determining that the target user and the electronic device have a first relative positional relationship, at least one channel of multimedia data collected by the multimedia data acquisition component of the electronic device and at least one channel of multimedia data collected by the multimedia data acquisition module are obtained.

[0085] The first relative positional relationship can characterize the target user being within the acquisition range of the multimedia data acquisition component of the electronic device; the target user can be an object with vital signs.

[0086] In the embodiments of the present application, the electronic device can detect first position information of the target user and second position information of the electronic device, determine first relative position information between the target user and the electronic device based on the first position information and the second position information, and when it is determined that the target user and the electronic device have the first relative position relationship based on the first relative position information, at least one piece of multimedia data collected by at least one multimedia data collection module for the target user can be obtained, and at least one piece of multimedia data collected by a multimedia data collection component of the electronic device for the target user can also be obtained; wherein the target user is within the collection range of the multimedia data collection component of the electronic device, and the target user is within the collection range of the at least one multimedia data collection module.

[0087] The number of the multimedia data collection components of the electronic device can be at least one, and each multimedia data collection component can collect one piece of multimedia data; the multimedia data collection component can be an image collection component and an audio collection component. For the image data collection component and the image data collection module of the electronic device, the collection range can be a viewfinder range; for the audio data collection component and the audio data collection module of the electronic device, the collection range can be a sound pickup range.

[0088] In a feasible implementation manner, the target user can be a person, the Bluetooth positioning technology can be used on the electronic device to determine the first position information of the person, and the second position information of the electronic device itself can be determined by the Global Positioning System (GPS), so as to determine the first relative position information between the person and the electronic device based on the first position information and the second position information.

[0089] It should be noted that when the target user and the electronic device have the first relative position relationship, and the target user is outside the collection range of the at least one multimedia data collection module, that is, at this time, the target user is only within the collection range of the multimedia data collection component of the electronic device, only at least one piece of multimedia data collected by the multimedia data collection component of the electronic device can be obtained.

[0090] Step a2, in response to determining that the target user and the electronic device have the second relative position relationship, at least one piece of multimedia data collected by at least one multimedia data collection module is obtained.

[0091] In the second relative position relationship, the distance between the at least one multimedia data collection module and the target user is less than the distance between the electronic device and the target user; the second relative position relationship indicates that the target user is outside the collection range of the multimedia data collection component of the electronic device.

[0092] In the embodiments of the present application, the electronic device can determine first relative position information between the target user and the electronic device, and when it is determined that the target user and the electronic device have a second relative position relationship based on the first relative position information, the electronic device does not start the multimedia data collection component of the electronic device, but only receives at least one piece of multimedia data collected by at least one multimedia data collection module; wherein the target user is within the collection range of the at least one multimedia data collection module.

[0093] Step a3, obtaining relative position information between the target user and the at least one multimedia data collection module, and obtaining at least one piece of multimedia data collected by the target multimedia data collection module based on the relative position information.

[0094] The number of multimedia data collection modules is at least one; wherein the relative position information between the target user and the at least one multimedia data collection module can be denoted as second relative position information.

[0095] In the embodiments of the present application, the electronic device can determine first position information of the target user and third position information of each multimedia data collection module, determine second relative position information between the target user and each multimedia data collection module based on the first position information and the third position information, determine target relative position information that meets the relative position condition from the second relative position information, and determine the multimedia data collection module corresponding to the target relative position information as the target multimedia data collection module. Wherein the target user can be an object with vital signs.

[0096] In a feasible implementation manner, the target user can be a person, and the electronic device can use Bluetooth positioning technology to determine the first position information of the person, and use GPS to position the third position information of each multimedia data collection module, so as to determine the second relative position information between the target user and the at least one multimedia data collection module based on the first position information and the third position information. Wherein the second relative position information is used to represent the direction of the target user relative to the multimedia data collection module, and the distance between the target user and the multimedia data collection module.

[0097] In other embodiments, the position of the target user can also be positioned by sound source positioning or image detection. Or the relative position information between the target user and the electronic device or the multimedia data collection module can be monitored by other sensors capable of measuring distance, such as infrared sensors, distance sensors, etc.

[0098] In the embodiment of the present application, the electronic device can send an acquisition instruction to the target multimedia data acquisition module, and the target multimedia data acquisition module can send at least one piece of multimedia data to the electronic device based on the received acquisition instruction. Of course, prompt information for prompting to start the target multimedia data acquisition module can also be sent to the user terminal, so that the user starts the target multimedia data acquisition module based on the prompt information received by the user terminal, and makes the target multimedia data acquisition module send the collected at least one piece of multimedia data to the electronic device in the working state.

[0099] It should be noted that the size of the data received by the electronic device through the wireless radio frequency module is the same as the size of the data collected by the multimedia data acquisition module, that is, the multimedia data collected by the multimedia data acquisition module is not processed in any way before being sent to the electronic device.

[0100] Step 202, in the case of obtaining one piece of multimedia data, performing first processing on the at least one piece of multimedia data to obtain at least one piece of candidate multimedia data.

[0101] Step 202 can be implemented by at least one of steps b1-b2:

[0102] Step b1, in the case of obtaining one piece of multimedia data, obtaining attribute information of the piece of multimedia data, and performing first processing on the piece of multimedia data based on the attribute information and a corresponding processing algorithm or a corresponding processing component to obtain first candidate multimedia data.

[0103] The processing component is configured with at least one processing algorithm; the processing algorithm configured in the processing component is a first processing algorithm used for first processing.

[0104] In the embodiments of the present application, the multimedia data can be analyzed to obtain attribute information of the multimedia data; the collection source information of the multimedia data can also be acquired, and the attribute information of the multimedia data is determined based on the collection source information; wherein the collection source information carries an identifier of a multimedia data collection module corresponding to the multimedia data; the collection source information is used to represent that the multimedia data is from which multimedia data collection module or which multimedia data collection component of the electronic device. The tag data corresponding to the multimedia data can also be acquired, and the attribute information corresponding to the multimedia data is determined from a plurality of attribute information based on the tag data; wherein the tag data and the attribute information are one-to-one corresponding; wherein the tag data can be used to uniquely indicate the multimedia data collection module that collects the multimedia data; the tag data can also be used to uniquely indicate the multimedia data; the tag data can be pre-configured for the multimedia data collection module, or can be configured for the multimedia data after the multimedia data is received; the electronic device stores a corresponding relationship between the tag data and the attribute information.

[0105] In a feasible implementation manner, the tag data can be a number of each multimedia data collection module.

[0106] In a feasible implementation manner, the attribute information can be at least one of a signal-to-noise ratio, a signal strength, an image resolution, a noise point number, a definition, a color degree, a frame rate and a code rate.

[0107] In the embodiments of the present application, based on the attribute information of the multimedia data, a first target processing algorithm corresponding to the attribute information can be determined from a plurality of first processing algorithms for performing first processing, and the first target processing algorithm is used to perform first processing on the multimedia data; of course, based on the attribute information of the multimedia data, a first target processing component corresponding to the attribute information can also be determined from a plurality of first processing components for performing first processing, and the first target processing component is used to perform first processing on the multimedia data based on the first processing algorithm stored in the first target processing component.

[0108] Specifically, the electronic device pre-stores a first correspondence relationship between a first processing algorithm and attribute information, and can determine a first target processing algorithm corresponding to the attribute information of the multimedia data from a plurality of first processing algorithms based on the attribute information of the multimedia data and the first correspondence relationship. The electronic device can also pre-store a second correspondence relationship between a first processing component and attribute information, and can determine a first target processing component corresponding to the attribute information of the multimedia data from a plurality of first processing components based on the attribute information of the multimedia data and the second correspondence relationship. The electronic device can also analyze the attribute information of the multimedia data and the plurality of first processing algorithms using an artificial intelligence (AI) algorithm to determine a first target processing algorithm corresponding to the attribute information of the multimedia data from the plurality of first processing algorithms, or analyze the attribute information of the multimedia data and the performance of the plurality of first processing components using the AI algorithm to determine the first target processing component from the plurality of first processing components.

[0109] In other embodiments, the processing algorithm corresponding to each attribute information can also be dynamically updated or determined based on self-learning to enable accurate processing of multimedia data.

[0110] The plurality of first processing components can be of the same type or different types, and the types of the plurality of first processing components include at least one of a central processing unit (CPU), a graphics processing unit (GPU), an image signal processor (ISP), and a digital signal processing (DSP) chip.

[0111] In a possible implementation, the multimedia data can be audio data or image data, and a target DSP chip or a target ISP chip can be determined from a plurality of DSP chips or ISP chips used for first processing according to the attribute information of the multimedia data, and the multimedia data is first processed by the target DSP chip or the target ISP chip. The DSP chip is also known as a digital signal processor.

[0112] In step b2, environment information of a space environment in which the multimedia data is generated is obtained, and the multimedia data is first processed by a corresponding processing algorithm or a corresponding processing component based on the environment information to obtain first candidate multimedia data.

[0113] The processing component is configured with at least one processing algorithm.

[0114] In the embodiments of the present application, the environment information of the spatial environment in which the multimedia data is generated can be the environment information around when the multimedia data is generated, and the environment information includes environment brightness, noise, number of target users, and the like.

[0115] Specifically, the environment information can include at least the environment information of the spatial environment in which the multimedia data acquisition module for generating the multimedia data is located. The electronic device can determine the first target processing algorithm corresponding to the environment information from the plurality of first processing algorithms based on the environment information, and perform first processing on the multimedia data by using the first target processing algorithm to obtain first candidate multimedia data; and determine the first target processing component corresponding to the environment information from the plurality of first processing algorithms based on the environment information, and perform first processing on the multimedia data by using the first target processing component; wherein the first target processing component stores at least one first processing algorithm.

[0116] Specifically, the electronic device can pre-store a third correspondence relationship between the environment information and the first processing algorithm; and determine the first target processing algorithm from the plurality of first processing algorithms based on the environment information of the multimedia data and the third correspondence relationship. The electronic device can also pre-store a fourth correspondence relationship between the environment information and the first processing component, and determine the first target processing component from the plurality of first processing components based on the environment information of the multimedia data and the fourth correspondence relationship. The environment information and the plurality of first processing algorithms can also be analyzed by using an AI algorithm to determine the first target processing algorithm from the plurality of first processing algorithms; or the environment information and the performance of the plurality of first processing components can be analyzed by using an AI algorithm to determine the first target processing component from the plurality of first processing components.

[0117] It should be noted that the environment information can also include environment change information; and the first target processing algorithm or the first target processing component used for processing the multimedia data can be adaptively adjusted based on the environment change information. When the environment information of the spatial environment in which the multimedia data is generated changes, the first target processing algorithm or the first target processing component currently used for processing the multimedia data can be replaced based on the environment change information; that is, at different time points, although the multimedia data collected by the same multimedia data acquisition module or the same multimedia data acquisition component of the electronic device is obtained, the first target processing component used for first processing is different, thereby improving the flexibility of first processing of the multimedia data.

[0118] It should be noted that at least one of steps 203-206 can be performed after step 202. Figure 2 Only any one of steps 203-206 after step 202 is shown in FIG. 2.

[0119] Step 203, performing second processing on the first candidate multimedia data based on the attribute information to obtain target multimedia data.

[0120] In the embodiments of the present application, the second target processing algorithm can be determined from the second processing algorithms for performing second processing based on the attribute information of the multimedia data, and the second target processing algorithm is used to perform second processing on the first candidate multimedia data to obtain the target multimedia data; or the AI intelligent algorithm is used to perform second processing on the first candidate multimedia data based on the attribute information to obtain the target multimedia data; wherein the second processing can also be understood as the optimization processing of the first candidate multimedia data.

[0121] Specifically, the fifth correspondence between the attribute information and the second processing algorithm can be pre-stored in the electronic device, and the second target processing algorithm corresponding to the attribute information can be determined from the plurality of second processing algorithms based on the attribute information of the multimedia data and the fifth correspondence.

[0122] In a feasible implementation manner, the first candidate multimedia data is audio data, and the second target processing algorithm determined based on the attribute information can be an intelligent noise reduction algorithm and / or an intelligent enhancement algorithm; although the first target processing algorithm and the second target processing algorithm are different, the types of the first target processing algorithm and the second target processing algorithm can be the same or different.

[0123] Step 204, evaluating the first candidate multimedia data, and performing second processing on the first candidate multimedia data based on the evaluation result to obtain target multimedia data.

[0124] In the embodiments of the present application, the sub-candidate multimedia data can be extracted from the first candidate multimedia data, and each second processing algorithm is used to perform second processing on the sub-candidate multimedia data to obtain processed sub-candidate multimedia data, and then the quality of the processed sub-candidate multimedia data can be evaluated to obtain a quality score of the processed sub-candidate multimedia data, the highest quality score is determined from the plurality of quality scores, and the second processing algorithm corresponding to the highest quality score is used as the second target processing algorithm; the second target processing algorithm is used to perform second processing on the first candidate multimedia data to obtain the target multimedia data.

[0125] In the embodiments of the present application, the quality of the first candidate multimedia data can also be evaluated based on preset evaluation items to obtain a quality score corresponding to each preset evaluation item, and in a case where the quality score corresponding to a preset evaluation item is less than a quality threshold score corresponding to the preset evaluation item, the second processing algorithm corresponding to the preset evaluation item is determined as the second target processing algorithm. The preset evaluation items include noise and signal strength, and if the first candidate multimedia data is image data, the preset evaluation items can also include image quality.

[0126] In a feasible implementation, the preset evaluation items can be noise and signal strength. The quality of the first candidate multimedia data can be evaluated considering noise to obtain a noise quality score, and the quality of the first candidate multimedia data can be evaluated considering signal strength to obtain a signal strength quality score. When the noise quality score is less than a target noise quality threshold score corresponding to noise, the noise (preset evaluation item) corresponding noise reduction algorithm is determined as the second target processing algorithm. When the signal strength quality score is less than a target signal strength quality threshold score corresponding to signal strength, the signal strength corresponding signal enhancement algorithm is determined as the second target processing algorithm. When the noise quality score is less than the target noise quality threshold score and the signal strength quality score is less than the target signal strength quality threshold score, the noise corresponding noise reduction algorithm and the signal strength corresponding signal enhancement algorithm are both determined as the second target processing algorithm.

[0127] In step 205, user portrait information of the target use object is obtained, and the first candidate multimedia data is processed based on the user portrait information to obtain the target multimedia data.

[0128] In the embodiments of the present application, the user portrait information can be input by the target use object to the electronic device, or can be obtained by the electronic device based on historical multimedia data of the target use object. The user portrait information includes display parameters or sound output parameters that the target use object is accustomed to in different modes. The modes include but are not limited to conference mode or entertainment mode.

[0129] In the embodiments of the present application, the electronic device can determine a target mode in which the target use object is currently located, and determine the display parameters or sound output parameters in the target mode from the stored user portrait information of the target use object based on the target mode, and process the first candidate multimedia data based on the display parameters or sound output parameters to obtain the target multimedia data. The target mode can be sent by the target use object to the electronic device through a terminal, or can be determined by the electronic device based on received multimedia data.

[0130] In a possible implementation, when the electronic device determines, according to the obtained audio data, that the target mode in which the target user is located is a conference mode, the sound output parameter in the conference mode can be determined from the user portrait information of the target user, and the first candidate audio data corresponding to the audio data is processed secondly by using the sound output parameter, to obtain the target audio data. The first candidate audio data is obtained by processing the audio data first.

[0131] It should be noted that the second processing of the first candidate multimedia data based on the user portrait information is performed by considering the expectation of the user on the sound output or image output in different scenarios (i.e., modes), and the flexibility of the second processing of the first candidate multimedia data is improved.

[0132] In step 206, configuration information of the target output component is obtained, and the first candidate multimedia data is processed secondly based on the configuration information, to obtain the target multimedia data.

[0133] The target output component is a component for outputting the target multimedia data.

[0134] In the embodiments of the present application, the target output component can be a component on the electronic device, and can also be a component on another device other than the electronic device. In a possible implementation, when the multimedia data is image data, the target output component can be a display screen; and when the multimedia data is audio data, the target output component can be a loudspeaker.

[0135] In the embodiments of the present application, when the target output component is a component on the electronic device, the electronic device can obtain the configuration information of the target output component from the configuration information of the electronic device; when the target output component is a component on another device, the electronic device can send an obtaining instruction for obtaining the configuration information of the target output component to the other device, and receive the configuration information of the target output component sent by the other device based on the obtaining instruction; and when the target output component is a component connected to the electronic device, the electronic device can detect the target output component to obtain the configuration information of the target output component. The first candidate multimedia data can be processed secondly according to the configuration information, so that the target multimedia data obtained can be adapted to the target output component, to improve the output effect of the target multimedia data. The other device can be a remote device.

[0136] The data processing method provided by the embodiment of the present application can adopt different processing algorithms, first processes at least one piece of multimedia data, then second processes the at least one piece of candidate multimedia obtained after the first processing, and obtains target multimedia data, thereby improving the flexibility of processing multimedia data, and improving the quality of the obtained target multimedia data through twice processing, thereby solving the problem of low flexibility and poor quality of processed multimedia data in related technologies.

[0137] Based on the foregoing embodiment, the embodiment of the present application provides a data processing method, as shown in Figure 3 The method comprises the following steps:

[0138] Step 301: Obtain at least one piece of multimedia data collected by at least one multimedia data collection module.

[0139] It should be noted that the specific implementation process of step 301 can be implemented by referring to at least one of steps a1-a3, which will not be described here.

[0140] Step 302: In the case of obtaining at least two pieces of multimedia data, first process at least one piece of multimedia data to obtain at least one piece of candidate multimedia data.

[0141] It should be noted that step 302 can be implemented by at least one of steps c1-c3.

[0142] Step c1: In the case of obtaining at least two pieces of multimedia data, obtain attribute information of each piece of multimedia data, and first process each piece of multimedia data based on the attribute information and a determined processing algorithm or processing component to obtain at least two pieces of candidate multimedia data.

[0143] Among them, the processing component is built-in at least one processing algorithm; the processing algorithm corresponding to each piece of multimedia data is the same or different, and the processing component corresponding to each piece of multimedia data is different. Among them, the processing algorithm corresponding to each piece of multimedia data is a first target processing algorithm used for first processing; the processing component corresponding to each piece of multimedia data is a first target processing component used for first processing.

[0144] It should be noted that the specific process of obtaining the attribute information of each piece of multimedia data can refer to the description of obtaining the multimedia data in step b1, and the embodiment of the present application will not be described here.

[0145] In the embodiments of the present application, the Nth attribute information of the Nth multimedia data in the at least two pieces of multimedia data can be used to determine the first target processing algorithm corresponding to the Nth multimedia data from the plurality of first processing algorithms for first processing, and the first target processing algorithm is used to perform first processing on the Nth multimedia data to obtain the Nth candidate multimedia data corresponding to the Nth multimedia data. The Nth attribute information can also be used to determine the first target processing component from the plurality of first processing components for first processing, and the first target processing component is used to perform first processing on the Nth multimedia data to obtain the Nth candidate multimedia data corresponding to the Nth multimedia data. In this way, each piece of multimedia data is processed in this way to obtain one piece of candidate multimedia data corresponding to each piece of multimedia data. N is a positive integer greater than or equal to 2.

[0146] It should be noted that the specific process of determining the first target processing algorithm or the first target processing component corresponding to the Nth multimedia data based on the Nth attribute information can refer to the description of determining the first target processing algorithm or the first target processing component corresponding to the multimedia data based on the attribute information of the multimedia data in step b1, and the embodiments of the present application will not be repeated here.

[0147] In step c2, when the at least two pieces of multimedia data are obtained, the environment information of the spatial environment generating each piece of multimedia data is obtained, and each piece of multimedia data is processed by the corresponding processing algorithm or the corresponding processing component based on the environment information to obtain at least two pieces of candidate multimedia data.

[0148] The processing component is built-in with at least one processing algorithm, and the processing algorithm corresponding to each piece of multimedia data is the same or different, and the processing component corresponding to each piece of multimedia data is different. The processing algorithm corresponding to each piece of multimedia data is the same or different.

[0149] It should be noted that the specific process of obtaining the environment information of the spatial environment generating each piece of multimedia data in step c2 can refer to the description of obtaining the environment information of the spatial environment generating the multimedia data in step b2, and the embodiments of the present application will not be repeated here.

[0150] In the embodiments of the present application, the Nth environment information of the spatial environment generating the Nth multimedia data can be obtained, the first target processing algorithm or the first target processing component corresponding to the Nth multimedia data is determined based on the Nth environment information, and the first target processing algorithm or the first target processing component is used to perform first processing on the Nth multimedia data to obtain one piece of candidate multimedia data corresponding to the Nth multimedia data. In this way, each piece of multimedia data is processed in this way to obtain one piece of candidate multimedia data corresponding to each piece of multimedia data.

[0151] It should be noted that the first target processing algorithm or the first target processing component corresponding to the Nth multimedia data based on the Nth environment information can refer to the description of the first target processing algorithm or the first target processing component corresponding to the multimedia data based on the environment information in step b2, and details are not repeated here.

[0152] In step c3, source information of each piece of multimedia data is obtained in the case that at least two pieces of multimedia data are obtained, and each piece of multimedia data is first processed based on the determined processing algorithm or processing component to obtain at least two pieces of candidate multimedia data.

[0153] The processing component is built-in at least one processing algorithm, the processing algorithm corresponding to each piece of multimedia data is different, and the processing component corresponding to each piece of multimedia data is different; the source information represents which target use object each piece of multimedia data comes from and the number of target use objects.

[0154] When the multimedia data is audio data, voiceprint recognition can be performed on each piece of audio data to determine the source information of each piece of audio data; when the multimedia data is image data, face recognition can be performed on the image data to determine the source information of each piece of image data. The source information of each piece of audio data can represent which person each piece of audio data comes from; the source information of each piece of image data can represent which person each piece of image data comes from.

[0155] In the embodiment of the application, the first target processing algorithm or the first target processing component corresponding to the source information can be determined based on the source information, and the first target processing algorithm or the first target processing component is used to first process the multimedia data corresponding to the source information to obtain the candidate multimedia data corresponding to the multimedia data. The electronic device is pre-provided with a corresponding relationship between the source information and the first processing algorithm, and a corresponding relationship between the source information and the first processing component.

[0156] Of course, the AI algorithm can also be used to analyze the source information and the plurality of first processing algorithms to determine the first target processing algorithm from the plurality of first processing algorithms; or the AI algorithm can be used to analyze the performance of the source information and the plurality of first processing components to determine the first target processing component from the plurality of first processing components.

[0157] It should be noted that at least one of steps 303-310 can be performed after step 302. Figure 3 Only any one of steps 303-310 after step 302 is shown in the figure.

[0158] In step 303, the at least two pieces of candidate multimedia data are spliced to obtain target multimedia data.

[0159] In the embodiments of the present application, the sub-candidate multimedia data at different time instants can be selected from the at least two channels of multimedia data based on the sound pressure levels or the image definition of the at least two channels of multimedia data, and the obtained sub-candidate multimedia data can be spliced to obtain the target multimedia data.

[0160] In a possible implementation, the number of target usage objects is one, and at least two multimedia data acquisition modules are started during the movement of the target usage object. At least two channels of candidate multimedia data are obtained after the first processing of the at least two channels of multimedia data collected by the at least two multimedia data acquisition modules. The sound pressure levels of the sub-candidate multimedia data at different time instants in each channel of candidate multimedia data are determined. For T1, the sound pressure levels of the sub-candidate multimedia data at T1 in the multiple channels of candidate multimedia data are compared, and the sub-candidate multimedia data corresponding to the maximum sound pressure level is determined as the target sub-candidate multimedia data at T1. In this way, the target sub-candidate multimedia data corresponding to multiple time instants can be determined, and the multiple target sub-candidate multimedia data can be spliced to obtain the target multimedia data. The candidate multimedia data is audio data.

[0161] It should be noted that the target sound pressure level is calculated according to the sound pressure levels corresponding to the multiple target sub-candidate multimedia data, the candidate multimedia data obtained after splicing is adjusted in sound pressure level according to the target sound pressure level, and the target multimedia data is obtained, so as to improve the output effect of the target multimedia data and avoid the sudden change of the sound pressure level of the output target multimedia data, thereby reducing the hearing effect of the output target multimedia data.

[0162] In another possible implementation, the number of target usage objects can be at least one, and the definition of the sub-candidate multimedia data at different time instants in each channel of candidate multimedia data can be determined. For T1, the definition of the sub-candidate multimedia data at T1 in the multiple channels of candidate multimedia data is compared, and the sub-candidate multimedia data corresponding to the maximum definition is determined as the target sub-candidate multimedia data at T1. In this way, the target sub-candidate multimedia data corresponding to multiple time instants can be determined, and the multiple target sub-candidate multimedia data can be spliced to obtain the target multimedia data. The candidate multimedia data is image data. The splicing of the multiple target sub-candidate multimedia data to obtain the target multimedia data can be understood as synthesizing the multiple target sub-candidate multimedia data based on the correspondence between each time instant and the target sub-candidate multimedia data, and generating the target video.

[0163] In addition, when the at least two pieces of candidate multimedia data are image data, images of different target use objects can be extracted from the at least two pieces of multimedia data, and the images of the different target use objects can be spliced to obtain a target image and output; wherein the multimedia data comprises the target image.

[0164] In step 304, the at least two pieces of candidate multimedia data are fused to obtain target multimedia data.

[0165] In the embodiments of the present application, candidate sub-multimedia data of each target use object can be extracted from the at least two pieces of candidate multimedia data, and the candidate sub-multimedia data of the target use objects can be screened to obtain target candidate sub-multimedia data, and the target candidate sub-multimedia data can be fused to obtain target multimedia data.

[0166] Specifically, candidate sub-multimedia data of each target use object can be obtained from the at least two pieces of candidate multimedia data, and the candidate sub-multimedia data can be quality evaluated to obtain a quality score of the candidate sub-multimedia data, and the candidate sub-multimedia data corresponding to the highest quality score can be determined from the candidate sub-multimedia data of each target use object to obtain target candidate sub-multimedia data of each target use object, and then the target candidate sub-multimedia data can be fused to obtain target multimedia data.

[0167] In a feasible implementation, the candidate multimedia data is 6-way, and the number of speaking objects in a multi-person conversation scene can be 4. The sub-candidate multimedia data corresponding to each speaking object can be determined from the 6-way candidate multimedia data, the quality of each sub-candidate multimedia data can be evaluated to obtain a quality score of each sub-candidate multimedia data, and then the sub-candidate multimedia data corresponding to the highest quality score can be determined from the sub-candidate multimedia data corresponding to each speaking object based on the quality score of the sub-candidate multimedia data corresponding to each speaking object to obtain target sub-candidate multimedia data of each speaking object; wherein the 6-way multimedia data is simultaneously collected; and the target use object is a speaking object.

[0168] It should be noted that in the multi-person speaking scene, the voices of the multi-person speaking can be collected by each multimedia data collection module, that is, there can be multiple sub-multimedia data of speaking objects in one multimedia data, and for multiple multimedia data collection modules, the collected multimedia data can be repeated, after the first processing of the multimedia data collected by the multiple multimedia data collection modules, one candidate multimedia data corresponding to each multimedia data is obtained, and then the target sub-candidate multimedia data of each speaking object can be extracted from the multiple candidate multimedia data, and the target sub-candidate multimedia data of the multiple speaking objects is fused to obtain the target multimedia data; it can be ensured that the speaking voice of each person is saved and output, and the speaking information of a person is avoided to be lost.

[0169] Step 305, performing editing processing on the at least two candidate multimedia data to obtain the target multimedia data.

[0170] In the embodiment of the application, the at least two candidate multimedia data can be edited based on the selection operation of the user to obtain the target multimedia data; of course, the quality of the at least two candidate multimedia data can also be determined, and the data with poor quality can be removed from each candidate multimedia data based on the quality to obtain the target multimedia data. The editing processing includes cutting processing or removing processing.

[0171] In a feasible implementation manner, the removal object can be determined based on the selection operation of the user, and the candidate sub-multimedia data of the removal object can be removed from the at least two candidate multimedia data to obtain the target multimedia data.

[0172] Step 306, performing differential processing on each candidate multimedia data based on the attribute information to obtain the target multimedia data.

[0173] The differential processing refers to different processing on each candidate multimedia data.

[0174] In the embodiment of the present application, the attribute information corresponding to each piece of multimedia data is different; the electronic device can perform differential processing on the Nth piece of candidate multimedia data based on the attribute information corresponding to the Nth piece of multimedia data, to obtain the target multimedia data; for example, the attribute information corresponding to the Nth piece of multimedia data indicates that the Nth piece of multimedia data is severely noisy, and after the first processing on the Nth piece of multimedia data, the Nth piece of candidate multimedia data is obtained, the Nth piece of candidate multimedia data can be only denoised, to obtain the denoised candidate multimedia data; when the attribute information corresponding to the N+1th piece of multimedia data indicates that the signal strength of the N+1th piece of multimedia data is relatively poor, the N+1th piece of candidate multimedia data can be only enhanced based on the signal strength, to obtain the enhanced candidate multimedia data; the electronic device can take the enhanced candidate multimedia data and the denoised candidate multimedia data as the target multimedia data; of course, the enhanced candidate multimedia data and the denoised candidate multimedia data can also be further optimized to obtain the target multimedia data.

[0175] Step 307: evaluating each piece of candidate multimedia data, and performing differential processing on each piece of candidate multimedia data based on the evaluation result, to obtain the target multimedia data.

[0176] It should be noted that the specific implementation process of evaluating each piece of candidate multimedia data in step 307 can refer to the specific implementation process of evaluating the first candidate multimedia data in step 204, and will not be repeated here in the embodiment of the present application.

[0177] The differential processing refers to different processing on each piece of candidate multimedia data.

[0178] In the embodiment of the present application, the evaluation result corresponding to each piece of candidate multimedia data is different, and the process of performing the second processing on each piece of candidate multimedia data is also different.

[0179] It should be noted that the process of performing the second processing on each piece of candidate multimedia data based on the evaluation result can refer to the specific implementation process of performing the second processing on the first candidate multimedia data in step 204, and will not be repeated here in the embodiment of the present application.

[0180] Step 308: obtaining user portrait information of a target use object, and performing differential processing on each piece of candidate multimedia data based on the user portrait information, to obtain the target multimedia data.

[0181] The differential processing on each piece of candidate multimedia data refers to different second processing on each piece of candidate multimedia data, and can also be understood as that the process of performing the second processing on each piece of candidate multimedia data is different.

[0182] In the embodiment of the present application, the candidate multimedia data in each path can be processed differently based on the target use object and the user portrait information of the target use object, to obtain the target multimedia data. The target user object in each path of the candidate multimedia data is different, and the second processing of each path of the candidate multimedia data is also different.

[0183] It should be noted that the specific implementation process of obtaining the user portrait information of the target use object in step 308, and the second processing of each path of the candidate multimedia data based on the user portrait information to obtain the target multimedia data can refer to the specific implementation process of obtaining the user portrait information of the target use object in step 205, and the second processing of the first candidate multimedia data based on the user portrait information to obtain the target multimedia data, which will not be repeated here.

[0184] Step 309, obtaining the configuration information of the target output component, and processing each path of the candidate multimedia data differently based on the configuration information to obtain the target multimedia data.

[0185] The target output component is a component for outputting the target multimedia data.

[0186] In the embodiment of the present application, each path of the candidate multimedia data is processed differently based on the configuration information of the target output component to adapt to different target output components.

[0187] Step 310, obtaining the target requirement information, and processing each path of the candidate multimedia data based on the target requirement information to obtain the target multimedia data.

[0188] The target requirement information comes from the electronic device or from a remote device in communication connection with the electronic device.

[0189] In the embodiment of the present application, the target requirement information can be used to process each path of the candidate multimedia data for single processing such as intelligent noise reduction, echo cancellation, and noise removal, to obtain the target multimedia data. The target requirement information can also be used to process each path of the candidate multimedia data for unified processing such as splicing and fusion, to obtain the target multimedia data.

[0190] It should be noted that the description of the same steps and contents in other embodiments in the present embodiment can refer to the description in other embodiments, which will not be repeated here.

[0191] The data processing method provided by the embodiment of the present application can use different processing algorithms to first process at least one piece of multimedia data, then second process the at least one piece of candidate multimedia obtained after the first processing, and obtain target multimedia data, thereby improving the flexibility of processing multimedia data, and improving the quality of the obtained target multimedia data through twice processing, thereby solving the problem of low flexibility and poor quality of processed multimedia data in related technologies.

[0192] Based on the foregoing embodiment, the embodiment of the present application provides a data processing method, as shown in Figure 4 The method comprises the following steps:

[0193] Step 401: Obtain at least one piece of multimedia data collected by at least one multimedia data collection module.

[0194] It should be noted that the specific implementation process of step 401 can be implemented by referring to at least one of steps a1-a3, which will not be described here.

[0195] Step 402: In the case of obtaining at least one piece of multimedia data collected by the multimedia data collection component of the electronic device and at least one piece of multimedia data collected by at least one multimedia data collection module, first process at least one piece of multimedia data to obtain at least one piece of candidate multimedia data.

[0196] It should be noted that step 402 can be implemented by at least one of steps d1 and d2:

[0197] Step d1: In the case of obtaining at least one piece of multimedia data collected by the multimedia data collection component of the electronic device and at least one piece of multimedia data collected by at least one multimedia data collection module, obtain the identification information of the multimedia data collection module, and based on the identification information, use a corresponding processing algorithm or a corresponding processing component to first process the multimedia data collected by the multimedia data collection module to obtain at least one piece of second candidate multimedia data, and the processing component is configured with at least one processing algorithm.

[0198] Wherein, the identification information is used to uniquely represent the multimedia data collection module, and the identification information represents the attribute of the multimedia data collection module; wherein the attribute includes at least one of the model, the configuration and the function.

[0199] In the embodiments of the present application, based on the identification information of each multimedia data collection module, a first target processing algorithm is determined from the first processing algorithms for performing first processing, and the first target processing algorithm is used to perform first processing on the multimedia data collected by the multimedia data collection module, to obtain first candidate multimedia data. In addition, based on the identification information of each multimedia data collection module, a first target processing component is determined from the plurality of first processing components for performing first processing, and the first target processing component is used to perform first processing on the multimedia data collected by the multimedia data collection module, to obtain first candidate multimedia data.

[0200] Specifically, the electronic device can pre-store a sixth correspondence relationship between the identification information and the first processing algorithm. Based on the identification information of the multimedia data collection module and the sixth correspondence relationship, the first processing algorithm corresponding to the identification information can be determined from the plurality of first processing algorithms, to obtain the first target processing algorithm. The identification information can be information carried in the multimedia data.

[0201] Step d1, in the case of obtaining at least one multimedia data collected by the multimedia data collection component of the electronic device and at least one multimedia data collected by the at least one multimedia data collection module, obtaining the position information of the multimedia data collection module, and based on the position information, using the determined processing algorithm or processing component to perform first processing on the multimedia data collected by the multimedia data collection module, to obtain at least one second candidate multimedia data. The processing component is configured with at least one processing algorithm.

[0202] In the embodiments of the present application, each multimedia data collection module can be detected to obtain third position information of each multimedia data collection module, and based on the third position information, target environment information within a target range from the multimedia data collection module is determined, and based on the target environment information corresponding to each multimedia data collection module, a first target processing algorithm is determined from the plurality of first processing algorithms. In addition, the electronic device can use an AI algorithm to analyze the plurality of first processing algorithms and the target environment information, to determine the first target processing algorithm from the plurality of first processing algorithms.

[0203] Step 403, performing first processing on at least one multimedia data collected by the multimedia data collection component to obtain at least one third candidate multimedia data, and performing second processing on the at least one second candidate multimedia data and the at least one third candidate multimedia data to obtain target multimedia data.

[0204] In the embodiments of the present application, the attribute information of each piece of multimedia data collected by the multimedia data collection component can be obtained, and a first target processing algorithm determined based on the attribute information of each piece of multimedia data is used to perform first processing on the multimedia data to obtain third candidate multimedia data. The first target processing algorithm can also be determined based on environmental information of the space environment in which the multimedia data collection component is currently located, and used to perform first processing on each piece of multimedia data to obtain third candidate multimedia data. The source information of each piece of multimedia data collected by the multimedia data collection component can also be determined, and the first processing is performed on the multimedia data based on the source information to obtain third candidate multimedia data.

[0205] It should be noted that the processing component used to perform first processing on at least one piece of multimedia data collected by the multimedia data collection component is the same processing component as the processing component used to perform second processing on at least one piece of second candidate multimedia data and at least one piece of third candidate multimedia data.

[0206] The second processing on the at least one piece of second candidate multimedia data and the at least one piece of third candidate multimedia data can specifically include evaluating the second candidate multimedia data and the third candidate multimedia data, and performing second processing on the second candidate multimedia data and the third candidate multimedia data based on the evaluation result. The second processing on the second candidate multimedia data and the third candidate multimedia data can also include obtaining user portrait information of a target use object, and performing second processing on the second candidate multimedia data and the third candidate multimedia data based on the user portrait information. The second processing on the second candidate multimedia data and the third candidate multimedia data can also include performing second processing on the second candidate multimedia data and the third candidate multimedia data based on configuration information of a target output component. The second processing on the second candidate multimedia data and the third candidate multimedia data can also include performing splicing processing on the second candidate multimedia data and the third candidate multimedia data to obtain target multimedia data. The second processing on the second candidate multimedia data and the third candidate multimedia data can also include performing fusion processing on the second candidate multimedia data and the third candidate multimedia data to obtain target multimedia data. The second processing on the second candidate multimedia data and the third candidate multimedia data can also include performing editing processing on the second candidate multimedia data and the third candidate multimedia data to obtain target multimedia data. The second processing on the second candidate multimedia data and the third candidate multimedia data can also include evaluating the second candidate multimedia data to obtain a first evaluation result, processing the second candidate multimedia data based on the first evaluation result to obtain processed second candidate multimedia data, evaluating the third candidate multimedia data to obtain a second evaluation result, processing the third candidate multimedia data based on the second evaluation result to obtain processed third candidate multimedia data, and using the processed second candidate multimedia data and the processed third candidate multimedia data as target multimedia data. The second processing on the second candidate multimedia data and the third candidate multimedia data can also include further optimizing the processed second candidate multimedia data and the processed third candidate multimedia data to obtain target multimedia data.

[0207] Based on the foregoing embodiments, the following solutions in application scenarios and related technologies are combined to explain and describe the data processing method provided by the embodiments of the present application in detail.

[0208] In the related art, whether it is a single-person dialogue scene or a multi-person dialogue scene, the acquisition module can only process one piece of audio data each time, and outputs the audio data after single processing. That is, when multiple pieces of audio data are obtained at the same time, only one piece of audio data is selected from the multiple pieces of audio data, and the selected piece of audio data is processed to obtain target audio data and output the target audio data. As such, the target audio data is missing data, and the output effect of the target audio data is extremely poor.

[0209] In the embodiments of the present application, when multiple pieces of audio data are obtained, each piece of audio data can be processed by a corresponding sub-DSP chip for first processing, and then a main DSP chip is used to process the audio data processed by all sub-DSP chips for second processing to obtain target audio data. As such, multiple pieces of audio data are processed at the same time, and no piece of audio data is discarded, the integrity of the obtained target audio data is improved, and the quality and output effect of the target audio data are further improved.

[0210] It should be noted that the descriptions of the same steps and the same contents in the embodiments can refer to the descriptions in other embodiments, and will not be described here.

[0211] The data processing method provided in the embodiments of the present application can use different processing algorithms to first process at least one piece of multimedia data, and then second process the at least one piece of candidate multimedia data obtained after the first processing to obtain target multimedia data, thereby improving the flexibility of processing multimedia data, and improving the quality of the obtained target multimedia data through two times of processing, thereby solving the problem of low flexibility and poor quality of the processed multimedia data in the related art.

[0212] Based on the foregoing embodiments, the embodiments of the present application provide a data processing device, which can be applied to Figures 1-4 The data processing method provided in the corresponding embodiments can refer to Figure 5 As shown in the figure, the data processing device 5 can include:

[0213] An acquisition unit 51 is configured to obtain at least one piece of multimedia data collected by at least one multimedia data acquisition module;

[0214] A first processing unit 52 is configured to first process the at least one piece of multimedia data to obtain at least one piece of candidate multimedia data;

[0215] The second processing unit 53 is configured to perform second processing on the at least one piece of candidate multimedia data to obtain target multimedia data that can be output; wherein the multimedia data acquisition module is not part of the electronic device, and the first processing unit and the second processing unit are configured to perform different processing algorithms at least in part.

[0216] In the embodiments of the present application, the acquisition unit 51 is further configured to perform the following steps:

[0217] In response to determining that the target user has the first relative positional relationship with the electronic device, obtaining at least one piece of multimedia data collected by the multimedia data acquisition component of the electronic device and at least one piece of multimedia data collected by the at least one multimedia data acquisition module;

[0218] In response to determining that the target user has the second relative positional relationship with the electronic device, obtaining at least one piece of multimedia data collected by the at least one multimedia data acquisition module, wherein the distance between the at least one multimedia data acquisition module and the target user is less than the distance between the electronic device and the target user in the second relative positional relationship;

[0219] Obtaining relative positional information between the target user and the at least one multimedia data acquisition module, and obtaining at least one piece of multimedia data collected by the target multimedia data acquisition module based on the relative positional information.

[0220] In the embodiments of the present application, the first processing unit 52 is further configured to perform the following steps:

[0221] In the case of obtaining one piece of multimedia data, obtaining attribute information of the piece of multimedia data, performing first processing on the piece of multimedia data based on the attribute information and using a corresponding processing algorithm or a corresponding processing component, to obtain first candidate multimedia data, and the processing component is configured with at least one processing algorithm;

[0222] In the case of obtaining one piece of multimedia data, obtaining environment information of a space environment in which the piece of multimedia data is generated, performing first processing on the piece of multimedia data based on the environment information and using a corresponding processing algorithm or a corresponding processing component, to obtain first candidate multimedia data, and the processing component is configured with at least one processing algorithm.

[0223] In the embodiments of the present application, the second processing unit 53 is further configured to perform the following steps:

[0224] Performing second processing on the first candidate multimedia data based on the attribute information to obtain target multimedia data;

[0225] Performing evaluation on the first candidate multimedia data, and performing second processing on the first candidate multimedia data based on the evaluation result to obtain target multimedia data;

[0226] Obtaining user portrait information of a target use object, performing second processing on the first candidate multimedia data based on the user portrait information, and obtaining the target multimedia data;

[0227] Obtaining configuration information of a target output component, performing second processing on the first candidate multimedia data based on the configuration information, and obtaining the target multimedia data, wherein the target output component is a component for outputting the target multimedia data.

[0228] In the embodiment of the present application, the first processing unit 52 is further configured to perform the following steps:

[0229] In the case of obtaining at least two pieces of multimedia data, attribute information of each piece of multimedia data is obtained, and each piece of multimedia data is processed by a determined processing algorithm or a processing component based on the attribute information, to obtain at least two pieces of candidate multimedia data, wherein the processing component is built-in at least one processing algorithm, the processing algorithm corresponding to each piece of multimedia data is the same or different, and the processing component corresponding to each piece of multimedia data is different;

[0230] In the case of obtaining at least two pieces of multimedia data, environment information of a space environment generating each piece of multimedia data is obtained, and each piece of multimedia data is processed by a corresponding processing algorithm or a corresponding processing component based on the environment information, to obtain at least two pieces of candidate multimedia data, the processing component is built-in at least one processing algorithm, the processing algorithm corresponding to each piece of multimedia data is the same or different, and the processing component corresponding to each piece of multimedia data is different;

[0231] In the case of obtaining at least two pieces of multimedia data, source information of each piece of multimedia data is obtained, and each piece of multimedia data is processed by a determined processing algorithm or a processing component based on the source information, to obtain at least two pieces of candidate multimedia data, wherein the processing component is built-in at least one processing algorithm, the processing algorithm corresponding to each piece of multimedia data is different, and the processing component corresponding to each piece of multimedia data is different.

[0232] In the embodiment of the present application, the second processing unit 53 is further configured to perform the following steps:

[0233] Splicing processing is performed on the at least two pieces of candidate multimedia data, to obtain the target multimedia data;

[0234] Fusion processing is performed on the at least two pieces of candidate multimedia data, to obtain the target multimedia data;

[0235] Editing processing is performed on the at least two pieces of candidate multimedia data, to obtain the target multimedia data;

[0236] Differential processing is performed on each piece of candidate multimedia data based on the attribute information, to obtain the target multimedia data;

[0237] Evaluate each candidate multimedia data, and differentially process each candidate multimedia data based on the evaluation result to obtain the target multimedia data;

[0238] Obtain user portrait information of the target usage object, and differentially process each candidate multimedia data based on the user portrait information to obtain the target multimedia data;

[0239] Obtain configuration information of the target output component, and differentially process each candidate multimedia data based on the configuration information to obtain the target multimedia data, wherein the target output component is a component for outputting the target multimedia data;

[0240] Obtain target requirement information, and singly or uniformly process each candidate multimedia data based on the target requirement information to obtain the target multimedia data, wherein the target requirement information is from an electronic device end or from a remote device in communication connection with the electronic device.

[0241] In the embodiment of the present application, the first processing unit 52 is further configured to perform the following steps:

[0242] In the case of obtaining at least one piece of multimedia data collected by the multimedia data collection component of the electronic device and at least one piece of multimedia data collected by the multimedia data collection module, obtaining identification information of the multimedia data collection module, and performing first processing on the multimedia data collected by the multimedia data collection module based on the corresponding processing algorithm or the corresponding processing component according to the identification information to obtain at least one piece of second candidate multimedia data, wherein at least one processing algorithm is configured in the processing component;

[0243] In the case of obtaining at least one piece of multimedia data collected by the multimedia data collection component of the electronic device and at least one piece of multimedia data collected by the multimedia data collection module, obtaining position information of the multimedia data collection module, and performing first processing on the multimedia data collected by the multimedia data collection module based on the determined processing algorithm or the processing component according to the position information to obtain at least one piece of second candidate multimedia data, wherein at least one processing algorithm is configured in the processing component;

[0244] Correspondingly, the second processing unit 53 is further configured to perform the following steps:

[0245] Performing first processing on at least one piece of multimedia data collected by the multimedia data collection component to obtain at least one piece of third candidate multimedia data, and performing second processing on the at least one piece of second candidate multimedia data and the at least one piece of third candidate multimedia data to obtain the target multimedia data.

[0246] In the embodiment of the present application, the second processing unit 53 is further configured to perform the following steps:

[0247] The multimedia data collected by the multimedia data collection module is obtained through a wireless radio frequency module of the electronic device; the amount of data received by the wireless radio frequency module of the electronic device is the same as the amount of data collected by the multimedia data collection module; the multimedia data includes at least one of audio data, image data, and video data.

[0248] It should be noted that the interaction process between the units in the embodiments of the present application can be referred to Figures 1-4 The implementation process of the data processing method provided by the corresponding embodiments will not be described here.

[0249] The data processing apparatus provided in the embodiments of the present application can use different processing algorithms to first process at least one multimedia data, and then second process at least one candidate multimedia obtained after the first processing to obtain target multimedia data, thereby improving the flexibility of processing multimedia data, and improving the quality of the obtained target multimedia data through two times of processing, thereby solving the problem of low flexibility and poor quality of processed multimedia data in related technologies.

[0250] Based on the foregoing embodiments, the embodiments of the present application provide an electronic device which can be applied to Figures 1-4 In the data processing method provided by the corresponding embodiments, reference is made to Figure 6 As shown in the figure, the electronic device 6 can include:

[0251] At least one first processing component 61 is capable of establishing a connection with at least one multimedia data collection module to first process at least one multimedia data of the multimedia data collection module to obtain at least one candidate multimedia data;

[0252] A second processing component 62 is connected with the at least one first processing component 61 and is used to second process the at least one candidate multimedia data to obtain target multimedia data capable of being outputted;

[0253] Among them, the multimedia data collection module does not belong to the electronic device 6, and the processing algorithms configured by the first processing component 61 and the second processing component 62 are at least partially different.

[0254] In the embodiments of the present application, Figure 6 The first processing component is shown as two; the first processing component can also be one, or more than two; when the first processing component is multiple, the multiple first processing components are connected in parallel; the types of the multiple first processing components are the same, and of course the types of the multiple first processing components can be different. The type of the first processing component can be the same as or different from the type of the second processing component. The performance of the second processing component is superior to the performance of the first processing component.

[0255] In a feasible implementation, the two first processing components can be of the same type, such as both being DSP chips, and the type of the first processing component and the type of the second processing component can also be the same, such as the second processing component also being a DSP chip.

[0256] In the embodiments of the present application, each first processing component can process multimedia data collected by a multimedia data collection module to obtain a candidate multimedia data, and send the candidate multimedia data to the second processing component. The second processing component can receive the candidate multimedia data sent by the multiple first processing components, and perform second processing on the multiple candidate multimedia data to obtain target multimedia data, and output the target multimedia data. That is, each piece of received multimedia data needs to be processed by the corresponding first processing component. In this way, the working load of the second processing component is reduced, and the efficiency of determining the target multimedia data is improved.

[0257] The electronic device provided by the embodiments of the present application includes at least one first processing component, which can establish a connection with at least one multimedia data collection module to perform first processing on at least one piece of multimedia data collected by the multimedia data collection module to obtain at least one piece of candidate multimedia data; a second processing component connected with the at least one first processing component, configured to perform second processing on the at least one piece of candidate multimedia data to obtain target multimedia data that can be output; wherein the multimedia data collection module does not belong to the electronic device, and the first processing component and the second processing component are configured with different processing algorithms at least in part. The at least one piece of multimedia data is first processed, and then the at least one piece of candidate multimedia data obtained after the first processing is second processed to obtain the target multimedia data, which improves the flexibility of processing the multimedia data, and improves the quality of the obtained target multimedia data through the two times of processing, thereby solving the problem of low flexibility and poor quality of the processed multimedia data in the related art. The working load of the second processing component is reduced, and the efficiency of determining the target multimedia data is improved.

[0258] In other embodiments of the present application, as shown in Figure 7 The electronic device 6 further includes a wireless radio frequency module 63, wherein the wireless radio frequency module 63 is connected with at least one multimedia data collection module, and the wireless radio frequency module 63 is connected with at least one first processing component 62, configured to receive at least one piece of multimedia data collected by at least one multimedia data collection module, and send each piece of multimedia data to the corresponding first processing component 61, and perform first processing on the piece of multimedia data by the corresponding first processing component 61 to obtain a piece of candidate multimedia data corresponding to the piece of multimedia data.

[0259] In other embodiments of the present application, as shown in Figure 7 The electronic device further comprises a multimedia data collecting component 64, which is connected with the second processing component 62, and is configured to send the collected multimedia data to the second processing component 62. The second processing component 62 processes the multimedia data collected by the multimedia data collecting component 64 to obtain second candidate multimedia data, and performs second processing on the second candidate multimedia data and the first candidate multimedia data sent by the first processing component 61 to obtain the target multimedia data.

[0260] That is, the first processing on the multimedia data collected by the multimedia data collecting component of the electronic device is performed on the second processing component, and then the second processing component performs second processing on all multimedia data after the first processing. In this way, through the cooperation between the first processing component and the second processing component, the efficiency of determining the target multimedia data is improved.

[0261] In other embodiments of the present application, as shown in Figure 7 The electronic device further comprises a target output component 65, wherein the target output component is connected with the second processing component to receive the target multimedia data sent by the second processing component and output.

[0262] It should be noted that the second processing component can also be connected with a remote device, and is configured to send the target multimedia data to the remote device to enable the remote device to output the target multimedia data.

[0263] In a possible implementation manner, as shown in Figure 8As shown, the multimedia data acquisition module can be an audio data acquisition module; the audio data acquisition module includes a plurality of microphones (MIC) and a wireless radio frequency transmission component (RFTX); wherein the wireless radio frequency module can be referred to as RF RX; the first processing component can be a DSP chip, which can also be referred to as a sub-DSP chip; the second processing component can be a DSP chip, which can also be referred to as a main DSP chip; the multimedia data acquisition component can be a MIC; and the target output component can be a speaker. The RF TX can communicate with the first processing component through a serial peripheral interface (SPI); the first processing component and the second processing component communicate through an integrated circuit built-in audio bus (I2S). The plurality of MICs on the multimedia data acquisition module form a MIC array, which is used to acquire audio data and send the audio data to an electronic device. The RF RX of the electronic device receives each piece of audio data and sends each piece of audio data to a corresponding sub-DSP for intelligent noise reduction, enhancement, and other processing tasks. The processed data is sent to the main DSP, which performs AI processing on the processed data sent by the plurality of sub-DSPs. The AI-processed data is output through the microphone or transmitted to a personal computer (PC) or other console through a universal serial bus (USB) interface. The microphone can be a satellite microphone.

[0264] It should be noted that when the multimedia data is an image, the image is processed by the plurality of first processing components on the electronic device, and then the second processing component processes the image data processed by the first processing component again to obtain a target image. In this way, compared with processing the image through software, a powerful system platform is not required, and the processing can be completed through hardware, which is low in processing cost and convenient to deploy. During use, for example, when holding a meeting, the user does not need a powerful conference control host to process multiple video streams, but only needs to connect the electronic device to a personal computer without installing software, and the multiple video streams can be processed.

[0265] Based on the foregoing embodiments, the embodiments of the present application provide a computer readable storage medium storing one or more programs, which can be executed by one or more processors to implement Figures 1-4 The steps of the data processing method provided by the corresponding embodiments.

[0266] It should be noted that the computer readable storage medium above can be a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Ferromagnetic Random Access Memory (FRAM), a Flash Memory, a magnetic surface memory, an optical disc, or a Compact Disc Read-Only Memory (CD-ROM) memory, etc. It can also be various electronic devices including one or any combination of the above memories, such as a mobile phone, a computer, a tablet device, a personal digital assistant, etc.

[0267] It should be noted that in this paper, the term "including", "containing" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or includes elements inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of another identical element in the process, method, article or device including the element.

[0268] The above sequence numbers of the embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0269] From the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment method can be realized by means of software and necessary general hardware platform, of course, it can also be realized by hardware, but in many cases the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disc, optical disc) and includes a plurality of instructions for making a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) execute the methods described in various embodiments of the present application.

[0270] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 one or more flowcharts and / or blocks

[0271] These computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 one or more flowcharts and / or blocks

[0272] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 one or more flowcharts and / or blocks

[0273] The above merely provides the preferred embodiment of the present application, and does not limit the patent scope of the present application, and any equivalent structure or equivalent flowchart transformation according to the content of the present application specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A data processing method, wherein, Applied to an electronic device, the method comprises: Obtaining at least one multimedia data collected by at least one multimedia data collection module; Using a first target processing algorithm corresponding to the multimedia data to perform first processing on the at least one multimedia data to obtain at least one candidate multimedia data; the first target processing algorithm is determined based on at least one of attribute information of the multimedia data, environmental information of a space environment in which the multimedia data is generated, and source information of the multimedia data; Using a second target processing algorithm corresponding to the candidate multimedia data to perform second processing on the at least one candidate multimedia data to obtain target multimedia data that can be output; the second target processing algorithm is determined based on at least one of attribute information of the multimedia data, evaluation results obtained by evaluating the first candidate multimedia data, user portrait information of a target user, and configuration information of a target output component; Wherein, the multimedia data collection module does not belong to the electronic device, and the processing algorithms used in the first processing and the second processing performed by the electronic device are at least partially different; In the case of first processing on multiple multimedia data, the first processing components performing the first processing are different; the second processing component performing the second processing is the same and unique, and the first processing component performing the first processing and the second processing component are different.

2. The method of claim 1, wherein, The obtaining of at least one multimedia data collected by at least one multimedia data collection module comprises at least one of the following: In response to determining that the target user and the electronic device have a first relative position relationship, obtaining at least one multimedia data collected by a multimedia data collection component of the electronic device and at least one multimedia data collected by at least one multimedia data collection module; In response to determining that the target user and the electronic device have a second relative position relationship, obtaining at least one multimedia data collected by at least one multimedia data collection module, wherein the distance between at least one multimedia data collection module and the target user is less than the distance between the electronic device and the target user under the second relative position relationship; Obtaining relative position information between the target user and the at least one multimedia data collection module, and obtaining at least one multimedia data collected by a target multimedia data collection module determined based on the relative position information.

3. The method of claim 1 or 2, wherein, In the case of obtaining one multimedia data, The first processing on the at least one multimedia data to obtain at least one candidate multimedia data comprises at least one of the following: Obtaining attribute information of the multimedia data, and performing first processing on the multimedia data based on the attribute information to obtain first candidate multimedia data using a corresponding processing algorithm or a corresponding processing component, wherein the processing component is configured with at least one processing algorithm; Obtaining environmental information of a space environment in which the multimedia data is generated, and performing first processing on the multimedia data based on the environmental information to obtain first candidate multimedia data using a corresponding processing algorithm or a corresponding processing component, wherein the processing component is configured with at least one processing algorithm.

4. The method of claim 3, wherein, The second processing of the at least one candidate multimedia data to obtain the target multimedia data capable of being output comprises at least one of the following: The first candidate multimedia data is second processed based on the attribute information to obtain the target multimedia data; The first candidate multimedia data is evaluated, and the first candidate multimedia data is second processed based on an evaluation result to obtain the target multimedia data; User portrait information of a target use object is obtained, and the first candidate multimedia data is second processed based on the user portrait information to obtain the target multimedia data; Configuration information of a target output component is obtained, and the first candidate multimedia data is second processed based on the configuration information to obtain the target multimedia data, wherein the target output component is a component for outputting the target multimedia data.

5. The method of claim 1 or 2, wherein, In a case where at least two pieces of multimedia data are obtained, The first processing of the at least one piece of multimedia data to obtain at least one candidate multimedia data comprises at least one of the following: Attribute information of each piece of multimedia data is obtained, and each piece of multimedia data is first processed based on the attribute information by using a determined processing algorithm or a processing component to obtain at least two pieces of candidate multimedia data, wherein the processing component is built-in with at least one processing algorithm, and the processing algorithm corresponding to each piece of multimedia data is the same or different, and the processing component corresponding to each piece of multimedia data is different; Environment information of a space environment in which each piece of multimedia data is generated is obtained, and each piece of multimedia data is first processed based on the environment information by using a corresponding processing algorithm or a corresponding processing component to obtain at least two pieces of candidate multimedia data, wherein the processing component is built-in with at least one processing algorithm, and the processing algorithm corresponding to each piece of multimedia data is the same or different, and the processing component corresponding to each piece of multimedia data is different; Source information of each piece of multimedia data is obtained, and each piece of multimedia data is first processed based on the source information by using a determined processing algorithm or a processing component to obtain at least two pieces of candidate multimedia data, wherein the processing component is built-in with at least one processing algorithm, and the processing algorithm corresponding to each piece of multimedia data is different, and the processing component corresponding to each piece of multimedia data is different.

6. The method of claim 5, wherein, The second processing of the at least one candidate multimedia data to obtain the target multimedia data capable of being output comprises at least one of the following: The at least two pieces of candidate multimedia data are spliced to obtain the target multimedia data; The at least two pieces of candidate multimedia data are fused to obtain the target multimedia data; The at least two pieces of candidate multimedia data are edited to obtain the target multimedia data; Each piece of candidate multimedia data is differentially processed based on the attribute information to obtain the target multimedia data; Each piece of candidate multimedia data is evaluated, and each piece of candidate multimedia data is differentially processed based on an evaluation result to obtain the target multimedia data; Obtaining user portrait information of a target use object, performing differential processing on each candidate multimedia data based on the user portrait information to obtain the target multimedia data; Obtaining configuration information of a target output component, performing differential processing on each candidate multimedia data based on the configuration information to obtain the target multimedia data, wherein the target output component is a component for outputting the target multimedia data; Obtaining target requirement information, performing single or unified processing on each candidate multimedia data based on the target requirement information to obtain the target multimedia data, wherein the target requirement information is from the electronic device or from a remote device in communication connection with the electronic device.

7. The method of claim 1 or 2, wherein, In a case where at least one multimedia data is collected by a multimedia data collection component of an electronic device and at least one multimedia data is collected by at least one multimedia data collection module, The first processing on the at least one multimedia data to obtain at least one candidate multimedia data comprises at least one of the following: Obtaining identification information of the multimedia data collection module, performing first processing on the multimedia data collected by the multimedia data collection module based on the corresponding processing algorithm or the corresponding processing component to obtain at least one second candidate multimedia data, wherein the processing component is configured with at least one processing algorithm; Obtaining position information of the multimedia data collection module, performing first processing on the multimedia data collected by the multimedia data collection module based on the determined processing algorithm or processing component to obtain at least one second candidate multimedia data, wherein the processing component is configured with at least one processing algorithm; Correspondingly, the second processing on the at least one candidate multimedia data to obtain the target multimedia data that can be output comprises: Performing first processing on the at least one multimedia data collected by the multimedia data collection component to obtain at least one third candidate multimedia data, and performing second processing on the at least one second candidate multimedia data and the at least one third candidate multimedia data to obtain the target multimedia data.

8. The method of claim 1, wherein, Further comprising at least one of the following: The electronic device obtains the multimedia data collected by the multimedia data collection module through a wireless radio frequency module; The data amount received by the electronic device through the wireless radio frequency module is the same as the data amount collected by the multimedia data collection module; The multimedia data comprises at least one of audio data, image data and video data.

9. A data processing apparatus, wherein, The apparatus comprises: An acquisition unit configured to acquire at least one multimedia data collected by at least one multimedia data collection module; A first processing unit configured to perform first processing on the at least one multimedia data by using a first target processing algorithm corresponding to the multimedia data to obtain at least one candidate multimedia data, wherein the first target processing algorithm is determined based on at least one of attribute information of the multimedia data, environment information of a space environment in which the multimedia data is generated, and source information of the multimedia data; The second processing unit is configured to perform second processing on the at least one piece of candidate multimedia data by using a second target processing algorithm corresponding to the candidate multimedia data, to obtain target multimedia data capable of being output; the second target processing algorithm is determined based on at least one of attribute information of the multimedia data, an evaluation result obtained by evaluating the first candidate multimedia data, user portrait information of a target user, and configuration information of a target output component; The multimedia data acquisition module is not part of the electronic device, and the processing algorithms configured by the first processing unit and the second processing unit are at least partially different; In the case of performing first processing on multiple pieces of multimedia data, the multiple first processing components performing the first processing are different; the second processing component performing the second processing is unique and the same; and the first processing component performing the first processing and the second processing component are different.

10. An electronic device, comprising: The electronic device comprises: At least one first processing component capable of establishing a connection with at least one multimedia data acquisition module, to perform first processing on at least one piece of multimedia data collected by the multimedia data acquisition module by using a first target processing algorithm corresponding to the multimedia data, to obtain at least one piece of candidate multimedia data; the first target processing algorithm is determined based on at least one of attribute information of the multimedia data, environment information of a space environment in which the multimedia data is generated, and source information of the multimedia data; A second processing component connected with the at least one first processing component, configured to perform second processing on the at least one piece of candidate multimedia data by using a second target processing algorithm corresponding to the candidate multimedia data, to obtain target multimedia data capable of being output; the second target processing algorithm is determined based on at least one of attribute information of the multimedia data, an evaluation result obtained by evaluating the first candidate multimedia data, user portrait information of a target user, and configuration information of a target output component; The multimedia data acquisition module is not part of the electronic device, and the processing algorithms configured by the first processing unit and the second processing unit are at least partially different; In the case of performing first processing on multiple pieces of multimedia data, the multiple first processing components performing the first processing are different; the second processing component performing the second processing is unique and the same; and the first processing component performing the first processing and the second processing component are different.

Images