Media image processing method, media image processing device and storage medium

Abstract

The present disclosure relates to a media image processing method, a media image processing device and a storage medium. The media image processing method includes: during the shooting process of the media image to be processed, determining the main layer and the background layer of the media image to be processed, wherein the main layer is the media image layer where the main object in the media image to be processed is located, and the background layer is the media image layer where the background objects other than the main object in the media image to be processed are located. In response to the effect adjustment input of the target object, the effect is superimposed on the target layer corresponding to the target object to generate a target media image, wherein the target object is the main object and / or the background object, and the target layer is the main layer and / or the background layer. Through the present disclosure, a media image with superimposed effects can be directly obtained when the media image acquisition is completed.

Description

Technical Field

[0001] The present disclosure relates to the field of media image processing, and in particular to a media image processing method, a media image processing device, and a storage medium. Background Art

[0002] With the development of science and technology, media image effect overlay and replacement has become well known as a media image processing method. Due to its wide application prospects, it has appeared in various scenes of daily life.

[0003] In related technologies, a subject with a green background can be obtained through a green screen and positioning points, and then the subject can be cut out and synthesized with the desired background through synthesis software to obtain a media image with superimposed effects. However, these methods can only be applied to completed video materials, and there are problems with high material costs and production complexity, and it is impossible to simply and directly obtain a media image with real-time superimposed effects. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a media image processing method, a media image processing device and a storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a media image processing method is provided, comprising:

[0006] During the shooting process of the media image to be processed, the subject layer and the background layer of the media image to be processed are determined, wherein the subject layer is the media image layer where the subject object in the media image to be processed is located, and the background layer is the media image layer where the background objects other than the subject object in the media image to be processed are located; in response to the effect adjustment input of the target object, the effect is superimposed on the target layer corresponding to the target object to generate a target media image, the target object is the subject object and / or the background object, and the target layer is the subject layer and / or the background layer.

[0007] In one embodiment, the media image processing method also includes: recording a first media stream corresponding to the main layer and a second media stream corresponding to the background layer, the first media stream includes the main object, the second media stream includes the background object, and the first media stream and the second media stream are different.

[0008] In one implementation, the media image processing method further includes: setting a first time axis for the first media stream, and setting a second time axis for the second media stream.

[0009] In one implementation, superimposing effects on a target layer corresponding to the target object includes: superimposing effects on a target layer corresponding to the target object based on the first timeline and / or the second timeline.

[0010] In one embodiment, superimposing effects on a target layer corresponding to the target object includes: determining a media image superimposition effect required for the media image to be processed based on an effect adjustment input to the target object, wherein the media image superimposition effect includes one or more of a reverse playback superimposition effect, a time stillness superimposition effect, a time deceleration effect, and a time acceleration effect; and adjusting the first time axis and / or the second time axis based on the media image superimposition effect to superimpose effects on the target layer corresponding to the target object.

[0011] In one implementation, the effect of superimposing the target layer corresponding to the target object includes: one or a combination of filter effect, light effect, blur effect, blur effect and beautification effect.

[0012] In one embodiment, the media image processing method further includes: segmenting the main object in the media image to be processed; and filling the background object obtained after segmentation based on the area of ​​the background object corresponding to the main object.

[0013] According to a second aspect of an embodiment of the present disclosure, there is provided a media image processing device, including:

[0014] A determination unit is used to determine the main layer and background layer of the media image to be processed during the shooting process of the media image to be processed, wherein the main layer is the media image layer where the main object in the media image to be processed is located, and the background layer is the media image layer where the background objects other than the main object in the media image to be processed are located; an overlay unit is used to perform effect overlay on the target layer corresponding to the target object in response to the effect adjustment input of the target object to generate a target media image, wherein the target object is the main object and / or the background object, and the target layer is the main layer and / or the background layer.

[0015] In one implementation, the overlay unit also performs effect overlay on the target layer corresponding to the target object in the following manner:

[0016] A first media stream corresponding to the main layer and a second media stream corresponding to the background layer are recorded, wherein the first media stream includes the main object, the second media stream includes the background object, and the first media stream and the second media stream are different.

[0017] In one implementation, the overlay unit records the first media stream corresponding to the main layer and the second media stream corresponding to the background layer in the following manner: a first timeline is set for the first media stream, and a second timeline is set for the second media stream.

[0018] In one implementation, the overlay unit performs effect overlay on the target layer corresponding to the target object in the following manner:

[0019] Based on the first timeline and / or the second timeline, effects are superimposed on the target layer corresponding to the target object.

[0020] In one implementation, the overlay unit performs effect overlay on the target layer corresponding to the target object in the following manner:

[0021] Based on the effect adjustment input of the target object, the media image overlay effect required for the media image to be processed is determined, and the media image overlay effect includes one or more of a reverse playback overlay effect, a time still overlay effect, a time deceleration effect, and a time acceleration effect; based on the media image overlay effect, the first timeline and / or the second timeline are adjusted to perform effect overlay on the target layer corresponding to the target object.

[0022] In one implementation, the superposition unit uses the following superposition effects to superimpose effects on the target layer corresponding to the target object, including: one or a combination of filter effects, light effects, blur effects, blur effects, and beauty effects.

[0023] In one implementation, the determination unit is further configured to: segment the main object in the to-be-processed media image; and fill the background object obtained after segmentation based on the area of ​​the background object corresponding to the main object.

[0024] According to a third aspect of the embodiment of the present disclosure, there is provided a media image processing device, including:

[0025] a processor; a memory for storing instructions executable by the processor;

[0026] Wherein, the processor is configured to: execute the media image processing method described in the first aspect or any one of the implementations of the first aspect.

[0027] According to the fourth aspect of the embodiments of the present disclosure, a non-temporary computer-readable storage medium is provided. When the instructions in the storage medium are executed by the processor of the mobile terminal, the mobile terminal can execute the media image processing method described in the first aspect or any one of the embodiments of the first aspect.

[0028] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: during the shooting process of the media image to be processed, the main layer and the background layer of the media image to be processed are determined, and the effects can be superimposed on the main layer and the background layer respectively, so that the media image after the effect superposition can be obtained in real time during the shooting process of the media image.

[0029] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0031] Figure 1 The figure is a flow chart of a media image processing method according to an exemplary embodiment.

[0032] Figure 2 The figure is a flow chart of a method for overlaying media image effects according to an exemplary embodiment.

[0033] Figure 3 This is a flow chart of a method for overlaying media image effects based on timeline adjustment, shown as an exemplary embodiment.

[0034] Figure 4 The figure is a flowchart of effect superposition for a single media stream shown by an exemplary embodiment.

[0035] Figure 5 The figure is a flow chart of a media image effect overlay shown by an exemplary embodiment.

[0036] Figure 6 The figure is a block diagram of a media image processing device according to an exemplary embodiment.

[0037] Figure 7 The invention is a block diagram of a device for media image processing according to an exemplary embodiment. DETAILED DESCRIPTION

[0038] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0039] The media image processing method provided by the embodiments of the present disclosure can be applied to the scenario of performing effect superposition on media images such as images and videos. For example, it can be the scenario of performing effect superposition on videos shot in a terminal.

[0040] In the related art, a green screen background and positioning points are set for the subject to achieve the acquisition of the subject image, and the media image is segmented and superimposed by the post-production software to obtain a media image with superimposed effects. For example, a media image processing device such as image synthesis software needs to place the subject in a pure green screen, and achieve real-time image capture by setting multiple positioning points on the subject to obtain a subject image with a green background. When a media image processing method in the related art performs effect superposition, a video cutout method is used. For example, for the subject image with a pure background (the camera is more sensitive to green, so a green screen is generally used), the subject is separated from the background and the green screen part is removed through the "cutout" and "pipe" functions of the synthesis software, and finally the background material that needs to be superimposed is placed therein, and the media image with superimposed effects is synthesized. The effect superposition method of the video cutout method can support multiple layers and multiple time axes. Another method for superimposing media image effects in the related art is to divide the display window into two parts, and the two parts can realize different content and time axes for splicing, so as to achieve segmentation and adjustment and achieve effect superposition.

[0041] In the above-mentioned media image processing method of video cutout, the main image of the solid color background needs to be segmented to obtain the media image of the required main part. However, this method of obtaining the main image has relative limitations and requires a lot of time and financial costs. In addition, the operation of broadcast / film-level professional post-production software is very complicated and requires extremely high professional skills to complete the operation. Ordinary users cannot complete the editing and production. In the above-mentioned media image processing method of display window segmentation, the screen is divided into two parts, and the media image effects are superimposed. It can only distinguish between the left and right screens, and cannot achieve fine segmentation of the subject. If the material is insufficient or cannot meet the needs, it needs to be re-shot, which is extremely costly. In addition, the above two methods require post-production adjustments and cannot be obtained immediately after shooting.

[0042] In view of this, an embodiment of the present disclosure provides a media image processing method, in which subject recognition and subject segmentation are performed on the media image input in real time to achieve separation of the subject and the background, and then real-time processing of the media image superposition effect can be performed on one or a combination of the subject and the background, thereby achieving the function of effect superposition processing of real-time materials compared to the original technology.

[0043] Figure 1 is a flow chart of a media image processing method according to an exemplary embodiment. Figure 1As shown, the media image processing method is used in a terminal and includes the following steps.

[0044] In step S11 , during the shooting process of the media image to be processed, a subject layer and a background layer of the media image to be processed are determined.

[0045] The subject layer is a media image layer where the subject object in the media image to be processed is located, and the background layer is a media image layer where the background object other than the subject object in the media image to be processed is located.

[0046] In the embodiments of the present disclosure, the media image to be processed is the obtained media image that needs to be superimposed with effects, for example, it can be an image input and recorded by a camera. For example, it can also be a video recorded and played by a camera in a terminal.

[0047] Furthermore, a subject is displayed in the media image to be processed obtained in the embodiment of the present disclosure. When determining the subject displayed in the media image to be processed, an image recognition algorithm in traditional technology can be used to identify the subject. The subject involved in the embodiment of the present disclosure can be understood as an object that can be subsequently superimposed with effects and has independence, regular or irregular shapes.

[0048] In one embodiment of the present disclosure, the machine learning method can be trained through an artificial neural network based on an image recognition algorithm, so that the trained algorithm has the ability to recognize objects such as human bodies, pets, single buildings, single plants, regular-shaped daily necessities, and small and medium-sized vehicles such as cars and bicycles. It is understandable that these objects need to be independent and regular-shaped objects, and the algorithm's recognition of the subject is not limited to the object's motion state, color and other features. Through this machine learning training, the algorithm is helped to improve the recognition rate of the subject, so that the subject displayed in the media image can be better recognized during shooting.

[0049] In step S12, in response to the effect adjustment input for the target object, the effect is superimposed on the target layer corresponding to the target object to generate a target media image.

[0050] The target object is the main object and / or the background object, and the target layer is the main layer and / or the background layer.

[0051] In the disclosed embodiment, superimposing effects on the main layer and / or the background layer can be understood as superimposing effects on the main layer or the background layer separately while keeping the effect of the other layer unchanged, or superimposing different effects on the main layer and the background layer respectively.

[0052] The superposition effect can be based on the effect change in the time domain or the effect change in the space domain. For example, for a rain scene image with a certain person as the main body, the playback speed of the background layer can be increased (time domain) to adjust the rain speed, and the rainy day can be changed to a sunny day by replacing the background image (space domain). It can be understood that the effect superposition of the target layer corresponding to the target object is not limited to the superposition of a single effect, and multiple effects can also be superimposed simultaneously.

[0053] In the embodiments of the present disclosure, the subject in the media image is segmented, resulting in a blank portion of the background originally blocked by the subject. When the media image is overlaid and output, a gap will inevitably appear in the intersection area of ​​the subject object and the background object, revealing the blank space of the background layer. In one implementation, in the media image processing method provided in the embodiments of the present disclosure, the blank space revealed in the intersection area of ​​the subject object and the background object can be filled by identifying adjacent pixels.

[0054] In one example, when the segmented main layer media image is re-synthesized with the background layer media image, white areas will inevitably appear at the intersection of the two layers. The algorithm will fill the blank areas of the intersection based on the recognition of adjacent pixels in the blank areas.

[0055] Figure 2 FIG. 1 is a flow chart of a method for superimposing media image effects according to an exemplary embodiment. Figure 2 As shown, the implementation process of step S11 in the media image processing method provided by the embodiment of the present disclosure is similar to Figure 1 The execution method shown is similar and will not be repeated here.

[0056] In step S121, a first media stream corresponding to the main layer and a second media stream corresponding to the background layer are recorded.

[0057] In step S122, a first timeline is set for the first media stream, and a second timeline is set for the second media stream.

[0058] In one implementation, the timeline set for the main layer of the media image is called the first timeline. The timeline set for the background layer of the media image is called the second timeline. The first timeline and the second timeline are independent of each other. When effects are superimposed based on the timeline, when effects are superimposed on one of the layers, the other layers will not be affected by the superposition process. For example, when the playback speed of the main layer along the first timeline is increased, the playback speed of the background layer image along the second timeline will not change with the change in the playback speed of the main layer image along the first timeline.

[0059] In step S123, based on the first timeline and / or the second timeline, effects are superimposed on the target layer corresponding to the target object.

[0060] In step S124 , a media image is generated.

[0061] The following embodiments of the present disclosure illustrate the media image processing method involved in the above embodiments in combination with practical applications.

[0062] Figure 3 It is a flow chart of a method for effect superposition of media images based on timeline adjustment, which is shown as an exemplary embodiment.

[0063] In step S21 , based on the effect adjustment input to the target object, the media image superposition effect required for the media image to be processed is determined.

[0064] In step S22, based on the media image overlay effect, the first timeline and / or the second timeline is adjusted to perform an effect overlay on the target layer corresponding to the target object.

[0065] Among them, in the disclosed embodiment, for the first media stream and the second media stream of the media image, the same acquisition start point and the same acquisition end point can be set to obtain two media streams of the same length. Then, by playing all the frame images of the two media streams in reverse, a media image with a reverse playback effect is obtained. It can be understood that there is no difference in effect between using this method to superimpose the reverse playback effect and using the original media stream of the media image for reverse playback. However, when using the original video stream of the media image for reverse playback, it is impossible to superimpose other effects on the first media stream and / or the second media stream separately.

[0066] In one example, for the first media stream and the second media stream of the media image, the same collection start point and different collection end points can be set to obtain two media streams of different lengths. Then, the playback speed of the short-duration media stream is reduced to obtain two media streams of the same length. The media image superposition effect exhibited by this processing method is a time deceleration effect. For example, for the first media stream and the second media stream of the media image, the same collection start point can be set, and the collection end point of the first media stream is set later than that of the second media stream, to obtain two media streams with a first media stream longer than that of the second media stream. Then, the playback speed of the second media stream is reduced to obtain two media streams of the same length, and the two media streams are synthesized and output to obtain a media image with a time deceleration effect of background deceleration.

[0067] In another example of the disclosed embodiment, for the first media stream and the second media stream of the media image, different collection start points and the same collection end point can be set to obtain two media streams of different durations. Then, the playback speed of the long-duration media stream can be increased to obtain two media streams of the same duration. The media image superposition effect exhibited by this processing method is a time acceleration effect. For example, for the first media stream and the second media stream of the media image, the collection start point of the second media stream can be set later than the first media stream, and the same collection end point can be set to obtain two media streams in which the first media stream is longer than the second media stream. Then, the playback speed of the first media stream can be increased to obtain two media streams of the same duration, and the two media streams are synthesized and output to obtain a media image with a time acceleration effect of the main body being accelerated.

[0068] In the disclosed embodiment, one of the two media streams can be captured, and based on the same time starting point, a frame image of the time starting point of the other media stream can be captured. The frame image is synthesized and output with the first media stream based on the first time axis to obtain a media image with a time-still effect.

[0069] In another example, the media images of each layer can be collected based on the same end time. Different superposition effects can be achieved based on different start time. For example, different start time can be selected to collect the main layer and the background layer, and based on the same end time, the media images at both ends with the first time greater than the second time can be obtained. By reducing the playback speed of the background layer, two media images with the same playback time can be obtained. The two media images are synthesized to obtain a media image with a time deceleration effect with the main body as a reference.

[0070] Among them, for media images with superimposed time stillness or time deceleration effects. Since the starting time of the acquisition is the same, the media images with superimposed effects can be output in real time while the acquisition is being performed, so that the user can watch the media images with superimposed effects in real time. For media images with superimposed time acceleration effects and / or reverse effects. Since the superimposition of the effects needs to be completed at the end of the acquisition, the user cannot see the media images with superimposed effects in real time.

[0071] It is understandable that, while using this method to overlay the reverse playback effect of the media image, a time freeze effect, a time acceleration effect or a time deceleration effect can also be overlaid on the media image. And for the two media streams of the media image, the effects can be overlaid on the first media stream and / or the second media stream separately.

[0072] Among them, for the two media streams of the media image, the method of superimposing the first media stream and / or the second media stream separately is as follows: Figure 4 shown.

[0073] Figure 4This is a flowchart of an effect superposition for a single media stream shown in an exemplary embodiment. The implementation process of step S31 in the media image processing method provided in the embodiment of the present disclosure is similar to Figure 3 The execution method of step S21 is similar and will not be repeated here.

[0074] In step S32, based on the media image overlay effect, the target layer corresponding to the target object is overlaid with an effect.

[0075] Among them, the effects of the target layer superimposed on the target object include: one or a combination of filter effects, lighting effects, blur effects, blur effects and beauty effects.

[0076] The media image processing method provided by the embodiment of the present disclosure achieves the purpose of synthesizing a media image with superimposed effects by superimposing one or a combination of filter effects, light effects, blur effects, blur effects, and beautification effects on the first media stream and / or the second media stream. It can be understood that this step is different from superimposing effects on media images by adjusting the timeline, and a comprehensive superposition of media image effects can be performed in combination with the timeline. For example, the synthesized effect-superimposed media image can be a time-still effect image with filter effects and beautification effects superimposed on the subject. Among them, while superimposing the effects on the subject alone, the timeline is also used to superimpose a time-still effect on the entire synthesized media image.

[0077] Figure 5 FIG. 1 is a flow chart of a media image effect superposition process shown in an exemplary embodiment. Figure 5 As shown, a media image is input, and layers are separated based on an image recognition algorithm and a subject segmentation algorithm, and a first media stream and a second media stream are recorded based on a first time axis and a second time axis. Separate effects are superimposed on the first media stream and the second media stream, for example, one or a combination of superimposed filter effects, light effects, blur effects, blur effects, and beauty effects. Alternatively, effects are superimposed on the media image based on time axis adjustment. The effects are superimposed on the media image, and the synthesized effects are superimposed on the media image, and the synthesized effects are superimposed on the media image, and the media image is output.

[0078] Based on the same concept, the embodiment of the present disclosure also provides a media image processing device.

[0079] It is understandable that the media image processing device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0080] Figure 6 is a block diagram of a media image processing device according to an exemplary embodiment. Figure 2 The media image processing device 100 includes a determining unit 101 and a superimposing unit 102.

[0081] The determining unit 101 is used to determine the subject layer and background layer of the media image to be processed during the shooting process of the media image to be processed, wherein the subject layer is the media image layer where the subject object in the media image to be processed is located, and the background layer is the media image layer where the background object other than the subject object in the media image to be processed is located. The superposition unit 102, in response to the effect adjustment input of the target object, performs effect superposition on the target layer corresponding to the target object to generate a target media image, wherein the target object is the subject object and / or the background object, and the target layer is the subject layer and / or the background layer.

[0082] In one implementation, the overlay unit 102 also performs effect overlay on the target layer corresponding to the target object in the following manner:

[0083] A first media stream corresponding to the main layer and a second media stream corresponding to the background layer are recorded, wherein the first media stream includes the main object, the second media stream includes the background object, and the first media stream and the second media stream are different.

[0084] In one implementation, the overlay unit 102 records the first media stream corresponding to the main layer and the second media stream corresponding to the background layer in the following manner: setting a first timeline for the first media stream and setting a second timeline for the second media stream.

[0085] In one implementation, the overlay unit 102 performs effect overlay on the target layer corresponding to the target object in the following manner: based on the first timeline and / or the second timeline, performs effect overlay on the target layer corresponding to the target object.

[0086] In one implementation, the overlay unit 102 performs effect overlay on the target layer corresponding to the target object in the following manner:

[0087] Based on the effect adjustment input of the target object, the media image superposition effect required for the media image to be processed is determined, and the media image superposition effect includes one or more of a reverse playback superposition effect, a time still superposition effect, a time deceleration effect, and a time acceleration effect. Based on the media image superposition effect, the first time axis and / or the second time axis are adjusted to perform effect superposition on the target layer corresponding to the target object.

[0088] In one implementation, the superposition unit 102 uses the following superposition effects to superimpose effects on the target layer corresponding to the target object, including: one or a combination of filter effects, light effects, blur effects, blur effects, and beauty effects.

[0089] In one implementation, the determination unit 101 is further configured to: segment the main object in the media image to be processed, and fill the background object obtained after segmentation based on the area of ​​the background object corresponding to the main object.

[0090] Regarding the media image processing device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0091] Figure 7 2 is a block diagram of a device for media image processing according to an exemplary embodiment. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0092] Reference Figure 7 , the device 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0093] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0094] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0095] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0096] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0097] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device 200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

[0098] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0099] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, the sensor assembly 214 can also detect the position change of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200 and the temperature change of the device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0100] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0101] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0102] It is to be understood that in the present disclosure, "plurality" refers to two or more than two, and other quantifiers are similar thereto. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. The singular forms "a", "" and "the" are also intended to include plural forms, unless the context clearly indicates other meanings.

[0103] It is further understood that the terms "first", "second", etc. are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or degree of importance. In fact, the expressions "first", "second", etc. can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0104] It should be further understood that the terms "center", "longitudinal", "lateral", "lower", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or position relationship are based on the orientation or position relationship shown in the drawings, and are only for the convenience of describing the present embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation.

[0105] It can be further understood that, unless otherwise specified, “connection” includes a direct connection without other components between the two, and also includes an indirect connection with other components between the two.

[0106] It is further understood that, although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring the execution of all the operations shown to obtain the desired results. In certain environments, multitasking and parallel processing may be advantageous.

[0107] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0108] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A media image processing method, characterized in that: The media image processing method comprises: During the shooting process of the media image to be processed, determining the subject layer and the background layer of the media image to be processed, wherein the subject layer is the media image layer where the subject object in the media image to be processed is located, and the background layer is the media image layer where the background objects other than the subject object in the media image to be processed are located; In response to an effect adjustment input for a target object, effect superposition is performed on a target layer corresponding to the target object to generate a target media image, wherein the target object is the subject object and / or the background object, and the target layer is the subject layer and / or the background layer; The media image processing method further includes: Recording a first media stream corresponding to the subject layer and a second media stream corresponding to the background layer, setting a first timeline for the first media stream and a second timeline for the second media stream, wherein the first media stream includes the subject object, the second media stream includes the background object, and the first media stream and the second media stream are different; The step of performing effect superposition on the target layer corresponding to the target object includes: Based on the effect adjustment input of the target object, determining the media image superposition effect required for the to-be-processed media image, wherein the media image superposition effect includes one or more of a reverse playback superposition effect, a time still superposition effect, a time deceleration effect, and a time acceleration effect; Based on the media image overlay effect, the first timeline and / or the second timeline are adjusted to perform effect overlay on the target layer corresponding to the target object.

2. The media image processing method according to claim 1, characterized in that: The effect superimposed on the target layer corresponding to the target object includes: one or a combination of filter effect, light effect, blur effect, blur effect and beautification effect.

3. The media image processing method according to claim 1, characterized in that: The media image processing method further includes: Segmenting the main object in the media image to be processed; Based on the area of ​​the background object corresponding to the main object, the background object obtained after segmentation is filled.

4. A media image processing device, characterized in that: The media image processing device comprises: A determination unit, used to determine a subject layer and a background layer of the media image to be processed during the shooting process of the media image to be processed, wherein the subject layer is a media image layer where the subject object in the media image to be processed is located, and the background layer is a media image layer where the background objects other than the subject object in the media image to be processed are located; A superposition unit, in response to an effect adjustment input to a target object, performs effect superposition on a target layer corresponding to the target object to generate a target media image, wherein the target object is the subject object and / or the background object, and the target layer is the subject layer and / or the background layer; The superimposing unit records the first media stream corresponding to the main layer and the second media stream corresponding to the background layer in the following manner: Recording a first media stream corresponding to the subject layer and a second media stream corresponding to the background layer, setting a first timeline for the first media stream and a second timeline for the second media stream, wherein the first media stream includes the subject object, the second media stream includes the background object, and the first media stream and the second media stream are different; The overlay unit performs effect overlay on the target layer corresponding to the target object in the following manner: Based on the effect adjustment input of the target object, determining the media image superposition effect required for the to-be-processed media image, wherein the media image superposition effect includes one or more of a reverse playback superposition effect, a time still superposition effect, a time deceleration effect, and a time acceleration effect; Based on the media image overlay effect, the first timeline and / or the second timeline are adjusted to perform effect overlay on the target layer corresponding to the target object.

5. The media image processing device according to claim 4, characterized in that: The superposition unit uses the following superposition effects to perform effect superposition on the target layer corresponding to the target object, including: One or a combination of filter effect, lighting effect, blur effect, blur effect and beauty effect.

6. The media image processing device according to claim 4, characterized in that: The determining unit is further configured to: Segmenting the main object in the media image to be processed; Based on the area of ​​the background object corresponding to the main object, the background object obtained after segmentation is filled.

7. A media image processing device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: execute the media image processing method described in any one of claims 1 to 3.

8. A non-temporary computer-readable storage medium, when the instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal is enabled to execute the media image processing method described in any one of claims 1 to 3.

Images