Image processing method and device, terminal and storage medium

Abstract

The invention relates to an image processing method and device, a terminal and a storage medium, and relates to the technical field of terminal display. Comprising the steps of performing superposition drawing on a first drawing image and a second image to obtain a second drawing image; the first drawn image is stored after a first image corresponding to a first service is redrawn or is stored after a plurality of first images are superposed, the second image is an image corresponding to a second service, and the second drawn image is a background image of a third image corresponding to a third service; and sending the second drawn image to the third service. By using the image processing method provided by the invention, the drawing times of the rendering process can be reduced.

Description

Technical Field

[0001] The present disclosure relates to the field of terminal display technology, and in particular to an image processing method, device, terminal and storage medium. Background Art

[0002] Currently, when the terminal displays the upper layer image, the lower layer image needs to be blurred to highlight the display effect of the upper layer image. However, when displaying the upper layer image, the lower layer image needs to be drawn layer by layer, and the drawing times are relatively high.

[0003] Taking the example that the upper layer image is a notification image and the lower layer images include wallpaper images, desktop images and software usage images, when the terminal displays the pull-down notification image, the wallpaper image, desktop image and software usage image will be blurred to highlight the display effect of the pull-down notification image. However, when drawing the pull-down notification image, the terminal needs to draw the wallpaper image, desktop image and software usage image layer by layer, and the drawing times are relatively high. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides an image processing method, device, terminal and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, there is provided an image processing method, including:

[0006] The first drawn image and the second image are superimposed and drawn to obtain the second drawn image; the first drawn image is a first image corresponding to the first service that is redrawn and saved, or a plurality of first images are superimposed and saved, the second image is an image corresponding to the second service, and the second drawn image is a background image of a third image corresponding to the third service;

[0007] The second drawn image is sent to the third service.

[0008] Optionally, the superimposing the first drawn image and the second image to obtain the second drawn image includes:

[0009] Filtering out a latest target drawn image from the plurality of first drawn images;

[0010] The target drawing image and the second image are drawn to obtain the second drawing image.

[0011] Optionally, the method further comprises:

[0012] A screenshot is taken of an image obtained by superimposing a plurality of the first images to obtain the first drawn image.

[0013] Optionally, after sending the second drawn image to a third service, the method further includes:

[0014] Processing the second drawn image and the third image by the third service to obtain a first composite image;

[0015] The first composite image, the first image, the second image and the third image are combined to obtain a third service image, where the third service image is a display image of the third service on the terminal.

[0016] Optionally, the method further comprises:

[0017] The first drawn image is sent to the second service.

[0018] Optionally, after sending the first drawn image to the second service, the method further includes:

[0019] Processing the first drawn image and the second image by the second service to obtain a second composite image;

[0020] The second composite image, the first image and the second image are combined to obtain a second service image, where the second service image is a display image of the second service on the terminal.

[0021] Optionally, the first drawn image is a wallpaper image corresponding to a wallpaper service, the second image includes a desktop image corresponding to a desktop service and a software usage image corresponding to a software service, and the third image is a notification image corresponding to a notification service; and the step of overlaying the first drawn image with the second image to obtain the second drawn image includes:

[0022] Overlaying and drawing the wallpaper image and the desktop image to obtain a third drawn image;

[0023] The third drawing image is superimposed on the software usage image to obtain the second drawing image, where the second drawing image is a background image of the notification image.

[0024] Optionally, the first drawn image is a wallpaper image corresponding to a wallpaper service, the second image is a desktop image corresponding to a desktop service, and the third image is a notification image corresponding to a notification service; and the step of superimposing the first drawn image and the second image to obtain the second drawn image includes:

[0025] The wallpaper image and the desktop image are overlaid and drawn to obtain the second drawn image, where the second drawn image is the background image of the notification image.

[0026] Optionally, the first drawn image is obtained by superimposing at least one of a wallpaper image corresponding to a wallpaper service, a desktop image corresponding to a desktop service, and a software usage image corresponding to a software service, the second image is a notification image corresponding to a notification service, and the third image is a control center image corresponding to a control center service; the superimposing and drawing the first drawn image and the second image to obtain the second drawn image includes:

[0027] The first drawn image and the notification image are overlaid and drawn to obtain the second drawn image; the second drawn image is the background image of the control center image.

[0028] According to a second aspect of an embodiment of the present disclosure, there is provided an image processing apparatus, including:

[0029] a drawing module configured to superimpose a first drawing image and a second image to obtain a second drawing image; the first drawing image is a first image corresponding to a first service that is redrawn and saved, or a plurality of first images that are superimposed and saved, the second image is an image corresponding to the second service, and the second drawing image is a background image of a third image corresponding to a third service;

[0030] A sending module is configured to send the second drawing image to the third service.

[0031] According to a third aspect of an embodiment of the present disclosure, a terminal is provided, including:

[0032] processor;

[0033] a memory for storing processor-executable instructions;

[0034] Wherein, the processor is configured to:

[0035] Execute the image processing method provided by the first aspect of the embodiment of the present disclosure.

[0036] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the image processing method provided in the first aspect of the present disclosure are implemented.

[0037] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0038] Each drawing of the rendering process can be obtained by combining the first drawing image saved in the latest screenshot with the second image, rather than drawing the lower-layer images layer by layer to obtain the first drawing image and then drawing the second image based on the second image, which can further reduce the number of drawing times.

[0039] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0041] Figure 1 The figure is a flowchart of an image processing method according to an exemplary embodiment.

[0042] Figure 2 It is a schematic diagram of an interface before cross-process fuzzy color mixing is performed according to an exemplary embodiment.

[0043] Figure 3 It is a schematic diagram of an interface before cross-process fuzzy color mixing is performed according to an exemplary embodiment.

[0044] Figure 4 The figure is a schematic diagram of an interface after cross-process fuzzy color mixing is performed according to an exemplary embodiment.

[0045] Figure 5 The diagram is a schematic diagram showing that a software usage image is located on a desktop image according to an exemplary embodiment.

[0046] Figure 6 The figure is a schematic diagram showing that a notification image is located on a software use image according to an exemplary embodiment.

[0047] Figure 7 The diagram is a schematic diagram showing that a control center image is located above a notification image according to an exemplary embodiment.

[0048] Figure 8 The diagram is a schematic diagram showing the interaction between a service and a rendering process before cross-process fuzzy color mixing is performed according to an exemplary embodiment.

[0049] Fig. 9 The diagram is a schematic diagram showing the interaction between a service and a rendering process after cross-process fuzzy color mixing according to an exemplary embodiment.

[0050] Fig.10 is a schematic diagram showing a first drawing image according to an exemplary embodiment.

[0051] Fig.11 It is a schematic diagram showing a service of drawing other image data based on a first drawn image according to an exemplary embodiment.

[0052] Fig.12is a schematic diagram of a second composite image according to an exemplary embodiment.

[0053] Fig.13 The diagram is a schematic diagram showing information of a first drawn image transmitted to a service according to an exemplary embodiment.

[0054] Fig.14 is a block diagram of an image processing apparatus according to an exemplary embodiment.

[0055] Fig.15 is a block diagram of an image processing apparatus according to an exemplary embodiment. DETAILED DESCRIPTION

[0056] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0057] It should be noted that all actions of acquiring signals, information or data in the present disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the device is located and with the authorization given by the owner of the corresponding device.

[0058] At present, when the terminal displays the upper image, the lower image needs to be blurred to highlight the display effect of the upper image. For example, the upper image is the notification image pulled down by the terminal, and the lower image includes the wallpaper image, desktop image and software usage image. Figure 2 , Figure 3 and Figure 5 As shown, Figure 5 It is shown that the upper layer image is a notification image pulled down by the terminal; Figure 2 shows the wallpaper image and the desktop image, Figure 2 The wallpaper image shown in is a dot-shaped wallpaper image. Figure 2 The desktop image shown includes desktop image data such as folder icons, setting icons, album icons, recorder icons, calendar icons, etc.; Figure 3 shows a software usage image that shows Mickey Mouse. See Figure 2 , Figure 3 and Figure 5 As shown, the wallpaper image is located on the first layer, the desktop image is located on the second layer above the wallpaper image, the software usage image is located on the third layer above the desktop image, and the notification image is located on the fourth layer above the software usage image. In this example, there are the above four layers of images.

[0059] In the case where no fuzzy color mixing is performed, see Figure 8 As shown, the wallpaper service sends the wallpaper image to the rendering process (SurfaceFlinger), the desktop service sends the desktop image to the rendering process, the software service sends the software usage image to the rendering process, and the notification service sends the notification image to the rendering process. After the rendering process receives the wallpaper image, desktop image, software usage image and notification image, it superimposes the desktop image on the wallpaper image, and then superimposes the software usage image on the desktop image, and finally superimposes the notification image on the software usage image to form a composite image. Although the composite image shows the notification image, the wallpaper image, desktop image, and software usage image under the notification image can also be clearly seen by the user, which cannot highlight the display interface of the notification image, resulting in a reduced user experience. Similarly, please refer to Figure 2 As shown in FIG. 1 , after the desktop image is superimposed on the wallpaper image, although the desktop image is displayed, the dot wallpaper image where the folder area is located can also be clearly seen by the user, and the display effect of the desktop image cannot be highlighted. Figure 3 As shown, after the software usage image is superimposed on the desktop image, the dot wallpaper image where the folder area in the software usage image is located can also be clearly seen by the user.

[0060] Based on this, a cross-process fuzzy color mixing scheme can be implemented to perform fuzzy color mixing on the underlying wallpaper images, desktop images, and images used by the software, thereby reducing the clarity of the underlying wallpaper images, desktop images, and images used by the software, thereby highlighting the display effect of the notification image. Cross-process means that the underlying business interacts with the underlying business through the rendering process. In the cross-process fuzzy color mixing scheme, the rendering process is used to overlay and draw images at different levels, and the business is used to perform fuzzy color mixing on the overlaid images. Similarly, please refer to Figure 4 and Figure 5 As shown in FIG. 1 , when the desktop image is superimposed on the wallpaper image, the dot wallpaper image in the background of the folder area of ​​the desktop image presents a blurred effect, which can highlight the display effect of the desktop image in the folder area. See also Figure 3 As shown, after the software usage image is superimposed on the desktop image, the origin wallpaper image of the folder area in the software usage image is also blurred, which can also highlight the display effect of the desktop image of the folder area. Figure 4 and Figure 5 The blurring effect shown is only exemplary, and other types of blurring effects may also be used. The blurring effect may be set according to actual needs, and the present disclosure does not impose any limitation on this.

[0061] In the cross-process fuzzy color mixing scheme, if you want to draw a notification image with a color mixing effect, the rendering process needs to first draw the wallpaper image (the first drawing), then draw the desktop image based on the drawn wallpaper image (the second drawing), and then draw the software usage image based on the drawn desktop image (the third drawing), and finally send the drawn image to the notification service. The notification service performs fuzzy color mixing on the drawn image, and then sends the fuzzy mixed image and the entire notification image to the rendering process. The rendering process merges the notification image with a fuzzy mixed color effect based on the fuzzy mixed notification image and all the images under the notification image, and sends the notification image to the terminal screen for display. It can be seen that each time a notification image with a fuzzy mixed color effect is drawn, it needs to go through three drawing times, which is a large number of drawing times.

[0062] The above example only shows the number of times a notification image is drawn. The following will further illustrate that the use of the above fuzzy color mixing solution will result in a large number of drawing times by using a scenario where multiple different business images need to be displayed one by one.

[0063] For example, the terminal displays wallpaper images, desktop images, software usage images, notification images, and control center images layer by layer from the bottom layer to the top layer.

[0064] When the desktop service needs to display the desktop image after fuzzy color mixing, the rendering process needs to draw the wallpaper image and send the drawn composite image to the desktop service to synthesize the desktop image after fuzzy color mixing. It can be seen that one drawing is required to display the desktop image.

[0065] When the notification service needs to display the notification image after fuzzy color mixing, the rendering process needs to draw the wallpaper image first, then overlay the desktop image, then overlay the image used by the drawing software, and send the finished composite image to the notification service to synthesize the notification image after fuzzy color mixing. It can be seen that three times of drawing are required to display the notification service.

[0066] When the control center service needs to display the control center image after fuzzy color mixing, the rendering process needs to draw the wallpaper image first, then overlay the desktop image, then overlay the software usage image, and then overlay the notification image, and send the finished composite image to the control center service to synthesize the control center image after fuzzy color mixing. It can be seen that displaying the control center image requires four drawing operations.

[0067] From the above example, it can be seen that if the rendering process wants to pass data to the above three services, it needs to go through 8 drawing operations in total, which is obviously more.

[0068] Based on this, see Figure 1As shown, the present disclosure proposes an image processing method, which is used in a terminal and includes the following steps.

[0069] In step S11 , the first drawn image and the second image are overlaid and drawn to obtain a second drawn image.

[0070] The interface image displayed by the terminal is usually composed of multiple images stacked on top of each other. The terminal can execute multiple levels of services. The levels of the first service, the second service, and the third service gradually increase. The higher the level of the service, the closer the displayed interface image is to the surface of the image. The lower the level of the service, the closer the displayed service is to the bottom layer of the image. The first service, the second service, and the third service proposed in the present disclosure have at least the following combination scenarios:

[0071] In the first combination scenario, the first service is the wallpaper service, the corresponding second service is the desktop service and software service, and the corresponding third service is the notification service. When the user wakes up the terminal screen, the wallpaper service and the desktop service always remain in operation. The first combination scenario corresponds to the scenario where the user opens the software, plays the video or page displayed by the software, and then pulls down the notification image, so the software service and the notification service are in operation.

[0072] In the second combination scenario, the first service is the wallpaper service, the corresponding second service is the desktop service, and the corresponding third service is the notification service. The second combination scenario corresponds to a scenario where the user wakes up the terminal screen, does not open the software, and directly pulls down the notification image.

[0073] In the third combination scenario, the first service is the wallpaper service, the corresponding second service is the desktop service, software service and notification service, and the corresponding third service is the control center service. The third combination scenario corresponds to the scenario where the user wakes up the terminal screen, first opens the software, then pulls down the notification image, and finally pulls down the control center image.

[0074] In the fourth combination scenario, the first service is the wallpaper service, the corresponding second service is the desktop service and notification service, and the corresponding third service is the control center service. The fourth combination scenario corresponds to the scenario where the user directly pulls down the control center image after waking up the terminal screen.

[0075] Understandably, see Figure 4 As shown, the wallpaper service is used to display wallpaper images and provide users with personalized desktop wallpapers; please refer to Figure 4 As shown, the desktop service is used to display desktop image data such as various software icons on the wallpaper image. The software icon is a link entrance to open the software; please refer to Figure 5As shown, the software service is used to display the software usage image. For example, if the software is a video player software, the software service can display the playback interface of the video player software. If the software is a web browsing software, the software service can display the web page. Please refer to Figure 6 As shown, the notification service is used to display the notification image pulled down by the terminal. The notification image will contain various notification information, such as text messages, software reminder information, etc.; please refer to Figure 7 As shown, the control center service is used to display a control center image, which displays adjustment buttons of various controls of the terminal, such as brightness, volume, flashlight, network mode, etc.

[0076] The third image of the third business display is located above the second image of the second business display, the second image of the second business display is located above the first image of the first business display, and the levels of the third image, the second image and the first image gradually decrease.

[0077] For example, see Figure 5 and Figure 6 As shown, the first image is a wallpaper image, the second image is a desktop image and a software usage image located above the wallpaper image, and the third image may be a notification image located above the software usage image. For another example, the first image is a wallpaper image, the second image is a desktop image, a software usage image, and a notification image located above the wallpaper image, and the third image may be a control center image located above the notification image.

[0078] The first drawn image is a first image corresponding to a first service that is redrawn and saved or a plurality of first images that are superimposed and saved, the second image is an image corresponding to a second service, and the second drawn image is a background image of a third image corresponding to a third service.

[0079] Taking the case where the first drawn image is a redrawn first image as an example, in a scenario where the first image is a wallpaper image, the second image is a desktop image and a software usage image, and the third image is a notification image, the rendering process redraws the wallpaper image to obtain a first drawn image, and then takes a screenshot of the first drawn image and saves it; then, on the basis of the screenshot of the first drawn image, the desktop image and the software usage image are successively superimposed and drawn to obtain a second drawn image; then, the second drawn image is sent to the notification service, and after the notification service performs fuzzy mixing on the second drawn image, the fuzzy mixed second drawn image is used as the background image of the notification image.

[0080] Taking the example of the first drawn image being three first images superimposed and saved, in the scenario where the first image is the wallpaper image, the desktop image and the software usage image, the second image is the notification image, and the third image is the control center image, the rendering process superimposes and draws the desktop image and the software usage image in sequence on the basis of the screenshot-saved wallpaper image to obtain the first drawn image, and then takes a screenshot and saves the first drawn image; then, the notification image is drawn on the basis of the screenshot-saved first drawn image to obtain the second drawn image, and the second drawn image is sent to the control center service. After the control center service performs fuzzy mixing on the second drawn image, the fuzzy mixed second drawn image is used as the background image of the control center image.

[0081] In the above example, after the rendering process overlays and draws a business image each time, a screenshot of the business image will be saved to provide a basis for the next drawing, that is, the next drawing of the rendering process is performed on the basis of the multiple superimposed images saved in the screenshot, rather than first overlaying multiple layers of business and then drawing the next image on this basis.

[0082] For example, after the rendering process finishes drawing the wallpaper image, a screenshot of the wallpaper image is saved to obtain a first screenshot image, so that subsequent desktop images are drawn on the first screenshot image saved in the screenshot without redrawing the wallpaper image.

[0083] For another example, the rendering process sequentially superimposes the desktop image and the software usage image on the basis of the first screenshot image saved in the screenshot, and then saves the screenshot to obtain the second screenshot image, so that the subsequent notification image is drawn on the second screenshot image saved in the screenshot, without the need to redraw the wallpaper image, draw the desktop image based on the wallpaper image, or draw the software usage image based on the desktop image.

[0084] For another example, the rendering process can overlay the control center image on the basis of the second screenshot image saved by the screenshot, and send the overlaid image to the control center service for fuzzy color mixing without redrawing the wallpaper image, drawing the desktop image based on the wallpaper image, drawing the software usage image based on the desktop image, or drawing the notification image on the software usage image.

[0085] In step S12, the second drawn image is sent to the third service.

[0086] The second drawn image is sent to the third service. After the third service performs fuzzy color mixing on the second drawn image, the fuzzy color mixed second drawn image is used as the background image of the third image, thereby highlighting the display effect of the third image.

[0087] Understandably, see Fig. 9 and Fig.13 As shown, the rendering process takes a screenshot of the superimposed image of the business images of the multiple lower-layer businesses and sends it to the upper-layer business, so that the upper-layer business can perform fuzzy color mixing on the superimposed image of the business images of the multiple lower-layer businesses, and then draw the image data required by the upper-layer business on the basis of the fuzzy color mixing, and finally renders the drawn business image of the upper-layer business to the terminal screen through the rendering process. This process is called a cross-process fuzzy color mixing process.

[0088] In some cases, see Fig. 9 As shown, if the user pulls down the notification image while using the software, the rendering process will overlay the desktop image on the wallpaper image saved in the screenshot to obtain a third drawn image, and then draw the software usage image on the basis of the third drawn image to obtain a second drawn image (the second drawn image is Fig. 9 and then sending the second drawn image to the notification service, which uses the second drawn image as the background image of the notification image, thereby highlighting the display effect of the notification image.

[0089] In some cases, see Fig. 9 As shown, if the user pulls down the notification image when not using the software, the rendering process will overlay the desktop image on the wallpaper image saved in the screenshot to obtain a second drawn image (the second drawn image is the overlay result of 1 and 2); the second drawn image is then sent to the notification service, and the notification service uses the second drawn image as the background image of the notification image, thereby highlighting the display effect of the notification image.

[0090] In some cases, see Fig. 9 As shown, if the user first pulls down the notification image and then pulls down the control center image when using the software, the rendering process will draw the notification image based on the superimposed wallpaper image, desktop image and software usage image to obtain a second drawn image (the second drawn image is Fig. 9 The second drawn image is then sent to the control center service, and the control center service uses the second drawn image as the background image of the control center image, thereby highlighting the display effect of the notification image.

[0091] It is understandable that the screenshot saves a clear image obtained by the rendering process redrawing the first image or superimposing multiple first images, and the image has not been subjected to blurring and color mixing processing.

[0092] Through the above technical solution, in the scenario where the second drawing image is sent to the third service, the first drawing image after superimposing at least one first image will be screenshotted and saved, so that the subsequent drawing of the second drawing image is superimposed on the first drawing image saved in the screenshot, without the need to redraw the at least one first image, thereby reducing the number of drawing times.

[0093] For example, in the related art, delivering the drawn wallpaper image to the desktop service requires one drawing process (drawing of the wallpaper image); delivering the drawn software usage image to the notification service requires three drawing processes (drawing of the wallpaper image, drawing of superimposing the desktop image on the wallpaper image, and drawing of superimposing the software usage image on the desktop image); delivering the drawn notification image to the control center service requires four drawing processes (drawing of the wallpaper image, drawing of superimposing the desktop image on the wallpaper image, drawing of superimposing the software usage image on the desktop image, and drawing of superimposing the control center image on the software usage image), so a total of eight drawing processes are required.

[0094] In this disclosure, please refer to Fig. 9 As shown, delivering the drawn image wallpaper to the desktop service requires one drawing process (redrawing of the wallpaper image); delivering the drawn software usage image to the notification service requires two drawing processes (overlaying the drawing of the desktop image on the redrawing result of 1 saved in the screenshot, and overlaying the drawing of the software usage image on the desktop image); delivering the drawn notification image to the control center service requires one drawing process (drawing the notification image on the overlay results of 1, 2, and 3 saved in the screenshot), so the present disclosure requires a total of four drawing processes, which shows that the number of drawing times is significantly reduced.

[0095] The following describes a specific embodiment of the above step S11, which is used to explain which first drawing image is to be superimposed with the second image to obtain the second drawing image when there are multiple first drawing images of screenshots.

[0096] A latest target drawing image is selected from the plurality of the first drawing images; and the target drawing image and the second image are drawn to obtain the second drawing image.

[0097] For example, the first drawn image includes the following three drawn images: (1) a redrawn wallpaper image; (2) a drawn wallpaper image superimposed with a desktop image and a software usage image; Fig. 9 The overlay results of 1, 2, and 3; (3) the drawn wallpaper image is overlaid with the desktop image, software usage image, and notification image. Fig. 9The overlay results of 1, 2, 3, and 4 are obtained. Then, the target drawing image saved in the latest screenshot can be selected from the three drawing images, and then the second image can be drawn based on the target drawing image saved in the latest screenshot to obtain the second drawing image.

[0098] When data needs to be sent to the desktop service, the (1st) type of drawing image saved in the latest screenshot can be superimposed on the desktop image and sent to the desktop service; when data needs to be sent to the notification service, the (2nd) type of drawing image saved in the latest screenshot can be superimposed on the notification image and sent to the notification service; when data needs to be sent to the control center service, the (3rd) type of drawing image saved in the latest screenshot can be superimposed on the control center image and sent to the control center service.

[0099] Through the above technical solution, each drawing of the rendering process can be obtained based on the first drawing image saved by the latest screenshot combined with the second image, which can further reduce the number of drawing times. For example, when the rendering process draws a notification image based on the software usage image, it superimposes the notification image on the basis of the above second drawing image, rather than superimposing the desktop image and the software usage image twice on the basis of the first drawing image before further superimposing the notification image, and the number of drawing times is significantly reduced.

[0100] A specific embodiment of the present disclosure is introduced below, which is used to explain a workflow of a terminal when displaying an image.

[0101] Receive a first image sent by a first service, redraw the first image to obtain a first drawn image; send the first drawn image to the second service; process the first drawn image and the second image through the second service to obtain a second composite image; receive a second composite image sent by a second service, merge the second composite image, the first image and the second image to obtain a second service image, wherein the second service image is a display image of the second service on the terminal.

[0102] After receiving the first image sent by the first service, the rendering process will redraw the first image, including reducing the first image, cropping the first image, etc., so as to obtain the redrawn first drawn image; then the first drawn image is sent to the second service, and the second service performs fuzzy color mixing on the first drawn image, and uses the fuzzy color mixing first drawn image as the background of the second image, and then combines the image data of the second image to obtain the second composite image; the second service sends the second composite image and the second image to the rendering process, and the rendering process merges the second composite image, the first image and the second image to obtain the second service image. The second composite image is obtained by synthesizing the images belonging to the same target area in the first image and the second image.

[0103] For example, taking the first service as a wallpaper service, the second service as a desktop service, the first image as a wallpaper image, and the second image as a desktop image, the desktop image contains various software icons. If it is necessary to blur the background wallpaper image of the folder area containing the software icons, the following steps can be adopted: after the rendering process receives the wallpaper image sent by the wallpaper service, the wallpaper image of the folder area is cropped out to obtain the following image: Fig.10 The first drawn image shown; the rendering process then Fig.10 The first drawn image of the folder area shown in the figure is sent to the desktop service. The desktop service first performs fuzzy color mixing on the first drawn image to obtain the background image of the folder area. The desktop service then draws the following image based on the background image: Fig.11 The border of the folder area and the software icons in the border are shown as follows, so that Fig.12 The desktop service then sends the second composite image to the rendering process, and the rendering process splices the second composite image of the folder area and the wallpaper image of other areas of the non-folder area with the desktop image to obtain Figure 4 The second service image to be displayed by the desktop service shown; finally, the rendering process sends the second service image to the terminal screen for display.

[0104] A specific embodiment of the present disclosure is introduced below, which is used to explain another workflow of a terminal when displaying an image.

[0105] The second drawn image is sent to the third service; the second drawn image and the third image are processed by the third service to obtain a first composite image; the first composite image, the first image, the second image and the third image are merged to obtain a third service image, which is a display image of the third service on the terminal.

[0106] The rendering process draws the second image based on the first drawn image to obtain the second drawn image; then the second drawn image is sent to the second service, the second service performs fuzzy color mixing on the second drawn image, uses the fuzzy color mixed second drawn image as the background of the third image, and then combines the image data of the second image to obtain the first composite image; the third service sends the first composite image and the third image to the rendering process, and the rendering process combines the first composite image, the first image, the second image and the third image to obtain the third service image. The first composite image is obtained by drawing the third image based on the fuzzy color mixed second drawn image.

[0107] For example, taking the case where the first service is a wallpaper service, the second service is a desktop service and a software usage service, the third service is a notification service, the first image is a wallpaper image, the second image is a desktop image and a software usage image, and the second image is a notification image, if it is necessary to blur the software usage image, the desktop image, and the wallpaper image under the notification image, the following steps can be adopted: the rendering process draws the desktop image and the software usage image in sequence on the basis of the wallpaper image saved by the screenshot to obtain a second drawn image, and then sends the second drawn image to the notification service; the notification service blurs and mixes the wallpaper image, the desktop image, and the software usage image to obtain a background image of the notification image, and the notification service then draws the notification message, time status, software usage status, etc. that the notification image needs to display on the basis of the background image, thereby obtaining a first composite image; the desktop service further processes the first composite image, the wallpaper image, the desktop image, the software usage image, and the notification image to finally obtain a third service image, which is the display image of the notification service when displaying the notification on the terminal.

[0108] Fig.14 is a block diagram of an image processing device according to an exemplary embodiment. Fig.14 The image processing device 1400 includes a drawing module 1410 and a sending module 1420 .

[0109] The drawing module 1410 is configured to perform superimposition drawing on a first drawing image and a second image to obtain a second drawing image; the first drawing image is a first image corresponding to a first service that is redrawn and saved, or a plurality of first images that are superimposed and saved, the second image is an image corresponding to the second service, and the second drawing image is a background image of a third image corresponding to a third service;

[0110] The sending module 1420 is configured to send the second drawn image to the third service.

[0111] Optionally, the drawing module 1410 includes:

[0112] A screening submodule, configured to screen out a latest target drawing image from the plurality of first drawing images;

[0113] The first drawing submodule is configured to draw the target drawing image and the second image to obtain the second drawing image.

[0114] Optionally, the image processing device 1400 includes:

[0115] The screenshot module is configured to take a screenshot of an image obtained by superimposing a plurality of the first images to obtain the first drawn image.

[0116] Optionally, the image processing device 1400 includes:

[0117] A first processing module is configured to process the second drawn image and the third image through the third service to obtain a first composite image;

[0118] The first rendering module is configured to merge the first composite image, the first image, the second image and the third image to obtain a third business image, where the third business image is a display image of the third business on the terminal.

[0119] Optionally, the sending module 1420 is further configured to send the first drawing image to the second service.

[0120] Optionally, the image processing device 1400 includes:

[0121] A second processing module is configured to process the first drawn image and the second image through the second service to obtain a second composite image;

[0122] The second rendering module is configured to merge the second composite image, the first image and the second image to obtain a second service image, where the second service image is a display image of the second service on the terminal.

[0123] Optionally, the first drawn image is a wallpaper image corresponding to a wallpaper service, the second image includes a desktop image corresponding to a desktop service and a software usage image corresponding to a software service, and the third image is a notification image corresponding to a notification service; the drawing module 1410 includes:

[0124] A second drawing submodule is configured to draw a superimposed image on the wallpaper image and the desktop image to obtain a third drawn image;

[0125] The third drawing submodule is configured to superimpose the third drawing image and the software usage image to obtain the second drawing image, where the second drawing image is the background image of the notification image.

[0126] Optionally, the first drawn image is a wallpaper image corresponding to a wallpaper service, the second image is a desktop image corresponding to a desktop service, and the third image is a notification image corresponding to a notification service; the drawing module 1410 includes:

[0127] The fourth drawing submodule is configured to perform superimposed drawing on the wallpaper image and the desktop image to obtain the second drawing image, where the second drawing image is the background image of the notification image.

[0128] Optionally, the first drawn image is obtained by superimposing at least one of a wallpaper image corresponding to a wallpaper service, a desktop image corresponding to a desktop service, and a software usage image corresponding to a software service, the second image is a notification image corresponding to a notification service, and the third image is a control center image corresponding to a control center service; the drawing module 1410 includes:

[0129] The fifth drawing submodule is configured to perform superimposed drawing on the first drawing image and the notification image to obtain the second drawing image; the second drawing image is the background image of the control center image.

[0130] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0131] The present disclosure also provides a computer-readable storage medium on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the image processing method provided by the present disclosure are implemented.

[0132] Fig.15 1 is a block diagram of an apparatus 1500 for image processing according to an exemplary embodiment. For example, the apparatus 1500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0133] Reference Fig.15 , the device 1500 may include one or more of the following components: a processing component 1502 , a memory 1504 , a power component 1506 , a multimedia component 1508 , an audio component 1510 , an input / output interface 1512 , a sensor component 1514 , and a communication component 1516 .

[0134] The processing component 1502 generally controls the overall operation of the device 1500, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1502 may include one or more processors 1520 to execute instructions to complete all or part of the steps of the above-mentioned image processing method. In addition, the processing component 1502 may include one or more modules to facilitate the interaction between the processing component 1502 and other components. For example, the processing component 1502 may include a multimedia module to facilitate the interaction between the multimedia component 1508 and the processing component 1502.

[0135] The memory 1504 is configured to store various types of data to support the operation of the device 1500. Examples of such data include instructions for any application or method operating on the device 1500, contact data, phone book data, messages, pictures, videos, etc. The memory 1504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0136] The power supply component 1506 provides power to the various components of the device 1500. The power supply component 1506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 1500.

[0137] The multimedia component 1508 includes a screen that provides an output interface between the device 1500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1508 includes a front camera and / or a rear camera. When the device 1500 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0138] The audio component 1510 is configured to output and / or input audio signals. For example, the audio component 1510 includes a microphone (MIC), and when the device 1500 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 1504 or sent via the communication component 1516. In some embodiments, the audio component 1510 also includes a speaker for outputting audio signals.

[0139] The input / output interface 1512 provides an interface between the processing component 1502 and the peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0140] The sensor assembly 1514 includes one or more sensors for providing various aspects of the status assessment of the device 1500. For example, the sensor assembly 1514 can detect the open / closed state of the device 1500, the relative positioning of components, such as the display and keypad of the device 1500, the sensor assembly 1514 can also detect the position change of the device 1500 or a component of the device 1500, the presence or absence of user contact with the device 1500, the orientation or acceleration / deceleration of the device 1500, and the temperature change of the device 1500. The sensor assembly 1514 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1514 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1514 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0141] The communication component 1516 is configured to facilitate wired or wireless communication between the device 1500 and other devices. The device 1500 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1516 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1516 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0142] In an exemplary embodiment, the device 1500 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned image processing method.

[0143] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1504 including instructions, and the instructions can be executed by the processor 1520 of the device 1500 to perform the above-mentioned image processing method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0144] In addition to being an independent electronic device, the above-mentioned device can also be a part of an independent electronic device. For example, in one embodiment, the device can be an integrated circuit (IC) or a chip, wherein the integrated circuit can be an IC or a collection of multiple ICs; the chip can include but is not limited to the following types: GPU (Graphics Processing Unit), CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), SOC (System on Chip, SoC), etc. The above-mentioned integrated circuit or chip can be used to execute executable instructions (or codes) to implement the above-mentioned image processing method. The executable instructions can be stored in the integrated circuit or chip, or can be obtained from other devices or equipment, such as the integrated circuit or chip includes a processor, a memory, and an interface for communicating with other devices. The executable instruction may be stored in the memory, and when the executable instruction is executed by the processor, the above-mentioned image processing method may be implemented; alternatively, the integrated circuit or chip may receive the executable instruction through the interface and transmit it to the processor for execution, so as to implement the above-mentioned image processing method.

[0145] In another exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program executable by a programmable device, and the computer program has a code portion for executing the above-mentioned image processing method when executed by the programmable device.

[0146] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0147] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An image processing method, characterized in that: include: Overlaying the first drawn image with the second image to obtain a second drawn image; The first drawn image is a first image corresponding to a first service that is redrawn and saved, or a plurality of first images that are superimposed and saved, the second image is an image corresponding to a second service, and the second drawn image is a background image of a third image corresponding to a third service; The second drawn image is sent to the third service.

2. The method according to claim 1, characterized in that The step of overlaying the first drawn image with the second image to obtain the second drawn image includes: Filtering out a latest target drawn image from the plurality of first drawn images; The target drawing image and the second image are drawn to obtain the second drawing image.

3. The method according to claim 1, characterized in that: The method further comprises: A screenshot is taken of an image obtained by superimposing a plurality of the first images to obtain the first drawn image.

4. The method according to claim 1, characterized in that: After sending the second drawn image to the third service, the method further includes: Processing the second drawn image and the third image by the third service to obtain a first composite image; The first composite image, the first image, the second image and the third image are combined to obtain a third service image, where the third service image is a display image of the third service on the terminal.

5. The method according to claim 1, characterized in that The method further comprises: The first drawn image is sent to the second service.

6. The method according to claim 5, characterized in that After sending the first drawn image to the second service, the method further includes: Processing the first drawn image and the second image by the second service to obtain a second composite image; The second composite image, the first image and the second image are combined to obtain a second service image, where the second service image is a display image of the second service on the terminal.

7. The method according to claim 1, characterized in that The first drawn image is a wallpaper image corresponding to the wallpaper service, the second image includes a desktop image corresponding to the desktop service and a software usage image corresponding to the software service, and the third image is a notification image corresponding to the notification service; The step of overlaying the first drawn image with the second image to obtain the second drawn image includes: Overlaying and drawing the wallpaper image and the desktop image to obtain a third drawn image; The third drawing image is superimposed on the software usage image to obtain the second drawing image, where the second drawing image is a background image of the notification image.

8. The method according to claim 1, characterized in that The first drawn image is a wallpaper image corresponding to a wallpaper service, the second image is a desktop image corresponding to a desktop service, and the third image is a notification image corresponding to a notification service; The step of overlaying the first drawn image with the second image to obtain the second drawn image includes: The wallpaper image and the desktop image are overlaid and drawn to obtain the second drawn image, where the second drawn image is the background image of the notification image.

9. The method according to claim 1, characterized in that: The first drawn image is obtained by superimposing at least one of a wallpaper image corresponding to a wallpaper service, a desktop image corresponding to a desktop service, and a software usage image corresponding to a software service, the second image is a notification image corresponding to a notification service, and the third image is a control center image corresponding to a control center service; the superimposing and drawing the first drawn image and the second image to obtain the second drawn image includes: The first drawn image and the notification image are overlaid and drawn to obtain the second drawn image; the second drawn image is the background image of the control center image.

10. An image processing device, characterized in that: include: A drawing module, configured to perform superimposition drawing on the first drawing image and the second image to obtain a second drawing image; The first drawn image is a first image corresponding to a first service that is redrawn and saved, or a plurality of first images that are superimposed and saved, the second image is an image corresponding to a second service, and the second drawn image is a background image of a third image corresponding to a third service; A sending module is configured to send the second drawing image to the third service.

11. A terminal, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: Execute the steps of any one of the methods of claims 1 to 9.

12. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the steps of the method described in any one of claims 1 to 9 are implemented.

Images