Image processing method and device, terminal and storage medium

By receiving the first image of the first drawing direction sent by the rendering process and processing it according to the second drawing direction of the service, the problem of background flickering when the image is switched from horizontal screen to vertical screen is solved, and the user experience is improved.

CN119902674APending Publication Date: 2025-04-29BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311406087.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-10-26
Publication Date
2025-04-29

AI Technical Summary

Technical Problem

In multiple business scenarios, when the image switches from horizontal screen to vertical screen, the background may flash problems, affecting the user experience.

Method used

By receiving a first image of the first drawing direction sent by the rendering process, and processing the first image according to the first drawing direction and/or the second drawing direction of the service, ensuring that the blurred color is always performed in the same direction during the switching process.

Benefits of technology

Avoid flickering problems of image backgrounds, improve user experience, and ensure that image backgrounds are continuous and correct during the switching process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119902674A_ABST
    Figure CN119902674A_ABST
Patent Text Reader

Abstract

The invention relates to an image processing method and device, a terminal and a storage medium, and relates to the technical field of terminal display. Comprising the steps of receiving a first image in a first drawing direction sent by a rendering process; and processing the first image according to the first drawing direction and / or a second drawing direction when the first business draws the image. By using the image processing method provided by the invention, the flicker problem of the first image serving as the background when the first business displays the image can be avoided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of terminal display technology, and in particular to an image processing method, device, terminal and storage medium. Background Art

[0002] Currently, there are multiple services at a certain moment, some of which are displayed in horizontal mode and others in vertical mode. When the images displayed by some services are switched from horizontal mode to vertical mode, the backgrounds of the images displayed in vertical mode by other services will flicker. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides an image processing method, device, terminal and storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an image processing method, including:

[0005] Receive a first image of a first drawing direction sent by a rendering process;

[0006] The first image is processed according to the first drawing direction and / or the second drawing direction when the first service draws the image.

[0007] Optionally, processing the first image according to the second drawing direction includes:

[0008] The first image is drawn in the second drawing direction, where the second drawing direction is the same as the first drawing direction.

[0009] Optionally, the first service is a vertical screen service, and drawing the first image in the second drawing direction includes:

[0010] The first image is drawn in a second drawing direction supported by the portrait screen service.

[0011] Optionally, drawing the first image in a second drawing direction when drawing an image in the vertical screen service includes:

[0012] During the process of switching the second service from the horizontal screen state to the vertical screen state, the first image is drawn in the second drawing direction, the second service is different from the vertical screen service, and the first image is the background image when the vertical screen service displays an image.

[0013] Optionally, processing the first image according to the first drawing direction and a second drawing direction when the first service draws the image includes:

[0014] When the first drawing direction is perpendicular to the second drawing direction, rotating the first image in the first drawing direction into a second image in the second drawing direction;

[0015] The second image is drawn in the second drawing direction.

[0016] Optionally, the first service is a horizontal screen service, and when the first drawing direction is perpendicular to the second drawing direction, rotating the first image in the first drawing direction to the second image in the second drawing direction includes:

[0017] When the first drawing direction is perpendicular to a second drawing direction supported by the horizontal screen service, the first image in the first drawing direction is rotated into a second image in the second drawing direction, and the second image is a background image when the horizontal screen service displays an image.

[0018] Optionally, the processing the first image according to the first drawing direction and a second drawing direction when the first service draws the image includes:

[0019] When the first drawing direction is the same as the second drawing direction, the first image is drawn in the first drawing direction or the second drawing direction.

[0020] According to a second aspect of an embodiment of the present disclosure, there is provided an image processing apparatus, including:

[0021] A receiving module, configured to receive a first image in a first drawing direction sent by a rendering process;

[0022] The drawing module is configured to process the image according to the first drawing direction and / or the second drawing direction when drawing the image for the first service.

[0023] According to a third aspect of an embodiment of the present disclosure, a terminal is provided, including:

[0024] processor;

[0025] a memory for storing processor-executable instructions;

[0026] Wherein, the processor is configured to:

[0027] Execute the steps of the image processing method provided in the first aspect of the embodiment of the present disclosure.

[0028] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the image processing method provided in the first aspect of the present disclosure are implemented.

[0029] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0030] The service can receive a first image of a first drawing direction sent by a rendering process, and then process the first image according to the first drawing direction and / or the second drawing direction, so that in the process of switching the horizontal screen display service from a horizontal screen state to a vertical screen state, the first service always performs blurry mixing on the first image in one direction, and there will be no situation where blurry mixing is performed in the horizontal screen direction at the previous moment and blurry mixing is performed in the vertical screen direction at the next moment, thereby avoiding the flickering problem of the first image serving as the background when the first service displays the image.

[0031] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0033] Figure 1 The figure is a flowchart of an image processing method according to an exemplary embodiment.

[0034] Figure 2 The diagram is a schematic diagram showing a desktop service displaying a desktop image according to an exemplary embodiment.

[0035] Figure 3 The figure is a schematic diagram showing a photo album service displaying captured images according to an exemplary embodiment.

[0036] Figure 4 The diagram is a schematic diagram showing a wallpaper image of a folder area according to an exemplary embodiment.

[0037] Figure 5 The figure is a schematic diagram showing a desktop image of a folder area according to an exemplary embodiment.

[0038] Figure 6 The diagram is a schematic diagram showing a processed image after drawing a desktop image by fuzzy mixing the wallpaper image in a folder area according to an exemplary embodiment.

[0039] Figure 7 The figure is a schematic diagram of a notification image according to an exemplary embodiment.

[0040] Figure 8 The diagram is a schematic diagram showing a processed image obtained by blurring and mixing a horizontal wallpaper image in a vertical direction in a desktop service according to an exemplary embodiment.

[0041] Fig. 9 The diagram is a schematic diagram of a processed image obtained by blurring and mixing a vertical wallpaper image in a vertical direction in a desktop service according to an exemplary embodiment.

[0042] Fig.10 The diagram is a schematic diagram showing a target direction of a terminal according to an exemplary embodiment.

[0043] Fig.11 The diagram is a schematic diagram showing a desktop service processing wallpaper image before optimization and a desktop service processing wallpaper image after optimization according to an exemplary embodiment.

[0044] Fig.12 It is a schematic diagram showing a pull-down notification service processing wallpaper image before optimization and a pull-down notification service processing wallpaper image after optimization according to an exemplary embodiment.

[0045] Fig.13 is a schematic diagram of an image processing device according to an exemplary embodiment.

[0046] Fig.14 is a schematic diagram of an image processing device according to an exemplary embodiment. DETAILED DESCRIPTION

[0047] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0048] It should be noted that all actions of acquiring signals, information or data in the present disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the device is located and with the authorization given by the owner of the corresponding device.

[0049] Currently, there are multiple services at a certain moment, with images of some services displayed in landscape mode and images of other services displayed in portrait mode. When images displayed by some services switch from landscape mode to portrait mode, the backgrounds of images displayed in portrait mode for other services will flicker, resulting in a poor user experience.

[0050] For example, the album service is first in the horizontal screen state. When the user slides the album service back to the desktop to switch from the horizontal screen state to the vertical screen state, the background of the desktop image displayed by the desktop service will flicker, resulting in a reduced user experience.

[0051] The following explains what causes the background of the desktop image to flicker briefly: Figure 2 As shown, most of the images displayed on the terminal are stacked, and the bottom layer is the wallpaper image. The wallpaper image is an image displayed by the wallpaper service and is used to provide users with personalized desktop wallpapers. Figure 2 The wallpaper image shown is a dot wallpaper image; the desktop image is displayed above the wallpaper image, and the desktop image is used to display the desktop images such as folders, settings, albums, recorders, calendars, etc., and the software icons are link entrances to the software; please refer to Figure 3 As shown, the captured image is displayed on the desktop image. The captured image is an image displayed by the album service and is used to show the user the image of the person captured by the terminal. When the user clicks Figure 2 Click the photo album icon in the desktop image shown to enter Figure 3 The captured image is shown.

[0052] See also Figures 4 to 6 As shown, when the desktop service displays the desktop image, the rendering process redraws the wallpaper image to obtain Figure 4 The wallpaper image of the folder area shown in the figure, the rendering process then Figure 4 The wallpaper images in the folder area shown are sent to the desktop business, see Figure 5 and Figure 6 As shown, the desktop service performs fuzzy color mixing on the redrawn wallpaper image, and then uses the fuzzy color mixing wallpaper image as the background of the desktop image to obtain a processed image; finally, the processed image is sent to the rendering process, and the rendering process renders the processed image on the terminal screen for display. In this way, the background wallpaper image in the desktop image of the folder area is blurred, so as to highlight the display effect of the desktop image in this area. For example, see Figure 2 As shown, the wallpaper image in the background of the folder area is blurred, and the wallpaper image in the background of the other non-folder areas is clear, so that the display effect of the desktop image in the folder area can be highlighted. Figure 2 and Figure 6 The blur effect shown is only an example. The blur effect can be changed according to needs during actual processing, and the present disclosure does not limit this.

[0053] So, suppose the user uses the album service in landscape mode to display the captured images in landscape mode. The captured images displayed by the album service are in landscape mode. When the user swipes up the album service to return to the terminal desktop, the rendering process first transmits the wallpaper image required by the desktop service to the desktop service because the desktop image needs to be displayed. The wallpaper image is in landscape mode. The desktop service then performs fuzzy color mixing on the wallpaper image in landscape mode in the vertical direction, resulting in background errors after fuzzy color mixing. Please refer to Figure 8As shown in the figure, the color switching between the background of the desktop image in the folder area and the wallpaper image in the rest of the non-folder area is not coherent, that is, after the background of the desktop image and the wallpaper image in the non-folder area are spliced, it is an incorrect wallpaper image, and the processed image is also incorrect; when the album service has been switched to the terminal desktop, the rendering process transmits the wallpaper image required by the desktop service to the desktop service. The wallpaper image is in a vertical direction, and the desktop service then performs fuzzy mixing on the vertical screen wallpaper image in the vertical direction. At this time, the background obtained after fuzzy mixing is correct, please refer to Fig. 9 As shown, the background of the desktop image in the folder area and the wallpaper image in the rest of the non-folder area have the same color. After the background of the desktop image and the wallpaper image in the non-folder area are spliced, it is the correct wallpaper image. Then the processed image based on the correct background and desktop image is correct. In this process, the background "wallpaper image" of the desktop image will first switch from an incorrect display state to a correct display state, which eventually causes the background of the folder area to flicker when the desktop image is displayed.

[0054] That is to say, the desktop service first obtains the wrong horizontal screen wallpaper image and draws it in the vertical direction, and then obtains the correct vertical screen wallpaper image and draws it in the vertical direction, which will cause the background of the displayed desktop image to switch from the wrong display state to the correct display state, thereby causing the background to flicker when the desktop image is displayed.

[0055] Based on this, the present disclosure proposes an image processing method, see Figure 1 As shown, the image processing method is applied in a terminal, comprising the following steps:

[0056] In step S11, a first image in a first drawing direction sent by a rendering process is received.

[0057] The rendering process (surfaceflinger) is a bridge for interaction between different services. The rendering process is used to superimpose images of services at different layers, and then send the superimposed images to the upper-layer services so that the upper-layer services can perform fuzzy color mixing on the superimposed images. The upper-layer services send the processed images after fuzzy color mixing to the rendering process, and the rendering process renders the processed images onto the terminal screen.

[0058] When the terminal displays an image, it will display the image through the service. For example, the wallpaper service is used to display the wallpaper image and provide the user with a personalized desktop wallpaper. The desktop service is used to display the desktop image data such as the software icons on the wallpaper image. The software icon is the link entrance to open the software. The software service is used to display the software usage image. For example, if the software is a video player software, the software service can display the playback interface of the video player software. If the software is a web browsing software, the software service can display the web page. The notification service is used to display the notification image pulled down by the terminal. Please refer to Figure 7 As shown, the notification image will include various notification information, such as text messages, software reminder information, etc. The control center service is used to display the control center image, which displays the adjustment buttons of various controls of the terminal, such as brightness, volume, flashlight, network mode, etc.

[0059] In this example, the desktop image displayed by the desktop service is above the wallpaper image displayed by the wallpaper service, so the desktop service can be called the upper-layer service of the wallpaper service; similarly, the software usage image displayed by the software service is above the desktop image displayed by the desktop service, so the software service can be called the upper-layer service of the wallpaper service and the desktop service.

[0060] The first image is an image to be blurred and mixed by the service. The first image may be an image reconstructed by the rendering process, or may be a superimposed image obtained by superimposing multiple layers of service images by the rendering process.

[0061] For example, see Figure 2 and Figure 7 As shown, a wallpaper image, a desktop image and a notification image are displayed on the terminal screen, the desktop image is overlaid on the wallpaper image, and the notification image is overlaid on the desktop image. When it is necessary to fuzzily mix the wallpaper image and the desktop image under the desktop image, the rendering process first redraws the wallpaper image (the wallpaper image is the first image) to obtain the wallpaper image of the folder area, and then draws the desktop image of the folder area based on the wallpaper image of the folder area to obtain an overlay image (the overlay image of the wallpaper image and the desktop image is also the first image); then the overlay image is sent to the notification service, the notification service performs fuzzy mixing on the overlay image, and uses the overlay image after fuzzy mixing as the background of the notification image to obtain a processed image; the notification service then sends the processed image to the rendering process, and the rendering process renders the processed image to the terminal screen.

[0062] The first drawing direction can be vertical, see Fig.10 As shown, the vertical direction proposed in the embodiment of the present disclosure refers to Fig.10The target point "vertex A" of the terminal screen is shown as the starting point, and drawing is performed along the target direction of the terminal screen. The target direction varies with the type of terminal. When the terminal is a mobile phone, the target direction is the length direction of the mobile phone screen, and the first drawing direction is the length direction of the mobile phone; when the terminal is a tablet, the target direction is the width direction of the tablet screen, and the first drawing direction is the width direction of the tablet.

[0063] After the upper-layer business displays the upper-layer image in landscape mode, when swiping up to switch to the desktop, the drawing direction of the first image sent by the rendering process received by the upper-layer business is the same as the drawing direction of the image displayed by the upper-layer business, both are horizontal. Therefore, after the upper-layer business switches to the desktop, it is drawn in the display direction of the desktop wallpaper image, which will cause the wallpaper image under the desktop image background to flicker.

[0064] For example, when the user is using the album service, the screen is displayed in landscape mode. When the album service swipes up to switch to the desktop, the drawing direction of the wallpaper image sent by the rendering process received by the desktop service and the image displayed by the upper-level album service are both in landscape mode, while the desktop service blurs and mixes the horizontal wallpaper image in portrait mode, and the background "wallpaper image" of the desktop image presented is wrong. After the album service is switched to the desktop, the desktop service receives the vertical wallpaper image sent by the rendering process, and the desktop service draws the wallpaper image in vertical mode again, and the background "wallpaper image" of the desktop image presented is correct, which causes the wallpaper image to switch from an incorrect display state to a correct display state, resulting in a display defect in which the wallpaper image as the background flickers.

[0065] In this application, the first image received by the service from the rendering process is set to be in the first drawing direction, which does not change with the drawing direction of the image displayed by the upper layer service. For example, this disclosure sets the first drawing direction of the first image received by the service to be in the vertical direction.

[0066] In step S12, the first image is processed according to the first drawing direction and / or the second drawing direction when the first service draws the image.

[0067] The first drawing direction is the drawing direction of the first image itself sent by the rendering process; the second drawing direction is the drawing direction when the first service draws the first image.

[0068] The first drawing direction and the second drawing direction may be the same or different. When the first drawing direction and the second drawing direction received by the service are the same, the first image may be drawn in any one of the first drawing direction and the second drawing direction. When the first drawing direction and the second drawing direction are different, the first image in the first drawing direction may be rotated to the second image in the second drawing direction so as to be the same as the second drawing direction when the first service draws the image.

[0069] Through the above technical solution, the service can receive the first image of the first drawing direction sent by the rendering process, and then process the first image according to the first drawing direction and / or the second drawing direction, so that in the process of switching the horizontal screen display service from the horizontal screen state to the vertical screen state, the first service always performs fuzzy mixing on the first image in one direction, and there will be no situation where the fuzzy mixing is performed in the horizontal screen direction at the previous moment and the fuzzy mixing is performed in the vertical screen direction at the next moment, thereby avoiding the flickering problem of the first image used as the background when the first service displays the image.

[0070] The following describes a specific embodiment involved in the above step S12, which is used to explain the processing method when the first service only supports receiving the first image in the vertical screen state.

[0071] The first image is drawn in the second drawing direction. For example, the first service is a portrait service, and the first image is drawn in the second drawing direction supported by the portrait service. The portrait service refers to a service in which the displayed image is in a portrait state, and the second drawing direction is the same as the first drawing direction.

[0072] During the process of switching the second service from the horizontal screen state to the vertical screen state, the first image is drawn in the second drawing direction, the second service is different from the vertical screen service, and the first image is the background image when the vertical screen service displays an image.

[0073] The second service is the upper-layer service of the vertical screen service. For example, if the second service is the album service and the vertical screen service is the desktop service, when the album service swipes up to return to the desktop and switches from the horizontal screen state to the vertical screen state, the desktop service receives the wallpaper image drawn in the vertical direction sent by the rendering process. The wallpaper image is drawn in the vertical direction supported by the desktop service by default. When the album service is switched to the desktop, the desktop service still displays the vertical wallpaper image so that the entire wallpaper image is displayed in the vertical direction.

[0074] It is understandable that to solve the problem of flickering of the wallpaper image of the desktop image background, the present disclosure considers adopting the following two solutions.

[0075] The first method is to set the first image sent by the rendering process to be in a vertical direction. In this way, when different services receive the first image in a vertical direction, they can rotate the first image according to the state when they draw the image. For example, taking the first image as a wallpaper image and the first service as a desktop service, when the desktop service receives the first image in a vertical direction in the process of sliding back to the desktop on the album service, since the drawing direction of the desktop service is also in a vertical direction, there is no need to rotate the first image. The desktop service can directly perform fuzzy mixing on the first image in a vertical direction. Since the drawing direction of the desktop service and the display direction of the first image are both in a vertical direction, the first image is always fuzzy mixed in a vertical direction in the process of sliding back to the desktop on the album service, and there will be no situation where the first image is fuzzy mixed in a horizontal direction at the previous moment and fuzzy mixed in a vertical direction at the next moment, thereby avoiding the problem of flickering of the wallpaper image in the background of the desktop image.

[0076] The second method is not to set the direction of the first image sent by the rendering process. When different services receive the first image in a vertical direction, they rotate the first image according to the state when they draw the image. For example, taking the first image as a wallpaper image and the first service as a desktop service, if the user uses the album service in landscape mode, when the desktop service receives the horizontal first image while sliding back to the desktop on the album service, since the drawing direction of the desktop service is vertical, the first image needs to be rotated, and the horizontal first image is rotated to the vertical first image, and then the vertical first image is blurred and mixed. Since the horizontal first image is rotated, the desktop service always blurs and mixes the first image in a vertical direction while sliding back to the desktop on the album service, thereby avoiding the problem of flickering wallpaper image in the background of the desktop image.

[0077] The second method cannot be implemented because: when the first image is covered by the album image, the desktop service cannot identify whether the drawing direction of the first image sent by the rendering process is horizontal or vertical, so it is naturally impossible to decide whether to rotate the first image based on the state of its own image drawing, so the second method cannot be implemented.

[0078] The present disclosure considers using the first method, setting the drawing direction of the first image sent by the rendering process and the drawing direction when the desktop service draws the image to be vertical. In this way, the desktop service does not need to distinguish whether the first image sent by the rendering process is in a vertical direction, but directly draws the first image in the vertical direction when it draws the image itself. On the one hand, it avoids the desktop service from identifying the drawing direction of the first image, and on the other hand, it also solves the background flickering problem of the desktop image.

[0079] For related technologies, see Fig.11 As shown, before optimization, the rendering process sends the horizontal wallpaper image to the desktop service, and the desktop service draws the wallpaper image in a vertical direction, which causes the wallpaper image to flicker under the background of the desktop image displayed by the desktop service; after optimization, the rendering process sends the vertical wallpaper image to the desktop service, and the desktop service draws the wallpaper image in a vertical direction, which avoids the flickering problem of the wallpaper image as the background.

[0080] Through the above technical solution, for the portrait screen service that cannot distinguish whether the received first image is vertical or horizontal, the first image received by the portrait screen service will be set to be vertical, so when the portrait screen service blurs and mixes the first image in the vertical direction that it supports by default, no display error will occur; and in the process of the second service switching from the horizontal screen state to the vertical screen state, the portrait screen service always draws the first image in the vertical direction, so there will be no problem of flickering of the first image as the background.

[0081] The following describes a specific embodiment of step S12, which is used to explain the processing method when the first service supports both the vertical screen state and the horizontal screen state when the first image is received.

[0082] The first service may be a portrait service or a landscape service. The portrait service refers to a service in which an image displayed by the first service is in a portrait state, and the landscape service refers to a service in which an image displayed by the first service is in a landscape state.

[0083] For example, taking the first service as a drop-down interface service, since the drop-down interface service can display a drop-down interface image in a horizontal state or a vertical state, the image processing method of the drop-down interface service will be explained from the following two scenarios.

[0084] In the first scenario, the image displayed by the drop-down interface service is in a horizontal screen state. At this time, when the first drawing direction is perpendicular to the second drawing direction, the first image in the first drawing direction is rotated to the second image in the second drawing direction; and the second image is drawn in the second drawing direction.

[0085] When the first drawing direction is perpendicular to a second drawing direction supported by the drop-down interface service, the first image in the first drawing direction may be rotated into a second image in the second drawing direction, and the second image is a background image when the drop-down interface service displays an image.

[0086] Taking the pull-down interface service as the notification service, the first drawing direction is the vertical direction, and the second drawing direction is the horizontal direction as an example, if the user pulls down the notification page in the horizontal screen state, the notification service supports drawing the first image in the horizontal direction. Since this article has set the drawing direction of the first image sent to the service by the rendering process to be the vertical direction, the horizontal direction supported by the notification service is perpendicular to the vertical direction of the first image. At this time, the notification service will rotate the vertical first image into a horizontal second image, and the notification service will then perform fuzzy mixed color drawing processing on the horizontal second image in the horizontal drawing direction.

[0087] The above-mentioned rotation processing includes but is not limited to: rotation and mirroring processing.

[0088] For related technologies, see Fig.12 As shown, when the user pulls down the notification page in the horizontal screen state, the drawing direction of the first image received by the notification service is horizontal, so the notification service draws the first image in the horizontal direction supported by itself, and there will be no flickering problem.

[0089] In this disclosure, please refer to Fig.12 As shown, based on setting the drawing direction of the first image to be vertical, when the notification service receives the first image in a vertical direction, the first image will be rotated to obtain a horizontal second image, and then the horizontal second image will be drawn in a horizontal direction, thereby avoiding the flickering problem caused by setting the drawing direction of the first image to be vertical.

[0090] In the second scenario, the image displayed by the pull-down interface service is in a vertical screen state. At this time, when the first drawing direction is the same as the second drawing direction, the first image is drawn in the first drawing direction or the second drawing direction.

[0091] Taking the pull-down interface service as the notification service, the first drawing direction is the vertical direction, and the second drawing direction is the vertical direction as an example, if the user pulls down the notification page in the vertical screen state, the notification service supports drawing the first image in the vertical direction. Since this article has set the drawing direction of the first image sent to the service by the rendering process to be the vertical direction, the drawing direction supported by the notification service and the drawing direction of the first image are both the same vertical direction. At this time, the notification service will directly perform fuzzy mixed color drawing processing on the first image in the vertical direction.

[0092] For the drop-down interface service, the drop-down interface service can receive the wallpaper image, desktop image and software usage image sent by the rendering process, and then perform fuzzy mixed color drawing on the superimposed image, and use the fuzzy mixed color superimposed image as the background of the image displayed by the drop-down interface service, and finally project it onto the terminal screen for display through the rendering process.

[0093] It is understandable that the above-mentioned drop-down interface service can be a control center service in addition to a notification service, and the control center image displayed by the control center service is located above the notification image. The control center service is used to display the control center image, which displays the adjustment buttons of various controls of the terminal, such as brightness, volume, flashlight, network mode, etc.

[0094] Through the above technical solution, for the first service that can distinguish whether the image displayed by the service itself is in a horizontal or vertical state, after receiving the first image in a vertical direction, the first service can first determine whether the image state displayed by the first service itself is a horizontal or vertical state. If it is a horizontal state, the first vertical image is rotated into a horizontal second image; if it is a vertical state, the direction of the first image is not processed, thereby ensuring that the first service can always draw in the same direction when blurring and mixing the first image, avoiding the problem of background flickering.

[0095] Fig.13 is a block diagram of an image processing device according to an exemplary embodiment. Fig.13 The image processing device includes: a receiving module 1310 and a drawing module 1320.

[0096] The receiving module 1310 is configured to receive a first image in a first drawing direction sent by a rendering process;

[0097] The drawing module 1320 is configured to process the image according to the first drawing direction and / or the second drawing direction when drawing the image for the first service.

[0098] Optionally, the drawing module 1320 includes:

[0099] The first drawing submodule is configured to draw the first image in the second drawing direction, where the second drawing direction is the same as the first drawing direction.

[0100] Optionally, the first service is a vertical screen service, and the first drawing submodule includes:

[0101] The second drawing submodule is configured to draw the first image in a second drawing direction supported by the vertical screen service.

[0102] Optionally, the second drawing submodule includes:

[0103] The third drawing submodule is configured to draw the first image in the second drawing direction when the second service switches from the horizontal screen state to the vertical screen state, the second service is different from the vertical screen service, and the first image is the background image when the vertical screen service displays an image.

[0104] Optionally, the drawing module 1320 includes:

[0105] A first rotation submodule is configured to rotate the first image in the first drawing direction into a second image in the second drawing direction when the first drawing direction is perpendicular to the second drawing direction;

[0106] The fourth drawing submodule is configured to draw the second image in the second drawing direction.

[0107] Optionally, the first service is a horizontal screen service, and the first rotation submodule includes:

[0108] The second rotation submodule is configured to rotate the first image in the first drawing direction into a second image in the second drawing direction when the first drawing direction is perpendicular to a second drawing direction supported by the horizontal screen service, and the second image is a background image when the horizontal screen service displays an image.

[0109] Optionally, the drawing module 1320 includes:

[0110] The fifth drawing submodule is configured to draw the first image in the first drawing direction or the second drawing direction when the first drawing direction is the same as the second drawing direction.

[0111] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0112] The present disclosure also provides a computer-readable storage medium having computer program instructions stored thereon, and the program instructions, when executed by a processor, implement the steps of the image processing method provided by the present disclosure.

[0113] Fig.14 1 is a block diagram of an apparatus 1400 for image processing according to an exemplary embodiment. For example, the apparatus 1400 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0114] Reference Fig.14 , the device 1400 may include one or more of the following components: a processing component 1402 , a memory 1404 , a power component 1406 , a multimedia component 1408 , an audio component 1410 , an input / output interface 1412 , a sensor component 1414 , and a communication component 1416 .

[0115] The processing component 1402 generally controls the overall operation of the device 1400, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1402 may include one or more processors 1420 to execute instructions to complete all or part of the steps of the above-mentioned image processing method. In addition, the processing component 1402 may include one or more modules to facilitate the interaction between the processing component 1402 and other components. For example, the processing component 1402 may include a multimedia module to facilitate the interaction between the multimedia component 1408 and the processing component 1402.

[0116] The memory 1404 is configured to store various types of data to support operations on the device 1400. Examples of such data include instructions for any application or method operating on the device 1400, contact data, phone book data, messages, pictures, videos, etc. The memory 1404 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0117] The power supply component 1406 provides power to the various components of the device 1400. The power supply component 1406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 1400.

[0118] The multimedia component 1408 includes a screen that provides an output interface between the device 1400 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1408 includes a front camera and / or a rear camera. When the device 1400 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0119] The audio component 1410 is configured to output and / or input audio signals. For example, the audio component 1410 includes a microphone (MIC), and when the device 1400 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 1404 or sent via the communication component 1416. In some embodiments, the audio component 1410 also includes a speaker for outputting audio signals.

[0120] The input / output interface 1412 provides an interface between the processing component 1402 and the peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0121] The sensor assembly 1414 includes one or more sensors for providing various aspects of the status assessment of the device 1400. For example, the sensor assembly 1414 can detect the open / closed state of the device 1400, the relative positioning of components, such as the display and keypad of the device 1400, the sensor assembly 1414 can also detect the position change of the device 1400 or a component of the device 1400, the presence or absence of user contact with the device 1400, the orientation or acceleration / deceleration of the device 1400, and the temperature change of the device 1400. The sensor assembly 1414 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1414 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1414 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0122] The communication component 1416 is configured to facilitate wired or wireless communication between the device 1400 and other devices. The device 1400 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1416 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0123] In an exemplary embodiment, the device 1400 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned image processing method.

[0124] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1404 including instructions, and the instructions can be executed by a processor 1420 of the device 1400 to perform the above-mentioned image processing method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0125] In addition to being an independent electronic device, the above-mentioned device can also be a part of an independent electronic device. For example, in one embodiment, the device can be an integrated circuit (IC) or a chip, wherein the integrated circuit can be an IC or a collection of multiple ICs; the chip can include but is not limited to the following types: GPU (Graphics Processing Unit), CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), SOC (System on Chip, SoC), etc. The above-mentioned integrated circuit or chip can be used to execute executable instructions (or codes) to implement the above-mentioned image processing method. The executable instructions can be stored in the integrated circuit or chip, or can be obtained from other devices or equipment, such as the integrated circuit or chip includes a processor, a memory, and an interface for communicating with other devices. The executable instruction may be stored in the memory, and when the executable instruction is executed by the processor, the above-mentioned image processing method may be implemented; alternatively, the integrated circuit or chip may receive the executable instruction through the interface and transmit it to the processor for execution, so as to implement the above-mentioned image processing method.

[0126] In another exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program executable by a programmable device, and the computer program has a code portion for executing the above-mentioned image processing method when executed by the programmable device.

[0127] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0128] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An image processing method, characterized in that: include: Receive a first image of a first drawing direction sent by a rendering process; The first image is processed according to the first drawing direction and / or the second drawing direction when the first service draws the image.

2. The method according to claim 1, characterized in that: Processing the first image according to the second drawing direction includes: The first image is drawn in the second drawing direction, where the second drawing direction is the same as the first drawing direction.

3. The method according to claim 2, characterized in that The first service is a vertical screen service, and drawing the first image in the second drawing direction includes: The first image is drawn in a second drawing direction supported by the portrait screen service.

4. The method according to claim 2, characterized in that: Drawing the first image in a second drawing direction when drawing an image in the vertical screen service includes: During the process of switching the second service from the horizontal screen state to the vertical screen state, the first image is drawn in the second drawing direction, the second service is different from the vertical screen service, and the first image is the background image when the vertical screen service displays an image.

5. The method according to claim 1, characterized in that: Processing the first image according to the first drawing direction and a second drawing direction when the first service draws the image includes: When the first drawing direction is perpendicular to the second drawing direction, rotating the first image in the first drawing direction into a second image in the second drawing direction; The second image is drawn in the second drawing direction.

6. The method according to claim 4, characterized in that The first service is a horizontal screen service, and when the first drawing direction is perpendicular to the second drawing direction, rotating the first image in the first drawing direction to a second image in the second drawing direction includes: When the first drawing direction is perpendicular to a second drawing direction supported by the horizontal screen service, the first image in the first drawing direction is rotated into a second image in the second drawing direction, and the second image is a background image when the horizontal screen service displays an image.

7. The method according to claim 1, characterized in that The processing of the first image according to the first drawing direction and the second drawing direction when the first service draws the image includes: When the first drawing direction is the same as the second drawing direction, the first image is drawn in the first drawing direction or the second drawing direction.

8. An image processing device, characterized in that: include: A receiving module, configured to receive a first image in a first drawing direction sent by a rendering process; The drawing module is configured to process the image according to the first drawing direction and / or the second drawing direction when drawing the image for the first service.

9. A terminal, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: Execute the steps of any one of the methods of claims 1 to 7.

10. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the steps of the method described in any one of claims 1 to 7 are implemented.