Display method, device and storage medium
By obtaining the display content label of the display screen and determining the display mode, the display effect of the image color gamut and the screen color gamut in the existing technologies in the existing technology is solved, and the display effect is more optimized.
Patent Information
- Application Number
- CN202011163565.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-10-27
- Publication Date
- 2025-01-21
- Estimated Expiration
- 2040-10-27
AI Technical Summary
When the image gamut is inconsistent with the screen gamut, existing monitors need to perform color gamut conversion, resulting in unsatisfactory display effect. Even if the image color gamut is the same, the unified display mode cannot reflect the characteristics of the image, resulting in poor display effect.
By obtaining the display content label of the screen to be displayed, the display mode is determined, and the screen is displayed to the screen based on this mode. This method includes multiple steps: determine the display content label in the screen, determine the display mode according to the label, and apply the mode when displaying.
By selecting the appropriate display mode according to different image contents, the display effect of the image can be significantly improved, making it more consistent with the characteristics of the image content, and improving the ideality and effect of the display.
Smart Images

Figure CN112346686B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of display technology, and in particular to a display method, device and storage medium. Background Art
[0002] At present, monitors support multiple display modes. When the image color gamut is inconsistent with the monitor's screen color gamut, the corresponding color gamut conversion will be performed, and the image will be sent to the screen for display after the conversion. However, if the image color gamut is consistent with the monitor's screen color gamut, images with the same color gamut will not be distinguished when displayed on the monitor, and will be sent to the monitor for display in the same display mode. In this way, even if the image color gamut is the same, there will be differences between images, and if they are all displayed in the same display mode, the display effect will still be unsatisfactory. Summary of the invention
[0003] The present disclosure provides a display method, a device and a storage medium.
[0004] According to a first aspect of an embodiment of the present disclosure, there is provided a display method, which is applied to an electronic device, comprising:
[0005] Determine a picture to be displayed, and obtain a display content label included in the picture to be displayed;
[0006] Determining a display mode of the picture to be displayed according to the display content label;
[0007] Based on the display mode, the picture to be displayed is adaptively displayed.
[0008] Optionally, the method further comprises:
[0009] Determine the display content label included in the picture to be displayed.
[0010] Optionally, the picture to be displayed is synthesized from a plurality of layers; wherein some of the plurality of layers contain layer images;
[0011] The step of determining the display content label included in the picture to be displayed includes:
[0012] Determine the display content label of the layer image included in the picture to be displayed.
[0013] Optionally, the determining of a display content label of the layer image included in the picture to be displayed includes one of the following:
[0014] Using an image acquisition module of an electronic device to acquire the layer image, and performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result;
[0015] Receiving an analysis result returned by the cloud server after performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result;
[0016] The layer image is subjected to content analysis by a processing module of the electronic device, and a display content label of the layer image is determined based on an analysis result of the analysis.
[0017] Optionally, the method further comprises:
[0018] When displaying the picture to be displayed, adding the display content label to the layer corresponding to the layer image;
[0019] The step of determining the display mode of the picture to be displayed according to the display content tag includes:
[0020] The display mode of the picture to be displayed is determined according to the display content label of each of the layers.
[0021] Optionally, determining the display mode of the to-be-displayed picture according to the display content label of each of the layers includes:
[0022] Determining the priority of the display content label of each layer according to the display content contained in the layer image;
[0023] The display mode corresponding to the display content tag with the highest priority is used to determine the display mode of the picture to be displayed.
[0024] Optionally, the method further comprises:
[0025] storing the display content tag in the file format tag of the layer image;
[0026] The obtaining of the display content label contained in the to-be-displayed picture includes:
[0027] The display content tag is obtained based on the analysis of the file format tag of each layer image.
[0028] Optionally, the file format tag further includes: an image color gamut tag;
[0029] Determining the display mode of the to-be-displayed picture according to the display content label also includes:
[0030] A display mode of the picture to be displayed is determined according to the display content label and the image color gamut label.
[0031] According to a second aspect of an embodiment of the present disclosure, there is provided an image display device, which is applied to an electronic device, including:
[0032] A first determining module, used to determine a picture to be displayed, and obtain a display content label included in the picture to be displayed;
[0033] A second determining module, used to determine the display mode of the to-be-displayed picture according to the display content label;
[0034] The display module is used to adaptively display the picture to be displayed based on the display mode.
[0035] Optionally, it also includes:
[0036] The third determining module is used to determine the display content label included in the picture to be displayed.
[0037] Optionally, the picture to be displayed is synthesized from a plurality of layers; wherein some of the plurality of layers contain layer images;
[0038] The third determining module comprises:
[0039] The content label determination module is used to determine the display content label of the layer image contained in the picture to be displayed.
[0040] Optionally, the content tag determination module is further configured to perform one of the following:
[0041] Using an image acquisition module of an electronic device to acquire the layer image, and performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result;
[0042] Receiving an analysis result returned by the cloud server after performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result;
[0043] The layer image is subjected to content analysis by a processing module of the electronic device, and a display content label of the layer image is determined based on an analysis result of the analysis.
[0044] Optionally, it also includes:
[0045] An adding module, used for adding the display content label to the layer corresponding to the layer image when displaying the picture to be displayed;
[0046] The second determining module includes:
[0047] The display mode determination module is used to determine the display mode of the to-be-displayed picture according to the display content label of each layer.
[0048] Optionally, the display mode determination module includes:
[0049] A priority determination module, used to determine the priority of the display content label of each layer according to the display content contained in the layer image;
[0050] The display mode determination submodule is used to determine the display mode of the to-be-displayed picture according to the display mode corresponding to the display content label with the highest priority.
[0051] Optionally, it also includes:
[0052] A storage module, used for storing the display content tag in the file format tag of the layer image;
[0053] The first determining module is further used for:
[0054] The display content tag is obtained based on the analysis of the file format tag of each layer image.
[0055] Optionally, the file format tag also includes: an image color gamut tag;
[0056] The second determining module is further used for:
[0057] A display mode of the picture to be displayed is determined according to the display content label and the image color gamut label.
[0058] According to a third aspect of an embodiment of the present disclosure, there is provided a display device, including:
[0059] processor;
[0060] a memory for storing processor-executable instructions;
[0061] The processor is configured to: implement any one of the methods described in the first aspect above when executing the executable instructions stored in the memory.
[0062] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, can implement the steps of the method provided in any one of the first aspects above.
[0063] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:
[0064] The display method provided by the embodiment of the present disclosure determines the display mode of the picture to be displayed by acquiring the display content label obtained by analyzing the content contained in the picture to be displayed; and then adapts the display of the picture to be displayed based on the display mode. In this way, since the display content contained in different pictures to be displayed is different, after analyzing the display content, the display mode is selected according to the corresponding display content, so that the display effect presented by the picture to be displayed can be better. In addition, since the display content contained in the pictures to be displayed is different, the use of a unified display mode cannot reflect the characteristics of the picture, and matching the display mode according to the display content can achieve a more optimized display effect.
[0065] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0066] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0067] Figure 1 A flow chart of a display method according to an exemplary embodiment is shown. Figure 1 .
[0068] Figure 2 is a schematic diagram showing different types of images according to an exemplary embodiment.
[0069] Figure 3 A flow chart of a display method according to an exemplary embodiment is shown. Figure 2 .
[0070] Figure 4 A flow chart of a display method according to an exemplary embodiment is shown. Figure 3 .
[0071] Figure 5 It is a schematic structural diagram of a display device according to an exemplary embodiment.
[0072] Figure 6 is a block diagram of a display device according to an exemplary embodiment. DETAILED DESCRIPTION
[0073] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0074] The present disclosure provides a display method. Figure 1 is a flow chart of a display method according to an exemplary embodiment. Figure 1 As shown, the display method includes the following steps:
[0075] Step 101, determine the picture to be displayed, and obtain the display content label contained in the picture to be displayed;
[0076] Step 102, determining the display mode of the image to be displayed according to the display content label;
[0077] Step 103: Adapt the display of the image to be displayed based on the display mode.
[0078] It should be noted that the display method is applicable to any electronic device, which may be a smart phone, a tablet computer, a desktop computer or a digital camera.
[0079] In the embodiment of the present disclosure, the display mode of the picture to be displayed refers to: a display mode jointly determined by the image mode of the display and the adjustment mode of the platform side.
[0080] The electronic device is provided with a display, and the display supports multiple image modes, for example, an image mode of a LAB color space, or an image mode of a standard color space (SRGB). Based on corresponding control instructions, the display can be switched to different image modes for display.
[0081] When the display is displayed in different color gamut spaces, the display's image mode is different. Because the color gamut space will correspond to different image modes, and the saturation of each color will also be different, you can choose a more appropriate image mode to display according to the content characteristics of the image, so that you can optimize the final display effect of the picture.
[0082] The adjustment mode on the platform side refers to the mode in which the image to be displayed is adjusted according to the characteristics of the image to be displayed before it is sent to the display after being synthesized. Since it is an adjustment implemented on the platform side, it is called the adjustment mode on the platform side.
[0083] The platform includes: photo albums or various picture editors.
[0084] The adjustment mode on the platform side may be a mode obtained by adjusting the pixels contained in the image, for example, adjusting the pixel values contained in the image according to the set adjustment parameters.
[0085] In this way, the display in the embodiment of the present disclosure can be described as follows: before the picture to be displayed is sent to the display for display, a display adjustment is first performed on the platform side according to the display content contained therein, and after the adjustment, it is sent to the display with adjusted image mode for display.
[0086] For example, assuming that the display supports three image modes and there are four adjustment modes on the platform side, then according to the display content label contained in the picture to be displayed, there are 12 display modes determined to adapt the picture to be displayed.
[0087] As a specific example, assuming that the picture to be displayed is a picture containing an image of black people, then the type corresponding to the display content is a black-skinned person. If the image mode suitable for this type of display is image mode A, then based on image mode A and the black-skinned person, the display mode of the picture to be displayed is determined as: the black-skinned person skin color protection mode presented in image mode A.
[0088] It should be noted that in the embodiment of the present disclosure, the display mode of the screen to be displayed is determined according to the display content tag, which can be: parsing the display content tag to determine the type corresponding to the display content; determining the display mode according to the mapping relationship between the preset display content type and the display mode.
[0089] That is, the electronic device pre-stores a mapping relationship between the type of display content and the display mode. After obtaining the display content label, the corresponding display mode can be determined; then the corresponding functional components are controlled to execute adjustments to the image mode of the display and the adjustment mode of the display screen on the platform side, so that the corresponding display effect is presented when the display screen is displayed.
[0090] The mapping relationship between the type corresponding to the display content and the display mode can be preset. Specifically, it can be determined based on experimental data, that is, by scoring the display effects of images with different display contents in different display modes, the relatively optimal display mode can be found, and the display mode with the highest score is determined as the display mode that matches the type corresponding to the display content.
[0091] In this way, since the image already contains a display content tag for indicating the display content, in subsequent use, the display content tag can be directly parsed to determine the content type corresponding to the content information; the analysis is convenient and quick. In addition, the mapping relationship between the type corresponding to the display content and the display mode is pre-set, which can provide a prerequisite for the self-execution of the display mode selection and provide conditions for the convenience of display operation.
[0092] The picture to be displayed refers to the picture presented on the display of the electronic device. Specifically, the picture to be displayed is synthesized from multiple layers.
[0093] For example, if the electronic device is a smart phone, if a full-screen selfie of a person is displayed on the display of the smart phone, and if the selfie is taken from an album, then when the selfie is displayed in full screen, the displayed image should include: a status bar at the top, the selfie of the person in the middle that occupies most of the area, and a toolbar at the bottom. That is, the image to be displayed is synthesized by the status bar layer, the layer where the selfie of the person is located, and the toolbar layer.
[0094] Therefore, even if the selfie of the person is displayed in full screen, the picture presented will not be just a single selfie of the person. Therefore, when selecting a display mode according to the display content contained in the picture to be displayed, it can be comprehensively determined in combination with the composition content characteristics of the picture to be displayed.
[0095] For example, if the selfie of the person is displayed in full screen, the display mode can be determined based on the display content of the selfie of the person. For another example, if a certain image is displayed in half screen or a portion less than half screen, and most of the screen to be displayed is a wallpaper image, the display mode can be determined based on the display content of the wallpaper image. For another example, priorities can be set for image types of different layers on the screen to be displayed, and the display mode can be determined based on the priority order. The present disclosure does not limit this.
[0096] In the embodiment of the present disclosure, images are considered to be different types of images because they contain content of different types or different chromaticities. For example, Figure 2 is a schematic diagram showing different types of images according to an exemplary embodiment, such as Figure 2 As shown, in one embodiment, different types of images include: landscape images, person images, vehicle images, and the like.
[0097] In another embodiment, even if the images contain the same type of content, they can be considered as different types of images due to the difference in color of the content. Therefore, the same type of images can be divided into different sub-categories according to the content. For example, taking human images as an example, according to the skin color of the human, they can be divided into: white skin human images, black skin human images, brown skin human images or yellow skin human images.
[0098] For another example, based on a person image, the corresponding display content label may be: a person with skin color xx, and the display mode corresponding to the display content label may be: skin color protection mode. In the skin color protection mode, a display effect of "skin color protection" is added.
[0099] Here, since different images to be displayed may contain different display contents, for example, the colors and saturations of the landscape images and the human images to be displayed are different, if the same display mode is used for display, the characteristics of the two types of images may not be reflected. Specifically, if the same display mode is used, the color saturation of the landscape images may be insufficient, and the human images may be distorted in color. Moreover, even if they are all human images, due to the different skin colors of the included human beings, using the same display mode for display may still not achieve a good display effect. For example, if the same display mode is used to display images containing Caucasians and images containing Africans, there may be some distortion.
[0100] In the embodiment of the present disclosure, before displaying the picture to be displayed, the display content label contained in the picture to be displayed is first obtained, and the display mode to be selected for display is determined by the display content label, so as to achieve better display effects for different display contents.
[0101] The display content label refers to: an information label describing the content contained in the image, which is used to indicate the type of content contained in the image or the type of object contained in the image. For example, the display content label is used to indicate whether the image contains a person, an animal, a scene, or a vehicle. For another example, the display content label is also used to indicate the skin color of the person contained in the image.
[0102] In the disclosed embodiment, the display mode of the picture to be displayed is determined by obtaining the display content label of the content contained in the picture to be displayed, and then the picture to be displayed is adaptively displayed based on the display mode. In this way, since the display content contained in different pictures to be displayed is different, after analyzing the display content, the display mode is selected according to the corresponding display content, so that the display effect presented by the picture to be displayed can be better. In addition, since the display content contained in the pictures to be displayed is different, the use of a unified display mode cannot reflect the characteristics of the picture, and a more optimized display effect can be achieved by matching the display mode according to the display content.
[0103] In some embodiments, the method further comprises:
[0104] Determine the display content label included in the picture to be displayed.
[0105] That is, before obtaining the display content label, the display content label needs to be determined first.
[0106] The display content label may be determined by: determining the content contained in the image based on the recognition of the image, and then determining the display content label based on the content.
[0107] It should be noted that the image recognition can be performed by the electronic device, and after the display content label is determined in the electronic device, the display content label can be directly obtained. It can also be performed by other devices, that is, after other devices determine the display content label, the electronic device obtains the display content label.
[0108] Regarding the above: After the electronic device determines the display content label, the display content label can be directly obtained in the following manner:
[0109] For example, after image A is generated in the image acquisition module of electronic device M, the processing chip in the image acquisition module recognizes the content of image A based on a preset recognition model, and then generates a display content label of image A. At this time, electronic device M can directly obtain the display content label of image A. Alternatively, in the process of acquiring image A based on the image acquisition module of electronic device M, the content of image A is directly recognized and acquired, and then the processor of electronic device M obtains the display content label of image A according to the content of image A.
[0110] Other devices can be: cloud servers or third-party electronic devices.
[0111] It should also be noted that after the display content tag is generated, it will be written into the exchangeable image file (EXIF) tag of the image.
[0112] The EXIF tag is tag information located in the Joint Photographic Experts Group (JPEG) / Tagged Image File Format (TIFF) image file, that is, a set of shooting parameters embedded in the JPEG / TIFF image file format, which is used to record the attribute information and shooting data of the image. When it is necessary to obtain the display content tag, the display content tag is obtained by reading the EXIF tag.
[0113] In some embodiments, the picture to be displayed is synthesized from multiple layers; wherein some of the multiple layers contain layer images.
[0114] As mentioned above, even if the person's selfie is displayed in full screen, the picture presented will not be just the person's selfie alone, but will generally be a composite of the status bar layer, the layer where the person's selfie is located, and the toolbar layer.
[0115] Depending on the different layers during synthesis, some layers may contain images (such as a wallpaper layer containing a wallpaper image); while some layers may contain some control icons (such as an icon indicating a signal). When a layer contains an image, the present disclosure refers to the image as a layer image.
[0116] The step of determining the display content label included in the picture to be displayed includes:
[0117] Determine the display content label of the layer image in the picture to be displayed.
[0118] Here, since the picture to be displayed is a picture synthesized by multiple layers when it is displayed on an electronic device, in addition to the image to be displayed selected based on the user's touch operation (called the image on the target layer), there may be other images on the picture to be displayed; that is, in addition to the target layer, some layers may also contain images.
[0119] Thus, the display content label contained in the to-be-displayed picture is determined here, including:
[0120] Determine the display content label of the layer image in the picture to be displayed.
[0121] The display content tag contained in the screen to be displayed is obtained, including:
[0122] The display content label corresponding to the layer containing the image on the screen to be displayed is obtained. In this way, when selecting the display mode according to the display content contained in the screen to be displayed, it can be comprehensively determined in combination with the composition content characteristics of the screen to be displayed.
[0123] In some embodiments, the determining of the display content label of the layer image in the to-be-displayed image includes one of the following:
[0124] Using an image acquisition module of an electronic device to acquire the layer image, and performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result;
[0125] Receiving an analysis result returned by the cloud server after performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result;
[0126] The layer image is subjected to content analysis by a processing module of the electronic device, and a display content label of the layer image is determined based on an analysis result of the analysis.
[0127] In the disclosed embodiment, the display content label can be determined by the image acquisition module of the electronic device when the image is generated by performing content analysis. It can also be that the image acquisition module of the electronic device generates an image, and then transmits the image to the processing module of the electronic device, and the processing module performs content analysis on the layer image, and determines the display content label based on the analysis result. Furthermore, it can also be that the cloud server performs content analysis on the image, returns the analysis result, and the electronic device determines the display content label based on the analysis result.
[0128] It should be noted that the determination of the display content label by the image acquisition module or the processing module belongs to the above-mentioned generation of the display content label by the electronic device. For example, when electronic device A needs to display image A, since it needs to know the content contained in image A, when the image acquisition module of the electronic device acquires the image, it can identify and obtain the content of image A and then generate the display content label of image A. Alternatively, after the image acquisition module of the electronic device acquires the image, it sends it to the processor of the electronic device, and the processor performs content analysis on the image to generate the display content label.
[0129] Here, in order not to occupy system resources, when the electronic device generates the content, the image content analysis and the generation of the display content tag can be performed when the electronic device is relatively idle.
[0130] Furthermore, after image A is generated, electronic device B can identify the content of image A based on a preset recognition model, and then generate a display content tag for image A, and write the display content tag of A into the EXIF tag of image A. When image A needs to be displayed on electronic device A, electronic device A can scan the EXIF tag of image A to obtain the display content tag of image A.
[0131] Here, when the display content tag is generated by the cloud server, an image content analysis request may be sent to the cloud server.
[0132] The image content analysis request includes: the picture to be displayed.
[0133] When the electronic device W needs to display the to-be-displayed screen A, it needs to know the contents of the different layers of images contained in the to-be-displayed screen A. In order not to occupy the system resources of the electronic device W, it can send an image content analysis request to the cloud server, and the cloud server can identify the contents of the layer image and then generate a display content label for the layer image. The disclosed embodiment does not limit the method for determining the display content label.
[0134] Here, the cloud server needs to obtain the image before performing content analysis on the image.
[0135] The acquisition of the image may be that the electronic device generates the image and then sends it to the cloud server, so that the cloud server acquires the image. Alternatively, the electronic device sends the image identifier to the cloud server, and the cloud server finds the image from the stored gallery according to the identifier. This embodiment of the disclosure is not limited to this.
[0136] It should be noted that the recognition of the image to determine the content contained in the image can be achieved based on artificial intelligence (AI) recognition, that is, recognition is performed using a recognition model such as a neural network model. The present disclosure does not limit the execution model of image recognition.
[0137] In the above-mentioned solution for obtaining the display content label based on the electronic device itself, if a recognition model is deployed in the electronic device, the content of the layer image can be directly recognized based on the recognition model, and then the display content label of the layer image can be generated.
[0138] After obtaining the display content label corresponding to the picture to be displayed, the electronic device can determine the display mode to be adjusted according to the display content label, and then display the picture to be displayed based on the display mode.
[0139] In this way, the display method of the embodiment of the present disclosure can select a display mode according to the corresponding display content after analyzing the content of the picture to be displayed, so that the display effect of the picture to be displayed can be better. In addition, since the display content of the picture to be displayed is different, the use of a unified display mode cannot reflect the characteristics of the display content. The use of matching the display mode according to the display content can achieve a more optimized display effect.
[0140] In the disclosed embodiment, after obtaining the display content tag, since the display content tag indicates the content contained in the image, the display content tag can be directly parsed to determine the content information contained in the image. After determining the content information contained in the image, the type corresponding to the content information can be determined based on a preset classification strategy. There is a mapping relationship between the types corresponding to different display contents and different display modes.
[0141] The types corresponding to the displayed content can be divided according to the different displayed contents or different chromaticities. For example, the images corresponding to different types of displayed content include: landscape images, character images and vehicle images. Alternatively, they also include: Caucasian images, African images or yellow images.
[0142] In some embodiments, the display method further includes:
[0143] When displaying the picture to be displayed, the display content label is added to the layer corresponding to the layer image.
[0144] Here, as mentioned above, when a picture is displayed on a monitor, the picture that the user actually sees is not only the image itself, but also other layers. For example, when you open an image in a mobile phone album, you will often see a status bar at the top of the displayed page, as well as some operation buttons, etc. These contents together with the image itself constitute the picture that the user sees, that is, the picture that the user sees is composed of multiple layers.
[0145] Then, when it is necessary to parse the display content tag to determine the content information contained in the image, it is necessary to first determine the layer corresponding to the image and add the display content tag to the layer. In this way, since the graphics processing unit (GPU) in the electronic device can directly process the layer, the display mode can be directly switched to the corresponding display mode based on the display content tag on the layer.
[0146] Thus, based on the layer, determining the display mode of the to-be-displayed picture according to the display content label includes:
[0147] The display mode of the picture to be displayed is determined according to the display content label of each of the layers.
[0148] In this way, when displaying the picture to be displayed, since there is a synthesis of various layers, when performing layer synthesis, the display content label on the layer corresponding to the layer image can be read to determine the display mode, which provides a basis for the implementation of the display solution disclosed in the present invention.
[0149] In some embodiments, determining the display mode of the to-be-displayed picture according to the display content label of each of the layers includes:
[0150] Determining the priority of the display content label of each layer according to the display content contained in the layer image;
[0151] The display mode corresponding to the display content tag with the highest priority is used to determine the display mode of the picture to be displayed.
[0152] Here, since the picture to be displayed is synthesized from multiple layers, and when the picture to be displayed is displayed on an electronic device, the picture presented is a picture synthesized from multiple layers, and on the picture to be displayed, in addition to the display image selected based on the user's touch operation (called the image on the target layer), there may be other images; that is, in addition to the target layer, some layers may also contain images, for example, the wallpaper layer may contain a wallpaper image.
[0153] Then, before determining the display mode, priorities may be set for image types of different layers on the screen to be displayed, and the display mode may be determined according to the order of priorities.
[0154] For example, when the screen to be displayed is a desktop wallpaper image, and a person photo image selected based on the user's touch operation is superimposed, the priority corresponding to the display image selected based on the user's touch operation is higher than the priority of the wallpaper image. If the screen to be displayed is a desktop wallpaper image with multiple application icons superimposed on it, the priority of the wallpaper image is higher than the priority of the application icons.
[0155] As a specific example, suppose the picture to be displayed is: a sky scenery wallpaper image with an image of a black person superimposed on it, and if the display mode corresponding to the sky scenery wallpaper image alone is A, and the display mode corresponding to the black person image alone is B, when the priority of the black person image is higher, then the display mode corresponding to the picture to be displayed with the black person image superimposed on the sky scenery wallpaper image is B.
[0156] In some embodiments, the method further comprises:
[0157] The display content tag is stored in the file format tag of the layer image.
[0158] Here, the file format tag at least includes: an Exchangeable Image File (EXIF) tag, which is used to record various types of information of the image, such as attribute information, shooting data or color gamut information.
[0159] Since the EXIF tag is an extensible tag, more information about the image can be added to the EXIF tag as needed for recording. For example, if the embodiment of the present disclosure needs to adjust the display mode according to the content of the image, then after determining the content of the image, the content information contained in the image can be added to the EXIF tag of the image in the form of generating a display content tag.
[0160] In this way, based on the extensible attributes of the EXIF tag, the image content can be directly parsed, providing the possibility of adjusting the display mode according to the image content. Moreover, it is also relatively convenient in implementation.
[0161] In the embodiment of the present disclosure, the tag in the file format tag of the image that records the content information contained in the image is called: display content tag.
[0162] The file format tag is an inherent tag of the image and can be obtained by directly scanning the image.
[0163] Based on the file format tag, in the above step 101, obtaining the display content tag included in the to-be-displayed picture includes:
[0164] The display content tag is obtained based on the analysis of the file format tag of each layer image.
[0165] As mentioned above, since the file format tag includes the display content tag, and the file format tag is embedded in the JPEG / TIFF image file format, then after obtaining the picture to be displayed, each layer image in the picture to be displayed can be directly scanned to obtain the file format tag corresponding to each layer image, and then the file format tag can be parsed to obtain the display content tag for recording the content information contained in the image.
[0166] In this way, since the file format tag is an inherent tag of the image, the display content tag can be obtained directly based on the analysis of the file format tag of the image, which is relatively convenient to implement.
[0167] In some embodiments, the file format tag further includes: an image color gamut tag;
[0168] Determining the display mode of the to-be-displayed picture according to the display content label also includes:
[0169] A display mode of the picture to be displayed is determined according to the display content label and the image color gamut label.
[0170] Here, the image gamut tag is used to indicate the color gamut of the image.
[0171] That is, Figure 3 As shown, Figure 3 A flow chart of a display method according to an exemplary embodiment is shown. Figure 2 ,exist Figure 3 In the method, the method comprises:
[0172] Step 301, obtaining the file format label of each layer image in the picture to be displayed;
[0173] Step 302, based on parsing the file format tag, obtaining the display content tag of the layer image;
[0174] Step 303, determining a display mode of the image to be displayed according to the display content label and the image color gamut label;
[0175] Step 304: display the picture to be displayed based on the display mode.
[0176] Here, the file format tag includes: an image color gamut tag and a display content tag.
[0177] Different images may have different color gamuts, and when electronic devices present or output the same image, they may present different visual effects in different display modes. When the image is displayed in a display mode that matches the color gamut of the image, the display effect will be better.
[0178] For example, the display effect of the same picture on the computer of user A may be different from the display effect on the computer of user B, even if the brand, model and usage level of the computer of user A and the computer of user B are exactly the same. The difference in display effect is caused by the different display modes of the display. When the display mode of the display matches the color gamut of the image, the display effect of the image will be more ideal. Therefore, in some embodiments, the display mode can be determined according to the image color gamut label.
[0179] In the disclosed embodiment, even if the color gamut of image A and image B is the same (assuming that the color gamut is SRGB), the content between the images is different, and if both are displayed using the display mode corresponding to SRGB, the display effect will still be unsatisfactory. For example, image A is a landscape image, and image B is a person image. Even if the color gamut is the same, due to the different focus points of the content and the different saturation required by the content object, the same display mode may be used, and the display effect of the landscape image may be better, while the effect of the person image may be affected to a certain extent.
[0180] In this way, the embodiment of the present disclosure determines the display mode of the display according to the display content label and the image color gamut label, thereby achieving a more accurate division of the display mode corresponding to the image.
[0181] It should be noted that when the display mode is determined according to the display content label and the image color gamut label, the display mode can be further subdivided. For example, the previous display mode may be display mode a corresponding to color gamut A, and now the display mode can be differentiated into: display mode a1 corresponding to color gamut A and landscape, and display mode a2 corresponding to color gamut A and yellow people.
[0182] In this way, based on the color gamut and in combination with the image content, a display mode that is more in line with the image content can be determined, which facilitates the improvement of the image display effect.
[0183] It should also be noted that in the solution of determining the display mode based on the display content tag and the image color gamut tag, the priority of the image color gamut tag is set higher. That is, when there is a conflict between the display mode determined based on the display content tag and the display mode determined based on the image color gamut tag, the display mode determined by the image color gamut tag is determined as the final display mode.
[0184] Under normal circumstances, in the scheme of determining the display mode based on the display content label and the image color gamut label, a display mode with a larger range is first determined based on the image color gamut label, and then in the display mode with a larger range, a subdivided display mode is further determined based on the display content label, thereby obtaining the final display mode.
[0185] In some embodiments, after step 101, the display method further includes:
[0186] If the layer image includes multiple objects, determining a focus object based on analysis of the multiple objects;
[0187] The display content label corresponding to the type to which the focus object belongs is determined as the display content label of the layer image.
[0188] Here, the focus object refers to the main object in the image.
[0189] For example, when an image contains people and scenery, there may be two corresponding display content labels. If the area of the portrait is smaller than the area threshold and / or the face does not meet the clarity requirements, the sky can be considered as the focus object; if the area of the portrait is larger than the area threshold and / or the face meets the clarity requirements, the portrait can be considered as the focus object.
[0190] In one embodiment, determining a focus object based on analysis of multiple objects includes:
[0191] A focus object is determined based on the number of pixels corresponding to each object included in the image.
[0192] That is, in the same image, different objects may occupy different numbers of pixels in the formed image due to their different position distributions. Generally, the object that occupies a larger number of pixels is the focus object.
[0193] In another embodiment, determining the focus object based on the analysis of each object contained in the image further includes:
[0194] Based on the number of pixels in the image containing multiple objects, a focus object is determined.
[0195] For example, when an image is composed of a portrait and the sky, and the portrait is very small in the image and the number of pixels corresponding to the sky is large, then it can be considered that the sky is the content that occupies more pixels, and the display content label corresponding to the sky is the final display content label.
[0196] In other embodiments, the method further comprises:
[0197] Determining whether the image contains a human portrait;
[0198] If a portrait is included, determining whether the clarity of the portrait is higher than a preset threshold;
[0199] If the clarity of the portrait is higher than a preset threshold, the display content label corresponding to the portrait is determined as the display content label of the image.
[0200] That is, if the portrait area is relatively large, the face can be seen clearly. Even if the sky occupies more pixels in the image, the focus object of the image is considered to be the person, and the display content label of the image is determined to be the display content label corresponding to the portrait.
[0201] The present disclosure also provides the following embodiments:
[0202] At present, images with the same color gamut are displayed with the same display effect without any distinction. However, electronic devices are capable of adjusting the display effect before sending the image to the display. For example, if the image has a display content tag such as skin color protection, then the matching skin color display effect can be selected and switched to before sending it to the display based on the "skin color" tag, thereby achieving a more optimized and reasonable display effect.
[0203] Figure 4 A flow chart of a display method according to an exemplary embodiment is shown. Figure 3 ,like Figure 4 As shown, the method includes:
[0204] Step 401, determining whether a display content tag corresponds to the image to be displayed when it is generated.
[0205] If yes, go to step 404; if no, go to step 402.
[0206] Step 402, determining whether the cloud server sends a display content tag corresponding to the picture to be displayed.
[0207] If yes, go to step 404; if no, go to step 403.
[0208] Step 403: determine whether the electronic device has performed content analysis on the image to be displayed and generated a display content tag.
[0209] If yes, go to step 404, if no, end.
[0210] Here, the following three strategies can be used to obtain the display content label:
[0211] A. When an image is produced (such as taking a photo with a camera), the content analysis result of the image is obtained, and then a display content label is generated. B. The electronic device interacts with the cloud server, and the cloud server performs content analysis on the image, and then generates a display content label. C. The electronic device uses a relatively low-complexity analysis algorithm to perform content analysis on the image when idle and generate a display content label.
[0212] Step 404: store the displayed content tag into the EXIF tag of the image.
[0213] After obtaining the display content tag, the display content tag is stored in the EXIF tag of the image.
[0214] The displayed content tags may include tags about scenery or tags about the race of a person, etc.
[0215] Step 405, when a display instruction is detected, the EXIF tag is read to obtain a display content tag, and the display content tag is added to the corresponding layer.
[0216] When the image is displayed, the display content tag will be passed to the corresponding layer.
[0217] Step 406, when synthesizing the layers, according to the display content tag on the corresponding layer, the display mode is adjusted to the display mode corresponding to the display content tag.
[0218] For example, a yellow race label is detected on a layer, and the yellow race skin color protection mode is turned on.
[0219] Step 407, executing display of the picture to be displayed.
[0220] In this way, the display method provided by the embodiment of the present disclosure determines the display mode by acquiring the display content label obtained by analyzing the content contained in the screen to be displayed; and then displays the screen to be displayed based on the display mode. In this way, since the contents contained in different screens to be displayed are different, after analyzing the contents of the screen to be displayed, the display mode is selected according to the corresponding display content, so that the display effect of the screen to be displayed can be better. In addition, since the display contents contained in the screen to be displayed are different, the use of a unified display mode cannot reflect the characteristics of the image, and a more optimized display effect can be achieved by matching the display mode according to the display content. The image has a display content label, and the display mode and display effect can be adaptively adjusted when it is displayed. Thereby, the final display effect is made more reasonable, avoiding the disadvantage of a one-size-fits-all display effect for all images in the same color domain.
[0221] Figure 5 is a schematic structural diagram of a display device according to an exemplary embodiment. Figure 5 As shown, the display device 500 includes:
[0222] The first determining module 501 is used to determine a picture to be displayed and obtain a display content label included in the picture to be displayed;
[0223] A second determining module 502, configured to determine a display mode of the to-be-displayed picture according to the display content tag;
[0224] The display module 503 is used to adaptively display the picture to be displayed based on the display mode.
[0225] In some embodiments, the display device further includes:
[0226] The third determining module is used to determine the display content label included in the picture to be displayed.
[0227] In some embodiments, the image to be displayed is synthesized from multiple layers; wherein some of the multiple layers contain layer images;
[0228] The third determining module comprises:
[0229] The content label determination module is used to determine the display content label of the layer image in the picture to be displayed.
[0230] In some embodiments, the content tag determination module is further configured to perform one of the following:
[0231] Using an image acquisition module of an electronic device to acquire the layer image, and performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result;
[0232] Receiving an analysis result returned by the cloud server after performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result;
[0233] The layer image is subjected to content analysis by a processing module of the electronic device, and a display content label of the layer image is determined based on an analysis result of the analysis.
[0234] In some embodiments, it also includes:
[0235] An adding module, used for adding the display content label to the layer corresponding to the layer image when displaying the picture to be displayed;
[0236] The second determining module includes:
[0237] The display mode determination module is used to determine the display mode of the to-be-displayed picture according to the display content label of each layer.
[0238] In some embodiments, the display mode determination module includes:
[0239] A priority determination module, used to determine the priority of the display content label of each layer according to the display content contained in the layer image;
[0240] The display mode determination submodule is used to determine the display mode of the to-be-displayed picture according to the display mode corresponding to the display content label with the highest priority.
[0241] In some embodiments, it also includes:
[0242] A storage module, used for storing the display content tag in the file format tag of the layer image;
[0243] The first determining module is further used for:
[0244] The display content tag is obtained based on the analysis of the file format tag of each layer image.
[0245] In some embodiments, the file format tag also includes: an image color gamut tag;
[0246] The second determining module is further used for:
[0247] The display mode of the image to be displayed is determined according to the display content label and the image color gamut label. Regarding the device in the above embodiment, the specific way in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0248] Figure 6 1 is a block diagram of a display device 1800 according to an exemplary embodiment. For example, the device 1800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0249] Reference Figure 6 , the device 1800 may include one or more of the following components: a processing component 1802 , a memory 1804 , a power component 1806 , a multimedia component 1808 , an audio component 1810 , an input / output (I / O) interface 1812 , a sensor component 1814 , and a communication component 1816 .
[0250] The processing component 1802 generally controls the overall operation of the device 1800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1802 may include one or more processors 1820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 1802 may also include one or more modules to facilitate the interaction between the processing component 1802 and other components. For example, the processing component 1802 may include a multimedia module to facilitate the interaction between the multimedia component 1808 and the processing component 1802.
[0251] The memory 1804 is configured to store various types of data to support operations on the device 1800. Examples of such data include instructions for any application or method operating on the device 1800, contact data, phone book data, messages, images, videos, etc. The memory 1804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.
[0252] The power component 1806 provides power to the various components of the device 1800. The power component 1806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 1800.
[0253] The multimedia component 1808 includes a screen that provides an output interface between the device 1800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1808 includes a front camera and / or a rear camera. When the device 1800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and / or the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
[0254] The audio component 1810 is configured to output and / or input audio signals. For example, the audio component 1810 includes a microphone (MIC), and when the device 1800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 1804 or sent via the communication component 1816. In some embodiments, the audio component 1810 also includes a speaker for outputting audio signals.
[0255] I / O interface 1812 provides an interface between processing component 1802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.
[0256] The sensor assembly 1814 includes one or more sensors for providing various aspects of the status assessment of the device 1800. For example, the sensor assembly 1814 can detect the open / closed state of the device 1800, the relative positioning of components, such as the display and keypad of the device 1800, the sensor assembly 1814 can also detect the position change of the device 1800 or a component of the device 1800, the presence or absence of user contact with the device 1800, the orientation or acceleration / deceleration of the device 1800, and the temperature change of the device 1800. The sensor assembly 1814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0257] The communication component 1816 is configured to facilitate wired or wireless communication between the device 1800 and other devices. The device 1800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology or other technologies.
[0258] In an exemplary embodiment, the device 1800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned methods.
[0259] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1804 including instructions, and the instructions can be executed by a processor 1820 of the device 1800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0260] A non-transitory computer-readable storage medium enables the above display method to be performed when instructions in the storage medium are executed by a processor.
[0261] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the appended claims.
[0262] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A display method, characterized in that: Used in electronic equipment, including: Determine a picture to be displayed, wherein the picture to be displayed is synthesized from a plurality of layers; wherein some of the plurality of layers contain layer images; Obtaining a display content label of the layer image included in the picture to be displayed; Determining a display mode of the picture to be displayed according to the display content label and the image color gamut label of the picture to be displayed; Based on the display mode, the picture to be displayed is adaptively displayed.
2. The method according to claim 1, characterized in that: The method further comprises: Determine the display content label of the layer image included in the picture to be displayed.
3. The method according to claim 2, characterized in that: The step of determining the display content label of the layer image contained in the picture to be displayed includes one of the following: Using an image acquisition module of an electronic device to acquire the layer image, and performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result; Receiving an analysis result returned by the cloud server after performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result; The layer image is subjected to content analysis by a processing module of the electronic device, and a display content label of the layer image is determined based on an analysis result of the analysis.
4. The method according to claim 2, characterized in that: The method further comprises: When displaying the picture to be displayed, adding the display content label to the layer corresponding to the layer image; The step of determining the display mode of the picture to be displayed according to the display content label and the image color gamut label of the picture to be displayed includes: The display mode of the picture to be displayed is determined according to the display content label of each of the layers and the image color gamut label of the picture to be displayed.
5. The method according to claim 4, characterized in that The step of determining the display mode of the picture to be displayed according to the display content labels of each layer and the image color gamut label of the picture to be displayed comprises: Determining the priority of the display content label of each layer according to the display content contained in the layer image; The display mode of the picture to be displayed is determined based on the display content label with the highest priority and the image color gamut label of the picture to be displayed.
6. The method according to claim 2, characterized in that The method further comprises: storing the display content tag in the file format tag of the layer image; wherein the image color gamut tag is located in the file format tag; The acquiring of the display content label obtained by analyzing the content included in the picture to be displayed includes: The display content tag is obtained based on the analysis of the file format tag of each layer image.
7. A display device, characterized in that: Used in electronic equipment, including: A first determination module is used to determine a picture to be displayed, wherein the picture to be displayed is synthesized from multiple layers; wherein some of the multiple layers contain layer images; and obtain a display content label of the layer images contained in the picture to be displayed; A second determination module, configured to determine a display mode of the picture to be displayed according to the display content label and the image color gamut label of the picture to be displayed; The display module is used to adaptively display the picture to be displayed based on the display mode.
8. The device according to claim 7, characterized in that Also includes: The content label determination module is used to determine the display content label of the layer image contained in the picture to be displayed.
9. The device according to claim 8, characterized in that The content tag determination module is further configured to perform one of the following: Using an image acquisition module of an electronic device to acquire the layer image, and performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result; Receiving an analysis result returned by the cloud server after performing content analysis on the layer image, and determining a display content label of the layer image based on the analysis result; The layer image is subjected to content analysis by a processing module of the electronic device, and a display content label of the layer image is determined based on an analysis result of the analysis.
10. The device according to claim 8, characterized in that Also includes: An adding module, used for adding the display content label to the layer corresponding to the layer image when displaying the picture to be displayed; The second determining module includes: The display mode determination module is used to determine the display mode of the picture to be displayed according to the display content label of each layer and the image color gamut label of the picture to be displayed.
11. The device according to claim 10, characterized in that The display mode determination module comprises: A priority determination module, used to determine the priority of the display content label of each layer according to the display content contained in the layer image; The display mode determination submodule is used to determine the display mode of the picture to be displayed based on the display content label with the highest priority and the image color gamut label of the picture to be displayed.
12. The device according to claim 8, characterized in that Also includes: A storage module, used for storing the display content tag in the file format tag of the layer image; wherein the image color gamut tag is located in the file format tag; The first determining module is further used for: The display content tag is obtained based on the analysis of the file format tag of each layer image.
13. A display device, characterized in that: include: A processor and a memory for storing executable instructions capable of running on the processor, wherein: When the processor is used to run the executable instructions, the executable instructions execute the steps in the method provided in any one of claims 1 to 6 above.
14. A non-transitory computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the steps of the method provided in any one of claims 1 to 6.
Citation Information
Patent Citations
Display method and electronic equipment
CN106201398A
Image display method and device, pan / tilt, and storage medium
CN110709813A