A display method, apparatus and electronic device

Abstract

The application discloses a display method, device and electronic equipment, and relates to the technical field of information display and human-computer interaction. The method comprises the following steps: in response to a first visual change of a desktop image of an electronic device, a first visual parameter is obtained; in response to the first visual parameter meeting a condition, a second visual parameter is determined according to the first visual change; the condition that the first visual parameter meets represents that at least part of the first visual change cannot be visually identified; rendering is performed based on the second visual parameter, and a second visual change is presented; wherein the first visual change and the second visual change are at least partially the same.

Description

Technical Field

[0001] This application relates to the field of information display and human-computer interaction technology, and in particular to a display method, device and electronic device. Background Technology

[0002] Desktop images, such as wallpapers, on electronic devices can personalize and customize the interface, breaking away from the monotonous default system background. While desktop images can change dynamically, in some cases, users may fail to perceive at least some of the visual changes, thus impacting the user experience. Summary of the Invention

[0003] Therefore, this application discloses the following technical solution:

[0004] A display method, comprising:

[0005] In response to a first visual change in the desktop image of an electronic device, obtain the first visual parameters;

[0006] In response to the condition that the first visual parameter is satisfied, a second visual parameter is determined based on the first visual change; the condition that the first visual parameter is satisfied indicates that at least part of the first visual change cannot be visually recognized.

[0007] Rendering is performed based on the second visual parameters to present the second visual change;

[0008] The first visual change is at least partially the same as the second visual change.

[0009] Optionally, in response to the first visual parameter satisfying a condition, determining a second visual parameter based on the first visual change includes:

[0010] In response to the first visual parameter characterizing the degree to which the visual change of the target object in the desktop image is occluded by the upper display object reaching a threshold, the visual change information of the target object is extracted from the first visual change;

[0011] The second visual parameter includes visual change information of the target object.

[0012] Optionally, the visual change information of the target object includes the image content and location information of the target object at different times;

[0013] Rendering is performed based on the second visual parameters to present a second visual change, including:

[0014] Rendering is performed based on the image content and location information of the target object at different times to obtain the rendering result;

[0015] Based on the rendering results, the image content of the target object at different times is presented at the corresponding position on the upper display object, so that the image content of the target object presented on the upper display object is the same as the image content of the target object in the desktop image; the corresponding position is determined based on the position information.

[0016] Optionally, in response to the first visual parameter satisfying a condition, determining a second visual parameter based on the first visual change includes:

[0017] Based on the first visual parameter characterizing that the visual changes of the target object in the desktop image cannot be visually perceived by the current target feature user, the visual change information of the target object is extracted from the first visual change.

[0018] The visual change information of the target object is enhanced to obtain enhanced visual change information;

[0019] The second visual parameter includes the enhanced visual change information.

[0020] Optionally, the enhanced visual change information includes the image content and location information of the enhanced target object at different times;

[0021] Rendering is performed based on the second visual parameters to present a second visual change, including:

[0022] Rendering is performed based on the enhanced image content and location information of the target object at different times to obtain the rendering result;

[0023] Based on the rendering results, the enhanced image content of the target object at different times is presented at the corresponding position of the desktop image, so that at least one attribute of the target object presented on the desktop image changes; the corresponding position is determined based on the position information.

[0024] Optionally, the display method further includes at least one of the following:

[0025] Identify display objects in the desktop image whose visual features and / or content attributes satisfy the focus condition to obtain the main object in the desktop image;

[0026] Identify the display objects in the additional layers of the desktop image to obtain the additional display objects;

[0027] The target object includes the main object and / or the additional display object.

[0028] Optionally, rendering is performed based on the second visual parameters to present a second visual change, including at least one of the following:

[0029] In response to the first visual parameter characterizing the degree to which the visual change of the main object in the desktop image is occluded by the upper display object, a threshold is reached, rendering is performed based on the visual change information of the main object, and the visual change of the main object is superimposed on the upper display object based on the rendering result;

[0030] Rendering is performed based on the visual change information of the additional display object, and based on the rendering result, the additional display object is adjusted from its layer in the desktop image to be above the upper display object, so as to display the additional display object on the upper display object.

[0031] Optionally, before obtaining the first visual parameters, the display method further includes:

[0032] In response to the electronic device being in a first state and / or the user of the electronic device being in a second state, the acquisition of the first visual parameter is avoided to prevent the presentation of the second visual change;

[0033] The first state and the second state are used to characterize that the user currently meets the target usage characteristics of the electronic device, and the target usage characteristics are the characteristics that meet the conditions among a variety of usage characteristics of the electronic device.

[0034] A display device, comprising:

[0035] The acquisition module is used to obtain first visual parameters in response to a first visual change in the desktop image of the electronic device;

[0036] A determining module is configured to determine a second visual parameter based on the first visual change in response to the first visual parameter satisfying a condition; the first visual parameter satisfying a condition indicates that at least a portion of the first visual change cannot be visually recognized.

[0037] The display module is used to render based on the second visual parameters to present the second visual change;

[0038] The first visual change is at least partially the same as the second visual change.

[0039] An electronic device, comprising:

[0040] Memory, used to store at least one set of computer instructions;

[0041] A processor is configured to perform the following processing by executing a set of instructions stored in the memory:

[0042] In response to a first visual change in the desktop image of an electronic device, obtain the first visual parameters;

[0043] In response to the condition that the first visual parameter is satisfied, a second visual parameter is determined based on the first visual change; the condition that the first visual parameter is satisfied indicates that at least part of the first visual change cannot be visually recognized.

[0044] Rendering is performed based on the second visual parameters to present the second visual change;

[0045] The first visual change is at least partially the same as the second visual change.

[0046] A storage medium carrying one or more computer instruction sets, which, when executed by an electronic device, enable the electronic device to implement any of the display methods provided above. Attached Figure Description

[0047] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0048] Figure 1 This is a flowchart illustrating one of the display methods provided in this application;

[0049] Figure 2(a) and Figure 2(b) are different examples of desktop images provided in this application;

[0050] Figure 3 This is another flowchart illustrating the display method provided in this application;

[0051] Figure 4 This is another flowchart illustrating the display method provided in this application;

[0052] Figure 5 This application provides an example of displaying visual changes of a main object in a desktop image on an active window;

[0053] Figure 6 This is another flowchart illustrating the display method provided in this application;

[0054] Figure 7 This is another flowchart illustrating the display method provided in this application;

[0055] Figure 8 This is a comparison image of the visual effects of a target object in a desktop image before and after enhancement, provided in this application.

[0056] Figure 9This is a structural diagram of the display device provided in this application;

[0057] Figure 10 This is a structural diagram of the electronic device provided in this application. Detailed Implementation

[0058] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0059] This application provides a display method, apparatus, and electronic device. The provided method can be applied to electronic devices in a variety of general or special computing device environments or configurations, such as personal computers, smart terminals, handheld or portable devices, tablet devices, etc.

[0060] See Figure 1 The flowchart shown in this application illustrates the display method provided in this embodiment, which may include steps 101 to 103 as described below. These steps will be described in detail below.

[0061] Step 101: Respond to the first visual change in the desktop image of the electronic device and obtain the first visual parameters.

[0062] Desktop images for electronic devices, which may include, but are not limited to, desktop wallpapers.

[0063] Desktop wallpapers and other desktop images allow users to use their favorite pictures (such as landscapes, anime, artwork, pets, or family photos) as screen backgrounds, making the interface of electronic devices more personalized and unique, and getting rid of the monotonous default system background.

[0064] Desktop images can be dynamically changing, such as rotating multiple images at set intervals to create a changing visual effect, or objects in the same wallpaper having dynamic changing characteristics.

[0065] The desktop image of an electronic device has its own image content, such as a hummingbird flying in a forest or a horse galloping on a grassland. In addition, optionally, the desktop image may also carry display objects in an additional layer on top of it. In this embodiment of the application, the display objects in the additional layer are referred to as additional display objects of the desktop image. In a broader sense, additional display objects can also be a component of the desktop image.

[0066] Additional display objects can be used, but are not limited to, to carry additional information such as time, location, weather, mood, zodiac sign, and holidays in additional layers of a desktop image.

[0067] See the examples in Figures 2(a)-2(b). The desktop image in Figure 2(a) includes its own image content "hummingbird flying in the forest", while the desktop image in Figure 2(b) includes its own image content "galloping horse" as well as additional display objects such as time, holidays, and constellations.

[0068] The first visual change occurring on the desktop image of an electronic device may include, but is not limited to, at least one of the following:

[0069] a. The desktop image on the electronic device changes.

[0070] For example, switching from the current desktop wallpaper to the next wallpaper.

[0071] b. At least part of the image content of the same desktop image changes.

[0072] For example, desktop wallpapers might depict hummingbirds changing their flight direction or horses speeding up their runs.

[0073] c. Additional display objects in the same desktop image change.

[0074] For example, adding or removing additional display objects in the desktop wallpaper, or changing the information content (such as time, mood) of existing additional display objects.

[0075] The first visual parameter refers to the actual visual parameters of the electronic device's interface during the display process when the desktop image of the electronic device undergoes a first visual change. This includes, but is not limited to, the color, texture, display position, and / or change rate of the desktop image's own image content and / or attached display objects on the display screen during the first visual change, as well as the color, size, and display position of the upper-level display objects (such as application windows) of the desktop image.

[0076] Step 102: In response to the condition that the first visual parameter is satisfied, determine the second visual parameter based on the first visual change.

[0077] Wherein, the first visual parameter satisfies the condition that at least a portion of the first visual change cannot be visually recognized. The fact that at least a portion of the first visual change cannot be visually recognized includes, but is not limited to, at least a portion of the first visual change being occluded, or at least a portion of the first visual change being visually indistinct / not significant enough to be recognized by the user of the electronic device or the user of the target characteristic (such as people with color blindness / color impairment).

[0078] The first visual change is at least partially the same as the second visual change.

[0079] The second visual parameter is used to characterize the visual changes corresponding to the at least part of the first visual change that cannot be visually recognized. It may include the visual parameters corresponding to the at least part of the first visual change that cannot be visually recognized, or the visual parameters obtained after processing the visual parameters corresponding to the at least part (such as image enhancement).

[0080] In response to the condition that the first visual parameter is satisfied, this step determines a second visual parameter based on the first visual change, so as to characterize the visual changes corresponding to the at least part of the first visual change that cannot be visually recognized based on the second visual parameter.

[0081] Step 103: Render based on the second visual parameters to present a second visual change; wherein the first visual change and the second visual change are at least partially the same.

[0082] After obtaining the second visual parameters, the embodiments of this application further render based on the second visual parameters to present the second visual changes.

[0083] The second visual change is used to present the visual change corresponding to at least a portion of the first visual change that cannot be visually recognized on the interface of the electronic device. Specifically, the second visual change can be displayed on the top layer of the electronic device interface, or it can be displayed on the layer corresponding to the original desktop image. There are no restrictions on this, depending on the actual application, as long as the displayed second visual change can be visually recognized by the user.

[0084] In addition, the second visual change can be the original visual change corresponding to the at least part (such as a flying hummingbird) in the first visual change, or it can be a visual change obtained after image processing of the original visual change. It is not limited in this respect and depends on the actual application.

[0085] In one possible implementation, the second visual change can be presented in a separate window. For example, the top layer of an electronic device interface could use a separate window to present the visual changes a hummingbird makes as it changes direction during flight.

[0086] In other possible implementations, OSD (On-Screen Display) technology can also be used to display the second visual change, thereby presenting the second visual change. For example, based on OSD technology, the visual changes of a hummingbird changing direction during flight can be overlaid and displayed on the upper application window of the electronic device interface for a certain period of time (such as 3-5 seconds).

[0087] The two methods described above can be rendered using different channels. Window display technology can present the second visual change through dynamically laid-out windows (such as window size and content) to adapt to different devices or user needs; OSD technology is mainly used to overlay visual information such as text, icons, or menus on video or image signals to provide operation feedback or status information, emphasizing the intuitiveness of the human-computer interaction interface.

[0088] In summary, the display method provided in this application obtains a first visual parameter in response to a first visual change in the desktop image of an electronic device, determines a second visual parameter based on the first visual change in response to the first visual parameter satisfying a condition, and renders and presents the second visual change based on the second visual parameter. This allows at least a portion of the first visual change that cannot be visually recognized to be displayed based on the presented second visual change, enabling the user to visually recognize the at least portion. For example, the second visual change can be used to display a portion of the desktop wallpaper that is obscured by an upper window, allowing the user to visually recognize the portion of the desktop wallpaper obscured by an upper window. Thus, this application overcomes the problem in some applications of traditional technology where visual changes in at least a portion of the desktop image cannot be recognized, improving the user experience.

[0089] In an alternative embodiment, see Figure 3 The method flowchart shown herein indicates that step 102 in the method provided in this application can be implemented as step 301 as follows:

[0090] Step 301: In response to the first visual parameter characterizing the degree to which the visual change of the target object in the desktop image is occluded by the upper display object, the visual change information of the target object is extracted from the first visual change.

[0091] The second visual parameter includes visual change information of the target object.

[0092] The upper-layer display object can be, but is not limited to, the active windows of various applications opened on electronic devices, such as the active windows of browsers, communication applications, office applications, screen mirroring applications, and so on.

[0093] The target object in the desktop image may include at least one of the desktop image's own display objects (such as the main object, background object, etc.) and additional display objects.

[0094] In practice, when a first visual change is detected in the desktop image, a first visual parameter can be obtained. Based on the first visual parameter, the position information of the target object in the desktop image (such as the main object in the wallpaper and / or additional display objects such as time and weather) and the position information of the upper-level display objects such as the active window on the desktop can be determined. Then, based on the position information of the target object in the desktop image and the position information of the upper-level display objects, it can be determined whether the visual change of the target object is occluded by the upper-level display objects and the degree of occlusion when occlusion occurs.

[0095] The metadata of desktop images such as wallpapers typically provides information on the types of display objects they contain (e.g., elements like birds and trees within the wallpaper itself, or additional display objects like weather and time attached to the wallpaper) and their corresponding positions and sizes. Optionally, the first visual parameter can be obtained based on the desktop image's metadata, combined with visual detection of the desktop image and its upper-level display objects (e.g., detecting window size and position). Then, based on the first visual parameter, the position information of the target object in the desktop image and the position information of the upper-level display objects are determined to ascertain whether the visual changes of the target object are occluded by the upper-level display objects and the degree of occlusion when occlusion occurs.

[0096] In response to the first visual parameter characterizing the degree to which the visual change of the target object in the desktop image is occluded by the upper display object, reaching a threshold, this embodiment extracts the visual change information of the target object from the first visual change.

[0097] In practice, optionally, the image content of the desktop image (such as a live wallpaper) during the first visual change can be input into the target model. The target model analyzes the identification and / or segmentation information of the target object during the visual change based on the input information (such as the type of the target object, background object, additional display object, etc., dynamic change position / outline, etc.). Then, based on the identification and / or segmentation information of the target object during the visual change, the visual change information of the target object can be extracted. The visual change information of the target object can be used as the second visual parameter so that rendering can be performed based on the second visual parameter to present the second visual change.

[0098] Visual change information of the target object may include, but is not limited to, changes in the target object's color, texture, shape / pose, position and / or size in the desktop image, such as changes in the flight direction and speed of a bird, and / or changes in the bird's color, size and position.

[0099] The target model can be a large or small AI (Artificial Intelligence) model. The large model can be a general-purpose large model, such as a general-purpose visual large model, a multimodal large model, etc., or it can be an expert large model obtained by fine-tuning a general-purpose large model based on requirements. This application does not limit this. The large model learns the features and patterns of the input information by training on a large amount of diverse data. It typically has hundreds of millions to trillions of model parameters (such as the weights corresponding to the model network layers, used to control model behavior), and can capture complex relationships and patterns in the input information for accurate and efficient inference / computation.

[0100] In this embodiment, when the degree of occlusion of the target object in the desktop image by the first visual parameter characterizes the visual changes of the target object reaches a threshold, the visual change information of the target object is extracted from the first visual change and used as the second visual parameter. This facilitates subsequent rendering based on the visual change information of the target object, thereby enabling the display of the occluded target object in the desktop image and avoiding the problem that the target object or at least part of it cannot be visually recognized due to occlusion.

[0101] In one optional embodiment, the visual change information of the target object includes the image content and location information (the location information corresponding to the desktop image) of the target object at different times.

[0102] See Figure 4 The flowchart shown illustrates that, in the case where the visual changes of a target object in a desktop image are occluded to a certain degree by the upper-layer display object, step 103 in the method provided in this application can be implemented as steps 401-402 as follows.

[0103] Step 401: Render the image content and position information of the target object at different times based on the visual change information of the target object to obtain the rendering result.

[0104] Step 402: Based on the rendering result, present the image content of the target object at different times at the corresponding position on the upper display object, so that the image content of the target object presented on the upper display object is the same as the image content of the target object in the desktop image; the corresponding position is determined based on the position information.

[0105] The visual changes of the target object are a dynamic process. In practice, the image content and position information corresponding to different times during the visual changes of the target object can be rendered and displayed simultaneously. That is, after each frame of the target object is rendered, it is displayed. By displaying multiple frames of the target object's images, the dynamic visual changes of the target object can be presented.

[0106] In this embodiment, after each frame of the target object is rendered, the target object is displayed at the corresponding position on the upper display object based on the rendering result, so that the image content of the target object presented on the upper display object is the same as the image content of the target object in the desktop image.

[0107] The corresponding position is determined based on the actual position information of the target object in the desktop image. Specifically, it can be the same position on the upper display object as the actual position, or it can be a position that is offset from the actual position.

[0108] See Figure 5 In the example, the main object in the hummingbird wallpaper is obscured by the active window (the upper display object) opened by the user. When the main object "hummingbird" in the wallpaper undergoes a visual change, the visual change information of the main object "hummingbird" is extracted based on this application and rendered to be displayed on the upper active window, so as to present its visual change on the active window and avoid its visual change being unperceptible and unrecognizable.

[0109] In implementation, optionally, the target object displayed on the upper-level display object (such as the active window) can also have a certain transparency effect based on the transparency setting, so that during the visual changes of the target object displayed on the upper-level display object, the part of the upper-level display object covered by the target object can still be visually perceived by the user. Subsequently, the display of the target object on the upper-level display object can be synchronously terminated when the visual changes of the target object end. For example, assuming that in Figure 5 The visual changes of the hummingbird will end after 2-3 seconds of display on the activity window, at which point the display of the hummingbird on the activity window can be stopped.

[0110] Optionally, the target object displayed on the upper display object (such as the active window) does not affect the functionality of the controls (such as buttons, input boxes, etc.) contained in the part covered by the upper display object, and the user can still operate and use the controls in the covered part of the upper display object normally.

[0111] This embodiment presents the image content of the target object in the desktop image at different times at the corresponding position on the upper display object, which enables the user to effectively perceive and identify the visual changes of the occluded target object in the desktop image, thereby avoiding the problem that the target object in the desktop image cannot be visually recognized due to the occlusion of the upper display object.

[0112] In an alternative embodiment, see Figure 6 The method flowchart shown herein, step 102 in the method provided in this application, can be implemented as steps 601-602 as follows:

[0113] Step 601: Based on the first visual parameter characterizing that the visual changes of the target object in the desktop image cannot be visually perceived by the current target feature user, extract the visual change information of the target object from the first visual change.

[0114] The target user characteristics may include, but are not limited to, users with color blindness or color weakness.

[0115] In practice, it is possible, but not limited to, to identify whether a user has color blindness or color weakness based on the user's historical settings or adjustments to the electronic device's display parameters (such as setting color filters, reducing white point values, setting contrast modes, etc.).

[0116] For the target user, it is determined whether the first visual parameter indicates that the visual changes of the target object in the desktop image cannot be visually perceived by the current target user. Optionally, it can be determined whether the image visual information indicated by the first visual parameter belongs to the range of visual recognition abnormalities / obstacles of the target user. If so, it indicates that the visual changes of the target object in the desktop image cannot be visually perceived by the current target user.

[0117] If the visual changes of the target object in the desktop image represented by the first visual parameter cannot be visually perceived by the current user of the target feature, then the visual change information of the target object is extracted from the first visual change.

[0118] The process of extracting visual change information of the target object, and the extracted information content, can be found in the description of the corresponding embodiments above, and will not be repeated here.

[0119] Step 602: Enhance the visual change information of the target object to obtain enhanced visual change information; the second visual parameter includes the enhanced visual change information.

[0120] The enhancement processing performed on the visual change information of the target object may include, but is not limited to, one or more of the following: color enhancement, contrast enhancement, or size increase of the target object. This is not limited and can be determined according to the actual visual characteristics of the user of the target feature (such as color blindness or color weakness) to ensure that the enhanced visual change information obtained enables the user of the target feature to visually perceive the visual changes of the target object.

[0121] The enhanced visual change information can then be used as a second visual parameter for rendering to present the second visual change.

[0122] This embodiment targets users with color blindness or color weakness. When visual changes in a target object cannot be perceived by the current user with the target characteristics, it enhances the visual change information of the target object to support the user's effective perception of visual changes in the target object, thus preventing the user from being unable to perceive visual changes in the target object.

[0123] In one optional embodiment, the enhanced visual change information includes the image content and location information of the enhanced target object at different times.

[0124] See Figure 7 The flowchart shown illustrates the method for enhancing visual change information of a target object to obtain enhanced visual change information. Step 103 in the method provided in this application can be implemented as steps 701-702 as follows.

[0125] Step 701: Render the image content and position information of the enhanced target object at different times based on the enhanced visual change information to obtain the rendering result.

[0126] Step 702: Based on the rendering result, the enhanced image content of the target object at different times is presented at the corresponding position of the desktop image, so that at least one attribute of the target object presented on the desktop image changes; the corresponding position is determined based on the position information.

[0127] In this embodiment, the visual changes of the target object are also a dynamic process. In practice, the image content and position information corresponding to different times during the visual changes of the target object can be rendered and displayed simultaneously. That is, after each frame of the target object is rendered, it is displayed. By displaying multiple frames of the target object's images, the dynamic visual changes of the target object are presented.

[0128] In this process, after each frame of the target object is rendered, the enhanced target object can be displayed at the corresponding position on the desktop image based on the rendering result, so that at least one attribute of the target object presented on the desktop image changes.

[0129] The change in at least one attribute can refer to a change in one or more attributes of the enhanced target object compared to the original target object, such as color, speed of change, position, or size. By changing at least one attribute of the target object, the visual change of the target object is enhanced, enabling users with target features to effectively perceive the visual change of the target object.

[0130] In this embodiment, the corresponding position can be determined based on the actual position information of the target object in the desktop image. Specifically, it can be the original position information of the target object in the desktop image, as represented by the position information, or it can be the position information obtained after processing the original position information. Wherein, if the enhancement process does not change the size or position of the target object, the corresponding position can be the original position of the target object in the desktop image. If the enhancement process changes the size or position of the target object, the corresponding position can be determined based on the adjustment information of the target object's size and position, such as the position after enlarging the size based on the original position.

[0131] See Figure 8 The image shows a visual comparison of a target object in a desktop image before and after enhancement. In this example, the enhancement process for the target object includes enlarging its size.

[0132] This embodiment targets users with color blindness or color weakness. By presenting enhanced visual changes of the target object at the corresponding position of the desktop image, at least one attribute of the target object changes, thereby enhancing the visual changes of the target object and enabling users with the target characteristics to effectively perceive the visual changes of the target object.

[0133] In an optional embodiment, the display method provided in this application may further include at least one of the following steps "1-1"-"1-2":

[0134] 1-1: Identify display objects in the desktop image whose visual features and / or content attributes satisfy the focus condition to obtain the main object in the desktop image.

[0135] The focal condition can be a condition that indicates the displayed object is the visual focal point or at least a secondary focal point in the desktop image, or a condition close to the visual focal point.

[0136] Specifically, but not limited to, the focus condition may be set to include at least one of the following visual features and / or content attributes:

[0137] a. The distance between the displayed object's location in the image and the image center is below a threshold;

[0138] b. The size of the displayed object occupies more than a certain proportion of the image;

[0139] c. The clarity of the displayed object reaches the threshold;

[0140] d. The object to be displayed is the foreground object in the image.

[0141] e. Display objects of a specific type (such as people, animals, etc.).

[0142] In practice, based on pre-defined recognition rules, such as the recognition rules corresponding to the above-mentioned focus conditions, display objects in the desktop image that meet the focus conditions can be identified, and the identified display objects can be used as the main objects of the desktop image.

[0143] The metadata of desktop images such as wallpapers provides information on the types of display objects they contain (such as elements like birds and trees in the wallpaper itself, or additional display objects like weather and time attached to the wallpaper) as well as their corresponding positions, sizes, and other metadata. Based on this, in practical applications, the metadata of desktop images can be combined to identify the display objects that meet the focus conditions, i.e., the main objects.

[0144] However, it is not limited to this. It can also be used to identify display objects in desktop images whose visual features and / or content attributes meet the focus criteria based on AI models. The AI ​​model used can be a large model, a small model specifically trained for this recognition task, or an expert large model obtained by fine-tuning a general large model based on requirements. There are no restrictions on this.

[0145] 1-2: Identify the display objects in the additional layers of the desktop image to obtain the additional display objects.

[0146] The target object includes the main object of the desktop image and / or additional display objects.

[0147] For additional display objects, identification can be based on the layers where different display objects are located on the desktop image, and display objects located in additional layers of the desktop image can be identified as additional display objects.

[0148] In addition, additional display objects can be identified based on the metadata of desktop images such as wallpapers. For example, additional display objects can be identified based on the object types corresponding to different display objects in the metadata (such as wallpaper elements themselves, or additional information such as time and weather). Alternatively, additional display objects can be obtained by identifying display objects in additional layers of desktop images based on AI models such as large models.

[0149] In desktop images such as wallpapers, the main subject and / or additional display objects such as time and weather are usually the content that users pay more attention to. This embodiment can facilitate the subsequent display processing of the main subject and / or additional display objects based on the method of this application by identifying the main subject and / or additional display objects in the desktop image, so as to avoid the problem that the visual changes of the main subject and / or additional display objects cannot be visually recognized by the user when the degree of obscuring of the main subject and / or additional display objects reaches a threshold.

[0150] In an optional embodiment, step 102 in the method provided in this application can also be implemented as at least one of the following steps "2-1"-"2-2":

[0151] 2-1: In response to the first visual parameter representing the degree to which the visual changes of the main object in the desktop image are occluded by the upper display object, a threshold is reached, rendering is performed based on the visual change information of the main object, and the visual changes of the main object are superimposed on the upper display object based on the rendering result.

[0152] Specifically, visual change information of the main object can be extracted from the first visual change. This visual change information may include the image content and position information (position information in the desktop image) of the main object at different times. Then, rendering can be performed based on the image content of the main object at different times, and based on the rendering result, the visual changes of the main object can be overlaid and displayed at the corresponding positions on the upper display object.

[0153] The visual changes of the main object are also a dynamic process, which can be rendered and displayed frame by frame.

[0154] The corresponding position on the upper display object can be determined based on the position information of the main object in the desktop image at different times. Specifically, it can be the same position on the upper display object as the actual position of the main object in the desktop image, or it can be a position that is offset from the actual position.

[0155] The image content of the main object displayed on the upper display object is the same as the image content of the main object on the desktop image (this part of the content on the desktop image or at least part of it is actually obscured by the upper display object).

[0156] 2-2: Render based on the visual change information of the additional display object, and adjust the additional display object from the layer in the desktop image to the upper display object based on the rendering result, so as to display the additional display object on the upper display object.

[0157] Similarly, visual change information of the additional display object can be extracted from the first visual change. This visual change information may include the image content and position information (position information in the desktop image) of the additional display object at different times. Then, rendering can be performed based on the image content of the additional display object at different times, and based on the rendering result, the additional display object can be adjusted from its layer in the desktop image to above the upper display object. By changing the layer, the additional display object that was originally obscured (or at least partially obscured) can be visually perceived.

[0158] The visual changes of the attached display objects are also a dynamic process, which can be rendered and displayed frame by frame.

[0159] When adjusting the layer to display an additional display object at a corresponding position on the upper display object, the corresponding position can be determined based on the position information of the additional display object in the desktop image. Specifically, it can be the same position on the upper display object as the actual position of the additional display object in the desktop image, or it can be a position that is offset from the actual position.

[0160] Based on this embodiment, the problem that the visual changes of the main object and / or additional display objects in the desktop image cannot be visually recognized by the user when the degree of occlusion reaches a threshold can be avoided, thus ensuring that the user can effectively perceive the visual changes of the main object and / or additional display objects that he or she is more concerned about in the desktop image.

[0161] In an optional embodiment, the method provided in this application may further include the following processing before obtaining the first visual parameter:

[0162] In response to the electronic device being in a first state and / or the user of the electronic device being in a second state, the acquisition of the first visual parameter is avoided to prevent the presentation of the second visual change.

[0163] The first state and the second state are used to characterize the current usage characteristics of the electronic device user that conform to the target usage characteristics of the electronic device.

[0164] The target usage feature is the feature that meets the conditions among a variety of usage features of electronic devices.

[0165] The conditions here are used to characterize whether a user is busy or focused when using an electronic device. These conditions may include, but are not limited to, the user’s use of the electronic device being prioritized to a priority threshold, and / or the user’s level of focus / busyness when using the electronic device being prioritized to a level threshold.

[0166] The first state can be, but is not limited to, the state in which specific software such as meeting, screen sharing, or office work is running on an electronic device, indicating whether the user is busy or focused. Correspondingly, it can be, but is not limited to, determining whether an electronic device is in the first state by detecting information such as the type and number of applications / software running on the device, and the running time.

[0167] The second state can be, but is not limited to, the user state corresponding to the target data features of the electronic device user, such as facial expressions, posture, and / or eye movements and gaze, when the user is busy or focused. Specifically, it can be determined whether the electronic device user is in the second state by detecting the user's facial expressions, posture, and / or eye movements and gaze.

[0168] If the electronic device is in the first state and / or the user of the electronic device is in the second state, it indicates that the user of the electronic device is currently in a busy or focused state. In this case, the step of obtaining the first visual parameter can be avoided to avoid presenting the second visual change, thereby avoiding interference with the user's current busy or focused state due to presenting the second visual change on the upper display object (such as presenting the visual change of a hummingbird on the active window).

[0169] Conversely, if the electronic device is not in the first state and the user of the electronic device is not in the second state, the step of obtaining the first visual parameter can be triggered to present the second visual change, so that even if at least part of the first visual change of the desktop image cannot be visually recognized (such as when the main object of the desktop image is occluded), the user can still effectively perceive the first visual change of the desktop image based on the display method of this application.

[0170] Based on this embodiment, when the user of the electronic device is in a busy or focused state, the corresponding processing of the desktop image of the electronic device for presenting the second visual change in this application can be intentionally avoided, thereby avoiding interference with the user's use of the electronic device in a busy or focused state.

[0171] Corresponding to the above-described method, this application also provides a display device, the composition of which is as follows: Figure 9 As shown, it includes:

[0172] The acquisition module 901 is used to obtain first visual parameters in response to a first visual change in the desktop image of the electronic device;

[0173] The determining module 902 is configured to determine a second visual parameter based on the first visual change in response to the first visual parameter satisfying a condition; the first visual parameter satisfying a condition indicates that at least part of the first visual change cannot be visually recognized.

[0174] Display module 903 is used to render based on the second visual parameters to present the second visual change;

[0175] The first visual change is at least partially the same as the second visual change.

[0176] In an optional implementation, the determining module 902 is specifically used for:

[0177] In response to the first visual parameter characterizing the degree to which the visual change of the target object in the desktop image is occluded by the upper display object reaching a threshold, the visual change information of the target object is extracted from the first visual change;

[0178] The second visual parameter includes visual change information of the target object.

[0179] In one optional implementation, the visual change information of the target object includes the image content and location information of the target object at different times.

[0180] Display module 903 is specifically used for:

[0181] Rendering is performed based on the image content and location information of the target object at different times to obtain the rendering result;

[0182] Based on the rendering results, the image content of the target object at different times is presented at the corresponding position on the upper display object, so that the image content of the target object presented on the upper display object is the same as the image content of the target object in the desktop image; the corresponding position is determined based on the position information.

[0183] In an optional implementation, the determining module 902 is specifically used for:

[0184] Based on the first visual parameter characterizing that the visual changes of the target object in the desktop image cannot be visually perceived by the current target feature user, the visual change information of the target object is extracted from the first visual change.

[0185] The visual change information of the target object is enhanced to obtain enhanced visual change information;

[0186] The second visual parameter includes the enhanced visual change information.

[0187] In one optional implementation, the enhanced visual change information includes the image content and location information of the enhanced target object at different times.

[0188] Display module 903 is specifically used for:

[0189] Rendering is performed based on the enhanced image content and location information of the target object at different times to obtain the rendering result;

[0190] Based on the rendering results, the enhanced image content of the target object at different times is presented at the corresponding position of the desktop image, so that at least one attribute of the target object presented on the desktop image changes; the corresponding position is determined based on the position information.

[0191] In an alternative embodiment, the above-described apparatus further includes an identification module for performing at least one of the following:

[0192] Identify display objects in the desktop image whose visual features and / or content attributes satisfy the focus condition to obtain the main object in the desktop image;

[0193] Identify the display objects in the additional layers of the desktop image to obtain the additional display objects;

[0194] The target object includes the main object and / or the additional display object.

[0195] In an alternative embodiment, the display module 903 is specifically configured to perform at least one of the following:

[0196] In response to the first visual parameter characterizing the degree to which the visual change of the main object in the desktop image is occluded by the upper display object, a threshold is reached, rendering is performed based on the visual change information of the main object, and the visual change of the main object is superimposed on the upper display object based on the rendering result;

[0197] Rendering is performed based on the visual change information of the additional display object, and based on the rendering result, the additional display object is adjusted from its layer in the desktop image to be above the upper display object, so as to display the additional display object on the upper display object.

[0198] In an alternative embodiment, the device further includes a control module for responding to the electronic device being in a first state and / or the user of the electronic device being in a second state before obtaining the first visual parameter, thereby avoiding triggering the acquisition of the first visual parameter to avoid presenting the second visual change.

[0199] The first state and the second state are used to characterize that the user currently meets the target usage characteristics of the electronic device, and the target usage characteristics are the characteristics that meet the conditions among a variety of usage characteristics of the electronic device.

[0200] This application also discloses an electronic device, the composition and structure of which are as follows: Figure 10 As shown, it includes at least:

[0201] Memory 10 is used to store the computer instruction set;

[0202] Computer instruction sets can be implemented in the form of computer programs.

[0203] Processor 20 is configured to implement the display method provided in any of the above method embodiments by executing a set of computer instructions in the memory.

[0204] The processor 20 can be a central processing unit (CPU), a graphics processor, an application-specific integrated circuit (ASIC), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a neural network processor (NPU), a deep learning processor (DPU), or other programmable logic devices.

[0205] Optionally, the electronic device may also include a display device for displaying information.

[0206] Optionally, electronic devices may also include storage resources such as memory and cache.

[0207] Optionally, the electronic device may also include an image acquisition device.

[0208] In addition to these components, electronic devices may also include communication interfaces, communication buses, and other parts. Memory, processor, and communication interface communicate with each other through the communication bus.

[0209] Communication interfaces are used for communication between electronic devices and other devices. Communication buses can be Peripheral Component Interconnect (PCI) buses or Extended Industry Standard Architecture (EISA) buses, and can be categorized into address buses, data buses, control buses, etc.

[0210] This application also discloses a storage medium carrying one or more computer instruction sets, which, when executed by an electronic device, enable the electronic device to implement the display method provided in any of the above method embodiments.

[0211] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0212] For ease of description, the above systems or devices are described separately as various modules or units based on their functions. Of course, in implementing this application, the functions of each unit can be implemented in one or more software and / or hardware components.

[0213] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solution of this application, in essence or the part that makes a creative contribution, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of this application.

[0214] Finally, it should be noted that in this document, relational terms such as first, second, third, and fourth are used to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0215] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A display method, comprising: In response to a first visual change in the desktop image of an electronic device, obtain the first visual parameters; In response to the condition that the first visual parameter is satisfied, a second visual parameter is determined based on the first visual change; the condition that the first visual parameter is satisfied indicates that at least part of the first visual change cannot be visually recognized. Rendering is performed based on the second visual parameters to present the second visual change; The first visual change is at least partially the same as the second visual change.

2. The display method according to claim 1, in response to the first visual parameter satisfying a condition, determining a second visual parameter based on the first visual change, includes: In response to the first visual parameter characterizing the degree to which the visual change of the target object in the desktop image is occluded by the upper display object reaching a threshold, the visual change information of the target object is extracted from the first visual change; The second visual parameter includes visual change information of the target object.

3. The display method according to claim 2, wherein the visual change information of the target object includes the image content and position information of the target object at different times; Rendering is performed based on the second visual parameters to present a second visual change, including: Rendering is performed based on the image content and location information of the target object at different times to obtain the rendering result; Based on the rendering results, the image content of the target object at different times is presented at the corresponding position on the upper display object, so that the image content of the target object presented on the upper display object is the same as the image content of the target object in the desktop image; the corresponding position is determined based on the position information.

4. The display method according to claim 1, in response to the first visual parameter satisfying a condition, determining a second visual parameter based on the first visual change, includes: Based on the first visual parameter characterizing that the visual changes of the target object in the desktop image cannot be visually perceived by the current target feature user, the visual change information of the target object is extracted from the first visual change. The visual change information of the target object is enhanced to obtain enhanced visual change information; The second visual parameter includes the enhanced visual change information.

5. The display method according to claim 4, wherein the enhanced visual change information includes the image content and position information of the enhanced target object at different times; Rendering is performed based on the second visual parameters to present a second visual change, including: Rendering is performed based on the enhanced image content and location information of the target object at different times to obtain the rendering result; Based on the rendering results, the enhanced image content of the target object at different times is presented at the corresponding position of the desktop image, so that at least one attribute of the target object presented on the desktop image changes; the corresponding position is determined based on the position information.

6. The display method according to any one of claims 2-5, further comprising at least one of the following: Identify display objects in the desktop image whose visual features and / or content attributes satisfy the focus condition to obtain the main object in the desktop image; Identify the display objects in the additional layers of the desktop image to obtain the additional display objects; in, The target object includes the main object and / or the additional display object.

7. The display method according to claim 6, wherein rendering is performed based on the second visual parameters to present a second visual change, comprising at least one of the following: In response to the first visual parameter characterizing the degree to which the visual change of the main object in the desktop image is occluded by the upper display object, a threshold is reached, rendering is performed based on the visual change information of the main object, and the visual change of the main object is superimposed on the upper display object based on the rendering result; Rendering is performed based on the visual change information of the additional display object, and based on the rendering result, the additional display object is adjusted from its layer in the desktop image to be above the upper display object, so as to display the additional display object on the upper display object.

8. The display object according to claim 1, further comprising, before obtaining the first visual parameter: In response to the electronic device being in a first state and / or the user of the electronic device being in a second state, the acquisition of the first visual parameter is avoided to prevent the presentation of the second visual change; The first state and the second state are used to characterize that the user currently meets the target usage characteristics of the electronic device, and the target usage characteristics are the characteristics that meet the conditions among a variety of usage characteristics of the electronic device.

9. A display device, comprising: The acquisition module is used to obtain first visual parameters in response to a first visual change in the desktop image of the electronic device; A determining module is configured to determine a second visual parameter based on the first visual change in response to the first visual parameter satisfying a condition; the first visual parameter satisfying a condition indicates that at least a portion of the first visual change cannot be visually recognized. The display module is used to render based on the second visual parameters to present the second visual change; The first visual change is at least partially the same as the second visual change.

10. An electronic device, comprising: Memory, used to store at least one set of computer instructions; A processor is configured to perform the following processing by executing a set of instructions stored in the memory: In response to a first visual change in the desktop image of an electronic device, obtain the first visual parameters; In response to the condition that the first visual parameter is satisfied, a second visual parameter is determined based on the first visual change; the condition that the first visual parameter is satisfied indicates that at least part of the first visual change cannot be visually recognized. Rendering is performed based on the second visual parameters to present the second visual change; The first visual change is at least partially the same as the second visual change.

Images