Method and apparatus for determining a display interface, device, and medium

By acquiring information about the display interface and device performance, the readability of interface elements is evaluated, and display parameters are adjusted when readability is insufficient. This solves the problem of inaccurate interface display caused by low-performance display devices and achieves more accurate interface display.

CN122363794APending Publication Date: 2026-07-10BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
Filing Date
2026-04-10
Publication Date
2026-07-10

AI Technical Summary

Technical Problem

Existing technologies fail to effectively consider the impact of low-performance display devices on the brightness and color performance of interface elements, resulting in poor readability of interface content and affecting the accuracy of interface display.

Method used

By acquiring display information from the display interface and performance information from the target display device, and combining this with the device's display performance parameters, the readability of interface elements is evaluated. If readability is not up to standard, the interface display parameters are adjusted to improve the accuracy of the interface display.

Benefits of technology

Precisely quantifying the perceptual deviations caused by performance differences in display devices ensures the readability of the interface in real-world usage environments and improves the accuracy of interface display.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122363794A_ABST
    Figure CN122363794A_ABST
Patent Text Reader

Abstract

The present disclosure provides a method and device, equipment and medium for determining a display interface, relating to the technical field of computers, and particularly to the technical field of interface display and image processing. The implementation scheme is: obtaining first display information, wherein the first display information includes foreground display parameters of a target element in an initial display interface and background display parameters of the initial display interface; obtaining display performance information of a target display device; determining target information representing readability of the target element in the initial display interface based on the first display information and the display performance information; in response to the target information satisfying a preset condition, adjusting the first display information based on the target information to obtain second display information; and adjusting the initial display interface based on the second display information to obtain a target display interface.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and more particularly to the field of interface display and image processing technology, specifically to a method, apparatus, electronic device, computer-readable storage medium, and computer program product for determining a display interface. Background Technology

[0002] With the development and widespread application of computer technology, the color design of display interfaces has become increasingly rich, and the information density of interfaces has also increased significantly. In actual use, the display performance of the terminal devices used by users varies significantly. For example, some low-performance devices cannot accurately display rich color information or accurately represent the brightness differences of different interface elements, which leads to poor readability of interface content and affects the accuracy of interface display.

[0003] The methods described in this section are not necessarily methods that had been previously conceived or adopted. Unless otherwise specified, no method described in this section should be assumed to be prior art simply because it is included in this section. Similarly, unless otherwise specified, the issues mentioned in this section should not be considered to be accepted in any prior art. Summary of the Invention

[0004] This disclosure provides a method, apparatus, electronic device, computer-readable storage medium, and computer program product for determining a display interface.

[0005] According to one aspect of this disclosure, a method for determining a display interface is provided, comprising: acquiring first display information, wherein the first display information includes foreground display parameters of a target element in an initial display interface and background display parameters of the initial display interface; acquiring display performance information of a target display device; determining target information characterizing the readability of the target element in the initial display interface based on the first display information and the display performance information; adjusting the first display information based on the target information to obtain second display information in response to the target information satisfying a preset condition; and adjusting the initial display interface based on the second display information to obtain the target display interface.

[0006] According to another aspect of this disclosure, an apparatus for determining a display interface is provided, comprising: a first acquisition unit configured to acquire first display information, wherein the first display information includes foreground display parameters of a target element in an initial display interface and background display parameters of the initial display interface; a second acquisition unit configured to acquire display performance information of a target display device; a first determination unit configured to determine target information characterizing the readability of the target element in the initial display interface based on the first display information and the display performance information; a first adjustment unit configured to adjust the first display information based on the target information in response to the target information satisfying a preset condition, to obtain second display information; and a second adjustment unit configured to adjust the initial display interface based on the second display information to obtain a target display interface.

[0007] According to another aspect of this disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method described above for determining a display interface.

[0008] According to another aspect of this disclosure, a non-transitory computer-readable storage medium is provided storing computer instructions, wherein the computer instructions are used to cause the computer to perform the above-described method for determining a display interface.

[0009] According to another aspect of this disclosure, a computer program product is provided, including a computer program, wherein the computer program, when executed by a processor, is capable of implementing the above-described method for determining a display interface.

[0010] According to one or more embodiments of this disclosure, the accuracy of the interface display can be improved.

[0011] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0012] The accompanying drawings exemplify embodiments and form part of the specification, serving together with the textual description to explain exemplary implementations of the embodiments. The illustrated embodiments are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0013] Figure 1A schematic diagram of an exemplary system in which various methods described herein may be implemented, according to exemplary embodiments of the present disclosure; Figure 2 A flowchart illustrating a method for determining a display interface according to an exemplary embodiment of the present disclosure is shown; Figure 3 A flowchart illustrating a method for determining a display interface according to an exemplary embodiment of the present disclosure is shown; Figure 4 A structural block diagram of an apparatus for determining a display interface according to an exemplary embodiment of the present disclosure is shown; Figure 5 A structural block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure is shown. Detailed Implementation

[0014] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding, and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0015] In this disclosure, unless otherwise stated, the use of terms such as "first," "second," etc., to describe various elements is not intended to limit the positional, temporal, or importance relationships of these elements; such terms are merely used to distinguish one element from another. In some examples, the first element and the second element may refer to the same instance of that element, while in other cases, based on the context, they may refer to different instances.

[0016] The terminology used in the description of the various examples described in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context explicitly indicates otherwise, an element may be one or more unless the number of elements is specifically limited. Furthermore, the term "and / or" as used in this disclosure covers any one of the listed items and all possible combinations thereof.

[0017] The embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0018] Figure 1 A schematic diagram of an exemplary system 100 in which the various methods and apparatus described herein can be implemented according to embodiments of this disclosure is shown. Reference Figure 1The system 100 includes one or more client devices 101, 102, 103, 104, 105 and 106, a server 120, and one or more communication networks 110 coupling the one or more client devices to the server 120. The client devices 101, 102, 103, 104, 105 and 106 can be configured to execute one or more applications.

[0019] In embodiments of this disclosure, server 120 may run one or more services or software applications that enable the execution of methods for determining a display interface.

[0020] In some embodiments, server 120 may also provide other services or software applications, which may include non-virtual and virtual environments. In some embodiments, these services may be provided as web-based services or cloud services, such as to users of client devices 101, 102, 103, 104, 105 and / or 106 under a Software as a Service (SaaS) model.

[0021] exist Figure 1 In the configuration shown, server 120 may include one or more components that implement the functions performed by server 120. These components may include software components, hardware components, or combinations thereof that can be executed by one or more processors. Users operating client devices 101, 102, 103, 104, 105, and / or 106 can sequentially interact with server 120 using one or more client applications to utilize the services provided by these components. It should be understood that various different system configurations are possible and may differ from system 100. Therefore, Figure 1 This is an example of a system used to implement the various methods described herein, and is not intended to be limiting.

[0022] Users can use client devices 101, 102, 103, 104, 105, and / or 106 to send initial interface content or information about the target display device. The client devices can provide an interface that allows users to interact with the client devices. The client devices can also output information to the user through this interface. Although... Figure 1 Only six client devices are described, but those skilled in the art will understand that this disclosure can support any number of client devices.

[0023] Client devices 101, 102, 103, 104, 105, and / or 106 may include various categories of computer devices, such as portable handheld devices, general-purpose computers (such as personal computers and laptops), workstation computers, wearable devices, smart screen devices, self-service terminal devices, service robots, gaming systems, thin clients, various messaging devices, sensors, or other sensing devices. These computer devices can run various categories and versions of software applications and operating systems, such as Microsoft Windows, Apple iOS, UNIX-like operating systems, Linux or Linux-like operating systems (such as Google Chrome OS); or include various mobile operating systems, such as Microsoft Windows Mobile OS, iOS, Windows Phone, and Android. Portable handheld devices may include cellular phones, smartphones, tablets, personal digital assistants (PDAs), etc. Wearable devices may include head-mounted displays (such as smart glasses) and other devices. Gaming systems may include various handheld gaming devices, internet-enabled gaming devices, etc. Client devices are capable of executing various applications, such as various internet-related applications, communication applications (such as email applications), short message service (SMS) applications, and can use various communication protocols.

[0024] Network 110 can be any type of network well known to those skilled in the art, and can support data communication using any of a variety of available protocols (including, but not limited to, TCP / IP, SNA, IPX, etc.). By way of example only, one or more networks 110 can be a local area network (LAN), an Ethernet-based network, a token ring network, a wide area network (WAN), the Internet, a virtual network, a virtual private network (VPN), an intranet, an extranet, a blockchain network, a public switched telephone network (PSTN), an infrared network, a wireless network (e.g., Bluetooth, WIFI), and / or any combination of these and / or other networks.

[0025] Server 120 may include one or more general-purpose computers, special-purpose server computers (e.g., PC (personal computer) servers, UNIX servers, mid-range servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and / or combination. Server 120 may include one or more virtual machines running a virtual operating system, or other computing architectures involving virtualization (e.g., one or more flexible pools of logical storage devices that can be virtualized to maintain virtual storage devices for servers). In various embodiments, server 120 may run one or more services or software applications that provide the functionality described below.

[0026] The computing unit in server 120 can run one or more operating systems, including any of the aforementioned operating systems and any commercially available server operating system. Server 120 can also run any of a variety of additional server applications and / or middleware applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, etc.

[0027] In some implementations, server 120 may include one or more applications to analyze and merge data feeds and / or event updates received from users of client devices 101, 102, 103, 104, 105, and 106. Server 120 may also include one or more applications to display data feeds and / or real-time events via one or more display devices of client devices 101, 102, 103, 104, 105, and 106.

[0028] In some implementations, server 120 can be a server for a distributed system or a server integrated with blockchain. Server 120 can also be a cloud server, or an intelligent cloud computing server or intelligent cloud host with artificial intelligence technology. A cloud server is a host product in the cloud computing service system, designed to address the shortcomings of traditional physical hosts and Virtual Private Server (VPS) services, such as high management difficulty and weak business scalability.

[0029] System 100 may also include one or more databases 130. In some embodiments, these databases may be used to store data and other information. For example, one or more of the databases 130 may be used to store information such as audio files and video files. Databases 130 may reside in various locations. For example, a database used by server 120 may be local to server 120, or it may be located away from server 120 and may communicate with server 120 via a network-based or dedicated connection. Databases 130 may be of different categories. In some embodiments, the database used by server 120 may be, for example, a relational database. One or more of these databases may store, update, and retrieve data from and from the databases in response to commands.

[0030] In some embodiments, one or more of the databases 130 may also be used by an application to store application data. The databases used by the application may be different categories of databases, such as key-value stores, object stores, or regular stores supported by a file system.

[0031] Figure 1The system 100 can be configured and operated in various ways to enable the application of the various methods and apparatus described in this disclosure.

[0032] With the development and widespread application of computer technology, the color design of display interfaces has become increasingly rich, and the information density of interfaces has also increased significantly. In actual use, the display performance of the terminal devices used by users varies significantly. For example, some low-performance devices cannot accurately display rich color information or accurately represent the brightness differences of different interface elements, which leads to poor readability of interface content and affects the accuracy of interface display.

[0033] Existing methods for evaluating the contrast of display interface content are based on the assumption that display devices have relatively stable brightness output capabilities or color rendering characteristics. This approach does not consider the impact of low-performance display devices (such as those with limited brightness output capabilities, dynamic range, or color performance) on the perceived brightness and contrast of interface elements, and therefore cannot accurately reflect the readability of interface elements in real-world usage environments, thus affecting the accuracy of interface display.

[0034] Based on this, this disclosure provides a method for determining a display interface. By obtaining the display information of the interface to be displayed and the display performance information of the target display device, the physical display performance of the device is introduced as a variable into the evaluation method for the readability of interface elements. The readability of interface elements is determined by combining the display performance parameters of the device, and the interface display parameters are adjusted in a targeted manner when the readability score does not meet the standard, so as to improve the accuracy of the interface display.

[0035] Figure 2 A flowchart of a method 200 for determining a display interface according to an exemplary embodiment of the present disclosure is shown. Figure 2 As shown, method 200 includes: Step S201: Obtain first display information, wherein the first display information includes the foreground display parameters of the target element in the initial display interface and the background display parameters of the initial display interface; Step S202: Obtain the display performance information of the target display device; Step S203: Based on the first display information and display performance information, determine the target information characterizing the readability of the target element in the initial display interface; Step S204: In response to the target information satisfying preset conditions, adjust the first display information based on the target information to obtain the second display information; and Step S205: Adjust the initial display interface based on the second display information to obtain the target display interface.

[0036] By applying the above method 200, the readability of the interface can be determined based on the hardware performance characteristics of the target display device. By combining the device capabilities and the display parameters of the interface to calculate the target information, the perceptual deviation caused by the performance differences of the display devices can be accurately quantified, so as to more accurately determine the readability of the interface in the real use environment (target display device). Then, when the readability risk is high, the interface configuration parameters can be adjusted in a targeted manner to improve the accuracy of the interface display.

[0037] In some examples, the target information characterizing the readability of a target element in the initial display interface is a target score. In one example, the readability of the target element in the initial display interface is scored continuously within a certain numerical range, such as a score based on readability within the range of 0-100. In this case, the preset condition for the target information is, for example, a preset scoring threshold. When the target score is less than or equal to the scoring threshold (e.g., 60 points), the target information is considered to meet the preset condition, and the first display information needs to be adjusted to improve the accuracy of the interface display. In another example, the target score is discretized, that is, the target score label is determined based on the readability of the target element in the initial display interface from multiple preset discrete labels, such as rating the target element based on readability in four discrete level labels: A, B, C, and D. In this case, the preset condition for the target information is, for example, a preset scoring level threshold. When the target score is less than or equal to the scoring threshold (e.g., level C), the target information is considered to meet the preset condition, and the first display information needs to be adjusted to improve the accuracy of the interface display.

[0038] In some examples, the initial display interface can be the user interface of various applications, operating systems, or system software. For example, the initial display interface can be the control panel of a marketing platform, the information feed list of a mobile application, the chat dialog box of social software, the display interface of an in-vehicle system, the interface of an industrial control terminal, or the reading interface on an e-ink screen device.

[0039] In some examples, the target element can be any visual component presented in the initial display interface. For example, the target element can be a text element, such as title text, body paragraphs, explanatory text, etc.; it can also be an icon element, such as function button icons, status indicator icons, etc.; or it can be a line or geometric element, such as the border line of a function area, a dividing line, a progress bar, a drag bar, or a decorative graphic, etc.

[0040] In some examples, the foreground display parameters of a target element are parameters used to define the visual characteristics of the element itself. Foreground display parameters can include brightness values, transparency, hue, saturation, lightness, or contrast. For example, in the RGB color model, foreground display parameters can be represented by specific color values ​​for the red, green, and blue channels; in the RGBA color model, in addition to RGB color values, it also includes an alpha channel parameter representing opacity; in the HSL or HSV color models, it can be represented by values ​​for hue, saturation, and lightness.

[0041] In some examples, background display parameters are data used to define the visual characteristics of the background area where the target element is located. Similar to foreground display parameters, background display parameters can also include the brightness, transparency, or color values ​​of various color channels of the background color. For example, background display parameters can be the RGB color values ​​of a solid color background, the color parameters of a semi-transparent overlay, or the effective color parameters of a white or light-colored background at a specific location. In one example, background display parameters include the display parameters of the global background of the initial display interface. In another example, background display parameters include the display parameters of the local background area surrounding the target element. For example, when the target element is text or an icon located on a semi-transparent floating card, the background display parameters are used to specifically indicate the local background color and brightness of the floating card at the location of the target element, thereby more accurately reflecting the contrast between the display effect of the target element and its directly contacting area.

[0042] In some examples, the display performance information in step S202 is a quantitative parameter characterizing the physical display capabilities of the target display device. For instance, display performance information can characterize the target display device's peak brightness output capability, native panel contrast ratio, effective dynamic range, black level control capability, grayscale resolution capability, color gamut coverage capability, and dynamic response capability of the display driving circuit. This information reflects the actual output limits and attenuation characteristics of the device when displaying content with brightness differences and semi-transparent colors.

[0043] In some examples, step S203 can be calculated using a multi-stage perceptual contrast model that includes a device capability correction module. For example, firstly, based on the foreground display parameters and background display parameters in the first display information, a conventional perceptual contrast model is applied to calculate the basic perceptual contrast value of the target element in the initial display interface. Further, the basic perceptual contrast value is corrected using display performance information characterizing the display capability of the target display device. Specifically, a brightness display capability correction factor can be calculated based on the hardware performance parameters of the display device (e.g., parameters characterizing brightness output capability or dynamic range) to simulate the device's compression effect on overall contrast. Alternatively, if the target element includes semi-transparent content, a transparency compensation factor can be calculated by combining the transparency value of the semi-transparent content with parameters characterizing the device's transparency color display attenuation characteristics. By fusing the basic perceptual contrast value with the aforementioned correction or compensation factors (e.g., multiplication, weighted calculation, or exponential calculation), target information reflecting the readability of the target element in a real device display environment can be obtained.

[0044] According to some embodiments, the foreground display parameters and background display parameters include at least one feature dimension, the at least one feature dimension including at least one of the following: brightness dimension, transparency dimension or color feature dimension, and the display performance information includes display performance parameters corresponding to the at least one feature dimension, the display performance parameters corresponding to each feature dimension being used to characterize the performance capability of the target display device for that feature dimension.

[0045] By breaking down display parameters and device display performance parameters into specific feature dimensions, the readability of target elements can be determined more accurately. By introducing corresponding display performance parameters for different dimensions such as brightness, transparency, or color, targeted compensation can be made for display effect deviations in specific scenarios (e.g., semi-transparent overlay graying attenuation, low brightness contrast compression), thereby improving the accuracy of readability information.

[0046] In some examples, in addition to brightness, transparency, and color feature dimensions, the feature dimensions may also include contrast, dynamic range, grayscale response, color gamut, or spatial frequency dimensions, based on which the readability of the target element can be determined more accurately, thereby improving display accuracy.

[0047] According to some embodiments, the foreground display parameters and background display parameters include a color feature dimension and a transparency dimension. The display performance information includes a first performance parameter characterizing the degree of display attenuation of transparent colors by the target display device. In step S203, based on the first display information and the display performance information, the target information characterizing the readability of the target element in the initial display interface includes: determining first information characterizing the degree of color perception contrast based on the color feature values ​​of the foreground display parameters and the color feature values ​​of the background display parameters; determining second information characterizing the degree of display attenuation of transparent colors based on the transparency value of the foreground display parameters and the first performance parameter; and determining target information based on the first information and the second information.

[0048] By calculating the first information of color perception contrast and the second information of transparent color attenuation separately, and then combining the two to obtain the target information, the contrast loss caused by the transparency of interface content in actual device rendering can be more accurately quantified. For display interfaces containing semi-transparent overlay elements, the readability can be determined more accurately, thereby improving the accuracy of interface display.

[0049] In some examples, the first and second information are in the form of ratings, such as continuous numerical ratings, to more accurately characterize the degree of color perception contrast and the degree of attenuation of transparent color display.

[0050] In practical applications, color feature values ​​are used to quantify the color attributes of interface elements. Taking the RGB color model as an example, color feature values ​​can be represented as pixel grayscale values ​​or luminance of the three channels: red, green, and blue. In the HSV or HSL color models, color feature values ​​are specifically expressed as values ​​for hue, saturation, and lightness. In the LAB color space, color feature values ​​can be represented as lightness components (L dimension values) and chromaticity components (A dimension values ​​and B dimension values), thus more accurately representing the content of interface elements.

[0051] According to some embodiments, determining the first information characterizing the degree of color perception contrast based on the color feature values ​​of the foreground display parameters and the background display parameters includes: determining the equivalent foreground color feature value of the target element based on the transparency value of the foreground display parameters, the color feature values ​​of the foreground display parameters, and the color feature values ​​of the background display parameters; and determining the first information based on the equivalent foreground color feature value and the color feature values ​​of the background display parameters.

[0052] By applying the above method to calculate the equivalent foreground color feature value of interface elements, the transparency blending process can be simulated more accurately. By performing pixel-level fusion of foreground elements with transparency with the underlying background, the actual color rendered on the screen can be restored. Compared with the calculation method that simply relies on the original foreground color value, the basic contrast calculation error is reduced, and the accuracy of determining the readability of interface elements is improved.

[0053] In some examples, determining the primary information based on the color feature values ​​of the foreground and background can employ other computational strategies. For instance, the relative brightness of the foreground and background colors can be directly extracted and calculated using the Weber-Fechner law or the existing WCAG contrast formula (i.e., the ratio of the relative brightness of the brighter color plus a fixed bias to the relative brightness of the darker color plus a fixed bias) to obtain the primary information. Alternatively, the color feature values ​​of both can be converted to a uniform color space, the color difference matrix distance between them can be directly calculated, and this distance can be mapped to primary information representing the degree of color perception contrast.

[0054] According to some embodiments, determining the second information characterizing the degree of attenuation of transparent color display based on the transparency value of the foreground display parameter and the first performance parameter includes: performing an exponential calculation by using the transparency value of the foreground display parameter and the first performance parameter as the base and exponent, respectively, to obtain the second information.

[0055] By combining the transparency value with the first performance parameter through exponential calculation, the non-linear optical attenuation characteristics of the screen hardware when presenting semi-transparent materials can be more accurately fitted. This allows the second information to accurately characterize the contrast loss phenomenon that occurs when a low-performance display screen processes semi-transparent elements, thereby more accurately determining the readability of semi-transparent interface elements.

[0056] It should be understood that the methods for determining the second information are not limited to the exponential calculation methods described above. In some examples, a linear calculation method can be used, where the transparency value of the foreground display parameter is weighted and added or multiplied by the first performance parameter to obtain the second information. For another example, a logarithmic decay model can be used, where the first performance parameter is multiplied by the logarithm of the transparency value of the foreground display parameter to obtain the second information. Alternatively, based on a pre-established lookup table, the transparency value of the foreground display parameter and the first performance parameter can be used as indexes for interpolation to obtain the corresponding second information representing the degree of transparency decay.

[0057] After obtaining the first and second information, the final target information can be determined through various mathematical fusion methods. For example, the second information can be used as a weighting factor or compensation coefficient, directly multiplied with the first information to simulate the proportional decrease in contrast when the base color contrast is superimposed with the attenuation effect of transparent color. Alternatively, empirically based weighting coefficients can be assigned to the first and second information respectively, and the target information can be obtained through a weighted summation.

[0058] According to some embodiments, the first performance parameter of the target display device is determined based on the brightness display sampling results or color display sampling results of a first sample including content with different transparent colors on the target display device. By directly using the sampling results to calibrate the device characteristics, the actual display effect of the target display device can be more accurately characterized based on the device performance parameters based on the actual calibration process, thereby improving the accuracy of the interface readability score.

[0059] In one example, the calibration process for the first performance parameter of the target display device is implemented as follows: a set of first sample images containing color blocks with various transparency gradients are pre-made and rendered on the target display device. Then, an optical luminance meter or colorimeter is used to perform actual optical sampling measurements on each transparency color block displayed on the screen. The measured actual brightness or color data is compared and fitted with the theoretically calculated ideal rendering data to extract the coefficients characterizing the transparency display decay curve of the target display device. The transparency display decay curve characterizes the functional relationship curve between the transparency of the interface content and the degree of display decay. This coefficient can be used as the first performance parameter of the target display device.

[0060] Besides optical sampling using physical instruments, the primary performance parameter can also be determined quickly in other ways. For example, it can be determined by reading the hardware configuration identifier of the target display device (such as the panel model) and then searching a pre-set device performance database to match the pre-entered primary performance parameter, or by manually performing calibration tests to label the primary performance parameters of different target display devices.

[0061] According to some embodiments, the foreground display parameters and background display parameters include a color feature dimension and a brightness dimension, and the display performance information includes a second performance parameter characterizing the target display device's ability to represent brightness differences. In step S203, the target information characterizing the readability of the target element in the initial display interface based on the first display information and the display performance information includes: determining first information characterizing the degree of color perception contrast based on the color feature values ​​of the foreground display parameters and the background display parameters; determining third information characterizing the accuracy of brightness difference performance based on the second performance parameters of the target display device and the second performance parameters of the reference display device; and determining target information based on the first information and the third information.

[0062] By introducing a second performance parameter representing the ability to represent brightness differences into the interface content readability determination algorithm and comparing it with a benchmark display device, the impact of performance differences in overall brightness output and dynamic range of different display devices on the readability of interface content can be compensated. Based on this, the readability of the display interface content on various different devices can be determined more accurately, thereby improving the cross-device compatibility of the optimized target display interface and improving the accuracy of interface display.

[0063] In some examples, the third information is in the form of a rating, such as a continuous numerical rating, to more accurately characterize the accuracy of brightness difference performance.

[0064] In some examples, the benchmark display device corresponds to a high-performance display with standard color reproduction capabilities and brightness output range. This benchmark display device can be selected based on hardware performance parameters such as the display device's peak brightness output capability, native panel contrast ratio, effective dynamic range, black level control capability, grayscale resolution capability (distinguishing grayscale levels), backlight structure, display driver, and dimming control precision. In one example, the benchmark display device can be virtually characterized using a set of benchmark display performance parameters (i.e., the second performance parameters of the benchmark display device) to represent standard display performance.

[0065] In some examples, a second performance parameter of the target display device can be extracted and compared with the second performance parameter of a reference display device, and a third piece of information can be determined based on the comparison result. For example, the second performance parameters of the two devices can be divided to obtain a ratio coefficient, or the difference between the two devices can be calculated. Furthermore, the calculated ratio coefficient or difference can be processed through a non-linear mapping function, such as converting the difference in device capabilities into a normalized discount coefficient between 0 and 1, as the third piece of information characterizing the accuracy of the target device's brightness performance.

[0066] In some examples, after obtaining the first and third information, the third information can be used as a global correction factor for the base contrast. For instance, the first and third information can be multiplied directly to simulate the discounting effect of dynamic range compression on the base color perception contrast of low-performance display devices, or the influence weight can be calculated based on the third information and superimposed on the first information to obtain the target information.

[0067] According to some embodiments, the second performance parameter of the target display device is determined based on the brightness display sampling results of a second sample including content of different brightness on the target display device. By determining the second performance parameter based on the actual brightness display sampling results, the device performance parameter based on the actual calibration process can more accurately characterize the actual display effect of the target display device. For example, it can more accurately characterize the degree of compression and distinguishability of the display device when presenting brightness differences, thereby improving the accuracy of the interface readability score.

[0068] In one example, the calibration process for the second performance parameter of the target display device is implemented as follows: a second sample image containing a standard grayscale test map from pure black to pure white is presented on the target display device, and then the absolute luminance value of each luminance level actually output on the screen is measured using an optical luminance meter or colorimeter. Based on this, the second performance parameter can be determined by analyzing the ratio of the highest absolute luminance to the black level luminance or the deviation of the fitted device response curve.

[0069] Besides optical sampling using physical instruments, the second performance parameter can also be determined in other ways. For example, the corresponding second performance parameter can be read by directly querying preset parameters such as the display device's maximum supported brightness and factory-set contrast ratio.

[0070] In some examples, the first piece of information representing color perception contrast, the second piece of information representing the attenuation of transparent colors, and the third piece of information representing the accuracy of brightness differences can be used together. For example, the first piece of information can be used as a base value, combined with the second piece of information to correct for local contrast loss caused by semi-transparent content in the initial display interface, and then the result can be multiplied by the third piece of information to determine the display effect discount caused by the difference in brightness display performance of the display device, thereby more comprehensively and accurately reflecting the readability of elements with transparent properties when presented on different display devices.

[0071] According to some embodiments, method 200 further includes: determining the element type of the target element, including graphics or text; in response to determining that the target element is text, determining the font size or weight of the target element; determining a text perception score characterizing the readability of the text based on the font size or weight of the target element; and adjusting the target information based on the text perception score. This enables more refined perception compensation for text objects, more accurately determining the readability of text content, thereby improving the accuracy of text display on the interface.

[0072] In this example, font size refers to the physical or logical size of the text characters in screen space, which determines the size of the display area occupied by the text, while font weight refers to the thickness of the text strokes, which determines the relative proportion of the display area occupied by the text lines.

[0073] In some examples, the element type of the target element can be further categorized into finer-grained categories. For instance, target elements of graphic or image type can be further subdivided into control outlines (such as the border line of an input box), status indicators (such as unread message red dots, battery icons), background fill blocks, interactive trigger areas, etc. Based on this, the readability of different types of target elements can be more accurately determined, and more precise adjustments to interface display parameters can be made to improve the accuracy of interface display.

[0074] In some examples, a mapping relationship can be established between font size, font weight, and perceptual sensitivity to determine the text perception score. For instance, when the font size of a target element is smaller than a preset standard size, or the font weight is thin, the system assigns it a text perception score less than 1 to indicate poor readability and an increased risk of inaccurate display. Conversely, for large-font or extremely bold text, a score equal to or slightly greater than 1 is assigned to reflect its inherent high recognizability. Based on this, the readability of text content can be determined more accurately, thereby improving the accuracy of text display on the interface. After obtaining the text perception score, it can be used as an adjustment factor directly on the aforementioned target information. For example, the target information can be multiplied by the text perception score. If the text is small and thin (i.e., the text perception score is low), the multiplication operation will lower the final target information, thereby triggering adjustment steps for that text element to improve display accuracy.

[0075] In step S204, when the target information is found to meet preset conditions (e.g., the target score is less than or equal to a preset scoring threshold), an adjustment strategy can be dynamically generated based on the difference between the target information and the preset conditions (e.g., the difference between the target score and the scoring threshold). Specific adjustment methods may include: automatically increasing the opacity in the foreground display parameters; increasing the color difference between the foreground and background (e.g., lowering the background brightness or increasing the foreground brightness); for text elements, style rewriting can be triggered to increase their font size or weight, thereby obtaining optimized second display information. Based on this, step S205 can then be used to obtain a target display interface corresponding to the optimized second display information. This target display interface has better readability, thereby improving the accuracy of the interface display.

[0076] In some examples, step S204 can also match the target score with preset score ranges corresponding to different risk levels to generate discretized, readable risk level information, such as low-risk, medium-risk, and high-risk levels. In one example, when the target information is a percentage-based score, a target score below 60 can be mapped to a high-risk level, a target score between 60 and 80 to a medium-risk level, and a target score above 80 to a high-risk level. Based on this, adjustments can be made to the initial display interface for specific risk levels (e.g., high-risk levels) to improve display accuracy.

[0077] In some examples, after the above parameter adjustment steps are completed and the target display interface is obtained, specific drawing instructions can be generated based on the adjusted target display interface, rendering the visual target display interface and displaying it on the screen of the target display device.

[0078] In some examples, the above method 200 can also be applied during the interface development and testing phase based on the display performance parameters of different display devices to determine whether the initial display interface meets the requirements on different display devices. Based on this, the display parameter configuration of the display interface can be optimized, thereby improving the accuracy of the interface display.

[0079] Figure 3 A flowchart of a method 300 for determining a display interface according to an exemplary embodiment of the present disclosure is shown. Figure 3 As shown, method 300 includes: Step S301: Obtain first display information. In this example, the first display information includes the foreground display parameters of the target element in the initial display interface and the background display parameters of the initial display interface. The foreground display parameters and the background display parameters include brightness dimension, transparency dimension, or color feature dimension.

[0080] Step S302: Obtain the display performance information of the target display device. In this example, the display performance information includes a first performance parameter characterizing the degree of display attenuation of transparent colors by the target display device and a second performance parameter characterizing the target display device's ability to handle brightness differences.

[0081] Step S303: Determine the first score representing the degree of color perception contrast based on the color feature values ​​of the foreground display parameters and the background display parameters.

[0082] Step S304: Determine a second score characterizing the degree of attenuation of transparent color display based on the transparency value of the foreground display parameter and the first performance parameter.

[0083] Step S305: Based on the second performance parameters of the target display device and the second performance parameters of the reference display device, determine the third score characterizing the accuracy of brightness difference performance.

[0084] Step S306: Determine the target score representing the readability of the target element in the initial display interface based on the first score, the second score, and the third score.

[0085] Step S307: In response to the target score being less than or equal to the score threshold, adjust the first display information based on the target score to obtain the second display information.

[0086] Step S308: Adjust the initial display interface based on the second display information to obtain the target display interface.

[0087] By applying the above method 300, the readability of the interface can be determined based on the hardware performance characteristics of the target display device. By combining the device capabilities and the display parameters of the interface to calculate the target score, the perceptual deviation caused by the performance differences of the display devices can be accurately quantified. This allows for a more accurate determination of the readability of the interface in the real usage environment (target display device). Furthermore, when the readability risk is high, the interface configuration parameters can be adjusted in a targeted manner to improve the accuracy of the interface display.

[0088] According to one aspect of this disclosure, an apparatus for determining a display interface is also provided. Figure 4 A structural block diagram of an apparatus 400 for determining a display interface according to an exemplary embodiment of the present disclosure is shown. Figure 4 As shown, the device 400 includes: The first acquisition unit 401 is configured to acquire first display information, wherein the first display information includes foreground display parameters of the target element in the initial display interface and background display parameters of the initial display interface; The second acquisition unit 402 is configured to acquire display performance information of the target display device; The first determining unit 403 is configured to determine target information characterizing the readability of the target element in the initial display interface based on the first display information and display performance information. The first adjustment unit 404 is configured to adjust the first display information based on the target information in response to the target information meeting preset conditions, so as to obtain the second display information; and The second adjustment unit 405 is configured to adjust the initial display interface based on the second display information to obtain the target display interface.

[0089] According to some embodiments, the foreground display parameters and background display parameters include at least one feature dimension, which includes at least one of the following: brightness dimension, transparency dimension, or color feature dimension, and the display performance information includes display performance parameters corresponding to each of the at least one feature dimension, wherein the display performance parameters corresponding to each feature dimension are used to characterize the performance capability of the target display device for that feature dimension.

[0090] According to some embodiments, the foreground display parameters and background display parameters include a color feature dimension and a transparency dimension, and the display performance information includes a first performance parameter characterizing the degree of display attenuation of transparent colors by the target display device. The first determining unit 403 includes: a first determining subunit configured to determine first information characterizing the degree of color perception contrast based on the color feature values ​​of the foreground display parameters and the color feature values ​​of the background display parameters; a second determining subunit configured to determine second information characterizing the degree of display attenuation of transparent colors based on the transparency value of the foreground display parameters and the first performance parameter; and a third determining subunit configured to determine target information based on the first information and the second information.

[0091] According to some embodiments, the second determining subunit is configured to: perform exponential calculation using the transparency value of the foreground display parameter and the first performance parameter as the base and exponent, respectively, to obtain the second information.

[0092] According to some embodiments, the first determining subunit is configured to: determine the equivalent foreground color feature value of the target element based on the transparency value of the foreground display parameter, the color feature value of the foreground display parameter, and the color feature value of the background display parameter; and determine first information based on the equivalent foreground color feature value and the color feature value of the background display parameter.

[0093] According to some embodiments, the first performance parameter of the target display device is determined based on the brightness display sampling results or color display sampling results of a first sample including different transparent color content on the target display device.

[0094] According to some embodiments, the foreground display parameters and background display parameters include a color feature dimension and a brightness dimension, and the display performance information includes a second performance parameter characterizing the target display device's ability to perform to brightness differences. The first determining unit 403 includes: a first determining subunit configured to determine first information characterizing the degree of color perception contrast based on the color feature values ​​of the foreground display parameters and the color feature values ​​of the background display parameters; a fourth determining subunit configured to determine third information characterizing the accuracy of brightness difference performance based on the second performance parameters of the target display device and the second performance parameters of the reference display device; and a fifth determining subunit configured to determine target information based on the first information and the third information.

[0095] According to some embodiments, the second performance parameter of the target display device is determined based on the brightness display sampling results of a second sample including content with different brightness on the target display device.

[0096] According to some embodiments, the apparatus 400 further includes: a second determining unit configured to determine the element type of the target element, the element type including graphics or text; a third determining unit configured to determine the font size or weight of the target element in response to determining that the target element is text; a fourth determining subunit configured to determine a text perception score characterizing the readability of the text based on the font size or weight of the target element; and a third adjusting unit configured to adjust the target information based on the text perception score.

[0097] The collection, storage, use, processing, transmission, provision, and disclosure of various types of information, including user personal information, in this technical solution comply with relevant laws and regulations and do not violate public order and good morals.

[0098] According to another aspect of this disclosure, an electronic device is also provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method described above for determining a display interface.

[0099] According to another aspect of this disclosure, a non-transitory computer-readable storage medium storing computer instructions is also provided, wherein the computer instructions are used to cause the computer to perform the above-described method for determining a display interface.

[0100] According to another aspect of this disclosure, a computer program product is also provided, comprising a computer program, wherein the computer program, when executed by a processor, implements the above-described method for determining a display interface.

[0101] refer to Figure 5 The present invention describes a structural block diagram of an electronic device 500 that can serve as a server or client of the present disclosure, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0102] like Figure 5As shown, device 500 includes a computing unit 501, which can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) 502 or a computer program loaded from storage unit 508 into random access memory (RAM) 503. RAM 503 may also store various programs and data required for the operation of device 500. The computing unit 501, ROM 502, and RAM 503 are interconnected via bus 504. Input / output (I / O) interface 505 is also connected to bus 504.

[0103] Multiple components in device 500 are connected to I / O interface 505, including: input unit 506, output unit 507, storage unit 508, and communication unit 509. Input unit 506 can be any type of device capable of inputting information to device 500. Input unit 506 can receive input numerical or character information and generate key signal inputs related to user settings and / or function control of the electronic device, and may include, but is not limited to, a mouse, keyboard, touchscreen, trackpad, trackball, joystick, microphone, and / or remote control. Output unit 507 can be any type of device capable of presenting information, and may include, but is not limited to, a monitor, speaker, video / audio output terminal, vibrator, and / or printer. Storage unit 508 may include, but is not limited to, a hard disk and an optical disk. Communication unit 509 allows device 500 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks, and may include, but is not limited to, modems, network cards, infrared communication devices, wireless communication transceivers, and / or chipsets, such as Bluetooth™ devices, 802.11 devices, WiFi devices, WiMax devices, cellular communication devices, and / or the like.

[0104] The computing unit 501 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 501 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 501 performs the various methods and processes described above, such as methods for determining a display interface. For example, in some examples, the methods for determining a display interface can be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 508. In some examples, part or all of the computer program can be loaded and / or installed on device 500 via ROM 502 and / or communication unit 509. When the computer program is loaded into RAM 503 and executed by the computing unit 501, one or more steps of the methods for determining a display interface described above can be performed. Alternatively, in other embodiments, the computing unit 501 can be configured to perform methods for determining a display interface by any other suitable means (e.g., by means of firmware).

[0105] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0106] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0107] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0108] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0109] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), the Internet, and blockchain networks.

[0110] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0111] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0112] While embodiments or examples of this disclosure have been described with reference to the accompanying drawings, it should be understood that the methods, systems, and devices described above are merely exemplary embodiments or examples, and the scope of the invention is not limited by these embodiments or examples, but only by the granted claims and their equivalents. Various elements in the embodiments or examples may be omitted or replaced by their equivalents. Furthermore, the steps may be performed in a different order than that described in this disclosure. Further, various elements in the embodiments or examples may be combined in various ways. Importantly, as the technology evolves, many elements described herein can be replaced by equivalents that appear after this disclosure.

Claims

1. A method for determining a display interface, comprising: Obtain first display information, wherein the first display information includes foreground display parameters of the target element in the initial display interface and background display parameters of the initial display interface; Obtain display performance information of the target display device; Based on the first display information and the display performance information, target information characterizing the readability of the target element in the initial display interface is determined; In response to the target information satisfying the preset conditions. The first display information is adjusted based on the target information to obtain the second display information; and The initial display interface is adjusted based on the second display information to obtain the target display interface.

2. The method as described in claim 1, wherein, The foreground display parameters and the background display parameters include at least one feature dimension, which includes at least one of the following: brightness dimension, transparency dimension, or color feature dimension, and wherein the display performance information includes display performance parameters corresponding to at least one feature dimension, and the display performance parameters corresponding to each feature dimension are used to characterize the performance capability of the target display device for that feature dimension.

3. The method as described in claim 2, wherein, The foreground display parameters and the background display parameters include a color feature dimension and a transparency dimension. The display performance information includes a first performance parameter characterizing the degree of display attenuation of transparent colors by the target display device. The target information characterizing the readability of the target element in the initial display interface, based on the first display information and the display performance information, includes: First information characterizing the degree of color perception contrast is determined based on the color feature values ​​of the foreground display parameters and the color feature values ​​of the background display parameters; Based on the transparency value of the foreground display parameter and the first performance parameter, second information characterizing the degree of attenuation of transparent color display is determined; and The target information is determined based on the first information and the second information.

4. The method of claim 3, wherein, The second information characterizing the degree of attenuation of transparent color display, based on the transparency value of the foreground display parameter and the first performance parameter, includes: The transparency value of the foreground display parameter and the first performance parameter are used as the base and exponent, respectively, to perform exponential calculations to obtain the second information.

5. The method of claim 3 or 4, wherein, The first information characterizing the degree of color perception contrast based on the color feature values ​​of the foreground display parameters and the background display parameters includes: Based on the transparency value of the foreground display parameter, the color feature value of the foreground display parameter, and the color feature value of the background display parameter, the equivalent foreground color feature value of the target element is determined; and The first information is determined based on the equivalent foreground color feature value and the background display parameter color feature value.

6. The method according to any one of claims 3-5, wherein, The first performance parameter of the target display device is determined based on the brightness display sampling results or color display sampling results of a first sample including different transparent color content on the target display device.

7. The method according to any one of claims 2-6, wherein, The foreground display parameters and the background display parameters include a color feature dimension and a brightness dimension. The display performance information includes a second performance parameter characterizing the target display device's ability to handle brightness differences. The target information characterizing the readability of the target element in the initial display interface, based on the first display information and the display performance information, includes: First information characterizing the degree of color perception contrast is determined based on the color feature values ​​of the foreground display parameters and the color feature values ​​of the background display parameters; Based on the second performance parameters of the target display device and the second performance parameters of the reference display device, third information characterizing the accuracy of brightness difference performance is determined; and The target information is determined based on the first information and the third information.

8. The method of claim 7, wherein, The second performance parameter of the target display device is determined based on the brightness display sampling results of a second sample including content with different brightness levels on the target display device.

9. The method according to any one of claims 1-8, wherein, The method further includes: Determine the element type of the target element, where the element type includes graphics or text; In response to determining that the target element is text, determine the font size or weight of the target element; Based on the font size or weight of the target element, a text perception score representing text readability is determined; and The target information is adjusted based on the text perception score.

10. An interface display device, comprising: The first acquisition unit is configured to acquire first display information, wherein the first display information includes foreground display parameters of the target element in the initial display interface and background display parameters of the initial display interface; The second acquisition unit is configured to acquire display performance information of the target display device; The first determining unit is configured to determine target information characterizing the readability of the target element in the initial display interface based on the first display information and the display performance information. A first adjustment unit is configured to adjust the first display information based on the target information in response to the target information satisfying a preset condition, so as to obtain second display information; and The second adjustment unit is configured to adjust the initial display interface based on the second display information to obtain the target display interface.

11. An electronic device, comprising: At least one processor; as well as A memory that is communicatively connected to the at least one processor; in The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-9.

12. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-9.

13. A computer program product comprising a computer program, wherein, The computer program, when executed by a processor, implements the method according to any one of claims 1-9.