Interface display method and device
By dynamically adjusting the interface display properties of the terminal device, determining the focus area based on user input and visually emphasizing it, the problem of distraction caused by complex interface elements is solved, and the user's immersion and experience are enhanced.
Patent Information
- Application Number
- PCT/CN2025/076789
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-20
- Filing Date
- 2025-02-11
- Publication Date
- 2025-09-25
AI Technical Summary
The interface design of existing terminal devices fails to fully utilize the possibilities provided by modern technology, resulting in complex interface elements and a lack of visual focus, which distracts users and reduces their sense of immersion and experience.
By receiving user input, determining the focus area, and dynamically adjusting the interface display properties based on the area, such as brightness, font size, and layer hierarchy, the user's focus area is highlighted, the display properties of non-focus areas are reduced, and the visual focus is improved.
Effectively enhance the user's sense of immersion and experience, allowing users to more quickly identify and focus on areas of interest, while reducing visual interference in non-areas of interest.
Smart Images

Figure CN2025076789_25092025_PF_FP_ABST
Abstract
Description
Method and device for interface display
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on March 20, 2024, with application number 202410326833.0 and application name “A method and device for interface display”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminal technology, and in particular to a method and device for interface display. Background Art
[0003] The field of terminal technology encompasses a wide range of communications, computing, and display technologies, aiming to optimize the user experience and improve the efficiency of terminal devices through innovative technological means. User interface design and display technologies play a central role in this field, as they directly influence how users interact with devices and the experiences and effects they experience from these interactions.
[0004] In the prior art, although the hardware performance of terminal devices continues to improve, enabling the devices to support more complex and diverse interface display effects, the design of the interface often fails to keep pace with the pace of such hardware advancement. The interfaces of many devices still adopt a relatively traditional and static design, and do not fully utilize the possibilities provided by modern technology, such as dynamic interface elements, personalized recommended content, and interface adaptability based on user behavior. In addition, with the surge in the number of applications, users often face the problem of information overload when using terminal devices. The content displayed on the screen is complicated and lacks focus, which not only distracts the user's attention but also reduces the user experience. Therefore, it is necessary to provide an interface display solution that can enhance the user's sense of immersion and experience. Summary of the Invention
[0005] The technical problem to be solved by the embodiments of the present application is to provide a method and device for interface display that can enhance the user's sense of immersion and experience.
[0006] In a first aspect, an embodiment of the present application provides an interface method, which is applied to an electronic device, comprising a display screen; the method may include: the display screen displays a first interface; receiving a first input from a user in a first area in the first interface, and determining a first focus area affected by the first area; the first attribute value and the second attribute value corresponding to the first interface display attributes of the first focus area and the first non-focus area in the first interface are the same, or the first attribute value and the second attribute value are different, wherein the first non-focus area is an area outside the first focus area in the first interface; adjusting the value of the first interface display attribute of the first focus area and / or the first non-focus area based on the type of the first interface display attribute, the display screen displays a second interface, and the third attribute value and the fourth attribute value corresponding to the first interface display attributes of the first focus area and the first non-focus area in the second interface are different.
[0007] In existing interface display solutions, as application functions continue to increase, interface elements become increasingly complex. Furthermore, because the area of user focus lacks sufficient visual focus, users are easily distracted by other areas, reducing their sense of immersion and experience. To address this technical issue, the embodiments of the present application can receive user input, determine the area of user focus, and dynamically adjust the properties of interface elements based on the content in the area of user focus, enabling users to more quickly identify and focus on the area of their focus, thereby enhancing their sense of immersion and experience. Specifically, in an embodiment of the present application, user input to the display screen (for example, operations such as touching and gazing at the display screen by the user) is first received, and a first area in the first interface of the display screen where the user input acts is determined; further, a corresponding first focus area (for example, an application window or application control contained in the first area is determined as the first focus area) and a first non-focus area (that is, an area outside the first focus area in the first interface) can be determined based on the above-mentioned first area, and the values of the interface display properties corresponding to the first focus area and the first non-focus area are adjusted respectively through the type of interface display properties in the first interface (for example, the type of the interface display property can be determined based on the content in the first focus area, and the type of the interface display property can include brightness type, font size type, and layer level type, etc.) to display the second interface, wherein the values of the interface display properties of the first focus area and the first non-focus area in the second interface are different, so as to achieve visual emphasis on the area of user focus and enhance the user's immersion and experience. In summary, in the embodiments of the present application, different display effects can be provided based on the user's interactive behavior (for example, different types of interface display attributes are determined based on the content in the focus area, and the values of the interface display attributes are adjusted in a targeted manner based on the types of the interface display attributes), so that there is sufficient visual focus in the focus area to guide the user's attention, thereby increasing the user's sense of immersion and improving the overall user experience.
[0008] In one possible implementation, the first input is a user's gaze operation; the electronic device further includes at least one front-facing camera; the receiving of the user's first input and determining the first area in the first interface where the first input acts include: monitoring the user's eye movement data through the at least one front-facing camera; and determining the first area corresponding to the user's gaze operation based on the eye movement data. In an embodiment of the present application, the user's eye movement data can be monitored through at least one front-facing camera in the electronic device, and the first area corresponding to the user's gaze operation can be determined based on the eye movement data. For example, when the user gazes at an area in the first interface for a certain period of time, the system responds by analyzing the user's eye movement data to determine the area the user is currently gazing at, responding to the user's needs in a more diverse manner, and more accurately identifying the user's area of interest in subsequent interface display solutions.
[0009] In one possible implementation, N application windows are displayed in the first interface, where N is a positive integer greater than 0; determining the first focus area corresponding to the first area includes: detecting the number Q of complete application windows displayed in the first area; if Q is 0, and M application controls in the first target application window are displayed in the first area, then determining the display area of the M application controls as the first focus area, wherein the first target application window is one of the N application windows, and M is a positive integer greater than 0; or, if Q is greater than or equal to 1, then determining the display area of P application windows out of the Q as the first focus area, wherein P is a positive integer less than or equal to Q; or, if Q is greater than or equal to 1, and the M application controls in the first target application window are displayed in the first area, then determining the display area of P application windows out of the Q as the first focus area. In an embodiment of the present application, the corresponding first focus area can be dynamically determined based on the number of application windows and application controls displayed in the first area. Specifically, the embodiment of the present application detects the number Q of complete application windows displayed in the first area and dynamically determines the first focus area based on the different numbers of application windows Q, thereby more accurately locating the user's visual focus; further, when the first area does not contain any complete application windows (i.e., Q is 0), but displays M application controls in the first target application window, the display area of the above M application controls can be determined as the first focus area; or, when Q is greater than or equal to 1, that is, when the first area contains Q complete application windows, the display area of P application windows among the above Q application windows (e.g., the P application windows with the highest layer level among the Q application windows) can be determined as the first focus area. In addition, if the first area contains both complete application windows and application controls, the display area of P application windows among the above Q application windows is determined as the first focus area. In summary, the embodiment of the present application can dynamically identify the user's focus area based on the number of interface elements when there are multiple interface elements (e.g., application windows and application controls) in the first area, thereby improving the accuracy of identifying the user's focus area.
[0010] In one possible implementation, determining the display areas of P of the Q application windows as the first focus area includes: determining the P application windows with the highest layer levels from the Q application windows; and determining the display areas of the P application windows as the first focus area. Specifically, in an embodiment of the present application, by identifying the layer levels of the application windows and selecting the application window with the highest layer level, it is possible to more accurately determine the area of user focus in a multi-window environment (for example, in the case where multiple application window areas intersect, the application window with the highest layer level is preferentially selected as the focus area), and achieve a visual emphasis effect for the focus area to ensure that the user's attention is focused on the most important task or information at the moment.
[0011] In one possible implementation, the first input is a touch operation by a user; the receiving the first input from the user and determining the first area in the first interface where the first input acts includes: receiving a touch operation from the user on the display screen and determining the first area where the touch operation acts. In an embodiment of the present application, a touch operation from the user on the display screen can be received and the first area corresponding to the touch operation can be determined. For example, when a user lightly touches an area on the display screen, the system determines that the area where the current touch operation acts is the first area, and subsequently more accurately identifies the user's area of interest based on the first area.
[0012] In one possible implementation, N application windows are displayed in the first interface, where N is a positive integer greater than 0; the determining the first focus area corresponding to the first area includes: if the first area occupies part or all of the area of the second target application window, then the display area of the second target application window is determined as the first focus area, and the second target application window is one of the N application windows. In an embodiment of the present application, the corresponding focus area can be determined by judging the area where the user's touch operation acts. Specifically, if the area corresponding to the user's touch operation is within a certain application window (that is, the first area covers part or all of the area of a certain application window), the display area of the application window can be determined as the first focus area. In summary, in an embodiment of the present application, the corresponding focus area can be accurately determined through the first area where the user's touch operation acts, and the interface attributes can be adjusted based on the focus area in the subsequent interface display scheme, so as to achieve visual enhancement for the focus area and optimize the user experience.
[0013] In one possible implementation, the method further includes: determining the specific content included in the first focus area; if the first focus area includes a complete application window, determining the type of the first interface display attribute to be a brightness type; or, if the first focus area does not include a complete application window and includes an application control in the application window, determining the type of the first interface display attribute based on the type of the application control. In an embodiment of the present application, the display attributes of the corresponding interface can be determined according to the type of the application window or application control in the user's focus area. Specifically, in an embodiment of the present application, the specific content included in the first focus area is first determined. If the area includes one or more complete application windows, the display attribute of the first interface can be set to a brightness type; or, if the first focus area does not completely include an application window but includes some application controls in the application window, the display attribute type of the first interface can be determined based on the type of these controls, so that when adjusting the visual effect of the focus area, it can be more in line with the user's needs, thereby improving the user experience; for example, if the user is viewing a complete application window, the user's immersion can be enhanced by reducing the brightness of the non-focus area; or, if the user is focusing on the application control in the incomplete application window, the interface display attributes can be dynamically determined and adjusted by judging the type of the application control to optimize the user experience. In summary, in the embodiments of the present application, the dynamic adjustment of the interface display attributes can be automatically performed based on the interface content that the user is currently paying attention to, so that the best visual adjustment can be obtained without the user performing additional operations, thereby increasing the user's immersion and improving the user's experience.
[0014] In one possible implementation, if the first focus area does not include a complete application window, but includes application controls in the application window, then the type of the first interface display attribute is determined based on the type of the application control, including: determining the type of the application control in the application window; if the application control is a text type, then determining that the type of the first interface display attribute is a font size type; or, if the application control is a multiple layer stacking type, then determining that the type of the first interface display attribute is a layer level type; or, if the application control is a target control type, then determining that the type of the first interface display attribute is a brightness type, and the target control type is a type other than a text type and a multiple layer stacking type. In an embodiment of the present application, if the first focus area does not include a complete application window, but includes application controls in the application window, then the corresponding interface display attributes are determined based on the type of the application control. Specifically, first determine the type of application control in the interface; then, determine the display properties of the interface based on the type of application control. For example, if the user is reading text, that is, the application control is of text type, determine that the interface display property of the current focus area is the text size property; if the user is watching a scene that includes both video and barrage, that is, the application control is of multiple layer stacking type, then determine that the interface display property of the current focus area is the layer level property; if the user is watching a control type other than text type and multiple layer stacking type, then determine that the interface display property of the current focus area is the brightness property. In summary, the embodiment of the present application can dynamically determine the corresponding interface display properties based on the type of application control when the focus area includes application controls in some application windows, so as to more accurately identify the elements that the user is actually concerned about, and make corresponding property adjustments in the subsequent interface display scheme to enhance the user experience.
[0015] In a possible implementation, if the type of the first interface display attribute is a brightness type; the adjusting the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, the display screen displays the second interface, including: increasing the brightness in the first focus area, and / or decreasing the brightness in the first non-focus area, the display screen displays the second interface, and the brightness in the first focus area in the second interface is higher than the brightness in the first non-focus area. Specifically, in an embodiment of the present application, after determining that the type of the first interface display attribute is a brightness type, the user's focus area can be highlighted by increasing the brightness of the focus area and / or decreasing the brightness of the non-focus area, thereby achieving an immersive use effect. In summary, in an embodiment of the present application, by visually emphasizing the area of user focus (i.e., increasing the brightness of the focus area and / or decreasing the brightness of the non-focus area), the user experience can be effectively improved, making it easier for the user to focus on the content of the focus area, and reducing the time and energy consumed in identifying and understanding interface information.
[0016] In a possible implementation, if the type of the first interface display attribute is a font size type; the adjusting the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, the display screen displays the second interface, including: enlarging the font size in the first focus area, the display screen displays the second interface, and the font size in the first focus area in the second interface is larger than the font size in the first non-focus area. Specifically, in the embodiment of the present application, after determining that the type of the first interface display attribute is a font size type, the second interface can be displayed on the display screen by adjusting the font size of the focus area. In the second interface, the font size of the first focus area is enlarged, so that the font size in the first focus area is larger than the font size in the first non-focus area. This adjustment method can effectively highlight the user's focus content. By enlarging the font size of the focus area instead of uniformly adjusting the font size of the entire interface, the user can more quickly identify and understand key information, thereby improving reading efficiency and user experience. In summary, in the embodiment of the present application, when the user's focus content is font, the user's attention can be focused on the focus area by appropriately adjusting the font size, thereby enhancing the user's immersion and usage experience.
[0017] In one possible implementation, if the type of the first interface display attribute is a layer level type; the adjusting the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, the display screen displays the second interface, including: increasing the layer level in the first focus area, the display screen displays the second interface, and the layer level in the first focus area in the second interface is higher than the layer level in the first non-focus area. Specifically, in an embodiment of the present application, after determining that the type of the first interface display attribute is a multiple layer stacking type, the second interface can be displayed on the display screen by adjusting the layer level, and the layer level of the focus area can be adjusted based on the recognition result. For example, when watching a video, when the barrage and video content appear at the same time, after determining that the user is specifically paying attention to a certain layer in the video content or the barrage, the layer level of the layer can be increased to make the area more visually prominent, while the layer level of the non-focus area can be relatively lowered, thereby reducing visual interference. In summary, in an embodiment of the present application, the layer level of elements in the interface can be dynamically adjusted based on the user's focus area, and the interface display can be optimized according to the user's actual usage scenario (such as barrage attention in video watching) to enhance the user's immersion and experience.
[0018] In one possible implementation, the method further includes: receiving a second input from the user, and determining a second area in the second interface where the second input acts; determining a second focus area corresponding to the second area; the values of the second interface display attribute of the second focus area and the second non-focus area in the second interface are respectively a fifth attribute value and a sixth attribute value, wherein the second non-focus area is an area outside the second focus area in the second interface; adjusting the fifth attribute value of the second focus area and / or the sixth attribute value of the second non-focus area based on the type of the second interface display attribute, the display screen displays a third interface, and in the third interface, the values of the second interface display attribute of the second focus area and the second non-focus area are respectively a seventh attribute value and an eighth attribute value, and the seventh attribute value and the eighth attribute value are different. In an embodiment of the present application, if the user input is detected again when the first focus area already exists, the second focus area is determined by identifying the user input and its action area, and then the value of the interface display attribute is dynamically adjusted to highlight the new area of focus of the user. Specifically, in an embodiment of the present application, the user's second input can be received and the area affected by the second input can be determined. Then, based on the area, a second focus area and a second non-focus area can be determined. Based on the content of the second focus area, the interface display properties, such as color depth, brightness, layer level, etc., can be determined, and the interface display properties can be adjusted accordingly to emphasize the area of user focus, so that the user can locate key information or operation areas more quickly, while reducing visual interference to non-focus areas.
[0019] In one possible implementation, if the type of the second interface display attribute is brightness; adjusting the fifth attribute value of the second focus area and / or the sixth attribute value of the second non-focus area based on the type of the second interface display attribute includes: determining whether the first focus area is within the second non-focus area; if the first focus area is within the second non-focus area, gradually changing the brightness of the first focus area to a third target brightness within a first preset time period. In an embodiment of the present application, if a new focus area (i.e., the second focus area) is generated after the user inputs again, the position of the original focus area (i.e., the first focus area) is determined. If the first focus area is within the second non-focus area, the brightness of the first focus area is gradually reduced until it reaches a predetermined lower brightness level, thereby avoiding abrupt brightness changes. If the focus area is switched back to the first focus area again within a short period of time, the operation of re-increasing the brightness of the first focus area is avoided, thereby improving the comfort of use and thus improving the user experience.
[0020] In one possible implementation, the method further includes: monitoring the user's input; if it is detected that the number of inputs by the user within a second preset time period is greater than a first switching number threshold, fixing the third attribute value and the fourth attribute value in a third preset time period; or, if it is detected that the number of inputs by the user within the second preset time period is less than the first switching number threshold, adjusting the attributes of the interface displayed on the display screen based on the user's input. In an embodiment of the present application, by monitoring the user's input and determining the number of user inputs within a certain period of time, corresponding processing is performed. Specifically, when the user's focus area switches frequently in a short period of time and exceeds a preset threshold, the system will not process it, which can prevent the user experience from being degraded due to frequent switching or user misoperation; or, if the number of user focus area switches within a short period of time does not exceed a preset threshold, the system will adjust the interface attributes displayed on the display screen (such as adjusting brightness, layer level and font size attributes, etc.) based on the user's input to emphasize the area of user focus and increase the user's immersion. In summary, the embodiment of the present application monitors the number of user inputs within a certain period of time and performs corresponding processing, which can not only avoid the interference of frequent changes in the interface caused by user misoperation, but also adjust the interface according to user needs when necessary, thereby improving the overall user experience.
[0021] In a second aspect, an embodiment of the present application provides an interface display device, the device including a display screen and may include:
[0022] A first interface unit, wherein the display screen displays a first interface;
[0023] a first input unit, configured to receive a first input from a user and determine a first area in the first interface where the first input acts;
[0024] a first region of interest unit, configured to determine a first region of interest corresponding to the first region; wherein the values of the first interface display attributes of the first region of interest and the first non-region of interest in the first interface are respectively a first attribute value and a second attribute value, wherein the first non-region of interest is an area outside the first region of interest in the first interface;
[0025] A second interface determination unit adjusts the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, the display screen displays a second interface, and in the second interface, the values of the first interface display attributes of the first focus area and the first non-focus area are respectively a third attribute value and a fourth attribute value, and the third attribute value and the fourth attribute value are different.
[0026] In existing interface display solutions, as application functions continue to increase, interface elements become increasingly complex. Furthermore, because the area of user focus lacks sufficient visual focus, users are easily distracted by other areas, reducing their sense of immersion and experience. To address this technical issue, the embodiments of the present application can receive user input, determine the area of user focus, and dynamically adjust the properties of interface elements based on the content in the area of user focus, enabling users to more quickly identify and focus on the area of their focus, thereby enhancing their sense of immersion and experience. Specifically, in an embodiment of the present application, user input to the display screen (for example, operations such as touching and gazing at the display screen by the user) is first received, and a first area in the first interface of the display screen where the user input acts is determined; further, a corresponding first focus area (for example, an application window or application control contained in the first area is determined as the first focus area) and a first non-focus area (that is, an area outside the first focus area in the first interface) can be determined based on the above-mentioned first area, and the values of the interface display properties corresponding to the first focus area and the first non-focus area are adjusted respectively through the type of interface display properties in the first interface (for example, the type of the interface display property can be determined based on the content in the first focus area, and the type of the interface display property can include brightness type, font size type, and layer level type, etc.) to display the second interface, wherein the values of the interface display properties of the first focus area and the first non-focus area in the second interface are different, so as to achieve visual emphasis on the area of user focus and enhance the user's immersion and experience. In summary, in the embodiments of the present application, different display effects can be provided based on the user's interactive behavior (for example, different types of interface display attributes are determined based on the content in the focus area, and the values of the interface display attributes are adjusted in a targeted manner based on the types of the interface display attributes), so that there is sufficient visual focus in the focus area to guide the user's attention, thereby increasing the user's sense of immersion and improving the overall user experience.
[0027] In a possible implementation, the first input is a user's gaze operation; the device further includes at least one front-facing camera; and the first input unit is specifically configured to:
[0028] monitoring the user's eye movement data through the at least one front-facing camera;
[0029] A first area corresponding to the user's gaze operation is determined based on the eye movement data.
[0030] In a possible implementation, N application windows are displayed on the first interface, where N is a positive integer greater than 0; and the second interface determining unit is specifically configured to:
[0031] Detecting the number Q of completely displayed application windows included in the first area;
[0032] If Q is 0, and M application controls in a first target application window are displayed in the first area, the display area of the M application controls is determined as the first focus area, wherein the first target application window is one of the N application windows, and M is a positive integer greater than 0; or
[0033] If Q is greater than or equal to 1, the display areas of P of the Q application windows are determined as the first focus area, where P is a positive integer less than or equal to Q; or, if Q is greater than or equal to 1, and the M application controls in the first target application window are displayed in the first area, the display areas of P of the Q application windows are determined as the first focus area.
[0034] In a possible implementation, the first region of interest unit is specifically configured to:
[0035] Determine P application windows with the highest layer levels from the Q application windows;
[0036] The display areas of the P application windows are determined as the first focus area.
[0037] In a possible implementation, the first input is a touch operation of a user; and the first input unit is specifically configured to:
[0038] A touch operation of the user on the display screen is received, and a first area affected by the touch operation of the user is determined.
[0039] In a possible implementation, N application windows are displayed on the first interface, where N is a positive integer greater than 0; and the second interface determining unit is specifically configured to:
[0040] If the first area occupies part or all of the area of the second target application window, the display area of the second target application window is determined as the first focus area, and the second target application window is one of the N application windows.
[0041] In a possible implementation, the apparatus further includes:
[0042] A first area of interest content determining unit, configured to determine specific content included in the first area of interest;
[0043] The first interface display attribute determination unit determines that the type of the first interface display attribute is a brightness type if the first focus area includes a complete application window; or, if the first focus area does not include a complete application window and includes an application control in the application window, determines the type of the first interface display attribute based on the type of the application control.
[0044] In a possible implementation, the first interface display attribute determining unit is specifically configured to:
[0045] Determining the type of the application control in the application window;
[0046] If the application control is of text type, determining that the type of the first interface display attribute is a font size type; or,
[0047] If the application control is a multi-layer stacking type, determining that the type of the first interface display attribute is a layer level type; or,
[0048] If the application control is a target control type, it is determined that the type of the first interface display attribute is a brightness type, and the target control type is a type other than a text type and a multiple layer stacking type.
[0049] In a possible implementation, if the type of the first interface display attribute is a brightness type, the second interface determination unit is specifically configured to:
[0050] The brightness in the first focus area is increased, and / or the brightness in the first non-focus area is decreased, and the display screen displays a second interface, in which the brightness in the first focus area is higher than the brightness in the first non-focus area.
[0051] In a possible implementation, if the type of the first interface display attribute is a font size type; the second interface determination unit is specifically configured to:
[0052] The font size in the first area of interest is enlarged, and the display screen displays a second interface, in which the font size in the first area of interest is larger than the font size in the first non-area of interest.
[0053] In a possible implementation, if the type of the first interface display attribute is a layer level type, the second interface determination unit is specifically configured to:
[0054] The layer level in the first area of interest is increased, and the display screen displays a second interface, in which the layer level in the first area of interest is higher than the layer level in the first non-area of interest.
[0055] In a possible implementation, the apparatus further includes:
[0056] a second input unit, configured to receive a second input from the user and determine a second area in the second interface where the second input acts;
[0057] a second region-of-interest unit, configured to determine a second region-of-interest corresponding to the second region; wherein the values of the second interface display attributes of the second region-of-interest and the second non-region-of-interest in the second interface are the fifth attribute value and the sixth attribute value, respectively, wherein the second non-region-of-interest is an area outside the second region of interest in the second interface;
[0058] A third interface determination unit adjusts the fifth attribute value of the second focus area and / or the sixth attribute value of the second non-focus area based on the type of the second interface display attribute. The display screen displays a third interface. In the third interface, the values of the second interface display attributes of the second focus area and the second non-focus area are respectively the seventh attribute value and the eighth attribute value, and the seventh attribute value and the eighth attribute value are different.
[0059] In a possible implementation, if the type of the second interface display attribute is brightness, the third interface determination unit is specifically configured to:
[0060] Determining whether the first region of interest is within the second region of no interest;
[0061] If the first focus area is within the second non-focus area, the brightness of the first focus area is gradually changed to a third target brightness within a first preset time period.
[0062] In a possible implementation, the apparatus further includes:
[0063] A monitoring unit, configured to monitor the user's input;
[0064] The second switching unit fixes the third attribute value and the fourth attribute value in a third preset time period if it is detected that the number of inputs by the user in the second preset time period is greater than the first switching number threshold; or
[0065] The third switching unit adjusts the attributes of the interface displayed on the display screen based on the user input if it is detected that the number of inputs by the user within the second preset time period is less than the first switching number threshold.
[0066] In a third aspect, an embodiment of the present application provides a computer storage medium for storing computer software instructions used in an interface display device provided in the second aspect above, which includes a program designed for executing the above aspect.
[0067] In a fourth aspect, an embodiment of the present application provides a computer program, which includes instructions. When the computer program is executed by a computer, the computer can execute the process executed in the interface display device in the second aspect above.
[0068] In a fifth aspect, the present application provides a terminal device, comprising a processor, a display, and a sensor. The processor is the processor involved in any one of the implementations of the second aspect above, the display is the display involved in any one of the implementations of the second aspect above, and the sensor is the sensor involved in any one of the implementations of the second aspect above. The terminal device may further include a communication interface for communicating with other devices or a communication network.
[0069] In a sixth aspect, the present application provides a smartphone having the function of implementing any one of the interface display methods described in the first aspect. This function can be implemented through hardware or through hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-mentioned functions. BRIEF DESCRIPTION OF THE DRAWINGS
[0070] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the background technology, the drawings required for use in the embodiments of the present application or the background technology will be described below.
[0071] FIG1 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.
[0072] FIG2 is a schematic diagram of a system framework of an electronic device provided in an embodiment of the present application.
[0073] FIG3 is a schematic diagram of an interface display module provided in an embodiment of the present application.
[0074] Figure 4A is a schematic diagram of a folding screen split process provided in an embodiment of the present application.
[0075] FIG4B is a schematic diagram of a gaze operation provided in an embodiment of the present application.
[0076] FIG4C is a schematic diagram of determining a region of interest provided in an embodiment of the present application.
[0077] FIG4D is another schematic diagram of determining a region of interest provided in an embodiment of the present application.
[0078] FIG4E is a schematic diagram of an application window intersection provided in an embodiment of the present application.
[0079] FIG4F is a schematic diagram of a touch operation provided in an embodiment of the present application.
[0080] FIG4G is a schematic diagram of a control brightness adjustment provided in an embodiment of the present application.
[0081] FIG4H is a schematic diagram of a window brightness adjustment provided in an embodiment of the present application.
[0082] FIG4I is a schematic diagram of a control font size adjustment provided in an embodiment of the present application.
[0083] FIG4J is a schematic diagram of a control layer level adjustment provided in an embodiment of the present application.
[0084] FIG5A is a flow chart showing another interface display process provided in an embodiment of the present application.
[0085] FIG5B is a schematic diagram of determining a third interface provided in an embodiment of the present application.
[0086] FIG5C is a schematic diagram of brightness gradient provided in an embodiment of the present application.
[0087] FIG5D is another schematic diagram of brightness gradient provided in an embodiment of the present application.
[0088] FIG6 is a schematic structural diagram of an interface display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0089] The embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.
[0090] The terms "first," "second," "third," and "fourth," etc., in the specification and claims of this application and the accompanying drawings are used to distinguish between different objects, rather than to describe a specific order. In addition, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.
[0091] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0092] As used in this specification, the terms "component," "module," "system," and the like are used to refer to computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program, and / or a computer. By way of illustration, both an application running on a computing device and a computing device can be a component. One or more components can reside in a process and / or an execution thread, and a component can be located on a computer and / or distributed between two or more computers. In addition, these components can be executed from various computer-readable media having various data structures stored thereon. For example, a component can communicate via a local and / or remote process based on a signal having one or more data packets (e.g., data from two components interacting with another component on a local system, a distributed system, and / or a network, such as the Internet interacting with other systems via signals).
[0093] First, some terms in this application are explained to facilitate understanding by those skilled in the art.
[0094] (1) Eye tracking refers to a technical means for measuring eye position and eye movement. This technology is widely used in user interface design and medical diagnosis. Eye tracking technology generally involves monitoring pupil position and eye movement, which can be achieved through optical sensors or cameras. In the embodiments of the present application, eye tracking can be used to analyze the user's attention distribution to visual content and determine the corresponding focus area.
[0095] (2) Touch Panel refers to an input device that can detect the user's touch position and action. It is an indispensable component of modern electronic products, especially mobile devices and touch screen devices, and plays the role of a bridge for intuitive interaction. The technical principles and implementation methods of touch panels are diverse, including resistive, capacitive, infrared and acoustic wave types. Among them, capacitive touch panels are widely used in smartphones and tablets due to their high sensitivity and support for multi-touch. The touch panel senses the touch action of the user's finger or stylus and converts the physical action into an electronic signal, which is then processed and responded to by the device.
[0096] (3) Touch Coordinates refers to the location information of the touch point on a touchscreen device. It is an important component of touch technology and human-computer interaction research, involving touch detection, position resolution, and its application. The touch coordinate process typically includes touch point detection, coordinate positioning, data conversion, and application response stages. The purpose is to accurately capture the user's touch behavior and ensure that the device can respond to the user's operational intentions.
[0097] (4) Eye Movement Data refers to a collection of information that records various parameters during eye movement. This data type has important applications in fields such as psychology, visual science, reading research, and human-computer interaction. Eye movement data usually includes indicators such as eye movement speed, fixation point, pupil size changes, and blinking frequency. These data can be used to analyze an individual's attention allocation, cognitive process, and visual information processing mechanism. Different eye tracking technologies and methods can accurately measure and record eye movements, providing a scientific basis for understanding human visual attention, reading behavior, and how to interact with images or text.
[0098] (5) Contrast refers to the degree of difference in brightness or color between different areas in an image in image processing, photography and visual arts. Regional contrast is different from overall contrast (or global contrast). Regional contrast focuses on the contrast effect of local areas in the image, which can highlight details and textures, making the image more deep and three-dimensional. By enhancing regional contrast, certain parts of the image can be made more eye-catching, improving visual focus, or highlighting the main object in a complex background. In the embodiment of the present application, the regional contrast in the user's area of interest can be adjusted to guide the user's attention and increase the user's sense of immersion.
[0099] (6) Layer Hierarchy refers to the organizational structure of different layers stacked in a certain order to create the final visual effect in graphic design, computer graphics and image processing. It is one of the core concepts in modern digital design and image editing, involving the creation and management of layers and their relationships. The layer hierarchy process usually includes the stages of layer creation, layer sorting, layer merging and layer adjustment. The purpose is to achieve complex image editing and visual effect creation by controlling the properties and order of each layer.
[0100] To facilitate understanding of the embodiments of the present application, the following first introduces an exemplary electronic device provided in the embodiments of the present application.
[0101] Please refer to Figure 1, which is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. The electronic device 100 is a smart terminal device, which can be of various types. The embodiment of the present application does not limit its specific type. For example, the terminal device can be a mobile phone, and can also include a tablet computer, a desktop computer, a desktop computer with a touch-sensitive surface or touch panel, a laptop computer (laptop), a handheld computer, a notebook computer, a smart screen, a wearable device (such as a smart watch, a smart bracelet, etc.), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a car machine, a smart headset, a game console, and can also be an Internet of Things (IOT) device or a smart home device such as a smart water heater, a smart lamp, a smart air conditioner, etc. Please refer to Figure 1, and the following is a detailed introduction to the various components of the electronic device 100 in conjunction with Figure 1:
[0102] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0103] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0104] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. In the embodiment of the present application, the processor 110 is responsible for analyzing the user's facial and eye information captured by the camera 193 to determine the user's gaze point. At the same time, the processor 110 also analyzes the touch operation data transmitted by the touch sensor 180K. Based on this data, the electronic device 100 can make specific adjustments to the local area of the screen that the user is looking at or touching, such as brightening the brightness, adjusting the font size, or adjusting the layer level, so as to enhance the user's immersion when using it.
[0105] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of processor 110, and thus improves the efficiency of adjusting the interface display scheme.
[0106] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0107] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
[0108] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.
[0109] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0110] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0111] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0112] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0113] The modem processor may include a modulator and a demodulator. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.
[0114] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0115] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0116] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0117] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel, which can be a liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode (AMOLED), flexible light-emitting diode (FLED), MiniLED, MicroLED, Micro-oLed, quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1. In the embodiment of the present application, display screen 194 not only displays content but also automatically adjusts certain attributes of specific areas on the screen based on user gaze information captured by camera 193 and touch operations detected by touch sensor 180K, thereby visually emphasizing the user's area of interest and enhancing the user's immersion and experience.
[0118] The electronic device 100 can optimize user interaction through its components, including the camera 193 (including the front camera), display 194, processor 110, and touch sensor 180K. The camera 193 is used to capture the user's facial features and eye movements to obtain information about the user's gaze point during use. The touch sensor 180K, located above the display 194, is used to detect touch operations on or near it. This information is analyzed and processed by the application processor.
[0119] The camera 193 is used to capture image information. These image data are converted into electrical signals through photosensitive elements (such as CCD or CMOS phototransistors), and then passed to the ISP for preliminary processing. The processed digital image signal is output to the DSP for further processing, such as conversion into image signals in standard RGB, YUV and other formats. In interface display applications, the electronic device 100 may include multiple cameras 193, including at least one front camera, which is combined with eye tracking technology to capture the user's gaze point information, and analyze the user's focus area based on the gaze point information to make visual emphasis adjustments to the focus area to enhance the user's immersion.
[0120] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0121] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0122] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.
[0123] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0124] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0125] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0126] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.
[0127] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.
[0128] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.
[0129] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.
[0130] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0131] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.
[0132] The gyro sensor 180B may be used to determine the motion posture of the electronic device 100 .
[0133] The air pressure sensor 180C is used to measure air pressure.
[0134] The magnetic sensor 180D includes a Hall sensor.
[0135] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when electronic device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.
[0136] The distance sensor 180F is used to measure distance.
[0137] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode.
[0138] The ambient light sensor 180L is used to sense the brightness of the ambient light.
[0139] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0140] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy.
[0141] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In an embodiment of the present application, when a user chooses to touch an application window, the application window can be determined as a focus area, thereby increasing the brightness of the focus area and / or reducing the brightness of the non-focus area to enhance the user's immersion. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.
[0142] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone mass in a human vocal part.
[0143] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.
[0144] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0145] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.
[0146] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0147] The software system of the electronic device 100 can adopt one or more of a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture to support the functions of the interface display solution. The embodiment of the present application takes a mobile operating system with a layered architecture as an example to illustrate the software structure of the electronic device 100.
[0148] FIG2 is a schematic diagram of a system framework of an electronic device provided in an embodiment of the present application.
[0149] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other via software interfaces. In some embodiments, a mobile operating system is divided into four layers: application layer 30, framework layer 31, native layer 32, and hardware and hardware abstraction layer 33, from top to bottom.
[0150] The application layer 30 (Application Layer) may include a series of application packages, which are applications that users can directly interact with and provide the main functions and user interface of the device.
[0151] As shown in FIG. 2 , the application layer 30 may include applications such as maps, navigation, shopping, and reading.
[0152] As shown in FIG2 , the framework layer 31 (Framework Layer): can include various management services, such as window management service 311 (WMS), display management service 312 (DMS) and input management service 313 (IMS).
[0153] Window Management Services 311 (WMS) refers to the system service responsible for managing the display, layout, and user interaction of application windows in the operating system. The WMS process typically includes stages such as window creation and destruction, hierarchical management between windows, adjustment of window size and position, and response to user input events, with the goal of providing an efficient, intuitive, and responsive user interface. In embodiments of the present application, control properties and / or window properties can be obtained through Window Management Services 311, and a region of interest can be determined based on a region of interest recognition algorithm.
[0154] Display Management Service 312 (DMS) refers to the system service responsible for managing and controlling display output devices in a computer system. The DMS process generally includes stages such as configuration and management of display devices, scheduling of graphics rendering engines, adjustment and optimization of output signals, and collaborative work in a multi-display device environment. The purpose is to maximize the display effect and ensure the clarity and smoothness of image and video output. In the embodiment of the present application, it can be used to adjust the properties in the interface, such as independent control of regional brightness and / or independent control of regional color, to achieve visual emphasis on the user's focus area, guide the user's attention, and increase the user's immersion.
[0155] Input Management System (IMS) 313 refers to a software framework or service responsible for managing and processing user input in computer and mobile device systems. The IMS process typically includes stages such as input device identification and configuration, input signal capture and parsing, and forwarding input data to appropriate applications or system services, providing an efficient, sensitive, and user-friendly input processing mechanism. In the embodiments of the present application, the user's touch and gaze operations can be monitored through touch tracking and eye tracking, and corresponding interface display adjustments can be made based on the data of the above operations.
[0156] Runtime can refer to all code libraries, frameworks, etc. required for the program to run. For example, the Java virtual machine and core libraries are provided to provide the necessary environment for the operation of the interface display solution.
[0157] As shown in Figure 2, the native layer 32 (Native) refers to an application or service running in the native environment of the operating system. Native may include rendering 321 and synthesis 322, wherein rendering 321 may include view effect processing and filter / shader (Shader), and rendering 321 is responsible for drawing user interface elements on the screen, and using tools such as views and shaders to process visual data such as images and animations. Synthesis 322 may include layer property control and layer Z-axis order control, synthesizing visual elements from different sources into a single image, and involving stacking window content and system graphics to generate the final screen image. In an embodiment of the present application, the native layer 32 can adjust the properties of the interface elements together with the framework layer 31.
[0158] As shown in Figure 2, the hardware and hardware abstraction layer 33 (HAL) acts as an intermediary between the system software and the physical hardware components, abstracting the specific details of the hardware and providing a consistent interface for the upper layer, so that the upper layer can use the hardware features without having to understand the specific information of the hardware. Specifically, the hardware and hardware abstraction layer 33 may include Display, Touch, and Camera. Among them, Display is used to manage the operation of the physical display panel, including brightness, resolution, and refresh rate control; Touch is used to handle the detection and conversion of touch input, enabling the system to use events of touch-sensitive surfaces; Camera is used to manage the device's camera hardware, controlling aspects such as focus, exposure, and image capture. In the embodiment of the present application, the system can detect the focus area on the screen through the input management service 313, and coordinately adjust the visual attributes of the focus area, such as brightness, font size, and layer properties, through the window management service 311 and the display management service 312 to enhance the user experience and immersion. The hardware and hardware abstraction layer 33 layer supports the above functions through interfaces with the device's physical sensors and input / output components.
[0159] Based on the system architecture described in Figures 1 and 2 above, an embodiment of the present application provides an interface display module applied to the above system architecture. Please refer to Figure 3, which is a schematic diagram of an interface display module provided in an embodiment of the present application. The interface display module 40 in Figure 3 may include a user focus area identification unit 401 and a region-independent attribute control unit 402. Among them:
[0160] User focus area identification unit 401: The focus area can be determined based on the user's input information and the layer information of the interface. Specifically, the electronic device can monitor the user's gaze operation based on the front camera, and / or monitor the user's touch operation based on the touch screen, and obtain eye movement data corresponding to the touch operation and / or touch coordinates corresponding to the gaze operation to determine the first area where the input acts on the display screen; further, the corresponding focus area (such as the number of application windows, application controls, layer information and other interface elements in the first area) and the non-focus area (i.e., the area other than the focus area in the user interface) can be determined based on the content in the first area.
[0161] Region-independent attribute control unit 402: The display effect of the display screen can be adjusted based on the specific content of the focus area. In an embodiment of the present application, after the system determines the focus area, it first determines the specific content contained in the focus area. If the area contains one or more complete application windows, the display attribute of the first interface can be set to a brightness type. Alternatively, if the first focus area does not completely contain an application window, but includes certain application controls in the application window, the display attribute type of the first interface can be determined based on the type of these controls, so that when adjusting the visual effect of the focus area, it can be more in line with the user's needs, thereby improving the user experience. For example, if the user is viewing a complete application window, the user's immersion can be enhanced by reducing the brightness of non-focus areas. Alternatively, if the user is focusing on application controls in an incomplete application window, the interface display attributes can be dynamically determined and adjusted by determining the type of application controls. As shown in Figure 3, if the application controls are of a type other than multiple layer stacking types or text types, the current interface display attribute is determined to be a brightness type. The focus area can be visually emphasized by increasing the brightness of the focus area and / or decreasing the brightness of non-focus areas to optimize the user experience. In addition, FIG3 only takes brightness as an example of the interface display attribute. The interface display attributes may also include interface elements such as font size and layer level, which are not specifically limited in the embodiments of the present application.
[0162] Based on the system architecture provided in Figures 1-2 and the interface display module provided in Figure 3, combined with the interface display method provided in the embodiments of this application, the technical problems raised in this application are specifically analyzed and solved.
[0163] Referring to Figure 4A, Figure 4A is a schematic diagram of a folding screen split-screen process provided by an embodiment of the present application. This method can be applied to the system architecture described in Figures 1 and 2 above, wherein the electronic device 100 in Figures 1 and 2 can be used to support and execute steps S500 to S503 of the method process shown in Figure 4A. The method may include the following steps S500 to S503.
[0164] Step S500: The display screen displays a first interface.
[0165] Specifically, the embodiments of the present application can be applied to an electronic device, which includes a display screen and displays a first interface through the display screen.
[0166] Step S501: Receive a first input from a user, and determine a first area in the first interface where the first input acts.
[0167] Specifically, the step of receiving the first user input includes receiving a user operation instruction to the system through a user interaction interface, and determining a specific area on the first interface of the display screen where the instruction is to be applied. For example, the user interaction interface can be any device capable of receiving user input, such as a touch screen or a camera. Once the user input is received, the system further determines the area on the first interface where the input is to be applied, thereby identifying the user's intent and responding accordingly.
[0168] In one possible implementation, the first input is a user's gaze operation; the electronic device further includes at least one front-facing camera; the receiving the user's first input and determining the first area in the first interface where the first input acts include: monitoring the user's eye movement data through the at least one front-facing camera; and determining the first area corresponding to the user's gaze operation based on the eye movement data. Specifically, in an embodiment of the present application, if the user's input is a gaze operation, the user's eye movement data can be monitored by at least one front-facing camera to capture and analyze the user's gaze operation, and the user's eye movement and gaze point can be analyzed through eye tracking technology to identify the specific area on the display screen where the user is looking. This technology can be applied to various electronic devices, such as smartphones, tablets, laptops, or any smart device equipped with a front-facing camera. For example, see Figure 4B, which is a schematic diagram of a gaze operation provided in an embodiment of the present application. As shown in Figure 4B, when a user looks at the display screen in the electronic device 100, the user's eye movement data can be monitored by the front-facing camera 100-A, and the user's eye movement trajectory, dwell point, and gaze duration can be analyzed based on the eye movement data to accurately identify the area corresponding to the user's gaze operation.
[0169] In one possible implementation, the first input is a touch operation of the user; the receiving of the first input of the user and determining the first area on which the first input acts in the first interface includes: receiving the touch operation of the user on the display screen and determining the first area on which the user's touch operation acts. Specifically, in an embodiment of the present application, the user's touch input can be received through its touch screen interface, including but not limited to the user directly sliding, tapping or long pressing on the display screen with a finger or stylus to realize touch input to the electronic device. The system then analyzes these touch actions to determine their specific action positions on the display screen, and then identifies the user's operation intention, and determines the corresponding focus area in the subsequent interface display scheme. For example, when the user taps an area on the display screen, the system determines that the area on which the current touch operation acts is the first area, and subsequently accurately identifies the user's focus area based on the first area.
[0170] Step S502: Determine a first region of interest corresponding to the first region.
[0171] Specifically, the values of the first interface display attributes of the first focus area and the first non-focus area in the first interface are respectively a first attribute value and a second attribute value, wherein the first non-focus area is an area outside the first focus area in the first interface. In an embodiment of the present application, the corresponding focus area can be determined by analyzing the user's input and the focus area recognition algorithm (for example, the area of the user's focus in the first interface can be determined by the first area affected by the user's input), and the corresponding visual elements that currently need to be adjusted (i.e., interface display attributes) are determined according to the specific content in the focus area, and the visual elements of the focus area and its surrounding areas (first non-focus areas) are adjusted in the subsequent interface display scheme to guide the user's attention or improve the efficiency of information presentation and increase the user's immersion. In addition, there can be multiple focus areas at the same time, for example, one or more focus areas determined based on a gaze operation and one or more focus areas determined based on a touch operation can exist at the same time.
[0172] In one possible implementation, N application windows are displayed in the first interface, where N is a positive integer greater than 0; determining the first focus area corresponding to the first area includes: detecting the number Q of fully displayed application windows included in the first area; if Q is 0, and M application controls in the first target application window are displayed in the first area, then determining the display area of the M application controls as the first focus area, wherein the first target application window is one of the N application windows, and M is a positive integer greater than 0; or, if Q is greater than or equal to 1, then determining the display area of P application windows out of the Q as the first focus area, wherein P is a positive integer less than or equal to Q; or, if Q is greater than or equal to 1, and the M application controls in the first target application window are displayed in the first area, then determining the display area of P application windows out of the Q as the first focus area. In an embodiment of the present application, when the user input is a gaze operation, the corresponding first focus area can be flexibly determined according to the number of application windows and application controls displayed in the first area. Specifically, the embodiment of the present application detects the number Q of complete application windows displayed in the first area, and dynamically determines the first focus area based on the number of complete application windows, so as to more accurately locate the user's visual focus; further, when the first area does not contain any complete application windows (that is, Q is 0), but displays M application controls in the first target application window, the display area of the above M application controls can be determined as the first focus area; or, when Q is greater than or equal to 1, that is, when the first area contains Q complete application windows, the display area of P application windows among the above Q application windows (for example, the P application windows with the highest layer level among the Q application windows) can be determined as the first focus area. In addition, if the first area contains both complete application windows and application controls, the display area of P application windows among the above Q application windows is determined as the first focus area.
[0173] Exemplarily, when the first area does not include a complete application window but includes application controls in the application window, the application controls in the first area can be determined as the focus area. Please refer to Figure 4C, which is a schematic diagram of a focus area determination provided in an embodiment of the present application. As shown in Figure 4C, Figure 4C may include a control first area schematic interface 05-A and a control first focus area schematic interface 05-B; as shown in the control first area schematic interface 05-A, the control first area schematic interface 05-A may include a first interface 50, wherein the first interface 50 may include a first area 50-A and a first control 50-B. When the area where the user's eyes are looking does not include a complete application window but includes application controls, the area where the application controls are located can be determined as the focus area. For example, assuming that the current interface is a full-screen folder application, the upper half includes a selected file control, and the lower half is a file list bar control. When the user's eyes are looking at When the eyes are looking at the selected file control in the first interface 50, the system can obtain the user's eye movement data through the front camera, analyze the eye movement data to determine the area affected by the user's gaze operation (i.e., the first area 50-A where the dotted box is located), and detect the number Q of complete application windows in the first area 50-A. When it is detected that Q is 0 (i.e., the first area 50-A does not include a complete application window), the application controls in the first area 50-A are continued to be detected, and it is detected that the first area 50-A may include the first control 50-B (i.e., the selected file control); further, as shown in the control first focus area schematic interface 05-B, the system can determine the selected file control that the user's eyes are looking at as the focus area (i.e., the area where the first control 50-B is located can be determined as the first focus area 50-C), and the area outside the first focus area 50-C in the first interface 50 is determined as the first non-focus area 50-D.Alternatively, when it is detected that the first area includes a complete application window, the system can determine the complete application window in the first area as the focus area, referring to Figure 4D, which is another focus area determination schematic diagram provided in an embodiment of the present application. As shown in Figure 4D, Figure 4D may include a window first area schematic interface 05-C and a window first focus area schematic interface 05-D; as shown in the window first area schematic interface 05-C, the window first area schematic interface 05-C may include a first interface 50, wherein the first interface 50 may include a first area 50-A and a first application window 50-E. When the area where the user's eyes are looking at includes a complete application window, the area where the application window in the area is located may be determined as the focus area. For example, assuming that the current interface includes a complete Regarding the news application window, when a user's eyes are focused on the news application window in the first interface 50, the system can obtain the user's eye movement data through the front camera, analyze the eye movement data to determine the area affected by the user's gaze (i.e., the first area 50-A where the dashed box is located), and detect the number Q of complete application windows in the first area 50-A, thereby concluding that the first area 50-A may include the first application window 50-E (i.e., the news application window). Furthermore, as shown in the window first focus area schematic interface 05-D, the system can determine the news application window focused on by the user as the focus area (i.e., the area where the first application window 50-E is located is determined as the first focus area 50-C), and determine the area outside the first focus area 50-C in the first interface 50 as the first non-focus area 50-D. Optionally, when both a complete application window and an application control for the application window exist in the first area 50-A, the complete application window is determined as the focus area. In addition, the number of application windows and / or application controls in the first area 50-A can be any integer greater than or equal to 0, or there can be multiple focus areas corresponding to application windows or application controls at the same time, which is not specifically limited in the embodiments of the present application.
[0174] In one possible implementation, determining the display areas of P of the Q application windows as the first focus area includes: determining the P application windows with the highest layer levels from the Q application windows; and determining the display areas of the P application windows as the first focus area. Specifically, in an embodiment of the present application, by identifying the layer levels of the application windows and selecting the application window with the highest layer level, it is possible to more accurately determine the area of user focus in a multi-window environment (for example, when multiple application window areas intersect, the application window with the highest layer level is preferentially selected as the focus area). For example, see Figure 4E, which is a schematic diagram of an application window intersection provided in an embodiment of the present application. Figure 4E may include an application window intersection schematic interface 05-E. In the application window intersection schematic interface 05-E, when the area where the user's eyes are looking at includes intersecting application windows, the area where the application window with the highest layer level in the area is located can be determined as the focus area. For example, assuming that the current interface includes three complete application windows, when the user's eyes are looking at the news application window in the first interface 50, the system can obtain the user's eye movement data through the front camera, analyze the eye movement data to determine the user's focus area. The area where the user's gaze operation acts (i.e., the first area 50-A where the dotted box is located), the first area 50-A may include application window A, application window B, and application window C, wherein the areas where application window A and application window B are located intersect; further, the focus area can be determined by detecting the layer levels of the above three application windows. Assuming that the layer levels of application window B and application window C are the highest, and the layer level intersecting with the application window B area is lower, the area where application window B and application window C are located is set as the corresponding focus area (i.e., the application window with the highest layer level seen by the user is determined as the focus area).
[0175] In one possible implementation, N application windows are displayed in the first interface, where N is a positive integer greater than 0; determining the first focus area corresponding to the first area includes: if the first area occupies part or all of the area of the second target application window, then determining the display area of the second target application window as the first focus area, and the second target application window is one of the N application windows. In an embodiment of the present application, the corresponding focus area can be determined by judging the area where the user's touch operation acts. Specifically, if the area corresponding to the user's touch operation is within an application window (that is, the first area covers part or all of an application window), the display area of the application window can be determined as the first focus area. For example, please refer to Figure 4F, which is a touch operation schematic diagram provided in an embodiment of the present application. As shown in Figure 4F, Figure 4F may include a touch operation schematic interface 05-F. In the touch operation schematic interface 05-F, the first interface 50 may include a first application window 50-E. When the user's hand touches the application window, the area where the application window is located can be determined as the focus area. For example, assuming that the current interface includes a complete news application window, the user can touch the news application window in the first interface 50 with a finger and determine the position of the user's touch operation (i.e., the touch coordinates 50-F). Because the touch coordinates 50-F occupy part of the area of the first application window 50-E, the news application window touched by the user can be determined as the focus area (i.e., the first application window 50-E can be determined as the gaze area). In summary, in an embodiment of the present application, the corresponding focus area can be accurately determined through the first area affected by the user's touch operation, and the interface attributes can be adjusted based on the focus area in the subsequent interface display scheme.
[0176] Step S503: adjusting the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, and the display screen displays a second interface.
[0177] Specifically, in the second interface, the values of the first interface display attribute in the first focus area and the first non-focus area are respectively a third attribute value and a fourth attribute value, and the third attribute value and the fourth attribute value are different. After the focus area is determined, the values of the interface display attributes corresponding to the first focus area and the first non-focus area can be adjusted respectively according to the type of interface display attribute in the first interface (for example, the type of interface display attribute can be determined based on the content in the first focus area, and the type of interface display attribute can include brightness type, font size type, and layer level type, etc.) to display the second interface. The values of the interface display attributes of the first focus area and the first non-focus area in the second interface are different, so as to achieve visual emphasis on the area of user focus, thereby improving the user's immersion and experience. In summary, in the embodiment of the present application, the area of user focus in the display screen can be determined based on user input, and the interface elements in the display screen can be adjusted based on the content in the focus area (for example, different interface display attribute types are determined based on the content in the focus area, and the values of the interface display attributes are adjusted based on the type of interface display attribute), so that there is sufficient visual focus in the focus area to guide the user's attention, thereby increasing the user's immersion and improving the overall user experience.
[0178] In one possible implementation, the specific content included in the first focus area is determined; if the first focus area includes a complete application window, the type of the first interface display attribute is determined to be a brightness type; or, if the first focus area does not include a complete application window and includes application controls in the application window, the type of the first interface display attribute is determined based on the type of the application control. Specifically, in an embodiment of the present application, the specific content included in the first focus area is first determined. If the area includes one or more complete application windows, the display attribute of the first interface can be set to a brightness type; or, if the first focus area does not completely include an application window, but includes certain application controls in the application window, the display attribute type of the first interface can be determined based on the type of these controls, so that when adjusting the visual effect of the focus area, it can be more in line with the user's needs, thereby improving the user experience; for example, if the user is viewing a complete application window, the user's immersion can be enhanced by reducing the brightness of the non-focus area; or, if the user is focusing on the application controls in the incomplete application window, the interface display attributes can be dynamically determined and adjusted by judging the type of the application controls to optimize the user experience.
[0179] In one possible implementation, if the first focus area does not include a complete application window, but includes an application control in the application window, then the type of the first interface display attribute is determined based on the type of the application control, including: determining the type of the application control in the application window; if the application control is a text type, then determining that the type of the first interface display attribute is a font size type; or, if the application control is a multiple layer stacking type, then determining that the type of the first interface display attribute is a layer level type; or, if the application control is a target control type, then determining that the type of the first interface display attribute is a brightness type, and the target control type is a type other than a text type and a multiple layer stacking type. Specifically, first determine the type of application control in the interface; then, determine the display properties of the interface based on the type of application control. For example, if the user is reading text, that is, the application control is of text type, determine that the interface display property of the current focus area is the text size type; if the user is watching a scene that includes both video and barrage, that is, the application control is of multiple layer stacking type, then determine that the interface display property of the current focus area is the layer level type; if the control type of the user's focus area is a type other than text type and multiple layer stacking type, then determine that the interface display property of the current focus area is the brightness property. In summary, the embodiment of the present application can dynamically determine the corresponding interface display properties based on the type of application control when the focus area includes application controls in some application windows, so as to more accurately identify the elements that the user is actually concerned about, and make corresponding property adjustments in the subsequent interface display scheme to increase the user's sense of immersion.
[0180] In one possible implementation, if the type of the first interface display attribute is a brightness type; the adjusting the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, and the display screen displays the second interface, includes: increasing the brightness in the first focus area, and / or decreasing the brightness in the first non-focus area, the display screen displays the second interface, and in the second interface, the brightness in the first focus area is higher than the brightness in the first non-focus area. Specifically, in an embodiment of the present application, after determining that the type of the first interface display attribute is a brightness type, the user's focus area can be highlighted by increasing the brightness of the focus area and / or decreasing the brightness of the non-focus area, thereby achieving an immersive use effect. Exemplarily, if the current focus area is the area where the application control is located, and the type of the interface display attribute is a brightness type, please refer to Figure 4G. Figure 4G is a control brightness adjustment schematic diagram provided in an embodiment of the present application. As shown in Figure 4G, Figure 4G may include a control first focus area schematic interface 05-B and a first brightness adjustment schematic interface 05-G. As shown in the control first focus area schematic interface 05-B, the first interface 50 may include a first control 50-B, a first focus area 50-C and a first non-focus area 50-D. When the interface display attribute of the focus area that the user's eyes are looking at is a brightness type, the brightness of the focus area can be increased and / or the brightness of the non-focus area can be decreased. For example, assuming that the current interface is a full-screen folder application, the upper half includes a selected file control (i.e., the first control 50-B), and the lower half is a file list bar control. , assuming that the focus area that the user is looking at (i.e., the first focus area 50-C) is the area where the selected file control is located, and the control type of the current first focus area 50-C is a type other than text type and multiple layer stacking type, then the interface display attribute of the current focus area is determined to be a brightness type; further, please refer to the first brightness adjustment schematic interface 05-G. As shown in the first brightness adjustment schematic interface 05-G, the second interface 60 may include a first control 50-B, a first focus area 50-C and a first non-focus area 50-D. After determining that the interface display attribute of the selected control (i.e., the first control 50-B) that the user is focusing on is a brightness type, the system can reduce the brightness of other areas (i.e., the first non-focus area 50-D) to achieve visual emphasis on the first focus area 50-C, guide the user's attention, and increase the user's immersion.Alternatively, if the current focus area is the area where the complete application window is located, and the type of the interface display attribute is a brightness type, please refer to Figure 4H. Figure 4H is a window brightness adjustment schematic diagram provided in an embodiment of the present application. As shown in Figure 4H, Figure 4H may include a shadow window first focus area schematic interface 05-H and a second brightness adjustment schematic interface 05-I. As shown in the shadow window first focus area schematic interface 05-H, the first interface 50 may include a first application window 50-E, a first focus area 50-C and a first non-focus area 50-D. For example, assuming that the first interface 50 includes a complete news application window (i.e., the first application window 50-E), when the user's eyes are looking at the news application window in the first interface 50, The area where the first application window 50-E is located is determined as the first focus area 50-C, and the interface display attribute of the current focus area is determined to be a brightness type; further, referring to the second brightness adjustment schematic interface 05-I, as shown in the second brightness adjustment schematic interface 05-I, the second interface 60 may include the first application window 50-E, the first focus area 50-C, and the first non-focus area 50-D. After determining that the interface display attribute of the current focus area is a brightness type, the system can increase the brightness of the news application window (i.e., the first focus area 50-C) and reduce the brightness of other areas (i.e., the first non-focus area 50-D) to achieve visual emphasis on the first focus area 50-C, guide the user's attention, and increase the user's immersion. In addition, if the brightness of the non-focus area is reduced, the user can restore the brightness of the non-focus area by gazing at the non-focus area for a period of time or by touching the non-focus area through a touch operation. In summary, in the embodiments of the present application, by visually emphasizing the areas of user interest (i.e., increasing the brightness of the areas of interest and / or reducing the brightness of the non-areas of interest), the user experience can be effectively improved, making it easier for users to focus on the content of the areas of interest, and reducing the time and energy consumed in identifying and understanding interface information.
[0181] In one possible implementation, if the type of the first interface display attribute is a font size type; the adjusting the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, the display screen displays the second interface, including: enlarging the font size in the first focus area, the display screen displays the second interface, and the font size in the first focus area in the second interface is larger than the font size in the first non-focus area. Specifically, in an embodiment of the present application, after determining that the type of the first interface display attribute is a font size type, the second interface can be displayed on the display screen by adjusting the font size of the focus area, wherein, in the second interface, the font size of the first focus area is enlarged, so that the font size in the first focus area is larger than the font size in the first non-focus area. This adjustment method can effectively highlight the user's focus content. By enlarging the font size of the focus area rather than uniformly adjusting the font size of the entire interface, the user can identify and understand key information more quickly, thereby improving reading efficiency and user experience. For example, if the current focus area is the area where the application control is located, and the type of the interface display attribute is the font size type, please refer to Figure 4I, which is a schematic diagram of a control font size adjustment provided in an embodiment of the present application. As shown in Figure 4I, Figure 4I may include a font control first focus area schematic interface 05-J and a font size adjustment schematic interface 05-K. As shown in the font control first focus area schematic interface 05-J, the first interface 50 may include a second control 50-G, a first focus area 50-C and a first non-focus area 50-D. Assuming that the first interface 50 includes a reading application, when the user's eyes focus on a line of words in the reading application (that is, determining the first focus area), the user's eyes focus on a line of words in the reading application (that is, determining the first focus area). A focus area 50-C is the area where the second control 50-G is located), and the interface display attribute of the current focus area can be determined to be a font size type; further, referring to the font size adjustment schematic interface 05-K, as shown in the font size adjustment schematic interface 05-K, the second interface 60 can include the second control 50-G, the first focus area 50-C, and the first non-focus area 50-D. After determining that the interface display attribute of the current focus area is a font size type, the system can enlarge the font size of the line that the user is looking at (i.e., the first focus area 50-C) to achieve visual emphasis on the first focus area 50-C, guide the user's attention, and increase the user's immersion. In summary, in the embodiment of the present application, when the content of the user's attention is the font, the user's attention can be focused on the focus area by appropriately adjusting the font size, thereby enhancing the user's immersion and sense of use.
[0182] In one possible implementation, if the type of the first interface display attribute is a layer level type; the first attribute value of the first focus area and / or the second attribute value of the first non-focus area is adjusted based on the type of the first interface display attribute, and the display screen displays the second interface, including: increasing the layer level in the first focus area, the display screen displays the second interface, and the layer level in the first focus area in the second interface is higher than the layer level in the first non-focus area. Specifically, in an embodiment of the present application, after determining that the type of the first interface display attribute is a multiple layer stacking type, the second interface can be displayed on the display screen by adjusting the layer level, and the layer level of the focus area can be adjusted based on the recognition result. For example, in a scene where barrage and video content appear at the same time when watching a video, after determining that the user is specifically focusing on a layer in the video content or barrage, the level of the layer can be increased to make the area more visually prominent, and the layer level of the non-focus area can be relatively lowered, thereby reducing visual interference. Exemplarily, if the current focus area is the area where the application control is located, and the type of the interface display attribute is the font size type, please refer to Figure 4J. Figure 4J is a control layer level adjustment schematic diagram provided in an embodiment of the present application. As shown in Figure 4J, Figure 4J may include a layer control first focus area schematic interface 05-L and a layer level adjustment schematic interface 05-M. As shown in the layer control first focus area schematic interface 05-L, the first interface 50 may include a third control 50-H, a first focus area 50-C and a first non-focus area 50-D. Assuming that the first interface 50 includes a video application, and some areas in the video application may include video content and barrage, the current display effect is that the barrage is displayed above the video content (that is, the layer level of the barrage is higher than the layer level of the video content). When it is detected that the user's input is a gaze operation, the system can detect that the area currently focused on by the user (that is, the area where the third control 50-H is located) includes multiple A layer stacking type is configured, and the user's eye movement data is further analyzed to determine the layer that the user is paying attention to. Assuming that it is detected that the user is paying attention to the layer where the video content is located, the layer where the video content is located in the area where the third control 50-H is located can be determined as the focus area (i.e., the first focus area 50-C), and the interface display attribute of the current focus area is determined to be a layer level type; further, please refer to the layer level adjustment schematic interface 05-M. As shown in the layer level adjustment schematic interface 05-M, the second interface 60 may include a third control 50-H, a first focus area 50-C and a first non-focus area 50-D. After determining that the interface display attribute of the current focus area is a layer level type, the system can increase the layer level of the video content (i.e., the first focus area 50-C), as shown in the first focus area 50-C, and adjust the layer level of the video content to be higher than the layer level of the barrage, so as to achieve visual emphasis on the content that the user is paying attention to.In summary, in the embodiments of the present application, the layer hierarchy of elements in the interface can be dynamically adjusted based on the user's attention area, and the interface display can be optimized according to the user's actual usage scenario (such as barrage attention during video viewing).
[0183] Optionally, in steps S500 to S503 of the above method, in the first interface, after detecting the user input, a first focus area can be determined based on the area affected by the user input, and the attributes of the interface elements can be dynamically adjusted based on the content in the first focus area to display the second interface; optionally, in the second interface, after detecting the user input again, the area affected by the user input can be again determined to determine a second focus area, and the attributes of the elements in the second interface can be dynamically adjusted based on the content in the second focus area to display the third interface, as shown in FIG5A , which is a flow chart of another interface display in an embodiment of the present application; as shown in FIG5A , the following steps S600 to S602 can also be included:
[0184] Step S600: receiving a second input from the user, and determining a second area in the second interface where the second input acts.
[0185] Specifically, please refer to the embodiment described in step S501 in Figure 4A, which will not be described in detail in the embodiments of this application.
[0186] Step S601: Determine a second region of interest corresponding to the second region.
[0187] Specifically, the values of the second interface display attributes of the second focus area and the second non-focus area in the second interface are the fifth attribute value and the sixth attribute value, respectively, wherein the second non-focus area is the area outside the second focus area in the second interface; wherein, the specific steps can be referred to the embodiment described in step S502 in Figure 4A, and will not be repeated in the embodiment of this application.
[0188] Step S602: adjusting the fifth attribute value of the second focus area and / or the sixth attribute value of the second non-focus area based on the type of the second interface display attribute, and the display screen displays a third interface.
[0189] Specifically, in the third interface, the values of the second interface display attribute for the second focus area and the second non-focus area are respectively the seventh attribute value and the eighth attribute value, and the seventh attribute value is different from the eighth attribute value. In an embodiment of the present application, the system can receive the user's second input and determine the area affected by the second input, identify the area as the user's second focus area and second non-focus area, and determine the interface display attributes, such as color depth, brightness, and layer level, based on the content of the second focus area, and adjust the interface display attributes accordingly to emphasize the area of user focus, allowing the user to locate key information or operation areas more quickly while reducing visual interference with non-focus areas. For example, please refer to Figure 5B, which is a schematic diagram of determining a third interface provided in an embodiment of the present application. As shown in Figure 5B, Figure 5B may include a second interface schematic interface 06-A and a third interface schematic interface 06-B. As shown in the second interface schematic interface 06-A, the second interface 60 may include a first focus area 50-C and a second area 60-A. The second area 60-A is not the same area as the first focus area 50-C. When the user's eyes are no longer focused on the first focus area 50-C, but are focused on other positions, it is assumed that when the user's eyes are focused on the second focus area 50 in the second interface 60 When the user is looking at the second area 60-A, the application window E in the second area 60-A can be determined as the focus area; further, referring to the third interface schematic interface 06-B, as shown in the third interface schematic interface 06-B, the third interface 70 may include a first focus area 50-C, a second focus area 60-B and a second non-focus area 60-C. The application window E that the user is looking at can be determined as the second focus area 60-B, and the brightness of other areas (i.e., the brightness of the second non-focus area 60-C) can be reduced to achieve visual emphasis on the second focus area 60-B, guide the user's attention, and increase the user's sense of immersion.
[0190] In one possible implementation, if the type of the second interface display attribute is brightness, adjusting the fifth attribute value of the second focus area and / or the sixth attribute value of the second non-focus area based on the type of the second interface display attribute includes: determining whether the first focus area is within the second non-focus area; if the first focus area is within the second non-focus area, gradually changing the brightness of the first focus area to a third target brightness within a first preset time period. In an embodiment of the present application, if a second focus area and a second non-focus area are generated due to new user input, the system determines the location of the original focus area (i.e., the first focus area); if the first focus area is within the second non-focus area, the brightness of the first focus area is gradually reduced until it reaches a predetermined lower brightness level.For example, see FIG5C, FIG5C is a schematic diagram of brightness gradient provided in an embodiment of the present application, FIG5C may include a first brightness gradient schematic interface 06-C and a second brightness gradient schematic interface 06-D, such as the first brightness gradient schematic interface 06-C, the second interface 60 may include a first focus area 50-C (i.e., application window D), a second focus area 60-B (i.e., application window E) and a second non-focus area 60-C (other areas in the second interface 60 except application window E). When the user's eyes switch the area of focus, that is, when the user no longer focuses on the first focus area, the second focus area 60-B (i.e., application window E) and the second non-focus area 60-C are switched. After the user looks at the second non-focus area 60-B instead of the previous focus area 50-C, the brightness of the area outside the application window E that the user is focusing on (i.e., the second non-focus area 60-C) can be reduced; wherein, when it is determined that the new area the user is focusing on is not the previous focus area (i.e., the first focus area 50-C is within the second non-focus area 60-C), the system can gradually change the brightness of the focus area that the user was previously focusing on (i.e., the first focus area 50-C) to the brightness of the second non-focus area 60-C within a certain period of time (e.g., within 10 seconds), as shown in the second brightness gradient schematic interface 06-D, while waiting for the first time (For example, 3 seconds), the system can reduce the brightness of the first focus area 50-C to the first brightness; further, referring to Figure 5D, Figure 5D is another brightness gradient schematic diagram provided in an embodiment of the present application, Figure 5D may include a third brightness gradient schematic interface 06-E and a third interface final schematic interface 06-F. As shown in the third brightness gradient schematic interface 06-E, when the user waits for a second time (for example, 6 seconds), the system can reduce the brightness of the first focus area 50-C from the first brightness to a second brightness (the second brightness value is lower than the first brightness and higher than the second non-focus area 60 -C brightness value); when the user waits for a third time (for example, 10 seconds), as shown in the final schematic interface 06-F of the third interface, the system can reduce the brightness of the first focus area 50-C from the first brightness to the same value as the brightness of the second non-focus area 60-C. Through the above embodiment, in the embodiment of the present application, when the user switches the focus area through an input operation, and the interface display attribute of the focus area is a brightness attribute, the system can slowly reduce the brightness of the previous focus area (i.e., the first focus area 50-C) within a preset time period to present a better visual experience to the user. In addition, the above-mentioned preset time period and brightness value of the brightness gradient can be any value and are not specifically limited in the embodiment of the present application. In summary, in the embodiment of the present application, after determining that the first focus area is within the second non-focus area, the brightness of the first focus area can be gradually changed to the brightness of the second non-focus area within a preset time period, avoiding abrupt brightness changes, and if the focus area is switched back to the first focus area again in a short time, the operation of re-increasing the brightness of the first focus area is avoided, thereby improving the comfort of use and thus improving the user experience.
[0191] In one possible implementation, the user's input is monitored; if it is detected that the number of inputs by the user within the second preset time period is greater than the first switching number threshold, the third attribute value and the fourth attribute value are fixed in the third preset time period; or, if it is detected that the number of inputs by the user within the second preset time period is less than the first switching number threshold, the attributes of the interface displayed on the display screen are adjusted based on the user's input. In an embodiment of the present application, by monitoring the user's input and determining the number of user inputs within a certain period of time, corresponding processing is performed. Specifically, when the user's focus area switches frequently in a short period of time and exceeds a preset threshold, the system will not process it, which can prevent the user experience from being degraded due to frequent switching or user misoperation; or, if the number of user focus area switches within a short period of time does not exceed the preset threshold, the system will adjust the interface attributes displayed on the display screen (such as adjusting brightness, layer level and font size attributes, etc.) based on the user's input to emphasize the area of user focus and increase the user's immersion. In summary, the embodiment of the present application monitors the number of user inputs within a certain period of time and makes corresponding processing, which can not only avoid the interference of frequent changes in the interface caused by user misoperation, but also adjust the interface according to user needs when necessary, thereby improving the overall user experience.
[0192] The above describes in detail the method of the embodiment of the present application, and the following provides the relevant device of the embodiment of the present application.
[0193] Please refer to Figure 6, which is a structural diagram of an interface display device provided in an embodiment of the present application. The interface display device 07 may include a first interface unit 701, a first input unit 702, a first focus area unit 703, a second interface determination unit 704, a first focus area content determination unit 705, a first interface display attribute determination unit 706, a second input unit 707, a second focus area unit 708, a third interface determination unit 709, a monitoring unit 710, a second switching unit 711 and a third switching unit 712, wherein a detailed description of each unit is as follows.
[0194] The first interface unit 701, the display screen displays the first interface;
[0195] A first input unit 702 is configured to receive a first input from a user and determine a first area on the first interface where the first input acts;
[0196] In a possible implementation, the first input is a touch operation of the user; the first input unit 702 is specifically configured to:
[0197] A touch operation of the user on the display screen is received, and a first area affected by the touch operation of the user is determined.
[0198] In one possible implementation, the first input is a user's gaze operation; the device further includes at least one front-facing camera; and the first input unit 702 is specifically configured to:
[0199] monitoring the user's eye movement data through the at least one front-facing camera;
[0200] A first area corresponding to the user's gaze operation is determined based on the eye movement data.
[0201] A first region of interest unit 703 is configured to determine a first region of interest corresponding to the first region; in the first interface, the values of the first interface display attributes of the first region of interest and the first non-region of interest are respectively a first attribute value and a second attribute value, wherein the first non-region of interest is an area outside the first region of interest in the first interface;
[0202] In a possible implementation, the first region of interest unit 703 is specifically configured to:
[0203] Determine P application windows with the highest layer levels from the Q application windows;
[0204] The display areas of the P application windows are determined as the first focus area.
[0205] The second interface determination unit 704 adjusts the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, and the display screen displays a second interface. In the second interface, the values of the first interface display attributes of the first focus area and the first non-focus area are respectively the third attribute value and the fourth attribute value, and the third attribute value and the fourth attribute value are different.
[0206] In a possible implementation, N application windows are displayed in the first interface, where N is a positive integer greater than 0; and the second interface determining unit 704 is specifically configured to:
[0207] Detecting the number Q of completely displayed application windows included in the first area;
[0208] If Q is 0, and M application controls in a first target application window are displayed in the first area, the display area of the M application controls is determined as the first focus area, wherein the first target application window is one of the N application windows, and M is a positive integer greater than 0; or
[0209] If Q is greater than or equal to 1, the display areas of P of the Q application windows are determined as the first focus area, where P is a positive integer less than or equal to Q; or, if Q is greater than or equal to 1, and the M application controls in the first target application window are displayed in the first area, the display areas of P of the Q application windows are determined as the first focus area.
[0210] In a possible implementation, N application windows are displayed in the first interface, where N is a positive integer greater than 0; and the second interface determining unit 704 is specifically configured to:
[0211] If the first area occupies part or all of the area of the second target application window, the display area of the second target application window is determined as the first focus area, and the second target application window is one of the N application windows.
[0212] In a possible implementation, if the type of the first interface display attribute is a brightness type, the second interface determining unit 704 is specifically configured to:
[0213] The brightness in the first focus area is increased, and / or the brightness in the first non-focus area is decreased, and the display screen displays a second interface, in which the brightness in the first focus area is higher than the brightness in the first non-focus area.
[0214] In a possible implementation, if the type of the first interface display attribute is a font size type, the second interface determining unit 704 is specifically configured to:
[0215] The font size in the first area of interest is enlarged, and the display screen displays a second interface, in which the font size in the first area of interest is larger than the font size in the first non-area of interest.
[0216] In a possible implementation, if the type of the first interface display attribute is a layer level type, the second interface determining unit 704 is specifically configured to:
[0217] The layer level in the first area of interest is increased, and the display screen displays a second interface, in which the layer level in the first area of interest is higher than the layer level in the first non-area of interest.
[0218] A first focus area content determination unit 705 is configured to determine specific content included in the first focus area;
[0219] The first interface display attribute determination unit 706 determines that the type of the first interface display attribute is a brightness type if the first focus area includes a complete application window; or, if the first focus area does not include a complete application window and includes an application control in the application window, determines the type of the first interface display attribute based on the type of the application control.
[0220] In a possible implementation, the first interface display attribute determining unit 706 is specifically configured to:
[0221] Determining the type of the application control in the application window;
[0222] If the application control is of text type, determining that the type of the first interface display attribute is a font size type; or,
[0223] If the application control is a multi-layer stacking type, determining that the type of the first interface display attribute is a layer level type; or,
[0224] If the application control is a target control type, it is determined that the type of the first interface display attribute is a brightness type, and the target control type is a type other than a text type and a multiple layer stacking type.
[0225] A second input unit 707 is configured to receive a second input from the user and determine a second area in the second interface where the second input acts;
[0226] A second region of interest unit 708 is configured to determine a second region of interest corresponding to the second region; the values of the second interface display attributes of the second region of interest and the second non-region of interest in the second interface are the fifth attribute value and the sixth attribute value, respectively, wherein the second non-region of interest is an area outside the second region of interest in the second interface;
[0227] A third interface determination unit adjusts the fifth attribute value of the second focus area and / or the sixth attribute value of the second non-focus area based on the type of the second interface display attribute. The display screen displays a third interface. In the third interface, the values of the second interface display attributes of the second focus area and the second non-focus area are respectively the seventh attribute value and the eighth attribute value, and the seventh attribute value and the eighth attribute value are different.
[0228] In a possible implementation, if the type of the second interface display attribute is brightness, the third interface determination unit is specifically configured to:
[0229] Determining whether the first region of interest is within the second region of no interest;
[0230] If the first focus area is within the second non-focus area, the brightness of the first focus area is gradually changed to a third target brightness within a first preset time period.
[0231] A monitoring unit 710, configured to monitor the user's input;
[0232] The second switching unit 711 fixes the third attribute value and the fourth attribute value in a third preset time period if it is detected that the number of inputs by the user in the second preset time period is greater than the first switching number threshold; or
[0233] The third switching unit 712 adjusts the attributes of the interface displayed on the display screen based on the user input if it is detected that the number of times the user inputs within the second preset time period is less than the first switching number threshold.
[0234] It should be understood that each step in the above method embodiment can be completed by hardware integrated logic circuits in a processor or by software instructions. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.
[0235] The present application also provides a terminal device, which may include: a memory and a processor. The memory may be used to store a computer program; the processor may be used to call the computer program in the memory to enable the terminal device to execute the method executed on the terminal device side in any of the above embodiments.
[0236] The present application also provides a chip system, which includes at least one processor for implementing the functions involved in the terminal device side in any of the above embodiments.
[0237] In one possible design, the chip system further includes a memory, which is used to store program instructions and data, and the memory is located inside or outside the processor.
[0238] The chip system can be composed of chips, or can include chips and other discrete devices.
[0239] Optionally, there may be one or more processors in the chip system. The processor may be implemented in hardware or software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.
[0240] Optionally, the memory in the chip system may be one or more. The memory may be integrated with the processor or may be provided separately from the processor, which is not limited in the embodiments of the present application. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or provided on different chips. The embodiments of the present application do not specifically limit the type of memory or the configuration of the memory and the processor.
[0241] Exemplarily, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.
[0242] The present application also provides a computer program product, which includes: a computer program (also referred to as code, or instructions), which, when executed, enables a computer to execute the method executed on the terminal device side in any of the above embodiments.
[0243] The present application also provides a computer-readable storage medium storing a computer program (also referred to as code or instruction). When the computer program is executed, the computer executes the method executed by the terminal device side in any of the above embodiments.
[0244] The various implementation modes of this application can be combined arbitrarily to achieve different technical effects.
[0245] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in this application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)).
[0246] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0247] In short, the above description is only an embodiment of the technical solution of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of this application should be included in the scope of protection of this application.
Claims
1. A method for interface display, characterized in that: Applied to an electronic device, the electronic device includes a display screen; the method includes: The display screen displays a first interface; receiving a first input from a user, and determining a first area in the first interface where the first input acts; Determining a first region of interest corresponding to the first region; in the first interface, values of the first interface display attributes of the first region of interest and the first region of no interest are respectively a first attribute value and a second attribute value, wherein the first region of no interest is an area outside the first region of interest in the first interface; The first attribute value of the first focus area and / or the second attribute value of the first non-focus area are adjusted based on the type of the first interface display attribute, and the display screen displays a second interface. In the second interface, the values of the first interface display attributes of the first focus area and the first non-focus area are respectively the third attribute value and the fourth attribute value, and the third attribute value and the fourth attribute value are different.
2. The method according to claim 1, characterized in that The first input is a user's gaze operation; the electronic device further includes at least one front-facing camera; and receiving the user's first input and determining a first area in the first interface where the first input acts includes: monitoring the user's eye movement data through the at least one front-facing camera; A first area corresponding to the user's gaze operation is determined based on the eye movement data.
3. The method according to claim 1 or 2, characterized in that N application windows are displayed on the first interface, where N is a positive integer greater than 0; and determining a first focus area corresponding to the first area includes: Detecting the number Q of completely displayed application windows included in the first area; If Q is 0, and M application controls in a first target application window are displayed in the first area, the display area of the M application controls is determined as the first focus area, wherein the first target application window is one of the N application windows, and M is a positive integer greater than 0; or If Q is greater than or equal to 1, the display areas of P of the Q application windows are determined as the first focus area, where P is a positive integer less than or equal to Q; or, if Q is greater than or equal to 1, and the M application controls in the first target application window are displayed in the first area, the display areas of P of the Q application windows are determined as the first focus area.
4. The method according to claim 3, characterized in that The determining the display areas of the P application windows among the Q as the first focus area includes: Determine P application windows with the highest layer levels from the Q application windows; The display areas of the P application windows are determined as the first focus area.
5. The method according to claim 1, wherein The first input is a touch operation of the user; and the receiving the first input of the user and determining the first area in the first interface where the first input acts includes: A touch operation of the user on the display screen is received, and a first area affected by the touch operation of the user is determined.
6. The method according to claim 5, characterized in that N application windows are displayed on the first interface, where N is a positive integer greater than 0; and determining a first focus area corresponding to the first area includes: If the first area occupies part or all of the area of the second target application window, the display area of the second target application window is determined as the first focus area, and the second target application window is one of the N application windows.
7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: Determining specific content included in the first area of interest; If the first focus area includes a complete application window, the type of the first interface display attribute is determined to be a brightness type; or, if the first focus area does not include a complete application window and includes an application control in the application window, the type of the first interface display attribute is determined based on the type of the application control.
8. The method according to claim 7, characterized in that If the first focus area does not include a complete application window but includes an application control in the application window, determining the type of the first interface display attribute based on the type of the application control includes: Determining the type of the application control in the application window; If the application control is of text type, determining that the type of the first interface display attribute is a font size type; or, If the application control is a multi-layer stacking type, determining that the type of the first interface display attribute is a layer level type; or, If the application control is a target control type, it is determined that the type of the first interface display attribute is a brightness type, and the target control type is a type other than a text type and a multiple layer stacking type.
9. The method according to claim 7 or 8, characterized in that If the type of the first interface display attribute is a brightness type; adjusting the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, and displaying the second interface on the display screen, includes: The brightness in the first focus area is increased, and / or the brightness in the first non-focus area is decreased, and the display screen displays a second interface, in which the brightness in the first focus area is higher than the brightness in the first non-focus area.
10. The method according to claim 8, characterized in that If the type of the first interface display attribute is a font size type; adjusting the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, and displaying the second interface on the display screen, includes: The font size in the first area of interest is enlarged, and the display screen displays a second interface, in which the font size in the first area of interest is larger than the font size in the first non-area of interest.
11. The method according to claim 8, characterized in that If the type of the first interface display attribute is a layer level type; adjusting the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, and displaying the second interface on the display screen, includes: The layer level in the first area of interest is increased, and the display screen displays a second interface, in which the layer level in the first area of interest is higher than the layer level in the first non-area of interest.
12. The method according to any one of claims 1 to 11, characterized in that The method further comprises: receiving a second input from the user, and determining a second area in the second interface where the second input acts; Determining a second region of interest corresponding to the second region; wherein the values of the second interface display attributes of the second region of interest and the second non-region of interest in the second interface are the fifth attribute value and the sixth attribute value, respectively, wherein the second non-region of interest is an area outside the second region of interest in the second interface; Based on the type of the second interface display attribute, the fifth attribute value of the second focus area and / or the sixth attribute value of the second non-focus area are adjusted, and the display screen displays a third interface. In the third interface, the values of the second interface display attributes of the second focus area and the second non-focus area are respectively the seventh attribute value and the eighth attribute value, and the seventh attribute value and the eighth attribute value are different.
13. The method according to claim 12, characterized in that If the type of the second interface display attribute is brightness, adjusting the fifth attribute value of the second focus area and / or the sixth attribute value of the second non-focus area based on the type of the second interface display attribute includes: Determining whether the first region of interest is within the second region of no interest; If the first focus area is within the second non-focus area, the brightness of the first focus area is gradually changed to a third target brightness within a first preset time period.
14. The method according to any one of claims 1 to 13, characterized in that The method further comprises: monitoring input from the user; If it is detected that the number of inputs by the user within the second preset time period is greater than the first switching number threshold, then fixing the third attribute value and the fourth attribute value in a third preset time period; or, If it is detected that the number of times the user inputs within the second preset time period is less than the first switching number threshold, the attributes of the interface displayed on the display screen are adjusted based on the user input.
15. An interface display device, characterized in that: The device includes a display screen; the device includes: A first interface unit, wherein the display screen displays a first interface; a first input unit, configured to receive a first input from a user and determine a first area in the first interface where the first input acts; a first region of interest unit, configured to determine a first region of interest corresponding to the first region; wherein the values of the first interface display attributes of the first region of interest and the first non-region of interest in the first interface are respectively a first attribute value and a second attribute value, wherein the first non-region of interest is an area outside the first region of interest in the first interface; A second interface determination unit adjusts the first attribute value of the first focus area and / or the second attribute value of the first non-focus area based on the type of the first interface display attribute, the display screen displays a second interface, and in the second interface, the values of the first interface display attributes of the first focus area and the first non-focus area are respectively a third attribute value and a fourth attribute value, and the third attribute value and the fourth attribute value are different.
16. The device according to claim 15, characterized in that The first input is a user's gaze operation; the device further includes at least one front camera; the first input unit is specifically configured to: monitoring the user's eye movement data through the at least one front-facing camera; A first area corresponding to the user's gaze operation is determined based on the eye movement data.
17. The device according to claim 15 or 16, characterized in that The first interface displays N application windows, where N is a positive integer greater than 0; and the second interface determining unit is specifically configured to: Detecting the number Q of completely displayed application windows included in the first area; If Q is 0, and M application controls in a first target application window are displayed in the first area, the display area of the M application controls is determined as the first focus area, wherein the first target application window is one of the N application windows, and M is a positive integer greater than 0; or If Q is greater than or equal to 1, the display areas of P of the Q application windows are determined as the first focus area, where P is a positive integer less than or equal to Q; or, if Q is greater than or equal to 1, and the M application controls in the first target application window are displayed in the first area, the display areas of P of the Q application windows are determined as the first focus area.
18. The device according to claim 17, characterized in that The first region of interest unit is specifically configured to: Determine P application windows with the highest layer levels from the Q application windows; The display areas of the P application windows are determined as the first focus area.
19. The device according to claim 15, characterized in that The first input is a touch operation of the user; the first input unit is specifically used to: A touch operation of the user on the display screen is received, and a first area affected by the touch operation of the user is determined.
20. The device according to claim 19, characterized in that The first interface displays N application windows, where N is a positive integer greater than 0; and the second interface determining unit is specifically configured to: If the first area occupies part or all of the area of the second target application window, the display area of the second target application window is determined as the first focus area, and the second target application window is one of the N application windows.
21. The device according to any one of claims 15 to 20, characterized in that The device further comprises: A first area of interest content determining unit, configured to determine specific content included in the first area of interest; The first interface display attribute determination unit determines that the type of the first interface display attribute is a brightness type if the first focus area includes a complete application window; or, if the first focus area does not include a complete application window and includes an application control in the application window, determines the type of the first interface display attribute based on the type of the application control.
22. The device according to claim 21, characterized in that The first interface display attribute determination unit is specifically configured to: Determining the type of the application control in the application window; If the application control is of text type, determining that the type of the first interface display attribute is a font size type; or, If the application control is a multi-layer stacking type, determining that the type of the first interface display attribute is a layer level type; or, If the application control is a target control type, it is determined that the type of the first interface display attribute is a brightness type, and the target control type is a type other than a text type and a multiple layer stacking type.
23. The device according to claim 21 or 22, characterized in that If the type of the first interface display attribute is brightness type, the second interface determination unit is specifically configured to: The brightness in the first focus area is increased, and / or the brightness in the first non-focus area is decreased, and the display screen displays a second interface, in which the brightness in the first focus area is higher than the brightness in the first non-focus area.
24. The device according to claim 22, characterized in that If the type of the first interface display attribute is a font size type; the second interface determination unit is specifically configured to: The font size in the first area of interest is enlarged, and the display screen displays a second interface, in which the font size in the first area of interest is larger than the font size in the first non-area of interest.
25. The device according to claim 22, characterized in that If the type of the first interface display attribute is a layer level type, the second interface determination unit is specifically configured to: The layer level in the first area of interest is increased, and the display screen displays a second interface, in which the layer level in the first area of interest is higher than the layer level in the first non-area of interest.
26. The device according to any one of claims 15 to 25, characterized in that The device further comprises: a second input unit, configured to receive a second input from the user and determine a second area in the second interface where the second input acts; a second region-of-interest unit, configured to determine a second region-of-interest corresponding to the second region; wherein the values of the second interface display attributes of the second region-of-interest and the second non-region-of-interest in the second interface are the fifth attribute value and the sixth attribute value, respectively, wherein the second non-region-of-interest is an area outside the second region of interest in the second interface; A third interface determination unit adjusts the fifth attribute value of the second focus area and / or the sixth attribute value of the second non-focus area based on the type of the second interface display attribute. The display screen displays a third interface. In the third interface, the values of the second interface display attributes of the second focus area and the second non-focus area are respectively the seventh attribute value and the eighth attribute value, and the seventh attribute value and the eighth attribute value are different.
27. The device according to claim 26, characterized in that If the type of the second interface display attribute is brightness, the third interface determination unit is specifically configured to: Determining whether the first region of interest is within the second region of no interest; If the first focus area is within the second non-focus area, the brightness of the first focus area is gradually changed to a third target brightness within a first preset time period.
28. The device according to any one of claims 15 to 27, characterized in that The device further comprises: A monitoring unit, configured to monitor the user's input; The second switching unit fixes the third attribute value and the fourth attribute value in a third preset time period if it is detected that the number of inputs by the user in the second preset time period is greater than the first switching number threshold; or The third switching unit adjusts the attributes of the interface displayed on the display screen based on the user input if it is detected that the number of inputs by the user within the second preset time period is less than the first switching number threshold.
29. A computer storage medium, characterized in that The computer storage medium stores a computer program, which implements the method according to any one of claims 1 to 14 when executed by a processor.
30. A computer program, characterized in that The computer program comprises instructions, which, when executed by a computer, cause the computer to perform the method according to any one of claims 1 to 14.
Citation Information
Patent Citations
Automatic adjusting method and device for brightness of display interface
CN104915139A
Interface display method and electronic equipment
CN115729346A
Screen display brightness adjusting method and device, storage medium and electronic equipment
CN115756285A
Interface display method, device and equipment and computer storage medium
CN115793910A
Method and apparatus for controlling function in a touch device
KR1020120007686A