Display device and display method

Abstract

The invention provides a display device and a display method, belongs to the technical field of design of display devices, and can accurately obtain a corresponding scrolling distance to realize scrolling when superior options in a multilevel menu are switched and to-be-displayed subordinate options are not loaded. The method comprises the following steps: responding to a first switching instruction for switching a first-level option under the condition that a first-level menu and a second-level menu are displayed in a user interface, if a second option corresponding to a target first-level option is not loaded, switching the first-level option to the second-level option, if yes, first index information of boundary options and second index information of second options in displayed second-level options in the second-level menu are obtained, and a first rolling distance is determined based on the first index information and the second index information; and marking the target first-level option as a selected state, and controlling all second-level options in the second-level menu to roll for a first rolling distance, so that the second option is loaded in the user interface, and the boundary of the second option in the first preset direction is aligned with the boundary of the target first-level option in the first preset direction.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and display method. Background Technology

[0002] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, communication terminals, smart advertising screens, and projectors. Taking smart TVs as an example, smart TVs are television products based on Internet application technologies, possessing open operating systems and chips, and having open application platforms. They enable two-way human-computer interaction and integrate multiple functions such as audio-visual entertainment and data to meet diverse and personalized user needs. Smart TVs not only provide a rich variety of audio-visual content but also continuously optimize user interface (UI) design to enhance the user's interactive experience.

[0003] To improve user experience, multi-level menus can be used on display devices such as TVs or smart TVs to display any possible setting options (e.g., system settings and / or application settings) to facilitate personalized adjustments to the display device or its applications. When displaying multi-level menus, as the focus shifts between parent options within a parent menu, the corresponding sub-options in the sub-menus need to be scrolled / slid / moved appropriately to allow users to intuitively understand the relationship between parent and sub-options. However, currently, each level of multi-level menus on display devices uses a RecyclerView. Because RecyclerView has a view reuse mechanism, it only loads the item views within the currently visible area; item views not yet in the visible area are not immediately created and loaded. Therefore, if a user switches between parent options and the corresponding sub-options are not loaded, their views and positions in the user interface cannot be obtained, leading to inaccurate calculation of scroll distances, affecting the multi-level menu display effect and reducing the user experience. Summary of the Invention

[0004] This application provides a display device and display method that can accurately obtain the corresponding scroll distance to achieve scrolling when switching between upper-level options in a multi-level menu and the lower-level options to be displayed are not loaded, thereby improving the display effect of the display device and enhancing the user experience.

[0005] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:

[0006] In a first aspect, a display device is provided, which may include: a display configured to display a user interface; a controller coupled to the display and configured to: in response to an instruction to expand a multi-level menu, control the display to display a first-level menu and a second-level menu in the user interface; the first-level menu includes a plurality of first-level options, and a first option among the plurality of first-level options is selected; the second-level menu includes a plurality of second-level options corresponding to at least one first-level option; in response to a first switching instruction to switch a first-level option, if a second option corresponding to a target first-level option indicated by the first switching instruction is not loaded, obtain first index information of the boundary option in the second-level menu and second index information of the second option in the second-level menu among the displayed second-level options, and determine a first scroll distance of the second option based on the first index information and the second index information; the second option is the second-level option with the smallest order among the plurality of second-level options corresponding to the target first-level option; and control the display to mark the first option as unselected, mark the target first-level option as selected, and control all second-level options in the second-level menu to scroll by the first scroll distance, so that the second option is loaded in the user interface, and the boundary of the second option in a first preset direction is aligned with the boundary of the target first-level option in the first preset direction.

[0007] In the technical solution provided in this application embodiment, when the display device displays a first-level menu and a second-level menu in a multi-level menu, if the user inputs a switching command to switch the first-level option, and the first second-level option (i.e., the second-level option with the smallest order) in a specific direction among the multiple second-level options corresponding to the target first-level option indicated by the switching command is not loaded, the first scroll distance corresponding to the second-level option can be obtained by acquiring the index information of the undisplayed second-level option and the displayed boundary option in the second-level menu, thereby scrolling. This allows the target first-level option to be left-aligned with its corresponding second-level option after the first-level option is switched, so that the user can intuitively see the correspondence between the second-level option and the first-level option after the first-level option is switched, thus improving the display effect of the display device and the user experience.

[0008] In one possible implementation of the first aspect, the boundary options include a first boundary option and a second boundary option. The first index information includes a first index value of the first boundary option and a second index value of the second boundary option, where the first index value is less than the second index value. The second index information includes a target index value. The controller determines a first scroll distance of the second option based on the first and second index information, specifically configured as follows: when the target index value is less than the first index value, the controller determines a first target coordinate of the second option in the screen coordinate system based on the first coordinate of the first boundary option in the screen coordinate system, the size information of the secondary option, and the first index difference; the first index difference is the difference between the first index value and the target index value. When the target index value is greater than the second index value, the controller determines a first target coordinate of the second option in the screen coordinate system based on the second coordinate of the second boundary option in the screen coordinate system, the size information of the secondary option, and the second index difference; the second index difference is the difference between the second index value and the target index value. The controller determines a first scroll distance based on the first target coordinate and the third coordinate of the target primary option in the screen coordinate system.

[0009] Based on the above technical solution, the display device can select appropriate parameters to calculate the position information of the second option (i.e., the first target coordinates of the second option in the screen coordinate system) based on the relationship between the first index value and the second index value in the first index information and the target index value in the second index information. This accurately obtains the precise position of the unloaded second option in the screen coordinate system, and thus obtains the accurate first scroll distance for scrolling. This ensures that after the first-level option is switched, the target first-level option is left-aligned with its corresponding second option. Consequently, after the first-level option is switched, the user can intuitively see the correspondence between the second-level option and the first-level option, improving the display effect of the display device and the user experience.

[0010] In one possible implementation of the first aspect, the controller is further configured to: in response to a first switching instruction for switching a primary option, if a second option has been loaded, obtain the second target coordinates of the second option in the screen coordinate system through a preset function; and determine a first scroll distance based on the second target coordinates and the third coordinates of the target primary option in the screen coordinate system.

[0011] Based on the above technical solution, when a display device displays a first-level menu and a second-level menu in a multi-level menu, if the user inputs a switching command to switch the first-level option, and the first second-level option (i.e., the lowest-order second-level option) in a specific direction among the multiple second-level options corresponding to the target first-level option indicated by the switching command has been loaded, the position information of the first second-level option can be directly obtained. Then, combined with the position information of the target first-level option, the first scroll distance that the second-level menu needs to scroll is determined, and thus scrolling is performed. This ensures that after the first-level option is switched, the target first-level option is left-aligned with its corresponding second-level option. As a result, after the first-level option is switched, the user can intuitively see the correspondence between the second-level option and the first-level option, ensuring the display effect of the display device and the user's experience.

[0012] In one possible implementation of the first aspect, when the display shows a first-level menu and a second-level menu in the user interface, the controller is further configured to: in response to a selection instruction for a third option in the second-level menu, control the display to mark the third option as selected; in response to a second switching instruction to switch the second-level option, if the target second-level option indicated by the second switching instruction is not loaded, obtain the third index information of the boundary option in the second-level menu and the fourth index information of the target second-level option in the second-level menu, determine the pending scroll distance of the target second-level option based on the third index information and the fourth index information, and determine the second scroll distance of the target second-level option based on the pending scroll distance; and control the display to mark the third option as unselected, mark the target second-level option as selected, and control all second-level options in the second-level menu to scroll the second scroll distance so that the second option is loaded in the user interface.

[0013] Based on the above technical solution, when a display device displays a first-level menu and a second-level menu in a multi-level menu, if the focus is on a certain second-level option, the user inputs a switching command to switch the second-level option, and the target second-level option indicated by the switching command is not loaded, the second scroll distance corresponding to the target second-level option can be obtained by acquiring the index information of the unloaded target second-level option and the displayed boundary options in the second-level menu, thereby accurately scrolling. After the target second-level option is switched, the user can intuitively see the correspondence between the second-level option and the first-level option, improving the display effect of the display device and the user experience.

[0014] In one possible implementation of the first aspect, the controller determines a second scroll distance of the target secondary option based on a pending scroll distance, including: determining a unit offset based on the number of secondary options corresponding to the primary option to which the target secondary option belongs and the size information of the primary option to which the target secondary option belongs; determining a first offset of the target secondary option based on the fourth index information of the target secondary option and the unit offset; and determining a second scroll distance based on the pending scroll distance and the first offset.

[0015] Based on the above technical solution, the display device can determine a suitable first offset based on the size information of the primary option to which the target secondary option belongs, the number of secondary options corresponding to the primary option to which the target secondary option belongs, and the fourth index information of the target secondary option. This first offset is then adjusted to obtain a more suitable second scrolling distance. Subsequently, by scrolling the secondary options in the secondary menu based on this second scrolling distance, the user can clearly see the correspondence between the primary and secondary options while avoiding repeated scrolling of the secondary menu, thus improving the display effect and enhancing the user experience.

[0016] In one possible implementation of the first aspect, the controller is further configured to: in response to a second switching instruction for switching secondary options, if the target secondary option has been loaded, obtain the third target coordinates of the target secondary option in the screen coordinate system through a preset function; and determine the pending scroll distance based on the third target coordinates and the fourth coordinates of the primary option to which the target secondary option belongs in the screen coordinate system.

[0017] Based on the above technical solution, when a display device displays a first-level menu and a second-level menu in a multi-level menu, and the focus is on the second-level menu, if the user inputs a switching command to switch the second-level option, and the target second-level option indicated by the switching command has been loaded, the position information of the target second-level option can be directly obtained. Then, combined with the position information of the first-level option to which the target second-level option belongs, the undetermined scrolling distance that the second-level menu needs to scroll is obtained, and the second scrolling distance is obtained for scrolling. This ensures that the target second-level option and its corresponding first-level option have a corresponding display position, and the user can intuitively see the correspondence between the target second-level option and the first-level option, thus ensuring the display effect of the display device and the user's experience.

[0018] In one possible implementation of the first aspect, after the control display marks the third option as selected, the controller is further configured to: in response to a menu expansion instruction for the third option, obtain the size information of the third-level menu corresponding to the third option and the first number of third-level options in the third-level menu; determine the display position of the third-level menu based on the first number, the size information of the third-level menu, and the fifth coordinate of the midpoint of the third option in the screen coordinate system; and control the display to display the third-level menu in the user interface according to the display position of the third-level menu.

[0019] Based on the above technical solution, the display can determine the appropriate display position of the third-level menu according to the size information of the third-level menu, the first number of third-level options in the third-level menu, and the position information of the second-level options to which the third-level menu belongs. This maximizes the complete display of the third-level menu, ensures the display effect of the display device, and improves the user experience.

[0020] In one possible implementation of the first aspect, the size information of the three-level menu includes a first width of the three-level menu in a second preset direction; the controller determines the display position of the three-level menu based on a first quantity, the size information of the three-level menu, and a fifth coordinate of the midpoint of the third option in the screen coordinate system, and is configured to: when the first quantity is greater than a preset maximum quantity, determine that the display position of the three-level menu is such that the first boundary of the three-level menu in the second preset direction coincides with the second boundary of the displayable area of ​​the user interface in the second preset direction; when the first quantity is less than or equal to the preset maximum quantity, and the horizontal or vertical coordinate value of the fifth coordinate is less than half of the first width, determine that the display position of the three-level menu is such that the first boundary of the three-level menu coincides with the second boundary of the displayable area; when the first quantity is less than or equal to the preset maximum quantity, and the first difference between the second width of the displayable area in the second preset direction and the horizontal or vertical coordinate value of the fifth coordinate is less than half of the first width, determine that the display position of the three-level menu is such that the first boundary of the three-level menu is at a first distance from the second boundary of the displayable area; the first distance is the difference between the second width and the first width.

[0021] Based on the above technical solution, the display device can determine different display scenarios for the third-level menu according to the size information of the third-level menu, the first number of third-level options in the third-level menu, and the position information of the second-level options to which the third-level menu belongs. This allows for different display positions of the third-level menu, thereby maximizing the complete display of the third-level menu, ensuring the display effect of the display device, and improving the user experience.

[0022] In one possible implementation of the first aspect, the controller determines the display position of the third-level menu based on a first quantity, the size information of the third-level menu, and the fifth coordinate of the midpoint of the third option in the screen coordinate system. It is further configured to: determine the display position of the third-level menu so that its center line coincides with the center line of the third option when the first quantity is less than or equal to a preset maximum quantity, the horizontal or vertical coordinate of the fifth option is greater than or equal to half the first width, and the first difference is greater than or equal to half the first width. In this way, when the third-level menu meets the adjustment requirement of being fully displayed when aligned with the center of the third option, it can be center-aligned with the third option when displaying the third-level menu. Since center alignment makes it easier for users to operate the third-level menu, it can bring a better display effect and improve the user experience.

[0023] In a second aspect, a display method is provided, applied to the display device provided in the first aspect. The method may include: displaying a first-level menu and a second-level menu in a user interface in response to an instruction to expand a multi-level menu; the first-level menu includes multiple first-level options, and a first option among the multiple first-level options is selected; the second-level menu includes multiple second-level options corresponding to at least one first-level option;

[0024] In response to a first switching command to switch a primary option, if the second option corresponding to the target primary option indicated by the first switching command is not loaded, the first index information of the boundary option in the secondary menu and the second index information of the second option in the secondary menu are obtained, and the first scroll distance of the second option is determined based on the first index information and the second index information; the second option is the secondary option with the smallest order among the multiple secondary options corresponding to the target primary option.

[0025] In addition, the first option is marked as unselected, the target first-level option is marked as selected, and all second-level options in the second-level menu are scrolled a first scroll distance so that the second option is loaded in the user interface and the boundary of the second option in the first preset direction is aligned with the boundary of the target first-level option in the first preset direction.

[0026] Thirdly, a computer-readable storage medium is provided that stores instructions which, when executed on a computer, enable the computer to perform any of the display methods described in the second aspect above.

[0027] Fourthly, a computer program product containing instructions is provided, which, when run on a display device, enables the display device to perform the display method described in any one of the second aspects above. Attached Figure Description

[0028] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0029] Figure 1 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 1 ;

[0030] Figure 2 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0031] Figure 3 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0032] Figure 4 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0033] Figure 5 A flowchart illustrating a display method provided in some embodiments of this application. Figure 1 ;

[0034] Figure 6 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 2 ;

[0035] Figure 7 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 3 ;

[0036] Figure 8 A flowchart illustrating a display method provided in some embodiments of this application. Figure 2 ;

[0037] Figure 9 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 4 ;

[0038] Figure 10 A flowchart illustrating a display method provided in some embodiments of this application. Figure 3 ;

[0039] Figure 11 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 5 ;

[0040] Figure 12 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 6 ;

[0041] Figure 13 A flowchart illustrating a display method provided in some embodiments of this application. Figure 4 ;

[0042] Figure 14 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 7 ;

[0043] Figure 15 A flowchart illustrating a display method provided in some embodiments of this application. Figure 5 ;

[0044] Figure 16 A flowchart illustrating a display method provided in some embodiments of this application. Figure 6 ;

[0045] Figure 17 A flowchart illustrating a display method provided in some embodiments of this application. Figure 7 ;

[0046] Figure 18 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 8 ;

[0047] Figure 19 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 9 ;

[0048] Figure 20 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 10 ;

[0049] Figure 21 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 10 one;

[0050] Figure 22 A schematic diagram of a multi-level menu display interface provided in some embodiments of this application. Figure 10 two. Detailed Implementation

[0051] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0052] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0053] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate. The terms "comprising" and "having," and any variations thereof, are intended to be comprehensive but not exclusive; for example, a product or device comprising a series of components is not necessarily limited to all components explicitly listed, but may include other components not explicitly listed or inherent to such product or device. The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code capable of performing the functions associated with that element.

[0054] First, the terms used in this application are explained as follows:

[0055] Focus: In user interface (UI) design, focus refers to visually guiding the user's attention to a specific element. It is usually used to indicate the location of the currently interactive element (such as a control) to help the user complete the operation efficiently.

[0056] RecyclerView: RecyclerView is a powerful and flexible view component for efficiently displaying large collections of scrollable data (such as lists, grids, etc.). It is an upgrade from ListView and GridView. RecyclerView only creates and binds views currently visible on the screen, reusing recycled views as scrolling occurs, avoiding duplicate creation and significantly improving performance (especially suitable for long lists).

[0057] Currently, in order to improve user experience, display devices such as TVs or smart TVs can use multi-level menus to display any possible setting options (such as the system settings of the display device itself and / or the settings of applications on the display device), so that users can make personalized adjustments to the display device or the various functions applied on the display device.

[0058] In related technologies, each level of a multi-level menu in a display device is displayed using a RecyclerView. Furthermore, in some possible implementation scenarios, to facilitate user browsing of audio and video content, it's necessary to minimize the impact of multi-level menus on the user interface. When displaying multi-level menus, the display device typically displays the first-level and second-level menus normally, while lower-level menus are displayed only when the user inputs relevant commands. To allow users to adjust more detailed settings according to their needs, the second-level menu can display all second-level options corresponding to all first-level options; that is, all second-level options are displayed in the same RecyclerView. Of course, due to the limited size of the user interface and the second-level menu, only a portion of all second-level options can be displayed simultaneously. Users can use any possible command, such as swiping, to control the display device to slide the displayed second-level options in the menu, thereby loading and displaying the undisplayed second-level options. Additionally, refer to... Figure 1 As shown, in the secondary menu, secondary options corresponding to the same primary option (e.g., secondary option 1, secondary option 2, and secondary option 3) are set consecutively, while sets of secondary options corresponding to different primary options are separated by specific markers, such as vertical lines.

[0059] Furthermore, to allow users to intuitively understand the correspondence between primary and secondary options, when a user switches focus on a primary option in the parent menu, the primary option that gains focus after the switch needs to be aligned with its corresponding first secondary option (e.g., left-aligned). The first secondary option refers to the first secondary option displayed in a specific direction when multiple secondary options corresponding to the primary option are displayed in the secondary menu. For example, refer to... Figure 1 As shown, if the secondary options corresponding to first-level option 2 are second-level option 4, second-level option 5, and second-level option 6, and the specific direction is from the left side of the screen to the right side of the screen, then when the focus switches from first-level option 1 to first-level option 2, the secondary menu needs to be scrolled to the right until second-level option 4 is aligned with the left edge of first-level option 2.

[0060] However, because RecyclerView has a view reuse mechanism, it only loads the view of the items currently in the visible area. Item views not yet in the visible area are not immediately created and loaded. Therefore, if a user needs to switch focus on a parent item (e.g., a first-level item) within a parent menu (e.g., a first-level item), and the corresponding second-level item (e.g., the first second-level item corresponding to the first-level item) is not loaded, its view and position in the user interface cannot be obtained. This results in inaccurate calculation of the scroll distance, affecting the display of multi-level menus and reducing the user experience.

[0061] To address the aforementioned problems, this application provides a display method that can be applied to a display device, specifically implemented by a controller within the display device. In this technical solution, the display device can determine the position information of the secondary option to be aligned using the index information of the secondary options in a secondary menu, thereby accurately obtaining the scroll distance of the secondary option. Specifically, when the display device displays a primary menu and a secondary menu in a multi-level menu in the user interface, if the user inputs a first switching command to switch the target primary option, and the corresponding secondary option is not loaded, in response to the first switching command, the display device can retrieve the first index information of the boundary option and the second index information of the second option among the displayed secondary options in the secondary menu from a pre-stored secondary menu index table, thereby determining the first scroll distance of the second option based on the first and second index information. Here, the second option refers to the one with the smallest order (i.e., the order / sequence in a specific direction (e.g., from left to right) among the multiple secondary options corresponding to the target primary option. The boundary option refers to the option located at the boundary among the multiple secondary options displayed in the secondary menu.

[0062] Based on this, the display device can control the target first-level option in the first-level menu to be selected (i.e., focus or focus switch to the target first-level option), and control all second-level options in the second-level menu to scroll a first scroll distance so that the second option is loaded in the user-decrypted state, and the boundaries (e.g., the left boundary) of the second option and the target first-level option in a first preset direction (e.g., from right to left).

[0063] In the technical solution provided in this application embodiment, when the display device displays a first-level menu and a second-level menu in a multi-level menu, if the user inputs a switching command to switch the first-level option, and the first second-level option (i.e., the second-level option with the smallest order) in a specific direction among the multiple second-level options corresponding to the target first-level option indicated by the switching command is not loaded, the first scroll distance corresponding to the second-level option can be obtained by acquiring the index information of the undisplayed second-level option and the displayed boundary option in the second-level menu, and scrolling can be performed. This allows the target first-level option to be left-aligned with its corresponding second-level option after the first-level option is switched, so that the user can intuitively see the correspondence between the second-level option and the first-level option after the first-level option is switched, thereby improving the display effect of the display device and the user's experience.

[0064] The technical solution provided in this application will be described in detail below with reference to the accompanying drawings.

[0065] The display device 200 disclosed in this application refers to a device with image display and data processing capabilities, and this display device 200 has the ability to play ATSC 3.0 corresponding programs. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, laser projection devices, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc. This application does not limit the specific form of the display device.

[0066] Figure 2 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 2 As shown, a user can operate the display device 200 via touch operation, a mobile terminal 300, and a control device 100. Communication between the control device 100 and the display device 200 includes infrared protocol communication, Bluetooth protocol communication, wireless, or other wired methods to control the display device 200. The control device 100 receives user-inputted operation commands and converts them into control commands that the display device 200 can recognize and respond to. These operation commands can be input by the user through button operation on the control device, voice input, control panel input, or other input methods. For example, the control device 100 can be a remote control, stylus, gamepad, etc.

[0067] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 and the display device 200 can have the same or compatible software applications installed, enabling communication via network communication protocols to achieve one-to-one control and data communication. Furthermore, audio and video content displayed on the mobile terminal 300 can be transmitted to the display device 200 for synchronized display. In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0068] like Figure 2 The document also shows that the display device 200 communicates with the server 400 via various communication methods, such as wired or wireless. The display device 200 can communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 can provide the display device 200 with various content and interactive features. For example, the server 400 can store subtitle data for ATSC 3.0 virtual channels and provide it to the display device 200 when needed, thereby enabling the display device 200 to implement the display method provided in this embodiment.

[0069] Display device 200 can provide broadcast television reception function (e.g., receiving TV programs corresponding to ATSC 3.0), and can also be equipped with smart network TV function that provides computer support, including but not limited to network TV, smart TV, Internet Protocol TV (IPTV), etc.

[0070] Figure 3 Provided for some embodiments of this application Figure 2 Hardware configuration block diagram of display device 200.

[0071] In some embodiments, the display device 200 may include at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0072] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0073] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user interface (UI), etc.

[0074] For example, the display 160 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0075] In some embodiments, the communicator 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 may have multiple communicators 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communicator 220 with Wi-Fi functionality. When the display device 200 supports Bluetooth connection communication, it needs to have a communicator 220 with Bluetooth functionality.

[0076] The communicator 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0077] In some embodiments, controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), and a power processor; random access memory (RAM); read-only memory (ROM); a first to an nth interface for input / output; a communication bus; etc. Controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. Controller 250 controls the overall operation of display device 200. For example, in response to receiving a user command to select a UI object to display on display 160, controller 150 can perform operations related to the object selected by the user command.

[0078] The tuner / demodulator 110 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals from multiple wireless or wired broadcast television signals, such as Electronic Program Guide (EPG) signals, ATSC 3.0 broadcast signals, etc.

[0079] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0080] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives user input commands through the GUI. In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For external audio output devices connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200. In some embodiments, the user input interface 280 can be used to receive user input instructions from the control device 100 or the mobile terminal 300.

[0081] In this application, "user interface" refers to the medium interface through which an application or operating system interacts and exchanges information with the user. It realizes the conversion between the internal form of information and the form that the user can accept. The most common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an interface element such as an icon, window, or control displayed on the screen of a display device. The control can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0082] Understandably, in general, the implementation of display device functions requires not only the support of the aforementioned hardware, but also the cooperation of software.

[0083] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0084] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0085] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 4As shown, in some embodiments, the operating system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0086] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In this application embodiment, the application layer may include a live TV application, and the cooperation of various modules in this application can be used to execute the display method provided in the embodiments of this disclosure. In some embodiments, the live TV application may include an activity module (LiveTvActivity), a menu module, and a menu focus assistant module. For example, if the multi-level menu displayed in the display method provided in this application is a game menu, then the menu module may be LiveTvGameMenu, and the menu focus assistant module may be GameMenuFocusHelper.

[0087] The Activity module, acting as the main interface controller, is responsible for handling user interactions. The Menu module manages menu data and the user interface, and also registers a global focus change listener in the Menu Focus module. The Menu Focus Assistant module calculates the scroll distance of any level of menu based on the focus change data detected by the global focus change listener and executes the corresponding scrolling.

[0088] In practice, the application packages in the application layer are not limited to the examples above.

[0089] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0090] like Figure 4As shown, the application framework layer in this embodiment includes a view system, managers, and a content provider. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0091] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0092] In some embodiments, the kernel layer (or driver layer) is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 4 As shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0093] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0094] The display methods described in the following embodiments can be implemented in a display device having the above-described hardware and software structures. The display methods provided in the embodiments of this application are described below.

[0095] This application provides a display method applied to the display device provided in the foregoing embodiments. The display device may include a display and a controller coupled to the display. The display is configured to display a user interface, and the controller is configured to execute the display method provided in this application. (Refer to...) Figure 5 As shown, the display method may specifically include S501-S507:

[0096] S501, In response to the instruction to expand a multi-level menu, display the first-level menu and the second-level menu in the user interface.

[0097] The primary menu includes multiple primary options, with the first option among them being selected. The secondary menu includes multiple secondary options corresponding to at least one primary option. Furthermore, in this embodiment, the secondary menu can display all secondary options corresponding to all primary options; that is, all secondary options must be displayed in the same secondary menu. However, due to the limited size of the user interface and the secondary menu, only a portion of all secondary options can be displayed simultaneously. Users can switch between the secondary options displayed in the secondary menu using any possible commands (e.g., subsequent first switching commands, second switching commands, etc.).

[0098] In this embodiment of the application, the selected state can refer to the focus state (the state of acquiring focus).

[0099] For example, such as Figure 1 As shown, the first-level menu may include first-level option 1, first-level option 2, first-level option 3, first-level option 4, and first-level option 5. Among them, first-level option 1 is selected as the first option. First-level option 1 can be the default first-level option when the first-level menu is displayed, or it can be the first-level option that was selected when the user last closed the multi-level menu. This application does not impose specific restrictions on this.

[0100] The secondary menu can include secondary options 1, 2, and 3 corresponding to primary option 1; secondary options 4, 5, and 6 corresponding to primary option 2; secondary options 7 and 8 corresponding to primary option 3; and all secondary options corresponding to primary options 4 and 5. Due to the limited size of the user interface, all secondary options corresponding to primary options 4 and 5 are not shown. If the user needs to view the secondary options corresponding to primary options 4 and 5, they can input a switching command for the primary or secondary menu (e.g., a switching command for primary options or a switching command for secondary options). The display device can respond to the switching command and display the undisplayed secondary options. Furthermore, the primary menu can also include more primary options that are not displayed; this application does not impose specific limitations on this. The display method for undisplayed primary options is the same as the display method for undisplayed secondary options, and will not be elaborated here.

[0101] In some embodiments, the display method provided in this application may specifically be executed by a controller calling a live TV application. In this case, the live TV application is in a running state before S501 is executed. Based on this, if the user needs to adjust various parameters of the content played by the live TV application in the user interface or various parameters of the display device itself, they can input instructions to expand multi-level menus into the display device in any feasible manner, so that the display device displays the first-level menu and the second-level menu in the user's view.

[0102] In some embodiments, a multi-level menu may specifically be a game menu.

[0103] For example, the expansion command can be a voice command or an operation command. When the expansion command is an operation command, the operation corresponding to the operation command can be an operation of selecting a menu control, an operation input on a control device (such as a remote control), or other pre-set operations for expanding multi-level menus. The embodiments of this application do not limit the implementation method of the expansion command.

[0104] In some embodiments, the display method is executed by various modules in a live TV application. For example, when a user presses the menu button on a control device (such as a remote control), the control device sends the command to the display device. (Refer to...) Figure 15 As shown, when the user presses the menu button, causing the control device to send an expand command to the display device, the active module in the live TV application on the display device can, upon receiving the expand command from the control device, respond to the expand command by sending an instruction to the menu module to display multi-level menu information. The active module can receive the expand command through the onKeyDown() method. In some embodiments, this expand command can also be referred to as a menu button press event.

[0105] Upon receiving an instruction to display a multi-level menu, the menu module can first initialize the relevant data for the multi-level menu. After initialization, it will then display the menu in the user interface as follows: Figure 1 The multi-level menu shown includes a first-level menu and a second-level menu. For example, if the multi-level menu is a game menu, the relevant data for the multi-level menu may include game option data.

[0106] After displaying a multi-level menu, in order to obtain timely data on focus changes within the multi-level menu, the menu module needs to register (addOn) a global focus change listener (GlobalFocusChangeLister) in the menu focus assistant module, thus enabling timely acquisition of focus change data. Furthermore, to clearly distinguish different options, the menu module can also set corresponding tags for each focusable option in the multi-level menu when it is displayed.

[0107] For example, refer to Figure 15 As shown, since the menu module is an object class and the menu focus assistant module is a management class, and listeners can be registered in the object class, the menu module needs to first create an instance of the menu assistant module in the menu focus assistant module. This instance can be used as an object class for the menu module to register global focus change listeners.

[0108] After the listener is registered, the menu focus assistant module can monitor the focus changes on multi-level menus in real time and obtain the corresponding focus change data.

[0109] In this embodiment, S501 can specifically be the controller responding to the instruction to expand the multi-level menu, controlling the display to show the first-level menu and the second-level menu in the user interface.

[0110] S502, in response to a first switching instruction for switching a primary option, determine whether the second option corresponding to the target primary option indicated by the first switching instruction has been loaded.

[0111] The second option is the lowest-ranking of the multiple second-level options corresponding to the target first-level option. In this embodiment, the order of the second-level options refers to the order obtained by sorting all displayable second-level options in the second-level menu according to a specific direction; or, the order of the second-level options refers to the order / sequence in a specific direction when all displayable second-level options are displayed in the second-level menu. For example, using... Figure 1 Taking the second-level menu as an example, if the specific direction is from left to right, then the order of second-level options 1 to 8 is 1 to 8 respectively. If the target first-level option is first-level option 2, and the corresponding second-level options for first-level option 2 are second-level option 4, second-level option 5, and second-level option 6, then the second option is second-level option 4, which is in the order of 4.

[0112] In some embodiments, the first switching instruction may be a voice instruction or an operation instruction. When the first switching instruction is an operation instruction, the operation corresponding to the operation instruction may be the operation of moving the user control focus from the first option to the target primary option, the operation of pressing the left / right key on the control device (such as a remote control), or other pre-set operations for switching primary options. This application embodiment does not limit the input method of the first switching instruction.

[0113] Since the multi-level menu in this embodiment is displayed using RecyclerView, loaded options can directly obtain their corresponding views and position information, thus accurately determining the scroll distance. Unloaded options, however, cannot directly obtain their corresponding views and require other methods to obtain their position information to determine the scroll distance. Therefore, upon receiving the first switching instruction, to determine which method to use to determine the scroll distance, it is necessary to first determine whether the target first-level option has been loaded (target first-level option != null?).

[0114] For example, the first switching instruction is an instruction generated by the user pressing the left / right button on the control device (such as a remote control), as shown in the example. Figure 15 As shown, the specific implementation of S502 may include: when the user presses the left / right keys to adjust the position of the focus in the first-level menu, the menu module can adjust the display format of the options before and after the focus change according to the focus change. For example, the color of the out-of-focus option is changed to the first color and the option is shrunk to its original size; the color of the focused option is changed to the second color and the option is enlarged to the focused size, etc. Simultaneously, the menu module can trigger a focus change callback to instruct the menu focus assistant module to listen for focus changes, obtain focus change data, and determine whether scroll distance needs to be calculated based on the option labels before and after the focus switch in the focus change data. In this embodiment, the change of focus between first-level options and between second-level options requires the calculation of scroll distance.

[0115] Based on this, if the option labels before and after the focus switch determine that the focus changes between first-level options, the menu focus assistant module can begin calculating the required scroll distance. If the option labels before and after the focus switch determine that the focus does not change between first-level or second-level options, no further action is taken. For example, the menu focus assistant module can calculate the required scroll distance by calling the `calculateTargetXByPosition()` method / interface. When calculating the scroll distance, the menu focus assistant module first checks whether the second option has been loaded.

[0116] If it is determined that the second option corresponding to the target first-level option is not loaded, it is necessary to obtain the position information (e.g., coordinates in the screen coordinate system) of the second option by acquiring the first index information of the boundary option and the second index information of the second option in the second-level menu, and then calculate the corresponding scroll distance. That is, if the second option is not loaded, execute S503.

[0117] If it is determined that the second option corresponding to the target first-level option has been loaded, the position information of the second option can be directly obtained through a preset function, thereby determining the corresponding scroll distance. That is, if the second option has been loaded, execute S504.

[0118] Of course, in practice, the judgment step in S502 above may not be necessary. The controller of the display device can execute S504 when the second option corresponding to the target first-level option has been loaded, and execute S503 when the second option corresponding to the target first-level option has not been loaded.

[0119] S503. Obtain the first index information of the boundary option in the second-level menu and the second index information of the second option in the second-level menu among the displayed second-level options.

[0120] In this embodiment, the boundary option in the displayed secondary options of the secondary menu refers to the outermost (or boundary) secondary option among the currently displayed secondary options. For example,... Figure 1 Taking the second-level menu shown as an example, the boundary options in the second-level options that have been displayed in the second-level menu are second-level option 1 and second-level option 8.

[0121] In this embodiment, the first index information is used to indicate the order (or position) of the boundary option in the secondary menu, and the second index information is used to indicate the order (or position) of the second option in the secondary menu. The order refers to the sequence obtained by sorting all the secondary options that can be displayed in the secondary menu according to a specific direction, such as which one from left to right.

[0122] In some embodiments, the controller of the display device can retrieve first index information and second index information from a pre-stored secondary menu index table based on the feature information of the boundary option and the feature information of the second option. The feature information can be any possible data such as a name or label. The feature information of the boundary option and the feature information of the second option can be retrieved in any possible manner. For example, the name of the secondary menu and the name of the target primary option can be directly obtained from the view content of the secondary options in the secondary menu displayed on the user interface, and the name of the second option can be retrieved from the primary-secondary mapping table based on the name of the target primary option. The primary-secondary mapping table can include the correspondence between primary options and secondary options. The secondary menu index table can include the order and feature information of all secondary options in the secondary menu.

[0123] After obtaining the first index information and the second index information, the controller can determine the accurate first rolling distance based on the first index information and the second index information. That is, execute S506.

[0124] S504. Obtain the second target coordinates of the second option in the screen coordinate system through a preset function.

[0125] For example, the default function could be getX().

[0126] In this embodiment, the second target coordinates of the second option in the screen coordinate system can refer to the coordinates of the boundary point of the second option in the screen coordinate system. For example, if the second option is a rectangle in the user interface, then the boundary point of the second option is any vertex on the boundary of the second option near the origin of the screen coordinate system (e.g., the vertex at the top left corner).

[0127] After obtaining the second target coordinates of the second option in the screen coordinate system, the controller can determine the first scroll distance based on the second target coordinates and the coordinates of the target first-level option in the screen coordinate system. That is, S505 is executed after S504.

[0128] S505. Determine the first scroll distance based on the second target coordinates and the third coordinates of the target first-level option in the screen coordinate system.

[0129] Specifically, the third coordinate of the target first-level option in the screen coordinate system can be obtained through a preset function. The third coordinate refers to the coordinates of the key point of the target first-level option in the screen coordinate system. The definition of the key point of the target first-level option is the same as the definition of the key point of the second option.

[0130] In some embodiments, if the options in the first-level menu and the second-level menu are displayed in the following manner... Figure 1 As shown in the horizontal display, and with the options in the same menu sorted from left to right, the first scroll distance can be the difference between the horizontal coordinates of the second and third targets. For example, combining... Figure 1 , refer to Figure 7 As shown, if the target first-level option is first-level option 2 and the second option is second-level option 4, then the first scroll distance is the difference between the horizontal coordinate x1 of first-level option 2 and the horizontal coordinate x2 of second-level option 4.

[0131] For example, if the x-coordinate of the second target coordinate is 100 and the x-coordinate of the third coordinate is 20, then the first scroll distance is -80. In this embodiment, the sign of the first scroll distance is used to determine the final scroll direction. For example, if the display format of the options in the first-level menu and the second-level menu is as follows... Figure 1 As shown in the horizontal display, and with a first scroll distance of -80, the second-level options in the second-level menu need to scroll 80 degrees in the opposite direction of the horizontal axis of the screen coordinate system when scrolling; if the display format of the options in the first-level menu and the second-level menu is as follows... Figure 1 As shown in the horizontal display, and with the first scroll distance being 80, the second-level options in the second-level menu need to scroll 80 in the positive direction of the horizontal axis of the screen coordinate system when scrolling.

[0132] In other embodiments, if the options in the first-level menu and the second-level menu are displayed in the following manner... Figure 6As shown in the vertical display, and with the options in the same-level menu sorted from top to bottom, the first scroll distance can be the difference between the ordinates of the second and third target coordinates. For example, if the ordinate of the second target coordinate is 100 and the ordinate of the third coordinate is 20, then the first scroll distance is -80. In this embodiment, the sign of the first scroll distance is used to determine the final scroll direction. For example, if the display format of the options in the first-level and second-level menus is as follows... Figure 1 As shown in the vertical display, and with the first scroll distance being -80, the second-level options in the second-level menu need to scroll 80 degrees in the opposite direction of the vertical axis of the screen coordinate system when scrolling; if the display format of the options in the first-level menu and the second-level menu is as follows... Figure 1 As shown in the vertical display, and with the first scroll distance being 80, the second-level options in the second-level menu need to scroll 80 in the positive direction of the vertical axis of the screen coordinate system when scrolling.

[0133] Based on the technical solutions corresponding to S504-S505, when a display device displays a first-level menu and a second-level menu in a multi-level menu, if the user inputs a switching command to switch the first-level option, and the first second-level option (i.e., the lowest-order second-level option) in a specific direction among the multiple second-level options corresponding to the target first-level option indicated by the switching command has been loaded, the position information of the first second-level option can be directly obtained. Then, combined with the position information of the target first-level option, the first scroll distance that the second-level menu needs to scroll is determined, and thus scrolling is performed. This ensures that after the first-level option is switched, the target first-level option is left-aligned with its corresponding second-level option. As a result, after the first-level option is switched, the user can intuitively see the correspondence between the second-level option and the first-level option, ensuring the display effect of the display device and the user's experience.

[0134] S506. Based on the first index information and the second index information, determine the first scroll distance of the second option.

[0135] In some embodiments, the boundary options include a first boundary option and a second boundary option. The first index information includes a first index value of the first boundary option and a second index value of the second boundary option, wherein the first index value is less than the second index value. The second index information includes a target index value. The first index value is used to indicate the order of the first boundary option in the secondary menu, the second index value is used to indicate the order of the second boundary option in the secondary menu, and the target index value is used to indicate the order of the second option in the secondary menu.

[0136] After obtaining the first index information and the second index information, the coordinates of the second option in the screen coordinate system can be determined based on the first index information and the second index information, thereby obtaining the first scroll distance. Based on this, in some embodiments, combined with Figure 5 , refer to Figure 8As shown, S506 may include S801-S804:

[0137] S801. Determine whether the target index value is less than the first index value.

[0138] When the target index value is less than the first index value, it means that the second option has a lower order in the second-level menu than the first boundary option. The display format of the options in the first-level and second-level menus is as follows: Figure 1 As shown in the example of a horizontal display where options in the same menu are sorted from left to right, the second option should be positioned to the left of the first option in the screen coordinate system. The display format of options in the first-level and second-level menus is as follows: Figure 6 Taking the vertical display shown as an example, where the options in the same menu are sorted from top to bottom, the second option should be located above the first boundary option in the screen coordinate system. In this case, the first target coordinate of the second option in the screen coordinate system can be determined based on the first coordinate of the first boundary option in the screen coordinate system, the size information of the second-level option, and the first index difference, i.e., S802 is executed.

[0139] Since the second option itself is not loaded, the target index value must be outside the range of [first index value, second index value]. Therefore, when the target index value is greater than or equal to the first index value, the target index value is greater than the second index value. This means that the second option has a higher order in the second-level menu than the second boundary option. The display format of the options in the first-level and second-level menus is as follows: Figure 1 As shown in the example of a horizontal display where options in the same menu are sorted from left to right, the second option should be positioned to the right of the second boundary option in the screen coordinate system. The display format of options in the first-level and second-level menus is as follows: Figure 6 Taking the vertical display shown as an example, where the options in the same menu are sorted from top to bottom, the second option should be located below the second boundary option in the screen coordinate system. In this case, the first target coordinate of the second option in the screen coordinate system can be determined based on the second coordinate of the second boundary option in the screen coordinate system, the size information of the second-level option, and the difference between the second index, i.e., S803 is executed.

[0140] It should be noted that, based on the above description, the judgment step of S801 can also be to determine whether the target index value is greater than the second index value. If the target index value is greater than the second index value, S803 can be executed, and if the target index value is less than or equal to the second index value, S802 can be executed.

[0141] Of course, in practice, the above-mentioned S801 judgment step may not be necessary. The controller of the display device can execute S803 if the target index value is greater than the second index value, and execute S802 if the target index value is less than the first index value.

[0142] S802. Based on the first coordinates of the first boundary option in the screen coordinate system, the size information of the second option, and the first index difference, determine the first target coordinates of the second option in the screen coordinate system.

[0143] The first index difference is the difference between the first index value and the target index value, specifically the difference between the first index value and the target index value.

[0144] In some embodiments, if the secondary option is a rectangle, the size information of the secondary option includes its width, which refers to the width of the secondary option in a first preset direction. In this embodiment, the first preset direction can be the direction from the second boundary option to the first boundary option. The method for obtaining the size information of the secondary option can be any possible implementation, and this application does not impose any specific limitations on it. The method for obtaining the size information of various options in subsequent embodiments is similar.

[0145] In some embodiments, the first coordinates of the first boundary option in the screen coordinate system can be obtained through a preset function. The first coordinates may refer to the coordinates of the key points of the first boundary option in the screen coordinate system. The definition of the key points of the first boundary option is the same as the definition of the key points of the second option described after S504 in the foregoing embodiments.

[0146] The display format is based on the options in the first-level menu and the second-level menu. Figure 1 As shown in the horizontal display example, where the options in the same menu are sorted from left to right, the horizontal coordinate of the first target coordinate is calculated as: horizontal coordinate of the first target coordinate - width of the second-level option * difference of the first index. For example, if the horizontal coordinate of the first target coordinate is 100, the width of the second-level option is 5, and the difference of the first index is 5, then the horizontal coordinate of the first target coordinate is 100 - 5 * 5 = 75.

[0147] The ordinate of the second target is the same as the ordinate of the first target.

[0148] The display format is based on the options in the first-level menu and the second-level menu. Figure 6 As shown in the vertical display, and taking the sorting direction of options in the same menu from top to bottom as an example, the ordinate of the first target coordinate = the ordinate of the first coordinate - the width of the second-level option * the difference of the first index. For example, if the ordinate of the first coordinate is 100, the width of the second-level option is 5, and the difference of the first index is 5, then the ordinate of the first target coordinate is 100 - 5 * 5 = 75.

[0149] The x-coordinate of the second target is the same as that of the first target.

[0150] S804 is executed after S802.

[0151] S803. Based on the second coordinates of the second boundary option in the screen coordinate system, the size information of the secondary option, and the difference between the second index, determine the first target coordinates of the second option in the screen coordinate system.

[0152] The second index difference is the difference between the second index value and the target index value, specifically the difference between the target index value and the second index value.

[0153] In some embodiments, if the secondary option is a rectangle, the size information of the secondary option includes the width of the secondary option, which refers to the width of the secondary option in a first preset direction.

[0154] In some embodiments, the second coordinates of the second boundary option in the screen coordinate system can be obtained through a preset function. The second coordinates can refer to the coordinates of the key points of the second boundary option in the screen coordinate system. The definition of the key points of the second boundary option is the same as the definition of the key points of the second option described after S504 in the foregoing embodiments.

[0155] The display format is based on the options in the first-level menu and the second-level menu. Figure 1 As shown in the horizontal display example, where the options in the same menu are sorted from left to right, the x-coordinate of the first target is calculated as: x-coordinate of the second target + width of the second-level option * difference of the second index. For example, if the x-coordinate of the second target is 200, the width of the second-level option is 5, and the difference of the second index is 5, then the x-coordinate of the second target is 200 + 5 * 5 = 225. The y-coordinate of the first target is the same as the y-coordinate of the second target.

[0156] The display format is based on the options in the first-level menu and the second-level menu. Figure 6 As shown in the vertical display, and assuming the options in the same menu are sorted from top to bottom, the ordinate of the first target is calculated as: ordinate = ordinate of the second target + width of the second-level option * difference of the second index. For example, if the ordinate of the second target is 200, the width of the second-level option is 5, and the difference of the second index is 5, then the ordinate of the first target is 200 + 5 * 5 = 225. The x-coordinate of the first target is the same as the x-coordinate of the second target.

[0157] S804 is executed after S803.

[0158] In some embodiments, due to various possible reasons, the x / y coordinate of the final obtained first target coordinate may be 0, while in reality, the x or y coordinate of any option in the screen coordinate system cannot be 0. Therefore, it can be determined with a high probability that the first target coordinate is incorrect. In this case, it can be determined that an accurate first scroll distance cannot be obtained, and the scrolling of the secondary menu can be stopped, and an error mark can be displayed in the user interface to prompt the user that the option switching action has failed and scrolling cannot be performed. Based on this, after obtaining the first target coordinate, it can be first determined whether the x or y coordinate of the first target coordinate is 0. If not, the subsequent steps are executed (e.g., S804); if so, the subsequent steps are not executed and an error mark is displayed in the user interface. The specific implementation process of calculating the second scroll distance is similar.

[0159] S804. Determine the first scroll distance based on the first target coordinates and the third coordinates of the target first-level option in the screen coordinate system.

[0160] The specific implementation of S804 can be referred to the relevant description of S505 in the aforementioned embodiments, and will not be repeated here.

[0161] Based on the technical solutions corresponding to S801-S804 above, the display device can select appropriate parameters to calculate the position information of the second option (i.e., the first target coordinates of the second option in the screen coordinate system) based on the relationship between the first index value and the second index value in the first index information and the target index value in the second index information. This accurately obtains the precise position of the unloaded second option in the screen coordinate system, and thus obtains the accurate first scroll distance for scrolling. This ensures that after switching the first-level option, the target first-level option is left-aligned with its corresponding second option. Consequently, after switching the first-level option, the user can intuitively see the correspondence between the second-level option and the first-level option, improving the display effect of the display device and the user experience. With the first scroll distance obtained, the display device can adjust the focus in the first-level menu, causing the first option to defocus and the target first-level option to gain focus, while simultaneously controlling the second-level option in the second-level menu to scroll the first scroll distance. That is, S507 is executed after S505 and S506.

[0162] S507. Mark the first option as unselected, mark the target first-level option as selected, and control all second-level options in the second-level menu to scroll by a first scroll distance so that the second option is loaded in the user interface and the boundary of the second option in the first preset direction is aligned with the boundary of the target first-level option in the first preset direction.

[0163] In this embodiment, the unselected state can refer to being out of focus, and the selected state can refer to being in focus. Furthermore, the display format of the out-of-focus option and the in-focus option can be different. For example, the out-of-focus option may be a first color and have the original size; the in-focus option may be a second color and have the in-focus size.

[0164] For example, refer to Figure 15 As shown, controlling the scrolling of all second-level options in the second-level menu by the first scroll distance can be accomplished by the menu focus assistant module in the live TV application. The menu focus assistant module can call the recycleview.smoothscrollto() interface to execute the scrolling of the second-level menu. In addition, S503-S506 in the aforementioned embodiment can be accomplished by the menu focus assistant module calling the calculateTargetXByPosition() method / interface.

[0165] It should be noted that, in practice, marking the first option as unselected and the target first-level option as selected, along with scrolling the second-level menu, can be performed simultaneously or sequentially with a duration imperceptible to the user. If they are not executed synchronously, in practice, after the user inputs the first switching command to switch the first option, the first option can be marked as unselected and the target first-level option as selected first, followed by the actions of determining the first scroll distance and scrolling the second-level menu. In some embodiments, the actions of marking the first option as unselected and the target first-level option as selected, and the action of determining the first scroll distance, can be executed synchronously, with the action of scrolling the second-level menu performed after the first scroll distance is determined. Of course, in practice, the execution order of the above actions can also be any other possible order, and this application does not impose specific restrictions on this.

[0166] For example, with Figure 1 Taking the multi-level menu shown as an example, if the first option is first-level option 1, the target first-level option is first-level option 2, and the second option is second-level option 4, the multi-level menu after scrolling all second-level options in the second-level menu based on the first scroll distance is as follows: Figure 9 As shown, the left boundary (boundary in the first preset direction) of secondary option 4 and the left boundary (boundary in the first preset direction) of primary option 2 are aligned. Furthermore, due to scrolling of the secondary menu, secondary option 1 is no longer displayed, while secondary options 9 and 10 are also loaded and displayed in the user interface.

[0167] In this embodiment, S507 specifically involves the controller controlling the display to mark the first option as unselected, the target first-level option as selected, and controlling all second-level options in the second-level menu to scroll a first scroll distance, so that the second option is loaded in the user interface, and the boundary of the second option in a first preset direction is aligned with the boundary of the target first-level option in the first preset direction. Based on the technical solution provided by this embodiment, when the display device displays the first-level menu and second-level menu in a multi-level menu, if the user inputs a switching command to switch the first-level option, and the first second-level option (i.e., the lowest-order second-level option) in a specific direction among the multiple second-level options corresponding to the target first-level option indicated by the switching command is not loaded, the first scroll distance corresponding to the second option can be obtained by acquiring the index information of the unloaded second option and the displayed boundary option in the second-level menu, and scrolling can be performed. This ensures that after the first-level option is switched, the target first-level option and its corresponding second option are aligned to the left, so that after the first-level option is switched, the user can intuitively see the correspondence between the second-level option and the first-level option, improving the display effect of the display device and the user experience.

[0168] In some embodiments, when the display device displays a primary menu and a secondary menu, the user can also directly switch between secondary options in the secondary menu. When switching between secondary options, it is necessary to accurately obtain the corresponding second scroll distance according to display requirements to complete the scrolling of the secondary options in the secondary menu, ensuring the display effect of the display device and improving the user experience. Based on this, combined with Figure 5 , refer to Figure 10 As shown, the display method may further include S508-S515 after S501:

[0169] S508. In response to the selection instruction for the third option in the secondary menu, mark the third option as selected.

[0170] For example, the selection instruction can be a voice instruction or an operation instruction. When the selection instruction is an operation instruction, the operation corresponding to the operation instruction can be the operation of selecting the third option, the operation input on the control device (such as a remote control), or other pre-set operations for selecting the third option. The embodiments of this application do not limit the implementation method of the expansion instruction.

[0171] For example, in combination Figure 1 Taking option 8 as an example (the third option being a secondary option), the focus of the multi-level menu in response to the selection command for the third option can be referred to... Figure 11 As shown.

[0172] In this embodiment, S508 can specifically be the controller responding to the selection instruction of the third option in the secondary menu and controlling the display to mark the third option as selected.

[0173] S509. In response to a second switching instruction for switching secondary options, determine whether the target secondary option indicated by the second switching instruction has been loaded.

[0174] In some embodiments, the second switching instruction may be a voice instruction or an operation instruction. When the second switching instruction is an operation instruction, the operation corresponding to the operation instruction may be the operation of moving the user control focus from the third option to the target secondary option, the operation of pressing the left / right key on the control device (such as a remote control), or other pre-set operations for switching secondary options. This application embodiment does not limit the input method of the second switching instruction.

[0175] Since the multi-level menu in this embodiment is displayed using RecyclerView, loaded options can directly obtain their corresponding views and position information, thus accurately determining the scroll distance. Unloaded options, however, cannot directly obtain their corresponding views and require other methods to obtain their position information to determine the scroll distance. Therefore, upon receiving the second switching instruction, to determine which method to use to determine the scroll distance, it is necessary to first determine whether the target second-level option is loaded (target second-level option != null?).

[0176] If it is determined that the target secondary option is not loaded, the position information (e.g., coordinates in the screen coordinate system) of the target secondary option needs to be obtained by acquiring the third index information of the boundary option in the secondary menu and the fourth index information of the target secondary option, and then the corresponding scroll distance can be calculated. That is, if the target secondary option is not loaded, execute S510.

[0177] If it is determined that the target secondary option has been loaded, the position information of the target secondary option can be directly obtained through a preset function, and then the corresponding scroll distance can be determined. That is, if the target secondary option has been loaded, execute S511.

[0178] Of course, in practice, the judgment step in S509 above may not be necessary. The controller of the display device can execute S511 when the target secondary option is loaded, and execute S510 when the target secondary option is not loaded.

[0179] S510. Obtain the third index information of the boundary option in the second-level menu and the fourth index information of the target second-level option in the second-level menu.

[0180] The definition of the boundary options can be referred to the relevant description after S503 in the previous embodiment, and will not be repeated here.

[0181] In this embodiment, the definition of the third index information can refer to the definition of the first index information after S503 in the aforementioned embodiment, and will not be repeated here. The fourth index information is used to indicate the order (or position) of the target secondary option in the secondary menu.

[0182] The methods for obtaining the third and fourth index information can refer to the relevant descriptions after S503 in the aforementioned embodiments, and will not be repeated here.

[0183] After obtaining the first index information and the second index information, the controller can determine a first scrolling distance that aligns the second option with the boundary of the target first-level option in a first preset direction. That is, S513 is executed.

[0184] S511. Obtain the third target coordinates of the target secondary option in the screen coordinate system through a preset function.

[0185] S512. Determine the undetermined scrolling distance based on the coordinates of the third target and the fourth coordinate of the first-level option to which the target's second-level option belongs in the screen coordinate system.

[0186] The specific implementations of S511 and S512 can be referred to the relevant descriptions of S504 and S505 in the aforementioned embodiments, and will not be repeated here.

[0187] Based on the technical solutions corresponding to S511-S512, when the display device displays a first-level menu and a second-level menu in a multi-level menu, and the focus is on the second-level menu, if the user inputs a switching command to switch the second-level option, and the target second-level option indicated by the switching command has been loaded, the position information of the target second-level option can be directly obtained. Then, combined with the position information of the first-level option to which the target second-level option belongs, the undetermined scrolling distance required for the second-level menu to be scrolled is determined, thus obtaining the second scrolling distance for scrolling. This ensures that the switched target second-level option and its corresponding first-level option have a corresponding display position, allowing the user to intuitively see the correspondence between the target second-level option and the first-level option, guaranteeing the display effect of the display device and the user experience. S513: Determine the undetermined scrolling distance of the target second-level option based on the third index information and the fourth index information.

[0188] The specific implementation of S513 can refer to the specific implementation of S506 in the aforementioned embodiments, and will not be repeated here. The difference between the two is that S506 specifically determines the first scroll distance of the second option based on the first index information and the second index information, while S513 determines the pending scroll distance of the target secondary option based on the third index information and the fourth index information. In the specific implementation, the first index information and the third index information have the same function, and the second index information and the fourth index information have the same function.

[0189] S514. Determine the second rolling distance of the target secondary option based on the pending rolling distance.

[0190] In this embodiment of the application, S514 can be implemented in the following ways:

[0191] In the first implementation, the pending scroll distance can be directly determined as the second scroll distance of the target secondary option. This way, when the secondary menu is scrolled based on the second scroll distance, the boundary of the target secondary option in the first preset direction is aligned with the boundary of its corresponding primary option in the same first preset direction. This allows users to intuitively understand the correspondence between the target secondary option and its corresponding primary option, improving the user experience.

[0192] In the second implementation, a second scroll distance can be obtained by adding a certain center offset to the predetermined scroll distance. This offset ensures that after scrolling the second-level menu based on the second scroll distance, the center of the target second-level option is aligned with the center of its corresponding first-level option (i.e., the center line coincides). This center offset can be determined based on the width of the target second-level option and the width of the first-level option it relates to. Specifically, the center offset can be the difference between the width of the target second-level option and the width of the first-level option it relates to. For example, if the width of the target second-level option is 10 and the width of its corresponding first-level option is 5, then the center offset is 5; if the width of the target second-level option is 5 and the width of its corresponding first-level option is 10, then the center offset is -5. Furthermore, the second scroll distance can be the predetermined scroll distance minus the center offset.

[0193] In this way, since the newly focused second-level option and its corresponding first-level option are centered after scrolling through the second-level menu, users can intuitively understand the correspondence between the target second-level option and its corresponding first-level option, thus improving the user experience.

[0194] However, in the two implementation methods mentioned above, if the width of the second-level option is less than the width of the first-level option, and the target second-level option is the largest in order among the second-level options corresponding to its first-level option, then after the second-level menu scrolls the first scroll distance, the part of the second-level option that does not correspond to the first-level option to which the target second-level option belongs will be located in the associated area of ​​the first-level option to which the target second-level option belongs (e.g., directly above or to the right).

[0195] Taking the first implementation method as an example, such as Figure 12 As shown in (a), taking the highest-ranking second-level option E among the second-level options corresponding to the first-level option F as the target second-level option, after scrolling left in the second-level menu, as shown... Figure 12As shown in (b), the second-level option E is aligned with the left boundary (boundary in the first preset direction) of the first-level option F, while a portion of the second-level option I to the right of the first-level option F lies above it. However, second-level option I should belong to the first-level option F, so if the first-level option F subsequently gains focus, it needs to align with the left boundary of the first-level option H, at which point the second-level menu needs to scroll to the right. However, in practice, if the user switches the focus from second-level option E to second-level option I, a better display would be for the second-level menu to continue scrolling to the left. If the second-level menu scrolls to the right at this point, it would degrade the user experience.

[0196] It is evident that the two implementation methods described above result in poor scrolling of the secondary menu when users need to intuitively see the correspondence between the primary and secondary options during the switching process. This reduces the display effect of the multi-level menu and diminishes the user experience.

[0197] To reduce or avoid the shortcomings of the above implementation methods, in the third implementation method, an appropriate offset can be determined based on the order of the target secondary option among all secondary options corresponding to its primary option (i.e., the fourth index information) and the size information of the primary option to which the target secondary option belongs, to adjust the required scroll distance. This ensures that when switching secondary options, the user can intuitively see the correspondence between the primary and secondary options, while avoiding repeated scrolling of the secondary menu. Based on this, in some embodiments, combined with... Figure 10 , refer to Figure 13 As shown, S514 may include S1301-S1303:

[0198] S1301. Determine the unit offset based on the number of secondary options corresponding to the primary option to which the target secondary option belongs and the size information of the primary option to which the target secondary option belongs.

[0199] The size information of the primary option to which the target secondary option belongs includes the width of the primary option in the first preset direction.

[0200] In some embodiments, the unit offset = width of the primary option to which the target secondary option belongs * 1 / number of secondary options corresponding to the primary option to which the target secondary option belongs. For example, if the width of the primary option to which the target secondary option belongs is 5, and the number of secondary options corresponding to the primary option to which the target secondary option belongs is 5, then the unit offset is 5 * 1 / 5 = 1.

[0201] S1302. Determine the first offset of the target secondary option based on the fourth index information and unit offset of the target secondary option.

[0202] In some embodiments, the fourth index information includes a fourth index value, which indicates the order of the target secondary options in the secondary menu.

[0203] In some embodiments, the first offset = (fourth index value - 1) * unit offset. For example, if the fourth index value is 4 and the unit offset is 1, then the first offset is (4-1)*1 = 3.

[0204] S1303. Determine the second rolling distance based on the undetermined rolling distance and the first offset.

[0205] In some embodiments, the second scroll distance = undetermined scroll distance - first offset.

[0206] For example, a multi-level menu as shown in the reference Figure 14 As shown in (a), the first-level option F corresponds to the second-level options A, B, C, D, and E. The width of the first-level option is 5, and the width of the second-level option is 4. If the second switching instruction is used to indicate that the focus is switched from the second-level option A to the second-level option B, and the fourth index value of the second-level option B is 2, then the pending scroll distance is 4, and the first offset is (2-1)*5*1 / 5. The second scroll distance is then 4-(5*1 / 5)=3. After controlling the second scroll distance of the second-level menu, the multi-level menu is as follows. Figure 14 As shown in (b), the distance between the left boundary of the second-level option B and the left boundary of the first-level option F is the first offset.

[0207] Similarly, if the second switching instruction is used to indicate that the focus is switched from secondary option B to secondary option E, and the fourth index value of secondary option E is 5, then the pending scroll distance is 4*3+1=13, and the first offset is (5-1)*5*1 / 5. The second scroll distance is then 13-((5-1)*5*1 / 5)=9. After controlling the second scroll distance of the secondary menu, the multi-level menu will behave as follows: Figure 14 As shown in (c). The distance between the left boundary of the second-level option B and the left boundary of the first-level option F is the first offset.

[0208] Based on the technical solutions corresponding to S1301-S1303 above, the display device can determine a suitable first offset based on the size information of the primary option to which the target secondary option belongs, the number of secondary options corresponding to the primary option to which the target secondary option belongs, and the fourth index information of the target secondary option. This first offset is then adjusted to obtain a more suitable second scrolling distance. Subsequently, by scrolling the secondary options in the secondary menu based on this second scrolling distance, the user can intuitively see the correspondence between the primary and secondary options while avoiding repeated scrolling of the secondary menu, thus improving the display effect of the display device and enhancing the user experience.

[0209] Having obtained the second scroll distance, the display device can adjust the focus in the secondary menu, causing the third option to defocus and the target secondary option to gain focus, while simultaneously controlling the secondary option in the secondary menu to scroll the second scroll distance. That is, S515 is executed after S512 and S514.

[0210] S515. Mark the third option as unselected, mark the target second-level option as selected, and control all second-level options in the second-level menu to scroll a second scroll distance so that the second option is loaded in the user interface.

[0211] In this embodiment, the specific implementation of S515 can refer to the relevant description of S507 in the foregoing embodiment, and will not be repeated here.

[0212] In this embodiment, S507 can specifically be that the controller controls the display to mark the third option as unselected, marks the target secondary option as selected, and controls all secondary options in the secondary menu to scroll a second scroll distance so that the second option is loaded in the user interface.

[0213] It should be noted that, in practice, marking the third option as unselected and the target secondary option as selected, along with scrolling the secondary menu, can be performed simultaneously or sequentially with a duration imperceptible to the user. If they are not executed synchronously, in practice, after the user inputs the first switching command to switch the third option, the third option can be marked as unselected and the target primary option as selected first, followed by determining the second scroll distance and scrolling the secondary menu. In some embodiments, the actions of marking the third option as unselected and the target secondary option as selected, and determining the second scroll distance, can be performed synchronously, with the scrolling of the secondary menu performed after the first scroll distance has been determined. Of course, in practice, the execution order of the above actions can also be any other possible order, and this application does not impose specific restrictions on this.

[0214] Based on the technical solution provided in this application, when a display device displays a first-level menu and a second-level menu in a multi-level menu, if the focus is on a certain second-level option, the user inputs a switching command to switch the second-level option, and the target second-level option indicated by the switching command is not loaded, the second scroll distance corresponding to the target second-level option can be obtained by acquiring the index information of the unloaded target second-level option and the displayed boundary options in the second-level menu, thereby accurately scrolling. After the target second-level option is switched, the user can intuitively see the correspondence between the second-level option and the first-level option, improving the display effect of the display device and the user experience.

[0215] In some embodiments, a multi-level menu may include tertiary menus and even lower-level menus in addition to primary and secondary menus. The tertiary menu can be displayed in the user interface in response to user input when a secondary option is selected. To ensure the tertiary menu is displayed as completely as possible, its size, the number of tertiary options, and the position of the secondary options within it are considered to determine its appropriate display location, thereby achieving complete display and improving the user experience.

[0216] Based on this, and in conjunction with 10, refer to Figure 16 As shown, the display method may further include S1601-S1603 after S508:

[0217] S1601, In response to the menu expansion instruction for the third option, obtain the size information of the third-level menu corresponding to the third option and the first number of third-level options in the third-level menu.

[0218] The menu expansion command can be a voice command or an operation command. When the menu expansion command is an operation command, the operation corresponding to the operation command can be a trigger operation for the third option, an operation input on the control device (such as a remote control), or other pre-set operations for expanding the three-level menu. The implementation method of the menu expansion command is not limited in this application embodiment.

[0219] In this embodiment, the size information of the third-level menu corresponding to the third option and the method for obtaining the first number of third-level options in the third-level menu can be any possible implementation, and this application does not impose any specific limitations on them. The size information of the third-level menu includes the first width of the third-level menu in a second preset direction. In some embodiments, the second preset direction can be the direction from the second boundary option in the second-level menu toward the first boundary option.

[0220] S1602. Based on the first quantity, the size information of the third-level menu, and the fifth coordinate of the midpoint of the third option on the screen coordinate system, determine the display position of the third-level menu.

[0221] Specifically, the fifth coordinate of the midpoint of the third option in the screen coordinate system can be obtained through a preset function.

[0222] In one possible implementation, combining Figure 16 , refer to Figure 17 As shown, S1602 may specifically include S1701-S1706:

[0223] S1701. Determine whether the first quantity is greater than the preset maximum quantity.

[0224] The preset maximum number refers to the maximum number of three-level options that can be displayed in the displayable area of ​​the user interface in the second preset direction. That is, taking the second preset direction as the user interface from left to right as an example, without considering other directions, displaying three-level options continuously from the leftmost side of the displayable area to the right can display the preset maximum number of three-level options. In the embodiments of this application, as shown... Figure 18 As shown, the displayable area refers to the area in the user interface that is separated from the interface boundaries (top, bottom, left, and right boundaries) by a reserved distance. The reserved distances between the top boundary of the displayable area and the top boundary of the user interface, the bottom boundary of the displayable area and the bottom boundary of the user interface, the left boundary of the displayable area and the left boundary of the user interface, and the right boundary of the displayable area and the right boundary of the user interface can be the same, different, or partially the same; this application does not impose specific restrictions on this.

[0225] When the first quantity exceeds the preset maximum quantity, it can be determined that not all third-level options in the third-level menu can be fully displayed in the user interface; only a portion of the third-level options can be displayed. In this case, the third-level options in the third-level menu can be sequentially tiled in the second preset direction of the displayable area of ​​the user interface. At this time, the display position of the third-level menu is determined to be such that the first boundary of the third-level menu in the second preset direction coincides with the second boundary of the displayable area of ​​the user interface in the second preset direction. That is, when the first quantity exceeds the preset maximum quantity, S1702 is executed.

[0226] When the first quantity is less than or equal to the preset maximum quantity, it can be determined that all third-level options in the third-level menu can be fully displayed in the user interface. In this case, to facilitate user viewing, the third-level menu and the third option can be aligned (center lines coincide). However, at this time, the position of the midpoint of the third option in the displayable area of ​​the user interface must be considered to prevent the midpoint of the third option from deviating too much from the center line in the second preset direction of the displayable area of ​​the user interface (e.g., to the left or right, or to the top or bottom), which would cause some third-level options to be undisplayed when the third-level menu and the third option are aligned. Based on this, when the first quantity is less than or equal to the preset maximum quantity, it is also necessary to determine the relationship between the horizontal or vertical coordinate value of the fifth coordinate and half of the first width, i.e., execute S1703.

[0227] The third-level options in the third-level menu can be displayed sequentially from one edge of the displayable area of ​​the user interface to the other edge. The display position of the third-level menu is determined so that the first edge of the third-level menu in the second preset direction coincides with the second edge of the displayable area of ​​the user interface in the second preset direction. That is, S1702 is executed when the first number is greater than the preset maximum number.

[0228] Of course, in practice, the judgment step in S1701 may not be necessary. The controller of the display device can execute S1703 when the first quantity is less than or equal to the preset maximum quantity, and execute S1702 when the first quantity is greater than the preset maximum quantity.

[0229] S1702. Determine the display position of the third-level menu so that the first boundary of the third-level menu in the second preset direction coincides with the second boundary of the displayable area of ​​the user interface in the second preset direction.

[0230] For example, the display format of the options in each level of a multi-level menu is as follows: Figure 1 Taking the horizontal display as an example, when the display position of the third-level menu is such that the first boundary of the third-level menu in the second preset direction coincides with the second boundary of the displayable area of ​​the user interface in the second preset direction, the display interface of the multi-level menu is as follows. Figure 18 As shown. (Refer to...) Figure 18 As shown, option 3 in the secondary category is the third option.

[0231] S1703. Determine whether the horizontal or vertical coordinate value of the fifth coordinate is less than half of the first width.

[0232] In this embodiment of the application, if the display format of the options in each level of the multi-level menu is as follows: Figure 1 As shown in the horizontal display, when executing S1703, it can specifically determine whether the horizontal coordinate value of the fifth coordinate is less than half of the first width; if the display format of each menu option in a multi-level menu is as follows... Figure 6 As shown in the vertical display, when executing S1703, it can specifically determine whether the vertical coordinate value of the fifth coordinate is less than half of the first width.

[0233] The display format of the options in each level of a multi-level menu is as follows: Figure 1 Taking the horizontal display shown as an example, refer to... Figure 19 As shown, taking the third option as an example of a second-level option 3, if the x-coordinate value X1 of the fifth coordinate of the midpoint of the third-level option is less than half the first width X2, then when the centers of the third-level menu and the third option are aligned, a portion of the third-level menu will be outside the displayable area, resulting in it not being displayed. Therefore, in this case, the third-level options in the third-level menu should be displayed sequentially in the second preset direction of the displayable area of ​​the user interface. The display position of the third-level menu is determined to be such that the first boundary of the third-level menu in the second preset direction coincides with the second boundary of the displayable area of ​​the user interface in the second preset direction.

[0234] Based on this, S1702 is executed when the horizontal or vertical coordinate value of the fifth coordinate is less than half of the first width.

[0235] The display format of the options in each level of a multi-level menu is as follows: Figure 1 Taking the horizontal display as an example, if the x-coordinate value X1 of the fifth coordinate of the midpoint of the third-level option is greater than or equal to half the first width X2, then it is determined that the third option is not biased to the left. Further, it is necessary to determine whether the third option being biased to the right would cause a portion of the right side of the third-level menu to be outside the displayable area and thus undisplayed when the third-level menu is aligned with the center of the third option. Based on this, when the x-coordinate or y-coordinate value of the fifth coordinate is greater than or equal to half the first width, it is also necessary to determine the relationship between the second width of the displayable area in the second preset direction and the first difference between the x-coordinate or y-coordinate value of the fifth coordinate and half the first width, i.e., execute S1704.

[0236] Of course, in practice, the judgment step in S1703 above may not be necessary. The controller of the display device can execute S1702 when the horizontal or vertical coordinate value of the fifth coordinate is less than half of the first width; and execute S1704 when the horizontal or vertical coordinate value of the fifth coordinate is greater than or equal to half of the first width.

[0237] S1704. Determine whether the first difference between the second width of the displayable area in the second preset direction and the horizontal or vertical coordinate of the fifth coordinate is less than half of the first width.

[0238] In this embodiment of the application, if the display format of the options in each level of the multi-level menu is as follows: Figure 1 As shown in the horizontal display, when executing S1704, it can specifically determine whether the first difference between the second width of the displayable area in the second preset direction and the horizontal coordinate value of the fifth coordinate is less than half of the first width; if the display format of each menu option in the multi-level menu is as follows... Figure 6 As shown in the vertical display, when executing S1703, it can specifically determine whether the first difference between the second width of the displayable area in the second preset direction and the first value of the vertical coordinate of the fifth coordinate is less than half of the first width. The display format of each menu option in a multi-level menu is as follows: Figure 1 Taking the horizontal display shown as an example, refer to... Figure 20 As shown, taking the third option as the second-level option 7 as an example, if the first difference X3 between the second width of the displayable area in the second preset direction and the horizontal coordinate value of the fifth coordinate is less than half of the first width X2, then when the third-level menu and the third option are aligned, a portion of the third-level menu will be outside the displayable area, resulting in it not being displayed. Therefore, the distance between the first boundary of the third-level menu and the second boundary of the displayable area should differ by a first distance, which is the difference between the second width and the first width. At this time, the third boundary directly opposite the first boundary of the third-level menu and the fourth boundary directly opposite the second boundary of the displayable area coincide.

[0239] Based on this, S1705 is executed when the first difference between the second width of the displayable area in the second preset direction and the horizontal or vertical coordinate of the fifth coordinate is less than half of the first width.

[0240] If the difference between the second width of the displayable area in the second preset direction and the first difference between the horizontal or vertical coordinate of the fifth coordinate is greater than or equal to half the first width, then when the third-level menu and the third option are center-aligned, the entire third-level menu can be within the displayable area, thus achieving center alignment between the third-level menu and the third option. At this point, the display position of the third-level menu can be determined as the center line of the third-level menu coinciding with the center line of the third option. That is, S1706 is executed. In this way, since center alignment makes it easier for users to operate the third-level menu, it can bring a better display effect and improve the user experience.

[0241] Of course, in practice, the judgment step in S1704 above may not be necessary. The controller of the display device can execute S1705 when the first difference between the second width of the displayable area in the second preset direction and the horizontal or vertical coordinate of the fifth coordinate is less than half of the first width; and execute S1706 when the first difference between the second width of the displayable area in the second preset direction and the horizontal or vertical coordinate of the fifth coordinate is greater than or equal to half of the first width.

[0242] S1705. Determine the display position of the third-level menu as a distance of a first distance between the first boundary of the third-level menu and the second boundary of the displayable area.

[0243] For example, when the display position of the third-level menu is determined to be a first distance between the first boundary of the third-level menu and the second boundary of the displayable area, the display interface of the third-level menu can be as follows: Figure 21 As shown. Among them, the third option is the second-level option 7.

[0244] S1706. Determine the display position of the third-level menu so that the center line of the third-level menu coincides with the center line of the third option.

[0245] For example, when the display position of the third-level menu is determined to be such that the center line of the third-level menu coincides with the center line of the third option, the display interface of the third-level menu can be as follows: Figure 22 As shown. Among them, the third option is the second-level option 5.

[0246] It should be noted that, Figure 17 The order of the three judgment steps S1701, S1703, and S1704 is only an example. In practice, the order of these three judgment steps can be any other possible order, as long as the judgment logic is the same. This application does not impose any specific restrictions on this.

[0247] Based on the technical solutions corresponding to S1701-S1706 above, the display device can determine different display scenarios of the three-level menu according to the size information of the three-level menu, the first number of three-level options in the three-level menu, and the position information of the second-level options to which the three-level menu belongs. This allows for different display positions of the three-level menu, thereby maximizing the complete display of the three-level menu, ensuring the display effect of the display device, and improving the user experience.

[0248] S1603. Display the third-level menu in the user interface according to its display position.

[0249] In this embodiment, S1603 can specifically be that the controller controls the display to show the three-level menu in the user interface according to the display position of the three-level menu.

[0250] Based on the technical solutions corresponding to S1601-S1603 above, the display can determine the appropriate display position of the third-level menu according to the size information of the third-level menu, the first number of third-level options in the third-level menu, and the position information of the second-level options to which the third-level menu belongs. This maximizes the complete display of the third-level menu, ensures the display effect of the display device, and improves the user experience.

[0251] The foregoing mainly describes the solutions provided by the embodiments of this application from a methodological perspective. To achieve the above functions, it includes corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0252] Based on the above display method, this application embodiment also provides a display device, which may include a display and a controller coupled to the display. The display is configured to display a user interface. The controller is configured to: in response to an expansion command for a multi-level menu, control the display to display a first-level menu and a second-level menu in the user interface; the first-level menu includes multiple first-level options, and a first option among the multiple first-level options is in a selected state; the second-level menu includes multiple second-level options corresponding to at least one first-level option; in response to a first switching command for switching a first-level option, if the second option corresponding to the target first-level option indicated by the first switching command is not loaded, obtain the first index information of the boundary option in the second-level menu and the second index information of the second option in the second-level menu, and determine a first scroll distance of the second option based on the first index information and the second index information; the second option is the second-level option with the smallest order among the multiple second-level options corresponding to the target first-level option; and control the display to mark the first option as unselected, mark the target first-level option as selected, and control all second-level options in the second-level menu to scroll by the first scroll distance, so that the second option is loaded in the user interface, and the boundary of the second option in a first preset direction is aligned with the boundary of the target first-level option in the first preset direction.

[0253] In addition, the controller is also configured to execute various possible process steps in the display method provided in the foregoing embodiments, which will not be repeated here.

[0254] This application also provides a chip that can be applied to the aforementioned display device. The chip includes one or more interface circuits and one or more processors; the interface circuits and processors are interconnected via lines; the processor receives and executes computer instructions from the display device's memory through the interface circuits to implement the display method provided in the above method embodiments.

[0255] This application also provides a computer-readable storage medium storing computer program instructions (or instructions). When the computer program instructions are executed by a display device, the display device can implement the display method provided in the above embodiments.

[0256] This application also provides a computer program product, including computer instructions for operation of the display device as described above. When the computer program product is run in the display device, the display device can implement the display method provided in the above embodiments.

[0257] Through the above description of the implementation methods, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0258] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0259] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units, meaning it can be located in one place or distributed across multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs. Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated units described above can be implemented in hardware or as software functional units.

[0260] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product, such as a program. This software product is stored in a program product, such as a computer-readable storage medium, and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0261] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the user interface; The controller, coupled to the display, is configured to: In response to an instruction to expand a multi-level menu, the display is controlled to show a first-level menu and a second-level menu in the user interface; the first-level menu includes multiple first-level options, and a first option among the multiple first-level options is selected; the second-level menu includes at least one of the multiple second-level options corresponding to the first-level option; In response to a first switching instruction to switch the primary option, if the second option corresponding to the target primary option indicated by the first switching instruction is not loaded, then the first index information of the boundary option in the secondary option displayed in the secondary menu and the second index information of the second option in the secondary menu are obtained, and based on the first index information and the second index information, the first scroll distance of the second option is determined; the second option is the secondary option with the smallest order among the multiple secondary options corresponding to the target primary option. In addition, the display is controlled to mark the first option as unselected, the target primary option as selected, and all secondary options in the secondary menu are controlled to scroll by the first scroll distance so that the second option is loaded in the user interface and the boundary of the second option in the first preset direction is aligned with the boundary of the target primary option in the first preset direction.

2. The display device according to claim 1, characterized in that, The boundary options include a first boundary option and a second boundary option. The first index information includes a first index value of the first boundary option and a second index value of the second boundary option, wherein the first index value is less than the second index value. The second index information includes a target index value. The controller determines a first scroll distance of the second option based on the first index information and the second index information, specifically configured as follows: When the target index value is less than the first index value, the first target coordinate of the second option in the screen coordinate system is determined based on the first coordinate of the first boundary option in the screen coordinate system, the size information of the second-level option, and the first index difference; the first index difference is the difference between the first index value and the target index value. When the target index value is greater than the second index value, the first target coordinate of the second option in the screen coordinate system is determined based on the second coordinate of the second boundary option in the screen coordinate system, the size information of the secondary option, and the second index difference; the second index difference is the difference between the second index value and the target index value. The first scroll distance is determined based on the first target coordinates and the third coordinates of the target first-level option in the screen coordinate system.

3. The display device according to claim 1, characterized in that, The controller is also configured to: In response to a first switching command to switch the first-level option, if the second option has been loaded, the second target coordinates of the second option in the screen coordinate system are obtained through a preset function; The first scroll distance is determined based on the second target coordinates and the third coordinates of the target first-level option in the screen coordinate system.

4. The display device according to claim 1, characterized in that, When the display shows a first-level menu and a second-level menu in the user interface, the controller is further configured to: In response to a selection instruction for a third option in the secondary menu, the display is controlled to mark the third option as selected. In response to a second switching instruction to switch the secondary option, if the target secondary option indicated by the second switching instruction is not loaded, the third index information of the boundary option in the secondary option already displayed in the secondary menu and the fourth index information of the target secondary option in the secondary menu are obtained. Based on the third index information and the fourth index information, the pending scroll distance of the target secondary option is determined, and based on the pending scroll distance, the second scroll distance of the target secondary option is determined. In addition, the display is controlled to mark the third option as unselected, the target secondary option as selected, and all secondary options in the secondary menu are controlled to scroll by the second scroll distance so that the second option is loaded in the user interface.

5. The display device according to claim 4, characterized in that, The controller determines the second scroll distance of the target secondary option based on the pending scroll distance, including: The unit offset is determined based on the number of secondary options corresponding to the primary option to which the target secondary option belongs and the size information of the primary option to which the target secondary option belongs; Based on the fourth index information of the target secondary option and the unit offset, determine the first offset of the target secondary option; The second rolling distance is determined based on the undetermined rolling distance and the first offset.

6. The display device according to claim 4, characterized in that, The controller is also configured to: In response to a second switching command to switch the secondary option, if the target secondary option has been loaded, the third target coordinates of the target secondary option in the screen coordinate system are obtained through a preset function; The undetermined scrolling distance is determined based on the third target coordinates and the fourth coordinates of the primary option to which the secondary option belongs in the screen coordinate system.

7. The display device according to claim 4, characterized in that, After controlling the display to mark the third option as selected, the controller is further configured to: In response to the menu expansion command for the third option, obtain the size information of the third-level menu corresponding to the third option and the first number of third-level options in the third-level menu; Based on the first quantity, the size information of the third-level menu, and the fifth coordinate of the midpoint of the third option on the screen coordinate system, the display position of the third-level menu is determined; The display is controlled to show the three-level menu in the user interface according to the display position of the three-level menu.

8. The display device according to claim 7, characterized in that, The size information of the third-level menu includes the first width of the third-level menu in a second preset direction; the controller determines the display position of the third-level menu based on the first quantity, the size information of the third-level menu, and the fifth coordinate of the midpoint of the third option in the screen coordinate system, and is configured to: When the first quantity is greater than the preset maximum quantity, the display position of the third-level menu is determined to be such that the first boundary of the third-level menu in the second preset direction coincides with the second boundary of the displayable area of ​​the user interface in the second preset direction. When the first quantity is less than or equal to the preset maximum quantity, and the horizontal or vertical coordinate value of the fifth coordinate is less than half of the first width, the display position of the third-level menu is determined to be that the first boundary of the third-level menu coincides with the second boundary of the displayable area. When the first quantity is less than or equal to the preset maximum quantity, and the first difference between the second width of the displayable area in the second preset direction and the horizontal or vertical coordinate value of the fifth coordinate is less than half of the first width, the display position of the third-level menu is determined to be a first distance between the first boundary of the third-level menu and the second boundary of the displayable area; the first distance is the difference between the second width and the first width.

9. The display device according to claim 8, characterized in that, The controller, based on the first quantity, the size information of the third-level menu, and the fifth coordinate of the midpoint of the third option in the screen coordinate system, determines the display position of the third-level menu, and is further configured to: When the first quantity is less than or equal to the preset maximum quantity, the horizontal or vertical coordinate value of the fifth coordinate is greater than or equal to half of the first width, and the first difference is greater than or equal to half of the first width, the display position of the third-level menu is determined to be that the center line of the third-level menu coincides with the center line of the third option.

10. A menu display method, characterized in that, include: In response to an instruction to expand a multi-level menu, a first-level menu and a second-level menu are displayed in the user interface; the first-level menu includes multiple first-level options, and the first option among the multiple first-level options is selected; the second-level menu includes at least one of the multiple second-level options corresponding to the first-level option; In response to a first switching instruction to switch the primary option, if the second option corresponding to the target primary option indicated by the first switching instruction is not loaded, then the first index information of the boundary option in the secondary option displayed in the secondary menu and the second index information of the second option in the secondary menu are obtained, and based on the first index information and the second index information, the first scroll distance of the second option is determined; the second option is the secondary option with the smallest order among the multiple secondary options corresponding to the target primary option. In addition, the first option is marked as unselected, the target primary option is marked as selected, and all secondary options in the secondary menu are controlled to scroll by the first scroll distance so that the second option is loaded in the user interface and the boundary of the second option in the first preset direction is aligned with the boundary of the target primary option in the first preset direction.

Images