Display device and cursor display method

Abstract

The invention relates to a display device and a cursor display method. The display device includes: a display configured to display an operation interface; the display position of the cursor in the operation interface is determined by the pointing position of the remote controller in the three-dimensional space; a batch watching picture and a functional area menu are displayed in the operation interface; the batch gaze picture is used for displaying the annotation content; the controller is connected with the display and is configured to: in response to a trigger operation on the annotation control, create an extended view between a layer where the functional area menu is located and a layer where the batch gaze picture is located; the projection area of the functional area menu in the extended view is located in the extended view; when it is monitored that the cursor enters the functional area menu, displaying the cursor in a first style; when it is monitored that the cursor enters the extended view, displaying the cursor in a second style; the first style cursor is used for performing control operation on the functional area menu; the cursor in the second style is used for performing annotation operation in the batch gaze picture. Through the display equipment, the accuracy of cursor switching can be improved.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a display device and a cursor display method. Background Art

[0002] With the development of display technology, it has made great progress, and its application scenarios are becoming increasingly rich and diverse. For example, in the context of meeting annotation, participants can annotate the meeting content during the meeting, such as marking key points and recording ideas. This greatly enhances the interactivity and intuitiveness of the meeting, making it easier for participants to participate in the discussion. For example, in teaching and presentation scenarios, users can mark up the display screen according to their presentation needs.

[0003] However, in actual application scenarios, when the user switches between the annotation drawing state and the normal cursor operation state, the system sometimes fails to timely and reliably recognize the user's intention, resulting in poor switching accuracy, affecting the fluency and continuity of the annotation, and reducing the user experience. Summary of the Invention

[0004] Based on this, it is necessary to provide a display device and a cursor display method to address the above technical issues, so as to improve the accuracy of cursor switching and thus enhance the user experience.

[0005] In a first aspect, some embodiments provide a display device, including:

[0006] The display is configured to display an operation interface; the operation interface has a cursor; the display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the operation interface displays an annotation view and a function area menu; the annotation view is used to display annotation content; the function area menu is used to display function controls; the function controls include annotation controls;

[0007] At least one controller, connected to the display, configured to:

[0008] In response to the triggering operation of the annotation control, an extended view is created between the layer where the ribbon menu is located and the layer where the annotation view is located; the projection area of ​​the currently displayed ribbon menu in the extended view is located in the extended view; when the cursor is detected to enter the ribbon menu, the cursor is displayed in the first style; when the cursor is detected to enter the extended view, the cursor is displayed in the second style; wherein, the cursor in the first style is used for control operations in the ribbon menu; the cursor in the second style is used for annotation operations in the annotation view.

[0009] In the above embodiment, by introducing an extended view, a buffer identification area is provided for the process of switching the cursor position between the function area menu and the annotation view. Setting the extended view between the layer where the function area menu is located and the layer where the annotation view is located is conducive to reducing the difficulty of creating the extended view. In addition, by monitoring the cursor entering the function area menu, the cursor is displayed in the first style, and when the cursor enters the extended view, the cursor is displayed in the second style, so that the cursor can still monitor the view that the cursor finally enters in a fast-moving scenario, thereby accurately switching the cursor style, avoiding errors in the cursor switching logic due to complex regional judgment logic and other reasons in the traditional method, reducing the probability of misjudgment of style switching, and improving the accuracy of cursor style display. In addition, since the extended view has a certain area range, the fault tolerance of the operation can be improved, which is conducive to improving the user experience.

[0010] In some embodiments, when there are at least two currently displayed ribbon menus, the controller is configured to create an extended view between the layer where the ribbon menu is located and the layer where the annotation view is located, as follows: for each ribbon menu, a first extended view corresponding to the ribbon menu is created between the layer where the ribbon menu is located and the layer where the annotation view is located; the projection area of ​​the ribbon menu in the corresponding first extended view is located in the corresponding first extended view; each first extended view is located in the same layer; or, the display position and corresponding display size of each ribbon menu are obtained, and the outer display boundary of the currently displayed ribbon menu is determined according to the display position and corresponding display size of each ribbon menu; based on the outer display boundary, a second extended view is created between the layer where the ribbon menu is located and the annotation layer; the projection area of ​​the outer display boundary in the second extended view is located in the second extended view.

[0011] In the above embodiment, at least two function area menus are provided to facilitate user operation and control in the corresponding function area menus according to different control needs. Furthermore, by creating a first extended view corresponding to each function area menu or creating a second extended view based on the display position and corresponding display size of each function area menu, accurate switching of cursor styles can be achieved when the cursor moves between different function area menus and extended views.

[0012] In some embodiments, the function control further includes an exit control, and the controller is further configured to: delete the extended view in response to a triggering operation on the exit control in the function area menu.

[0013] In the above embodiment, by deleting the extended view in response to the triggering operation of the exit control in the function area menu, it is possible to avoid the extended view interfering with the user's normal annotation operation in the annotation view.

[0014] In a second aspect, some embodiments provide a display device, including:

[0015] The display is configured to display an operation interface; the operation interface has a cursor; the cursor position in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the operation interface displays an annotation view and a function area menu; the annotation view is used to display annotation content; the function area menu is used to display function controls; the function controls include annotation controls;

[0016] At least one controller, connected to the display, configured to:

[0017] In response to the triggering operation of the annotation control, an extended view is created along the edge of the ribbon menu in the layer where the ribbon menu is located; when the cursor is detected to enter the ribbon menu, the cursor is displayed in the first style; when the cursor is detected to enter the extended view, the cursor is displayed in the second style; wherein, the cursor in the first style is used for control operations in the ribbon menu; the cursor in the second style is used for annotation operations in the annotation view.

[0018] In the above embodiment, by introducing an extended view, a buffer recognition area is provided for the process of switching the cursor position between the function area menu and the annotation view. In addition, by creating an extended view on the layer where the function area menu is located along the edge of the function area menu, it is beneficial to accurately control the size and position of the extended view. In addition, by monitoring the cursor entering the function area menu, the cursor is displayed in the first style, and in the case of monitoring the cursor entering the extended view, the cursor is displayed in the second style, so that the cursor can still monitor the view that the cursor finally enters in a fast-moving scenario, thereby accurately switching the cursor style, avoiding the error in the cursor switching logic due to the complexity of the area judgment logic in the traditional method. The error of misjudgment of style switching is reduced, and the accuracy of cursor style display is improved. In addition, because the extended view has a certain area range, the fault tolerance of the operation can be improved, which is beneficial to improving the user experience. This is beneficial to improving the user experience.

[0019] In some embodiments, when there are at least two function area menus, when the controller creates an extended view along the edge of the function area menu on the layer where the function area menu is located, it is configured to: for each function area menu, create a first extended view corresponding to the function area menu along the edge of the function area menu on the layer where the function area menu is located; or, obtain the display position and corresponding display size of each function area menu, and determine the outer display boundary of the currently displayed function area menu based on the display position and corresponding display size of each function area menu; create a second extended view along the edge of the outer display boundary on the layer where the function area menu is located.

[0020] In the above embodiment, at least two function area menus are provided to facilitate user operation and control in the corresponding function area menus according to different control needs. Furthermore, by creating a first extended view corresponding to each function area menu or creating a second extended view based on the display position and corresponding display size of each function area menu, accurate switching of cursor styles can be achieved when the cursor moves between different function area menus and extended views.

[0021] In some embodiments, the function control further includes an exit control, and the controller is further configured to: delete the extended view in response to a triggering operation on the exit control in the function area menu.

[0022] In the above embodiment, by deleting the extended view in response to the triggering operation of the exit control in the function area menu, it is possible to avoid the extended view interfering with the user's normal annotation operation in the annotation view.

[0023] In a third aspect, some embodiments provide a display device, including:

[0024] The display is configured to display an operation interface; the operation interface has a cursor; the cursor position in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the operation interface displays a function area menu; the function area menu is used to display function controls; the function controls include annotation controls;

[0025] At least one controller, connected to the display, configured to:

[0026] In response to the triggering operation of the annotation control, the cursor display data corresponding to the annotation control is obtained through the application layer module and sent to the application framework layer module; the cursor display data is cached in the current layer storage space through the application framework layer module; when the application layer module monitors that the cursor needs to be switched from the first style to the second style, the style adjustment information is sent to the system service through the application framework layer module; in response to the style adjustment information, the system service obtains the cursor display data from the current layer storage space corresponding to the application framework layer module, and displays the second style cursor at the current cursor position.

[0027] In the above embodiment, by responding to the triggering operation of the annotation control, the cursor display data corresponding to the annotation control is obtained through the application layer module, thereby providing a data basis for displaying the second style cursor. By introducing the application framework layer module and having the application framework layer module cache the cursor display data, the application framework layer module builds a communication bridge between the application layer module and the system service, avoiding the application layer from directly interacting with the system service for cursor display data, which is conducive to reducing development difficulty and improving system security. Since the system service can obtain the cursor position in the first time, the second style cursor is displayed at the current cursor position of the cursor through the system service, which can effectively improve the response speed of displaying the second style cursor.

[0028] In a fourth aspect, some embodiments provide a cursor display method, comprising:

[0029] Control the display to display the annotation view and the ribbon menu in the operation interface; the annotation view is used to display the annotation content; the ribbon menu is used to display the function controls; the function controls include the annotation controls; in response to the triggering operation of the annotation control in the ribbon menu of the operation interface, create an extended view between the layer where the ribbon menu is located and the layer where the annotation view of the operation interface is located; the projection area of ​​the currently displayed ribbon menu in the extended view is located in the extended view; when the cursor is detected to enter the ribbon menu, the cursor is displayed in the first style; when the cursor is detected to enter the extended view, the cursor is displayed in the second style; wherein the cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the cursor under the first style is used for control operations in the ribbon menu; the cursor under the second style is used for annotation operations in the annotation view.

[0030] In the above embodiment, by introducing an extended view, a buffer identification area is provided for the process of switching the cursor position between the function area menu and the annotation view. Setting the extended view between the layer where the function area menu is located and the layer where the annotation view is located is conducive to reducing the difficulty of creating the extended view. In addition, by monitoring the cursor entering the function area menu, the cursor is displayed in the first style, and when the cursor enters the extended view, the cursor is displayed in the second style, so that the cursor can still monitor the view that the cursor finally enters in a fast-moving scenario, thereby accurately switching the cursor style, avoiding errors in the cursor switching logic due to complex regional judgment logic and other reasons in the traditional method, reducing the probability of misjudgment of style switching, and improving the accuracy of cursor style display. In addition, since the extended view has a certain area range, the fault tolerance of the operation can be improved, which is conducive to improving the user experience.

[0031] In a fifth aspect, some embodiments provide a cursor display method, including:

[0032] Control the display to display the annotation view and the ribbon menu in the operation interface; the annotation view is used to display the annotation content; the ribbon menu is used to display the function controls; the function controls include the annotation controls; in response to the triggering operation of the annotation control, an extended view is created along the edge of the ribbon menu in the layer where the ribbon menu is located; when the cursor is detected to enter the ribbon menu, the cursor is displayed in the first style; when the cursor is detected to enter the extended view, the cursor is displayed in the second style; wherein the cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the cursor in the first style is used for control operations in the ribbon menu; the cursor in the second style is used for annotation operations in the annotation view.

[0033] In the above embodiment, by introducing an extended view, a buffer recognition area is provided for the process of switching the cursor position between the function area menu and the annotation view. In addition, by creating an extended view on the layer where the function area menu is located along the edge of the function area menu, it is beneficial to accurately control the size and position of the extended view. In addition, by monitoring the cursor entering the function area menu, the cursor is displayed in the first style, and in the case of monitoring the cursor entering the extended view, the cursor is displayed in the second style, so that the cursor can still monitor the view that the cursor finally enters in a fast-moving scenario, thereby accurately switching the cursor style, avoiding the error in the cursor switching logic due to the complexity of the area judgment logic in the traditional method. The error of misjudgment of style switching is reduced, and the accuracy of cursor style display is improved. In addition, because the extended view has a certain area range, the fault tolerance of the operation can be improved, which is beneficial to improving the user experience. This is beneficial to improving the user experience.

[0034] In a sixth aspect, some embodiments provide a cursor display method, including:

[0035] In response to the triggering operation of the annotation control, the cursor display data corresponding to the annotation control is obtained through the application layer module and sent to the application framework layer module; the annotation control is displayed in the function area menu in the operation interface; the cursor display data is cached in the current layer storage space through the application framework layer module; when the application layer module monitors that the cursor needs to be switched from the first style to the second style, the style adjustment information is sent to the system service through the application framework layer module; in response to the style adjustment information, the system service obtains the cursor display data from the current layer storage space corresponding to the application framework layer module, and displays the second style cursor at the current cursor position.

[0036] In the above embodiment, by responding to the triggering operation of the annotation control, the cursor display data corresponding to the annotation control is obtained through the application layer module, thereby providing a data basis for displaying the second style cursor. By introducing the application framework layer module and having the application framework layer module cache the cursor display data, the application framework layer module builds a communication bridge between the application layer module and the system service, avoiding the application layer from directly interacting with the system service for cursor display data, which is conducive to reducing development difficulty and improving system security. Since the system service can obtain the cursor position in the first time, the second style cursor is displayed at the current cursor position of the cursor through the system service, which can effectively improve the response speed of displaying the second style cursor.

[0037] In a seventh aspect, some embodiments provide a cursor display device, comprising:

[0038] The first control module is used to control the display to display the annotation view and the function area menu in the operation interface; the annotation view is used to display the annotation content; the function area menu is used to display the function control; the function control includes the annotation control; the first creation module is used to create an extended view between the layer where the function area menu is located and the layer where the annotation view of the operation interface is located in response to the triggering operation of the annotation control in the function area menu of the operation interface; the projection area of ​​the currently displayed function area menu in the extended view is located in the extended view; the second control module is used to display the cursor in the first style when it is detected that the cursor enters the function area menu; the cursor in the first style is used to perform control operations in the function area menu; wherein the cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the third control module is used to display the cursor in the second style when it is detected that the cursor enters the extended view; the cursor in the second style is used to perform annotation operations in the annotation view.

[0039] In an eighth aspect, some embodiments provide a cursor display device, comprising:

[0040] The third control module is used to control the display to display the annotation view and the function area menu in the operation interface; the annotation view is used to display the annotation content; the function area menu is used to display the function control; the function control includes the annotation control; the second creation module is used to create an extended view along the edge of the function area menu in the layer where the function area menu is located in response to the triggering operation of the annotation control; the fourth control module is used to display the cursor in the first style when the cursor enters the function area menu; the cursor in the first style is used to perform control operations in the function area menu; wherein the cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the fifth control module is used to display the cursor in the second style when the cursor enters the extended view; the cursor in the second style is used to perform annotation operations in the annotation view.

[0041] In a ninth aspect, some embodiments provide a cursor display device, comprising:

[0042] An acquisition module is used to respond to a trigger operation on an annotation control, obtain cursor display data corresponding to the annotation control through the application layer module, and send it to the application framework layer module; the annotation control is displayed in the function area menu in the operation interface; a cache module is used to cache the cursor display data to the current layer storage space through the application framework layer module; a sending module is used to send style adjustment information to the system service through the application framework layer module when the application layer module monitors that the cursor needs to be switched from a first style to a second style; a processing module is used to respond to the style adjustment information through the system service, obtain cursor display data from the current layer storage space corresponding to the application framework layer module, and display a cursor of the second style at the current cursor position.

[0043] In the tenth aspect, some embodiments further provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the method provided in some embodiments of the fourth aspect, the fifth aspect or the sixth aspect are implemented.

[0044] In the eleventh aspect, the present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the method provided in some embodiments of the fourth aspect, the fifth aspect or the sixth aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments of the present application or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying any creative work.

[0046] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0047] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0048] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0049] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0050] Figure 5 A schematic diagram of position data of a pointing remote control in three-dimensional space provided in some embodiments of the present application;

[0051] Figure 6 A schematic diagram of a first pointing remote control operation provided in some embodiments of the present application;

[0052] Figure 7 A schematic diagram of a first pointing remote control operation provided in some embodiments of the present application;

[0053] Figure 8 A schematic diagram of a first pointing remote control operation provided in some embodiments of the present application;

[0054] Figure 9 A schematic diagram of a first pointing remote control operation provided in some embodiments of the present application;

[0055] Figure 10 A schematic diagram of a first pointing remote control operation provided in some embodiments of the present application;

[0056] Figure 11 A schematic diagram of a first pointing remote control operation provided in some embodiments of the present application;

[0057] Figure 12 A schematic diagram of a first pointing remote control operation provided in some embodiments of the present application;

[0058] Figure 13 A schematic diagram of a cursor monitoring process provided by traditional technology;

[0059] Figure 14A A flowchart of a cursor display method provided in some embodiments of the present application;

[0060] Figure 14B A schematic diagram of displaying an annotation floating view provided in some embodiments of the present application;

[0061] Figure 14C A schematic diagram of the display position of a function area menu provided in some embodiments of the present application;

[0062] Figure 14D A schematic diagram of display content of a function area menu provided in some embodiments of the present application;

[0063] Figure 14E A schematic diagram of displaying and operating a function area submenu provided in some embodiments of the present application;

[0064] Figure 14F A hierarchical relationship diagram provided for some embodiments of the present application;

[0065] Figure 14G A schematic diagram showing an expanded view provided in some embodiments of the present application;

[0066] Figure 14H A display view of a second-style cursor provided in some embodiments of the present application;

[0067] Figure 14I A schematic diagram of cursor switching provided in some embodiments of the present application;

[0068] Figure 14J A schematic diagram of displaying a cursor annotation provided in some embodiments of the present application;

[0069] Figure 15 A schematic diagram of displaying a first expanded view provided in some embodiments of the present application;

[0070] Figure 16 A flowchart of a cursor display method provided in some embodiments of the present application;

[0071] Figure 17A This is a timing diagram of the brush generation process in the traditional way;

[0072] Figure 17B A flowchart of a cursor display method provided in some embodiments of the present application;

[0073] Figure 17C A schematic diagram of an interaction process provided for some embodiments of the present application;

[0074] Figure 18 A timing diagram of a cursor display method provided in some embodiments of the present application;

[0075] Figure 19 A timing diagram of another cursor display method provided in some embodiments of the present application;

[0076] Figure 20A structural diagram of a cursor display device provided in some embodiments of the present application;

[0077] Figure 21 A structural diagram of another cursor display device provided in some embodiments of the present application;

[0078] Figure 22 A structural diagram of another cursor display device provided in some embodiments of the present application;

[0079] Figure 23 FIG. 1 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0080] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0081] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0082] The terms "first", "second", "third", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar or similar objects or entities, and are not necessarily meant to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way are interchangeable under appropriate circumstances. The terms "including" and "having" and any variations thereof are intended to cover but not exclude inclusion. For example, a product or device that includes a series of components is not necessarily limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices. The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that can perform the functions associated with the element.

[0083] In the embodiments of the present application, the display device 200 generally refers to a device capable of displaying images and processing data. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0084] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1As shown in FIG, a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0085] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling connection and communication via a network communication protocol, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0086] like Figure 1 As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0087] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0088] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0089] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0090] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0091] In some embodiments, the display 260 includes a display component for presenting images and a driver component for driving image display. The display 260 is configured to receive image signals output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces.

[0092] In some embodiments, the communication device 220 is a component used to communicate with an external device or server 400 according to various communication protocols. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, if the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including WiFi functionality. If the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth functionality.

[0093] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0094] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0095] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0096] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0097] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0098] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0099] Figure 3 Some embodiments of this application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0100] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0101] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0102] In some embodiments, as Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0103] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.

[0104] Under the control of the controller 110, the communication interface 130 communicates control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, or other near field communication modules.

[0105] The user input / output interface 140 includes at least one of a microphone 141 , a touch panel 142 , a sensor 143 , a button 144 and other input interfaces.

[0106] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, to encode user input commands via the WiFi protocol, Bluetooth protocol, or NFC protocol and transmit them to the display device 200.

[0107] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0108] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0109] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling the hardware and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0110] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0111] The operating system can be divided into different modules or layers according to the functions implemented.

[0112] For example, Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (abbreviated as "application layer"), the application framework layer (abbreviated as "framework layer"), the system library layer and the kernel layer.

[0113] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0114] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0115] like Figure 4 In the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0116] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling application exit, opening, and back. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling changes in display windows, such as shrinking, shaking, or distorting the display window.

[0117] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0118] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 4As shown, the kernel layer can be configured with hardware drivers, and the drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0119] like Figure 4 As shown, Figure 4 Some embodiments of this application provide Figure 1 Schematic diagram of software configuration in the display device. In some embodiments, the system of the display device 200 can be divided into three layers, namely, application layer, middleware layer and hardware layer from top to bottom.

[0120] The application layer mainly includes commonly used applications on the TV and the application framework. Common applications are mainly browser-based applications, such as HTML5 applications (HyperText Markup Language 5 applications, applications based on web technologies such as the fifth edition of Hypertext Markup Language) and native applications.

[0121] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0122] Native apps can support online or offline, message push or local resource access.

[0123] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware uses the basic services (functions) provided by system software to connect various parts of the application system or different applications on the network, enabling resource and function sharing.

[0124] The hardware layer primarily includes the Hardware Abstraction Layer (HAL) interface, hardware, and drivers. The HAL interface is a unified interface for all TV chipsets, with each chip implementing its own logic. Drivers primarily include audio drivers, display drivers, Bluetooth drivers, camera drivers, Wi-Fi drivers, USB drivers, HDMI drivers, sensor drivers (such as fingerprint sensors, temperature sensors, and pressure sensors), and power drivers.

[0125] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0126] In some embodiments, a display device is provided, comprising: a display configured to: display a user interface, the user interface including at least one control; the user interface also having a cursor, the position of the cursor on the user interface being determined by the position pointed to by the remote control in three-dimensional space.

[0127] Optionally, the user can control the display device to start up through voice, remote control, or the switch of the TV device. After the display device is started, the user interface corresponding to the homepage is displayed through the display. The user can switch to other user interfaces through voice or remote control, such as: the user interface corresponding to the TV series label, the user interface corresponding to the movie label, the user interface corresponding to a page provided by a certain application, etc. The embodiment of the present application does not limit this.

[0128] Optionally, among all the user interfaces displayed on the display, some user interfaces contain controls, while some user interfaces may not contain controls. The solution provided in the embodiment of the present application is aimed at user interfaces containing controls. The number of controls on a user interface containing controls may be only one or may be greater than one, and the embodiment of the present application does not limit this.

[0129] Optionally, the remote control used with the display device may be a remote control with a pointing function, hereinafter referred to as a pointing remote control. When the pointing function is enabled, the user interface displayed on the display also includes a cursor, and the position of the cursor on the user interface is determined by the position pointed to by the pointing remote control in three-dimensional space. In the embodiments of the present application, the position pointed to by the pointing remote control in three-dimensional space is also referred to as the position data of the pointing remote control in three-dimensional space. The specific implementation process for determining the position of the cursor on the user interface based on the position data of the pointing remote control is described below.

[0130] The position data of a pointing remote control in three-dimensional space may include: position coordinates and pointing direction. The position coordinates are the physical position of the pointing remote control relative to the display device (e.g., horizontal distance and vertical height from the display device). The pointing direction is the pointing angle of the pointing remote control (e.g., horizontal and vertical angles relative to the display device). The pointing remote control has a built-in gyroscope to detect the remote control's rotation angle and an accelerometer to detect the remote control's acceleration. Using these sensors, the pointing remote control can determine its position data in three-dimensional space in real time.

[0131] In some embodiments, after obtaining its own position data in three-dimensional space, the pointing remote control can send this position data to a display device. The display device can perform screen coordinate conversion based on this position data, thereby converting the position data of the pointing remote control in three-dimensional space into a screen coordinate system. The obtained screen coordinates can be used as the position of the cursor on the user interface, and the cursor can be drawn at this position, thereby displaying the cursor.

[0132] In some embodiments, the pointing remote control includes a coordinate conversion module. After obtaining its own position data in three-dimensional space, the pointing remote control can input the position data into the coordinate conversion module. The coordinate conversion module can perform screen coordinate conversion based on the position data to convert the position data into a screen coordinate system to obtain screen coordinates. The screen coordinates can be used as the position of the cursor on the user interface, and the position of the cursor on the user interface is sent to the display device. After receiving the position of the cursor on the user interface, the display device draws the cursor at the position, thereby displaying the cursor. Exemplarily, the position of the cursor on the user interface is the coordinates (a, b), and the display device draws the cursor at the position with the coordinates (a, b) on the user interface, thereby displaying the cursor.

[0133] For example, see Figure 5 As shown, when the position data of the pointing remote control in three-dimensional space is A, the position of the cursor on the user interface is coordinates (a1, b1). When the position data of the pointing remote control in three-dimensional space is B, the position of the cursor on the user interface is coordinates (a2, b2). When the position data of the pointing remote control in three-dimensional space is C, the screen coordinates calculated using the above method exceed the screen range, and the display device no longer draws the cursor, so the cursor disappears.

[0134] See also Figure 6 As shown, the pointing remote control supports tapping. When the cursor hovers over a control, the user can press the touch area (confirmation key) on the pointing remote control, and the display device executes the corresponding logic in response to the operation. The controls here can be cards, buttons, input boxes, single choices, switches, dialog boxes, multiple choices, sliders, playback progress bars, scroll bars, drop-down menus, labels, lists, etc., and the embodiments of the present application do not limit this.

[0135] See also Figure 7As shown, the pointing remote control supports selection. When the user interface displays multiple options and selection boxes corresponding to these multiple options, if the user wants to select the first option and the third option, the user can first control the cursor to hover over the selection box corresponding to the first option and press the touch area on the pointing remote control. At this time, the first option is selected; then, the user can control the cursor to hover over the selection box corresponding to the third option and press the touch area on the pointing remote control. At this time, the third option is selected, thereby completing the jump selection.

[0136] See also Figure 8 As shown, the pointing remote control supports drag-and-drop multi-selection. When the user interface displays multiple options and selection boxes corresponding to these multiple options, if the user wants to select all options, the user can control the cursor to hover anywhere in the area above the first option, press the touch area on the pointing remote control and drag downward until the cursor moves to the area below the last option. At this time, all options are selected, thus completing the drag-and-drop multi-selection.

[0137] See also Figure 9 As shown, the pointing remote control supports dragging. When the user interface is playing a video and a playback progress bar is displayed, the user can control the cursor to hover over a certain position on the playback progress bar, and then press the touch area on the pointing remote control. The video played in the user interface will fast forward or rewind the video frame corresponding to the position, thereby completing the dragging of the playback progress. The playback progress bar in this example is only an example. Controls that support dragging also include sliders, scroll bars, labels, cards, lists, etc., and the embodiments of the present application are not limited to this.

[0138] See also Figure 10 As shown, the pointing remote control supports sliding. When a cursor is displayed on the user interface, the user can slide up, down, left or right on the touch area on the pointing remote control, and the display device will respond to these slides.

[0139] See also Figure 11 As shown, the pointing remote control supports continuous sliding. When a cursor is displayed on the user interface, the user can continuously slide up, down, left or right on the touch area on the pointing remote control. The display device will respond to these continuous slides and display a damped sliding effect on the user interface. Figure 11 A schematic diagram of continuous upward sliding.

[0140] See also Figure 12As shown, the pointing remote control supports continuous reverse sliding. When a cursor is displayed on the user interface, the user can slide in a certain direction and then in the opposite direction on the touch area on the pointing remote control. The display device will respond to the continuous reverse sliding and display a damped sliding effect on the user interface. Figure 12 A schematic diagram of sliding up and then sliding down.

[0141] It should be noted that the term "in response to" used below indicates a state in which a corresponding event occurs or a condition is satisfied. It is understandable that the timing of executing the subsequent action executed in response to the event or condition is not necessarily strongly correlated with the time when the event occurs or the condition is satisfied. For example, in some cases, the subsequent action may be executed immediately when the event occurs or the condition is satisfied; while in other cases, the subsequent action may not be executed until a period of time has passed after the event occurs or the condition is satisfied. "Trigger operation" refers to an action performed by a user on a visual interface by clicking, dragging, sliding, controlling cursor movement or other interactive methods. At the same time, the above-mentioned trigger operation can be implemented by a control device 100 such as a remote control or a mouse, or it can be implemented based on user touch. This embodiment does not impose any limitation on the specific control method of the trigger operation. Exemplarily, the remote control may include a pointing remote control.

[0142] With the development of display technology, display technology has made great progress, and its application scenarios are becoming increasingly rich and diverse. For example, in the conference annotation scenario, participants can annotate the content of the meeting during the meeting, such as marking key points and recording ideas, which greatly enhances the interactivity of the meeting and the intuitiveness of information communication, allowing participants to participate in the meeting discussion more conveniently. For example, in scenarios such as teaching and lectures, users can mark on the display screen according to the needs of the presentation. However, in actual application scenarios, when the user switches between the annotation drawing state and the normal cursor operation state, the system sometimes cannot recognize the user's intention in a timely and reliable manner, resulting in poor switching accuracy, affecting the fluency and continuity of the annotation, and reducing the user experience.

[0143] refer to Figure 13 As shown, in some embodiments, after monitoring the cursor entering the first view (ie Figure 13 In process a), the cursor is switched to the default cursor style, and when the cursor leaves the first view (i.e. Figure 13 After step b), the cursor is switched to the annotation style. This allows the cursor to switch between the annotation style and the default cursor style. However, when the cursor moves quickly between the first view and the second view, and finally moves from the first view to the second view, the cursor hovering event for the first view may not be detected due to an untimely response, resulting in a cursor style switching error.

[0144] In some alternative embodiments, see Figure 14A , provides a cursor display method, comprising the following steps:

[0145] S1410. Control the display to display an annotation view and a function area menu in the operation interface; the annotation view is used to display annotation content; the function area menu is used to display function controls; the function controls include annotation controls.

[0146] The annotation view can be understood as a view used to annotate content displayed in the user interface. The ribbon menu can be understood as a collection of regional views that integrate various annotation-related operations to facilitate user operation and management of annotation objects. The annotation control can be understood as a control used to create, edit, and manage annotations.

[0147] The following is an exemplary description of the display mode of the annotation view and the function area menu. It should be noted that this should not be understood as a limitation on the specific display mode of the annotation view and the function area menu.

[0148] In some embodiments, in response to a media access operation, the display 260 can be controlled to display a content view and an annotation floating view; in response to a triggering operation on the annotation floating view, the display 260 can be controlled to display a ribbon menu and an annotation view.

[0149] Among them, the media access operation can be understood as the connection establishment, control and interaction operations of the media stream transmission between the external device and the display device 100 through a preset interface or protocol. Optionally, the media access operation may include at least one of the switching operation and screen projection initiation operation for the HDMI (High Definition Multimedia Interface) channel. Among them, the annotation floating view can be understood as a graphical interface layer with annotation interaction properties. By triggering the annotation floating view, the function area menu and the annotation view for the annotation function can be displayed. Among them, the content view is used to display media content, so that users can annotate the media content in the annotation view.

[0150] For example, the application layer of display device 200 may include a media application and a conference annotation application. In response to a media access operation, the media application may control display 260 to display a content view and send a notification message to the conference annotation application. In response to the notification message, the conference annotation application may control display 260 to display an annotation overlay view. The media application may include at least one of a live TV application and a converged screen projection application.

[0151] Optionally, the annotation pop-up view can be set to a non-focusable and clickable state. "Non-focusable" can be understood as prohibiting the annotation pop-up view from capturing input from the control device 100 such as the remote control direction keys, keyboard or handle, ensuring that the main content layer such as the content view can normally receive the target control instructions of the control device 100. Exemplarily, the target control instructions may include at least one control instruction such as volume adjustment, pause playback and page turning. "Clickable" can be understood as allowing the control device 100 to perform trigger operations on the annotation pop-up view.

[0152] Optionally, the annotation floating view can be displayed at a preset display position in the display 260. For example, the preset display position can be the edge of the display area of ​​the display 260 to minimize interference with the content view. Figure 14B The diagram shows the display of the annotation floating view. Figure 14B The example shows that the annotation floating layer view Figure 1 It can be displayed in the middle of the right side of the display screen of the display 260, thereby reducing the visual impact of the content. Figure 2 It should be noted that this embodiment does not impose any restrictions on the specific display position and specific presentation method of the annotation floating layer view. For example, the annotation floating layer can be set to a non-focusable state to prohibit the annotation floating layer from capturing input from the control device 100 such as the remote control direction keys, keyboard or handle. For example, the annotation view can be created in a floating layer manner and loaded by the conference annotation application.

[0153] See also Figure 14C This is a diagram showing the display location of the ribbon menu. Figure 14C As shown in FIG, the display position of the function area menu 4 can correspond to the annotation floating layer view setting, that is, located at the edge of the display area. Figure 14C Also shown is the comment Figure 3 and cursor view Figure 5 Understandably, the criticism Figure 3 Can be displayed on top of the content view. Figure 5 That is, the display view of the cursor. Figure 5 It can be a global view displayed by the whole platform system service of the display device 200. The cursor position of the cursor view in the display screen can be controlled by pointing at at least one control device 100 such as a remote control and a mouse, or by touch. This embodiment does not impose any restrictions on the specific control method and specific presentation method of the cursor. For example, the cursor position in the operation interface is determined by the pointing position of the remote control in three-dimensional space. For example, the cursor view can use a circular cursor style by default.

[0154] See also Figure 14DFigure 4 is a schematic diagram of the display content of the ribbon menu. The ribbon menu 4 can display at least one of the following: an erase control, a clear screen control, a cursor control, a focus control, and a close control. The annotation control is used to annotate media content in the annotation drawing; the erase control is used to erase the annotated content; the clear screen control is used to clear the screen of annotated content; the cursor control is used to switch the annotation brush to the default cursor; the focus control is used to focus the selected content; and the close control is used to close the ribbon menu.

[0155] Continue to refer Figure 14D , the function area menu can also display the annotation control 6, which is used to create, edit and manage annotations. It should be noted that this embodiment does not impose any restrictions on the specific content presented in the function area menu. Exemplarily, the function area menu can be set to a non-focusable state to prohibit the function area menu from capturing input from the control device 100 such as the remote control direction keys, keyboard or handle. Exemplarily, the function area menu can be created in a floating layer manner and loaded by the conference annotation application.

[0156] Optionally, in response to a trigger operation on the annotation control, at least one selectable annotation option may be displayed. The annotation option may include at least one of an annotation color option, an annotation line option, and a cursor style option. Accordingly, in response to the trigger operation on the annotation option, cursor display data may be generated based on the selected annotation option. The cursor display data is used to render and display the cursor style when annotating.

[0157] Exemplarily, multiple function area menus may be provided. Furthermore, different function area menus may be configured as different menu levels according to actual needs. Optionally, the function area menu may include a function area main menu and a function area submenu. The function area main menu and the function area submenu may be located at the same view level.

[0158] refer to Figure 14E The function area submenu is shown as a schematic diagram of the display operation. The function area submenu can be displayed in response to the triggering operation of the annotation control 6 in the function area main menu. Among them, at least one annotation selection item 7 can be displayed in the function area submenu. Figure 14F The following is a diagram showing the hierarchical relationship between the function area menu, annotation view and content view. Figure 3 Located in the content view Figure 2 Above.

[0159] S1420. In response to a triggering operation on an annotation control in a ribbon menu of an operation interface, an extended view is created between a layer where the ribbon menu is located and a layer where an annotation view of the operation interface is located; a projection area of ​​a currently displayed ribbon menu in the extended view is located in the extended view.

[0160] The projection area can be understood as a two-dimensional coverage area formed in the extended view by projecting the function area menu currently displayed in the operation interface in a first direction. The first direction is perpendicular to the function area menu and the extended view.

[0161] refer to Figure 14G The diagram of the display of the extended view is shown in the figure. The function area menu 4 currently displayed is in the extended view. Figure 8 The projection area in the extended view Figure 8 middle.

[0162] In some embodiments, the target layer position of the currently displayed ribbon menu may be acquired, and an extended view may be created at a layer position next to the target layer position.

[0163] Optionally, the display size of the ribbon menu can be obtained; the outer display boundary of the ribbon menu can be determined; the outer display boundary can be extended by a preset size away from the ribbon menu to obtain an extended display boundary; and an extended view can be created at the next layer position after the target layer, corresponding to the extended display boundary, so that the projection area of ​​the currently displayed ribbon menu in the extended view is located within the extended view. It should be noted that the preset size can be set by a technician based on needs or experience, or determined through extensive experimentation, and this embodiment does not impose any limitation on this.

[0164] Illustratively, the line connecting the center of the extended view and the center of the function area menu may be perpendicular to the extended view.

[0165] Exemplarily, the vertex position of at least one vertex in the function area menu can be obtained, and the horizontal and vertical coordinates of the vertex position are respectively moved a preset distance away from the function area menu to obtain the extended vertex position of the extended view; based on the extended vertex position of the extended view, an extended view is created between the layer where the function area menu is located and the layer where the annotation view of the operation interface is located. It should be noted that the preset distance can be set by technicians according to needs or experience, or determined through a large number of experiments, and this embodiment does not impose any limitation on this. Exemplarily, the at least one vertex can include at least one of the upper left vertex and the lower left vertex of the function area menu.

[0166] Optionally, the target layer of the extended view to be created can be determined, and the vertex positions of the extended view in the target layer can be determined based on the extended vertex positions. By connecting the vertex positions, the view area where the extended view is located can be obtained.

[0167] Optionally, the target layer of the extended view to be created can be determined, and based on at least one extended vertex position and the display size of the ribbon menu, the extended view can be created between the layer where the ribbon menu is located and the layer where the annotation view of the operation interface is located.

[0168] In an optional embodiment, a cursor hover state monitor may be set for the extended view and the ribbon menu.

[0169] The cursor hover state monitoring can be understood as triggering a hover enter event when the cursor moves to and stays in the target view, indicating that the cursor has moved into the target view. The target view includes the extended view and the function area menu.

[0170] In some embodiments, the extended view may be a transparent view to prevent the extended view from blocking display content in the operation interface and also to avoid affecting the user's normal control operations.

[0171] S1430. When it is detected that the cursor enters the function area menu, the cursor is displayed in a first style; the cursor in the first style is used to perform control operations in the function area menu.

[0172] The cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in the three-dimensional space.

[0173] In an optional embodiment, the first style may be a default cursor style. For example, the default cursor style may be at least one of a circular cursor style and a pointer cursor style. This embodiment does not impose any limitation on the specific style content of the first style.

[0174] S1440. When it is detected that the cursor enters the extended view, the cursor is displayed in a second style; the cursor in the second style is used for performing annotation operations in the annotation view.

[0175] The cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in the three-dimensional space.

[0176] In an optional embodiment, the second style cursor can be drawn using the aforementioned cursor display data.

[0177] Optionally, the cursor position of the cursor may be obtained, a transparent canvas may be created at the cursor position, and a second-style cursor may be drawn in the canvas at a preset position and / or in a preset direction, thereby facilitating improved accuracy of the brush position and brush pointing.

[0178] For example, the second style cursor can be drawn along the preset direction starting from the preset position. For example, the second style can be a brush style. Figure 14HThe display view of the second style cursor is shown. The pen tip area and / or pen shaft area in the brush style can be filled with the color corresponding to the selected annotation color option. Among them, the pen shaft area is set to a rectangle; the pen tip area can be set to a triangular area, and one vertex in the triangular area can also be set to an arc, so as to improve the visual effect. This embodiment does not impose any restrictions on the specific style content of the second style. It should be noted that, in order to facilitate understanding by those skilled in the art, Figure 14H The middle canvas is filled with red. In some embodiments, the canvas can be set to a transparent canvas.

[0179] In an optional embodiment, the display of the function area menu may be canceled in response to a triggering operation on an exit control in the function area menu.

[0180] In some embodiments, the extended view may be deleted in response to a triggering operation on an exit control in the function area menu, thereby preventing the extended view from interfering with the user's normal annotation operation in the annotation view.

[0181] In an optional embodiment, the cursor of the second style may be drawn and displayed through the application layer module, the application framework layer module and the system service.

[0182] The application layer module can be understood as a software component used to provide application functions or services to users. The application layer module can include at least one of the following: an annotation application layer module, etc. The application framework layer module, i.e., the framework layer module, can be used to support the development of application layer modules and provide reusable functionality across applications. The system service can be understood as a system service process used to support the operation of applications and manage system resources. Furthermore, the system service can draw a second cursor style based on the current cursor position.

[0183] Optionally, in response to a triggering operation on the annotation control, the cursor display data corresponding to the annotation control can be obtained through the application layer module and sent to the application framework layer module; the annotation control is displayed in the function area menu in the operation interface; the cursor display data is cached in the current layer storage space through the application framework layer module; when the application layer module monitors that the cursor needs to be switched from the first style to the second style, the style adjustment information is sent to the system service through the application framework layer module; the system service responds to the style adjustment information, obtains the cursor display data from the current layer storage space corresponding to the application framework layer module, and displays the second style cursor at the current cursor position.

[0184] The above is the content about the second style. The following is an exemplary description of the cursor switching process with reference to the accompanying drawings.

[0185] refer to Figure 14IThe diagram for cursor switching is as follows. Figure 3 Move to expanded view Figure 8 In the case of extended viewing, you can monitor Figure 8 The cursor hovers over the event and displays the cursor in the second style. Figure 8 When the cursor moves to the function area menu 4, the cursor hovering event for the function area menu 4 can be monitored and the cursor is displayed in the first style. Figure 8 In the case of extended viewing, you can monitor Figure 8 The cursor hovers over the event, and the cursor is displayed in the second style. Figure 8 Move to comment Figure 3 In this case, the ribbon menu 4 and the extended view Figure 8 The cursor hovering event is not detected, and the cursor maintains the second style, so that the cursor can be viewed in batches. Figure 3 Perform annotation operations in .

[0186] refer to Figure 14J This is a diagram showing the cursor annotation display. Users can use the second-style cursor to perform annotation operations in the annotation view. During the annotation process, when the user needs to select an annotation function, they can control the cursor to move to the function area menu to select annotation functions, such as annotation color and annotation line.

[0187] In the above embodiment, by introducing an extended view, a buffer identification area is provided for the process of switching the cursor position between the function area menu and the annotation view. Setting the extended view between the layer where the function area menu is located and the layer where the annotation view is located is conducive to reducing the difficulty of creating the extended view. In addition, by monitoring the cursor entering the function area menu, the cursor is displayed in the first style, and when the cursor enters the extended view, the cursor is displayed in the second style, so that the cursor can still monitor the view that the cursor finally enters in a fast-moving scenario, thereby accurately switching the cursor style, avoiding errors in the cursor switching logic due to complex regional judgment logic and other reasons in the traditional method, reducing the probability of misjudgment of style switching, and improving the accuracy of cursor style display. In addition, since the extended view has a certain area range, the fault tolerance of the operation can be improved, which is conducive to improving the user experience.

[0188] In some embodiments, reference Figure 15A schematic diagram of the display of the first extended view is shown. When there are at least two currently displayed ribbon menus, a first extended view corresponding to each ribbon menu 4 can be created between the layer where the ribbon menu 4 is located and the layer where the annotation view is located. The projection area of ​​the ribbon menu in the corresponding first extended view is located in the corresponding first extended view. Each first extended view is located on the same layer.

[0189] Optionally, a target layer position of the ribbon menu may be obtained, and a first extended view may be created at a next layer position of the target layer position.

[0190] Optionally, for each ribbon menu, the display size of the ribbon menu can be obtained to determine the outer display boundary of the ribbon menu; the outer display boundary is extended by a preset size in the direction away from the ribbon menu to obtain an extended display boundary; between the layer where the ribbon menu is located and the layer where the annotation view of the operation interface is located, corresponding to the ribbon menu, a first extended view with the extended display boundary is created.

[0191] Optionally, for each function area menu, the vertex position of at least one vertex in the function area menu in the operation interface can be obtained, and the horizontal and vertical coordinates of the vertex position are moved a preset distance away from the function area menu to obtain the extended vertex position of the first extended view; based on the extended vertex position of the first extended view, a first extended view is created between the layer where the function area menu is located and the layer where the annotation view of the operation interface is located. Exemplarily, the extended vertex positions can be connected, and the area formed by the connection is used as the creation area of ​​the first extended view. Exemplarily, the first extended view can be created based on at least one extended vertex position and the display size of the function area menu.

[0192] In some embodiments, when there are at least two currently displayed ribbon menus, the display position and corresponding display size of each ribbon menu can be obtained, and the peripheral display boundary of the currently displayed ribbon menu can be determined based on the display position and corresponding display size of each ribbon menu; based on the peripheral display boundary, a second extended view is created between the layer where the ribbon menu is located and the annotation layer; the projection area of ​​the peripheral display boundary in the second extended view is located in the second extended view.

[0193] In the above embodiment, at least two function area menus are provided to facilitate user operation and control in the corresponding function area menus according to different control needs. Furthermore, by creating a first extended view corresponding to each function area menu or creating a second extended view based on the display position and corresponding display size of each function area menu, accurate switching of cursor styles can be achieved when the cursor moves between different function area menus and extended views.

[0194] In some alternative embodiments, see Figure 16 , provides a cursor display method, comprising the following steps:

[0195] S1610. Control the display to display an annotation view and a function area menu in the operation interface; the annotation view is used to display annotation content; the function area menu is used to display function controls; the function controls include annotation controls.

[0196] S1620. In response to the triggering operation on the annotation control, an extended view is created along the edge of the function area menu in the layer where the function area menu is located.

[0197] S1630. When it is detected that the cursor enters the function area menu, the cursor is displayed in a first style; the cursor in the first style is used to perform control operations in the function area menu.

[0198] S1640: When it is detected that the cursor enters the extended view, the cursor is displayed in a second style; the cursor in the second style is used for performing annotation operations in the annotation view.

[0199] Among them, the cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space; among them, the relevant contents about the annotation view, function area menu, first style and second style have been described above and will not be repeated here.

[0200] In an optional embodiment, the preset size can be expanded along the edge of the function area menu in a direction away from the function area menu to obtain an expanded view, wherein the expanded view and the function area menu are located in the same layer.

[0201] In an optional embodiment, the vertex position of each vertex in the function area menu can be obtained, and the horizontal and vertical coordinates of the vertex position can be moved a preset distance away from the function area menu to obtain the extended vertex position of the extended view. The outer boundary of the extended view can be obtained by connecting the extended vertex positions. The outer boundary of the function area menu is used as the inner boundary of the extended view to obtain the view area where the extended view is located.

[0202] In an optional embodiment, in response to a triggering operation of an exit control in the ribbon menu, the extended view is deleted.

[0203] In an optional embodiment, when there are at least two function area menus, a first extended view corresponding to the function area menu can be created for each function area menu along the edge of the function area menu in the layer where the function area menu is located; or, the display position and corresponding display size of each function area menu can be obtained, and the outer display boundary of the currently displayed function area menu can be determined according to the display position and corresponding display size of each function area menu; and a second extended view can be created along the edge of the outer display boundary in the layer where the function area menu is located. The function area menu is set to at least two so that the user can perform operations and controls in the corresponding function area menu according to different control needs. At the same time, by creating a first extended view corresponding to each function area menu or creating a second extended view according to the display position and corresponding display size of each function area menu, it is possible to meet the requirements of accurate switching of cursor styles in scenarios where the cursor moves between different function area menus and extended views.

[0204] In the above embodiment, by introducing an extended view, a buffer recognition area is provided for the process of switching the cursor position between the function area menu and the annotation view. In addition, by creating an extended view on the layer where the function area menu is located along the edge of the function area menu, it is beneficial to accurately control the size and position of the extended view. In addition, by monitoring the cursor entering the function area menu, the cursor is displayed in the first style, and in the case of monitoring the cursor entering the extended view, the cursor is displayed in the second style, so that the cursor can still monitor the view that the cursor finally enters in the fast-moving scene, thereby accurately switching the cursor style, avoiding the error in the cursor switching logic due to the complexity of the area judgment logic in the traditional method. The error of misjudgment of style switching is reduced, and the accuracy of cursor style display is improved. In addition, because the extended view has a certain area range, the fault tolerance of the operation can be improved, which is beneficial to improving the user experience. This is beneficial to improving the user experience.

[0205] During the second cursor display, Figure 17A The figure shows a timing diagram of the traditional brush generation process. In the traditional method, the application layer usually obtains the real-time cursor position from the system service. At the same time, the application layer generates the cursor display data used to draw the brush and stores it in the application layer's storage space. When the cursor needs to be set as a brush, the application layer sets the cursor to the brush of the corresponding cursor display data based on the obtained real-time cursor position. During the process of brush movement and display, the application layer needs to continuously obtain the real-time cursor position from the system service. After obtaining the real-time cursor position, it generates the target brush at the corresponding cursor position. This makes it easy for the display to be poor during the brush movement process.

[0206] Based on this, in some optional embodiments, see Figure 17B , provides a cursor display method, comprising the following steps:

[0207] S1710. In response to a triggering operation on the annotation control, the application layer module obtains cursor display data corresponding to the annotation control and sends the data to the application framework layer module; the annotation control is displayed in a function area menu in the operation interface.

[0208] Application layer modules can be understood as software components used to provide application functions or services to users. Application layer modules can include at least one of the following: annotation application layer modules, etc. Application framework layer modules, or framework layer modules, can be used to support the development of application layer modules and provide reusable functionality across applications.

[0209] In an optional embodiment, at least one selectable annotation option may be displayed in response to a trigger operation on an annotation control. The annotation option may include at least one of an annotation color option, an annotation line option, and a cursor style option. Accordingly, in response to the trigger operation on the annotation option, cursor display data may be generated based on the selected annotation option. The cursor display data is used to render and display the cursor style when annotating.

[0210] In an optional embodiment, the application layer module may send the cursor display data and the intention information to the application framework module. The intention information may be understood as a predefined identifier for representing the intention of sending the cursor display data.

[0211] S1720. Cache cursor display data into the storage space of this layer through the application framework layer module.

[0212] In an optional embodiment, the application framework layer module can respond to the intent information and determine the processing unit corresponding to the intent information, and the processing unit can cache the cursor display data in the storage control of this layer. The processing units corresponding to different intent information can be pre-defined in the application framework layer module.

[0213] S1730: When the application layer module detects that the cursor needs to be switched from the first style to the second style, the application framework layer module sends style adjustment information to the system service.

[0214] The system service can be understood as the system's service process used to support the operation of applications and manage system resources, and can draw a cursor of the second style based on the current cursor position of the cursor. In an optional embodiment, when the application layer module monitors that the cursor enters the extended view, it sends style adjustment information to the application framework layer module so that the application framework layer module forwards the style adjustment information to the system service. Exemplarily, the application framework layer module can forward the style adjustment information to the system service based on the address of the system service. The adjustment information can include the cache path of the cursor display data.

[0215] S1740. Responding to the style adjustment information through the system service, obtain cursor display data from the current layer storage space corresponding to the application framework layer module, and display a cursor of the second style at the current cursor position.

[0216] The display process of the second style cursor has been described above and will not be repeated here. Figure 17C This is a flowchart of the interaction between the application layer module, the application framework layer module, and the system service. The interaction content has been described above and will not be repeated here.

[0217] In the above embodiment, by responding to the triggering operation of the annotation control, the cursor display data corresponding to the annotation control is obtained through the application layer module, thereby providing a data basis for displaying the second style cursor. By introducing the application framework layer module and having the application framework layer module cache the cursor display data, the application framework layer module builds a communication bridge between the application layer module and the system service, avoiding the application layer from directly interacting with the system service for cursor display data, which is conducive to reducing development difficulty and improving system security. Since the system service can obtain the cursor position in the first time, the second style cursor is displayed at the current cursor position of the cursor through the system service, which can effectively improve the response speed of displaying the second style cursor.

[0218] Based on the above embodiment, the cursor display method can be implemented based on the interaction between media applications, conference annotation applications and system services. Figure 18 The following is a timing diagram of the cursor display method, which includes the following steps:

[0219] S1801. When the media application detects the switching of the HDMI channel or the screen projection scenario, it sends a scenario notification to the conference annotation application.

[0220] S1802. The conference annotation application displays an annotation floating view.

[0221] S1803: The conference annotation application displays a function area menu in response to a triggering operation on the annotation floating layer view.

[0222] S1804. The conference annotation application adds an extended subview according to the menu level status and sets a status monitor.

[0223] S1805. The conference annotation application generates a default brush based on the default color.

[0224] S1806: The conference annotation application sends the current drawing status and the cache path of the brush to the system service.

[0225] S1807: The conference annotation application generates cursor display data in response to the brush style selected by the user.

[0226] S1808. The conference annotation application sends the current drawing state and the cache path of the cursor display data to the system service.

[0227] S1809: When the conference annotation application monitors the cursor hovering and entering event corresponding to the function area menu, it sends a first notification message to the system service.

[0228] S1810: The system service switches the cursor to a default state (ie, a first style) in response to the first notification message.

[0229] S1811: The conference annotation application monitors a cursor hovering event corresponding to an extended view, or responds to a triggering operation of closing a control, and removes the extended view corresponding to the function area menu.

[0230] S1812. The conference annotation application sends a second notification message to the system service; in response to the second notification message, the system service loads cursor display data and switches the cursor to a second style.

[0231] Based on the above embodiments, Figure 19 The timing diagram of the cursor display method in some other embodiments includes:

[0232] S1901: In response to a media access operation, control the display to display an annotation floating layer view and a content view.

[0233] S1902: In response to a triggering operation on the annotation floating layer view, controlling the display to display a function area menu and the annotation view.

[0234] S1903: In response to the triggering operation on the annotation control, an extended view is created along the edge of the ribbon menu in the layer where the ribbon menu is located.

[0235] S1904: In response to the triggering operation of the annotation control, the cursor display data corresponding to the annotation control is obtained through the application layer module and sent to the application framework layer module; the annotation control is displayed in the function area menu in the operation interface.

[0236] S1905: Cache cursor display data into the storage space of this layer through the application framework layer module.

[0237] S1906: When it is detected that the cursor enters the function area menu, the cursor is displayed in a first style; the cursor in the first style is used to perform control operations in the function area menu.

[0238] S1907: When it is detected that the cursor enters the extended view, the style adjustment information is sent to the system service through the application framework layer module.

[0239] S1908: In response to the style adjustment information, the system service obtains the cursor display data from the storage space of the current layer corresponding to the application framework layer module, and displays a cursor of the second style at the current cursor position. The cursor under the second style is used for annotation operations in the annotation view.

[0240] S1909: In response to a triggering operation on an exit control in the function area menu, the extended view is deleted.

[0241] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0242] Based on the same inventive concept, embodiments of the present application further provide a cursor display device for implementing the aforementioned cursor display method. The solution provided by this device is similar to the solution described in the aforementioned method. Therefore, the specific limitations of one or more cursor display device embodiments provided below can be found in the above-described limitations of the cursor display method and will not be further elaborated here.

[0243] In an exemplary embodiment, Figure 20 As shown, a cursor display device is provided, comprising: a first control module 2010, a first creation module 2020, a second control module 2030 and a third control module 2040, wherein:

[0244] The first control module 2010 is used to control the display to display the annotation view and the function area menu in the operation interface; the annotation view is used to display the annotation content; the function area menu is used to display the function controls; the function controls include the annotation control;

[0245] A first creation module 220 is configured to, in response to a triggering operation on an annotation control in a function area menu of an operation interface, create an extended view between a layer where the function area menu resides and a layer where an annotation view of the operation interface resides; a projection area of ​​the currently displayed function area menu in the extended view is located in the extended view;

[0246] The second control module 2030 is configured to display the cursor in a first style upon detecting that the cursor enters the function area menu; the cursor in the first style is used to perform control operations in the function area menu; wherein the cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space;

[0247] The third control module 2040 is configured to display the cursor in a second style when detecting that the cursor enters the extended view; the cursor in the second style is used for performing annotation operations in the annotation view.

[0248] In an exemplary embodiment, Figure 21 As shown, a cursor display device is provided, including: a third control module 2110, a second creation module 2120, a fourth control module 2130 and a fifth control module 2140, wherein:

[0249] The third control module 2110 is used to control the display to display the annotation view and the function area menu in the operation interface; the annotation view is used to display the annotation content; the function area menu is used to display the function controls; the function controls include the annotation control;

[0250] The second creation module 2120 is configured to create an extended view on the layer where the function area menu is located along the edge of the function area menu in response to a triggering operation on the annotation control;

[0251] The fourth control module 2130 is configured to display the cursor in a first style upon detecting that the cursor enters the function area menu; the cursor in the first style is used to perform control operations in the function area menu; wherein the cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space;

[0252] The fifth control module 2140 is configured to display the cursor in a second style when detecting that the cursor enters the extended view; the cursor in the second style is used for performing annotation operations in the annotation view.

[0253] In an exemplary embodiment, Figure 22 As shown, a cursor display device is provided, including: an acquisition module 2210, a second creation module 2220, a fourth control module 2230 and a fifth control module 2240, wherein:

[0254] The acquisition module 2210 is used to respond to the triggering operation of the annotation control, obtain the cursor display data corresponding to the annotation control through the application layer module, and send it to the application framework layer module; the annotation control is displayed in the function area menu in the operation interface;

[0255] The cache module 2220 is used to cache the cursor display data to the storage space of this layer through the application framework layer module;

[0256] The sending module 2230 is configured to send style adjustment information to the system service through the application framework layer module when the application layer module monitors that the cursor needs to be switched from the first style to the second style;

[0257] The processing module 2240 is configured to obtain cursor display data from the storage space of the application framework layer module corresponding to the style adjustment information through the system service, and display a cursor of the second style at the current cursor position.

[0258] Each module in the cursor display device can be implemented in whole or in part through software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in the computer device in the form of software, so that the processor can call and execute the corresponding operations of each module.

[0259] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 23As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface, the display unit and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, a mobile cellular network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, a cursor display device method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device casing, or an external keyboard, touchpad or mouse.

[0260] Those skilled in the art will understand that Figure 23 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0261] In one embodiment, a computer device is further provided, including a memory and a processor. The memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

[0262] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0263] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0264] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile memory and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processor involved in the various embodiments provided herein may be, but are not limited to, a general-purpose processor, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), a programmable logic unit (PLC), a data processing logic unit based on quantum computing, an artificial intelligence (AI) processor, and the like.

[0265] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0266] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A display device, characterized in that: include: A display configured to display an operation interface; The operation interface has a cursor; The display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the operation interface displays an annotation view and a function area menu; the annotation view is used to display the annotation content; the function area menu is used to display function controls; the function controls include annotation controls; At least one controller, connected to the display, configured to: In response to a triggering operation on the annotation control, creating an extended view between the layer where the function area menu is located and the layer where the annotation view is located; The projection area of ​​the currently displayed function area menu in the extended view is located in the extended view; In the case of monitoring that the cursor enters the function area menu, displaying the cursor in a first style; In a case where it is monitored that the cursor enters the extended view, displaying the cursor in a second style; The cursor in the first style is used for performing control operations in the function area menu; the cursor in the second style is used for performing annotation operations in the annotation view.

2. The display device according to claim 1, wherein When there are at least two currently displayed ribbon menus, the controller is configured to: For each function area menu, a first extended view corresponding to the function area menu is created between the layer where the function area menu is located and the layer where the annotation view is located; the projection area of ​​the function area menu in the corresponding first extended view is located in the corresponding first extended view; each of the first extended views is located in the same layer; or, Obtain the display position and corresponding display size of each function area menu, and determine the outer display boundary of the currently displayed function area menu based on the display position and corresponding display size of each function area menu; create a second extended view between the layer where the function area menu is located and the annotation layer based on the outer display boundary; the projection area of ​​the outer display boundary in the second extended view is located in the second extended view.

3. The display device according to claim 1 or 2, characterized in that The function control further includes an exit control, and the controller is further configured to: In response to a triggering operation on an exit control in the function area menu, the extended view is deleted.

4. A display device, characterized in that: include: A display configured to display an operation interface; The operation interface has a cursor; The cursor position in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the operation interface displays an annotation view and a function area menu; the annotation view is used to display the annotation content; the function area menu is used to display function controls; the function controls include annotation controls; At least one controller, connected to the display, configured to: In response to a triggering operation on the annotation control, creating an extended view along an edge of the function area menu and on the layer where the function area menu is located; In the case of monitoring that the cursor enters the function area menu, displaying the cursor in a first style; In a case where it is monitored that the cursor enters the extended view, displaying the cursor in a second style; The cursor in the first style is used for performing control operations in the function area menu; the cursor in the second style is used for performing annotation operations in the annotation view.

5. The display device according to claim 4, wherein: In the case where there are at least two function area menus, when executing the step of creating an extended view along an edge of the function area menu and at a layer where the function area menu is located, the controller is configured to: For each function area menu, create a first extended view corresponding to the function area menu along the edge of the function area menu and on the layer where the function area menu is located; or, Obtain the display position and corresponding display size of each function area menu, and determine the outer display boundary of the currently displayed function area menu based on the display position and corresponding display size of each function area menu; and create a second extended view on the layer where the function area menu is located along the edge of the outer display boundary.

6. The display device according to claim 4 or 5, characterized in that The function control further includes an exit control, and the controller is further configured to: In response to a triggering operation on an exit control in the function area menu, the extended view is deleted.

7. A display device, characterized in that: include: A display configured to display an operation interface; The operation interface has a cursor; The cursor position in the operation interface is determined by the pointing position of the remote control in three-dimensional space; a function area menu is displayed in the operation interface; the function area menu is used to display function controls; the function controls include annotation controls; At least one controller, connected to the display, configured to: In response to the triggering operation of the annotation control, the application layer module obtains the cursor display data corresponding to the annotation control and sends it to the application framework layer module; the application framework layer module caches the cursor display data in the current layer storage space; When the application layer module detects that the cursor needs to be switched from the first style to the second style, the application framework layer module sends style adjustment information to the system service; The system service responds to the style adjustment information, obtains the cursor display data from the current layer storage space corresponding to the application framework layer module, and displays the cursor of the second style at the current cursor position of the cursor.

8. A cursor display method, characterized in that: include: Controlling the display to display an annotation view and a function area menu in the operation interface; the annotation view is used to display the annotation content; The function area menu is used to display function controls; the function controls include annotation controls; In response to a triggering operation on an annotation control in a function area menu of an operation interface, creating an extended view between a layer where the function area menu is located and a layer where an annotation view of the operation interface is located; The projection area of ​​the currently displayed function area menu in the extended view is located in the extended view; In the case of monitoring that the cursor enters the function area menu, displaying the cursor in a first style; In a case where it is monitored that the cursor enters the extended view, displaying the cursor in a second style; The cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the cursor under the first style is used to perform control operations in the function area menu; and the cursor under the second style is used to perform annotation operations in the annotation view.

9. A cursor display method, characterized in that: include: Controlling the display to display an annotation view and a function area menu in the operation interface; the annotation view is used to display the annotation content; The function area menu is used to display function controls; the function controls include annotation controls; In response to a triggering operation on the annotation control, creating an extended view along an edge of the function area menu and on the layer where the function area menu is located; In the case of monitoring that the cursor enters the function area menu, displaying the cursor in a first style; In a case where it is monitored that the cursor enters the extended view, displaying the cursor in a second style; The cursor is displayed in the operation interface, and the display position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space; the cursor under the first style is used to perform control operations in the function area menu; and the cursor under the second style is used to perform annotation operations in the annotation view.

10. A cursor display method, characterized in that: include: In response to a triggering operation on the annotation control, the cursor display data corresponding to the annotation control is obtained through the application layer module and sent to the application framework layer module; the annotation control is displayed in the function area menu in the operation interface; Cache the cursor display data into the storage space of this layer through the application framework layer module; When the application layer module detects that the cursor needs to be switched from the first style to the second style, the application framework layer module sends style adjustment information to the system service; The system service responds to the style adjustment information, obtains the cursor display data from the current layer storage space corresponding to the application framework layer module, and displays the cursor of the second style at the current cursor position of the cursor.

Images