Display device control method and display device
By calling target controls on smart TVs to obtain and analyze instructions for control devices, the problem of low user experience of smart TVs is solved, efficient control of mobile terminal applications is achieved, and operation convenience and user experience are improved.
Patent Information
- Application Number
- CN202310532287.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-11
- Publication Date
- 2024-11-12
Smart Images

Figure CN118945436A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the field of smart devices, and in particular to a control method of a display device and a display device. Background Art
[0002] Smart TV (TV) is a common household appliance in daily life, which can integrate audio and video, entertainment and games. For example, smart TV can play videos; compared with mobile terminals (such as smart phones and tablets), it has the advantages of large screen and high resolution.
[0003] There are version differences between the applications on the smart TV and the applications on the mobile terminal. The applications on the mobile terminal can be operated by clicking the display panel on the mobile terminal, while the applications on the smart TV are usually operated using a remote control.
[0004] In the related art, since smart TVs lack touch panels, mobile terminal versions of applications are installed on smart TVs. When users operate the mobile terminal versions of applications on smart TVs, they usually use external control devices (such as a mouse) to operate, which results in a low user experience. Summary of the invention
[0005] In view of this, in order to solve the above technical problems or part of the technical problems, an embodiment of the present invention provides a control method of a display device and a display device.
[0006] In a first aspect, an embodiment of the present invention provides a method for controlling a display device, comprising:
[0007] When it is determined that the first application is in a display state, calling the target control;
[0008] Using the target control to obtain a control instruction sent by a control device;
[0009] The first application is controlled based on the control instruction.
[0010] In a possible implementation, the using the target control to obtain the control instruction sent by the control device includes:
[0011] Acquire a first control instruction sent by a control device using the target control, where the first control instruction is used to instruct to perform a click operation on an icon corresponding to the first application;
[0012] The controlling the first application based on the control instruction includes:
[0013] The first application is controlled to start on the display device, and the first application enters a first mode and displays a first interface, wherein the first interface carries a first object.
[0014] In a possible implementation manner, the using the target control to obtain the control instruction sent by the control device further includes:
[0015] When the first application is in the first mode, using the target control to obtain a second control instruction sent by a control device, where the second control instruction is used to instruct a move / click operation on the first object;
[0016] The controlling the first application based on the control instruction further includes:
[0017] Based on the second control instruction, information corresponding to the first object is displayed in the first interface.
[0018] In a possible implementation manner, the using the target control to obtain the control instruction sent by the control device further includes:
[0019] When the first application is in the first mode, using the target control to obtain a third control instruction sent by the control device, wherein the third control instruction is used to instruct a mode switching operation of the first application;
[0020] The controlling the first application based on the control instruction further includes:
[0021] Based on the third control instruction, the first application is controlled to switch from the first mode to a target mode, where the target mode includes a second mode and a third mode.
[0022] In a possible implementation manner, the using the target control to obtain the control instruction sent by the control device further includes:
[0023] When the first application is in the target mode, using the target control to obtain a fourth control instruction sent by the control device, wherein the fourth control instruction is used to instruct a mode switching operation of the first application;
[0024] The controlling the first application based on the control instruction further includes:
[0025] The first application is controlled to switch from the target mode to the first mode based on the third control instruction.
[0026] In a possible implementation manner, controlling the first application to switch from the first mode to the target mode based on the third control instruction includes:
[0027] When the third control instruction instructs the first application to switch from the first mode to the second mode, the first application is controlled to enter the second mode and display a second interface, wherein the second interface carries a second object;
[0028] or,
[0029] When the third control instruction instructs the first application to switch from the first mode to the third mode, the first application is controlled to enter the third mode and a third interface is displayed, wherein the third interface carries a third object.
[0030] In a possible implementation manner, the using the target control to obtain the control instruction sent by the control device further includes:
[0031] When the first application is in the second mode, using the target control to obtain a fifth control instruction sent by a control device, wherein the fifth control instruction is used to instruct a click / continuous press operation on a sub-element in the second object;
[0032] The controlling the first application based on the control instruction further includes:
[0033] Based on the fifth control instruction, the information corresponding to the second object is displayed in the second interface by sliding. During the sliding display, a target sub-element in the second object triggers a reminder event.
[0034] In a possible implementation manner, the using the target control to obtain the control instruction sent by the control device further includes:
[0035] When the first application is in the third mode, using the target control to obtain a sixth control instruction sent by a control device, wherein the sixth control instruction is used to instruct a click operation on a sub-element in the third object;
[0036] The controlling the first application based on the control instruction further includes:
[0037] Based on the sixth control instruction, a target sub-element in the third object displayed on the third interface is selected to complete the input of the search text.
[0038] In a possible implementation, the method further includes:
[0039] When it is determined that the second application is in the preset area, obtaining a seventh control instruction sent by the control device;
[0040] The second application is controlled based on the seventh control instruction.
[0041] In a second aspect, an embodiment of the present invention provides a display device, including:
[0042] A calling module, used for calling the target control when it is determined that the first application is in a display state;
[0043] An acquisition module, used for acquiring a control instruction sent by a control device using the target control;
[0044] A control module is used to control the first application based on the control instruction.
[0045] In a third aspect, an embodiment of the present invention provides a display device, comprising: a processor and a memory, wherein the processor is used to execute a control program of the display device stored in the memory to implement a control method of the display device described in any one of the first aspects above.
[0046] In a fourth aspect, an embodiment of the present invention provides a storage medium, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the control method of the display device described in any one of the first aspects above.
[0047] The control method of a display device provided in an embodiment of the present invention calls a target control when determining that a first application is in a display state; uses the target control to obtain a control instruction sent by a control device, controls the first application based on the control instruction, monitors the control device using the target control, and analyzes and processes the control instruction sent by the obtained control device by the display device system, and controls the first application, thereby achieving control of a non-display device version of an application installed on the display device through the control device. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] Figure 1 An application scenario diagram of a control method for a display device provided by an embodiment of the present invention;
[0049] Figure 2 A schematic flow chart of a method for controlling a display device provided by an embodiment of the present invention;
[0050] Figure 3 A schematic flow chart of another method for controlling a display device provided by an embodiment of the present invention;
[0051] Figure 4 A schematic diagram of a control device provided by an embodiment of the present invention;
[0052] Figure 5A schematic diagram of a first application program in a display device from being started to entering a first mode provided by an embodiment of the present invention;
[0053] Figure 6 A schematic flow chart of another method for controlling a display device provided by an embodiment of the present invention;
[0054] Figure 7 A schematic diagram of an operation of a first application in a display device in a first mode provided by an embodiment of the present invention;
[0055] Figure 8 A schematic flow chart of another method for controlling a display device provided by an embodiment of the present invention;
[0056] Fig. 9 A schematic diagram of switching from a first mode to a second mode in a display device provided by an embodiment of the present invention;
[0057] Fig.10 A schematic flow chart of another method for controlling a display device provided by an embodiment of the present invention;
[0058] Fig.11 A schematic diagram of a display device sliding in a second mode provided by an embodiment of the present invention;
[0059] Fig.12 A schematic diagram of switching from a first mode to a third mode in a display device provided by an embodiment of the present invention;
[0060] Fig.13 A schematic diagram of the structure of a display device provided by an embodiment of the present invention;
[0061] Fig.14 A schematic structural diagram of another display device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0062] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0063] To facilitate understanding of the embodiments of the present invention, specific embodiments will be further explained below in conjunction with the accompanying drawings. The embodiments do not constitute a limitation on the embodiments of the present invention.
[0064] Figure 1An application scenario diagram of a control method for a display device provided by an embodiment of the present invention, as shown in the figure, specifically includes:
[0065] Remote control device 1, display device 2;
[0066] The remote control device 1 establishes a wireless communication connection with the display device 2, and the display device 2 can be controlled by the remote control device 1. The control signal of the remote control device 1 can be sent to the display device 2 in the form of infrared signals, Bluetooth signals, etc.
[0067] The remote control device 1 can be a remote control, the display device 2 can be a smart home appliance (for example, a TV), or a commercial / home projection device (such as a projector). An application is installed on the display device 2, and the application can include a first application and a second application. The first application can be a mobile terminal (for example, a smart phone, a tablet computer) version of the application, and the second application can be a display device 2 version of the application. In addition, the display device 2 is also installed with an operating system, for example, an Android operating system. In addition to the Android system, other operating systems can be installed on the display device 2. The system type of the display device is not specifically limited in this embodiment. The embodiment of the present invention will use the display device 2 installed with the Android system for a detailed introduction.
[0068] Furthermore, there are version differences between the first application and the second application, and there are also differences between the display device and the mobile terminal, resulting in that when the first application is installed on the display device, the control device cannot effectively control the first application on the display device.
[0069] In this embodiment, by calling a target control set on the display device and using the target control to monitor the control signal sent by the control device, the acquired control signal is written into the system in the form of an event, and the system controls the first application through the event.
[0070] Figure 2 A flow chart of a control method for a display device provided by an embodiment of the present invention is shown as follows: Figure 2 As shown, the method specifically includes:
[0071] S21. When it is determined that the first application is in a display state, call a target control.
[0072] In this embodiment, a first application is installed on the display device, and the version of the first application is different from that of the display device. For example, an APP of a smartphone is installed on an Android TV. In addition, a second application is also installed on the display device, and the version of the second application is the same as that of the display device.
[0073] Furthermore, the system of the display device detects the display interface (screen image) of the display device to determine whether there is a first application in the display interface. Specifically, the Android application package (APK) of the application can be read through the Application Programming Interface (API) to obtain the type of the application and determine whether the application in the display interface is the first application. When it is determined that the first application exists in the display interface (it can also be understood that the icon of the first application is in the display interface), the first application is configured to enter a display state, which can be understood as a state in which the first application can interact through the control device.
[0074] When the first application is determined according to the APK of the application and is in a display state, a target control inside the display device is called, and the control instruction of the control device is monitored by using the target control.
[0075] S22: using the target control to obtain a control instruction sent by a control device.
[0076] S23. Control the first application based on the control instruction.
[0077] In this embodiment, the system of the display device uses the target control to monitor the control instructions of the control device. When the target control obtains the control instructions sent by the control device, the system analyzes the control instructions and controls the first application according to the analysis results.
[0078] It should be noted that the control instruction is generated by the user triggering a control key (which may be called a button) on the control device, and the control key includes at least one of the following: a four-way movement key, a confirmation key, a return key, and a home key.
[0079] The control instruction includes at least one of the following: entering / exiting the first application, switching the mode of the first application, operating (selecting, clicking, moving) the content displayed by the first application, or inputting search text in the first application through a virtual keyboard, etc.
[0080] The control method of a display device provided in an embodiment of the present invention calls a target control when determining that a first application is in a display state; uses the target control to obtain a control instruction sent by a control device, controls the first application based on the control instruction, monitors the control device using the target control, and analyzes and processes the control instruction sent by the obtained control device by the display device system, and controls the first application, thereby achieving control of a non-display device version of an application installed on the display device through the control device.
[0081] In an optional scheme of an embodiment of the present invention, the target control is used to monitor the control instructions of the control device. The target control may be an auxiliary service (Accessibility Service) provided in the display device, and may also be replaced by other services other than the auxiliary service that can monitor the control instructions issued by the control device. This embodiment does not make any specific limitation on this, and the following will be described in detail by taking the target control including the auxiliary service as an example.
[0082] Figure 3 A flow chart of another method for controlling a display device provided by an embodiment of the present invention is shown as follows: Figure 3 As shown, the method specifically includes:
[0083] S31. When it is determined that the first application is in a display state, call an auxiliary service.
[0084] In this embodiment, the system of the display device detects the display interface (screen image) of the display device to determine whether there is a first application in the display interface. When it is determined that there is an application in the display state, an API is called to analyze the APK of the application in the display state to determine the type of application. When it is determined that there is a first application in the display interface, the first application is configured to enter the display state.
[0085] Furthermore, the following will be introduced by taking the display device as a TV, the control device as a remote controller, and the first application as a mobile terminal version of an APP as an example.
[0086] When it is determined that the mobile terminal version of the APP is in the TV display interface, the mobile terminal version of the APP is configured to enter a display state. At this time, the TV system calls the auxiliary service and starts the auxiliary service to monitor the remote control.
[0087] In this embodiment, refer to Figure 4 , which shows a schematic diagram of a control device provided by an embodiment of the present invention, such as Figure 4As shown, the control device includes multiple buttons. In this embodiment, the confirmation key 101, the left shift key 102, the right shift key 103, the up shift key 104, the down shift key 105, the return key 106, and the home key 107 are specifically introduced as examples.
[0088] It should be noted that the setting position of the above-mentioned buttons, the icon of each button, and the functions configured for the buttons can all be set according to actual needs. For example, in addition to the above settings, 103 can also be configured as a left shift key, 102 can be configured as a right shift key, 105 can be configured as an up shift key, 104 can be configured as a down shift key, and so on. This embodiment does not make any specific limitations on this.
[0089] S32: Utilize the auxiliary service to obtain a first control instruction sent by the control device.
[0090] In this embodiment, when it is determined that the first application is in the display state, a first control instruction may be generated by triggering a button in the control device, where the first control instruction is used to instruct a click operation on an icon corresponding to the first application.
[0091] Furthermore, when the mobile terminal version of the APP is in a display state, the user clicks on the icon of the mobile terminal version of the APP by pressing the confirmation key 101 on the remote control, and the remote control generates a first control instruction for the mobile terminal version of the APP based on the click operation, and the remote control then sends the first control instruction to the auxiliary service of the TV.
[0092] S33: Control the first application to start on the display device, and the first application to enter a first mode and display a first interface, wherein the first interface carries a first object.
[0093] In this embodiment, when the auxiliary service obtains the first control instruction, it controls the first application to start, and sets the first application to enter the first mode by default, and displays the first interface corresponding to the first mode. The first interface may include part or all of the entire screen of the display device, and a first object is suspended in the first interface. The first object can be moved by the control device. The first object can be understood as a reminder mark, which can include but is not limited to: a mouse hand, a cartoon finger, etc. The first mode can be understood as a mode controlled by the first object. For example, when the display interface of the first application includes a mouse hand, the first mode can be a mouse mode.
[0094] Reference Figure 5 , showing a schematic diagram of a first application program in a display device provided by an embodiment of the present invention from being started to entering a first mode, specifically including:
[0095] Use the left / right movement keys on the remote control to move the mobile terminal APP (N) to Figure 5 (a) When the position display state is displayed, the first control instruction is triggered by clicking the confirmation button of the remote control, and the display interface of the TV is changed from Figure 5 (a) Switch to Figure 5 (b) and in the interface Figure 5 In (b), a mouse hand (first object) is displayed.
[0096] Figure 6 A flow chart of another method for controlling a display device provided by an embodiment of the present invention is shown as follows: Figure 6 As shown, the method specifically includes:
[0097] S61. When the first application is in the first mode, use the auxiliary service to obtain a second control instruction sent by a control device.
[0098] S62: Display information corresponding to the first object in the first interface based on the second control instruction.
[0099] In this embodiment, when the first application is in the first mode, the auxiliary service is used to obtain a second control instruction sent by the control device, where the second control instruction is used to instruct a move / click operation on the first object; the auxiliary service parses the second control instruction and converts the second control instruction into an event to which the first application can respond, and injects the event into the system of the display device, and the system of the display device controls the first application to display information corresponding to the first object in the first interface.
[0100] Reference Figure 7 , showing a schematic diagram of an operation of a first application in a display device provided by an embodiment of the present invention when the first application is in a first mode, specifically including:
[0101] When the mouse hand is Figure 7 (a), you can use the left shift key + up shift key on the remote control (to generate the second control command) and move the mouse from Figure 7 (a) moves to Figure 7 (b) position; and then click the confirmation key of the mover (generating a second control instruction) to confirm the information corresponding to the mouse hand, and at the same time highlight the reminder in the first interface.
[0102] In this embodiment, the control device can be monitored by calling the auxiliary service, and the control instructions of the remote control can be converted into instructions to which the first application can respond through the auxiliary service. The system of the display device then controls the first application through the instructions to which the first application can respond. In this way, the control device can control the first application without the need for other auxiliary devices / programs, thereby saving operating costs. In addition, in the process of controlling the first application, the first object can be suspended in the first interface of the first application to effectively prompt the user for the information required, thereby improving the user experience.
[0103] In an optional solution of the embodiment of the present invention, the functions corresponding to the buttons on the control device may also be configured, such as short movement, long movement, four-way sliding, etc. of the first object, which will be introduced in the form of examples below.
[0104] Short movement can be understood as moving once each time the four-way movement key is triggered, that is, the key is triggered intermittently, and the mouse hand moves intermittently; long movement can be understood as moving a certain distance each time the four-way movement key is triggered for a period of time (which can be set through a timer, for example, pressing the key on the control device for more than 1200ms is defined as a long movement), that is, continuously triggering the key, and the mouse hand moves continuously until the key is not triggered (from the pressed state to the lifted state), then it stops moving. By configuring short movement, the first object can be moved in four directions for a short distance, which is convenient for the selection and display of close-range information; by configuring long movement, the first object can be moved in four directions for a long distance. Compared with mobile terminals, the interface of the display device is larger. Long movement can reduce the number of times the control device buttons are pressed and increase the service life of the control device, thereby improving user experience.
[0105] Four-way sliding may include: up sliding, down sliding, left sliding and right sliding; it may be set to: when the first object is moved to the bottom of the first interface, an up sliding is triggered once (similar to turning pages); when the first object is moved to the top of the first interface, a down sliding is triggered once; when the first object is moved to the left part of the first interface, a right sliding is triggered once; when the first object is moved to the right part of the first interface, a left sliding is triggered once; by setting four-way sliding, the number of times the control device buttons are pressed can be reduced and the service life of the control device can be increased, thereby improving the user experience.
[0106] In an optional solution of the embodiment of the present invention, the second control instruction may also include short movement, long movement, and four-way sliding instructions generated by triggering a four-way movement key of the control device.
[0107] It should be noted that: the above-mentioned short movement and long movement can be configured interchangeably, the four-way sliding can be configured interchangeably (for example, when the first object is moved to the bottom of the first interface, a downward sliding is triggered once; when the first object is moved to the top of the first interface, an upward sliding is triggered once), etc. The specific configuration can be customized according to user needs, and this embodiment does not make any specific limitations on this.
[0108] In an optional scheme of an embodiment of the present invention, the second control instruction may also include a return instruction generated by triggering a return key on the control device; the first interface includes a main interface, or a main interface and multiple sub-interfaces associated with the main interface; when it is necessary to return from a sub-interface to an upper-level sub-interface or a main interface, a second control instruction can be generated by triggering the return key on the control device to return to the upper-level sub-interface or the main interface, thereby realizing switching between the current / previous interface and improving the user experience.
[0109] In an optional scheme of an embodiment of the present invention, the first application includes: a first mode, a second mode and a third mode; in the first mode, the second mode or the third mode can be entered by controlling the device, and in the second mode or the third mode, the first mode can also be returned to the first mode by controlling the device. The switching between the above modes is described in detail below.
[0110] Figure 8 A flow chart of another method for controlling a display device provided by an embodiment of the present invention is shown as follows: Figure 8 As shown, the method specifically includes:
[0111] S81. When the first application is in the first mode, use the auxiliary service to obtain a third control instruction sent by the control device.
[0112] S82. Control the first application to switch from the first mode to a target mode based on the third control instruction, where the target mode includes a second mode and a third mode.
[0113] In this embodiment, three modes (a first mode, a second mode, and a third mode) and trigger conditions corresponding to each mode are pre-configured in the mobile terminal.
[0114] The trigger conditions of the three modes are introduced below in the form of examples. In addition to the following conditions, other trigger conditions may also be included, which can be customized according to user needs or manufacturers. This embodiment does not make specific limitations on this.
[0115] For example, the trigger condition of the first mode is configured as follows: when the first application is in the display state, the first control instruction sent by the control device is received (a click operation on the confirmation key), and the first mode is determined to be entered; the trigger condition of the second mode is configured as follows: when the first application is in the first mode, the third control instruction sent by the control device is received (the confirmation key is pressed continuously for 2 seconds), and the first mode is switched to the second mode; the trigger condition of the third mode is configured as follows: when the first application is in the first mode, the third control instruction sent by the control device is received (a preset object in the first interface is selected by clicking the four-way movement key and the confirmation key), and the first mode is switched to the third mode.
[0116] Furthermore, when the first application is in the first mode, the auxiliary service is used to monitor the control device. When a third control instruction sent by the control device is received (the third control instruction is used to instruct a mode switching operation of the first application), the auxiliary service parses the third control instruction and converts the third control instruction into an event to which the first application can respond, and injects the event into the system of the display device. The system of the display device controls the first application to complete the switching from the first mode to the target mode.
[0117] S821. When the third control instruction instructs the first application to switch from the first mode to the second mode, control the first application to enter the second mode and display a second interface, wherein the second interface carries a second object.
[0118] In this embodiment, when the auxiliary service obtains the third control instruction, it controls the first application to switch modes from the first mode to the second mode, and displays the second interface corresponding to the second mode. Compared with the first interface of the first mode, the second interface of the second mode carries a second object, and the second object can be understood as a reminder mark, which can include but is not limited to: a four-way moving icon. The second mode can be understood as a mode in which the second object controls the displayed content, and the control can include four-way continuous sliding of the displayed content; for example, when the display interface of the first application includes a four-way moving icon, the first mode can be a sliding mode.
[0119] Reference Fig. 9 , showing a schematic diagram of switching from a first mode to a second mode in a display device provided by an embodiment of the present invention; specifically comprising:
[0120] Fig. 9(a) is the first interface displayed by the first application in the first mode, and the first interface includes a first object mouse hand set in suspension. When the user continuously presses the confirmation button on the remote control for more than 2 seconds, the remote control generates a third control instruction and sends the third control instruction to the auxiliary service of the TV. The auxiliary service parses the third control instruction and converts the third control instruction into an event to which the first application can respond, controls the first application to switch modes from the first mode to the second mode, and displays the second interface corresponding to the second mode at the same time, in which the second object (four-way sliding icon) set in suspension is displayed. It should be noted that when the first mode is switched to the second mode, except that the first object is switched to the second object, other information of the first interface will not change.
[0121] Fig.10 A flow chart of another method for controlling a display device provided by an embodiment of the present invention is shown as follows: Fig.10 As shown, the method specifically includes:
[0122] S101. When the first application is in the second mode, use the auxiliary service to obtain a fifth control instruction sent by a control device.
[0123] S102: Slide and display information corresponding to the second object in the second interface based on the fifth control instruction.
[0124] In this embodiment, when the first application is in the second mode, the auxiliary service is used to obtain the fifth control instruction sent by the control device, and the second control instruction is used to indicate a sliding operation on the content displayed on the second interface; the auxiliary service parses the fifth control instruction and converts the fifth control instruction into an event to which the first application can respond, and injects the event into the system of the display device, and the system of the display device controls the second application to slide and display the displayed content in the second interface.
[0125] In an optional scheme of an embodiment of the present invention, the sliding display may include: four-way short sliding and four-way long sliding of the content displayed in the second interface with the second object as the center, the four directions referring to up, down, left and right, which will be introduced in the form of examples below.
[0126] The four-way short slide can be understood as each time the four-way movement key is triggered, the displayed content slides once in the corresponding direction, that is, the key is triggered intermittently, and the displayed content slides intermittently.
[0127] The four-way long slide can be understood as the four-way movement key being continuously triggered, and the displayed content continuously sliding in the corresponding direction, that is, the key is continuously triggered, and the displayed content continuously slides. When the key changes from the triggered state to the untriggered state (the key is lifted), the sliding display stops.
[0128] In an optional scheme of an embodiment of the present invention, the target sub-element in the second object triggers a reminder event during the sliding display process. For example, when a short swipe is performed to the left, the right arrow of the four-way sliding icon is highlighted. For example, when a long swipe is performed to the right, the left arrow of the four-way sliding icon is highlighted.
[0129] Reference Fig.11 , showing a schematic diagram of a display device provided by an embodiment of the present invention sliding in a second mode, specifically comprising:
[0130] By triggering the left shift button on the remote control (single press or continuous long press), a fifth control instruction is generated and sent to the auxiliary service. The auxiliary service converts the fifth control instruction into an event that the first application can respond to and injects the event into the system of the display device. The system controls the second interface Fig.11 The left arrow of the four-way sliding icon in (a) is highlighted, indicating that the display content in the second interface slides to the right (whether it is a long slide or a short slide needs to be determined according to the triggering situation of the button. Here it is a static display and only the sliding effect is shown). At this time, part of the content on the right has been moved out of the second interface.
[0131] By triggering the down button on the remote control (single press or continuous long press), a fifth control instruction is generated and sent to the auxiliary service. The auxiliary service converts the fifth control instruction into an event that the first application can respond to and injects the event into the system of the display device. The system controls the second interface Fig.11 The downward arrow of the four-way sliding icon in (b) is highlighted, indicating that the displayed content in the second interface slides upward (whether it is a long slide or a short slide needs to be determined according to the triggering situation of the button. Here it is a static display and only the sliding effect is shown). At this time, the upper part of the content has been moved out of the second interface.
[0132] In this embodiment, a second mode of the first application is set, and the sliding display of the content displayed in the first application is realized through the auxiliary service with the help of the second object as the coordinate origin, so as to solve the problem that the display device needs to display multiple contents and the inconvenience of searching for the content. The sliding display can shorten the search time, improve the search efficiency and enhance the user experience.
[0133] S822: When the third control instruction instructs the first application to switch from the first mode to the third mode, control the first application to enter the third mode and display a third interface, wherein the third interface carries a third object.
[0134] In this embodiment, when the auxiliary service obtains the third control instruction, it controls the first application to switch modes from the first mode to the third mode, and displays the third interface corresponding to the third mode. Compared with the first interface of the first mode, the third interface of the third mode carries a third object, which can be understood as an auxiliary input tool. The auxiliary input tool can be understood as a virtual keyboard. The presentation form of the virtual keyboard can be set according to needs. Here, this embodiment does not specifically limit the presentation form of the virtual keyboard.
[0135] The third mode may be understood as an input mode in which a third object assists in inputting search text. For example, when the display interface of the first application includes a virtual keyboard, the third mode may be an input mode.
[0136] Furthermore, a preset object is set in the first interface displayed by the first application. In the first mode, a third control instruction can be generated by controlling the device to move the first object to complete a click operation on the preset object. The preset object may include but is not limited to: search symbols, search input areas, etc.
[0137] Reference Fig.12 , showing a schematic diagram of switching from a first mode to a third mode in a display device provided by an embodiment of the present invention; specifically comprising:
[0138] In the first mode, the mouse hand in the first interface is moved to the Search area through the four-way movement keys of the remote control, and the confirmation key of the remote control is triggered to generate a third control instruction, and the third control instruction is sent to the auxiliary service of the TV. The auxiliary service parses the third control instruction and converts the third control instruction into an event to which the first application can respond, controls the first application to switch modes from the first mode to the third mode, and displays the third interface corresponding to the third mode at the same time, in which a third object (virtual keyboard) set in suspension is displayed. It should be noted that when the first mode is switched to the third mode, except that the first object is switched to the third object, other information in the first interface will not change.
[0139] Fig.13 A flow chart of another method for controlling a display device provided by an embodiment of the present invention is shown as follows: Fig.13 As shown, the method specifically includes:
[0140] S131. When the first application is in the third mode, use the auxiliary service to obtain a sixth control instruction sent by a control device.
[0141] S132: Select a target sub-element in the third object displayed on the third interface based on the sixth control instruction to complete input of the search text.
[0142] In this embodiment, when the first application is in the third mode, the auxiliary service is used to obtain the sixth control instruction sent by the control device, and the sixth control instruction is used to indicate a click operation on a sub-element in the third object, and the sub-elements of the third object include keys in the virtual keyboard; the auxiliary service directly forwards the sixth control instruction to the system of the display device, and the system directly selects the target sub-element in the third object displayed on the third interface according to the sixth control instruction to complete the input of the search text, and the input can be completed by the four-way movement key + confirmation key of the remote control.
[0143] S83. When the first application is in the target mode, use the auxiliary service to obtain a fourth control instruction sent by the control device.
[0144] S84. Control the first application to switch from the target mode to the first mode based on the third control instruction.
[0145] In this embodiment, the trigger condition for switching the target mode back to the first mode is pre-configured in the mobile terminal (that is, a fourth control instruction is set to indicate a mode switching operation for the first application), and the target mode switching back to the first mode includes: switching the second mode back to the first mode and switching the third mode back to the first mode.
[0146] The triggering conditions for mode switching will be introduced below in the form of examples. In addition to the following conditions, other triggering conditions may also be included, which can be customized according to user needs or manufacturers. This embodiment does not make specific limitations on this.
[0147] For example, the trigger condition for switching from the second mode back to the first mode is configured as, during the process of the display device displaying the second interface, receiving the fourth control instruction (a click operation on the return key) sent by the control device, determining to switch from the second mode back to the first mode; the trigger condition for switching from the third mode back to the first mode is configured as, during the process of the display device displaying the third interface, receiving the fourth control instruction (a click operation on the return key) sent by the control device, determining to switch from the third mode back to the first mode.
[0148] In an optional solution of the embodiment of the present invention, when the first application is in any mode, when the auxiliary service receives a trigger operation of the home button in the control device, the auxiliary service is closed, that is, the control of the first application by the control device is exited.
[0149] In an optional solution of the embodiment of the present invention, after determining that the second application is in a preset area (the preset area can refer to Figure 5 (a) when the location area of the first application N is reached, a seventh control instruction sent by the control device is obtained; and the second application is controlled based on the seventh control instruction.
[0150] In this embodiment, the second application is a display version application, and the seventh control instruction includes an instruction generated by triggering a button on the control device. Therefore, the second application can be directly controlled by the control device.
[0151] The control method of the display device provided in the embodiment of the present invention sets three modes of the first application and the trigger conditions of each mode, and calls the auxiliary service, and uses the auxiliary service to receive control instructions from the control device side to realize the control of different types of applications on the display device side. Specifically, it can realize operations such as moving, clicking, sliding and inputting the content displayed in the first application, without the need for external devices such as USB mouse, thereby reducing the occupancy of the interface, reducing the difficulty of operation, and improving the user experience.
[0152] Fig.13 A schematic diagram of a display device provided by an embodiment of the present invention is shown in FIG. Fig.13 Specifically shown include:
[0153] The calling module 131 is used to call the target control when it is determined that the first application is in the display state;
[0154] An acquisition module 132 is used to acquire a control instruction sent by a control device using the target control;
[0155] The control module 133 is used to control the first application based on the control instruction.
[0156] In a possible implementation, the acquisition module 132 is specifically configured to use the target control to acquire a first control instruction sent by a control device, where the first control instruction is used to instruct a click operation to be performed on an icon corresponding to the first application;
[0157] The control module 133 is specifically used to control the first application to start on the display device, and the first application to enter a first mode and display a first interface, wherein the first interface carries a first object.
[0158] In a possible implementation, the acquisition module 132 is further configured to, when the first application is in the first mode, use the target control to acquire a second control instruction sent by a control device, where the second control instruction is used to instruct a move / click operation on the first object;
[0159] The control module 133 is further configured to display information corresponding to the first object in the first interface based on the second control instruction.
[0160] In a possible implementation, the acquisition module 132 is further configured to, when the first application is in the first mode, use the target control to acquire a third control instruction sent by the control device, wherein the third control instruction is used to instruct a mode switching operation of the first application;
[0161] The control module 133 is further configured to control the first application to switch from the first mode to a target mode based on the third control instruction, where the target mode includes a second mode and a third mode.
[0162] In a possible implementation, the acquisition module 132 is further configured to, when the first application is in the target mode, use the target control to acquire a fourth control instruction sent by the control device, wherein the fourth control instruction is used to instruct a mode switching operation of the first application;
[0163] The control module 133 is further configured to control the first application to switch from the target mode to the first mode based on the third control instruction.
[0164] In a possible implementation manner, the control module 133 is specifically configured to control the first application to enter the second mode and display a second interface when the third control instruction instructs the first application to switch from the first mode to the second mode, wherein the second interface carries a second object;
[0165] or,
[0166] When the third control instruction instructs the first application to switch from the first mode to the third mode, the first application is controlled to enter the third mode and a third interface is displayed, wherein the third interface carries a third object.
[0167] In a possible implementation, the acquisition module 132 is further configured to, when the first application is in the second mode, use the target control to acquire a fifth control instruction sent by the control device, where the fifth control instruction is used to instruct a click / continuous press operation on a sub-element in the second object;
[0168] The control module 133 is further configured to slide and display the information corresponding to the second object in the second interface based on the fifth control instruction, wherein a target sub-element in the second object triggers a reminder event during the sliding display process.
[0169] In a possible implementation, the acquisition module 132 is further configured to, when the first application is in the third mode, use the target control to acquire a sixth control instruction sent by the control device, where the sixth control instruction is used to instruct a click operation on a sub-element in the third object;
[0170] The control module 133 is further configured to select a target sub-element in the third object displayed on the third interface based on the sixth control instruction to complete input of the search text.
[0171] In a possible implementation, the method further includes:
[0172] The acquisition module 132 is further configured to acquire a seventh control instruction sent by the control device when it is determined that the second application is in the preset area;
[0173] The control module 133 is further configured to control the second application based on the seventh control instruction.
[0174] The display device provided in this embodiment may be Fig.13 The display device shown in FIG. 1 may execute the following Figure 1-12 All steps of the control method of the display device are implemented Figure 1-12 For details, please refer to the technical effect of the control method of the display device shown in Figure 1-12 For the sake of brevity, the relevant description is not repeated here.
[0175] Fig.14 A schematic diagram of the structure of another display device provided by an embodiment of the present invention, Fig.14 The display device 1400 shown includes: at least one processor 1401, a memory 1402, at least one network interface 1404 and other user interfaces 1403. The various components in the display device 1400 are coupled together via a bus system 1405. It is understood that the bus system 1405 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 1405 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 1405 is not described in detail. Fig.14 Various buses are labeled as bus system 1405.
[0176] The user interface 1403 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touch pad, or a touch screen).
[0177] It can be understood that the memory 1402 in the embodiment of the present invention can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct memory bus random access memory (DRRAM). The memory 1402 described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0178] In some implementations, the memory 1402 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 14021 and an application program 14022 .
[0179] The operating system 14021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 14022 includes various application programs, such as a media player (MediaPlayer), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present invention can be included in the application 14022.
[0180] In the embodiment of the present invention, by calling the program or instruction stored in the memory 1402, specifically, the program or instruction stored in the application 14022, the processor 1401 is used to execute the method steps provided by each method embodiment, for example, including:
[0181] When it is determined that the first application is in a display state, a target control is called; a control instruction sent by a control device is acquired using the target control; and the first application is controlled based on the control instruction.
[0182] In one possible implementation, the target control is used to obtain a first control instruction sent by a control device, wherein the first control instruction is used to instruct a click operation on an icon corresponding to the first application; the first application is controlled to start on the display device, and the first application enters a first mode and displays a first interface, wherein the first interface carries a first object.
[0183] In one possible implementation, when the first application is in the first mode, the target control is used to obtain a second control instruction sent by the control device, where the second control instruction is used to instruct a move / click operation on the first object; based on the second control instruction, information corresponding to the first object is displayed in the first interface.
[0184] In one possible implementation, when the first application is in the first mode, the target control is used to obtain a third control instruction sent by the control device, and the third control instruction is used to instruct a mode switching operation of the first application; based on the third control instruction, the first application is controlled to switch from the first mode to the target mode, and the target mode includes the second mode and the third mode.
[0185] In one possible implementation, when the first application is in the target mode, the target control is used to obtain a fourth control instruction sent by the control device, and the fourth control instruction is used to instruct a mode switching operation of the first application; based on the third control instruction, the first application is controlled to switch from the target mode to the first mode.
[0186] In a possible implementation, when the third control instruction instructs the first application to switch from the first mode to the second mode, the first application is controlled to enter the second mode and a second interface is displayed, wherein the second interface carries a second object;
[0187] or,
[0188] When the third control instruction instructs the first application to switch from the first mode to the third mode, the first application is controlled to enter the third mode and a third interface is displayed, wherein the third interface carries a third object.
[0189] In one possible implementation, when the first application is in the second mode, the target control is used to obtain a fifth control instruction sent by the control device, wherein the fifth control instruction is used to instruct a click / continuous press operation on a sub-element in the second object; based on the fifth control instruction, the information corresponding to the second object is displayed in a sliding manner in the second interface, wherein the target sub-element in the second object triggers a reminder event during the sliding display process.
[0190] In one possible implementation, when the first application is in the third mode, the target control is used to obtain a sixth control instruction sent by the control device, and the sixth control instruction is used to instruct a click operation on a sub-element in the third object; based on the sixth control instruction, a target sub-element in the third object displayed on the third interface is selected to complete the input of the search text.
[0191] In a possible implementation, when it is determined that the second application is in a preset area, a seventh control instruction sent by a control device is obtained; and the second application is controlled based on the seventh control instruction.
[0192] The method disclosed in the above embodiment of the present invention can be applied to the processor 1401, or implemented by the processor 1401. The processor 1401 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 1401 or the instruction in the form of software. The above processor 1401 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present invention can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 1402, and the processor 1401 reads the information in the memory 1402 and completes the steps of the above method in combination with its hardware.
[0193] It is understood that the embodiments described herein can be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPDevice, DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present application or a combination thereof.
[0194] For software implementation, the technology described herein can be implemented by a unit that performs the functions described herein. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.
[0195] The display device provided in this embodiment may be Fig.14 The display device shown in FIG. 1 may execute the following Figure 1-12 All steps of the control method of the display device are implemented Figure 1-12 For details, please refer to the technical effect of the control method of the display device shown in Figure 1-12 For the sake of brevity, the relevant description is not repeated here.
[0196] The embodiment of the present invention also provides a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.
[0197] When one or more programs in the storage medium can be executed by one or more processors, the automatic plate-making method executed on the control device side of the display device can be implemented.
[0198] The processor is used to execute a control program of the display device stored in the memory to implement the following steps of a control method of the display device executed on a control device side of the display device:
[0199] When it is determined that the first application is in a display state, a target control is called; a control instruction sent by a control device is acquired using the target control; and the first application is controlled based on the control instruction.
[0200] In one possible implementation, the target control is used to obtain a first control instruction sent by a control device, wherein the first control instruction is used to instruct a click operation on an icon corresponding to the first application; the first application is controlled to start on the display device, and the first application enters a first mode and displays a first interface, wherein the first interface carries a first object.
[0201] In one possible implementation, when the first application is in the first mode, the target control is used to obtain a second control instruction sent by the control device, where the second control instruction is used to instruct a move / click operation on the first object; based on the second control instruction, information corresponding to the first object is displayed in the first interface.
[0202] In one possible implementation, when the first application is in the first mode, the target control is used to obtain a third control instruction sent by the control device, and the third control instruction is used to instruct a mode switching operation of the first application; based on the third control instruction, the first application is controlled to switch from the first mode to the target mode, and the target mode includes the second mode and the third mode.
[0203] In one possible implementation, when the first application is in the target mode, the target control is used to obtain a fourth control instruction sent by the control device, and the fourth control instruction is used to instruct a mode switching operation of the first application; based on the third control instruction, the first application is controlled to switch from the target mode to the first mode.
[0204] In a possible implementation, when the third control instruction instructs the first application to switch from the first mode to the second mode, the first application is controlled to enter the second mode and a second interface is displayed, wherein the second interface carries a second object;
[0205] or,
[0206] When the third control instruction instructs the first application to switch from the first mode to the third mode, the first application is controlled to enter the third mode and a third interface is displayed, wherein the third interface carries a third object.
[0207] In one possible implementation, when the first application is in the second mode, the target control is used to obtain a fifth control instruction sent by the control device, wherein the fifth control instruction is used to instruct a click / continuous press operation on a sub-element in the second object; based on the fifth control instruction, the information corresponding to the second object is displayed in a sliding manner in the second interface, wherein the target sub-element in the second object triggers a reminder event during the sliding display process.
[0208] In one possible implementation, when the first application is in the third mode, the target control is used to obtain a sixth control instruction sent by the control device, and the sixth control instruction is used to instruct a click operation on a sub-element in the third object; based on the sixth control instruction, a target sub-element in the third object displayed on the third interface is selected to complete the input of the search text.
[0209] In a possible implementation, when it is determined that the second application is in a preset area, a seventh control instruction sent by a control device is obtained; and the second application is controlled based on the seventh control instruction.
[0210] The professionals should further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to the function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0211] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
[0212] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
Claims
1. A method for controlling a display device, characterized in that: include: When it is determined that the first application is in a display state, calling the target control; Using the target control to obtain a control instruction sent by a control device; The first application is controlled based on the control instruction.
2. The method according to claim 1, characterized in that The step of using the target control to obtain a control instruction sent by a control device includes: Acquire a first control instruction sent by a control device using the target control, where the first control instruction is used to instruct to perform a click operation on an icon corresponding to the first application; The controlling the first application based on the control instruction includes: The first application is controlled to start on the display device, and the first application enters a first mode and displays a first interface, wherein the first interface carries a first object.
3. The method according to claim 2, characterized in that The step of using the target control to obtain the control instruction sent by the control device also includes: When the first application is in the first mode, using the target control to obtain a second control instruction sent by a control device, where the second control instruction is used to instruct a move / click operation on the first object; The controlling the first application based on the control instruction further includes: Based on the second control instruction, information corresponding to the first object is displayed in the first interface.
4. The method according to claim 3, characterized in that The step of using the target control to obtain the control instruction sent by the control device also includes: When the first application is in the first mode, using the target control to obtain a third control instruction sent by the control device, wherein the third control instruction is used to instruct a mode switching operation of the first application; The controlling the first application based on the control instruction further includes: Based on the third control instruction, the first application is controlled to switch from the first mode to a target mode, where the target mode includes a second mode and a third mode.
5. The method according to claim 4, characterized in that The step of using the target control to obtain the control instruction sent by the control device also includes: When the first application is in the target mode, using the target control to obtain a fourth control instruction sent by the control device, wherein the fourth control instruction is used to instruct a mode switching operation of the first application; The controlling the first application based on the control instruction further includes: The first application is controlled to switch from the target mode to the first mode based on the third control instruction.
6. The method according to claim 4, characterized in that The controlling the first application to switch from the first mode to the target mode based on the third control instruction includes: When the third control instruction instructs the first application to switch from the first mode to the second mode, the first application is controlled to enter the second mode and display a second interface, wherein the second interface carries a second object; or, When the third control instruction instructs the first application to switch from the first mode to the third mode, the first application is controlled to enter the third mode and a third interface is displayed, wherein the third interface carries a third object.
7. The method according to claim 6, characterized in that The step of using the target control to obtain the control instruction sent by the control device also includes: When the first application is in the second mode, using the target control to obtain a fifth control instruction sent by a control device, wherein the fifth control instruction is used to instruct a click / continuous press operation on a sub-element in the second object; The controlling the first application based on the control instruction further includes: Based on the fifth control instruction, the information corresponding to the second object is displayed in the second interface by sliding. During the sliding display, a target sub-element in the second object triggers a reminder event.
8. The method according to claim 6, characterized in that The step of using the target control to obtain the control instruction sent by the control device also includes: When the first application is in the third mode, using the target control to obtain a sixth control instruction sent by a control device, wherein the sixth control instruction is used to instruct a click operation on a sub-element in the third object; The controlling the first application based on the control instruction further includes: Based on the sixth control instruction, a target sub-element in the third object displayed on the third interface is selected to complete the input of the search text.
9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: When it is determined that the second application is in the preset area, obtaining a seventh control instruction sent by the control device; The second application is controlled based on the seventh control instruction.
10. A display device, characterized in that: include: A processor and a memory, wherein the processor is used to execute a control program of a display device stored in the memory to implement the control method of the display device according to any one of claims 1 to 9.
