Display control method and device, storage medium and electronic equipment

Abstract

The embodiment of the invention provides a display control method and device, a storage medium and electronic equipment. The method comprises the steps that a page currently displayed on a display screen is acquired; acquiring a control mode of the touch remote controller corresponding to the current page according to a preset relationship between the page and the control mode; when the control mode is the first control mode, displaying a mouse cursor on the page; obtaining touch track information on the touch remote controller, determining a cursor movement track according to the touch track information, and controlling the mouse cursor to move on the page according to the cursor movement track; when the control mode is a second control mode, displaying a focus frame at the position of the first control on the page; obtaining touch track information on the touch remote controller, and determining a second control on the page according to the touch track information; and the focus frame is moved to the position of the second control, so that different control modes are used according to different pages, and a user can conveniently control display.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of remote control technology, and in particular, to a display control method, device, storage medium, and electronic device. Background Art

[0002] With the continuous development of technology and the continuous improvement of people's material living standards, various devices such as televisions, computers, and interactive tablets have gradually become popular in people's daily lives. In order to simplify the operation of these devices, remote controls came into being, greatly improving user experience and convenience.

[0003] However, in the related art, the control mode of the remote controller is often fixed at the factory, and the control mode is too simple and inconvenient for users to control. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present application provides a display control method, device, storage and electronic device, which have the advantage of convenient user control.

[0005] According to a first aspect of an embodiment of the present application, a display control method is provided, comprising the following steps:

[0006] Get the page currently displayed on the display screen; the page includes several controls;

[0007] According to the preset relationship between the page and the control method, obtain the control method of the touch remote control corresponding to the current page;

[0008] When the control mode is the first control mode, displaying a mouse cursor on the page; acquiring touch track information on the touch remote controller, determining a cursor movement track according to the touch track information, and controlling the mouse cursor to move on the page according to the cursor movement track;

[0009] When the control mode is the second control mode, a focus frame is displayed at the position of the first control on the page to indicate that the first control is selected; touch track information on the touch remote control is obtained, and the second control on the page is determined according to the touch track information; the focus frame is moved to the position of the second control to indicate that the second control is switched to be selected.

[0010] According to a second aspect of an embodiment of the present application, a display control device is provided, including:

[0011] A page acquisition module is used to acquire the page currently displayed on the display screen; the page includes several controls;

[0012] A control mode acquisition module, used to acquire the control mode of the touch remote controller corresponding to the current page according to the relationship between the preset page and the control mode;

[0013] A first movement module is used to display a mouse cursor on the page when the control mode is the first control mode; obtain touch track information on the touch remote controller, determine a cursor movement track according to the touch track information, and control the mouse cursor to move on the page according to the cursor movement track;

[0014] A second moving module is used to display a focus frame at the position of the first control on the page to indicate that the first control is selected when the control mode is the second control mode; obtain touch track information on the touch remote control, and determine the second control on the page according to the touch track information; move the focus frame to the position of the second control to indicate that the second control is switched to be selected.

[0015] According to a third aspect of an embodiment of the present application, there is provided an electronic device, comprising a processor and a memory; the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the display control method as described above.

[0016] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the display control method as described above is implemented.

[0017] The embodiment of the present application obtains the page currently displayed on the display screen; obtains the control mode of the touch remote control corresponding to the current page according to the preset relationship between the page and the control mode, so that when the control mode is the first control mode, a mouse cursor is displayed on the page; obtains touch trajectory information on the touch remote control, determines the cursor movement trajectory according to the touch trajectory information, and controls the mouse cursor to move along the cursor movement trajectory on the page; when the control mode is the second control mode, a focus frame is displayed at the position of the first control on the page to indicate that the first control is selected; obtains the touch trajectory information on the touch remote control, determines the second control on the page according to the touch trajectory information; moves the focus frame to the position of the second control to indicate that the second control is switched to be selected, so that different control modes are used according to different pages, making it more convenient for users to control the display of the display screen.

[0018] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application.

[0019] For better understanding and implementation, the present invention is described in detail below with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 A schematic diagram of an application scenario of a display control method according to an embodiment of the present application;

[0022] Figure 2 A flow chart of a display control method shown in one embodiment of the present application;

[0023] Figure 3 A flowchart of a display control method according to another embodiment of the present application;

[0024] Figure 4 A flowchart of a method for obtaining a control mode according to an embodiment of the present application;

[0025] Figure 5 This is a schematic diagram of the display effect of the mouse cursor in the first control mode according to an embodiment of the present application;

[0026] Figure 6 This is a schematic diagram of the display effect after the mouse cursor moves according to the touch track information in the first control mode of an embodiment of the present application;

[0027] Figure 7 This is a schematic diagram of the display effect of the focus frame under the second control mode shown in an embodiment of the present application;

[0028] Figure 8 This is a schematic diagram of the display effect after the focus frame moves according to the touch track information in the second control mode according to an embodiment of the present application;

[0029] Fig. 9 A flowchart of a method for determining a second control shown in one embodiment of the present application;

[0030] Fig.10 A flow chart of a method for determining a moving direction shown as an embodiment of the present application;

[0031] Fig.11 A flowchart of a method for determining whether to respond to touch track information according to an embodiment of the present application;

[0032] Fig.12A flowchart of a method for determining whether to respond to touch track information based on response setting information according to an embodiment of the present application;

[0033] Fig.13 A schematic block diagram of a display control device according to an embodiment of the present application;

[0034] Fig.14 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical solution and advantages of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. Wherein, when the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements.

[0036] It should be clear that the implementation methods described in the embodiments described below do not represent all implementation methods consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims. Based on the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.

[0037] The terms used in this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The singular forms of "a" and "the" used in this application are also intended to include plural forms, unless the context clearly indicates other meanings. In addition, in the description of this application, unless otherwise specified, "multiple" refers to two or more. It should also be understood that the term "and / or" used in this article refers to and includes any or all possible combinations of one or more associated listed items, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone; the character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0038] It should be understood that, although the terms first, second, third, etc. may be used in the present application to describe various information, such information should not be limited to these terms, and these terms are only used to distinguish similar objects, and do not have to be used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances. Depending on the context, the words "if" / "if" used in the present application can be interpreted as "at the time of" or "when" or "in response to determination".

[0039] With the continuous development of technology and the continuous improvement of people's material living standards, various devices such as televisions, computers, and interactive tablets have gradually become popular in people's daily lives. In order to simplify the operation of these devices, remote controls have emerged, greatly improving user experience and convenience. However, in related technologies, the control method of the remote control is often fixed at the factory, and the control method is too single and inconvenient for users to control.

[0040] Specifically, the design and implementation of remote controllers in the related art generally include two types: key remote controllers and touch remote controllers. Key remote controllers are generally equipped with physical keys, and users control the display screen by pressing different keys. For example, the direction keys (up, down, left, and right) allow users to move the focus frame on the display screen to select the control on the display screen. The touch remote controller uses a touch pad as an input method, and users control the movement of the mouse cursor on the display screen by sliding their fingers on the touch pad.

[0041] The remote control design in the related technology usually has a control mode determined at the factory, whether it is button-type or touch-type, and the user cannot switch according to actual needs during use. This fixedness limits the adaptability and flexibility of the remote control, especially in changing usage scenarios and user needs. It cannot meet user needs, causing great inconvenience to users.

[0042] The embodiment of the present application is based on a touch remote control and sets different control modes for the display screen. By detecting the page currently displayed on the display screen, different control modes are adaptively used. Compared with the fixed control mode in the related technology, it is more convenient for users to control the display.

[0043] See also Figure 1 , which is a schematic diagram of an application scenario of the display control method of an embodiment of the present application. The application scenario includes a touch remote controller 100 and a terminal device 200.

[0044] The touch remote controller 100 is connected to the terminal device 200 in a wireless manner; the wireless manner includes an infrared connection, a Bluetooth connection, or a local area network connection, etc., which is not limited in this application.

[0045] The touch remote controller 100 includes a touch panel 110, a processor (not shown) and a wireless transmission module (not shown); the touch panel can be a resistive touch panel or a capacitive touch panel or other touch panels capable of detecting touch points. When the touch remote controller 100 is in a normal working state, whenever the user touches the touch panel with a finger, the processor detects the number and position of the touch points, and obtains the touch motion trajectory formed by the sliding of the user's finger according to the sequence of the detected touch points, and sends the touch motion trajectory to the terminal device 200 through the wireless transmission module.

[0046] The terminal device 200 includes a controller (not shown in the figure), a display screen (not shown in the figure) and a wireless receiving module (not shown in the figure); the controller and the wireless receiving module can be integrated into the display screen as a whole with the display screen; the controller and the wireless receiving module can also be independent of the display screen and connected to the display screen respectively. The wireless receiving module receives the touch motion trajectory sent by the wireless sending module of the touch remote controller 100, and sends the touch motion trajectory to the controller, and the controller controls the display of the display screen according to the touch motion trajectory. The hardware pointed to by the terminal device 200 can essentially be a computer device, such as a computer, a television, or an interactive tablet or other smart device.

[0047] For ease of understanding, the embodiments are described exemplarily by taking an interactive tablet as the terminal device 200. The interactive tablet may be an integrated device that controls the content displayed on the display tablet and implements human-computer interaction through touch technology, and integrates one or more functions such as a projector, an electronic whiteboard, a screen, a sound system, a television, and a video conferencing terminal.

[0048] The interactive tablet includes at least one display screen. For example, the interactive tablet is equipped with a display screen with a touch function. From the technical principle, the display screen can be a capacitive screen, a resistive screen, an electromagnetic screen, an infrared screen, and a surface acoustic wave screen. In one embodiment, the user can implement touch operations by touching the display screen with a finger or a stylus. Accordingly, the interactive tablet detects the touch position, and determines a response scheme according to the display content corresponding to the touch position, and then responds to implement the touch function. For example, according to the touch position, the corresponding display content is determined to be a control of a certain function. At this time, the response scheme is to execute the function. It can be understood that in actual applications, users can also implement control operations through keyboards, mice, physical buttons, etc.

[0049] Typically, the interactive tablet is installed with at least one type of operating system, wherein the operating system includes but is not limited to Android system, Linux system and Windows system. In one embodiment, the interactive tablet can install at least one application based on the operating system. In the embodiment, an application with a drawing function is used for exemplary description. For example, an electronic whiteboard application with a drawing function is installed in the interactive tablet. Among them, the application can be an application that comes with the operating system, or it can be an application downloaded from a third-party device or server. Optionally, in addition to the drawing function, the application also has other editing functions, such as writing, inserting tables, inserting pictures, inserting multimedia, inserting graphics, drawing tables and the like.

[0050] The following will be combined with the attached Figures 2 to 12 , the display control method provided in the embodiment of the present application is introduced in detail.

[0051] See also Figure 2 The display control method of the embodiment of the present application includes the following steps:

[0052] Step S101: obtaining the page currently displayed on the display screen; the page includes several controls;

[0053] Step S102: acquiring the control mode of the touch remote controller corresponding to the current page according to the preset relationship between the page and the control mode;

[0054] Step S103: when the control mode is the first control mode, displaying a mouse cursor on the page; acquiring touch track information on the touch remote controller, determining a cursor movement track according to the touch track information, and controlling the mouse cursor to move on the page according to the cursor movement track;

[0055] Step S104: When the control mode is the second control mode, a focus frame is displayed at the position of the first control on the page to indicate that the first control is selected; touch track information on the touch remote control is obtained, and the second control on the page is determined according to the touch track information; the focus frame is moved to the position of the second control to indicate that the second control is switched to be selected.

[0056] The embodiment of the present application obtains the page currently displayed on the display screen; obtains the control mode of the touch remote control corresponding to the current page according to the preset relationship between the page and the control mode, so that when the control mode is the first control mode, a mouse cursor is displayed on the page; obtains touch trajectory information on the touch remote control, determines the cursor movement trajectory according to the touch trajectory information, and controls the mouse cursor to move along the cursor movement trajectory on the page; when the control mode is the second control mode, a focus frame is displayed at the position of the first control on the page to indicate that the first control is selected; obtains the touch trajectory information on the touch remote control, determines the second control on the page according to the touch trajectory information; moves the focus frame to the position of the second control to indicate that the second control is switched to be selected, so that different control modes are used according to different pages, making it more convenient for users to control the display of the display screen.

[0057] The display control method provided in the embodiment of the present application uses a terminal device as an execution subject; the terminal device is connected to a touch remote control; the terminal device includes a display screen; the following describes each step in detail by taking the terminal device as an interactive tablet as an example.

[0058] For step S101, the page currently displayed on the display screen is obtained; the page includes several controls.

[0059] In an optional embodiment, the interactive tablet can obtain which page is displayed on the current display screen through the window manager, where the window manager is responsible for managing the windows and desktop space in the user interface of the interactive tablet, so that the window manager can determine which window is displayed on the current display screen.

[0060] In another optional embodiment, the interactive tablet can query the currently displayed page through an API (application programming interface) provided by the operating system.

[0061] In yet another optional embodiment, the interactive tablet captures the image displayed on the display screen at preset time intervals, and determines the currently displayed page by analyzing the image.

[0062] See also Figure 3 In an optional embodiment, before the step of obtaining the page currently displayed on the display screen in step S101, the method further includes:

[0063] Step S1011: Acquire the control mode of the touch remote controller;

[0064] Step S1012: when the control mode of the touch remote controller is the first mode, obtaining the page currently displayed on the display screen;

[0065] Step S1013: when the control mode is the second mode, displaying a mouse cursor on the page; acquiring touch track information on the touch remote controller, determining a cursor movement track according to the touch track information, and controlling the mouse cursor to move on the page according to the cursor movement track;

[0066] Step S1014: When the control mode is the third mode, a focus frame is displayed at the position of the first control on the page to indicate that the first control is selected; touch track information on the touch remote control is obtained, and the second control on the page is determined according to the touch track information, and the focus frame is moved to the position of the second control to indicate that the second control is switched to be selected.

[0067] The touch remote controller of the embodiment of the present application realizes multiple control modes, thereby making it more convenient for users to control the interactive tablet.

[0068] The control mode refers to the way the touch remote control operates the interactive tablet.

[0069] See also Figure 4 In an optional embodiment, for step S1011, the step of obtaining the control mode of the touch remote controller includes:

[0070] Step S111: In response to the triggering operation of the mode selection control, a control mode list is displayed.

[0071] Step S112: using a control mode selected in the control mode list as a control mode of the touch remote controller.

[0072] It can be understood that a mode selection control is provided on the interactive tablet; the user can click on the interactive tablet to trigger the mode selection control, and the interactive tablet responds to the triggering operation of the mode selection control and displays a control mode list on the display screen of the interactive tablet; the control mode list includes several modes, and the user can select any remote control mode as the control mode of the remote control touch controller.

[0073] The several modes in the control mode list may include a first mode, a second mode and a third mode.

[0074] The second mode is a mouse control mode, which is used to simulate mouse control operations, for example, a mouse cursor is displayed on the page displayed on the display screen, and the mouse cursor moves along the touch track of the user on the touch remote control. It can be understood that the second mode is equivalent to the first control mode in step S103.

[0075] The third mode is a focus frame control mode, which is used to simulate the direction key control operation. For example, on the page displayed on the display screen, a focus frame is displayed at the control position on the page, and the focus frame moves on each control along the touch track of the touch remote controller. It can be understood that the third mode is equivalent to the second control mode in step S103.

[0076] The first mode is an automatic control mode, which can automatically switch the control mode according to the page currently displayed on the display screen. For example, according to different pages, it automatically switches to the mouse control mode (first mode) or the focus frame control mode (second mode).

[0077] It is understandable that the interactive tablet can pre-set the remote control mode by default. For example, the remote control mode is pre-set to the first mode by default. After the touch remote control is connected to the interactive tablet, the touch remote control uses the first mode to control the interactive tablet. Thereafter, the user switches the touch remote control to the second mode or the third mode by triggering the mode selection control.

[0078] In step S102, according to the preset relationship between the page and the control method, the control method of the touch remote controller corresponding to the current page is obtained.

[0079] It is understandable that the relationship between the page and the control mode can be pre-set on the interactive tablet, and then different control modes can be automatically switched according to different pages displayed on the display screen.

[0080] In an optional embodiment, the pages displayed on the display screen may be different pages of the same application. In this case, the control methods of the touch remote controller will be different for different pages of the same application.

[0081] In the process of implementing the present application, the applicant discovered that: when the display screen displays the home page and setting page of the application, since the layout of the various controls in the home page and the setting page is relatively regular, the focus frame control method (the second control method) can be used for precise control; when the display screen displays other pages of the application, since the layout of the various controls on other pages is relatively irregular, the mouse control method (the first control method) is used to quickly select the control controls to achieve quick and convenient control.

[0082] In another optional embodiment, the pages displayed on the display screen may be pages of different applications. In this case, different applications will have different control methods of the touch remote controller.

[0083] In the process of implementing this application, the applicant discovered that: when the application displayed on the display screen is a browser, based on the browser's quick browsing characteristics, it is more convenient to operate using the mouse control method (first control method); when the application displayed on the display screen is an application that requires filtering controls one by one, such as a video application, in order to facilitate the filtering of videos one by one, the focus frame control method (second control method) is used to implement the operation.

[0084] The embodiment of the present application uses a mode selection control to allow the user to select the required control mode according to actual needs.

[0085] For step S103, when the control mode is the first control mode, a mouse cursor is displayed on the page; touch track information on the touch remote controller is obtained, a cursor movement track is determined according to the touch track information, and the mouse cursor is controlled to move on the page according to the cursor movement track.

[0086] The first control mode is the mouse control mode, which is the aforementioned second mode, and is used to simulate the mouse control operation. In the first control mode, a mouse cursor is displayed on the page displayed on the display screen. The shape of the mouse cursor is not limited, and can be an arrow, an asterisk, or other symbols, such as Figure 5 As shown, on the display screen of the interactive tablet 200, the shape of the mouse cursor 210 is an arrow on the currently displayed page for exemplary description.

[0087] like Figure 6As shown, the touch remote controller 100 is provided with a touch panel 110, and the user's finger touches the touch panel 110 of the remote controller 100 to trigger a touch track 111. The touch remote controller 100 obtains the touch track information of the user's finger on the touch panel 110, and sends the touch track information to the interactive tablet 200. After the interactive tablet 200 obtains the touch track information, it determines the cursor movement track of the mouse cursor 210 according to the preset mapping relationship between the track coordinates of the touch panel and the track coordinates of the display screen, thereby controlling the mouse cursor 210 to move according to the cursor movement track, and obtaining the moved mouse cursor 210.

[0088] For step S104, when the control mode is the second control mode, a focus frame is displayed at the position of the first control on the page to indicate that the first control is selected; touch track information on the touch remote control is obtained, and the second control on the page is determined according to the touch track information; the focus frame is moved to the position of the second control to indicate that the second control is switched to be selected.

[0089] The second control mode is the focus frame control mode, which is the aforementioned third mode, which is used to simulate the direction key control operation. In the second control mode, the interactive tablet will select the first control and display the focus frame on the first control. Among them, the first control can be the control sorted in the first position on the page, or it can be the control sorted in the most conspicuous position, or a preset control, etc., which is not limited in this application. The style of the focus frame can be a circular frame, a square frame, etc. that highlights the control. The color of the focus frame is usually different from the border color of the interface theme or the control to attract the user's attention; the focus frame can be an additional frame set on the basis of the control border; the focus frame can also be in the form of highlighting the border, or the focus frame can be in the form of using other bright colors for the border.

[0090] like Figure 7 As shown, on the display screen of the interactive tablet 200, on the currently displayed page, the shape of the focus frame 220 is taken as a square frame surrounding the highlighted control as an example for exemplary description.

[0091] like Figure 8 As shown, the touch remote controller 100 is provided with a touch panel 110, and the user's finger touches the touch panel 110 of the remote controller 100 to trigger a touch track 111. The touch remote controller 100 obtains the touch track information of the user's finger on the touch panel 111, and sends the touch track information to the interactive tablet 200. After the interactive tablet 200 obtains the touch track information, it determines that the control below the first control is the second control, and then moves the focus frame 220, and displays the focus frame 220 at a position surrounding the second control.

[0092] See also Fig. 9In an optional embodiment, the step of determining the second control on the page according to the touch track information in step S104 includes:

[0093] Step S1041: Determine the moving direction according to the touch track information.

[0094] Step S1042: Determine a second control on the page according to the moving direction, the position of the first control, and the positional relationship between the controls on the page.

[0095] The moving direction includes moving upward, moving downward, moving leftward or moving rightward.

[0096] In one embodiment, the coordinates of the touch point at different time points are compared according to the touch trajectory information to determine the moving direction. If the Y coordinate of the touch point changes from y1 to y2, and y2-y1>0, it can be determined to be moving upward; if y2-y1<0, it is moving downward. If the X coordinate of the touch point changes from x1 to x2, and x2-x1>0, it can be determined to be moving to the right; if x2-x1<0, it is moving to the left.

[0097] In another embodiment, the moving direction of the touch point is determined by comparing the speed of the touch point on the X-axis and the Y-axis according to the touch track information. For example, if the speed on the X-axis is positive, it means moving to the right; if it is negative, it means moving to the left.

[0098] Optionally, the interactive tablet can obtain the positional relationship of each control on the page and the position of the first control by obtaining the page layout file. Optionally, the interactive tablet can obtain information of all controls on the page through a UI (graphical interface) automated testing tool, and then obtain the positional relationship of each control on the page and the position of the first control based on the information analysis of all controls on the page.

[0099] It is understandable that, according to the position of the first control and the positional relationship between the controls on the page, controls located in four directions of left, right, top and bottom of the first control can be obtained, and then the second control can be further obtained according to the moving direction.

[0100] The embodiment of the present application determines the moving direction according to the touch track information; determines the second control on the page according to the moving direction, the position of the first control and the positional relationship between the controls on the page, thereby realizing quick determination of the second control.

[0101] See also Fig.10 In an optional embodiment, the moving direction includes moving upward, moving downward, moving leftward or moving rightward; the step of determining the moving direction according to the touch track information in step 1041 includes:

[0102] Step S1411: acquiring a first relative displacement of the touch track in the horizontal direction and a second relative displacement of the touch track in the vertical direction according to the touch track information.

[0103] It can be understood that the first relative displacement of the touch track in the horizontal direction is the difference between the x-axis coordinates of the last touch point and the first touch point of the touch track; the first relative displacement of the touch track in the horizontal direction is the difference between the y-axis coordinates of the last touch point and the first touch point of the touch track. For example, assuming that a rectangular coordinate system is established with the lower left corner of the touch pad as the origin, if the coordinates of the first touch point of the touch track are (x1, y1), and the coordinates of the last touch point of the touch track are (x2, y2), then the first relative displacement is x2-x1, and the second relative displacement is y2-y1.

[0104] Considering that the touch track of the user on the touchpad is generally not a pure horizontal or vertical movement, or a pure upward or downward direction, but is usually an inclined track, for this reason, the present application further determines the user's intention by comparing the absolute values ​​of the first relative displacement of the touch track in the horizontal direction and the second relative displacement of the touch track in the vertical direction.

[0105] Step S1412: When the absolute value of the first relative displacement is greater than the absolute value of the second relative displacement, and the first relative displacement is greater than 0, the moving direction is determined to be moving to the right; when the absolute value of the first relative displacement is greater than the absolute value of the second relative displacement, and the first relative displacement is less than 0, the moving direction is determined to be moving to the left.

[0106] Taking the first relative displacement as x2-x1 and the second relative displacement as y2-y1 as an example, if the absolute value of x2-x1 is greater than the absolute value of y2-y1, and x2-x1 is greater than 0, then the moving direction is determined to be horizontal right movement; if the absolute value of x2-x1 is greater than the absolute value of y2-y1, and x2-x1 is less than 0, then the moving direction is determined to be horizontal left movement.

[0107] Step S1413: When the absolute value of the first relative displacement is smaller than the absolute value of the second relative displacement, and the second relative displacement is greater than 0, the moving direction is determined to be downward movement; when the absolute value of the first relative displacement is smaller than the absolute value of the second relative displacement, and the first relative displacement is less than 0, the moving direction is determined to be upward movement.

[0108] Taking the first relative displacement as x2-x1 and the second relative displacement as y2-y1 as an example, if the absolute value of x2-x1 is smaller than the absolute value of y2-y1, and y2-y1 is greater than 0, the moving direction is determined to be downward; if the absolute value of x2-x1 is greater than the absolute value of y2-y1, and y2-y1 is less than 0, the moving direction is determined to be upward.

[0109] It can be understood that when the absolute value of the first relative displacement is equal to the absolute value of the second relative displacement, the first relative displacement or the second relative displacement can be selected for further judgment.

[0110] Optionally, when the absolute value of the first relative displacement is equal to the absolute value of the second relative displacement, if the first relative displacement is greater than 0, the direction of movement is determined to be rightward movement; when the absolute value of the first relative displacement is equal to the absolute value of the second relative displacement, if the first relative displacement is less than 0, the direction of movement is determined to be leftward movement. For example, taking the first relative displacement as x2-x1 and the second relative displacement as y2-y1 as an example, if the absolute value of x2-x1 is equal to the absolute value of y2-y1, and x2-x1 is greater than 0, the direction of movement is determined to be horizontal rightward movement; if the absolute value of x2-x1 is equal to the absolute value of y2-y1, and x2-x1 is less than 0, the direction of movement is determined to be horizontal leftward movement.

[0111] Optionally, when the absolute value of the first relative displacement is equal to the absolute value of the second relative displacement, if the second relative displacement is greater than 0, the moving direction is determined to be upward movement; when the absolute value of the first relative displacement is equal to the absolute value of the second relative displacement, if the second relative displacement is less than 0, the moving direction is determined to be downward movement. Taking the first relative displacement as x2-x1 and the second relative displacement as y2-y1 as an example, if the absolute value of x2-x1 is equal to the absolute value of y2-y1, and y2-y1 is greater than 0, the moving direction is determined to be downward movement; if the absolute value of x2-x1 is equal to the absolute value of y2-y1, and y2-y1 is less than 0, the moving direction is determined to be upward movement.

[0112] The present application determines the moving direction by comparing the magnitudes of the first relative displacement of the touch track in the horizontal direction and the second relative displacement of the touch track in the vertical direction, thereby realizing accurate and quick determination of the moving direction.

[0113] See also Fig.11 In an optional embodiment, before the step of determining the second control on the page according to the touch track information in step S104, the method includes:

[0114] Step S141: determining the time interval between the touch track information currently acquired and the touch track information acquired last time.

[0115] Step S142: when the time interval is less than the preset time interval, the currently acquired touch track information is discarded.

[0116] Step S143: when the time interval is greater than or equal to the preset time interval, determining the second control on the page according to the currently acquired touch track information.

[0117] It is understandable that, based on the limitations of the touch remote control's own hardware, the touch remote control usually collects the touch track on the touchpad at a certain time interval and uploads it to the terminal device. When the user slides and touches on the touchpad, he may slide continuously based on habit. Then, when the user continues to slide and touch on the touchpad, the touch remote control may actually collect touch track information twice or even more times. For this reason, the present application detects the time interval for acquiring two adjacent touch track information. If the time interval is less than the preset time interval, that is, based on the same sliding touch, two or more continuous touch track information is detected, then after responding to a mobile control last time, the subsequent two or more continuous touch track information will be discarded and no response will be made, thereby achieving precise control of the focus cursor.

[0118] See also Fig.12 In an optional embodiment, before the step of determining the time interval between the currently acquired touch track information and the last acquired touch track information in step S141, the following steps are included:

[0119] Step S41: Acquire response setting information.

[0120] It is understandable that a response setting control can also be set on the interactive tablet. The user can touch the response setting control to display a response setting list. The response setting list can include a single response and multiple responses. The user can select one of the settings as the response setting information.

[0121] Step S42: when the response setting information is for a single response, determining the time interval between the currently acquired touch track information and the last acquired touch track information.

[0122] When the response setting information is used for a single response, as shown in the aforementioned steps S151 to S153, the user's continuous touch sliding on the touch panel will only respond once, realizing a single movement of the focus coordinates.

[0123] Step S43: when the response setting information is used for multiple responses, a second control on the page is determined according to the currently acquired touch track information.

[0124] When the response setting information is used for multiple responses, even if the user continues to touch and slide on the touchpad, the interactive tablet will move the focus cursor according to the touch track information obtained each time, so that convenient control of the display can be achieved through the focus cursor.

[0125] The embodiment of the present application obtains response setting information. When the response setting information is used for a single response, the time interval between the currently obtained touch track information and the last obtained touch track information is determined; when the response setting information is used for multiple responses, the second control on the page is determined according to the currently obtained touch track information, thereby facilitating the user to set the touch response according to actual needs and adapting to the needs of the user.

[0126] See also Figure 3 , which is a schematic diagram of the structure of a display device provided in the second embodiment of the present application. The display control device 200 provided in the embodiment of the present application includes:

[0127] The page acquisition module 201 is used to acquire the page currently displayed on the display screen; the page includes several controls;

[0128] The control mode acquisition module 202 is used to acquire the control mode of the touch remote controller corresponding to the current page according to the relationship between the preset page and the control mode;

[0129] The first movement module 203 is used to display the mouse cursor on the page when the control mode is the first control mode; obtain touch track information on the touch remote control, determine the cursor movement track according to the touch track information, and control the mouse cursor to move on the page according to the cursor movement track;

[0130] The second moving module 204 is used to display a focus frame at the position of the first control on the page to indicate that the first control is selected when the control mode is the second control mode; obtain touch track information on the touch remote control, and determine the second control on the page according to the touch track information; move the focus frame to the position of the second control to indicate that the second control is switched to be selected.

[0131] It should be noted that when the display control device provided in the second embodiment of the present application executes the display control method, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the display control device provided in the second embodiment of the present application and the display control method of the first embodiment of the present application are of the same concept. The implementation process thereof is detailed in the method embodiment and will not be repeated here.

[0132] The embodiment of the display control device of the second embodiment of the present application can be applied to a computer device, such as an interactive tablet, and the device embodiment can be implemented by software, or by hardware or a combination of software and hardware. Taking software implementation as an example, as a device in a logical sense, it is formed by the processor of the file processing in which it is located reading the corresponding computer program instructions in the memory and running. From a hardware perspective, the computer device in which it is located may include a processor and a memory, and the processor and the memory are connected via a data bus or other known methods.

[0133] See also Fig.14 , is a schematic diagram of the structure of an electronic device provided in the third embodiment of the present application. Fig.14 As shown, the electronic device 300 can be specifically a computer, a mobile phone, a tablet computer, an interactive tablet, etc. In an exemplary embodiment of the present application, the electronic device 300 is an interactive tablet, and the electronic device 300 may include: at least one processor 310, at least one memory 320, at least one display 330, at least one network interface 340, a user interface 350 and at least one communication bus 360.

[0134] The communication bus 360 is used to realize the connection and communication between these components.

[0135] The user interface 350 may include a display screen and a camera; the user interface 350 may also include a standard wired interface and a wireless interface.

[0136] The network interface 340 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).

[0137] Among them, the processor 310 may include one or more processing cores. The processor 310 uses various interfaces and lines to connect various parts within the entire electronic device 300, and executes various functions and processes data of the electronic device 300 by running or executing instructions, programs, code sets or instruction sets stored in the memory 320, and calling data stored in the memory 320. Optionally, the processor 310 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 310 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed by the display layer; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 310, but implemented separately by a chip.

[0138] Among them, the memory 320 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 320 includes a non-transitory computer-readable storage medium. The memory 320 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 320 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 320 may also be optionally at least one storage device located away from the aforementioned processor 310. As Fig.14 As shown, the memory 320 as a computer storage medium may include an operating system, a network communication module, and a user.

[0139] exist Fig.14In the electronic device 300 shown, the user interface 350 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 310 can be used to call the operating application of the smart interactive tablet stored in the memory 320, for example: the program of the display control method; and execute the relevant operations of any display control method in the above-mentioned embodiments, with corresponding functions and beneficial effects.

[0140] The fourth embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and the instructions are suitable for being loaded by a processor and executing the steps of the display control method shown above. The specific execution process can refer to the specific description shown in the embodiment, and will not be repeated here. The device where the storage medium is located can be a personal computer, a laptop computer, a smart phone, a tablet computer and other electronic devices.

[0141] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can refer to the partial description of the method embodiments. The device embodiments described above are merely schematic, wherein the components described as separate parts may or may not be physically separated, and the parts displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present application scheme. A person of ordinary skill in the art can understand and implement it without paying any creative work.

[0142] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0143] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the function selected in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 function selected in a box or multiple boxes.

[0144] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 steps for the function selected in a box or multiple boxes.

[0145] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0146] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0147] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0148] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0149] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A display control method, characterized in that: The steps include: Get the page currently displayed on the display screen; the page includes several controls; According to the preset relationship between the page and the control method, obtain the control method of the touch remote control corresponding to the current page; When the control mode is the first control mode, displaying a mouse cursor on the page; Acquire touch track information on the touch remote controller, determine a cursor movement track according to the touch track information, and control the mouse cursor to move on the page according to the cursor movement track; When the control mode is the second control mode, a focus frame is displayed at the position of the first control on the page to indicate that the first control is selected; Acquire touch track information on the touch remote control, and determine a second control on the page according to the touch track information; move the focus frame to the position of the second control to indicate that the second control is switched and selected.

2. The display control method according to claim 1, characterized in that: The step of determining the second control on the page according to the touch track information includes: Determining a moving direction according to the touch track information; A second control on the page is determined according to the moving direction, the position of the first control, and the positional relationship between the controls on the page.

3. The display control method according to claim 2, characterized in that: The moving direction includes moving upward, moving downward, moving leftward or moving rightward; The step of determining the moving direction according to the touch track information includes: Acquire a first relative displacement of the touch track in a horizontal direction and a second relative displacement of the touch track in a vertical direction according to the touch track information; When the absolute value of the first relative displacement is greater than the absolute value of the second relative displacement, and the first relative displacement is greater than 0, the moving direction is determined to be moving to the right; when the absolute value of the first relative displacement is greater than the absolute value of the second relative displacement, and the first relative displacement is less than 0, the moving direction is determined to be moving to the left; When the absolute value of the first relative displacement is smaller than the absolute value of the second relative displacement, and the second relative displacement is greater than 0, the moving direction is determined to be downward movement; when the absolute value of the first relative displacement is smaller than the absolute value of the second relative displacement, and the first relative displacement is less than 0, the moving direction is determined to be upward movement.

4. The display control method according to claim 1, characterized in that: Before the step of determining the second control on the page according to the touch track information, the method includes: Determine the time interval between the touch track information currently acquired and the touch track information acquired last time; When the time interval is less than the preset time interval, the touch track information currently acquired is discarded; When the time interval is greater than or equal to the preset time interval, a second control on the page is determined according to the touch track information currently acquired.

5. The display control method according to claim 4, characterized in that: Before the step of determining the time interval between the touch track information currently acquired and the touch track information acquired last time, the method includes: Get response setting information; When the response setting information is used for a single response, determining a time interval between the touch track information currently acquired and the touch track information acquired last time; When the response setting information is used for multiple responses, a second control on the page is determined according to the currently acquired touch track information.

6. The display control method according to any one of claims 1 to 5, characterized in that: Before the step of obtaining the page currently displayed on the display screen, the method further includes: Obtaining the control mode of the touch remote controller; When the control mode of the touch remote controller is the first mode, obtaining a page currently displayed on the display screen; When the control mode is the second mode, displaying a mouse cursor on the page; acquiring touch track information on the touch remote controller, determining a cursor movement track according to the touch track information, and controlling the mouse cursor to move on the page according to the cursor movement track; When the control mode is the third mode, a focus frame is displayed at the position of the first control on the page to indicate that the first control is selected; touch track information on the touch remote control is obtained, and the second control on the page is determined according to the touch track information; the focus frame is moved to the position of the second control to indicate that the second control is switched to be selected.

7. The display control method according to claim 6, characterized in that: The step of obtaining the control mode of the touch remote controller includes: In response to a mode selection operation, displaying a mode list; The control mode selected by the user in the mode list is used as the control mode of the touch remote controller.

8. A display control device, characterized in that: include: A page acquisition module is used to acquire the page currently displayed on the display screen; the page includes several controls; A control mode acquisition module, used to acquire the control mode of the touch remote controller corresponding to the current page according to the relationship between the preset page and the control mode; A first moving module, used for displaying a mouse cursor on the page when the control mode is the first control mode; Acquire touch track information on the touch remote controller, determine a cursor movement track according to the touch track information, and control the mouse cursor to move on the page according to the cursor movement track; A second moving module, used for controlling the position of the first control on the page to display a focus frame to indicate that the first control is selected when the control mode is the second control mode; Acquire touch track information on the touch remote control, and determine a second control on the page according to the touch track information; move the focus frame to the position of the second control to indicate that the second control is switched and selected.

9. An electronic device comprising a processor and a memory; characterized in that: The memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the display control method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the display control method according to any one of claims 1 to 7 is implemented.

Images