Television remote control method based on potential field technology

Abstract

The invention provides a method for conveniently, quickly and accurately remotely controlling a television screen through mobile products such as a television special remote controller, a smart watch and a mobile phone or other touch screen (panel) devices by utilizing technologies of digital communication, screen (panel) touch and display and the like. The potential field of a controllable target component is used as a basic object of remote control decision and touch screen operation, according to page potential field layout characteristics, a touch component of touch screen remote control equipment and the potential field and touch screen gestures of the controllable component are utilized, and a remote control strategy of mutual cooperation of simple click positioning and touch screen sliding positioning is adopted. And various remote control functions of the target component of the television screen are realized. When the potential field technology is applied to large-screen pointing technologies such as flying mice and air gestures, the speed and accuracy can be effectively improved. According to the invention, a solution is provided for compatible operation of four remote control modes including a touch screen, keys, flying mice and air gestures.

Description

TECHNICAL FIELD

[0001] The present application relates to the application and improvement of television and its remote control, and is a convenient, fast and accurate television remote control method for television screen through television special remote control, smart watch and mobile phone and other mobile products, or other touch screen devices, by using digital communication, screen touch, electronic sensor and display technology. BACKGROUND

[0002] Today, with the wide application of mobile products such as mobile phones and tablet computers, home televisions are undergoing serious challenges. The screen of the television is large, the information carried by the page is large, and the damage to the eyesight is small, which has been deeply welcomed by families for many years. However, in recent years, televisions have gradually been unpopular, and many families regard them as decorations and rarely use them. The primary problem is that the television is stiff and the man-machine interaction is difficult.

[0003] Since its inception, the television has always existed as a single play type public product. As an important link of man-machine interaction, the remote control technology has always adopted a passive selection mode, which is single and mechanical. Users can only watch, but cannot participate.

[0004] Compared with mobile products with touch display screens, home televisions are obviously at a disadvantage in touch screen applications due to the lack of touch screens. Many operations such as "point to go" and "drag to go" that can be completed on mobile phones cannot be realized on televisions. This makes many software running on mobile products unable to achieve the same good effect and user experience on televisions, making it difficult to run on televisions.

[0005] There was an early "mouse" remote control method that used the built-in sensor of a mobile product to control the rapid movement of the screen cursor or component focus by rotating or tilting. Recently, the absolute pointing remote control and star flash pointing remote control released in China are all using inertial measurement units (IMU) to improve the wireless communication technology between the remote control and the television, enhance the precision positioning and anti-interference ability, realize the absolute pointing interaction of the television "pointing to where", and complete the operations of sliding, clicking and dragging. When working, the user can shake the remote control to control the movement of the screen cursor dot. When the dot points to a target, the button is used to confirm the selection.

[0006] The above-mentioned way of controlling the screen cursor movement through the remote controller is collectively referred to as the mouse technology. This method is very suitable for use in reporting, demonstration, teaching and the like, but for most home users, because the mouse needs a cursor movement positioning process, not only the experience is affected, but also the requirements for communication speed and other hardware configurations are higher. In actual operation, it is not as convenient as the touch screen mode of mobile products such as mobile phones. Even when the number of targets is not large, it is not as fast as the traditional key mode. For example, when there are only two selection buttons on the page, using the key mode, it is likely to only need one key.

[0007] In the aspect of remote control by air gestures, with the help of artificial intelligence, some functions have been realized on some high-end televisions. The main applications include air gesture mute, play / pause, confirmation, return, etc., but there is still no key breakthrough in the main application fields such as television navigation and video playback.

[0008] Compared with the four television remote control modes of touch screen, key, mouse and air gesture, the touch screen mode is more suitable for use in page navigation, video playback and the like. Functions such as zooming, writing and drawing, as well as other single-finger, double-finger, palm center and other gesture operations can only be directly and quickly completed by the touch screen mode. However, in the case of roadshow, teaching demonstration and the like, the on-site feeling and effect are not as good as the mouse.

[0009] Using the touch screen mode, a small touchpad is installed on the television remote controller. Since it cannot be integrated with the display screen like the screen of a mobile phone, the touch point cannot absolutely match the control object, so it is difficult to achieve "point-to-point". This is also the biggest obstacle for non-touch screen televisions to use the touch screen mode for many years.

[0010] Unlike mobile phones and computers, televisions have large screens and fixed positions, and the audience is of all ages. With the development of information technology, televisions are gradually changing from single-play products to interactive products, providing more suitable and detailed personalized information services to users while providing audio and video services. In particular, in the application fields of video resource distribution, education and training, talent display, sports and health, game entertainment, care and protection, there are different individual needs and even different remote control methods. The single key remote control method that has been used for decades has become difficult to adapt. Therefore, changing the remote control method and improving the interactive ability of televisions is also required by the development of the times.

[0011] The new generation of remote control technology should not only meet the needs of various groups of people using televisions at present, but also provide strong remote control support for the more prosperous television ecological construction in the future.

[0012] Therefore, it is very important and has very great practical significance to develop an efficient touch screen technology which can be compatible with the key, mouse and other modes, and expand the application of the air gesture, so as to simply, quickly and accurately remotely control the television screen. SUMMARY

[0013] The purpose of the present application is to provide a method for realizing convenient, fast and accurate television remote control on a television screen by using digital communication, screen (panel) touch and display technologies, through a television special remote controller, a smart watch, a mobile phone and other mobile products, or other touch screen (panel) devices.

[0014] The technical solution adopted by the present application to solve the technical problem is: a television remote control method based on potential field technology, in the design of various television pages such as program navigation, video playback, education and training, sports and health, and game scenarios, the non-controllable screen area outside the controllable components required to complete the remote control task is reasonably allocated to each controllable component, and a separate potential field is constructed for each controllable component, thereby maximizing the screen space occupied by each controllable component, and providing convenience for screen remote control activities such as searching, moving, replacing, labeling and zooming of the controllable components.

[0015] The potential field has the following basic elements:

[0016] Reasonable: the combination and construction of the controllable components and the potential field are in line with user cognitive common sense;

[0017] Independent: each controllable component must have and only have one potential field, and there is no intersection with other potential fields;

[0018] Full: the potential field of all controllable components in the screen fills the entire television screen.

[0019] When performing remote control operations on a television, the potential field of the controllable components of the television is taken as the basic object of operation and control, and is associated with the controllable components that own the potential field, forming a unified management pattern of controllable components and their potential fields without gaps.

[0020] The potential field can be rectangular, or other shapes and styles that are convenient to construct and use.

[0021] Potential distance is a potential field in the form of a rectangle. It is the largest upright rectangle that can be generated after the minimum upright rectangle (original rectangle) surrounding the controllable component is extended in all directions without obstacles, with the television screen area as the boundary.

[0022] The potential field technology can maximize the operable range of each controllable component. Each click must hit a specific component, which also greatly improves the accuracy of screen clicking.

[0023] According to the potential field layout characteristics of different scenes of the page, using the touch screen (panel) of the remote control device, and the potential field and operation gestures of the controllable components, adopting simple click positioning and touch screen sliding positioning strategies, multiple remote control functions of the controllable components of the television screen are realized.

[0024] The above controllable components are buttons, pictures, scenes and other components on the television page that can react to click, move, replace, mark, zoom and other remote control commands. Other screen areas except the controllable components are called non-controllable areas.

[0025] The above remote control device includes a television dedicated remote control, a smart watch, a mobile phone and other mobile products, and other devices with electronic sensors such as touch screens and wireless communication capabilities with the television.

[0026] The above multiple remote control functions include opening, dragging, zooming, full-screen translation, row and column translation, volume control, returning, voice, and power on / off.

[0027] The television described in the specification can be a television main machine or a television box connected thereto and having an independent operating system. The television box described in the specification includes a smart set-top box and other smart television boxes. The touch screen described in the specification refers to a touch panel and a touch screen. The difference between the two is that the latter has a display screen. The touch screen area described in the specification refers to the effective touch area on the touch screen or touch panel of the touch screen remote control device. The television screen or television screen area described in the specification is usually the screen area when it is in an active state. When multiple application scene split screen display occurs, it is the currently activated screen display area.

[0028] In the touch screen mode, the display dot matrix of the television screen is converted into the horizontal and vertical dot matrix number of the touch screen area according to the proportion, so as to meet the standard analog projection area of the television screen with different length-width size proportion and density, which has a fixed size proportion and density of the touch screen. When the display dot matrix of the television screen is X*Y (horizontal*vertical, light point unit), and the touch screen area is x*y (horizontal*vertical, touch point unit), a potential distance rectangle with a left top corner position of x1, y1 and side lengths of m1, n1 in the television screen display area can be mapped into a potential distance rectangle with a left top corner position of x2, y2 and side lengths of m2, n2 in the touch screen area.

[0029] x2 = [x1*(x / X)], y2 = [y1*(y / Y)];

[0030] m2 = [m1*(x / X)], n2 = [n1*(y / Y)].

[0031] According to the above formula, when the number of controllable components is large, m1 and n1 are small enough, and the values of x / X and y / Y are also small, the values of m2 and n2 after rounding can be zero, and even several controllable components on the screen can share a point in the touch screen area. This screen mapping state is called asymmetric mapping. Conversely, it is symmetric mapping.

[0032] When the resolution of the television screen is high, the above-mentioned television screen display lattice XY can be simplified by conversion, so that the values of x / X and y / Y are within a suitable range, without affecting the expression of all controllable components in the page, to meet the needs of unified and rapid processing of potential distance processing system for various screen display resolution television products. After that, all operations related to the position, size, and potential distance of the controllable component are based on the simplified data, i.e. the simplified data. The simplified virtual grid is called the simplified grid.

[0033] In program navigation, recording and file display, as well as various application scenarios such as video playing and television teaching, symmetric mapping is used. Clicking any position on the touch screen area, the system will refine the contact surface between the finger and the touch screen into a point, which can be sent to the television through the wireless communication link between the touch screen remote control and the television. Through the potential field layout characteristics of each target component in the simplified grid, the television remote control management system can capture the potential field where the position is located and the potential field components.

[0034] The above-mentioned simple click positioning refers to directly clicking the touch screen potential distance in the touch screen area to achieve one-click fast positioning of the potential distance component. Since all potential distances fill the entire television screen, when the television screen scene presents a simple distribution state, the simple click method can be used to achieve fast positioning of all or part of the controllable components, especially the potential distances located at the corners and periphery of the television screen. Since the screen corner area is more easily distinguished than the center area, the one-hit rate will be significantly improved. After clicking the touch screen, the potential distance component clicked is focused and enters the agreed state, i.e. morphological changes such as size, border or color variation occur. When a one-click does not achieve the desired result, you can choose to click again or multiple times. Each click can be considered as an agreement update.

[0035] The above-mentioned touch screen sliding positioning refers to sliding the finger in the touch screen area, so that the user can refer to the trajectory of the component focus replacement on the screen to stop at the intended controllable component. Since the touch screen area is a standard analog projection area of the television screen on the remote control side, each point excited by the finger on the touch screen has a controllable component on the screen related to it. When the finger moves, the potential distance components involved in the way change morphologically in turn, so that the intended target can be accurately reached.

[0036] The above-mentioned step button positioning refers to using the direction button to complete the agreement update when the combined direction button is configured on the touch screen remote control device. It is usually used by users who are not used to using the slide screen operation and when running the application in the traditional button mode. In addition, in combination with the confirmation key, it can also be used as the main navigation and operation button throughout the traditional television application.

[0037] Any application running on a television needs to draw a page potential map in each page layout. It is a virtual layout. It is usually saved and transmitted in data formats such as arrays or lists. The potential map drawing follows the following four principles:

[0038] 1) Association principle: Each potential must be associated with one and only one controllable component.

[0039] 2) Fullness principle: Each controllable component must have one and only one independent potential of its own. The potentials of all controllable components in the screen fill the entire television screen.

[0040] 3) Division principle: Based on the original rectangle of the controllable component, when expanding in each direction, if it is blocked by other components, it will divide the space between them equally. However, when the other potential cannot reach the division line, it will use the boundary it can reach as the standard.

[0041] 4) Priority principle: When two components are diagonally arranged, if the horizontal distance between them is greater than or equal to the vertical distance, their potentials are arranged vertically. Otherwise, they are arranged horizontally.

[0042] The potential map can be drawn manually or automatically. Among them:

[0043] Manual drawing: After the page layout is completed, set the potential for each controllable component. They can exist as a controllable component drawing entity or as a virtual grid. The system ultimately needs only a data sequence related to the names of all controllable components and the positions of the potential four-line positions.

[0044] Automatic drawing: Use AI technology to design a dedicated potential generation plug-in for the system. This plug-in can be run after the page layout design is completed. According to the four principles of potential map drawing, draw the potential map and abstract it into a data sequence related to the names of all controllable components and the positions of the potential four-line positions. Automatic drawing can also be done automatically by executing the above-mentioned system plug-in when the system opens a page during live television operation.

[0045] In practical applications, when the touch screen on the remote control is clicked, the remote control sends the coordinate position of the touch point to the television host. The television management program searches and compares the controllable component potential field according to the received position information, and can quickly lock the potential field and controllable component.

[0046] The aforementioned potential field diagram was drawn using a full-page drawing method. However, a feasible alternative is to use a temporary, localized drawing method. After receiving the contact information from the remote control at the television end, a small-scale, temporary drawing is performed on-site to locate the potential field in which the device is located.

[0047] Once a controllable component is selected, the system enters the target agreement state. The system can cancel and re-agree, or perform other operations such as opening, running, dragging, and dropping to complete various other tasks.

[0048] When this invention is used in small touchscreen products such as TV remote controls, smartwatches, and mobile phones, although the touchscreen is small, the potential distance of the controllable components is greater than or much greater than the components themselves, and the corners of the touchscreen are very easy to capture. Therefore, even when the TV screen displays a simplified layout, the probability of the user hitting the target on the first try is still very high. If a simple click does not achieve the desired result, touchscreen swiping and step buttons can be used to conveniently and quickly select the target.

[0049] When an array of relatively small but concentrated controllable components appears on the screen, this array can be defined as a potential window. When this potential window becomes the focus of the screen, its potential field can be considered to fill the entire screen. At this time, all the listed components within the potential window will equally divide the potential field of the entire screen. Potential window bisectation is a strategy for rapidly identifying and executing controllable components in a concentrated arrangement.

[0050] The television-specific remote control described in this invention is a universal remote control designed for television sets and featuring three remote control modes: touchscreen, buttons, and air mouse. The remote control surface is equipped with a touchpad and physical buttons. The touchpad is used for various touchscreen gestures such as clicking, swiping, dragging, and zooming, while the physical buttons are used for operations such as power on / off, returning to home page, back, menu, direct access, multitasking, directional and confirmation control, and volume control.

[0051] To facilitate quick and easy operation, this invention combines the touchpad and the confirmation button into a single integrated unit. By applying pressure to the touchpad, button operations can be performed simultaneously with regular touchscreen operations. This integrated unit is called the touchpad button. This functionality can be achieved using either a mechanical button or finger pressure measurement technology.

[0052] Mechanical Buttons: Below the touchpad, a rubber sheet with conductive rubber blocks installed at multiple locations is adhered, with the contact surface facing down. Below the rubber sheet, a printed circuit board is mounted, containing contact pads corresponding to the conductive rubber blocks. Applying pressure to any location on the touchpad will always activate the corresponding contact pad.

[0053] Touch pressure measurement: using pressure sensing touch technology. Under such touchpad, there are pressure sensors, such as 3D-touch, or ClearForce technology. The size of the finger pressure level can be detected while monitoring the finger touch point. The system provides a threshold reference standard, when the finger pressure exceeds, it is judged as button effective. Users can also modify this threshold according to their own situation.

[0054] The touchpad is the physical existence of the potential distance map in the remote control end. The distribution of its physical touch point corresponds to the folding grid array of the television page. The touch screen operation on the touchpad is very similar to the operation directly on the touch screen installed on the television screen.

[0055] In navigation applications, if the total number of page controllable components exceeds the screen display range, when the finger slides down to the bottom of the touchpad, the entire page automatically floats up one row. Similarly, if the finger slides up to the top of the touchpad, as long as the top of the page is not in the screen window, the entire page automatically sinks down one row.

[0056] Implementing drag on controllable components can perform "drag" gesture operation: after finding the target component by clicking or sliding, press the touchpad button, do not lift the finger, continue to slide, you can drag the component to the target position on the page.

[0057] Like the zoom function of the mobile phone, to enlarge or reduce a specified picture, you only need to use two fingers to expand or shorten the distance between the two fingers on the touchpad to achieve the zoom in or zoom out of the picture.

[0058] In addition to the above simple touch screen to complete the click, move, drag, zoom and other various instruction type operations, using the touchpad, a variety of text, graphics input and drawing work can be completed, and through specific graphic input, a number of command functions can be realized. The former is defined as A type operation, and the latter is defined as B type operation.

[0059] B type operation is mainly used to draw text and graphics, which can be used for information transmission and command execution. As information transmission, writing text on the touchpad can present the handwriting on the television screen, and through the text recognition system, it becomes a sentence information transmission. As command execution, if a circle is drawn on the touchpad, it can become a command (such as "shutdown") execution after system recognition.

[0060] The four television remote control modes of touch screen, key, mouse and air gesture all adopt the potential field technology in navigation, video playing and other applications. Through the unified management of the remote control mode, data interaction and communication signal of the television remote control system, one remote controller can be used to realize the remote control operation of the three modes of touch screen, key and mouse, and the depth compatibility is achieved. Meanwhile, the air gesture remote control can also be inserted into operation while using the remote controller.

[0061] Due to the adoption of the touch plate button technology, the touch screen application becomes simple and smooth. The click positioning and sliding positioning can be completed in one cycle of finger "fall -> lift". Therefore, the target component focus and the agreed state do not need to be reserved after the cycle ends. However, when the key and air gesture modes are operated, or a mobile phone, a smart watch or other devices without the touch plate button function are used as a television remote controller, the target component focus cannot be cancelled as long as it is still in the agreed state. The application is called the focus retention strategy. From the compatibility of the remote control mode and the remote control tool, the focus retention strategy can also be adopted in the touch screen mode, but when a conflict with other touch screen gestures may occur, the priority can be specified or the agreement can be cancelled.

[0062] For users who are used to using keys, when opening a navigation page, if the focus retention strategy is not adopted, the combined keys can be pressed to set an initial focus by the system. Except for the first time, the initial focus is defined by the system according to the user's last use record. Then, the keys are continuously used for operation. Otherwise, an initial focus is automatically set by the system. If the user changes to use the touch screen during the key operation, the touch screen mode is entered and a new focus is generated after clicking or sliding. If it is under the focus retention framework, the focus always exists (the stay duration can also be set). Otherwise, the focus disappears as soon as the finger leaves the touch screen.

[0063] For users who are used to using the touch screen, the screen focus is generated by clicking or sliding on the touch screen. If the focus retention strategy is adopted, the combined keys are pressed to immediately enter the key mode, generate focus movement or related reactions such as command execution. Otherwise, an initial focus needs to be defined again.

[0064] In the key or touch screen mode, the mouse mode can be switched to by using keys, gestures and other controls.

[0065] In the application, the mouse mode is realized based on the light points (display dot array elements) on the television screen or the coordinate points of the simplified grid. The former has a high density and requires a high wireless transmission rate. The latter is relatively loose, and after adopting the potential field technology, the effect similar to the touch screen mode can be achieved.

[0066] For remote controller without gyro or IMU (combined gyro), the manual mode is adopted. When the finger slides on the touch screen, the cursor moves along the sliding direction. For remote controller with gyro or IMU, the automatic mode is adopted. When the remote controller is tilted, moved left and right (or rotated), the system accurately positions the cursor according to the gyro motion state and instructs it to move up and down, left and right.

[0067] Generally, the mouse mode is applied to the following scenarios:

[0068] 1) Navigation scenario related to controllable components. In this scenario, the cursor is first aligned with the target component or the component potential field, and then the button is confirmed.

[0069] 2) Demonstration scenario related to text pages. In this scenario, the cursor is used for guidance, annotation, and other purposes for live demonstration and interaction.

[0070] 3) Game scenario related to static or moving components. In some game scenarios, quick reaction is required for moving controllable components. The mouse mode can quickly align the target by moving the cursor.

[0071] Similar to the mouse mode, the air gesture is a method of realizing "pointing to pointing" television remote control by directly capturing and recognizing user gestures in real time through the camera installed on the television. It can be inserted at any time.

[0072] Obviously, the potential field technology can effectively improve the accuracy and efficiency of large-screen pointing applications such as mouse and air gesture. Since the potential field area is larger, even much larger than the controllable component, the target does not need to reach the specific target component, but only needs to reach the potential field of the component. At any time, whether it is a remote controller or an air gesture, once it points to the screen, it points to a specific target component. When the pointing direction moves, continuous component focus movement will occur. For example, when the cursor enters a page with three keys arranged in a row, as long as the cursor falls in one of the three vertical screens, the corresponding key will be in focus.

[0073] The invention does not exclude the use of a single system or other mixed solutions such as touch screen, mouse, and air gesture. In these remote control systems, the television dedicated remote controller can remove the arrangement of physical keys, or only retain a few keys such as power, return home, and return, and operate basically without keys throughout the process; or it can not install a gyro or a combined gyro, or not install a touchpad.

[0074] The above description is suitable for a television dedicated remote control with a touch panel, and is also applicable to a smart watch and a mobile phone. Since the mobile phone screen has a larger touch screen space than the smart watch, in order to maintain the consistency of operation with the television dedicated remote control, the application adds a key function area similar to the television dedicated remote control in addition to the touch screen area similar to the smart watch touch screen on the mobile phone touch screen. In the area, power, return home, return, menu, direct, mouse, direction and confirmation control, volume and other remote control command buttons are placed. The user can use the touch screen to complete gesture remote control operation, and can also use the keys in the key function area to complete other related operations.

[0075] When the application is used for a mobile phone, a remote touch screen area is opened on the mobile phone touch screen. The size of the remote touch screen area can be automatically adjusted according to the horizontal and vertical dot matrix of the screen provided by the television when starting up and the horizontal and vertical dot matrix data of the screen itself, and becomes a standard analog projection area of the television screen.

[0076] In specific applications, for mobile phones, smart watches and other remote control devices that do not have the function of realizing touch panel button through finger pressure, the application provides a replacement scheme for touch panel buttons. In the state of the agreed target component, the "confirmation" button on the remote control panel is used to directly complete confirmation. In the touch panel button replacement scheme:

[0077] 1) Focus setting: After the screen enters a new page, the system automatically sets the initial focus. When the target component is selected, the agreed state is retained and the focus does not disappear.

[0078] 2) Opening: Press the "confirmation" key to open the page defined by the component or the application. For a smart watch, a double-click gesture is used to replace the "confirmation" key.

[0079] 3) Dragging: After agreement, long press the touch screen and move the finger to drag the component to the target position of the page.

[0080] The television screen management system and the touch screen remote control device are connected through a wireless communication channel, and communication technologies such as WIFI, NearLink and Bluetooth are usually used. When NearLink or Bluetooth technology is used, the television and the touch screen remote control device both need to install corresponding communication modules. After pairing and connecting, data interaction can be realized. When WIFI technology is used, both need to be in the same WIFI environment. After connection, both sides can not only transmit commands related to remote control, but also transmit text, voice, picture and other data.

[0081] The application has obvious social and economic benefits. The main aspects are as follows:

[0082] One, crack the human-computer interaction problem. The interaction between television and user has been a difficult problem to solve, and the remote control technology is the most difficult one. The scheme provided by the present application can make the ordinary television realize the function similar to the touch screen, and solve the drawbacks of the previous human-computer interaction mode, such as clumsiness and low speed.

[0083] Two, the potential field technology provided by the present application can maximize the hit rate of each controllable component, and the point is not virtual, without the need of cursor guidance. Not only the remote control efficiency is greatly improved, but also the requirement for hardware processing speed is much lower than that of the cursor absolute pointing technology, which is more conducive to popularization and promotion.

[0084] Three, the touch screen mode of television remote control is the simulation of mobile phone touch screen operation. Compared with other remote control modes, since the finger relies on the remote controller and the activity range is small, it is not easy to get tired and has good stability. In addition, in the application scenarios such as screen brushing, zooming, text and graphic input, it has unique advantages and is more in line with user habits.

[0085] Four, the television remote control method provided by the present application integrates the four methods of touch screen, key, mouse and air gesture, and they are mutually integrated. The advantages of each method are fully utilized to meet the scene and user demand under multiple occasions and application conditions. After adopting the potential field technology, the progress of the pointing remote control technology such as mouse and air gesture can be promoted.

[0086] Five, support for personalized remote control and television sharing. The remote control technology of the present application can be completely implemented on mobile products such as ordinary mobile phones and smart watches. In the future, whether at home, in hotels or in office places, as long as the mobile phone or smart watch is used for remote control to start, without logging in and registering and paying separately, the television can directly identify the user identity, obtain the user related use records and social, shopping, file and other data, and directly reach the user historical records, applications or favorite channels. BRIEF DESCRIPTION OF DRAWINGS

[0087] The present application is further described below in combination with the drawings and an example.

[0088] Figure 1 An example of potential distance generation in the example of the present application is shown.

[0089] Figure 2 Several example diagrams of potential distance distribution of page controllable components in the example of the present application are shown.

[0090] Figure 3 An operation diagram of dragging the controllable components of the television screen in the example of the present application is shown.

[0091] Figure 4 A diagram of using line translation operation in the example of the present application is shown.

[0092] Figure 5Fig. 1 is a schematic diagram of the column shift operation used in the example of the present application.

[0093] Figure 6 Fig. 2 is a schematic diagram of the potential window application used in the example of the present application.

[0094] Figure 7 Fig. 3 is a schematic diagram of the appearance of the TV-specific remote control used in the example of the present application.

[0095] Figure 8 Fig. 4 is a schematic diagram of the appearance of the mobile phone analog remote control used in the example of the present application.

[0096] Fig. 1 is a schematic diagram of the column shift operation used in the example of the present application. DETAILED DESCRIPTION

[0097] The present application is further described below in connection with an example of using a TV-specific remote control to control a TV.

[0098] In this example, the TV is a smart TV, hereinafter referred to as TV host. The TV host is installed with an Android operating system and other management and application programs, collectively referred to as resident application programs. The operation panel of the TV-specific remote control is installed with a touchpad and several physical buttons such as power, return, menu, and direction combination buttons, and is internally installed with a remote control application program matched with the TV host. Both the TV-specific remote control and the TV host can be wirelessly connected through the same Wifi environment and the internally installed Bluetooth communication components.

[0099] The potential distance is used as the screen potential field construction method in this example. The resolution of the TV host display screen is 1920*1080 light point units, and the touch screen effective area is 480*270 touch point units. Generally, in the TV screen navigation page, the 4*3 (three rows, each row has four controllable components) format is more commonly used. When 4*3 squares are evenly arranged on the screen, each square is 480*360 light point units. According to the aforementioned calculation formula m2=[m1*(x / X)], n2=[n1*(y / Y)], corresponding to the touchpad, each square is 120*90 touch point units. This configuration can meet the needs of users to easily watch the screen and reliably control the TV. This screen mapping state is called symmetric mapping. Even in an application like Go, the number of squares in the horizontal and vertical directions is 18, and the vertical length of each square can reach 60 light point units. On the touchpad, the vertical length of each square mapped can reach 15 touch point units, which still meets the condition of symmetric mapping. However, when the number of square components evenly distributed on the screen exceeds 480*270, or the sizes are different, and the smallest rectangle on the touchpad end may have a side length less than 1 touch point unit, it will share a touch point with other controllable components. This screen mapping state is called asymmetric mapping.

[0100] When using the touchpad of the remote controller to position the controllable components on the TV screen, since it cannot be directly pointed to the controllable component like a mobile phone, it can only be pointed to one or more touch points in the touchpad mapping area. Therefore, maximizing the mapping area can effectively improve the accuracy of the hit and ensure that each point is actually implemented, and there will be no situation where the component cannot be hit.

[0101] The potential distance of the controllable component is the largest upright rectangle that can be generated after the upright smallest rectangle (original rectangle) surrounding itself is extended without obstacles in all directions with the TV screen display area as the boundary. The potential distance map can be manually drawn, or automatically drawn by a potential distance generation system. The potential distance drawing follows four principles of association, fullness, halving, and priority.

[0102] Figure 1 As shown in the example of potential distance generation, there are a total of 5 controllable components (2) in the entire TV screen display area (1). Each rounded rectangle can be regarded as the combination of the controllable component and the original rectangle. Starting from the upper left corner, the entire screen is scanned. In the expansion of No. 1 component, because there is an intersection with No. 4 component, it cannot expand to the left to the vertical halving line position of No. 2 component, but only to the vertical halving line position on the right side of No. 4 component. Similarly, No. 5 component cannot expand upward to the horizontal halving line position of No. 3 component. In the expansion of No. 4 component, it cannot expand to the right to the vertical halving line position of No. 5 component, but only to the vertical halving line position on the left side of No. 5 component. Figure 1 _b shows the final result of potential distance generation.

[0103] In the potential distance atlas, each controllable component has its own potential distance name. They are closely related. In this example, the potential distance atlas of each page is constructed in a virtual layout, and is saved and transmitted in an array data format. For example, in the example shown in Fig. 2b, the controllable components with names A1, A2,..., A5 exist in a one-dimensional array imagId_ar, and the completed potential distance exists in a two-dimensional array itemArray, and when i is constant, the potential distance of imagId_ar[i] is itemArray[i]. Figure 1

[0104] imagId_ar = {A1, A2, A3, A4, A5};

[0105] itemArray = {{a0, a1, a2, a3}, {b0, b1, b2, b3}, {c0, c1, c2, c3}, {d0, d1, d2, d3}, {e0, e1, e2, e3}};

[0106] In the example shown in Fig. 2b, the controllable components with names A1, A2,..., A5 exist in a one-dimensional array imagId_ar, and the completed potential distance exists in a two-dimensional array itemArray, and when i is constant, the potential distance of imagId_ar[i] is itemArray[i].

[0107] The naming of the controllable components has component attributes, including normal, potential window, etc. The potential window type component needs to add "_x" at the end of the name string.

[0108] Figure 2 Some examples of potential distance distribution of controllable components are listed in Fig. 2a. In the scenes in each display area of the television screen, there are different distributions of controllable components. These scenes are very common in television navigation and various applications of television, and all show simple distribution types. Among them:

[0109] Figure 2 In Fig. 2a, there is only one controllable component, and its potential distance extends to the entire screen, so clicking anywhere on the touchpad can hit the target.

[0110] Figure 2 In Fig. 2b, the potential distance of component A occupies the upper half of the screen, and the potential distances of B1 and B2 occupy the left and right halves of the lower half, respectively. Clicking on these three parts can hit them, respectively.

[0111] Figure 2 ​In c, A1, A2, A3 are arranged in a row, cutting the screen into three parts vertically. Clicking on the three parts can hit the target respectively.

[0112] Figure 2 In d, there are six parts of potential distance, among which the first hit rate of A, B1, B3, C1 and C2 parts is obviously higher than that of B2 part.

[0113] Figure 2 In e, A, B and C three parts of potential distance are arranged in a row, cutting the screen into three parts. Clicking anywhere in each part can hit the target respectively.

[0114] Figure 2 In f, nine parts of potential distance are arranged in a 3*3 format. The controllable parts located at the corners and the periphery have a higher first hit rate than the B2 part located in the center. Overall, the first full hit rate is higher than that in the irregular arrangement scenario.

[0115] As can be seen from the above six examples, the size of the potential distance is usually not symmetrical with the size of the controllable part itself. Small parts on a screen can also have a large potential distance. In addition, the accurate hit rate of the potential distance located at the corners and the periphery of the screen is higher than that of other parts.

[0116] This example uses three collaborative remote control technologies of simple click positioning, touch screen sliding positioning and step button positioning. For simple distribution type screen scenarios, the first hit rate of simple click positioning is higher. Especially for those screen scenarios that mainly play scenes and provide soft buttons such as likes, evaluations and wishes, the first hit rate is higher.

[0117] When using simple click positioning, directly click the position on the surface of the remote control touchpad corresponding to the screen scene. When the finger contact area is large, the system is refined and sends the refined point position to the television end. After receiving it, the television end captures the potential field and its parts of the position through the potential field layout characteristics of each target part in the simplified grid, and at the same time, the part is focused, such as magnification, framing, color change, etc., to show the selection. When the finger is lifted, the focus is cancelled and the original state is restored.

[0118] If the selected part is not as expected, you can continue to use simple click positioning to re-appoint, or use touch screen sliding positioning technology to reach the accurate selection target. Sliding positioning is to slide the finger on the touchpad. In this process, the remote control constantly sends the coordinate position to the television end. After receiving it, the television end compares it with the current focus potential distance, and if it is not in it, the current focus potential distance part is cancelled and a new focus is set.

[0119] In touch screen slide positioning, there is no restriction on finger moving direction. However, to avoid gesture conflict, for remote controllers not configured with key mode, fast slide from lower left corner to upper right corner is usually not supported.

[0120] In this example, the TV dedicated remote controller uses mechanical buttons to realize touch screen and key linkage. Under the touchpad, a rubber sheet with the same size as the touchpad is attached. In the four corners, four edge centers, and the center of the rubber sheet, round conductive rubber is installed. The conductive rubber faces down and corresponds to the contact pads on the lower printed circuit board. When a certain pressure is applied to the touchpad, the corresponding contact pad is connected. With this technology, clicking positioning or slide positioning can be performed at the same time, and finger pressure can be applied to complete the "confirmation" key operation without moving or changing fingers.

[0121] For mobile phones, smart watches, and other remote control devices without pressure-sensitive touch control, this example uses the "confirmation" key or touch screen gesture configured on the remote controller to replace it. After implementing the replacement solution, it is necessary to use the focus retention strategy. After the agreement, the focus is retained.

[0122] After the controllable component completes the agreement, opening, dragging, and other operations can be completed through touch screen gestures, and various gestures such as single click, double click, triple click, long press, movement, and double-finger slide on the touchpad can be used to realize agreement, zoom, screen overall translation, row and column translation, multitasking, mouse, volume control, return, return home, power on / off, etc. Since the TV dedicated remote controller in this example has physical keys such as power, volume control, return, direct, multitasking, return home, and mouse, the operations completed using the touchpad only include agreement, opening, dragging, zoom, screen overall translation, row and column translation, etc., including:

[0123] Agreement - Set the focus component through simple click positioning or touch screen slide positioning.

[0124] Opening - In the agreement state, do not lift the finger, and press the touchpad button at the same time, then open the page or application defined by the agreed component.

[0125] Dragging - Click or slide to the target component potential distance, press the touchpad button, and slide the finger at the same time, then enter the dragging state. If the component allows to be dragged, a copy of the currently agreed component will appear on the TV screen at the corresponding position of the fingertip. At this time, move the finger, and the component copy will be synchronized with the line to the expected target. After the finger is lifted, the component copy reaches the new position. The original component disappears.

[0126] Figure 3The operation of dragging the controllable component B1 to position A3 on the TV screen is shown. After the finger slides to B1, the touchpad button is pressed. If B1 can be dragged, the current position is converted to the actual starting position on the screen, and the component B1 on the original position is faded out. The copy of the component is displayed at the starting position on the screen. Then, the finger slides to A3, and the copy of B1 is moved on the screen. When the finger reaches the target A3, it is lifted, and the copy of B1 on the screen is positioned at A3. The faded-out B1 on the original position disappears. Under the focus retention strategy framework, after the agreement, the confirmation is completed using the keys or gestures, and then the new finger position is converted to the actual starting position on the screen, and the copy of B1 is displayed.

[0127] Zooming - for pictures, and zooming in and out of dynamic scenes such as video playing, shooting, map navigation, etc. After entering the scene, two fingers slide on the touch screen surface away from each other or towards each other to zoom in or out of the scene. Here, shooting refers to adjusting the lens focus when using the TV camera through touch screen gestures.

[0128] Whole screen translation - the TV screen allows for subsequent pages. A single finger moves vertically up and down or horizontally left and right on the touch screen surface to move the whole screen up and down or left and right. Whole screen translation is more commonly used in short videos. A video playing scene usually contains the following three components:

[0129] 1) Play management: including "pause / play" button and play "progress bar". By clicking the middle of the screen (with the interactive column at the bottom) or the left middle (with the interactive column on the right), the potential distance can be activated in this section. Click again to deactivate.

[0130] 2) Full screen image update: use a single finger to slide up and down.

[0131] 3) Interactive column: set up multiple controllable components such as likes, comments, and forwards. Usually arranged horizontally at the bottom of the screen or vertically on the right side of the screen in a potential window.

[0132] When "play management" is in the active state, the other two activities are suspended. Avoid mutual interference between the three.

[0133] Row and column translation - row translation method is only used when subsequent component prompts appear at the left or right end of a certain row or several rows on the screen. Figure 4 _a is a "jigsaw puzzle" example using row translation operation in this example. It requires seven boards of different shapes B1, …, B7 to be connected into A1, A2 style patterns.

[0134] Since there are many controllable components in the row, a component array is established for the down row jigsaw arrangement. It is composed of seven components B1, …, B7 arranged in sequence. The user can drag the whole row to the left by single-finger sliding screen, which can introduce one or more subsequent arrangements. The components at the left end of the array arrangement that overflow the page will become the subsequent component arrangement for the reverse translation of the row. Figure 4 _b shows the state diagram of the first component at the left end of the original down row overflowing the page after the left translation of the down row by one component. At this time, the television application displays a prompt "->" indicating the existence of subsequent components on the left side of the initial page P0.

[0135] The above example has two objects that can implement row translation. Their potential distance is almost equally divided into the upper and lower half of the television screen. Therefore, when selecting the row translation object, you only need to slide your finger in the upper and lower half of the touchpad, and the selection rate is extremely high.

[0136] Figure 5 The operation schematic diagram of column translation is shown. Column translation is to vertically divide the large screen of the television into two or more vertical screen spaces. Each vertical screen space can be in an equal relationship or a master-slave relationship, but they are independent blocks. Figure 5 _a is an example of a master-slave relationship. The left half of the screen is an arrangement of chat objects in a social chat software. When the finger slides up and down on the left half of the touch screen surface, the block can be activated. After agreeing on the A2 object, the right half of the screen displays all recent chat records related to the object. The lower end is arranged with several controllable components, including full-screen display, chat tools such as text and voice, etc. Figure 5 _b is an example of an equal relationship. They each belong to three application programs, such as three e-commerce platforms. After selecting a product, you can browse the details of the product on the three platforms. Similarly, the finger slides up and down on the 1 / 3 part of the touch screen surface to activate the corresponding block and complete the browsing, full-screen display, ordering, payment, and more operation functions. In multi-screen column translation, it is allowed to retain the focus of the original screen after changing the sub-screen.

[0137] Mouse - This is a remote control behavior that simulates the use of a laser mouse to control the movement of the cursor on the curtain. It is usually used in teaching, conference presentation, etc. to guide and prompt a certain picture or text on the television screen. Press the <mouse> button on the remote control panel to enter the mouse state. At this moment, a cursor pattern will appear in the center of the television screen. It can be a circle, an arrow, or other patterns.

[0138] The operation of the mouse is divided into high and low configurations, which are set according to the configuration of the television and the remote control. Under high configuration, the cursor moves based on the actual dot matrix of the screen. Otherwise, the cursor moves based on the simplified grid of the screen.

[0139] The flying mouse has two modes of operation, manual and automatic, for remote controls with or without a gyroscope or IMU (integrated gyroscope). In manual mode, when the finger slides on the touch screen, the cursor moves in the sliding direction. When a certain drawing or document needs to be marked, the cursor is moved to the appropriate position called the mark starting point, and the touchpad button is pressed to enter the mark state. Then, under the condition that the touchpad button is valid, single-finger sliding moves the cursor along the way, and draws lines, boxes, etc. After the touchpad button is cancelled, the marking is completed.

[0140] In automatic mode, when the remote control is tilted, moved left and right (or rotated), the cursor moves up and down, left and right. When a certain drawing or document needs to be marked, the touchpad button is pressed to enter the mark state. In this example, the remote control is equipped with an IMU, so the automatic mode is used. The automatic flying mouse mode can also provide a good user experience in page component dragging and related game applications.

[0141] Potential window - in TV application pages such as movies, TV series, short videos, online classes, online social networking, etc., there are usually button components that allow users to comment, like, share, or choose conversation methods. The potential window strategy can divide these components evenly across the touch screen area, improve the one-hit rate, and facilitate blind hits. In some navigation scenarios that are frequently used and have clear targets, such as history records, potential window technology can also be used to quickly start the target application without opening the application page. Figure 6 A schematic diagram of a potential window application in this example.

[0142] Figure 6 _a is a 3*3 component arrangement navigation scenario. A2 is expressed as the title "History". Below the title, there are four record pictures X1, X2, X3, and X4. The top left corner of the entire history component has a colored mark indicating that this target component is a potential window. When the finger clicks or slides to the component, three results can be produced:

[0143] 1) pass by without stopping: like ordinary controllable components, there is a brief focus style flash, and no other reaction is produced.

[0144] 2) stop and exceed the specified time (such as more than one second): the potential window is enlarged to full-screen (or full-screen). As shown in Figure 6 _b. All controls are evenly distributed in the potential distance space of the entire large screen, as shown in Figure 6As shown in Fig. c. At this time, the finger slides on the touchpad horizontally, and X1, X2, X3, X4 can form the focus flicker in turn. Moreover, the finger can not be limited by the A2 boundary as long as it is not lifted. When selecting one of the components, the touchpad button is pressed to open the corresponding program. During the whole process of staying, sliding, positioning, the finger cannot leave the touchpad. Once it leaves, the potential window returns to its original state.

[0145] 3) Without staying, directly press the touchpad button: open the "history" application and open a new page.

[0146] In this way, whether it is a simple layout or a layout containing high density, it can be easily and accurately positioned, improving the efficiency of remote control. In one sentence, it is "one arbitrary point, two half edges, and multiple walking columns". The meaning is:

[0147] One arbitrary point: If there is only one controllable component, clicking anywhere on the touch screen can select the component.

[0148] Two half edges: When there are two controllable components, clicking anywhere on the upper or lower half or the left or right half of the screen can select one of the two components.

[0149] Multiple walking columns: When there are multiple components, you can slide within the row and column and click on one of them.

[0150] The dedicated remote control in this example adopts a two-in-one mode of touch screen and physical keys, and its appearance structure is shown in Fig. Figure 7 In addition to the touchpad (5), the television dedicated remote control also has other physical keys:

[0151] Power (3): On / Off.

[0152] Home (4): Return to the home page.

[0153] Menu (6): Basic function shortcut setting.

[0154] Direction combination (7): Up, down, left, right step movement control.

[0155] Multi-task (8): Browse the multi-task list running in the foreground and background.

[0156] Back (9): Return to the previous application.

[0157] Direct (10): Custom favorite program or application, direct at startup.

[0158] Confirm (11): Confirmation key.

[0159] Volume control (12): Control the volume of the TV.

[0160] Mouse (13): Mouse key.

[0161] The present example supports voice operation. Voice operation is divided into two categories: voice command and voice expression. Generally, the former requires receiving the command at the television end and then completing the command execution. The latter only needs to complete information transmission.

[0162] Voice command is to interpret the user's voice as a command format, which is sent from the remote control to the television end. The opposite party receives it and then executes the relevant task. This type of voice is usually a phrase and is applied more in screen navigation, such as "power on", "power off", "open my space", "enter history record", "search XXX animation", "drag XXX component to XXX position", etc. When using voice command, the user can single-finger long-press the touch screen of the remote control device (avoiding the potential window), and input voice at the same time; when the voice ends, the user can lift the finger.

[0163] Voice expression is usually used in screen interaction and other related applications. After these applications are started and run, the respective systems provide interactive modes including voice, expression, text, etc., and produce relevant reactions on the screen of the remote control end. When the interactive environment permits, the user can ask questions through voice, network chat, real-time evaluation, etc.

[0164] When the present application is used in smart watches and mobile phones and other products with touch screens, a television simulation remote control application program can be installed in these products. After the application is started, the screen will present a simulation remote control or a television power button interface, providing the user with various operations of remotely controlling the television. In the present example, all gesture applications involving touch panels can be perfectly implemented through the touch screen of the watch and the mobile phone.

[0165] Figure 8 A schematic diagram of a mobile phone simulating the appearance of a remote control. The mobile phone screen is relatively large, and a remote control touch area (15) is opened on the mobile phone touch screen, with an upper component (14) and a lower component (16) arranged above and below the remote control touch area (15). The lower component (16) carries the layout of all soft keys. In the horizontal direction, the mobile phone simulation remote control does not set a boundary, i.e., the horizontal touch screen resources of the mobile phone are fully used. The position of the lower component (16) can be automatically adjusted according to the horizontal and vertical proportions of the television screen. In this way, based on the horizontal and vertical proportions of the screen sent by the television end to the remote control end at the time of starting up, the horizontal and vertical touch point data of the touch screen of the mobile phone end, and the position data of the upper and lower components, the accurate position and size of the remote control touch area (15) on the mobile phone touch screen can be calculated, which becomes the standard simulation projection area of the television screen. When the density of the remote control touch area (15) is relatively high, the required density can be achieved through a folding algorithm.

[0166] On the surface of the mobile phone remote control, in addition to the remote control touch area (15), a plurality of soft keys are also arranged. Their names and functions are basically the same as those of the physical keys on the above-mentioned television dedicated remote control.

[0167] This example relates to gestures of touchpad, which can also be used in smart watch. The touch screen of watch is usually small, and there is no space to install soft buttons, so the above-mentioned two types of gestures A and B are implemented by using the touch screen. Among them, the conventions, opening, dragging, zooming, screen overall translation, row and column translation, and mouse operation are basically the same as the operations on the remote control of the TV. In addition, the following operations are added:

[0168] 1) Power on / off: After entering the TV remote control application, the power button appears on the screen. Clicking the button can enter the boot program. The TV enters the running state from the standby state. When turning off, draw a circle in the touch screen area or tap the touch screen with the palm.

[0169] 2) Return to home page: triple-click the touch screen.

[0170] 3) Return: single finger quickly slides from the lower left corner to the upper right corner of the touch screen and then lifts up, returning to the state before the operation.

[0171] 4) Volume control: use the volume control button of the watch itself, or double-click vertically in the touch screen area to increase or decrease the volume of the TV.

[0172] 5) Voice remote control: single finger long press on the touch screen, and the speaker pattern appears, and the voice is effective.

[0173] 6) Multi-task: long press the touch screen twice to display the multi-task page arrangement.

[0174] 7) Floating window: double-click the touch screen to the right to gradually pull the <more operations> floating window from the left end of the TV screen. The floating window contains the following soft buttons:

[0175] a) Direct: boot directly to the custom application page.

[0176] b) Direction combination: similar to the direction combination button and confirmation button of the TV remote control, and the "exit" button to return to the main page of the remote control.

[0177] c) Menu - basic function shortcut setting.

[0178] The TV remote control method and the design of the TV-specific remote control and mobile product analog remote control adopted in this invention can be used not only for traditional TVs, but also for smart TVs, various set-top boxes, and other TV boxes. Furthermore, it is backward compatible, working with both TV applications that use potential field technology and those that do not. Users accustomed to button mode can directly operate the TV using the physical buttons on the remote control or the soft buttons on their mobile phones without any further explanation. Users who need to use the air mouse remote control mode can activate it by completing the explanation using the <Air Mouse> button on the remote control. Smartwatch users accustomed to button mode can use the "Direction Combinations" page in the <More Operations> floating window and its soft buttons to complete the operation. Any user can switch to touchscreen mode from button and air mouse modes to enjoy a simple, convenient, and accurate remote control experience.

[0179] While operating in compatible modes including touchscreen, buttons, and air mouse remote control, users can insert air gestures at any time to fully enjoy the perfect experience brought by convenient body language after adopting potential field technology.

Claims

1. A TV remote control method based on potential field technology, which, in the design of various TV pages such as program navigation, video playback, education and training, sports and health, and game scenes, rationally allocates the non-controllable area other than the controllable components to each controllable component, constructs their own independent potential fields, maximizes the screen space occupied by each controllable component, and provides convenience for screen remote control activities such as searching, moving, replacing, marking, and scaling of controllable components. A potential field possesses the following basic elements: Reasonable: The combination and construction of controllable components and potential fields conform to users' common sense. Independent: Each controllable component must have, and only has, one potential field, and has no intersection with other potential fields; Fill: The potential energy of all controllable components within the screen fills the entire television screen; When performing remote control operation on a television, the potential field of the controllable components of the television is taken as the basic object of operation and control, and associated with the controllable components that possess the potential field, forming a unified management pattern of controllable components and their potential fields without gaps across the entire screen. The potential field can be rectangular, or other shapes and styles that are easy to construct and use; Potential distance is a potential field that exists in the form of a rectangle; it is the largest upright rectangle that can be generated after the smallest upright rectangle surrounding the controllable component itself is extended unobstructed in all directions, with the perimeter of the TV screen area as the boundary.

2. The television remote control method based on potential field technology according to claim 1, characterized in that: The touchpad (screen) installed on the remote control device is a physical representation of the potential field spectrum at the remote control end; the display dot matrix of the TV screen is proportionally converted into the horizontal and vertical dot matrix number of the touch screen area to meet the requirement that a touch screen with a fixed size ratio and density becomes a standard analog projection area of ​​a TV screen with different length and width ratios and densities; all calculations involving the position, size, and potential field of controllable components are based on simplified data and simplified grids; When you tap any point on the touchscreen, the system refines the contact area between your finger and the touchscreen into a single point. This point is then transmitted to the TV via the wireless communication link between the touchscreen remote control and the TV. By analyzing the potential field layout characteristics of each target component in the simplified grid, the TV remote control management system can capture the potential field at that location and its components.

3. The television remote control method based on potential field technology according to claim 1, characterized in that: The plotting of potential distance diagrams follows four main principles: 1) Association principle: Each potential distance must be associated with one and only one controllable component; 2) Filling principle: Each controllable component must have one and only one independent potential distance; the potential distances of all controllable components within the screen fill the entire television screen. 3) Bisector principle: Based on the original rectangle of the controllable component, when expanding in all directions, if it is blocked by other components, it will bisect the space between them. However, when the potential distance of the other component cannot reach the bisecting line, the boundary that it can reach will be used as the standard. 4) Priority principle: When two components are arranged diagonally, if the lateral distance between them is greater than or equal to the longitudinal distance, they are arranged longitudinally; otherwise, they are arranged laterally. Potential distance maps were drawn using both manual and automatic methods.

4. The television remote control method based on potential field technology according to claim 1, characterized in that: The automatic drawing plugin for potential distance diagrams can run after the page layout design is completed. Based on the four principles of potential distance diagram drawing, it abstracts the potential distance diagram into a data sequence related to the names of all controllable components and the positions of the four potential distance lines. Automatic drawing can also be performed during the live TV broadcast. When the system opens a certain page, it will automatically complete the drawing by executing the operating system plugin.

5. The television remote control method based on potential field technology according to claim 1, characterized in that: An array of relatively concentrated controllable components can be defined as a potential window; when the potential window becomes the focus of the screen, its potential field can be regarded as filling the entire screen; all the listed components within the potential window divide the potential field of the entire screen.

6. The television remote control method based on potential field technology according to claim 1, characterized in that: The TV remote control features three remote control modes: touchscreen, buttons, and air mouse. It has a touchpad and physical buttons on its surface. The touchpad is used for various touchscreen gestures such as clicking, swiping, dragging, and zooming. The physical buttons are used for power on / off, returning to home page, back, menu, air mouse, direct access, multitasking, directional and confirmation control, volume control, and other operations.

7. The television remote control method based on potential field technology according to claim 1, characterized in that: Based on the potential field layout characteristics of different scenarios on the page, and utilizing the touch screen (panel) of the remote control device, as well as the potential field and operation gestures of the controllable components, a simple click positioning, touch screen swipe positioning, and step button positioning strategy is adopted to realize multiple remote control functions for the controllable components of the TV screen. In touch screen mode, a focus holding strategy can be selected to improve compatibility with different remote control modes and remote control tool environments.

8. The television remote control method based on potential field technology according to claim 1, characterized in that: The touchpad and confirmation button are combined into a single unit, allowing button operations to be performed simultaneously with regular touchscreen operations by varying the pressure applied to the touchpad. This functionality can be achieved using either mechanical buttons or finger pressure measurement technology. When using finger pressure measurement technology, pressure-sensing touch technology is employed. The touchpad button becomes active when the finger pressure exceeds a specified threshold.

9. The television remote control method based on potential field technology according to claim 1, characterized in that: In large-screen pointing applications such as air mice and air gestures, potential field technology is used. Pointing to a target only requires reaching the potential field of the component, without needing to reach the specific target component. Once pointing at the screen, it is already pointing to a specific target component. When the pointing direction moves, continuous component focus movement can occur.

10. The television remote control method based on potential field technology according to claim 1, characterized in that: The TV remote control system offers four remote control methods: touchscreen, button, air mouse, and air gesture. Potential field technology is used uniformly in applications such as navigation and video playback. The TV remote control system implements unified management of remote control methods, data interaction, and communication signals. A single remote control can simultaneously achieve compatible remote control operation using touchscreen, button, and air mouse methods. Air gesture remote control can also be inserted and operated while using the remote control.

Images