Television box simulation mouse interaction method and device, computer equipment and program product
By connecting to the touch screen terminal to render the mouse on the TV interface and responding to mobile and click commands, the problem of inefficient operation of traditional remote controls is solved, achieving an efficient and intuitive interactive experience.
Patent Information
- Application Number
- CN202411586118.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-07
- Publication Date
- 2025-02-18
AI Technical Summary
Traditional remote controls are inefficient in handling complex tasks, especially in web browsing or multi-level applications. Point-by-point navigation is slow and inaccurate, resulting in user operations being cumbersome and unintuitive.
By establishing a connection with the touch screen terminal, mouse rendering is performed on the TV interface, mouse position is determined, and mouse position is updated in response to mouse movement and clicking instructions, click event is triggered, to achieve similar interactive effects to physical mouse.
It improves the convenience and smoothness of operation, achieves precise control of cursor position, and improves overall interactive performance and operation efficiency.
Smart Images

Figure CN119484913A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of smart devices, and in particular to a method, device, computer equipment, computer-readable storage medium and computer program product for simulating mouse interaction for a TV box. Background Art
[0002] With the development of smart device technology, the functions of smart TVs and set-top boxes are becoming increasingly complex, and users are also demanding higher and higher interactive methods. At present, the traditional operation method of smart TVs and set-top boxes mainly relies on physical remote controls. Although it can complete basic operations, it shows obvious limitations when facing complex tasks.
[0003] In traditional technology, the remote control uses the direction keys to move the cursor to achieve screen interaction. This method is suitable for simple menu navigation, but when it comes to web browsing or multi-level applications, the point-by-point navigation of the remote control is slow and imprecise. Users need to frequently move the cursor or perform complex selection buttons to complete simple operations, which is cumbersome and unintuitive, and the operation efficiency is low. Summary of the invention
[0004] Based on this, it is necessary to provide a TV box simulating mouse interaction method, device, computer equipment, computer readable storage medium and computer program product to address the above technical problems.
[0005] In the first aspect, the present application provides a method for simulating mouse interaction in a TV box, which is applied to a TV box, including: establishing a connection with a touch screen terminal, and rendering the mouse on a TV interface to determine a first mouse position of the rendered mouse in the TV interface; determining mouse offset data in response to a mouse movement instruction; the mouse movement instruction is determined by the touch screen terminal according to a touch point movement operation; updating the mouse position of the mouse in the TV interface according to the first mouse position and the mouse offset data; if a mouse click instruction sent by the touch screen terminal in response to a mouse click operation is received, triggering a click event at a second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position update matches the target mouse position.
[0006] In one of the embodiments, performing mouse rendering on a television interface and determining a first mouse position of the rendered mouse in the television interface includes: establishing a mouse floating window on the television interface; performing mouse rendering on the mouse floating window, and determining the first mouse position of the rendered mouse in the mouse floating window.
[0007] In one of the embodiments, establishing a mouse floating window on a TV interface includes: obtaining a TV screen resolution, determining a window range of the mouse floating window according to the TV screen resolution, and establishing the mouse floating window according to the window range; performing mouse rendering in the mouse floating window includes: if the position of the mouse to be rendered is outside the window range of the mouse floating window, determining a boundary of the mouse floating window according to the window range, and performing mouse rendering at the boundary.
[0008] In one of the embodiments, updating the mouse position of the mouse in the TV interface based on the first mouse position and the mouse offset data includes: determining the horizontal coordinate and the vertical coordinate of the mouse in the TV interface based on the first mouse position; parsing the mouse offset data to obtain a first offset and a second offset; and superimposing the horizontal coordinate and the vertical coordinate with the first offset and the second offset, respectively, to obtain the second mouse position.
[0009] In one of the embodiments, the method further includes: determining a mouse vibration pattern corresponding to the operation posture and operation intensity in response to the operation posture and operation intensity of the touch screen terminal; and vibrating the mouse based on the intensity and duration corresponding to the mouse vibration pattern.
[0010] In a second aspect, the present application provides a method for simulating mouse interaction in a TV box, which is applied to a touch screen terminal, including:
[0011] Establish a connection with a TV box; the TV box is used to perform mouse rendering on a TV interface and determine a first mouse position of the rendered mouse in the TV interface; in response to a touch point movement operation, determine mouse offset data, and send a mouse movement instruction carrying the mouse offset data to the TV box; the mouse movement is specified to trigger the TV box to update the mouse position of the mouse in the TV interface according to the first mouse position and the mouse offset data; in response to a mouse click operation, send a mouse click instruction to the TV box to trigger the TV box to trigger a click event at a second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position update matches the target mouse position.
[0012] In a third aspect, the present application further provides a TV box simulating mouse interaction device, which is applied to a TV box, comprising:
[0013] Establish a connection with a TV box; the TV box is used to perform mouse rendering on a TV interface and determine a first mouse position of the rendered mouse in the TV interface; in response to a touch point movement operation, determine mouse offset data, and send a mouse movement instruction carrying the mouse offset data to the TV box; the mouse movement is specified to trigger the TV box to update the mouse position of the mouse in the TV interface according to the first mouse position and the mouse offset data; in response to a mouse click operation, send a mouse click instruction to the TV box to trigger the TV box to trigger a click event at a second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position update matches the target mouse position.
[0014] In a fourth aspect, the present application further provides a TV box simulating mouse interaction device, which is applied to a touch screen terminal, including:
[0015] A communication connection module, used to establish a connection with a TV box; the TV box is used to render a mouse on a TV interface and determine a first mouse position of the rendered mouse on the TV interface;
[0016] a mouse movement instruction sending module, configured to determine mouse offset data in response to a touch point movement operation, and send a mouse movement instruction carrying the mouse offset data to the TV box; the mouse movement is designated to trigger the TV box to update the mouse position of the mouse in the TV interface according to the first mouse position and the mouse offset data;
[0017] A mouse click instruction sending module is used to send a mouse click instruction to the TV box in response to a mouse click operation, so as to trigger the TV box to trigger a click event at a second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position is updated matches the target mouse position.
[0018] In a fifth aspect, the present application further provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of any of the above-mentioned TV box simulating mouse interaction methods when executing the computer program.
[0019] In a sixth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of any of the following methods for simulating mouse interaction in a TV box are implemented.
[0020] In a seventh aspect, the present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of any of the above-mentioned TV box simulating mouse interaction methods.
[0021] The above-mentioned TV box simulates mouse interaction method, device, computer equipment, computer-readable storage medium and computer program product, by establishing a connection with a touch screen terminal, and rendering the mouse on the TV interface, determining the first mouse position of the rendered mouse in the TV interface; determining the mouse offset data in response to the mouse movement instruction; the mouse movement instruction is determined by the touch screen terminal according to the touch point movement operation; the mouse position of the mouse in the TV interface is updated according to the first mouse position and the mouse offset data; if a mouse click instruction sent by the touch screen terminal in response to the mouse click operation is received, a click event is triggered at the second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position is updated matches the target mouse position. In the present application, by establishing a connection with the target touch-screen terminal and rendering the current mouse position, communication between the TV box and the external device is achieved, so that the user can control the TV interface through the touch-screen device, avoiding the button limitations of the traditional remote control; by obtaining the mouse target offset data of the touch-screen terminal and updating the target mouse position according to the offset data, the user can move quickly, and the movement of the mouse pointer on the TV box interface is achieved, so as to achieve the effect of accurately controlling the cursor position and improve the convenience and smoothness of the operation; by responding to the click operation of the touch-screen terminal, the click event is obtained and triggered, and accurate click feedback is achieved when the TV box is remotely operated, achieving an interactive effect similar to that of a physical mouse, ensuring that the user can accurately perform selection and confirmation operations on the interface, improving the overall interactive performance, and thus improving the interactive operation efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0023] FIG1 is a diagram showing an application environment of a method for simulating mouse interaction of a TV box in one embodiment;
[0024] FIG2 is a schematic diagram of a flow chart of a method for simulating mouse interaction of a TV box in one embodiment;
[0025] FIG3 is a schematic diagram of a flow chart of a method for simulating mouse interaction of a TV box in another embodiment;
[0026] FIG4 is a schematic diagram of a flow chart of a method for simulating mouse interaction of a TV box in another embodiment;
[0027] FIG5 is a schematic diagram of a touch screen terminal control application interface in one embodiment;
[0028] FIG6 is a schematic diagram of a mouse rendered on a TV interface by a TV box in one embodiment;
[0029] FIG. 7 is a structural block diagram of a device for simulating mouse interaction of a TV box in one embodiment;
[0030] FIG8 is a structural block diagram of a device for simulating mouse interaction of a TV box in another embodiment;
[0031] FIG. 9 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0032] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0033] In order to enable those skilled in the art to better understand the present application, the relevant technology is first introduced below.
[0034] With the rapid development of Bluetooth technology, its application in the field of smart devices has gradually matured. With its low power consumption, low cost and short-distance transmission characteristics, Bluetooth technology has become a widely used wireless communication solution in smart homes, smart wearables and other devices. In response to the user's operation needs on Android TVs or set-top boxes, there are currently a variety of Bluetooth-based technical solutions to improve the convenience and accuracy of interaction.
[0035] In traditional remote control operation, when users perform complex operations on the interface (such as browsing web pages, editing texts, playing games, etc.), they often need to press the direction keys multiple times, especially when moving from the upper left to the lower right or switching between multiple interfaces, the operation is cumbersome and not intuitive. In order to solve this problem, the present invention focuses on simulating the interaction mode of the mouse, so that users can also experience the mouse pointer control similar to computer operation on Android TV or set-top box, which is realized through Bluetooth remote control or supporting software, simulating the movement and click of the mouse through software methods, adapting to devices without touch screen or mouse hardware support, and further optimizing the Bluetooth communication protocol, which can achieve a smoother interactive experience with lower latency and power consumption.
[0036] The TV box simulation mouse interaction method provided in the embodiment of the present application can be applied to the application environment as shown in Figure 1, wherein the TV box is a device connected to the TV set, which has the function of receiving, parsing and executing instructions from the touch screen terminal. The TV box renders the mouse pointer on the TV interface as a visual feedback of the user control and responds to the input of the touch screen terminal. A touch screen terminal refers to a device equipped with a touch screen and supporting wireless communication, such as a smart phone or a tablet computer. As the user's operating interface, the touch screen terminal sends instructions to control the mouse pointer in the TV box, thereby realizing interactive control of the TV interface.
[0037] The Bluetooth transmission part can automatically scan and search for Bluetooth devices, and obtain relevant information such as the device name and address, so that users can select the device they want to connect to. At the same time, it can support the pairing process of Bluetooth devices, covering the connection methods of traditional Bluetooth and low-power Bluetooth (BLE). After the connection is established, data transmission can be realized, and different forms of data exchange such as file transfer and message exchange can be supported between connected devices. In addition, it also has a service discovery function. In a low-power Bluetooth (BLE) connection, it can discover the services and features provided by the target device, so that users can understand the functions and features of the device.
[0038] The remote control management part is divided into three parts: Bluetooth connector, remote mouse and mouse pointer constructor. The Bluetooth connector supports automatic search for nearby Bluetooth devices and lists available Bluetooth servers for users to choose to connect. After the connection is established, Bluetooth data can be sent and received, and real-time feedback on the connection status is provided, so that users can control the connection status. In the remote mouse part, the system supports touchpad mouse mode, which simulates the movement and click operations of the mouse through the touch screen, and provides simulation of click events such as single click and double click. Finally, the mouse pointer constructor provides the function of customizing the mouse pointer style, and the pointer can be personalized according to user needs.
[0039] In an exemplary embodiment, as shown in FIG2 , a method for simulating mouse interaction of a TV box is provided, and the method is applied to the TV box example in FIG1 for illustration. In this embodiment, the method includes the following steps, wherein:
[0040] Step S202, establishing a connection with the touch screen terminal, and performing mouse rendering on the TV interface, and determining a first mouse position of the rendered mouse on the TV interface.
[0041] Among them, the touch screen terminal refers to an electronic device with a touch screen, such as a smart phone or a tablet computer. The touch screen terminal is a device for user input and control, and sends control signals to the TV box through touch operation. The touch screen terminal may include but is not limited to devices that support wireless communication, especially devices based on Bluetooth technology.
[0042] The TV interface refers to the display interface connected to the TV box, usually a TV screen, which is used to display the user interface of the TV box. The TV interface provides a display basis for rendering the mouse pointer, and can intuitively present interactive operations such as mouse movement and clicking.
[0043] Mouse rendering refers to displaying a simulated mouse pointer on the TV interface, so that it can respond to input operations of the touch-screen terminal and generate movement and click feedback. Mouse rendering includes the drawing process of displaying the mouse position, and the mouse visibility and interactivity are achieved by adjusting the screen coordinates of the pointer.
[0044] The first mouse position is the initial rendering position of the mouse pointer on the TV interface, which may be the center point of the TV screen (or other preset position) to ensure that the user can clearly see the mouse pointer when starting the operation.
[0045] Exemplarily, the TV box first scans the surrounding Bluetooth devices, and pairs and connects after detecting the touch screen terminal. After this connection is established, the touch screen terminal can send control instructions. After the connection is established, the TV box renders a simulated mouse pointer on the TV interface. In one embodiment, the TV box initializes the mouse position. Assuming that the TV screen resolution to which the TV box is connected is 1920x1080 pixels, the initial rendering position can be set at the center point of the screen (960, 540), that is, the "first mouse position". When the mouse pointer is rendered, the screen coordinates of the first mouse position are recorded. The coordinates are used as the reference point in subsequent position updates, so that the offset data sent by the touch screen terminal can accurately adjust the specific position of the mouse on the screen.
[0046] Step S204, in response to the mouse movement instruction, determining the mouse offset data; the mouse movement instruction is determined by the touch screen terminal according to the touch point movement operation.
[0047] The mouse movement instruction refers to the control instruction sent from the touch screen terminal to the TV box, reflecting the operation of the user sliding his finger on the touch screen. The mouse movement instruction includes but is not limited to the movement time, the number of fingers involved in the movement, and the position information of the touch point movement, which is transmitted to the TV box via Bluetooth to control the movement of the mouse pointer on the TV interface.
[0048] Touch point movement operation refers to the sliding action performed by the user on the touch screen terminal, such as dragging a finger on the screen of a mobile phone. The touch screen terminal calculates the displacement of the mouse pointer every time the touch point position is updated.
[0049] Mouse offset data is displacement information generated based on the touch point movement operation, including the offset in horizontal and vertical coordinates. This data is used to calculate the next position of the mouse pointer in the TV interface to ensure that it can be updated in real time with the touch operation.
[0050] For example, when a user performs a sliding operation on a touch-screen terminal, the mobile event monitoring mechanism of the touch-screen terminal will record the difference between the two coordinates at the beginning and end of the user's sliding, which is the basis of the mouse offset data. The touch-screen terminal packages the calculated offset into a mouse movement instruction, and the instruction format contains the relative displacement information of the touch point, which is transmitted to the TV box via Bluetooth. On the TV box side, the mouse movement instruction is received and the offset data is parsed for subsequent updating of the mouse position on the TV screen.
[0051] Step S206: updating the mouse position of the mouse in the television interface according to the first mouse position and the mouse offset data.
[0052] The mouse position update refers to adjusting the current display coordinates of the mouse on the TV interface to new coordinates to reflect the user's touch screen operation. The update process obtains new screen coordinates by weighted calculation of the first mouse position and offset data to achieve smooth movement of the mouse on the interface.
[0053] Optionally, based on the first mouse position, a weight factor is added to the offset data to obtain the mouse update position. For example, the mouse update position can be obtained by adding the first mouse position to the product of the offset data and the mouse movement rate. The mouse is re-rendered at the mouse update position to enable users to feel the touch on different touch screen terminals.
[0054] Optionally, an update threshold of the offset data is set, and when the offset exceeds the update threshold, an update is performed to avoid interference from small touch actions.
[0055] Step S208, if a mouse click instruction is received from the touch screen terminal in response to a mouse click operation, a click event is triggered at the second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position is updated matches the target mouse position.
[0056] Among them, the mouse click operation is a single or double click action performed by the user on the touch screen terminal, which is triggered by the touch event of the touch screen terminal and converted into a control command and sent to the TV box to trigger the response of the TV interface. The mouse click command is a control command generated by the touch screen terminal after detecting the click operation, which contains relevant information of the click event and is sent to the TV box to notify the click trigger at the specified location. The command is transmitted to the box end via Bluetooth or other wireless communication methods.
[0057] The second mouse position indicates the final position of the mouse pointer after the update. It is the position where the mouse click command takes effect on the TV interface. This position is closely related to the click operation of the touch screen terminal. The target mouse position is the screen coordinate corresponding to the user's expected mouse position. It is used to verify the validity of the mouse click operation and ensure that the click event is only triggered when the mouse position matches the target position. This position can be determined by preset or dynamic calculation to improve the accuracy of the click operation.
[0058] Exemplarily, when a user performs a click operation on the touch screen terminal, the touch screen terminal generates a mouse click instruction after detecting the click event of the touch point, and sends it to the TV box via Bluetooth or other wireless transmission methods.
[0059] Optionally, a direct match is performed based on the coordinate values of the second mouse position and the target mouse position, and if the two are consistent, a click event is triggered.
[0060] Optionally, the click event is allowed to be triggered within a certain threshold range, that is, if the coordinate difference between the second mouse position and the target position is within a preset error range, the positions are considered to match, thereby triggering the click event.
[0061] For example, after the matching verification is passed, the TV box performs a click event operation at the current mouse position (second mouse position) to make the target area generate a corresponding interface response. The click effect will be reflected in the TV interface.
[0062] In the above-mentioned TV box simulating mouse interaction method, a connection is established with a touch screen terminal, and mouse rendering is performed on the TV interface to determine the first mouse position of the rendered mouse in the TV interface; in response to a mouse movement instruction, mouse offset data is determined; the mouse movement instruction is determined by the touch screen terminal according to the touch point movement operation; the mouse position of the mouse in the TV interface is updated according to the first mouse position and the mouse offset data; if a mouse click instruction is received and sent by the touch screen terminal in response to a mouse click operation, a click event is triggered at the second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position is updated matches the target mouse position. In this embodiment, by establishing a connection with the target touch-screen terminal and rendering the current mouse position, communication between the TV box and the external device is achieved, so that the user can control the TV interface through the touch-screen device, avoiding the button limitations of the traditional remote control; by obtaining the mouse target offset data of the touch-screen terminal and updating the target mouse position according to the offset data, the user can move quickly, and the movement of the mouse pointer on the TV box interface is achieved, so as to achieve the effect of accurately controlling the cursor position and improve the convenience and smoothness of the operation; by responding to the click operation of the touch-screen terminal, the click event is obtained and triggered, and accurate click feedback is achieved when the TV box is remotely operated, achieving an interactive effect similar to that of a physical mouse, ensuring that the user can accurately perform selection and confirmation operations on the interface, improving the overall interactive performance, and thus improving the interactive operation efficiency.
[0063] In an exemplary embodiment, mouse rendering is performed on a television interface, and a first mouse position of the rendered mouse in the television interface is determined, including: establishing a mouse floating window in the television interface; mouse rendering is performed on the mouse floating window, and a first mouse position of the rendered mouse in the mouse floating window is determined.
[0064] Among them, the mouse floating window is a virtual area within the TV screen used to render the mouse pointer. It can be suspended in the desktop application on the box end. This window is not an additional layer displayed independently of the TV interface, but a part of the TV interface to ensure the display stability of the mouse pointer and the continuity of operation control. It can be customized with the TV box manufacturer.
[0065] Specifically, after the TV box receives the connection request from the touch screen terminal and successfully connects, it establishes a mouse floating window within the TV screen. The size of the window is set according to the TV resolution and can cover the entire TV screen so that the mouse pointer can move freely within the entire interface. The mouse pointer is rendered in the mouse floating window, and the visual style of the mouse pointer can be customized, including color, size, etc., so that it is clearly visible on the TV screen. Based on the current mouse floating window, after the mouse rendering is completed, the rendered pointer position is marked as the first mouse position, and its coordinates are recorded.
[0066] In this embodiment, the mouse pointer is rendered in the window so that the user can clearly see the position of the mouse pointer on the interface, providing an intuitive operation starting point for subsequent interactions; the first mouse position is used as a reference point to ensure the accuracy of the pointer position update process, thereby improving the accuracy and smoothness of the touch screen terminal's operation of the TV interface.
[0067] In an exemplary embodiment, a mouse hovering window is established on a television interface, including: obtaining the television screen resolution, determining the window range of the mouse hovering window according to the television screen resolution, and establishing the mouse hovering window according to the window range; performing mouse rendering in the mouse hovering window, including: if the position of the mouse to be rendered is outside the window range of the mouse hovering window, determining the boundary of the mouse hovering window according to the window range, and performing mouse rendering at the boundary.
[0068] Specifically, when the TV box is started, the resolution of the current TV screen is obtained, and according to the resolution, the range of the mouse floating window is set to the entire screen size. If the position to be rendered is within the window range, the pointer is directly displayed at this position; at this time, the mouse position can accurately respond to user input. If the position of the mouse to be rendered exceeds the window range, the pointer is limited to the window according to the boundary of the mouse floating window. In one embodiment, the resolution of the TV screen connected to the TV box is 1920x1080 pixels. According to the resolution, the range of the mouse floating window is set to the screen range from coordinates (0, 0) to (1920, 1080). This full-screen range of mouse floating window settings ensures that the mouse pointer can move within the entire TV interface. If the position to be rendered is at (960, 540), the position is within the range of 1920x1080, and the pointer is directly displayed at this position. If the position to be rendered of the mouse is the coordinates (2000, 1200), since the horizontal coordinate is limited to the maximum value of 1920 and the vertical coordinate is limited to 1080, the mouse is rendered at the lower right corner of the screen (1920, 1080). Even if the user tries to move the mouse pointer off the screen, the pointer is still constrained to the edge of the visible area, thus preventing the mouse pointer from visually disappearing.
[0069] In this embodiment, by dynamically setting the size of the floating window according to the TV resolution, the mouse active area perfectly matches the TV screen, ensuring the accuracy of mouse pointer operations. At the same time, when the pointer exceeds the expected position, it is automatically corrected to the boundary position, avoiding invalid out-of-bounds operations and improving the tolerance for user operations.
[0070] In an exemplary embodiment, the mouse position of the mouse in the TV interface is updated according to the first mouse position and the mouse offset data, including: determining the horizontal coordinate and the vertical coordinate of the mouse in the TV interface according to the first mouse position; parsing the mouse offset data to obtain a first offset and a second offset; and superimposing the horizontal coordinate and the vertical coordinate with the first offset and the second offset, respectively, to obtain a second mouse position.
[0071] Specifically, after the mouse is rendered for the first time, the coordinates (X0, Y0) of the first mouse position are recorded, and the coordinate point represents the starting position of the mouse pointer in the TV interface. The touch screen terminal generates mouse offset data according to the user's sliding operation, which includes relative displacement information. The offset data is parsed to obtain a first offset and a second offset, which correspond to the horizontal axis ΔX and the vertical axis ΔY, respectively. After determining the first mouse position and the offset, the horizontal coordinate X0 of the first mouse position is added to the first offset ΔX to obtain an updated horizontal coordinate X_new=X0+ΔX; similarly, the vertical coordinate Y0 is added to the second offset ΔY to obtain an updated vertical coordinate Y_new=Y0+ΔY. The new mouse position (X_new, Y_new) is the second position of the mouse.
[0072] In this embodiment, based on the accurate superposition calculation of the first mouse position and the offset, the position change of the mouse pointer accurately reflects the sliding trajectory of the user, thereby ensuring the accuracy of the pointer movement on the screen.
[0073] In an exemplary embodiment, the TV box determines the mouse vibration pattern corresponding to the operation posture and operation intensity in response to the operation posture and operation intensity of the touch screen terminal; and renders the mouse vibration based on the intensity and duration corresponding to the mouse vibration pattern.
[0074] Specifically, the touch screen terminal detects the user's operating posture (such as single click, double click, long press, etc.) and operation intensity (such as light touch or heavy press) in real time. When the user performs a specific posture operation on the touch screen terminal, the terminal records the pressing force and time and generates a data packet, which is sent to the TV box via Bluetooth connection. After the TV box parses the data packet, it identifies the user's specific operating posture and operation intensity. The TV box matches the corresponding vibration pattern in the preset vibration pattern table based on the received posture and intensity data. After matching the applicable vibration pattern, the TV box controls the mouse pointer to vibrate based on the pattern. For example, when the user presses the touch screen hard, the mouse pointer vibrates at a high intensity on the TV interface to simulate the tactile feeling of real pressing.
[0075] In this embodiment, by matching the combination of operation posture and intensity, the user can obtain more delicate vibration feedback, generate diversified feedback effects according to different operations, and make the interactive experience richer. By providing unique interactive functions, it not only enhances the market competitiveness of the product, but also attracts more consumers. This innovative control method not only optimizes the user experience, but also promotes the expansion technology of smart home TV boxes, bringing users a more intelligent life experience.
[0076] In an exemplary embodiment, as shown in FIG3 , another method for simulating mouse interaction of a TV box is provided, which is described by taking application to a touch screen terminal as an example, and may include the following steps:
[0077] Step S302, establishing a connection with a TV box; the TV box is used to render a mouse on a TV interface and determine a first mouse position of the rendered mouse on the TV interface.
[0078] Exemplarily, the user starts the control application on the touch screen terminal and searches for surrounding Bluetooth or Wi-Fi devices to find the TV box. After detecting the TV box, the touch screen terminal initiates a connection request. After the connection is established, the TV box starts the mouse rendering function and displays a simulated mouse pointer on the TV interface. After the mouse rendering is completed, the system records the current rendering position as the "first mouse position" and uses this position as the reference point for subsequent operations.
[0079] Step S304, in response to the touch point movement operation, determine the mouse offset data, and send a mouse movement instruction carrying the mouse offset data to the TV box; the mouse movement is specified to trigger the TV box to update the mouse position of the mouse in the TV interface according to the first mouse position and the mouse offset data.
[0080] Specifically, the user drags his finger on the touch screen terminal, and the touch screen terminal records the changes in the starting and ending positions, and obtains the mouse offset data by calculating the horizontal and vertical displacements. The touch screen terminal packages the offset data into a mouse movement instruction, including the horizontal and vertical offsets. The instruction is sent to the TV box via Bluetooth or Wi-Fi to control the position update of the mouse on the TV interface.
[0081] Step S306, in response to the mouse click operation, a mouse click instruction is sent to the TV box to trigger the TV box to trigger a click event at the second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position is updated matches the target mouse position.
[0082] Exemplarily, when a user performs a single-click operation on a touch-screen terminal, the touch-screen terminal detects the touch position and click type, and then generates a corresponding mouse click instruction. The instruction contains the target position that triggers the click event (i.e., the mouse position when the user clicks), and is sent to the TV box via Bluetooth communication. In order to ensure the accuracy of the click event, the TV box checks the match between the second mouse position and the target mouse position before triggering the event. If the coordinates of the second mouse position and the target position completely coincide or are within the set error range, the click is confirmed to be valid, and the system executes the click event at that position.
[0083] In this embodiment, the user only needs to use the touch screen terminal at hand to control the TV interface, without the need for a traditional remote control or mouse, thereby improving the universality and ease of use of the interactive device. At the same time, through the mouse offset data and position update mechanism, the matching confirmation function of the click command reduces the possibility of misoperation, and the user's sliding and clicking operations can be instantly and accurately fed back on the TV screen, thereby improving the efficiency of interactive operations.
[0084] In an exemplary embodiment, the following steps may also be included: in response to the touch point movement operation, determining the mouse offset data corresponding to each preset time interval; determining the mouse movement direction and movement speed according to the mouse offset data corresponding to each preset time interval, and sending the movement direction and movement speed to the TV box so that the TV box renders the mouse movement trajectory.
[0085] Specifically, when the user slides his finger on the touch screen terminal, the system samples the position of the touch point once at each time interval (such as 50ms), and the touch screen terminal calculates the direction and speed of the mouse movement based on the mouse offset data at each time interval. The touch screen terminal packages the calculated movement direction and speed into instructions and sends them to the TV box via Bluetooth. After receiving the instructions, the TV box renders the movement trajectory of the mouse pointer according to the direction and speed in the TV interface. The TV box renders the pointer trajectory based on the received direction and speed data, so that the mouse moves smoothly in the TV interface. With the direction and speed data updated in each time interval, the pointer trajectory will be rendered continuously until the user stops the sliding operation.
[0086] In this embodiment, through data transmission based on movement direction and speed, the TV box achieves accurate pointer trajectory rendering, which improves the continuity and responsiveness of the operation and effectively improves the user experience of remote control.
[0087] In an exemplary embodiment, as shown in FIG4 , a user starts an application on a touch screen terminal, which is used to control a Bluetooth device connected to a TV box, thereby realizing the function of remotely controlling the TV interface. After the application is started, it enters the device connection management mode. Enter the device connection management interface and prepare to scan and connect to available Bluetooth devices. The management interface displays the current connection status of the device and allows the user to view and select surrounding Bluetooth devices. The scanning operation lists the names and basic information of all available devices for the user to select the target device to connect to.
[0088] Before scanning Bluetooth devices, first check whether the touch screen terminal has the relevant permissions for Bluetooth connection, device positioning, and network status access. These permissions ensure that the device can discover and pair with nearby Bluetooth devices. If the permissions are met, the touch screen terminal starts the actual Bluetooth device scan and lists all available devices within the scan range. Users can view the name or logo of the target device (TV box) in the scan results to connect.
[0089] After the user selects a TV box from the device list, the touch screen terminal sends a pairing request to the selected TV box. After the TV box receives the request, the system will verify it according to the preset pairing method to ensure the security of the connection between the two parties.
[0090] The system checks whether the pairing is successful to ensure the stability of the Bluetooth connection. If the pairing is successful, a Bluetooth connection is established between the touch screen terminal and the TV box. At this point, the touch screen terminal can transmit control signals via Bluetooth to achieve further control operations on the TV box.
[0091] After the connection is established, the system checks the Bluetooth connection status to ensure that the connection is stable. If the connection is normal, the touch screen terminal automatically jumps to the remote control operation interface. The interface includes a touch pad, mouse click button, return button and other control components to provide users with comprehensive remote control functions.
[0092] The user uses various functions of the remote control interface on the touch-screen terminal, and operates the touchpad or buttons through gestures such as clicking, sliding, and long pressing to send instructions to the TV box. The touch-screen terminal generates corresponding control instructions based on the user's gestures and sends them to the TV box via Bluetooth. On the TV box side, the system receives the mouse movement instructions sent by the touch-screen terminal and controls the movement of the mouse pointer on the TV interface. The user's gesture operation is accurately mapped to the TV screen, and the user can control the real-time movement of the mouse pointer on the screen by sliding his finger on the touch-screen terminal.
[0093] When the user has completed all operations, he can choose to disconnect the Bluetooth connection. The connection between the touch screen terminal and the TV box is disconnected, the remote control operation ends, and the process returns to the initial state.
[0094] In this embodiment, through permission checking, pairing verification and connection status detection, the connection between the touch screen terminal and the TV box is ensured to be reliable, and the stability and security of the entire interaction process are enhanced. At the same time, the control signal is transmitted through the Bluetooth connection, and the user's operation gestures can be quickly mapped to the TV interface, providing real-time feedback, thereby improving the efficiency of operation interaction.
[0095] In order to enable those skilled in the art to better understand the above steps, the embodiment of the present application is illustrated below by using an example, but it should be understood that the embodiment of the present application is not limited to this.
[0096] In an exemplary embodiment, the user starts a control application on the touch screen terminal. The control application interface is shown in FIG5 . The control application automatically scans the surrounding TV box devices that support Bluetooth communication and sends a connection request. On the TV box side, after receiving the connection request, a handshake protocol is executed to establish a stable connection channel. Through this channel, the touch screen terminal will be able to transmit mouse control instructions to the TV box in real time, providing users with cross-device remote operation capabilities.
[0097] After the connection is successful, the TV box renders a mouse pointer on the TV interface, as shown in Figure 6. The initial position of the mouse pointer is set to the default area of the TV interface, such as the center of the screen, to ensure that the user can quickly find the mouse pointer at the beginning of the operation. The initial position is recorded as the "first mouse position" as the reference point for subsequent offset calculations. This rendering operation ensures that the user can clearly see the position of the pointer before sliding or clicking on the touch screen terminal, providing a visual basis for interaction.
[0098] The user starts sliding his finger on the touch screen terminal. The touch sensor of the touch screen terminal responds to the touch point movement operation and collects the position information of the sliding track in each preset time interval. The displacement data in each time interval is extracted as the offset data of the mouse, including the displacement in the horizontal and vertical directions. The touch screen terminal packages these offset data, generates mouse movement instructions, and sends them to the TV box through the connection channel.
[0099] After receiving the mouse movement command sent by the touch screen terminal, the TV box parses the offset data in the command to calculate the new position of the mouse pointer. According to the coordinates of the first mouse position, the offset is superimposed to calculate the new coordinate position, and the mouse pointer is rendered at this position to update the mouse position. This update operation ensures that the mouse pointer can continuously respond to the user's sliding action on the touch screen terminal, so that the movement trajectory of the pointer conforms to the user's operation trajectory.
[0100] When the user performs continuous sliding operations, the touch screen terminal regularly samples the offset data of the touch point position and calculates the mouse movement direction and movement speed based on the offset at each time interval. This information includes the direction angle of the pointer and the distance moved within a specified time. The touch screen terminal packages the movement direction and speed data into trajectory instructions and sends them to the TV box via Bluetooth connection.
[0101] After receiving the trajectory command, the TV box renders the trajectory of the mouse pointer according to the movement direction and speed information. The mouse pointer moves smoothly along the direction of the touch screen terminal sliding, and the speed is consistent with the user's sliding speed. Therefore, the mouse pointer in the TV interface shows a continuous movement effect that conforms to the user's touch screen sliding trajectory, bringing natural visual feedback and smooth interactive experience to users.
[0102] When a user performs a click operation (such as single click, double click or long press) on a touch screen terminal, the touch screen terminal detects the click event and records the coordinates of the pointer position, generating a mouse click instruction. The instruction carries the click type and corresponding coordinate information, and is transmitted to the TV box via a wireless connection.
[0103] On the TV box side, after receiving the mouse click command, check whether the current pointer position, that is, the "second mouse position", matches the target mouse position. If the match is successful, a click event is triggered at that position, such as activating an interface element, selecting content, or entering a new page. This matching mechanism ensures the accuracy of the click event and avoids false triggering due to pointer offset.
[0104] During a user's click or slide operation, a corresponding mouse vibration pattern is generated based on the operation posture and operation intensity detected by the touch screen terminal. The vibration pattern includes the intensity and duration of the vibration, which is used to provide tactile feedback to the user and simulate a real touch experience.
[0105] The touch screen terminal generates vibration instructions based on the operation posture and intensity, and sends them to the TV box. After the TV box analyzes the vibration pattern, it renders the corresponding vibration effect on the TV interface, allowing the user to obtain tactile feedback. For example, a light touch can trigger a short, slight vibration feedback, while a heavy or long press may trigger a strong, continuous vibration feedback. Through vibration feedback, users can intuitively perceive the operation effect, enhancing the realism of the interaction and the immersiveness of the operation.
[0106] In this embodiment, the user can control the TV box through the touch screen terminal without a physical remote control or mouse, making the applicability of the interactive device more extensive. The real-time rendering, trajectory display and position update of the mouse pointer on the TV interface ensure that the user's touch operation receives smooth feedback; through position verification and click confirmation, the user's click command can be accurately triggered at the target position, improving the accuracy of the operation; through vibration feedback and movement trajectory rendering, the user's touch experience is more natural and immersive, achieving a multi-sensory interaction effect.
[0107] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0108] Based on the same inventive concept, the embodiment of the present application also provides a TV box simulating mouse interaction device for implementing the TV box simulating mouse interaction method involved above and applying it to a TV box. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the one or more TV box simulating mouse interaction device embodiments provided below can refer to the limitations of the TV box simulating mouse interaction method above, and will not be repeated here.
[0109] In an exemplary embodiment, as shown in FIG. 7 , a TV box simulating mouse interaction device 700 is provided, which is applied to a TV box and includes: a communication connection and mouse rendering module 710, a mouse offset determination module 720, a mouse position update module 730 and a mouse click trigger module 740, wherein:
[0110] The communication connection and mouse rendering module 710 is used to establish a connection with the touch screen terminal, and to perform mouse rendering on the TV interface and determine the first mouse position of the rendered mouse in the TV interface.
[0111] The mouse offset determination module 720 is used to respond to a mouse movement instruction and determine mouse offset data; the mouse movement instruction is determined by the touch screen terminal according to a touch point movement operation.
[0112] The mouse position updating module 730 is used to update the mouse position of the mouse in the television interface according to the first mouse position and the mouse offset data.
[0113] The mouse click trigger module 740 is used to trigger a click event at the second mouse position where the mouse is currently located if a mouse click instruction is received from the touch screen terminal in response to a mouse click operation; the mouse click operation occurs when the second mouse position obtained after the mouse position is updated matches the target mouse position.
[0114] In one embodiment, the communication connection and the mouse rendering module 710 are also used to perform mouse rendering on a television interface and determine a first mouse position of the rendered mouse in the television interface, including: establishing a mouse floating window on the television interface; performing mouse rendering in the mouse floating window, and determining the first mouse position of the rendered mouse in the mouse floating window.
[0115] In one embodiment, the communication connection and mouse rendering module 710 are also used to establish a mouse floating window on a TV interface, including: obtaining the TV screen resolution, determining the window range of the mouse floating window according to the TV screen resolution, and establishing the mouse floating window according to the window range; performing mouse rendering in the mouse floating window, including: if the position of the mouse to be rendered is outside the window range of the mouse floating window, determining the boundary of the mouse floating window according to the window range, and performing mouse rendering at the boundary.
[0116] In one embodiment, the mouse position update module 730 is also used to update the mouse position of the mouse in the TV interface according to the first mouse position and the mouse offset data, including: determining the horizontal coordinate and vertical coordinate of the mouse in the TV interface according to the first mouse position; parsing the mouse offset data to obtain a first offset and a second offset; and superimposing the horizontal coordinate and the vertical coordinate with the first offset and the second offset respectively to obtain the second mouse position.
[0117] In one embodiment, the mouse click trigger module 740 is also used to determine the mouse vibration pattern corresponding to the operation posture and operation intensity in response to the operation posture and operation intensity of the touch screen terminal; and to render the mouse vibration based on the intensity and duration corresponding to the mouse vibration pattern.
[0118] In an exemplary embodiment, as shown in FIG8 , another TV box simulating mouse interaction device 800 is provided, which is applied to a touch screen terminal and includes: a communication connection module 810, a mouse movement instruction sending module 820 and a mouse click instruction sending module 830, wherein:
[0119] The communication connection module 810 is used to establish a connection with a TV box; the TV box is used to render a mouse on a TV interface and determine a first mouse position of the rendered mouse on the TV interface;
[0120] The mouse movement instruction sending module 820 is used to determine the mouse offset data in response to the touch point movement operation, and send a mouse movement instruction carrying the mouse offset data to the TV box; the mouse movement is used to trigger the TV box to update the mouse position of the mouse in the TV interface according to the first mouse position and the mouse offset data;
[0121] The mouse click instruction sending module 830 is used to send a mouse click instruction to the TV box in response to a mouse click operation, so as to trigger the TV box to trigger a click event at the second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position is updated matches the target mouse position.
[0122] In one embodiment, the mouse movement instruction sending module 820 is also used to determine the mouse offset data corresponding to each preset time interval in response to the touch point movement operation; determine the movement direction and movement speed of the mouse according to the mouse offset data corresponding to each preset time interval, and send the movement direction and the movement speed to the TV box so that the TV box renders the mouse movement trajectory.
[0123] Each module in the above-mentioned TV box simulated mouse interaction device can be implemented in whole or in part by software, hardware and a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.
[0124] In an exemplary embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be shown in FIG9. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. The processor, the memory, and the input / output interface are connected via a system bus, and the communication interface, the display unit, and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, a method for simulating mouse interaction of a TV box is implemented. The display unit of the computer device is used to form a visually visible picture, which may be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.
[0125] Those skilled in the art will understand that the structure shown in FIG. 9 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.
[0126] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.
[0127] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.
[0128] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.
[0129] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.
[0130] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.
[0131] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.
[0132] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A TV box simulating mouse interaction method, characterized in that: Applied to a TV box, the method comprises: Establishing a connection with a touch screen terminal, and performing mouse rendering on a television interface, and determining a first mouse position of the rendered mouse in the television interface; In response to a mouse movement instruction, determining mouse offset data; the mouse movement instruction is determined by the touch screen terminal according to a touch point movement operation; updating the mouse position of the mouse in the television interface according to the first mouse position and the mouse offset data; If a mouse click instruction is received from the touch screen terminal in response to a mouse click operation, a click event is triggered at the second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position is updated matches the target mouse position.
2. The method according to claim 1, characterized in that The performing mouse rendering on the TV interface and determining a first mouse position of the rendered mouse in the TV interface includes: Create a mouse floating window on the TV interface; Mouse rendering is performed in the mouse floating window, and the first mouse position of the mouse in the mouse floating window obtained by rendering is determined.
3. The method according to claim 2, characterized in that The step of establishing a mouse floating window on the TV interface includes: Acquire a TV screen resolution, determine a window range of the mouse floating window according to the TV screen resolution, and establish the mouse floating window according to the window range; The performing mouse rendering in the mouse floating window includes: If the position of the mouse to be rendered is outside the window range of the mouse floating window, the boundary of the mouse floating window is determined according to the window range, and the mouse rendering is performed at the boundary.
4. The method according to claim 1, characterized in that: The updating of the mouse position of the mouse in the television interface according to the first mouse position and the mouse offset data includes: Determining the horizontal coordinate and the vertical coordinate of the mouse on the TV interface according to the first mouse position; Parsing the mouse offset data to obtain a first offset and a second offset; The horizontal coordinate and the vertical coordinate are respectively superimposed with the first offset and the second offset to obtain the second mouse position.
5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: In response to an operation posture and an operation intensity of the touch screen terminal, determining a mouse vibration mode corresponding to the operation posture and the operation intensity; Vibration rendering is performed on the mouse based on the intensity and duration corresponding to the mouse vibration pattern.
6. A method for simulating mouse interaction of a TV box, characterized in that: Applied to a touch screen terminal, the method comprises: Establishing a connection with a TV box; the TV box is used to render a mouse on a TV interface, and determining a first mouse position of the rendered mouse on the TV interface; In response to the touch point movement operation, mouse offset data is determined, and a mouse movement instruction carrying the mouse offset data is sent to the TV box; the mouse movement is designated to trigger the TV box to update the mouse position of the mouse in the TV interface according to the first mouse position and the mouse offset data; In response to a mouse click operation, a mouse click instruction is sent to the TV box to trigger the TV box to trigger a click event at a second mouse position where the mouse is currently located; the mouse click operation occurs when the second mouse position obtained after the mouse position is updated matches the target mouse position.
7. The method according to claim 6, characterized in that The method further comprises: In response to the touch point movement operation, determining mouse offset data corresponding to each preset time interval; According to the mouse offset data corresponding to each preset time interval, the moving direction and the moving speed of the mouse are determined, and the moving direction and the moving speed are sent to the TV box so that the TV box renders the mouse movement trajectory.
8. A TV box simulating mouse interaction device, characterized in that: Applied to a TV box, the device comprises: A communication connection and mouse rendering module, used to establish a connection with a touch screen terminal, and to perform mouse rendering on a television interface and determine a first mouse position of the rendered mouse on the television interface; A mouse offset determination module, used to respond to a mouse movement instruction and determine mouse offset data; the mouse movement instruction is determined by the touch screen terminal according to a touch point movement operation; A mouse position updating module, configured to update the mouse position of the mouse in the television interface according to the first mouse position and the mouse offset data; The mouse click trigger module is used to trigger a click event at the second mouse position where the mouse is currently located if a mouse click instruction is received from the touch screen terminal in response to a mouse click operation; the mouse click operation occurs when the second mouse position obtained after the mouse position is updated matches the target mouse position.
9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the TV box simulating mouse interaction method described in any one of claims 1 to 5 or the steps of the TV box simulating mouse interaction method described in any one of claims 6 to 7 are implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the TV box simulating mouse interaction method described in any one of claims 1 to 5 or the steps of the TV box simulating mouse interaction method described in any one of claims 6 to 7 are implemented.