A cursor control method and electronic device

Abstract

The present application provides a cursor control method and electronic device, which is applied to a first electronic device, and includes: receiving a first instruction sent by a second electronic device, and displaying the cursor in a static state according to the first instruction; receiving a second instruction sent by the second electronic device, and changing the cursor from the static state to a pointing state according to the second instruction, and moving the cursor, the focus on which the cursor currently stops, and at least one of the list displayed on the screen of the first electronic device on the screen of the first electronic device, and displaying the cursor in the static state when the cursor or the list stops moving; receiving a third instruction sent by the second electronic device, and playing a picture corresponding to the target focus on which the cursor stops according to the third instruction. The present application can solve the problem that pointing interaction is difficult to control accurately, prevent cursor jitter caused by user misoperation, thereby achieving efficient interaction and improving user experience.

Description

Technical Field

[0001] This application relates to the field of electronic devices, and more particularly to a cursor control method and an electronic device. Background Technology

[0002] With the continuous development of smart screens, more and more companies are migrating their mobile applications to smart screens to expand their large-screen ecosystem. Currently, the industry commonly uses the active pointing method, where users hold the remote control and actively point it at the large screen to operate it. Although this active pointing method is simple and easy to learn, the user experience is poor in actual operation, and efficient interaction cannot be achieved.

[0003] Specifically, when a user actively points their mobile remote control at the large screen to operate it, many non-pointing actions can also cause changes in the remote control's posture, resulting in cursor movement. For example, when a user selects to play video 1 and clicks or swipes on the remote control, the remote control's posture changes, causing the cursor, which should be displayed on video 1, to move to another position on the large screen. This mistakenly turns on the focus of the cursor's final location, degrading the user experience. Summary of the Invention

[0004] This application provides a cursor control method and an electronic device that can solve the problem of difficult-to-control pointing interaction, achieve efficient interaction, and improve user experience.

[0005] In a first aspect, a cursor control method is provided, the method being applied to a first electronic device, the method comprising:

[0006] The system receives a first instruction from the second electronic device and displays the cursor as stationary according to the first instruction; receives a second instruction from the second electronic device and changes the cursor from the stationary state to a pointing state according to the second instruction, and moves the cursor, the current focus of the cursor, and at least one of the lists displayed on the screen of the first electronic device on the screen of the first electronic device, and displays the cursor as stationary when the cursor or the list stops moving, wherein when the cursor is displayed as pointing, the cursor, the current focus of the cursor, and at least one of the lists are movable, and when the cursor is displayed as stationary, the cursor, the current focus of the cursor, and the list are immovable; receives a third instruction from the second electronic device and plays the screen corresponding to the target focus where the cursor is located according to the third instruction.

[0007] The solution provided in this application embodiment allows a first electronic device to display the cursor as stationary according to a first instruction sent by a second electronic device. While the cursor is stationary, the first electronic device can change the cursor to a pointing state according to a second instruction sent by the second electronic device, and move the cursor, the current focus of the cursor, and at least one item from the list displayed on the screen of the first electronic device. When the movement stops, the cursor remains stationary. Furthermore, the first electronic device can play the image corresponding to the target focus where the cursor stopped moving according to a received third instruction. The solution provided in this application embodiment, by distinguishing the cursor's state—that when the cursor is in a pointing state, the first electronic device can move the cursor, the current focus of the cursor, and at least one item from the list according to a received instruction, and when the cursor is stationary, the cursor, the current focus of the cursor, and the list cannot be moved—solves the problem of difficult precise control of pointing interaction, prevents cursor jitter caused by user misoperation, thereby achieving efficient interaction and improving user experience.

[0008] In conjunction with the first aspect, in some possible implementations, the second instruction is used to instruct the cursor to move in a first direction and move a first distance; the step of changing the cursor from the stationary state to the pointing state according to the second instruction, and the cursor, the current focus of the cursor, and at least one of the list displayed on the screen of the first electronic device moving on the screen of the first electronic device, includes: changing the cursor from the stationary state to the pointing state according to the second instruction, and moving the cursor on the screen of the first electronic device in the first direction and moving it a first distance.

[0009] The solution provided in this application embodiment is that the second instruction instructs the cursor to move in the first direction and move a first distance. At this time, the first electronic device can move the cursor on the screen of the first electronic device in the first direction and move a first distance according to the second instruction. That is, the first electronic device can accurately move the cursor according to the second instruction, which can solve the problem of difficult precise control of pointing interaction, thereby further realizing efficient interaction and improving user experience.

[0010] In conjunction with the first aspect, in some possible implementations, the cursor in the pointing state presents a first state, which represents the direction of cursor movement.

[0011] The solution provided in this application embodiment presents a first state when the cursor is in the pointing state. This first state represents the direction of cursor movement. This design can better provide feedback on the interaction status to the user, thereby improving the user experience.

[0012] In conjunction with the first aspect, in some possible implementations, the second instruction is used to instruct the list displayed on the screen of the first electronic device to move in a second direction and move a second distance; the step of changing the cursor from the stationary state to the pointing state according to the second instruction, and moving at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device on the screen of the first electronic device, includes: changing the cursor from the stationary state to the pointing state according to the second instruction, and moving the list on the screen of the first electronic device in the second direction and moving the list a second distance on the screen of the first electronic device.

[0013] The solution provided in this application embodiment is that the second instruction instructs the list displayed on the screen of the first electronic device to move in a second direction and move a second distance. At this time, the first electronic device can move the list on the screen of the first electronic device in the second direction and move a second distance according to the second instruction. That is, the first electronic device can accurately move the list displayed on the screen of the first electronic device according to the second instruction, which can further realize efficient interaction and improve user experience.

[0014] In conjunction with the first aspect, in some possible implementations, the cursor in the pointing state presents a second state, which characterizes the direction of the list movement and the magnitude of the cursor deformation.

[0015] The solution provided in this application embodiment presents a second state when the cursor is in a pointing state. This second state represents the direction of movement of the list displayed on the screen of the first electronic device and the magnitude of the cursor deformation. This design can better provide feedback to the user on the interaction status, thereby improving the user experience.

[0016] In conjunction with the first aspect, in some possible implementations, the second instruction includes moving the cursor in a third direction and moving it a third distance; the step of changing the cursor from the stationary state to the pointing state according to the second instruction, and moving at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device on the screen of the first electronic device, includes: changing the cursor from the stationary state to the pointing state according to the second instruction, and moving the cursor and the current focus of the cursor on the screen of the first electronic device by the third distance in the third direction.

[0017] The solution provided in this application embodiment indicates that the second instruction moves the cursor in a third direction and moves it a third distance. At this time, the first electronic device can move the cursor and the focus where the cursor is currently located on the screen of the first electronic device in a third direction according to the second instruction. That is, the first electronic device can accurately move the cursor and the focus where the cursor is currently located according to the second instruction, which can further realize efficient interaction and improve user experience.

[0018] In conjunction with the first aspect, in some possible implementations, the cursor presents a third state, which represents the direction of movement of the cursor and the focus on which the cursor rests.

[0019] The solution provided in this application embodiment presents a third state when the cursor is in a pointing state. This third state represents the direction of movement of the cursor and the focus where the cursor is located. This design can better provide feedback on the interaction status to the user, thereby improving the user experience.

[0020] In conjunction with the first aspect, in some possible implementations, the method further includes: receiving a fourth instruction sent by the second electronic device, and displaying a function box according to the fourth instruction, the function box including function keys for controlling the screen currently displayed by the first electronic device.

[0021] The solution provided in this application embodiment allows a first electronic device to receive a fourth instruction sent by a second electronic device and display a function box according to the fourth instruction. The function box includes function keys for controlling the screen currently displayed by the first electronic device. This application embodiment provides a method for displaying a function box. This design can be distinguished from pointing or sliding operations, and the currently displayed screen can be adjusted through the function keys.

[0022] In conjunction with the first aspect, in some possible implementations, if the cursor is moved out of the screen of the first electronic device according to the second instruction, the cursor in the pointing state displays a fourth state, the fourth state representing the direction in which the cursor moves out of the screen of the first electronic device and the extent by which the cursor moves out of the screen of the second electronic device; the method further includes: receiving a fifth instruction sent by the second electronic device, and displaying the cursor on the screen of the first electronic device according to the fifth instruction.

[0023] The solution provided in this application embodiment allows a first electronic device to receive a fifth instruction sent by a second electronic device and redisplay the cursor on the screen of the first electronic device according to the fifth instruction. During the process of the first electronic device redisplaying the cursor on its screen according to the fifth instruction, the cursor shape changes accordingly. The degree of cursor deformation can represent the angle at which the second electronic device's posture deviates from that of the first electronic device. This animation design can better provide feedback to the user on the interaction status, thereby improving the user experience. In particular, when the first electronic device moves the cursor off its screen according to the second instruction, the solution provided in this application embodiment can make the cursor redisplay on the screen of the first electronic device, and the degree of cursor deformation can indicate the angle at which the second electronic device's posture deviates from that of the first electronic device, further enhancing the user experience.

[0024] Secondly, a cursor control method is provided, the method being applied to a second electronic device, the method comprising:

[0025] In response to a first user operation, a first instruction is generated, which instructs the cursor displayed on the first electronic device to display a stationary state; the first instruction is sent to the first electronic device; in response to a second user operation, a second instruction is generated, which instructs the cursor to change from the stationary state to a pointing state, and that when the cursor is displayed in the pointing state, at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device moves in a direction and / or a distance on the screen of the first electronic device, and the cursor displays the stationary state when the cursor or the list stops moving, wherein when the cursor is displayed in the pointing state, the cursor, the current focus of the cursor, and at least one of the list are movable, and when the cursor is displayed in the stationary state, the cursor, the current focus of the cursor, and the list are immovable; the second instruction is sent to the first electronic device; in response to a third user operation, a third instruction is generated, which instructs the playback of the image corresponding to the target focus where the cursor is located; the third instruction is sent to the first electronic device.

[0026] The solution provided in this application embodiment, in response to a user's first operation, allows a second electronic device to generate a first instruction and send the first instruction to the first electronic device, so that the first electronic device can display the cursor as stationary according to the first instruction; in response to a user's second operation, the second electronic device can generate a second instruction and send the second instruction to the first electronic device, so that the first electronic device can change the cursor to a pointing state according to the second instruction, and move the cursor, the current focus of the cursor, and at least one of the lists displayed on the screen of the first electronic device, on the screen of the first electronic device, and when the movement stops, the cursor is displayed as stationary; in response to a user's third operation, the second electronic device generates a third instruction and sends the third instruction to the first electronic device, so that the first electronic device can play the image corresponding to the target focus where the cursor stopped moving according to the received third instruction. The solution provided in this application embodiment allows the second electronic device to generate different instructions in response to different user operations, so that the first electronic device can perform corresponding operations according to the received instructions. Specifically, when the cursor is in a pointing state, the cursor, the current focus of the cursor, and at least one item in the list are moved. When the cursor is in a stationary state, the cursor, the current focus of the cursor, and the list cannot be moved. This can solve the problem of difficult precise control of pointing interaction, prevent cursor jitter caused by user misoperation, thereby achieving efficient interaction and improving user experience.

[0027] In conjunction with the second aspect, in some possible implementations, generating a second instruction in response to a user's second operation includes: in response to the second operation, determining the operation type of the second operation, the operation type including a pointing operation and a sliding operation; and generating the second instruction based on the operation type of the second operation.

[0028] The solution provided in this application embodiment, in response to a second operation, allows a second electronic device to first determine the operation type of the second operation, and then generate a second instruction more accurately based on the operation type of the second operation and send it to the first electronic device. This allows the first electronic device to perform a corresponding action based on the second instruction. Since the second instruction is generated based on the operation type of the second operation, in other words, the content of the second instruction can reflect the user's operation on the second electronic device. This allows the first electronic device to synchronize with the user's second operation when performing a corresponding operation based on the second instruction. For example, if the second operation is a pointing operation, the first electronic device can move the cursor and / or the focus where the cursor is located based on the pointing operation, without sliding the list. This can further achieve efficient interaction and improve the user experience.

[0029] In conjunction with the second aspect, in some possible implementations, determining the operation type of the second operation in response to the second operation includes: in response to the second operation, determining the magnitude of the value corresponding to the movement trajectory and a first threshold, or determining the magnitude of the angle difference and a second threshold, wherein the movement trajectory is the movement trajectory of a finger acting on the screen of the second electronic device, which is included in the second operation, and the angle difference is the difference in the change of the attitude angle of the second electronic device caused by the second operation; if the value corresponding to the movement trajectory is greater than the first threshold, the second operation is determined to be the sliding operation; if the angle difference is greater than the second threshold, the second operation is determined to be the pointing operation.

[0030] The solution provided in this application embodiment allows the second electronic device to determine if the value corresponding to the movement trajectory of a finger on the screen of the second electronic device is greater than a first threshold, thus identifying the second operation as a swipe operation. Conversely, if the difference in the change in the attitude angle of the second electronic device caused by the second operation is greater than a second threshold, the second electronic device can determine if the second operation is a pointing operation. In other words, the second electronic device can determine whether the second operation is a swipe or a pointing operation based on the difference between the movement trajectory and the change in attitude angle, and generate a corresponding instruction based on the operation type and send it to the first electronic device. This allows the first electronic device to execute the corresponding action based on the received instruction, preventing inaccuracies in the content indicated by the generated second instruction due to uncertainty in the operation type, which could lead to errors in the execution of the first electronic device. Therefore, this application embodiment can achieve precise interaction and improve the user experience.

[0031] In conjunction with the second aspect, in some possible implementations, if the operation type of the second operation is the pointing operation, the second instruction is used to indicate the direction and / or distance that the cursor and / or the focus where the cursor is currently resting moves on the screen of the first electronic device; if the operation type of the second operation is the sliding operation, the second instruction is used to indicate the direction and / or distance that the list displayed on the screen of the first electronic device moves on the screen of the first electronic device.

[0032] The solution provided in this application embodiment, if the operation type of the second operation is a pointing operation, the second instruction is used to indicate the direction and / or distance the cursor and / or the focus where the cursor is currently resting move on the screen of the first electronic device; if the operation type of the second operation is a sliding operation, the second instruction is used to indicate the direction and / or distance the list displayed on the screen of the first electronic device moves on the screen of the first electronic device. This allows the first electronic device to accurately move at least one of the cursor, the focus where the cursor is currently resting, and the list displayed on the screen of the first electronic device according to the second instruction, further achieving efficient interaction and improving the user experience.

[0033] In conjunction with the second aspect, in some possible implementations, the first operation is the user's finger pressing on the screen of the second electronic device, and the second operation is the user's wrist holding the second electronic device moving in a first direction; the second instruction is used to instruct the cursor to move in the first direction and move a first distance.

[0034] The solution provided in this application embodiment indicates that the specific content indicated by the second instruction is related to the first operation and the second operation. If the first operation is that the user's finger presses the screen of the second electronic device, and the second operation is that the user's wrist holding the second electronic device moves in the first direction, then the second instruction can instruct the cursor to move in the first direction and move a first distance, so that the first electronic device can move the cursor in the first direction and move a first distance on the screen of the first electronic device according to the second instruction. That is, the first electronic device can accurately move the cursor according to the second instruction, which can solve the problem of difficult precise control of pointing interaction, thereby further realizing efficient interaction and improving user experience.

[0035] In conjunction with the second aspect, in some possible implementations, the cursor in the pointing state presents a first state, which represents the direction of cursor movement.

[0036] The solution provided in this application embodiment further includes a second instruction that instructs the cursor in the pointing state to present a first state, which represents the direction of cursor movement. This design allows for better feedback of the interaction status to the user, thereby improving the user experience.

[0037] In conjunction with the second aspect, in some possible implementations, the first operation is the user's finger pressing on the screen of the second electronic device, and the second operation is the user's finger sliding on the screen of the second electronic device along a second direction; the second instruction is used to instruct the list displayed on the screen of the first electronic device to move along the second direction and move a second distance.

[0038] The solution provided in this application embodiment indicates that the specific content indicated by the second instruction is related to the first operation and the second operation. If the first operation is that the user's finger presses the screen of the second electronic device, and the second operation is that the user's finger slides the screen of the second electronic device along a second direction, then the second instruction can instruct the list displayed on the screen of the first electronic device to move along the second direction and move a second distance, so that the first electronic device can move the list along the second direction and move a second distance on the screen of the first electronic device according to the second instruction. That is, the first electronic device can accurately move the list displayed on the screen of the first electronic device according to the second instruction, which can further realize efficient interaction and improve user experience.

[0039] In conjunction with the second aspect, in some possible implementations, the cursor in the pointing state presents a second state, which characterizes the direction of list movement and the magnitude of cursor deformation.

[0040] The solution provided in the application embodiment further includes a second instruction that instructs the cursor in the pointing state to present a second state, which represents the direction of movement of the list displayed on the screen of the first electronic device and the magnitude of the cursor deformation. This design can better provide feedback on the interaction status to the user, thereby improving the user experience.

[0041] In conjunction with the second aspect, in some possible implementations, the first operation is that the user's finger taps the screen of the second electronic device, lifts it, and then taps it again after lifting it; the second operation is that the user's wrist, which is holding the second electronic device, moves in a third direction; the second instruction is used to instruct the cursor to move in the third direction and move a third distance.

[0042] The solution provided in this application embodiment indicates that the specific content indicated by the second instruction is related to the first operation and the second operation. If the first operation is that the user's finger clicks and lifts on the screen of the second electronic device and then clicks again after lifting, and the second operation is that the user's wrist holding the second electronic device moves in a third direction, then the second instruction can instruct the cursor to move in a third direction and move a third distance, so that the first electronic device can move the cursor and the current focus of the cursor on the screen of the first electronic device in a third direction according to the second instruction. That is, the first electronic device can accurately move the cursor and the current focus of the cursor according to the second instruction, which can further realize efficient interaction and improve user experience.

[0043] In conjunction with the second aspect, in some possible implementations, the cursor in the pointing state presents a third state, which represents the direction of movement of the cursor and the focus on which the cursor rests.

[0044] The solution provided in this application embodiment further includes a third state in which the cursor in the pointing state presents a third state. This third state represents the direction of movement of the cursor and the focus where the cursor is located. This design can better provide feedback on the interaction state to the user, thereby improving the user experience.

[0045] In conjunction with the second aspect, in some possible implementations, when the user's finger taps and lifts off the screen of the second electronic device, then taps again after lifting, and the duration of the second tap exceeds a preset threshold, the method further includes: generating a fourth instruction, the fourth instruction being used to instruct the first electronic device to display a function box, the function box including function keys for controlling the currently displayed screen of the first electronic device; and sending the fourth instruction to the first electronic device.

[0046] The solution provided in this application embodiment allows the second electronic device to generate a fourth instruction and send it to the first electronic device when a user's finger taps and lifts off the screen of the second electronic device, then taps again and the duration of the second tap exceeds a preset threshold. This enables the first electronic device to display a function box based on the fourth instruction. The function box includes function keys for controlling the currently displayed screen of the first electronic device. This application embodiment provides a method for displaying a function box, which can be distinguished from pointing or sliding operations, and the currently displayed screen can be adjusted through the function keys.

[0047] In conjunction with the second aspect, in some possible implementations, the method further includes: in response to a fourth user operation, generating a fifth instruction, the fifth instruction indicating the direction of cursor movement so that the cursor is displayed on the screen of the first electronic device; and sending the fifth instruction to the first electronic device.

[0048] The solution provided in this application embodiment allows the second electronic device to generate a fifth instruction in response to the user's fourth operation and send it to the first electronic device, so that the first electronic device can redisplay the cursor on its screen according to the fifth instruction. Specifically, when the first electronic device moves the cursor off its screen according to the second instruction, the solution provided in this application embodiment allows the cursor to redisplay on the screen of the first electronic device.

[0049] In conjunction with the second aspect, in some possible implementations, the distance the cursor and the focus where the cursor is currently resting move on the screen of the first electronic device is related to the rotation speed of the second electronic device, and the distance the list displayed on the screen of the first electronic device moves on the screen of the first electronic device is related to the speed at which the user swipes on the screen of the second electronic device.

[0050] The solution provided in this application embodiment is that the distance the cursor and the current focus of the cursor move on the screen of the first electronic device is related to the rotation speed of the second electronic device, and the distance the list displayed on the screen of the first electronic device moves on the screen of the first electronic device is related to the sliding speed of the user on the screen of the second electronic device. When the rotation speed of the second electronic device is a fixed value, or when the sliding speed of the user on the screen of the second electronic device is a fixed value, the movement distance of the cursor or list can be adjusted by adjusting the display control ratio, which can improve the user experience.

[0051] In conjunction with the second aspect, in some possible implementations, the faster the second electronic device rotates, the larger the display-to-control ratio, and the greater the distance the cursor and / or the focus where the cursor is currently resting moves on the screen of the first electronic device; the slower the second electronic device rotates, the smaller the display-to-control ratio, and the smaller the distance the cursor and / or the focus where the cursor is currently resting moves on the screen of the first electronic device.

[0052] The solution provided in this application embodiment is that the distance the cursor and / or the current focus of the cursor moves on the screen of the first electronic device is related to the rotation speed of the second electronic device. That is, the faster the second electronic device rotates and the larger the display control ratio, the greater the distance the cursor and / or the current focus of the cursor moves on the screen of the first electronic device. Conversely, the slower the second electronic device rotates and the smaller the display control ratio, the smaller the distance the cursor and / or the current focus of the cursor moves on the screen of the first electronic device. By adjusting the display control ratio according to the rotation speed of the second electronic device, the distance the cursor and / or the current focus of the cursor moves can be further adjusted. To a certain extent, both the speed and accuracy of movement can be considered. Specifically, the faster the second electronic device rotates, the greater the distance the cursor and / or the current focus of the cursor moves on the screen of the first electronic device. This can be understood as prioritizing the efficiency of the cursor and / or the current focus of the cursor's movement when the second electronic device rotates faster, that is, quickly moving the cursor and / or the current focus of the cursor to the corresponding position. Conversely, the slower the second electronic device rotates, the smaller the distance the cursor and / or the current focus of the cursor moves on the screen of the first electronic device. This can be understood as prioritizing the accuracy of the cursor and / or the current focus of the cursor's movement when the second electronic device rotates slower, that is, slowly moving the cursor and / or the current focus of the cursor to the precise position.

[0053] In conjunction with the second aspect, in some possible implementations, the faster the user swipes on the screen of the second electronic device, the greater the display-to-control ratio, and the greater the distance the list displayed on the screen of the first electronic device moves; the slower the user swipes on the screen of the second electronic device, the smaller the display-to-control ratio, and the smaller the distance the list displayed on the screen of the first electronic device moves.

[0054] The solution provided in this application embodiment involves a list displayed on the screen of a first electronic device that moves a distance that is related to the user's sliding speed on the screen of a second electronic device. Specifically, the faster the user slides on the second electronic device and the higher the display-to-control ratio (V / C ratio), the greater the distance the list moves on the first electronic device's screen; conversely, the slower the user slides on the second electronic device and the lower the V / C ratio, the smaller the distance the list moves on the first electronic device's screen. By adjusting the V / C ratio based on the user's sliding speed on the second electronic device's screen to further adjust the distance the list moves, a balance between speed and accuracy can be achieved to a certain extent. Specifically, the faster the user slides on the second electronic device's screen, the greater the final distance the list moves on the first electronic device's screen. This can be understood as prioritizing the efficiency of list movement when the user slides faster, i.e., quickly moving the list to the appropriate position; conversely, the slower the user slides on the second electronic device's screen, the smaller the final distance the list moves on the first electronic device's screen. This can be understood as prioritizing the accuracy of list movement when the user slides slower, i.e., slowly moving the list to the precise position.

[0055] Thirdly, an apparatus is provided, included in an electronic device, having the function of implementing the behaviors of the electronic device in the above aspects and possible implementations thereof. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions.

[0056] Fourthly, an electronic device is provided, comprising: one or more processors; a memory; one or more application programs; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the methods in any possible implementation of the first or second aspect described above.

[0057] Fifthly, a chip system is provided, including at least one processor, wherein when program instructions are executed in the at least one processor, the method in any possible implementation of the first or second aspect described above is implemented in an electronic device.

[0058] In a sixth aspect, a computer storage medium is provided, including computer instructions that, when executed on an electronic device, cause the electronic device to perform the method in any possible implementation of the first or second aspect described above.

[0059] In a seventh aspect, a computer program product is provided that, when the computer program product is run on an electronic device, causes the electronic device to perform the method in any of the possible designs of the first or second aspect described above. Attached Figure Description

[0060] Figure 1 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0061] Figure 2 This is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application.

[0062] Figure 3 A schematic diagram of a set of GUIs provided for embodiments of this application.

[0063] Figure 4 This is a schematic diagram of another set of GUIs provided for embodiments of this application.

[0064] Figure 5 This is a schematic diagram of another set of GUIs provided in the embodiments of this application.

[0065] Figure 6 This is a schematic diagram of another set of GUIs provided in the embodiments of this application.

[0066] Figure 7 This is a schematic diagram of a method for controlling cursor display provided in an embodiment of this application.

[0067] Figure 8 This is a schematic diagram of a cursor display provided in an embodiment of this application.

[0068] Figure 9 This is a schematic diagram illustrating a user pointing based on body orientation, provided as an embodiment of this application.

[0069] Figure 10 This is another schematic diagram illustrating user pointing based on body orientation, provided as an embodiment of this application.

[0070] Figure 11 This is a schematic diagram of a planar coordinate system established based on a mobile phone screen, as provided in an embodiment of this application.

[0071] Figure 12 This is a schematic diagram of a three-dimensional Cartesian coordinate system established based on a mobile phone screen, as provided in an embodiment of this application.

[0072] Figure 13 This is a schematic diagram of a display-to-control ratio curve provided in an embodiment of this application.

[0073] Figure 14 This is a schematic diagram of a light control method provided in an embodiment of this application.

[0074] Figure 15 This is a schematic block diagram of an electronic device provided in an embodiment of this application.

[0075] Figure 16 A schematic block diagram of another electronic device provided in an embodiment of this application. Detailed Implementation

[0076] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0077] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0078] The solutions provided in this application can be applied to electronic devices such as mobile phones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). This application does not impose any restrictions on the specific type of electronic device.

[0079] For example, Figure 1A schematic diagram of the structure of electronic device 100 is shown. Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0080] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0081] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0082] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0083] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0084] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0085] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0086] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0087] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0088] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0089] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0090] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0091] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0092] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0093] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0094] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0095] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0096] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0097] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0098] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0099] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0100] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0101] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0102] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0103] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0104] The ISP is used to process data fed back from camera 193. Camera 193 is used to capture still images or videos. The video codec is used to compress or decompress digital video.

[0105] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0106] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0107] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0108] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0109] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0110] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0111] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0112] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0113] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0114] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.

[0115] Figure 2 This is a software structure block diagram of an electronic device 100 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0116] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0117] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0118] like Figure 2 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0119] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0120] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0121] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0122] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).

[0123] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0124] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0125] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0126] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0127] To facilitate understanding of the solution in this application, the following section will first introduce the technologies related to this application.

[0128] With the continuous development of smart screens, more and more companies are migrating their mobile applications to smart screens to expand their large-screen ecosystem. Currently, the industry commonly uses the active pointing method, where users hold the remote control and actively point it at the large screen to operate it. Although this active pointing method is simple and easy to learn, the user experience is poor in actual operation, and efficient interaction cannot be achieved.

[0129] Specifically, when a user actively points their mobile remote control at the large screen to operate it, many non-pointing actions can also cause changes in the remote control's posture, resulting in cursor movement. For example, when a user selects to play video 1 and clicks or swipes on the remote control, the remote control's posture changes, causing the cursor, which should be displayed on video 1, to move to another position on the large screen. This mistakenly turns on the focus of the cursor's final location, degrading the user experience.

[0130] This application provides a cursor control method that can solve the problem of difficult-to-control pointing interaction, achieve efficient interaction, and improve user experience.

[0131] The following embodiments of this application will be used to illustrate having Figure 1 and Figure 2 Taking the electronic device with the structure shown as an example, and in conjunction with the accompanying drawings and application scenarios, the cursor control method provided in this application embodiment will be specifically described.

[0132] Figure 3 The image shows a set of graphical user interfaces (GUIs) for a television, from which... Figure 3 (a) in Figure 3 (j) shows a method by which a user controls the cursor displayed on the TV interface via a mobile phone.

[0133] See Figure 3The GUI shown in (a) is the main interface displayed on the TV screen. At the top of this main interface are tabs such as: My, Kids, Featured, VIP, etc., and multiple videos are also displayed. The current cursor state is... That is, the cursor is stationary and located in the focus of video 1. The user can control the state and position of the cursor on the TV screen via their mobile phone. When the TV detects the user's finger pressing on the mobile phone screen 301, the TV can display as follows: Figure 3 The GUI shown in (b) is shown in the image.

[0134] See Figure 3 As shown in GUI (b), it can be seen that the state of the cursor displayed on the TV screen changes from... Transform into This means the cursor has moved from a normal state to a stationary state. The user can point their phone at the TV and rotate their wrist to change the phone's orientation. When the TV detects the phone's rotation from left to right, it can display something like... Figure 3 The GUI shown in (c) is shown in the image.

[0135] It should be noted that the cursor can be in three states: normal, stationary, and pointing. When the cursor is pointing, it moves with the phone when the user rotates their wrist to change the phone's orientation. When the cursor is stationary or in a normal state, it does not move when the user rotates their wrist to change the phone's orientation.

[0136] See Figure 3 As shown in GUI (c), it can be seen that as the phone rotates from left to right, the cursor's state changes from... Transform into That is, the cursor changes from a static state to a pointing state, where, This indicates that the cursor is currently moving to the right. The user can stop rotating their wrist at any time. When the cursor is in the focus area of ​​the desired playback, the user can stop rotating their wrist, and the TV will display something like this. Figure 3 The GUI shown in (d) is shown in the image.

[0137] See Figure 3 As shown in GUI (d), the cursor displayed on the TV screen is currently focused on video 2, and the cursor's state is... That is, the cursor returns from the pointing state to the stationary state. When the TV detects that the user's finger taps the phone screen 302 again, the TV can display as follows: Figure 3 The GUI shown in (e) is shown in the image.

[0138] See Figure 3As shown in (e) of the GUI, the TV screen displays information about video 2. The user can press and hold the phone screen with their finger, and at the same time, the user can rotate their wrist to move the cursor to the "play" function control. After clicking on the phone screen, the TV can play video 2.

[0139] In some embodiments, when a user rotates their wrist, the cursor may move to the edge of the TV screen or even move out of the TV screen due to excessive wrist rotation. This application provides a cursor display method that can use animation to inform the user of the angle of cursor deviation, so that the user can rotate their wrist in the opposite direction to compensate for the angle deviation.

[0140] As mentioned above Figure 3 As shown in (c) of the GUI, the cursor's state changes from left to right as the phone rotates. Transform into When the user stops rotating their wrist, the cursor is positioned in focus on video 2. If the user rotates their wrist too much, causing the cursor to move to the edge of the TV screen, the TV can display... Figure 3 The GUI shown in (f) is shown in the image.

[0141] See Figure 3 As shown in GUI (f), the cursor is still in a certain state at this time. The cursor is located at the right edge of the screen. If the user's wrist continues to turn to the right, the phone also continues to turn to the right, and the TV can display... Figure 3 The GUI shown in (g) is shown in the image.

[0142] See Figure 3 As shown in GUI (g), the cursor has now completely moved off the screen, and the icon "" is displayed on the right edge of the TV screen. The cursor is now snapped to the right edge. If the user continues to turn their wrist to the right, the TV can display... Figure 3 The GUI shown in (h) is shown in the image.

[0143] See Figure 3 As shown in (h) of the GUI, the icon "" is displayed on the right edge of the TV screen. ",and Figure 3 The icon displayed on the right edge of (h) in the middle. "Compare Figure 3 The icon displayed on the right edge of (g) in the middle. The higher the height of the cursor, the stronger its attraction. At this point, the user can rotate their wrist in the opposite direction (from right to left), and the phone will also rotate to the left, allowing the TV to display... Figure 3 The GUI shown in (i) is shown in the image.

[0144] See Figure 3 As shown in GUI (i), the icon "" is displayed on the right edge of the TV screen. ",and Figure 3 The icon displayed on the right edge of (i) in the middle "Compare Figure 3 The icon displayed on the right edge of (h) in the middle. The lower the height of the cursor, the weaker its attraction. At this point, the user can further rotate their wrist in the opposite direction; that is, if the user continues to rotate their wrist to the left, the TV can display... Figure 3 The GUI shown in (j) is shown in the image.

[0145] See Figure 3 As shown in (j) of the GUI, the cursor is displayed on the right edge of the TV screen. This indicates that the user has now compensated for the phone's tilted angle by rotating their wrist in the opposite direction. The user can continue rotating their wrist to control the cursor's movement. Additionally, it's important to note that because the user rotates their wrist from right to left during the reverse wrist rotation, when the cursor reappears from the right edge of the TV screen... The white circle in the image is located to the left of the entire cursor.

[0146] The solution provided in this application distinguishes the cursor's state. If the cursor is in a normal or stationary state, it will not move when the user rotates their wrist to change the orientation of the phone used to control the cursor; that is, the cursor's position will not change with the phone's orientation. If the cursor is in a pointing state, it will move with the phone when the user rotates their wrist to change the orientation of the phone used to control the cursor; that is, the cursor's position will change with the phone's orientation. Compared with existing solutions where cursor movement is caused by changes in the phone's orientation due to various non-pointing user actions, this application solves the problem of difficult-to-precise control of pointing interaction by distinguishing the cursor's state and ensuring that the cursor's position changes with the orientation of the phone used to control the cursor when it is in a pointing state. This achieves efficient interaction and improves the user experience. Furthermore, this application also provides a visual cue method for feedback on the cursor's state. When the cursor moves off the edge of the TV screen, its shape changes. The degree of cursor deformation represents the degree to which the phone's orientation deviates from the TV. At this time, the user can compensate for the angle of deviation by moving or rotating the phone in the opposite direction. When the angle of deviation is compensated by the reverse rotation, the cursor reappears from the edge of the TV screen. Such motion design can better provide feedback to users on the interaction status, thereby improving the user experience.

[0147] Figure 4 Another set of GUIs for the television is shown, from which... Figure 4 (a) in Figure 4 (e) shows a method by which a user controls the cursor displayed on the TV interface using their mobile phone.

[0148] See Figure 4 The GUI shown in (a) is the main interface displayed on the TV screen. At the top of this main interface are tabs such as: My, Kids, Featured, VIP, etc., and multiple videos are also displayed. The current cursor state is... And the cursor is in focus in video 2. The user can control the state and position of the cursor on the TV screen using their mobile phone. When the TV detects the user's finger pressing on the mobile phone screen 401, the TV can display as follows: Figure 4 The GUI shown in (b) is shown in the image.

[0149] See Figure 4 As shown in GUI (b), it can be seen that the state of the cursor displayed on the TV screen changes from... Transform into This means the cursor has moved from a normal state to a stationary state. When the user slides their finger across the phone screen, the list on the TV interface scrolls. When the TV detects that the user's finger is sliding upwards on the phone screen (402), the TV can display something like this. Figure 4 The GUI shown in (c) is shown in the image.

[0150] See Figure 4 As shown in GUI (c), the cursor state changes as the user slides their finger up on the phone screen. That is, the cursor changes from a static state to a pointing state, where, This indicates that the list on the TV interface (including Video 1, Video 2, Video 3, Hot Recommendations, My Apps, etc. displayed on the TV screen) is moving upwards. When the cursor is positioned on the area the user wants to play, the user's finger can remain still on the phone screen, and the TV can display something like this. Figure 4 The GUI shown in (d) is shown in the image.

[0151] It should be noted that in this embodiment, the magnitude of the cursor deformation is related to the distance the user slides on the mobile phone screen. The longer the distance the user slides on the mobile phone screen, the greater the magnitude of the cursor deformation; the shorter the distance the user slides on the mobile phone screen, the smaller the magnitude of the cursor deformation. However, it is worth noting that there is a maximum upper limit to the magnitude of the cursor deformation, which can be a preset value.

[0152] See Figure 4As shown in GUI (d), the cursor displayed on the TV screen is currently focused on video 4, and the cursor's state is... That is, the cursor returns from a pointing state to a stationary state, and when the TV detects that the user's finger has left the TV, the TV can display something like this. Figure 4 The GUI shown in (e) is shown in the image.

[0153] See Figure 4 As shown in GUI (e), the cursor is still in focus on video 4, and its current state is... At this point, users can refer to the above. Figure 3 Video 4 is played in this way.

[0154] The solution provided in this application allows users to scroll the video displayed on a TV screen by swiping on their mobile phone screen. This enables users to quickly position the cursor on the desired playback focus. Specifically, as the user's finger swipes on the mobile phone screen, the cursor's state changes, and the magnitude of the change is related to the distance the user swipes on the screen. That is, the longer the distance the user swipes, the greater the cursor deformation; the shorter the distance the user swipes, the smaller the cursor deformation. This animation design provides better feedback on the interaction status to the user, thereby improving the user experience.

[0155] Figure 5 Another set of GUIs for the television is shown, from which... Figure 5 (a) in Figure 5 (d) shows a method by which a user controls the cursor displayed on the TV interface via a mobile phone.

[0156] See Figure 5 The GUI shown in (a) is the main interface displayed on the TV screen. At the top of this main interface are tabs such as: My, Kids, Featured, VIP, etc., and multiple videos are also displayed. The current cursor state is... And the cursor is located in the focus of video 2. The user can control the state and position of the cursor on the TV screen through the mobile phone. When the TV detects that the user's finger has tapped and lifted on the mobile phone screen, and then tapped 501 again after lifting, the TV can display as follows: Figure 5 The GUI shown in (b) is shown in the image.

[0157] See Figure 5 As shown in GUI (b), it can be seen that the state of the cursor displayed on the TV screen changes from... Transform into That is, the cursor moves from a normal state to a static state, where, This indicates that the user can drag the selected focus point. The user can change the phone's orientation by rotating their wrist, thus dragging the focus point. When the user's wrist rotates from left to right, the phone's orientation also rotates from left to right. The TV can display something like this. Figure 5 The GUI shown in (c) is shown in the image.

[0158] See Figure 5 As shown in GUI (c), it can be seen that as the phone rotates from left to right, the cursor's state changes from... Transform into That is, the cursor changes from a static state to a pointing state, where, This indicates that the cursor and the focus of video 2 are currently moving uniformly to the right. When the cursor and the focus of video 2 are dragged to the desired position, the user can remove their finger from the phone screen, and the TV will display as shown below. Figure 5 The GUI shown in (d) is shown in the image.

[0159] See Figure 5 As shown in GUI (d), the cursor state has now returned to normal. Furthermore, the focus of video 2 is now located at the far right of the TV screen, while video 3, which was previously located at the far right of the TV screen, is now located in the position of video 2, which is equivalent to swapping the positions of video 3 and video 2.

[0160] The solution provided in this application embodiment allows users to drag the focus on the TV screen. Specifically, when the TV detects that the user's finger taps and lifts off the screen, and then taps again after lifting, the cursor state changes. When the cursor state changes to... In this state, users can drag the focus point on the TV screen to the desired location. This design allows for dragging the focus point on the TV screen, thereby enhancing the user experience.

[0161] Figure 6 Another set of GUIs for the television is shown, from which... Figure 6 (a) in Figure 6 (c) shows a method by which a user controls the cursor displayed on the TV interface via a mobile phone.

[0162] See Figure 6 The GUI shown in (a) is the main interface displayed on the TV screen. At the top of this main interface are tabs such as: My, Kids, Featured, VIP, etc., and multiple videos are also displayed. The current cursor state is... And the cursor is located in the focus of video 2. The user can control the state and position of the cursor on the TV screen via their mobile phone. When the user follows the above... Figure 3 When playing video 2 using the method shown, the TV can display as follows: Figure 6 The GUI shown in (b) is shown in the image.

[0163] See Figure 6 The GUI shown in (b) displays the screen of video 2. When the TV detects that the user's finger taps and lifts off the phone screen, then taps again after lifting, and the tap duration exceeds a threshold, a long-press operation is triggered. The TV can then display the following: Figure 6 The GUI shown in (c) is shown in the image.

[0164] See Figure 6 As shown in (c) of the GUI, a function box pops up at this time. The function box includes function keys for controlling the playback of video 2. The user can control the playback of video 2 by clicking the corresponding function keys.

[0165] Figure 7 This is a schematic diagram of a method for controlling cursor display provided in an embodiment of this application. Taking a mobile phone and a television as examples, the method may include steps S710 to S730.

[0166] S710, with your finger pressed on the phone screen.

[0167] S712, can the phone determine the type of operation?

[0168] If yes, proceed to step S714; otherwise, proceed to step S716.

[0169] In this embodiment of the application, the mobile phone can determine the operation type in step S712 based on the user's operation on the mobile phone. For example, when the user presses his finger on the mobile phone screen, if the mobile phone detects that the user is holding the mobile phone and the mobile phone's posture is changing, the mobile phone can determine that the operation type is a pointing operation; if the mobile phone detects that the touch coordinates of the user's finger on the mobile phone screen change, the mobile phone can determine that the operation type is a swiping operation.

[0170] Is the S714 a sliding operation?

[0171] If yes, proceed to step S718; otherwise, proceed to step S720.

[0172] S718 scrolls a list on a TV screen based on changes in touch coordinates.

[0173] The S720 controls cursor movement on the TV screen based on changes in the phone's posture.

[0174] In this embodiment, when the mobile phone determines that the operation type is a swipe operation, the list on the TV screen scrolls as the user's touch coordinates on the mobile phone screen change. As described above... Figure 4 As shown, when a user swipes their finger up on the phone screen, the list on the TV screen scrolls up accordingly; similarly, when a user swipes their finger down on the phone screen, the list on the TV screen scrolls down accordingly.

[0175] When the operation type is determined to be a pointing operation, the cursor displayed on the TV screen will move as the phone's orientation changes. (As mentioned above.) Figure 3 As shown, when a user holds the phone, points it at the TV, and rotates their wrist to the right, the cursor on the TV screen moves to the right; when the user holds the phone, points it at the TV, and rotates their wrist to the left, the cursor moves to the left. When the user holds the phone, points it at the TV, and moves their wrist upwards, the cursor moves upwards; when the user holds the phone, points it at the TV, and moves their wrist downwards, the cursor moves upwards.

[0176] In some embodiments, when the operation type is determined to be a pointing operation, as the phone's orientation changes, in addition to the cursor on the TV screen moving, the focus of the cursor also moves simultaneously. The phone can distinguish this movement by the user's finger action on the phone screen before the user rotates or moves their wrist. If the user taps the phone screen, lifts their finger, and then taps again before rotating or moving their wrist, the focus of the cursor moves along with the cursor when the user rotates or moves their wrist. As described above. Figure 5 As shown, when the user's wrist rotates from left to right, the phone's orientation also rotates from left to right, and the cursor and the focal point of video 2 where the cursor is located move to the right in unison.

[0177] like Figure 8 The diagram shown is a schematic representation of a cursor display according to an embodiment of this application. Figure 8 (a) in the text represents the normal state of the cursor; Figure 8 (b) shows the cursor movement when the user taps the phone screen with their finger and simultaneously rotates or moves their wrist. Figure 8 (c) in the figure represents the movement of the cursor when the user slides their finger on the phone screen; Figure 8 (d) represents the cursor movement when the user taps and lifts their finger on the phone screen, then taps again after lifting, while simultaneously rotating or moving their wrist.

[0178] Furthermore, the solution provided in this application allows users to point within a suitable range of wrist movement based on their own orientation.

[0179] like Figure 9 and Figure 10 The figures shown are schematic diagrams illustrating a user pointing based on body orientation, as provided in an embodiment of this application.

[0180] like Figure 9 As shown, when the user is facing the TV screen, the user can... Figure 9 The range of motion shown (the angle shown in the figure) is directed towards the television screen; as... Figure 10 As shown, when the user is located on the right side of the TV screen, the user can, based on the right side of the TV screen where they are located, [follow the instructions]. Figure 10 The range of motion shown (angles shown in the figure) Point to the left side of the TV screen.

[0181] Is S716 the first frame when a finger touches the screen?

[0182] If yes, proceed to step S722; otherwise, proceed to step S724.

[0183] S722 records the initial touch coordinates and the initial posture of the phone.

[0184] In this embodiment of the application, when the operation type cannot be determined, the mobile phone can determine whether the operation of pressing the finger on the mobile phone screen is the first frame when the finger just touches the mobile phone screen. If so, the initial touch coordinates of the finger touching the mobile phone screen and the initial posture of the mobile phone can be recorded to facilitate the calculation of the finger movement trajectory of subsequent sliding operations and the changes in the mobile phone posture of rotating operations.

[0185] S724, whether the value of the finger movement trajectory exceeds the first threshold.

[0186] If yes, proceed to step S726; otherwise, proceed to step S728.

[0187] S726, enter the sliding operation state.

[0188] In this embodiment of the application, the calculation of the value of the finger movement trajectory is as follows: a planar coordinate system can be established based on the center of the mobile phone screen, and the value of the finger movement trajectory can be calculated according to the change of the coordinates of the finger touch.

[0189] like Figure 11The diagram shown is a schematic of a planar coordinate system established based on a mobile phone screen according to an embodiment of this application. Assume the initial touch position A of the user's finger has coordinates (a1, a2), and the user's finger stops at position B, where the coordinates are (b1, b2). If the user's finger movement trajectory is a straight line, then the numerical value of the user's finger movement trajectory can be expressed as... .

[0190] In this embodiment of the application, after obtaining the value of the finger movement trajectory, it is possible to determine the size of the value and the first threshold. If the value is greater than the first threshold, it can be considered that the user has swiped on the mobile phone screen, and thus can enter the swiping operation state. If the value is less than or equal to the first threshold, it is possible to further determine the size of the mobile phone posture change value and the second threshold.

[0191] When the value of the finger movement trajectory exceeds a first threshold, the user's finger operation on the phone screen will be reflected on the TV screen, causing the list on the TV interface to scroll up or down. Specifically, if the user slides their finger up on the phone screen, the list on the TV interface will scroll up; if the user slides their finger down on the phone screen, the list on the TV interface will scroll down.

[0192] S728, whether the phone's posture change value exceeds the second threshold.

[0193] If yes, proceed to step S730; otherwise, end.

[0194] S730, enters pointing operation mode.

[0195] In this embodiment of the application, for the change value of the mobile phone posture, a three-dimensional rectangular coordinate system can be established based on the center of the mobile phone screen, and the rotation angle of the mobile phone can be calculated based on the change of the mobile phone posture, that is, the change value of the mobile phone posture.

[0196] like Figure 12 The diagram shown is a schematic of a three-dimensional Cartesian coordinate system established based on a mobile phone screen, as provided in an embodiment of this application.

[0197] See Figure 12 In (a), the center of the phone screen is taken as the origin, and the x-axis, y-axis, and z-axis are defined as right, inward, and upward, respectively. When the phone rotates to the right by a certain angle, the coordinate axes will also rotate with the phone, and thus the coordinate axes will change accordingly, such as... Figure 12 As shown in (b) of the diagram.

[0198] See Figure 12 As can be seen from (b) in the image, when the phone... Figure 12After the phone rotates to the right by a certain angle as shown in (a), the phone's orientation changes. Since the coordinate axes rotate along with the phone, the coordinate axes presented at this time are different from those of the phone. Figure 12 The coordinate axes presented in (a) are somewhat deviated.

[0199] To compensate for this deviation, after the phone rotates by a certain angle, its attitude can be calculated according to a new coordinate system (i.e., x' axis, z' axis, and y axis). See [link to relevant documentation]. Figure 12 In (c), the new coordinate system can be understood as being in relation to... Figure 12 The coordinate system shown in (a) is consistent.

[0200] Specifically, the calculation can be performed using the following formula:

[0201]

[0202]

[0203]

[0204] in, This indicates the relative rotation angle between two adjacent frames. The relative rotation angle expressed in Euler angle form , The relative rotation angle expressed in quaternion form , The rotation quaternion for the roll angle, This represents the relative rotation between two adjacent coordinate systems. The inverse of the rotation quaternion for the roll angle. This represents the roll angle of the equipment relative to the Earth coordinate system after rotation. The attitude of the device relative to the Earth coordinate system before rotation (quaternion form). for The reverse, The orientation of the device relative to the Earth coordinate system after rotation (in quaternion form).

[0205] In this embodiment of the application, after obtaining the mobile phone posture change value, it is possible to determine the magnitude of the mobile phone posture change value and the second threshold. If the posture change value is greater than the second threshold, it can be considered that the user has rotated the hand holding the mobile phone, and thus can enter the pointing operation state; if the posture change value is less than or equal to the second threshold, the judgment process ends.

[0206] When the change in posture exceeds a second threshold, any wrist movement or rotation of the user's hand while holding the phone will be reflected on the television screen by a horizontal or vertical cursor. Specifically, if the user rotates their wrist to the right while holding the phone, the cursor on the television screen will move to the right; if the user rotates their wrist to the left while holding the phone, the cursor will move to the left; if the user moves their wrist upwards while holding the phone, the cursor will move upwards; and if the user moves their wrist downwards while holding the phone, the cursor will move downwards.

[0207] Of course, in some possible implementations, the determination of the finger movement trajectory and the magnitude of the first threshold are not sequential with the determination of the change in phone posture and the magnitude of the second threshold. In other words, the finger movement trajectory and the magnitude of the first threshold can be determined first, and then the change in phone posture and the magnitude of the second threshold can be determined; or, the change in phone posture and the magnitude of the second threshold can be determined first, and then the finger movement trajectory and the magnitude of the first threshold can be determined; there are no restrictions.

[0208] It should be noted that, although the above embodiments show that when the value of the finger movement trajectory exceeds the first threshold, it can be considered that the user has swiped on the mobile phone screen, in some embodiments, when the value of the finger movement trajectory is equal to or exceeds the first threshold, it can also be considered that the user has swiped on the mobile phone screen; similarly, when the mobile phone posture change value is equal to the second threshold, it can also be considered that the user has rotated the hand holding the mobile phone.

[0209] Furthermore, in this embodiment, the display control ratio can be adjusted by the wrist rotation speed to control the accuracy and speed of cursor movement. Specifically, if the wrist rotation speed is low, such as less than a preset value, priority can be given to the accuracy of cursor display; that is, as the user's wrist rotates, the cursor can move slowly and eventually stop precisely at the position the user wants the cursor to be displayed. If the wrist rotation speed is high, such as greater than the preset value, priority can be given to the efficiency of cursor display; that is, as the user's wrist rotates, the cursor can move quickly and eventually stop near the position the user wants the cursor to be displayed.

[0210] like Figure 13 The figure shows a schematic diagram of a display-to-control ratio curve provided in an embodiment of this application. As can be seen from the figure, for any curve, the greater the speed at which the user moves the phone or the user's finger moves, the greater the display-to-control ratio, and the greater the distance the cursor and / or the focus of the cursor moves on the TV screen; conversely, the smaller the speed at which the user moves the phone or the user's finger moves, the smaller the display-to-control ratio, and the less the distance the cursor and / or the focus of the cursor moves on the TV screen.

[0211] It is worth noting that the faster the user moves the phone, the greater the distance the cursor and / or the current focus of the cursor will move on the TV screen. This can be understood as prioritizing the efficiency of cursor and / or current focus movement when the phone moves faster, meaning the cursor and / or current focus is moved quickly to the corresponding position. Conversely, the slower the user moves the phone, the smaller the distance the cursor and / or current focus of the cursor will move on the TV screen. This can be understood as prioritizing the precision of cursor and / or current focus movement when the phone moves slower, meaning the cursor and / or current focus is moved slowly to the precise position.

[0212] In addition, the figure also shows multiple curves, which are mainly related to the sensitivity of the cursor. The more sensitive the cursor is, the greater the speed at which the phone or finger moves, and the greater the display control ratio. Therefore, the cursor sensitivity corresponding to curve 1 in the figure is the greatest, followed by curve 2, and so on.

[0213] Scenario 1: The user rotates the phone with their wrist.

[0214] The control ratio can be calculated using the following formula:

[0215]

[0216]

[0217] in, For display control ratio, This represents the total rotation angle between two adjacent frames of the phone. The rotation angle between two adjacent frames of the phone in the horizontal direction. The vertical rotation angle between two adjacent frames of the phone.

[0218] The phone was rotated. This is reflected on the television screen, where the magnitude of the cursor's displacement is displayed using... express:

[0219]

[0220]

[0221]

[0222] in, This represents the horizontal displacement of the cursor. This represents the vertical displacement of the cursor.

[0223] It should be noted that in the embodiments of this application, the same wrist movement has the same pointing effect regardless of the user's different hand positions when holding the phone. In other words, the change value of the phone's posture is not related to the user's hand position when holding the phone, but only to the direction of wrist rotation of the hand holding the phone. When the wrist rotates horizontally, the cursor displayed on the TV moves horizontally; when the wrist rotates vertically, the cursor displayed on the TV moves vertically.

[0224] Scenario 2: The user slides their finger across the screen.

[0225] The magnitude of the displacement of the user's finger as it slides across the phone screen is This is reflected on the television screen, where the magnitude of the cursor's displacement is displayed using... express:

[0226] If the user swipes their finger up or down, then

[0227] If the user swipes their finger left or right, then

[0228] in, For display control ratio, Longitudinal displacement of the fingers, Lateral displacement of the fingers.

[0229] The solution provided in this application allows the mobile phone to determine the user's operation type by combining the user's finger movements and changes in the phone's posture, and then enter the corresponding operation state based on the operation type. Specifically, when the mobile phone can determine the operation type based on the user's finger movements, it can scroll the list on the TV screen based on changes in the coordinates of the finger's touch on the phone screen, or it can control the cursor to move on the TV screen based on changes in the phone's posture. When the mobile phone cannot determine the operation type based on the user's finger movements, it can first record the initial touch coordinates of the user's finger on the phone screen, and then determine the value of the user's finger movement trajectory compared to a first threshold, or the value of the phone's posture change compared to a second threshold, thereby entering the corresponding operation state more accurately. This design solves the problem of difficult-to-control pointing interaction, thereby achieving efficient interaction and improving the user experience.

[0230] like Figure 14 The diagram shown is a schematic representation of a light control method provided in an embodiment of this application. This method can be executed by a first electronic device and a second electronic device, and may include steps 1410-1426.

[0231] 1410, in response to a first operation by the user, the second electronic device generates a first instruction, the first instruction being used to instruct the cursor displayed on the first electronic device to display a stationary state;

[0232] 1412, the second electronic device sends the first instruction to the first electronic device;

[0233] 1414, The first electronic device displays the cursor as stationary according to the first instruction.

[0234] In this application embodiment, the first electronic device can be a television as described in the above embodiments, and the second electronic device can be a mobile phone as described in the above embodiments. When the first electronic device receives a first instruction sent by the second electronic device, it can adjust the cursor displayed on the screen of the first electronic device to a stationary state according to the first instruction.

[0235] 1416, In response to a second operation by the user, the second electronic device generates a second instruction, the second instruction being used to instruct the cursor to change from the stationary state to a pointing state, and when the cursor is displayed in the pointing state, at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device moves in a direction and / or a distance on the screen of the first electronic device, and when the cursor or the list stops moving, the cursor is displayed in the stationary state, wherein when the cursor is displayed in the pointing state, the cursor, the current focus of the cursor, and at least one of the list are movable, and when the cursor is displayed in the stationary state, the cursor, the current focus of the cursor, and the list are immovable;

[0236] 1418, the second electronic device sends the second instruction to the first electronic device.

[0237] 1420, the first electronic device displays the cursor as changing from the stationary state to a pointing state according to the second instruction, and moves at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device on the screen of the first electronic device, and displays the cursor as the stationary state when the cursor or the list stops moving.

[0238] In this embodiment, when the cursor is in a stationary state, when the first electronic device receives a second instruction from the second electronic device, it can perform corresponding operations according to the second instruction. For example, it can change the cursor to a pointing state according to the second instruction and move the cursor, the current focus of the cursor, and at least one of the items in the list displayed on the screen of the first electronic device. The specific operations performed by the first electronic device are related to the specific content indicated by the second instruction, which in turn is related to the user's second operation. For specific details, please refer to Situation 1, Situation 2, and Situation 3 below.

[0239] 1422, In response to a third operation by the user, the second electronic device generates a third instruction, the third instruction being used to instruct the playback of the image corresponding to the target focus where the cursor is hovering;

[0240] 1424, the second electronic device sends the third instruction to the first electronic device.

[0241] 1426, the first electronic device receives a third instruction sent by the second electronic device, and plays the image corresponding to the target focus where the cursor is hovering according to the third instruction.

[0242] The solution provided in this application embodiment allows a first electronic device to display the cursor as stationary based on a first instruction sent by a second electronic device. While the cursor is stationary, the first electronic device can change the cursor to a pointing state based on a second instruction sent by the second electronic device, and move the cursor, the current focus of the cursor, and at least one item from the list displayed on the screen of the first electronic device. When the movement stops, the cursor is displayed as stationary. At this time, the second electronic device can generate a third instruction based on a third user operation, and the first electronic device can play the image corresponding to the target focus where the cursor stopped moving based on the received third instruction. The solution provided in this application embodiment, by distinguishing the cursor's state—that when the cursor is in a pointing state, the first electronic device can move the cursor, the current focus of the cursor, and at least one item from the list based on the received instruction, and when the cursor is stationary, the cursor, the current focus of the cursor, and the list cannot be moved—solves the problem of difficult precise control of pointing interaction, prevents cursor jitter caused by user misoperation, thereby achieving efficient interaction and improving user experience.

[0243] Optionally, in some embodiments, generating a second instruction in response to a second user operation includes:

[0244] In response to the second operation, the operation type of the second operation is determined, the operation type including pointing operation and sliding operation;

[0245] The second instruction is generated based on the operation type of the second operation.

[0246] The solution provided in this application embodiment, in response to a second operation, allows a second electronic device to first determine the operation type of the second operation, and then generate a second instruction more accurately based on the operation type of the second operation and send it to a first electronic device. The first electronic device can then perform a corresponding action based on the second instruction. Since the second instruction is generated based on the operation type of the second operation, in other words, the content of the second instruction can reflect the user's operation on the second electronic device. Therefore, when the first electronic device performs a corresponding operation based on the second instruction, it can synchronize with the user's second operation. For example, if the second operation is a pointing operation, the first electronic device can move the cursor and / or the focus where the cursor is located based on the pointing operation, without sliding the list, thus further achieving efficient interaction and improving the user experience.

[0247] Optionally, in some embodiments, determining the operation type of the second operation in response to the second operation includes:

[0248] In response to the second operation, the value corresponding to the movement trajectory is determined to be the size of the first threshold, or the angle difference and the second threshold are determined, wherein the movement trajectory is the movement trajectory of the finger acting on the screen of the second electronic device included in the second operation, and the angle difference is the difference in the attitude angle of the second electronic device caused by the second operation.

[0249] If the value corresponding to the movement trajectory is greater than the first threshold, the second operation is determined to be the sliding operation;

[0250] If the angle difference is greater than the second threshold, the second operation is determined to be the pointing operation.

[0251] The solution provided in this application embodiment allows the second electronic device to determine whether the second operation is a swipe operation if the value corresponding to the movement trajectory of a finger on the screen of the second electronic device is greater than a first threshold; conversely, if the difference in the change of the attitude angle of the second electronic device caused by the second operation is greater than a second threshold, the second electronic device can determine whether the second operation is a pointing operation. In other words, the second electronic device can determine whether the second operation is a swipe operation or a pointing operation based on the difference between the movement trajectory and the change in attitude angle, and generate a corresponding instruction based on the operation type and send it to the first electronic device. The first electronic device can then execute the corresponding action based on the received instruction. This prevents inaccuracies in the content indicated by the generated second instruction due to uncertainty in the operation type, thus avoiding errors in the execution of the first electronic device. Therefore, this application embodiment can achieve precise interaction and improve the user experience.

[0252] Optionally, in some embodiments, if the operation type of the second operation is the pointing operation, the second instruction is used to indicate the direction and / or distance that the cursor and / or the focus where the cursor is currently resting moves on the screen of the first electronic device;

[0253] If the operation type of the second operation is the sliding operation, the second instruction is used to indicate the direction and / or distance that the list displayed on the screen of the first electronic device moves on the screen of the first electronic device.

[0254] The solution provided in this application embodiment, if the operation type of the second operation is a pointing operation, the second instruction is used to indicate the direction and / or distance the cursor and / or the focus where the cursor is currently resting move on the screen of the first electronic device; if the operation type of the second operation is a sliding operation, the second instruction is used to indicate the direction and / or distance the list displayed on the screen of the first electronic device moves on the screen of the first electronic device. Thus, the first electronic device can accurately move at least one of the cursor, the focus where the cursor is currently resting, and the list displayed on the screen of the first electronic device according to the second instruction, further achieving efficient interaction and improving the user experience.

[0255] As stated above, in response to the user's first operation, the second electronic device generates a first instruction; in response to the user's second operation, the second electronic device generates a second instruction; wherein the specific content indicated by the second instruction is related to the first and second operations, please refer to the following text for details.

[0256] Case 1:

[0257] The first operation is that the user's finger presses on the screen of the second electronic device, and the second operation is that the user's wrist, which is holding the second electronic device, moves in a first direction;

[0258] The second instruction is used to instruct the cursor to move in the first direction and move a first distance.

[0259] The step of displaying the cursor in a pointing state according to the second instruction, and moving at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device, on the screen of the first electronic device, includes:

[0260] The cursor is displayed in a pointing state according to the second instruction, and the cursor is moved a first distance in the first direction on the screen of the first electronic device.

[0261] For details regarding scenario one, please refer to the above. Figure 3 The content shown will not be repeated here.

[0262] The solution provided in this application embodiment indicates that the specific content indicated by the second instruction is related to the first operation and the second operation. If the first operation is that the user's finger presses the screen of the second electronic device, and the second operation is that the user's wrist holding the second electronic device moves in the first direction, then the second instruction can instruct the cursor to move in the first direction and move a first distance. At this time, the first electronic device can move the cursor in the first direction and move a first distance on the screen of the first electronic device according to the second instruction. That is, the first electronic device can accurately move the cursor according to the second instruction, which can solve the problem of difficult precise control of pointing interaction, thereby further realizing efficient interaction and improving user experience.

[0263] Optionally, in some embodiments, the second instruction is further used to instruct the cursor in the pointing state to present a first state, the first state representing the direction of cursor movement.

[0264] The solution provided in this application embodiment further includes a second instruction that instructs the cursor in the pointing state to present a first state, which represents the direction of cursor movement. This design allows for better feedback of the interaction status to the user, thereby improving the user experience.

[0265] Case 2:

[0266] The first operation is that the user's finger presses on the screen of the second electronic device, and the second operation is that the user's finger slides on the screen of the second electronic device in a second direction;

[0267] The second instruction is used to instruct the list displayed on the screen of the first electronic device to move in a second direction and move a second distance.

[0268] The step of displaying the cursor in a pointing state according to the second instruction, and moving at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device, on the screen of the first electronic device, includes:

[0269] The cursor is displayed in a pointing state according to the second instruction, and the list is moved a second distance in the second direction on the screen of the first electronic device.

[0270] For details regarding scenario two, please refer to the above. Figure 4 The content shown will not be repeated here.

[0271] The solution provided in this application embodiment indicates that the specific content indicated by the second instruction is related to the first operation and the second operation. If the first operation is that the user's finger presses the screen of the second electronic device, and the second operation is that the user's finger slides the screen of the second electronic device along a second direction, then the second instruction can instruct the list displayed on the screen of the first electronic device to move along the second direction and move a second distance. At this time, the first electronic device can move the list along the second direction and move a second distance on the screen of the first electronic device according to the second instruction. That is, the first electronic device can accurately move the list displayed on the screen of the first electronic device according to the second instruction, which can further realize efficient interaction and improve user experience.

[0272] Optionally, in some embodiments, the second instruction is further used to instruct the cursor in the pointing state to present a second state, the second state representing the direction of the list movement and the magnitude of the cursor deformation.

[0273] The solution provided in this application embodiment further includes a second instruction that instructs the cursor in the pointing state to present a second state. This second state represents the direction of movement of the list displayed on the screen of the first electronic device and the magnitude of the cursor deformation. This design can better provide feedback on the interaction status to the user, thereby improving the user experience.

[0274] Case 3:

[0275] The first operation is that the user's finger taps the screen of the second electronic device, lifts it, and then taps it again after lifting it; the second operation is that the user's wrist, which is holding the second electronic device, moves in a third direction.

[0276] The second instruction is used to instruct the cursor to move in the third direction and move a third distance.

[0277] The step of displaying the cursor in a pointing state according to the second instruction, and moving at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device, on the screen of the first electronic device, includes:

[0278] According to the second instruction, the cursor is displayed in a pointing state, and the cursor and the focus where the cursor is currently located are moved a third distance on the screen of the first electronic device in the third direction.

[0279] For details regarding scenario three, please refer to the above. Figure 5 The content shown will not be repeated here.

[0280] The solution provided in this application embodiment indicates that the specific content indicated by the second instruction is related to the first operation and the second operation. If the first operation is that the user's finger clicks on the screen of the second electronic device, then lifts up and clicks again after lifting up, and the second operation is that the user's wrist holding the second electronic device moves in a third direction, then the second instruction can instruct the cursor to move in a third direction and move a third distance. At this time, the first electronic device can move the cursor and the focus where the cursor is currently located on the screen of the first electronic device in a third direction according to the second instruction. That is, the first electronic device can accurately move the cursor and the focus where the cursor is currently located according to the second instruction, which can further realize efficient interaction and improve user experience.

[0281] Optionally, in some embodiments, the second instruction is further used to instruct the cursor in the pointing state to present a third state, the third state representing the direction of movement of the cursor and the focus where the cursor is located.

[0282] The solution provided in this application embodiment further includes a third state in which the cursor in the pointing state presents a third state. This third state represents the direction of movement of the cursor and the focus where the cursor is located. This design can better provide feedback on the interaction state to the user, thereby improving the user experience.

[0283] Optionally, in some embodiments, when the user's finger taps and lifts off the screen of the second electronic device, then taps again and the duration of the second tap exceeds a preset threshold, the method further includes:

[0284] The second electronic device generates a fourth instruction, which instructs the first electronic device to display a function box, the function box including function keys for controlling the screen currently displayed by the first electronic device;

[0285] The second electronic device sends the fourth instruction to the first electronic device.

[0286] The first electronic device receives a fourth instruction sent by the second electronic device and displays a function box according to the fourth instruction. The function box includes function keys for controlling the screen currently displayed by the first electronic device.

[0287] The solution provided in this application embodiment allows the second electronic device to generate a fourth instruction and send it to the first electronic device when a user's finger taps and lifts off the screen of the second electronic device, then taps again and the duration of the second tap exceeds a preset threshold. The first electronic device can then display a function box based on the fourth instruction. This function box includes function keys for controlling the currently displayed screen of the first electronic device. This application embodiment provides a method for displaying a function box, which can be distinguished from pointing or sliding operations, and the currently displayed screen can be adjusted through the function keys.

[0288] Optionally, in some embodiments, if the cursor is moved out of the screen of the first electronic device according to the second instruction, the cursor in the pointing state displays a fourth state, the fourth state representing the direction in which the cursor moves out of the screen of the first electronic device and the extent by which the cursor moves out of the screen of the second electronic device;

[0289] The method further includes:

[0290] In response to the user's fourth operation, the second electronic device generates a fifth instruction, which indicates the direction of cursor movement so that the cursor is displayed on the screen of the first electronic device;

[0291] The second electronic device sends the fifth instruction to the first electronic device.

[0292] The first electronic device receives a fifth instruction sent by the second electronic device and displays the cursor on the screen of the first electronic device according to the fifth instruction.

[0293] The solution provided in this application embodiment allows for the following: if a first electronic device moves the cursor off its screen according to a second instruction, the cursor in a pointing state displays a fourth state. This fourth state represents the direction in which the cursor moves off the screen of the first electronic device and the extent by which the cursor moves off the screen of the second electronic device. The second electronic device can then respond to the user's fourth operation by generating a fifth instruction and sending it to the first electronic device. The first electronic device can then redisplay the cursor on its screen according to the fifth instruction. During the process of the first electronic device redisplaying the cursor according to the fifth instruction, the cursor shape changes accordingly. The degree of cursor deformation represents the angle at which the second electronic device deviates from the first electronic device's orientation. This animation design provides better feedback to the user regarding the interaction status, thereby improving the user experience.

[0294] Optionally, in some embodiments, the distance the cursor and the focus where the cursor is currently resting move on the screen of the first electronic device is related to the rotation speed of the second electronic device, and the distance the list displayed on the screen of the first electronic device moves on the screen of the first electronic device is related to the speed at which the user swipes on the screen of the second electronic device.

[0295] The solution provided in this application embodiment is that the distance the cursor and the current focus of the cursor move on the screen of the first electronic device is related to the rotation speed of the second electronic device, and the distance the list displayed on the screen of the first electronic device moves on the screen of the first electronic device is related to the sliding speed of the user on the screen of the second electronic device. When the rotation speed of the second electronic device is a fixed value, or when the sliding speed of the user on the screen of the second electronic device is a fixed value, the movement distance of the cursor or list can be adjusted by adjusting the display control ratio, which can improve the user experience.

[0296] Optionally, in some embodiments, the faster the second electronic device rotates, the greater the display-to-control ratio, and the greater the distance the cursor and / or the focus where the cursor is currently located moves on the screen of the first electronic device;

[0297] The slower the second electronic device rotates, the smaller the display-to-control ratio, and the smaller the distance the cursor and / or the focus of the cursor currently rests on moves on the screen of the first electronic device.

[0298] The solution provided in this application embodiment is that the distance the cursor and / or the current focus of the cursor moves on the screen of the first electronic device is related to the rotation speed of the second electronic device. That is, the faster the second electronic device rotates and the larger the display control ratio, the greater the distance the cursor and / or the current focus of the cursor moves on the screen of the first electronic device. Conversely, the slower the second electronic device rotates and the smaller the display control ratio, the smaller the distance the cursor and / or the current focus of the cursor moves on the screen of the first electronic device. By adjusting the display control ratio according to the rotation speed of the second electronic device, the distance the cursor and / or the current focus of the cursor moves can be further adjusted. To a certain extent, both the speed and accuracy of movement can be considered. Specifically, the faster the second electronic device rotates, the greater the distance the cursor and / or the current focus of the cursor moves on the screen of the first electronic device. This can be understood as prioritizing the efficiency of the cursor and / or the current focus of the cursor's movement when the second electronic device rotates faster, that is, quickly moving the cursor and / or the current focus of the cursor to the corresponding position. Conversely, the slower the second electronic device rotates, the smaller the distance the cursor and / or the current focus of the cursor moves on the screen of the first electronic device. This can be understood as prioritizing the accuracy of the cursor and / or the current focus of the cursor's movement when the second electronic device rotates slower, that is, slowly moving the cursor and / or the current focus of the cursor to the precise position.

[0299] Optionally, in some embodiments, the faster the user swipes on the screen of the second electronic device, the greater the display-to-control ratio, and the greater the distance the list displayed on the screen of the first electronic device moves on the screen of the first electronic device;

[0300] The slower the user swipes on the screen of the second electronic device, the smaller the display-to-control ratio, and the smaller the distance the list displayed on the screen of the first electronic device moves.

[0301] The solution provided in this application embodiment involves a list displayed on the screen of a first electronic device that moves a distance that is related to the user's sliding speed on the screen of a second electronic device. Specifically, the faster the user slides on the second electronic device and the higher the display-to-control ratio (V / C ratio), the greater the distance the list moves on the first electronic device's screen; conversely, the slower the user slides on the second electronic device and the lower the V / C ratio, the smaller the distance the list moves on the first electronic device's screen. By adjusting the V / C ratio based on the user's sliding speed on the second electronic device's screen to further adjust the distance the list moves, a balance between speed and accuracy can be achieved to a certain extent. Specifically, the faster the user slides on the second electronic device's screen, the greater the final distance the list moves on the first electronic device's screen. This can be understood as prioritizing the efficiency of list movement when the user slides faster, i.e., quickly moving the list to the appropriate position; conversely, the slower the user slides on the second electronic device's screen, the smaller the final distance the list moves on the first electronic device's screen. This can be understood as prioritizing the accuracy of list movement when the user slides slower, i.e., slowly moving the list to the precise position.

[0302] It is understood that, in order to achieve the above-mentioned functions, electronic devices include hardware and / or software modules that perform the respective functions. Based on the algorithmic steps of the examples described in the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.

[0303] This embodiment can divide the electronic device into functional modules according to the above method example. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated modules can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0304] When dividing each function into modules according to its corresponding function. Figure 15 A schematic diagram of a possible composition of the electronic device 1500 involved in the above embodiments is shown, such as... Figure 15 As shown, the electronic device 1500 may include a transceiver module 1510 and a processing module 1520.

[0305] When electronic device 1500 is used to achieve Figure 14 When the first electronic device performs its function in the method embodiment, the processing module 1520 can be used to support the electronic device 1500 in performing the above steps 1414, 1420, 1426, etc., and / or other processes used in the technology described herein.

[0306] When electronic device 1500 is used to achieve Figure 14 When the second electronic device functions as described in the method embodiment, the transceiver module 1510 can be used to support the electronic device 1500 in performing the above steps 1412, 1418, 1424, etc., and / or other processes used in the technology described herein.

[0307] The processing module 1520 can be used to support the electronic device 1500 in performing the above steps 1410, 1416, 1422, etc., and / or other processes used in the technology described herein.

[0308] It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.

[0309] The electronic device provided in this embodiment is used to execute the method of this application described above, and therefore can achieve the same effect as the above implementation method.

[0310] When using integrated units, the electronic device may include a processing module, a storage module, and a communication module. The processing module can be used to control and manage the actions of the electronic device; for example, it can support the electronic device in executing the steps performed by the aforementioned units. The storage module can support the electronic device in executing stored program code and data. The communication module can support communication between the electronic device and other devices.

[0311] The processing module can be a processor or a controller. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, or other devices that interact with other electronic devices.

[0312] In one embodiment, when the processing module is a processor and the storage module is a memory, the electronic device involved in this embodiment can be a device having... Figure 1 The device with the structure shown.

[0313] Figure 16A schematic diagram of another possible composition of the electronic device 800 involved in the above embodiments is shown, such as... Figure 16 As shown, the electronic device 800 may include a communication unit 810, an input unit 820, a processing unit 830, an output unit (or display unit) 840, a peripheral interface 850, a storage unit 860, a power supply 870, a video decoder 880, and an audio decoder 890.

[0314] The communication unit 810 is used to establish a communication channel, enabling the electronic device 800 to connect to a remote server through the communication channel and download media data from the remote server. The communication unit 810 may include communication modules such as a WLAN module, Bluetooth module, NFC module, and baseband module, as well as corresponding radio frequency (RF) circuits for wireless local area network communication, Bluetooth communication, NFC communication, infrared communication, and / or cellular communication system communication, such as wideband code division multiple access (W-CDMA) and / or high speed downlink packet access (HSDPA). The communication unit 810 is used to control the communication of various components in the electronic device and can support direct memory access.

[0315] The input unit 820 can be used to enable user interaction with the electronic device and / or input information into the electronic device. In specific embodiments of this application, the input unit can be a touch panel, or other human-computer interaction interfaces, such as physical input keys, microphones, etc., or other external information acquisition devices, such as cameras.

[0316] The processing unit 830 serves as the control center of the electronic device. It can connect to various parts of the electronic device via various interfaces and lines. By running or executing software programs and / or modules stored in the storage unit, and by calling data stored in the storage unit, it performs various functions of the electronic device and / or processes data. Steps 1410, 1416, 1422, or steps 1414, 1420, 1426, etc., can be implemented by the processing unit 830.

[0317] Output unit 840 includes, but is not limited to, an image output unit and an audio output unit. The image output unit is used to output text, images, and / or video. In specific embodiments of this application, the touch panel used in the input unit 820 can also serve as the display panel of the output unit 840. For example, when the touch panel detects a touch or proximity gesture on it, it transmits the information to the processing unit to determine the type of touch event. Subsequently, the processing unit provides corresponding visual output on the display panel based on the type of touch event. Although in Figure 16 In this embodiment, the input unit 820 and the output unit 840 are two independent components that realize the input and output functions of the electronic device. However, in some embodiments, the touch panel and the display panel can be integrated to realize the input and output functions of the electronic device. For example, the image output unit can display various graphical user interfaces as virtual control components, including but not limited to windows, scroll bars, icons, and clipboards, for users to operate via touch.

[0318] The storage unit 860 can be used to store software programs and modules. The processing unit executes various functional applications of the electronic device and performs data processing by running the software programs and modules stored in the storage unit.

[0319] This embodiment also provides a computer storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the methods described in the above embodiments.

[0320] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the methods described in the above embodiments.

[0321] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the methods in the above-described method embodiments.

[0322] In this embodiment, the electronic device, computer storage medium, computer program product or chip are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding method provided above, and will not be repeated here.

[0323] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0324] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0325] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0326] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0327] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0328] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A cursor control method, characterized in that, The method is applied to a first electronic device, and the method includes: Receive a first instruction sent by a second electronic device, and display the cursor as stationary according to the first instruction; The system receives a second instruction sent by the second electronic device, changes the cursor from the stationary state to a pointing state according to the second instruction, and moves the cursor, the current focus of the cursor, and at least one of the lists displayed on the screen of the first electronic device on the screen of the first electronic device. When the cursor or the list stops moving, the cursor is displayed in the stationary state. When the cursor is displayed in the pointing state, the cursor, the current focus of the cursor, and at least one of the lists are movable. When the cursor is displayed in the stationary state, the cursor, the current focus of the cursor, and the list are immovable. The device receives a third instruction sent by the second electronic device and plays the image corresponding to the target focus where the cursor is hovering, according to the third instruction.

2. The method according to claim 1, characterized in that, The second instruction is used to instruct the cursor to move in a first direction and move a first distance; The step of changing the cursor from the stationary state to the pointing state according to the second instruction, and moving at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device, on the screen of the first electronic device, includes: The cursor is changed from the stationary state to the pointing state according to the second instruction, and the cursor is moved a first distance on the screen of the first electronic device in the first direction.

3. The method according to claim 2, characterized in that, The cursor in the pointing state presents a first state, which represents the direction of cursor movement.

4. The method according to claim 1, characterized in that, The second instruction is used to instruct the list displayed on the screen of the first electronic device to move in a second direction and move a second distance; The step of changing the cursor from the stationary state to the pointing state according to the second instruction, and moving at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device, on the screen of the first electronic device, includes: The cursor is changed from the stationary state to the pointing state according to the second instruction, and the list is moved a second distance in the second direction on the screen of the first electronic device.

5. The method according to claim 4, characterized in that, The cursor in the pointing state presents a second state, which represents the direction of the list movement and the magnitude of the cursor deformation.

6. The method according to claim 1, characterized in that, The second instruction includes moving the cursor in a third direction and moving it a third distance; The step of changing the cursor from the stationary state to the pointing state according to the second instruction, and moving at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device, on the screen of the first electronic device, includes: According to the second instruction, the cursor is changed from the stationary state to the pointing state, and the cursor and the focus where the cursor is currently located are moved by the third distance on the screen of the first electronic device in the third direction.

7. The method according to claim 6, characterized in that, The cursor is in a third state, which represents the direction of movement of the cursor and the focus where the cursor is located.

8. The method according to claim 6 or 7, characterized in that, The method further includes: The system receives a fourth instruction sent by the second electronic device and displays a function box according to the fourth instruction. The function box includes function keys for controlling the screen currently displayed by the first electronic device.

9. The method according to any one of claims 1 to 8, characterized in that, If the cursor is moved out of the screen of the first electronic device according to the second instruction, the cursor in the pointing state displays a fourth state, which represents the direction in which the cursor moves out of the screen of the first electronic device and the extent by which the cursor moves out of the screen of the second electronic device. The method further includes: The system receives a fifth instruction from the second electronic device and displays the cursor on the screen of the first electronic device according to the fifth instruction.

10. A cursor control method, characterized in that, The method is applied to a second electronic device, and the method includes: In response to a user's first operation, a first instruction is generated, the first instruction being used to instruct the cursor displayed on the first electronic device to display a stationary state; Send the first instruction to the first electronic device; In response to a second user operation, a second instruction is generated, which instructs the cursor to change from the stationary state to a pointing state, and, when the cursor is displayed in the pointing state, at least one of the cursor, the current focus of the cursor, and the list displayed on the screen of the first electronic device moves in a direction and / or a distance on the screen of the first electronic device, and the cursor is displayed in the stationary state when the cursor or the list stops moving, wherein, when the cursor is displayed in the pointing state, the cursor, the current focus of the cursor, and at least one of the list are movable, and when the cursor is displayed in the stationary state, the cursor, the current focus of the cursor, and the list are immovable; Send the second instruction to the first electronic device; In response to a third user action, a third instruction is generated, which instructs the playback of the image corresponding to the target focus where the cursor is hovering. Send the third instruction to the first electronic device.

11. The method according to claim 10, characterized in that, The second instruction generated in response to the user's second operation includes: In response to the second operation, the operation type of the second operation is determined, the operation type including pointing operation and sliding operation; The second instruction is generated based on the operation type of the second operation.

12. The method according to claim 11, characterized in that, The step of determining the operation type of the second operation in response to the second operation includes: In response to the second operation, the value corresponding to the movement trajectory is determined to be the size of the first threshold, or the angle difference and the second threshold are determined, wherein the movement trajectory is the movement trajectory of the finger acting on the screen of the second electronic device included in the second operation, and the angle difference is the difference in the attitude angle of the second electronic device caused by the second operation. If the value corresponding to the movement trajectory is greater than the first threshold, the second operation is determined to be the sliding operation; If the angle difference is greater than the second threshold, the second operation is determined to be the pointing operation.

13. The method according to claim 11 or 12, characterized in that, If the operation type of the second operation is the pointing operation, the second instruction is used to indicate the direction and / or distance that the cursor and / or the focus where the cursor is currently resting moves on the screen of the first electronic device; If the operation type of the second operation is the sliding operation, the second instruction is used to indicate the direction and / or distance that the list displayed on the screen of the first electronic device moves on the screen of the first electronic device.

14. The method according to any one of claims 10 to 13, characterized in that, The first operation is that the user's finger presses on the screen of the second electronic device, and the second operation is that the user's wrist, which is holding the second electronic device, moves in a first direction; The second instruction is used to instruct the cursor to move in the first direction and move a first distance.

15. The method according to claim 14, characterized in that, The cursor in the pointing state presents a first state, which represents the direction of cursor movement.

16. The method according to any one of claims 10 to 13, characterized in that, The first operation is that the user's finger presses on the screen of the second electronic device, and the second operation is that the user's finger slides on the screen of the second electronic device in a second direction; The second instruction is used to instruct the list displayed on the screen of the first electronic device to move in a second direction and move a second distance.

17. The method according to claim 16, characterized in that, The cursor in the pointing state presents a second state, which represents the direction of the list movement and the magnitude of the cursor deformation.

18. The method according to any one of claims 10 to 13, characterized in that, The first operation is that the user's finger taps the screen of the second electronic device, lifts it, and then taps it again after lifting it; the second operation is that the user's wrist, which is holding the second electronic device, moves in a third direction. The second instruction is used to instruct the cursor to move in the third direction and move a third distance.

19. The method according to claim 18, characterized in that, The cursor in the pointing state presents a third state, which represents the direction of movement of the cursor and the focus where the cursor is located.

20. The method according to claim 18 or 19, characterized in that, When the user's finger taps and lifts off the screen of the second electronic device, and then taps again after lifting off, with the duration of the second tap exceeding a preset threshold, the method further includes: A fourth instruction is generated, which is used to instruct the first electronic device to display a function box, the function box including function keys for controlling the screen currently displayed by the first electronic device; Send the fourth instruction to the first electronic device.

21. The method according to any one of claims 10 to 20, characterized in that, The method further includes: In response to the user's fourth operation, a fifth instruction is generated, which indicates the direction of cursor movement so that the cursor is displayed on the screen of the first electronic device; Send the fifth instruction to the first electronic device.

22. The method according to any one of claims 10 to 21, characterized in that, The distance the cursor and its current focus move on the screen of the first electronic device is related to the rotation speed of the second electronic device, and the distance the list displayed on the screen of the first electronic device moves on the screen of the first electronic device is related to the speed at which the user swipes on the screen of the second electronic device.

23. The method according to claim 22, characterized in that, The faster the second electronic device rotates, the greater the display control ratio, and the greater the distance the cursor and / or the focus where the cursor is currently located moves on the screen of the first electronic device; The slower the second electronic device rotates, the smaller the display-to-control ratio, and the smaller the distance the cursor and / or the focus of the cursor currently rests on moves on the screen of the first electronic device.

24. The method according to claim 22, characterized in that, The faster the user swipes on the screen of the second electronic device, the greater the display-to-control ratio, and the greater the distance the list displayed on the screen of the first electronic device moves. The slower the user swipes on the screen of the second electronic device, the smaller the display-to-control ratio, and the smaller the distance the list displayed on the screen of the first electronic device moves.

25. An electronic device, characterized in that, include: One or more processors; One or more memory units; The one or more memories store one or more computer programs, the one or more computer programs including instructions that, when executed by the one or more processors, cause the electronic device to perform the method as described in any one of claims 1 to 9 or 10 to 24.

26. A computer storage medium, characterized in that, Includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 9 or 10 to 24.

Images