Touch method, electronic device and system

Abstract

The application provides a touch method, an electronic device and a system, and relates to the technical field of terminals. The application can detect the position of a user's finger in part of a detection area, thereby meeting the demand of single-hand operation of the user. The method comprises the following steps: a first electronic device acquires a first finger position of a user holding the first electronic device at a first edge of a first area of the first electronic device, and the first area is part of a detection area of the first electronic device. The first electronic device acquires a second finger position of the user holding the first electronic device at a second edge of the first area, and the first edge and the second edge of the first area are opposite edges, which are perpendicular to the long side of the detection area. The first finger position corresponds to a first display element displayed by a second electronic device at a first edge of a display area; and the second finger position corresponds to a second display element displayed by the second electronic device at a second edge of the display area, and the first edge and the second edge of the display area are opposite edges.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a touch control method, electronic device and system. Background Technology

[0002] With the development of touch interaction technology, some long-distance display devices, such as televisions, in-vehicle screens, and projectors, have enabled hand-eye separation touch interaction scenarios. For example, after launching an application on the television, the application's display interface can be projected onto the touch device, allowing the user to control the television via touch operations on the touch device. Compared to simultaneous hand-eye interaction scenarios, hand-eye separation scenarios better meet users' needs for controlling display devices from a distance.

[0003] However, in the aforementioned hand-eye separation scenario, users need to frequently switch their gaze between the display device and the touch device, making continuous operation impossible and limiting the controllable range of interaction, thus affecting interaction efficiency. Summary of the Invention

[0004] To address the aforementioned technical problems, this application provides a touch control method, electronic device, and system. The technical solution provided by this application includes a first electronic device whose detection area comprises a first region, which is a portion of the detection area. When a user's finger is positioned at any edge of the first region, a second electronic device can also display corresponding display elements at the edges of its own display area. Thus, when a user holds the first electronic device, the reduced operating area of ​​the first region satisfies the user's single-handed operation needs, improving the user experience. Furthermore, through the display of elements, the user can correctly perform control operations without switching their gaze, improving interaction efficiency.

[0005] To achieve the above-mentioned technical objectives, this application provides the following technical solution:

[0006] A first aspect provides a touch control method applied to a first electronic device. The method includes: acquiring the position of a first finger when a user holds the first electronic device, the first finger being located at a first edge of a first region of the first electronic device, the first region being a portion of a detection region of the first electronic device, the first region being used to detect the user's finger position; acquiring the position of a second finger when the user holds the first electronic device, the second finger being located at a second edge of the first region of the first electronic device, the first edge and the second edge of the first region being opposite edges of the first region, the opposite edge of the first region being perpendicular to the long side of the detection region. The first finger position corresponds to a first display element displayed on the second electronic device, the first display element being located at the first edge of the display region of the second electronic device. The second finger position corresponds to a second display element displayed on the second electronic device, the second display element being located at the second edge of the display region of the second electronic device, the first edge and the second edge of the display region being opposite edges of the display region.

[0007] In this way, by configuring a first area in the first electronic device that can map operations onto the entire display area of ​​the second electronic device, the user's single-handed operation range requirement is met, reducing the difficulty of operation. This avoids situations where the user's fingers cannot reach certain areas of the first electronic device, thus preventing operational disruptions.

[0008] Furthermore, by displaying and changing the display elements, users no longer need to switch their gaze back and forth between the first and second electronic devices. They can simply keep their eyes on the second electronic device to perform touch operations. This allows users to control a second electronic device from a distance using the first device, even in scenarios requiring timely and consistent interactive feedback, such as games. Thus, it satisfies both the user's need for a larger display experience and their need for long-distance operation.

[0009] According to the first aspect, the method further includes: obtaining the positions of the user's third finger and fourth finger, wherein the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device. The third finger position corresponds to a third display element with a first display effect displayed on the second electronic device, and the fourth finger position corresponds to a fourth display element with a second display effect displayed on the second electronic device, wherein the first display effect differs from the second display effect.

[0010] For example, as the user's finger decreases in height from the cover of the first electronic device, the color of the displayed element gradually deepens until the user's finger touches the cover. Then, as the user's finger increases in height from the cover of the first electronic device, the color of the displayed element with the darkest color gradually decreases until the finger height exceeds the detection distance of the first electronic device, i.e., exceeds the detection area. The first electronic device can no longer detect the finger and stops displaying the displayed element.

[0011] In this way, users can perceive the relative position of their fingers in space with the first electronic device based on changes in the display effects of the displayed elements, and adjust their finger positions in a timely manner to improve interaction efficiency.

[0012] According to the first aspect, or any implementation of the first aspect above, the method further includes: in response to a user's finger moving from a first finger position to a fifth finger position, obtaining the position of the fifth finger; in response to a user's finger moving from a second finger position to a sixth finger position, obtaining the position of the sixth finger; wherein a first projected distance between the first finger position and the fifth finger position on the first electronic device is equal to a second projected distance between the second finger position and the sixth finger position on the first electronic device. The fifth finger position corresponds to a fifth display element displayed on the second electronic device, and the sixth finger position corresponds to a sixth display element displayed on the second electronic device; the first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

[0013] For example, in the first region, the farther away from the base of the finger, the larger the scaling factor for transforming the three-dimensional coordinates; the closer to the base of the finger, the smaller the scaling factor for transforming the three-dimensional coordinates. Therefore, moving the finger position the same distance closer to the base of the finger and moving it the same distance further away from the base of the finger will result in different movement distances for the corresponding display elements. For example, moving the finger position closer to the base of the finger will result in a smaller movement distance for the display elements, while moving the finger position further away from the base of the finger will result in a larger movement distance for the display elements.

[0014] In this way, by changing the scaling factor, a relatively sensitive interactive experience can be ensured whether the user's finger is near or far from the touchpad. This prevents excessive finger span during touch operation, even if the first electronic device is relatively large for the user, thus improving the user experience.

[0015] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining the position of the user's seventh finger. The position of the seventh finger corresponds to the seventh display element displayed on the second electronic device, and the display effect of the eighth display element originally displayed at the display position changes before and after the seventh display element is displayed at the display position corresponding to the seventh finger position.

[0016] According to the first aspect, or any of the above implementations of the first aspect, the display effect of the modified eighth display element matches that of the seventh display element.

[0017] In this way, by changing the display of multiple elements, the user's interactive experience is enhanced.

[0018] According to the first aspect, or any implementation of the first aspect above, the detection area of ​​the first electronic device further includes a second area, which is a portion of the detection area of ​​the first electronic device, and is used to detect the position of a user's finger; the first finger position and the second finger position are the positions of the user's right-hand fingers; the method further includes: obtaining the position of an eighth finger when the user holds the first electronic device, the eighth finger position being at the first edge of the second area of ​​the first electronic device. Obtaining the position of a ninth finger when the user holds the first electronic device, the ninth finger position being at the second edge of the second area of ​​the first electronic device; wherein, the first edge of the second area and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the eighth finger position and the ninth finger position are the positions of the user's left-hand fingers, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area. The eighth finger position corresponds to the ninth display element displayed by the second electronic device, the ninth display element being located at the second edge of the display area of ​​the second electronic device. The ninth finger position corresponds to the tenth display element displayed by the second electronic device, the tenth display element being located at the first edge of the display area of ​​the second electronic device.

[0019] In this way, by configuring a right-hand detectable area and / or a left-hand detectable area, and ensuring that both areas are mapped to the entire display area of ​​the display device, the user's two-handed operation needs are met, reducing the difficulty of single-handed operation. This avoids situations where the user's fingers cannot reach certain areas, thus preventing operational disruptions.

[0020] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining the position of the user's tenth finger. Multiple first signals are sent to the tenth finger position via a signal transmitting array, the multiple first signals arriving at the tenth finger position at the same or similar times.

[0021] Optionally, the first signal is ultrasound, high-frequency light, etc.

[0022] In this way, the first electronic device can provide tactile feedback to the user, thereby enriching the user experience.

[0023] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining the position of the user's eleventh finger; wherein the position of the tenth finger is at a third height from the first electronic device, and the position of the eleventh finger is at a fourth height from the first electronic device. Multiple second signals are sent to the eleventh finger position via a signal transmitting array, the multiple second signals arriving at the eleventh finger position at the same or similar times, and the signal strengths of the multiple first signals are different from the signal strengths of the multiple second signals.

[0024] In this way, through the continuous tactile feedback that increases as the user's finger gets closer and closer to the cover, the user is prompted about the change in distance at the same time as the tactile feedback.

[0025] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining the position of the user's twelfth finger, the twelfth finger position being a fifth height distance from the first electronic device. The twelfth finger position corresponds to the eleventh display element displayed on the second electronic device, the eleventh display element is displayed above the twelfth display element displayed on the second electronic device, and the fifth height being 0 indicates that the second electronic device is triggered to execute a response event corresponding to the twelfth display element.

[0026] Thus, as the user's finger moves in space, the second electronic device can change the corresponding display elements to indicate the task that the user's finger can instruct the second electronic device to perform. Furthermore, in response to changes in the user's finger height, the second electronic device triggers corresponding response events to meet the user's interaction needs.

[0027] According to the first aspect, or any implementation of the first aspect above, the user finger position includes the position relative to the first electronic device generated by the user finger performing a hovering or touching action on the first electronic device.

[0028] Secondly, a first electronic device is provided. The first electronic device includes: a processor and a memory, the memory being coupled to the processor. The memory stores computer program code, which includes computer instructions. When the processor reads the computer instructions from the memory, the first electronic device executes: acquiring the position of a first finger held by a user, the first finger position being at a first edge of a first region of the first electronic device, the first region being a portion of a detection region of the first electronic device, the first region being used to detect the user's finger position; acquiring the position of a second finger held by the user, the second finger position being at a second edge of the first region of the first electronic device, the first edge and the second edge of the first region being opposite edges of the first region, the opposite edge of the first region being perpendicular to the long side of the detection region. The first finger position corresponds to a first display element displayed by the second electronic device, the first display element being located at the first edge of the display region of the second electronic device. The second finger position corresponds to a second display element displayed by the second electronic device, the second display element being located at the second edge of the display region of the second electronic device, the first edge and the second edge of the display region being opposite edges of the display region.

[0029] According to the second aspect, when the processor reads computer instructions from memory, it also causes the first electronic device to execute: acquiring the positions of the user's third and fourth fingers, wherein the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device. The third finger position corresponds to a third display element with a first display effect displayed by the second electronic device, and the fourth finger position corresponds to a fourth display element with a second display effect displayed by the second electronic device, wherein the first display effect differs from the second display effect.

[0030] According to the second aspect, or any implementation thereof, when the processor reads computer instructions from memory, it further causes the first electronic device to perform: in response to a user's finger moving from a first finger position to a fifth finger position, acquiring the position of the fifth finger; in response to a user's finger moving from a second finger position to a sixth finger position, acquiring the position of the sixth finger; wherein a first projected distance between the first finger position and the fifth finger position on the first electronic device is equal to a second projected distance between the second finger position and the sixth finger position on the first electronic device. The fifth finger position corresponds to a fifth display element displayed by the second electronic device, and the sixth finger position corresponds to a sixth display element displayed by the second electronic device; the first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

[0031] According to the second aspect, or any implementation of the second aspect above, when the processor reads computer instructions from memory, it also causes the first electronic device to execute: obtaining the position of the user's seventh finger. The position of the seventh finger corresponds to the seventh display element displayed by the second electronic device, and before and after the seventh display element is displayed at the display position corresponding to the seventh finger position, the display effect of the eighth display element originally displayed at that position changes.

[0032] According to the second aspect, or any of the implementation methods of the second aspect above, the display effect of the modified eighth display element matches that of the seventh display element.

[0033] According to the second aspect, or any implementation of the second aspect above, the detection area of ​​the first electronic device further includes a second area, which is a portion of the detection area of ​​the first electronic device. The second area is used to detect the position of the user's fingers; the first finger position and the second finger position are the positions of the user's right-hand fingers. When the processor reads computer instructions from the memory, it also causes the first electronic device to execute: acquiring the position of the eighth finger when the user holds the first electronic device, the eighth finger position being at the first edge of the second area of ​​the first electronic device. Acquiring the position of the ninth finger when the user holds the first electronic device, the ninth finger position being at the second edge of the second area of ​​the first electronic device; wherein, the first edge of the second area and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the eighth finger position and the ninth finger position are the positions of the user's left-hand fingers, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area. The eighth finger position corresponds to the ninth display element displayed by the second electronic device, the ninth display element being located at the second edge of the display area of ​​the second electronic device. The ninth finger position corresponds to the tenth display element displayed by the second electronic device, the tenth display element being located at the first edge of the display area of ​​the second electronic device.

[0034] According to the second aspect, or any implementation of the second aspect above, when the processor reads computer instructions from memory, it also causes the first electronic device to perform: acquiring the position of the user's tenth finger. Multiple first signals are sent to the tenth finger position via a signal transmitting array, the multiple first signals arriving at the tenth finger position at the same or similar times.

[0035] According to the second aspect, or any implementation of the second aspect above, when the processor reads computer instructions from memory, it also causes the first electronic device to execute: acquiring the position of the user's eleventh finger; wherein the tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device. Multiple second signals are sent to the eleventh finger position via a signal transmitting array, the multiple second signals arriving at the eleventh finger position at the same or similar times, and the signal strength of the multiple first signals is different from the signal strength of the multiple second signals.

[0036] According to the second aspect, or any implementation of the second aspect above, when the processor reads computer instructions from memory, it further causes the first electronic device to execute: obtaining the position of the user's twelfth finger, the twelfth finger position being a fifth height away from the first electronic device. Wherein, the twelfth finger position corresponds to the eleventh display element displayed by the second electronic device, the eleventh display element is displayed above the twelfth display element displayed by the second electronic device, and the fifth height being 0 indicates that the second electronic device is triggered to execute the response event corresponding to the twelfth display element.

[0037] According to the second aspect, or any implementation of the second aspect above, the user finger position includes the position relative to the first electronic device generated by the user finger performing a hovering or touching action on the first electronic device.

[0038] Thirdly, a touch control system is provided. The system includes: a first electronic device and a second electronic device. The first electronic device is configured to: acquire the position of a first finger when a user holds the first electronic device, the first finger being located at a first edge of a first region of the first electronic device, the first region being a portion of a detection region of the first electronic device, and the first region being used to detect the user's finger position; acquire the position of a second finger when the user holds the first electronic device, the second finger being located at a second edge of the first region of the first electronic device; wherein the first edge and the second edge of the first region are opposite edges of the first region, and the opposite edge of the first region is perpendicular to the long side of the detection region. The second electronic device is configured to: in response to the first electronic device detecting the first finger position, display a first display element corresponding to the first finger position, the first display element being located at the first edge of the display region of the second electronic device; and in response to the first electronic device detecting the second finger position, display a second display element corresponding to the second finger position, the second display element being located at the second edge of the display region of the second electronic device; wherein the first edge and the second edge of the display region are opposite edges of the display region.

[0039] According to the third aspect, the first electronic device is configured to: acquire the positions of a user's third finger and fourth finger, wherein the third finger position is at a first height distance from the first electronic device, and the fourth finger position is at a second height distance from the first electronic device. The second electronic device is configured to: display a third display element having a first display effect when the third finger position is at the first height distance from the first electronic device; and display a fourth display element having a second display effect when the fourth finger position is at the second height distance from the first electronic device, wherein the first display effect differs from the second display effect.

[0040] According to the third aspect, or any implementation of the first aspect above, a first electronic device is configured to: acquire the position of a fifth finger in response to a user's finger moving from a first finger position to a fifth finger position; and acquire the position of a sixth finger in response to a user's finger moving from a second finger position to a sixth finger position; wherein a first projected distance between the first finger position and the fifth finger position on the first electronic device is equal to a second projected distance between the second finger position and the sixth finger position on the first electronic device. A second electronic device is configured to: display a fifth display element corresponding to the fifth finger position in response to the first electronic device detecting the fifth finger position; and display a sixth display element corresponding to the sixth finger position in response to the first electronic device detecting the sixth finger position; wherein a first distance between the first display element and the fifth display element is less than a second distance between the second display element and the sixth display element.

[0041] According to the third aspect, or any implementation of the first aspect above, the first electronic device is used to: obtain the position of the user's seventh finger. The second electronic device is used to: in response to the first electronic device detecting the position of the seventh finger, display a seventh display element corresponding to the position of the seventh finger, and change the display effect of the eighth display element originally displayed at the display position of the seventh display element.

[0042] According to the third aspect, or any of the implementation methods of the first aspect above, the display effect of the modified eighth display element matches that of the seventh display element.

[0043] According to the third aspect, or any implementation of the first aspect above, the detection area of ​​the first electronic device further includes a second area, which is a portion of the detection area of ​​the first electronic device, and is used to detect the position of a user's finger; the first finger position and the second finger position are the positions of the user's right-hand fingers. The first electronic device is used to: acquire the position of an eighth finger when the user holds the first electronic device, the eighth finger position being at the first edge of the second area of ​​the first electronic device; acquire the position of a ninth finger when the user holds the first electronic device, the ninth finger position being at the second edge of the second area of ​​the first electronic device; wherein, the first edge of the second area and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the eighth finger position and the ninth finger position are the positions of the user's left-hand fingers, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area. The second electronic device is used to: in response to the first electronic device detecting the eighth finger position, display a ninth display element corresponding to the eighth finger position, the ninth display element being located at the second edge of the display area of ​​the second electronic device; in response to the first electronic device detecting the ninth finger position, display a tenth display element corresponding to the ninth finger position, the tenth display element being located at the first edge of the display area of ​​the second electronic device.

[0044] According to the third aspect, or any implementation of the first aspect above, the first electronic device is configured to: acquire the position of a user's tenth finger; and send multiple first signals to the tenth finger position via a signal transmitting array, wherein the multiple first signals arrive at the tenth finger position at the same or similar times.

[0045] According to the third aspect, or any implementation of the first aspect above, the first electronic device is used to: acquire the position of the user's eleventh finger; wherein the position of the tenth finger is at a third height from the first electronic device, and the position of the eleventh finger is at a fourth height from the first electronic device. Multiple second signals are sent to the eleventh finger position via a signal transmitting array, the multiple second signals arriving at the eleventh finger position at the same or similar times, and the signal strengths of the multiple first signals are different from the signal strengths of the multiple second signals.

[0046] According to the third aspect, or any implementation of the first aspect above, the first electronic device is configured to: obtain the position of the user's twelfth finger, the position of the twelfth finger being a fifth height away from the first electronic device. The second electronic device is configured to: in response to the first electronic device detecting the position of the twelfth finger, display an eleventh display element corresponding to the twelfth finger position, the eleventh display element being displayed above the twelfth display element displayed by the second electronic device. When the fifth height is 0, a response event corresponding to the twelfth display element is triggered.

[0047] According to the third aspect, or any implementation of the third aspect above, the user finger position includes the position relative to the first electronic device generated by the user finger performing a hovering or touching action on the first electronic device.

[0048] Fourthly, a touch control method is provided, applied to a first electronic device. The method includes: detecting a first finger position corresponding to a user's finger; sending the first finger position to a second electronic device, wherein the first finger position is used by the second electronic device to display a first display element corresponding to a first display effect of the first finger position.

[0049] In some examples, when a user's finger is within the detection area of ​​a first electronic device, the first electronic device is able to detect the position of the first finger corresponding to the user's finger.

[0050] In this way, the first electronic device detects the user's finger position and displays corresponding elements on the second electronic device. By displaying and changing these elements, the user doesn't need to switch their gaze back and forth between the two devices; they can simply keep their eyes on the second device to perform touch operations. Therefore, in scenarios requiring timely and consistent interactive feedback, such as games, users can control a remotely located second electronic device using the first device. This satisfies both the user's need for a larger display and their need for long-distance operation.

[0051] According to the fourth aspect, a first signal is sent to the spatial location indicated by the first finger position via a signal transmission array.

[0052] According to the fourth aspect, or any implementation of the fourth aspect above, the multiple first signals transmitted by the multiple signal transmitting arrays arrive at the spatial position indicated by the first finger position at the same or similar times.

[0053] In this way, the first electronic device can provide tactile feedback to the user, thereby enriching the user experience.

[0054] According to the fourth aspect, or any implementation of the fourth aspect above, the position of a second finger corresponding to the user's finger is detected. The position of the second finger is sent to the second electronic device, which is used by the second electronic device to display a second display element corresponding to the second display effect of the second finger position.

[0055] According to the fourth aspect, or any of the above implementations of the fourth aspect, the first display effect of the first display element corresponds to the first height indicated by the position of the first finger, and the second display effect of the second display element corresponds to the second height indicated by the position of the second finger. The first height is different from the second height, and the first display effect is different from the second display effect.

[0056] In this way, based on different finger position heights, the second electronic device can present display elements with different display effects, helping users understand the height of their current finger position relative to the first electronic device. Thus, users can control the display of the second electronic device without having to switch their gaze to the first electronic device.

[0057] In some examples, a user can use a first electronic device to operate a second electronic device with one or more fingers. The second electronic device can then display a single display element corresponding to a single finger, or one or more display elements corresponding to multiple fingers, thus meeting various user needs.

[0058] In some examples, multiple fingers can refer to different fingers of the same user, or fingers of different users. In some examples, the user can hold or not hold the first electronic device. When the user holds the first electronic device with one hand, the first display element corresponds to the user's thumb in the hand, and the second display element, which can be displayed simultaneously with the first display element, corresponds to the user's other finger not in the hand. Alternatively, when the user holds the first electronic device with both hands, the first display element and the second display element, which can be displayed simultaneously, correspond to the user's left thumb and right thumb, respectively.

[0059] According to the fourth aspect, or any of the above implementations of the fourth aspect, the first display effect of the first display element and the second display effect of the second display element are matched.

[0060] For example, when a user performs a two-finger pinch operation in the detection space of the first electronic device, the second electronic device can display a first display element and a second display element corresponding to the two fingers respectively, and the first display effect and the second display effect are matched to present different degrees of pinching.

[0061] In this way, by matching the display effects of the displayed elements, a better operating experience can be provided to the user.

[0062] According to the fourth aspect, or any implementation of the fourth aspect above, when the user holds the first electronic device, the detection area of ​​the first electronic device includes a right-hand detectable area and / or a left-hand detectable area. Optionally, the right-hand detectable area and the left-hand detectable area may not overlap and may be combined to form the detection area of ​​the first electronic device; alternatively, the right-hand detectable area and the left-hand detectable area may partially overlap. When the user's right-hand finger is located at the right edge of the right-hand detectable area, the second electronic device displays a cursor at the right edge of the display area. When the user's right-hand finger is located at the left edge of the right-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left-hand finger is located at the left edge of the left-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left-hand finger is located at the right edge of the left-hand detectable area, the second electronic device displays a cursor at the right edge of the display area.

[0063] Thus, by configuring a right-hand detectable area and / or a left-hand detectable area, and ensuring that both areas are mapped to the entire display area of ​​the display device, the user's two-handed operation needs are met, reducing the difficulty of single-handed operation. This avoids situations where the user's fingers cannot reach certain areas, thus preventing operational disruptions.

[0064] According to the fourth aspect, or any implementation of the fourth aspect above, when the user holds the first electronic device, in the right-hand detectable area and the left-hand detectable area, the user's finger moves a first projection distance near the base of the finger and a second projection distance away from the base of the finger. When the first projection distance is equal to the second projection distance, the movement distance of the display element displayed on the display area of ​​the second electronic device corresponding to the first projection distance is less than the movement distance corresponding to the second projection distance.

[0065] This ensures a responsive interactive experience whether the user's finger is near or far from the touchpad. Even if the first electronic device is relatively large for the user, it avoids the problem of the user's finger spanning too far during touch operation, thus improving the user experience.

[0066] Fifthly, a touch control method is provided, applied to a second electronic device. The method includes: receiving a first finger position transmitted by a first electronic device; and presenting a first display element, the first display element having a first display effect on the second electronic device for indicating the first finger position.

[0067] In some examples, the second electronic device receives the position of a second finger from the first electronic device. A second display element is presented, and a second display effect of this second display element on the second electronic device is used to indicate the position of the second finger.

[0068] In some examples, the first display effect of the first display element corresponds to the first height indicated by the position of the first finger, and the second display effect of the second display element corresponds to the second height indicated by the position of the second finger. The first height is different from the second height, and the first display effect is different from the second display effect.

[0069] According to the fifth aspect, presenting the second display element includes: presenting the second display element during the presentation of the first display element; or presenting the second display element after the presentation of the first display element.

[0070] According to the fifth aspect, or any of the above implementations of the fifth aspect, the first display effect of the first display element and the second display effect of the second display element are matched.

[0071] According to the fifth aspect, or any implementation of the fifth aspect above, the first horizontal and vertical coordinates indicated by the position of the first finger are within the area of ​​the third display element displayed on the second electronic device, and the method further includes: changing the third display effect of the third display element, wherein the changed third display effect of the third display element matches the first display effect of the first display element.

[0072] For example, during the process of displaying the desktop on the second electronic device, if the location of the first finger is received and it is determined that the display position of the first finger is above an application icon on the desktop, then the second electronic device can display the first display element corresponding to the first finger position on top and display a magnified version of the application icon on the bottom. This prompts the user that the application icon can be interacted with at the current finger position.

[0073] In this way, by coordinating the original display elements with the display elements corresponding to the finger position, the difficulty of user operation is further reduced, and the fun of operation is increased.

[0074] Presenting a first display element according to the fifth aspect, or any implementation thereof, includes: determining the display position of the first display element proportionally based on the ratio between the first size of the display screen of the second electronic device and the second size of the detection area of ​​the first electronic device, and displaying the first display element at that display position.

[0075] In this way, the second electronic device displays the elements corresponding to the finger's position at a fixed ratio, providing users with more realistic display feedback. For example, in a drawing scenario, as the user's finger moves in the space above the first electronic device, the cursor (or displayed as a pen, etc.) can move proportionally on the screen of the second electronic device.

[0076] According to the fifth aspect, or any implementation thereof, when the user holds the first electronic device, the detection area of ​​the first electronic device includes a right-hand detectable area and / or a left-hand detectable area. Optionally, the right-hand detectable area and the left-hand detectable area may not overlap and may be combined to form the detection area of ​​the first electronic device; alternatively, the right-hand detectable area and the left-hand detectable area may partially overlap. When the user's right-hand finger is located at the right edge of the right-hand detectable area, the second electronic device displays a cursor at the right edge of the display area. When the user's right-hand finger is located at the left edge of the right-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left-hand finger is located at the left edge of the left-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left-hand finger is located at the right edge of the left-hand detectable area, the second electronic device displays a cursor at the right edge of the display area.

[0077] According to the fifth aspect, or any implementation of the fifth aspect above, when the user holds the first electronic device, in the right-hand detectable area and the left-hand detectable area, the user's finger moves a first projection distance near the base of the finger and a second projection distance away from the base of the finger. When the first projection distance is equal to the second projection distance, the movement distance of the display element displayed on the display area of ​​the second electronic device corresponding to the first projection distance is less than the movement distance corresponding to the second projection distance.

[0078] According to the fifth aspect, or any implementation of the fifth aspect above, the height indicated by the first finger position is 0, and the method further includes: executing the response event corresponding to the first finger position.

[0079] Sixthly, an electronic device is provided that has the function of implementing the touch method as described in the first aspect and any of its possible implementations. This function can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the described function.

[0080] In a seventh aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program (also referred to as instructions or code) that, when executed by an electronic device, causes the electronic device to perform the method of the first aspect or any embodiment of the first aspect.

[0081] Eighthly, a computer program product is provided that, when run on an electronic device, causes the electronic device to perform the method of the first aspect or any one of the embodiments of the first aspect.

[0082] Ninth aspect, a circuit system is provided, the circuit system including processing circuitry configured to perform the method of the first aspect or any embodiment of the first aspect.

[0083] In a tenth aspect, a chip system is provided, including at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor, and when the at least one processor executes the instructions, the at least one processor performs the method of the first aspect or any embodiment of the first aspect.

[0084] The technical effects of the aforementioned aspects can be referenced from each other, and will not be elaborated further here. Attached Figure Description

[0085] Figure 1 A schematic diagram illustrating the working principle of a mouse provided in an embodiment of this application;

[0086] Figure 2 This is a schematic diagram of a long-distance display device control scenario provided in an embodiment of this application;

[0087] Figure 3 A schematic diagram of the communication system used in the touch method provided in the embodiments of this application;

[0088] Figure 4 A schematic diagram of the hardware structure of the first electronic device provided in an embodiment of this application;

[0089] Figure 5 This is a schematic diagram of module interaction provided in an embodiment of this application;

[0090] Figure 6 This application provides a schematic diagram of a touch scenario. Figure 1 ;

[0091] Figure 7 This application provides a schematic diagram of a touch scenario. Figure 2 ;

[0092] Figure 8 This application provides a schematic diagram of a touch scenario. Figure 3 ;

[0093] Figure 9 This application provides a schematic diagram of a touch scenario. Figure 4 ;

[0094] Figure 10 This application provides a schematic diagram of a touch scenario. Figure 5 ;

[0095] Figure 11 This application provides a schematic diagram of a touch scenario. Figure 6 ;

[0096] Figure 12 This application provides a schematic diagram of a touch scenario. Figure 7 ;

[0097] Figure 13 This is a schematic diagram illustrating the principle of grip state detection provided in an embodiment of this application;

[0098] Figure 14 This application provides a schematic diagram of a touch scenario. Figure 8 ;

[0099] Figure 15 This application provides a schematic diagram of a touch scenario. Figure 9 ;

[0100] Figure 16 This application provides a schematic diagram of a touch scenario. Figure 10 ;

[0101] Figure 17 This application provides a schematic diagram of a touch scenario. Figure 10 one;

[0102] Figure 18 This is a schematic diagram illustrating the working principle of the suspension detection module provided in the embodiments of this application;

[0103] Figure 19 This application provides a schematic diagram of a touch scenario. Figure 10 two;

[0104] Figure 20 This application provides a schematic diagram of a touch scenario. Figure 10 three;

[0105] Figure 21 This application provides a schematic diagram of a touch scenario. Figure 10 Four;

[0106] Figure 22 This application provides a schematic diagram of a touch scenario. Figure 10 five;

[0107] Figure 23 This is a schematic diagram illustrating the working principle of the haptic feedback module provided in the embodiments of this application;

[0108] Figure 24 This is a schematic diagram illustrating a usage mode switching scenario provided in an embodiment of this application.

[0109] Figure 25 This is a schematic diagram of the touch method provided in the embodiments of this application;

[0110] Figure 26 A schematic diagram of the structure of the first electronic device provided in the embodiments of this application;

[0111] Figure 27 A schematic diagram of the structure of the second electronic device provided in an embodiment of this application. Detailed Implementation

[0112] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings. In the description of the embodiments of this application, the terminology used in the following embodiments is for the purpose of describing specific embodiments only and is not intended to be a limitation of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include expressions such as “one or more,” unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, “at least one” and “one or more” refer to one or more (including two).

[0113] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized. The term "connection" includes direct connections and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.

[0114] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.

[0115] In some embodiments, electronic devices such as mobile phones, televisions, in-vehicle screens, and projectors can achieve touch interaction. Touch scenarios include hand-eye synchronization scenarios and hand-eye separation scenarios. For example, in a hand-eye synchronization scenario, the display device and the touch device are the same device. For instance, a mobile phone displays an application interface and responds to the user's touch operations on the application interface, executing corresponding tasks. Alternatively, in a hand-eye separation scenario, the display device and the touch device are different devices. Optionally, the touch device may be, for example, a keyboard and mouse, an air mouse remote control, or a touchscreen device, thereby facilitating user control of a distant display device.

[0116] For example, a display device (such as a computer) is configured with such Figure 1 The mouse shown allows users to interact with the content displayed on the screen. The mouse illuminates an external sensing surface using a light-emitting diode (LED), and an image sensor captures this surface. The mouse then compares the relative displacement between two frames using the image sensor to determine the direction and distance of movement. The mouse then sends this determined displacement direction and distance to the display device, which moves the cursor and executes the corresponding response event based on this information.

[0117] It can be seen that the mouse must be located on a stable, perceptible plane to control the display device, thus limiting its usability. Furthermore, in simultaneous operation, one mouse corresponds to one focus on the display device (such as the cursor). To achieve multi-finger touch, the display device would need to be configured with multiple mice, making it difficult for users to operate multiple mice simultaneously.

[0118] For example, such as Figure 2 As shown, the display device projects the application interface onto the touch device for synchronized display. The user can then perform touch operations based on the content displayed on the touch device. The touch device sends the detected touch operations and generated touch data to the display device, which then displays the corresponding content based on this touch data. In this way, the user can control the display device from the touch device using touch operations.

[0119] It can be seen that, compared to hand-eye synchronization scenarios, hand-eye separation scenarios can meet users' needs for remote control of display devices. However, in the aforementioned hand-eye separation scenarios, when operating the displayed content, users need to switch their gaze from the display device to the touch device, and then switch their gaze back from the touch device after completing the operation. Therefore, during the entire touch process, users need to frequently switch their gaze between the display and touch devices, making continuous operation impossible and impacting interaction efficiency. Furthermore, the touch device and display device need to transmit display data and touch data multiple times, increasing touch latency.

[0120] In some scenarios, the display device can obtain the actual size of the touch device and determine a scaling factor based on the size of its own display area. The touch device is equipped with a floating screen, which can be used to detect the floating information of the user's finger on the floating screen. This floating information includes the coordinates of the finger on the floating screen and its distance from the screen. The touch device can then send this floating information to the display device, which displays an indicator icon based on this information, making it easier for the user to locate the finger's position.

[0121] In the aforementioned touch scenarios, users can determine their finger movement position based on the indicator icons, reducing the need for eye switching. However, because the display device shows the indicator icons based on a ratio between the actual size of the touch device and its own screen size—meaning the indicator icons are displayed proportionally on the screen—in some scenarios, such as when users are accustomed to holding the touch device for gaming, the limited finger movement distance makes it difficult for users to move their fingers to the opposite edge of the touch device for operation. This results in some content on the display being difficult for users to interact with. Furthermore, if the display device is large, such as a large screen, the difficulty of operation will further increase, impacting the user experience.

[0122] Therefore, this application provides a method for controlling element display on a screen using finger hovering, and further provides a touch control method. The detection area of ​​the touch device is designed to include a first area, which is a portion of the detection area. Through further design, when the user's finger is positioned at the edges of the first area, the display device can also display corresponding display elements at the edges of its own display area. Thus, when the user holds the touch device, the reduced operating area of ​​the first region satisfies the user's single-handed operation needs, improving the user experience. Furthermore, by displaying the elements, the user can correctly perform control operations without switching their gaze, improving interaction efficiency.

[0123] Figure 3 This is a schematic diagram of the communication system used in the touch method provided in the embodiments of this application. Figure 3 As shown, the communication system includes a first electronic device 100 and a second electronic device 200.

[0124] Optionally, the first electronic device 100 may be a dedicated touch device, or it may be a device with touch functionality. For example, the first electronic device 100 may be a touch device specifically configured for the second electronic device 200. Alternatively, the first electronic device 100 may be a terminal device such as a mobile phone, tablet, wearable device, or AI device. The operating system installed on the first electronic device 100 may include, but is not limited to, […]. Alternatively, the first electronic device 100 may use other operating systems, or it may not have an operating system installed. This application does not limit the specific type of the first electronic device 100, whether it has an operating system installed, or the operating system installed.

[0125] Optionally, the second electronic device 200 can be, for example, a television, in-vehicle screen, projector, computer, tablet computer, laptop computer, mobile phone, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), wearable device, artificial intelligence (AI) device, or other terminal device. The operating system installed on the second electronic device 200 includes, but is not limited to, […]. Alternatively, other operating systems may be used. This application does not limit the specific type of the second electronic device 200 or the operating system installed on it.

[0126] In some embodiments, a wireless communication connection is established between the first electronic device 100 and the second electronic device 200. The wireless communication technology used to establish this connection includes, but is not limited to, at least one of the following: wireless local area networks (WLAN) (such as Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT) (e.g., classic Bluetooth or Bluetooth Low Energy (BLE)), near field communication (NFC), Zigbee, frequency modulation (FM), infrared (IR), ultra-wideband (UWB), and star-flash technology.

[0127] Optionally, the first electronic device 100 and the second electronic device 200 can also establish a communication connection through a third-party device in the local area network, such as a router, gateway, or server.

[0128] In other embodiments, a wired communication connection is established between the first electronic device 100 and the second electronic device 200. This wired communication connection can be established, for example, via a Universal Serial Bus (USB) interface.

[0129] Optionally, Figure 4This is a schematic diagram of the hardware structure of the first electronic device 100 provided in an embodiment of this application. Figure 4 As shown, the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, a wireless communication module 150, an audio module 160, a hover detection module 170, a touch detection module 171, a button 180, and a motor 190, etc.

[0130] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the first electronic device 100. In other embodiments of this application, the first electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0131] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0132] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0133] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0134] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0135] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to a touch sensor, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to a touch sensor through the I2C interface, enabling the processor 110 and the touch sensor to communicate through the I2C bus interface, thereby realizing the touch function of the first electronic device 100.

[0136] USB interface 130 is a USB standard compliant interface, specifically a Mini USB interface, Micro USB interface, USB Type-C interface, etc. USB interface 130 can be used to connect a charger to charge the first electronic device 100, and can also be used for data transfer between the first electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other terminal devices, such as AR devices.

[0137] In some embodiments, the first electronic device establishes a wired communication connection with the second electronic device 200 via a USB interface 130. Subsequently, after detecting the user's finger position, the first electronic device 100 sends the user's finger position to the second electronic device 200 via the wired communication connection.

[0138] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the first electronic device 100. In other embodiments of this application, the first electronic device 100 may also adopt different interface connection methods or a combination of multiple interface connection methods as described in the above embodiments.

[0139] The wireless communication function of the first electronic device 100 can be implemented through an antenna, a wireless communication module 150, a modem processor, and a baseband processor.

[0140] Antennas are used to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antennas can be multiplexed as diversity antennas for a wireless local area network. In some other embodiments, antennas can be used in conjunction with tuning switches.

[0141] The wireless communication module 150 can provide solutions for wireless communication applications on the first electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 150 can be one or more devices integrating at least one communication processing module. The wireless communication module 150 receives electromagnetic waves via an antenna, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to the processor 110. The wireless communication module 150 can also receive signals to be transmitted from the processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via the antenna.

[0142] In some embodiments, the first electronic device 100 can communicate with a network and other devices via wireless communication technologies. The wireless communication technologies may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies. The GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), BeiDou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).

[0143] In some embodiments, the hover detection module 170 and the touch detection module 171 are used to detect the position of a user's finger in the detection area of ​​the first electronic device 100. Optionally, the detection area is a preset space range located above the cover of the first electronic device 100. The first electronic device 100 can be a mobile device or a non-mobile device. The space above the cover of the first electronic device 100 is used to indicate the orientation corresponding to the cover of the first electronic device 100. In some examples, the orientation corresponding to the cover of the first electronic device 100 is not necessarily physically above (e.g., towards the sky). That is, in this embodiment, the space above the cover of the first electronic device 100 is the space above the orientation relative to the detection area. For example, if a user holds the first electronic device 100 and the first electronic device 100 is tilted towards the user for ease of operation, then the space above the detection area of ​​the first electronic device 100 can also be the preset space range tilted towards the user as indicated by the detection area.

[0144] In some examples, the hover detection module 170 is used to detect hover data of the user's finger, and the touch detection module 171 is used to detect touch data of the user's finger. Optionally, the hover data and touch data are, for example, the three-dimensional coordinates of the user's finger located in the detection area. The z-coordinate of the touch data is 0, meaning that when the user's finger touches the cover of the first electronic device 100, the height of the finger relative to the cover of the first electronic device 100 is 0. In some examples, the hover detection module 170 and the touch detection module 171 can be two independent modules, or they can be combined into one module. Further details regarding the hover detection module 170 and the touch detection module 171 are provided in the following description.

[0145] In some examples, the first electronic device 100 establishes a wireless communication connection with the second electronic device 200 via the wireless communication module 150. After obtaining the position of the user's finger, the first electronic device 100 sends the finger position to the second electronic device 200 via the wireless communication module 150, so that the second electronic device 200 can display the corresponding display element (such as a cursor) at the corresponding position on the display screen based on the finger position.

[0146] In some embodiments, the first electronic device 100 is configured with a cover plate. Optionally, the cover plate is located above the levitation detection module 170 and the touch detection module 171. In some examples, the cover plate is part of the housing of the first electronic device 100. In some examples, the cover plate can also be used to display images, videos, etc. The cover plate includes a display panel. The display panel can be manufactured using a liquid crystal display (LCD), such as an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, a quantum dot light-emitting diode (QLED), etc.

[0147] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the first electronic device 100. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0148] Internal memory 121 can be used to store computer executable program code, which includes instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of the first electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of the first electronic device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory disposed in the processor.

[0149] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via a USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the second electronic device 200. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0150] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, internal memory 121, hover detection module 170, touch detection module 171, and wireless communication module 150, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0151] The audio module 160 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 160 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 160 may be located in the processor 110, or some functional modules of the audio module 160 may be located in the processor 110. The first electronic device 100 can use the audio module 160 for functions such as music playback and recording. The audio module 160 may include a speaker, receiver, microphone, headphone jack, and application processor to implement audio functions.

[0152] Buttons 180 include control buttons, power buttons, volume buttons, etc. Buttons 180 can be mechanical buttons or touch-sensitive buttons. The first electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of the first electronic device 100.

[0153] In some examples, the first electronic device 100 is equipped with an image acquisition module, which can be used to acquire user images, such as those used to determine user identity; it can also be used to acquire user finger images, such as those used to determine the position of the user's fingers, how the user holds the device, etc.

[0154] Optionally, the second electronic device 200 has a similar Figure 4 The hardware structures shown are the same, similar, or have some differences. For example, except... Figure 4 In addition to the hardware shown, the second electronic device 200 may also include hardware such as a display screen, camera, and sensor module.

[0155] In some examples, the display screen can be used to display images, videos, etc. The display screen includes a display panel. The display panel can be manufactured using LCD, such as OLED, active-matrix organic light-emitting diode or AMOLED, FLED, Mini-led, Micro-led, Micro-oled, QLED, etc.

[0156] In some examples, the second electronic device 200 establishes a wireless communication connection with the first electronic device 100 via a wireless communication module. After receiving the user's finger position sent by the first electronic device 100, the wireless communication module of the second electronic device 200 sends the finger position to the processor. Based on the user's finger position, the processor determines the display position and display effect of the display element (such as the cursor) corresponding to the finger position. Then, the second electronic device 200 can display the display element corresponding to the user's finger position at the determined display position and according to the determined display effect.

[0157] In some examples, the second electronic device 200 does not include, for example... Figure 4The hover detection module 170 and touch detection module 171 are shown. That is, the first electronic device 100 detects the user's finger position through the hover detection module 170 or the touch detection module 171, and the second electronic device 200 does not need to detect the user's finger position, but can directly receive the user's finger position sent by the first electronic device 100.

[0158] In some examples, the display can be a touchscreen or a non-touchscreen.

[0159] A camera is used to capture still images or videos. An object is projected onto a photosensitive element by an optical image generated through a lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP (Internet Service Provider) for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP (Digital Signal Processor) for processing. The DSP converts the digital image signal into image signals in standard formats such as RGB and YUV. In some embodiments, the second electronic device 200 may include one or N cameras, where N is a positive integer greater than 1.

[0160] Sensor modules may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, etc.

[0161] The following section uses the first electronic device 100 as a touch device and the second electronic device 200 as a display device as an example to describe in detail the touch method provided in the embodiments of this application.

[0162] In some embodiments, a communication connection is established between the display device and the touch device. This communication connection can be wired or wireless. For example, the display device and the touch device can establish a wired connection via a USB interface, or a Bluetooth communication connection via Bluetooth technology.

[0163] In some examples, the display device and the touch device are complementary devices, meaning that one display device is equipped with at least one dedicated touch device. Alternatively, the touch device can respond to user input and establish communication connections with different display devices, making it convenient for users to operate different display devices while carrying the touch device.

[0164] For example, such as Figure 5As shown, a communication connection is established between the peripheral interface 521 of the display device 52 and the peripheral interface 511 of the touch device 51 to meet the communication needs between the display device 52 and the touch device 51. Afterwards, the processing module 512 of the touch device 51, upon acquiring user data, can send the user data to the display device 52 through the peripheral interface 511. Correspondingly, the display device 52 receives the user data sent by the touch device 51 through the peripheral interface 521 and processes the user data through the processing module 522 to display relevant content through the display module 523. Optionally, the user data may be, for example, the position of the user's finger detected by the touch device 51 through the hover detection module 514 or the touch detection module 515, such as the three-dimensional coordinates of the user's finger relative to the touch device 51. Based on the position of the user's finger, the display device 52 can display a corresponding cursor to help the user determine the current operation location. In this way, the user can complete the touch operation while continuously looking at the display device 52 without switching their gaze, thereby improving the continuity of the touch operation.

[0165] It should be understood that Figure 5 The illustrated structure does not constitute a specific limitation on the touch device 51. In other embodiments of this application, the touch device 51 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. For example, the touch device 51 may also include a power management module 513 for powering other modules. Similarly, Figure 5 The schematic structure does not constitute a specific limitation on the display device 52. For example, the display device 52 may also include a power management module 524 for powering other modules.

[0166] In some embodiments, the touch device can be used to detect the position of a user's finger within the detection area of ​​the touch device, such as the three-dimensional coordinates corresponding to the center position of the user's finger, to meet the user's need to control the displayed content of the display device via touch. Optionally, the user's finger position includes the position relative to the touch device resulting from the user's finger performing a hovering or touching action on the touch device.

[0167] In some examples, users control a cursor displayed on a screen by moving their fingers in the space above the touch device. Specifically, as the user's finger hovers above the touch device or touches it, the touch device detects changes in the three-dimensional coordinates of the user's finger in the space above it and displays a moving cursor corresponding to those coordinates on the screen. This way, the user can be aware of the current movement of their finger, such as direction, position, and height, without having to switch their gaze to the touch device.

[0168] Optionally, the display device displays a display element corresponding to the position of the user's finger. This display element can be the cursor mentioned above, or it can be a game controller, the outline of the user's finger, a virtual character, or other forms. The following section uses a cursor as an example to illustrate the display elements displayed by the display device.

[0169] For example, such as Figure 6 As shown, the touch device detects a user's finger located above the cover plate (which can also be described as a touchscreen, touch panel, touch area, etc.) and determines the corresponding three-dimensional coordinates (x, y, z). The touch device then sends these three-dimensional coordinates (x, y, z) to the display device. The display device receives these three-dimensional coordinates (x, y, z) and displays a cursor 61 at the corresponding position on the screen. For example, if the user's finger is located near the center of the left edge above the cover plate of the touch device, the display device can also display cursor 61 near the center of the left edge of its display screen. This helps the user understand the current finger position and facilitates subsequent finger movements to control the displayed content.

[0170] In subsequent embodiments, the terms "up," "down," "left," and "right" are all referenced. Figure 6 The directions shown will not be repeated below.

[0171] In some embodiments, the detection area of ​​the touch device includes a touch area located on the cover plate, which is used to detect user touch operations on the cover plate of the touch device. That is, the detection area of ​​the touch device includes the space within a preset height range above the touch area and the touch area itself. The display device can obtain dimensional information of the touch area of ​​the touch device (such as the entire cover plate or a portion thereof), such as length and width. In this way, the display device can determine the dimensional ratio between the touch area of ​​the touch device and the display area of ​​the display screen, for example... Figure 6 As shown, the length ratio is 'a' and the width ratio is 'b'. Subsequently, after receiving the 3D coordinates sent by the touch device, the display device can adapt these coordinates to the current display area based on a determined scaling factor, including the length ratio 'a' and the width ratio 'b'. This allows the display device to show a cursor that moves with the finger's position, avoiding misinterpretations caused by a mismatch between the user's finger movement and the cursor's display position. Furthermore, by establishing the scaling factor, it's not necessary for the touch area of ​​the touch device and the display area of ​​the display device to be the same size, simplifying user operation with a smaller screen while still meeting the user's need for a larger screen.

[0172] For example, such as Figure 6As shown, when a user's finger is located within the detection area of ​​a touch device, the touch device can obtain the position of the user's finger and send the corresponding three-dimensional coordinates to the display device. Accordingly, after receiving the three-dimensional coordinates (x, y, z), the display device obtains the coordinates (x*a, y*b) based on the x and y values ​​indicated in the three-dimensional coordinates, as well as the scales a and b, and displays the cursor 61 at the coordinate (x*a, y*b) position.

[0173] In some embodiments, the touch device is a fixed device or a handheld mobile device. In some examples, while holding the touch device, the user may use their hand in a holding state to perform touch operations. In this case, when the touch device determines that the user's hand is in a holding state, it can instruct the display device to display a cursor corresponding to the user's finger position based on that holding state. Optionally, the user may hold the touch device with one hand or with both hands.

[0174] For example, such as Figure 7 As shown, a user holds the touch device 100 with both hands to operate a game application displayed on the display device 200. Optionally, the touch device 100 may simultaneously display the game application or not. Optionally, as... Figure 16 As shown, the display device 200 displays cursors corresponding to the left and right thumbs when the user holds the device with both hands. This allows the user to determine changes in hand touch control during gameplay based on cursor movement. Optionally, the display device 200 may display the outlines of the user's two thumbs and the cursor in the center area of ​​the fingers; alternatively, the display device 200 may display only the cursor in the center area of ​​the fingers, without displaying the outlines of the two thumbs.

[0175] In this way, by displaying and changing the cursor, users no longer need to switch their gaze back and forth between the display device and the touch device; they can simply keep their eyes on the display device to perform touch operations. This allows users to control a distant display device via the touch device in scenarios requiring timely and consistent interactive feedback, such as games. Thus, it satisfies both the user's need for a larger display experience and their need for long-distance operation.

[0176] In some examples, the flexibility of operation is limited when a user holds a touch device to perform touch operations, such as a reduction in the reach of their fingers. Therefore, the entire detection area of ​​the touch device can be divided, and the operable detection area can be determined according to the reach of the user's fingers when holding the touch device, so as to facilitate a wider range of free control of the display device by the user when holding it.

[0177] For example, such as Figure 8As shown in (a), taking the cover plate of the touch device and the display screen of the display device as a rectangle, with the top and bottom sides as the long sides and the left and right sides as the short sides, when the user holds the touch device with their right hand, their right thumb is located in the detection area of ​​the touch device and can be used to control the movement of the cursor displayed on the display screen. Optionally, the detection area of ​​the touch device includes a right-hand detectable area 81, which is a portion of the detection area of ​​the touch device and is used to detect the position of the user's finger. Furthermore, when the user's finger is in any position within the right-hand detectable area 81, the cursor can be displayed at any corresponding position on the display screen. For example, as shown in (a). Figure 8 As shown in (a), when the user's finger is located at the right edge 811 of the right-hand detectable area 81, the display device can display a cursor corresponding to the user's finger at the corresponding position on the right edge of the entire display area. For example, as... Figure 8 As shown in (b), when the user's finger is located at the left edge 812 of the right-hand detectable area 81, the display device can display a cursor corresponding to the user's finger at the corresponding position on the left edge of the entire display area.

[0178] Optionally, the right-hand detectable area 81 includes the touch area within the reach of the user's right thumb and the space above it when the user holds the touch device with their right hand. For example, the longer side of the touch area within the reach of the right thumb is smaller than the longer side of the touch area of ​​the touch device, and / or the shorter side of the touch area within the reach of the right thumb is smaller than the shorter side of the touch area of ​​the touch device. As another example, such as... Figure 9 As shown in (a), taking the cover of the touch device and the display screen of the display device as a rectangle, with the top and bottom sides as the long sides and the left and right sides as the short sides, when the user holds the touch device with their left hand, the left thumb is located in the detection area of ​​the touch device and can be used to control the movement of the cursor displayed on the display screen. Optionally, the detection area of ​​the touch device includes a left-hand detectable area 91, which is a portion of the detection area of ​​the touch device and is used to detect the position of the user's finger. Furthermore, when the user's finger is in any position within the left-hand detectable area 91, the cursor can be displayed at any corresponding position on the display screen. For example, as shown in (a). Figure 9 As shown in (a), when the user's finger is located at the left edge 911 of the left-hand detectable area 91, the display device can display a cursor corresponding to the user's finger at the corresponding position on the left edge of the entire display area. For example, as... Figure 9 As shown in (b), when the user's finger is located at the right edge 912 of the left-hand detectable area 91, the display device can display a cursor corresponding to the user's finger at the corresponding position on the right edge of the entire display area.

[0179] Optionally, the left-hand detectable area 91 includes a touch area corresponding to the reach of the user's left thumb and the space above it, set for the user when the user holds the touch device with their left hand. For example, the long side of the touch area matching the reach of the left thumb is smaller than the long side of the complete touch area of ​​the touch device, and / or the short side of the touch area matching the reach of the left thumb is smaller than the short side of the complete touch area of ​​the touch device.

[0180] For example, such as Figure 10 As shown, the detection area of ​​the touch device includes a right-hand detectable area 81 and a left-hand detectable area 91 to meet the two-hand operation needs of users holding the touch device with both hands. Optionally, the right-hand detectable area 81 and the left-hand detectable area 91 may or may not overlap. For example, the right-hand detectable area 81 and the left-hand detectable area 91 may not overlap, forming the entire detection area, or the right-hand detectable area 81 and the left-hand detectable area 91 may partially overlap.

[0181] In this way, by configuring a right-hand detectable area and / or a left-hand detectable area, and ensuring that both areas are mapped to the entire display area of ​​the display device, the user's one-handed operation needs are met, reducing the difficulty of one-handed operation. This avoids situations where the user's fingers cannot reach certain areas, thus preventing operational disruptions.

[0182] Optionally, the size of the right-hand operable touch area or the left-hand operable touch area can be a pre-configured size in the touch device, which can be obtained after the display device establishes a communication connection with the touch device. Alternatively, if the touch device (or display device) detects that the user is using the touch device for the first time, or detects that the user indicates an update to the operable touch area size, it can prompt the user to collect the operable touch area size of the user's fingers when holding the touch device, in order to obtain an operable touch area size more suitable for the current user, or it can be automatically determined by the device based on the user's usage habits. Optionally, the area that can be used to detect single-handed operation when the user holds the touch device can be continuous throughout the user's use of the touch device; or it can be dynamically determined according to the way the user uses the touch device, such as dynamically adjusting the size of the operable detection area to a size suitable for single-handed operation when the user holds the touch device.

[0183] In some embodiments, as described above Figure 6 In the scenario shown, the display device transforms the three-dimensional coordinates corresponding to the user's finger position based on the size ratio between the display area of ​​the screen and the touch area of ​​the touch device. Therefore, when the user holds the touch device, the display device can transform the three-dimensional coordinates based on the size ratio between the display area of ​​the screen and the operable detection area of ​​the touch device.

[0184] Optionally, the user holds the touch device with one hand (e.g., left hand or right hand) or with both hands. Then, the touch device can determine the detectable area for the left hand and / or the detectable area for the right hand based on the user's holding posture.

[0185] For example, such as Figure 11 As shown in (a), the right-hand detectable area 81 is a region extending to the left from the right edge of the touch device's detection area. Figure 12 As shown in (a), the left-hand detectable area 91 is a certain range extending to the right from the left edge of the detection area of ​​the touch device.

[0186] Alternatively, the left-hand detectable area and / or the right-hand detectable area are not necessarily mapped to the entire display area of ​​the display device, but rather correspond to specific portions of the entire display area of ​​the display device.

[0187] In some examples, the display device can transform the acquired three-dimensional coordinates according to a fixed ratio between its own display area and the operable touch area of ​​the touch device.

[0188] In other examples, during touch operation, the closer the center of the finger is to the base of the finger, the more flexible and easier the operation; conversely, the farther the center of the finger is from the base, the more difficult and challenging the operation. Therefore, the display device can be set with a dynamically changing scaling factor, so that the scaling factor is smaller when the center of the finger is closer to the base and larger when the center of the finger is farther from the base, thereby increasing touch sensitivity.

[0189] Optionally, when a user holds the touch device, the base of their finger will also fall within the three-dimensional detection area of ​​the touch device. It should be understood that the three-dimensional detection area is the region above the touch device where the three-dimensional coordinates corresponding to the user's finger can be detected. For example, such as... Figure 13 As shown in (a), the three-dimensional coordinates acquired by the touch device have a coordinate distribution characteristic that extends inward from the edge of the detection area. Therefore, after acquiring the three-dimensional coordinates, the display device determines the three-dimensional coordinates with holding characteristics based on these coordinate distribution characteristics, thereby determining whether the user's hand is currently in a holding state. Furthermore, it can determine whether the user's hand is in a single-handed holding state (e.g., detecting one set of three-dimensional coordinates with holding characteristics) or a two-handed holding state (e.g., detecting two sets of three-dimensional coordinates with holding characteristics).

[0190] Optionally, after determining the three-dimensional coordinates of the base of the finger when the user holds the touch device, the display device can determine the distribution of the proportional coefficient within the detectable area based on the extended area of ​​that position, so that the proportional coefficient is smaller closer to the base of the finger and larger further away from the base of the finger.

[0191] For example, such as Figure 13 As shown in (a), the detection area of ​​the touch device is rectangular. The intersection of the long and short sides at the lower right corner of the detection area is taken as the origin of the three-dimensional coordinate system, with the long side as the x-axis and the short side as the y-axis. Therefore, if the display device determines that the acquired three-dimensional coordinates include both x-coordinates with an x-value of 0 or less than a preset threshold 1 and x-coordinates with an x-value greater than a preset threshold 2, it can be determined that the user's finger root has been detected.

[0192] In some examples, such as Figure 13 As shown in (a) and (b), during the touch operation of a user holding a touch device, the touch device can detect the three-dimensional coordinates corresponding to the center area of ​​the user's finger. The display device can determine the change in distance between the center area of ​​the user's finger and the base of the finger based on the change in these three-dimensional coordinates, thereby determining the scaling factor required to transform the three-dimensional coordinates corresponding to the center area of ​​the user's finger.

[0193] For example, such as Figure 11 As shown in (a), when a user holds the touch device with both hands, and the center area of ​​the right hand's fingers is located at a certain position on the right edge of the right-hand detectable area, the touch device sends the detected three-dimensional coordinates (x1, y1, z1) to the display device. The display device, based on the received three-dimensional coordinates (x1, y1, z1), obtains the corresponding scaling factors (a1, b1) to determine the converted cursor display position coordinates (x1*a1, y1*b1), and displays the cursor at that coordinate position. Then, as... Figure 11 As shown in (b), when the center area of ​​the user's right hand finger is located at a certain position in the upper left corner of the right-hand detectable area, the touch device sends the detected three-dimensional coordinates (x2, y2, z2) to the display device. Based on the received three-dimensional coordinates (x2, y2, z2), the display device obtains the corresponding scaling factors (a2, b2) to determine the converted cursor display position coordinates (x2*a2, y2*b2), and displays the cursor at that coordinate position. Here, a2 > a1 > a, b2 > b1 > b, where a and b are the scaling factors between the display area of ​​the display device and the right-hand detectable area of ​​the touch device, or they can be the scaling factors between the display area of ​​the display device and the detection area of ​​the touch device.

[0194] For example, such as Figure 12As shown in (a), when a user holds the touch device with both hands, and the center area of ​​the left hand's fingers is located at a certain position on the left edge of the detectable area of ​​the left hand, the touch device sends the detected three-dimensional coordinates (x3, y3, z3) to the display device. The display device, based on the received three-dimensional coordinates (x3, y3, z3), obtains the corresponding scaling factor (a3, b3) to determine the converted cursor display position coordinates (x3*a3, y3*b3), and displays the cursor at that coordinate position. Then, as... Figure 12 As shown in (b), when the center area of ​​the user's left-hand finger is located at a certain position in the upper right corner of the left-hand detectable area, the touch device sends the detected three-dimensional coordinates (x4, y4, z4) to the display device. Based on the received three-dimensional coordinates (x4, y4, z4), the display device obtains the corresponding scaling factors (a4, b4) to determine the converted cursor display position coordinates (x4*a4, y4*b4), and displays the cursor at that coordinate position. Here, a4 > a3 > a, b4 > b3 > b, where a and b are the scaling factors between the display area of ​​the display device and the left-hand detectable area of ​​the touch device, or they can be the scaling factors between the display area of ​​the display device and the detection area of ​​the touch device.

[0195] In some examples, by setting different scaling factors for different positions within the detectable area, the cursor displayed on the display device can be moved different distances when the user moves the same distance within the detectable area, thus compensating for the lack of dexterity when the user operates at a distal position far from the base of the finger.

[0196] For example, such as Figure 11 As shown in (a), in response to the touch device detecting a finger position 1 located at the right edge of the right-hand detectable area, the display device displays display element 1 corresponding to finger position 1. In response to the user's finger moving inward from finger position 1 to finger position 2, the finger position 2 is acquired. In response to the touch device detecting finger position 2, the display device displays display element 2 corresponding to finger position 2. Figure 11As shown in (b), in response to the touch device detecting a finger position 3 located at the left edge of the right-hand detectable area, the display device displays display element 3 corresponding to finger position 3. In response to the user's finger moving outward from finger position 3 to finger position 4, the finger position 4 is acquired. In response to the touch device detecting the finger position 4, the display device displays display element 4 corresponding to finger position 4. The projection distance between finger positions 1 and 2 on the touch area (cover plate) of the touch electronic device is equal to the projection distance between finger positions 3 and 4 on the touch area (cover plate); the distance between display element 1 and display element 2 is less than the distance between display element 3 and display element 4. That is, relative to a finger moving closer to the base of the finger, moving the finger a greater distance farther from the base of the finger allows for a larger movement of the cursor display position, thus achieving more flexible operation.

[0197] In this way, by varying the scaling factor, a relatively responsive interactive experience is ensured whether the user's finger is near or far from the touchpad. This prevents excessive finger span during touch operation, even when the touch device is relatively large for the user, thus improving the user experience.

[0198] In some embodiments, as the user's finger moves, the touch device can acquire multiple different three-dimensional coordinates. The touch device can then send these coordinates to the display device. The display device can then use these coordinates to display a cursor, allowing the cursor to move on the screen as the user's finger moves. This satisfies the user's long-distance touch needs even in hand-eye separation scenarios.

[0199] For example, such as Figure 14 In the scenario shown, the display device has obtained the scaling factor (a, b) between the touch area of ​​the touch device and the display area of ​​the display device. Wherein, as... Figure 14 As shown in (a), after the touch device sends the detected three-dimensional coordinates (x1, y1, z1) of the user's finger to the display device, the display device can display a cursor at coordinates (x1*a, y1*b) on the screen based on these three-dimensional coordinates and a scaling factor, such as displaying the cursor slightly to the left of the screen. Then, as... Figure 14 As shown in (b), the touch device detects the movement of the user's finger, resulting in a change in three-dimensional coordinates (x2, y2, z2). The touch device sends these changed three-dimensional coordinates to the display device. Based on these coordinates and a scaling factor, the display device can display a cursor at coordinates (x2*a, y2*b) on the screen, such as displaying the cursor in the center of the screen. Then, as... Figure 14As shown in (c), the touch device detects the movement of the user's finger, and the corresponding three-dimensional coordinate change is (x3, y3, z3). After the touch device sends the changed three-dimensional coordinates to the display device, the display device can display the cursor at the coordinates (x3*a, y3*b) on the display screen according to the three-dimensional coordinates and the scaling factor, such as displaying the cursor at the right side of the display screen.

[0200] Optionally, the touch device can directly send the three-dimensional coordinates corresponding to the detected user's finger position to the display device, which then converts these coordinates to a cursor position suitable for display on the screen. Alternatively, after detecting the three-dimensional coordinates corresponding to the user's finger position, the touch device can first convert the coordinates and then send the converted coordinates to the display device. Upon receiving the converted coordinates, the display device can then directly display the cursor at the corresponding position.

[0201] It should be understood that, in cases such as Figure 14 In the finger movement scenario shown, the cursor position displayed on the display device changes continuously. The display device can follow the movement trajectory, or it can not display the complete movement trajectory, but only display the corresponding cursor at one or several set positions, or it can not display the movement trajectory at all. Figure 14 (a), (b), and (c) are merely schematic diagrams of cursor positions corresponding to a certain movement position during the user's finger movement, and do not constitute a limitation on the entire movement process. In similar finger movement scenarios in space, this will not be elaborated further below.

[0202] In this way, by detecting the changes in the three-dimensional coordinates of the user's finger in space through the touch device, the corresponding display elements (such as the cursor) are displayed on the display device in real time, thereby helping the user understand the current operation, realizing remote control of the display device without switching eyes, and improving interaction efficiency.

[0203] Furthermore, during the control process, the display device no longer needs to send display data to the touch device, thereby reducing operation latency by reducing the amount of display data sent.

[0204] In some embodiments, the three-dimensional coordinates detected by the touch device include a z-coordinate, which indicates the height of the user's finger from the cover plate of the touch device. After acquiring the three-dimensional coordinates, the display device can adjust the cursor display based on the z-coordinate, thereby indicating the user's current finger distance from the touch device and effectively reducing the difficulty of user operation.

[0205] For example, the display device uses changes in cursor color intensity to indicate the height of the user's finger from the touchscreen's cover. For instance, as shown... Figure 15As shown in (a)-(c), as the user's finger moves in the space above the touch device, the touch device sends corresponding three-dimensional coordinates to the display device. The display device displays the cursor at different positions based on the changes in the three-dimensional coordinates. Furthermore, as the user's finger decreases in height from the touch device's cover, the cursor color gradually deepens until the user's finger touches the cover, at which point the cursor displays its darkest color. It should be understood that z=0 indicates the user's finger has touched the cover. As the user's finger increases in height from the touch device's cover, the cursor color gradually weakens until the finger height exceeds the touch device's detection distance, i.e., exceeds the detection area, and the touch device can no longer detect the finger, thus stopping the cursor display.

[0206] For example, the display device uses changes in cursor size to indicate the height of the user's finger from the touchscreen's cover. For instance, such as... Figure 16 As shown in (a)-(c), as the user's finger moves in the space above the touch device, the touch device sends corresponding three-dimensional coordinates to the display device. The display device displays the cursor at different display positions based on the changes in the three-dimensional coordinates. Furthermore, as the height of the user's finger from the touch device's cover decreases, the cursor size gradually decreases until the user's finger touches the cover, at which point the smallest cursor size is displayed. It should be understood that z=0 indicates the user's finger has touched the cover. As the height of the user's finger from the touch device's cover increases, the cursor size gradually increases until the finger height exceeds the touch device's detection distance, i.e., exceeds the detection area, and the touch device can no longer detect the finger, stopping the cursor display. Optionally, the cursor size can be measured by the area of ​​the display area occupied by the cursor.

[0207] Optionally, when the display device determines that z=0 in the three-dimensional coordinates, it can display a cursor in a preset display state to prompt the user that a touch operation has been triggered.

[0208] It should be understood that display devices can also indicate changes in finger height to the user by simultaneously changing the color and size of the cursor. Alternatively, display devices can also indicate changes in finger height to the user in other ways based on three-dimensional coordinates. For example, the display device can indicate changes in finger height to the user by changing the shape of the cursor.

[0209] Furthermore, the embodiments of this application do not limit the display shape of the cursor. For example, the cursor can be displayed as an arrow, a circle, a square, or other shapes adapted to different application scenarios (such as a pen shape, a little person shape, etc.).

[0210] In this way, users can perceive the relative position of their fingers in space and the touch device based on changes in the cursor display, and adjust their finger position in a timely manner to improve interaction efficiency.

[0211] In some embodiments, as a user's finger moves in the space above the touch device, one or more display elements on the display device change. For example, the display device displays a cursor and changes the display of the cursor. Alternatively, as the cursor's position changes, other display elements at that position change accordingly, thus more clearly indicating to the user the currently available actions.

[0212] For example, such as Figure 17 As shown in (a), the touch device detects the three-dimensional coordinate 1 corresponding to the user's finger and sends this three-dimensional coordinate 1 to the display device. The display device then displays the cursor 171 based on this three-dimensional coordinate 1. Subsequently, as the user's finger moves, as... Figure 17 As shown in (b), the touch device detects the three-dimensional coordinates 2 corresponding to the user's finger and sends these coordinates 2 to the display device. Based on these coordinates 2, the display device displays cursor 171. Furthermore, the display device determines that the current display position of cursor 171 overlaps with the display area of ​​the Smart Life application icon, such as cursor 171 appearing above the Smart Life application icon. Therefore, the display device can expand the display of the Smart Life application icon, thereby indicating to the user that the current cursor position is operable.

[0213] In this way, by changing the display of multiple elements, the user's interactive experience is enhanced.

[0214] In some embodiments, z = 0 in three-dimensional coordinates indicates that the user's finger has touched the cover plate. The display device can then determine the task triggered by the user's instruction based on this touch operation and execute the corresponding response event.

[0215] For example, such as Figure 17 As shown in (b), the user determines that the current cursor position (171) is operable by the enlarged Smart Life application icon. The user can then lower their finger to trigger the operation of the Smart Life application icon. Figure 17 As shown in (c), the touch device detects the three-dimensional coordinates 3 corresponding to the user's finger and sends these coordinates 3 to the display device. Based on these coordinates 3, the display device determines that z = 0 and can display the cursor 171 corresponding to the touch state. Furthermore, the display device can determine that the user has clicked the Smart Life application icon. Therefore, the display device can launch the Smart Life application and display... Figure 17 The smart living application interface shown in (d) is shown in the middle.

[0216] In this way, as the user's finger moves in space, the display device can change the corresponding display elements to indicate the task that the current finger can instruct the display device to perform. Furthermore, in response to changes in the user's finger height, the display device triggers corresponding response events to meet the user's interaction needs.

[0217] In some examples, as mentioned above Figure 17 In the scenario shown, the touch device detects multiple consecutive 3D coordinates with a z-value of 0 and sends these coordinates to the display device. The display device can then determine, based on these consecutive 3D coordinates with a z-value of 0, that the user has instructed a long-press operation on the display element (such as an icon) corresponding to the current 3D coordinate. Optionally, the display device can also determine, based on the x-value and / or y-value of these consecutive 3D coordinates with a z-value of 0, whether to perform a drag operation on the currently selected long-pressed display element. For example, if the x-value and / or y-value change range exceeds a preset threshold, the display device can perform a drag operation on the currently selected long-pressed display element.

[0218] It should be understood that the above examples of single-click, long-press, and drag gestures are used to illustrate the gesture triggering process in a spatial touch scenario. Other gesture operations can also be applied to the touch methods provided in the embodiments of this application, and will not be illustrated one by one.

[0219] In some embodiments, when a user's finger is positioned above the touch device, the touch device can detect the user's finger and determine the three-dimensional coordinates corresponding to the center of the finger. For example, if a user moves their index finger above the touch device to manipulate the display content, the touch device can detect the index finger and send the three-dimensional coordinates corresponding to the center of the fingertip to the display device, thereby triggering the display device to change the corresponding display content.

[0220] It should be understood that the three-dimensional coordinates sent by the touch device to the display device can be the three-dimensional coordinates corresponding to the center of the user's fingertip, or the three-dimensional coordinates corresponding to other finger positions. For example, when a user operates the display content of the display device by moving the side of their finger above the touch device, after detecting the finger, the touch device can determine the three-dimensional coordinates corresponding to the position of the finger closest to the cover plate of the touch device as the three-dimensional coordinates to be sent.

[0221] In some examples, such as Figure 5 As shown, the touch device 51 is equipped with a hover detection module 514 and a touch detection module 515. The hover detection module 514 is used to detect the three-dimensional coordinates of a finger when it is in a hovering state and the distance between the finger and the cover plate of the touch device 51 is greater than a preset distance. The touch detection module 515 is used to detect the three-dimensional coordinates of a finger when the distance between the finger and the cover plate of the touch device 51 is less than or equal to a preset distance (including when the finger touches the cover plate).

[0222] In some examples, the hover detection module 514 and the touch detection module 515 can be two separate modules, or they can be a single module with both hover detection and touch detection functions.

[0223] For example, such as Figure 18As shown in (a), a touch detection module 182 is disposed below the cover plate 181 of the touch device. This touch detection module 182 detects the user's finger touch operation through methods such as capacitive touch detection, resistive touch detection, surface acoustic wave touch detection, infrared touch detection, and piezoelectric touch detection. Below the touch detection module 182, a hover detection module 183 is disposed. This hover detection module 183 detects the three-dimensional coordinates of the user's finger through methods such as a high-sensitivity capacitive array, an invisible light array, an ultrasonic array, and a camera.

[0224] It should be understood that Figure 18 The structure shown in (a) does not constitute a specific limitation on the touch device. For example, the hover detection module may also be located above the touch detection module.

[0225] Optionally, such as Figure 18 As shown in (a), the levitation detection module 183 is an invisible light emitting or receiving array. The touch device emits light through the invisible light emitting array and determines the location with the strongest light signal intensity by measuring the intensity and distribution of the light signal received by the invisible light receiving array, and determines the three-dimensional coordinates of that location, such as the center of the user's fingertip.

[0226] Optionally, such as Figure 18 As shown in (b), the levitation detection module 183 is an ultrasonic transmitting or receiving array. The touch device emits ultrasonic waves through the ultrasonic transmitting array and determines the location with the strongest ultrasonic signal intensity by analyzing the intensity and distribution of the ultrasonic signal received by the ultrasonic receiving array, and determines the three-dimensional coordinates of that location, such as the center of the user's fingertip.

[0227] Optionally, such as Figure 18 As shown in (c), the hover detection module 183 is a camera, such as an ultra-wide-angle camera or a fisheye camera. The touch device captures an image by focusing at close range through this camera and performs image recognition on the image to determine the three-dimensional coordinates corresponding to the center position of the finger. For example, the three-dimensional coordinates corresponding to the center of the user's fingertip are determined through image recognition. Optionally, when the hover detection module 183 is a camera, the cover of the touch device is, for example, a transparent cover, so that the hover detection module 183 can capture images through the cover.

[0228] In this way, touch devices can flexibly detect the three-dimensional coordinates of the finger in various ways, improve the accuracy of finger position detection, improve the responsiveness of cursor movement, and thus enhance the user experience.

[0229] Optionally, during the process of detecting the three-dimensional coordinates of a user's finger using a high-sensitivity capacitive array, invisible light array, ultrasonic array, or camera, if the touch device detects a capacitive signal, light signal, ultrasonic signal, or image that matches the characteristics of the user's finger root, it can indicate to the display device that the user's finger root has been detected.

[0230] In some embodiments, the touch device can also detect the movement of multiple fingers in the space above it, thereby meeting the user's multi-finger touch needs.

[0231] For example, such as Figure 19 As shown, the user's two fingers are positioned in the space above the touch device. The touch device can detect the corresponding 3D coordinates 1 and 2 of these two fingers respectively and send these 3D coordinates 1 and 2 to the display device. Correspondingly, the display device displays cursors 191 and 192 corresponding to the 3D coordinates of the user's two fingers, respectively, based on the received 3D coordinates 1 and 2. The display style of the multiple cursors simultaneously displayed by the display device varies according to the height of the corresponding fingers; for example, the higher the finger, the lighter the cursor color and the larger the cursor size.

[0232] In this way, when the user performs multi-finger operations, the display device can also display changes in various corresponding display elements, thereby enriching the interaction scenario.

[0233] Optionally, the aforementioned multi-finger touch scenarios include multi-finger touch scenarios in both held and unheld states. For example, when a user holds the touch device with both hands, the display device can also display two cursors corresponding to the user's left and right thumbs, respectively.

[0234] In some examples, in multi-finger touch scenarios, the scaling factor is the same for different cursor display positions. Optionally, the scaling factor may be, for example, the size ratio between the display area of ​​the display device and the touch area of ​​the touch device.

[0235] For example, such as Figure 20 As shown in (a), after the touch device detects that the three-dimensional coordinates corresponding to the user's two fingers are (x1, y1, z1) and (x2, y2, z2) respectively, it sends these three-dimensional coordinates to the display device. After receiving the three-dimensional coordinates, the display device converts them into cursor display position coordinates (x1*a, y1*b) and (x2*a, y2*b) adapted to the current display area, based on scaling factors (a, b). Furthermore, it determines the cursor display style based on the z-value in these three-dimensional coordinates. For example, as shown... Figure 20 As shown in (a), the display device displays cursor 201 and cursor 202.

[0236] Next, the touch device detects the movement of the user's two fingers, and the resulting positions correspond to the three-dimensional coordinates (x3, y3, z3) and (x4, y4, z4) respectively. These coordinates are then sent to the display device. Upon receiving the three-dimensional coordinates, the display device converts them into cursor display position coordinates (x3*a, y3*b) and (x4*a, y4*b) adapted to the current display area, using scaling factors (a, b). Based on the z-value in these coordinates, the display style of the cursor is determined. For example, ... Figure 20 As shown in (b), the display device displays the display cursor 201 and cursor 202 in the changed display position.

[0237] In other examples, in multi-finger touch scenarios, the scaling factor for different cursor display positions is different when holding the device. This scaling factor can be determined based on the detectable area of ​​the left hand or the detectable area of ​​the right hand. For specific implementation methods, please refer to the relevant content above, which will not be repeated here.

[0238] In this way, by combining touch devices and display devices, the multi-finger touch needs of users can be met, and the usage scenarios for remote control of display devices can be enriched.

[0239] Additionally, optionally, in multi-finger touch scenarios, there is no restriction on whether the multiple fingers belong to the same user. For example, user A and user B each use one finger to perform touch operations on the same touch device to instruct the display device to show the corresponding cursor movement effect.

[0240] It should be understood that other aspects of multi-finger touch scenarios can be found in the single-finger touch scenarios described above, and will not be repeated here. Furthermore, the above example using two fingers to illustrate multi-finger touch scenarios also applies to the implementation of touch operations using more fingers, as illustrated in the multi-finger touch scenarios above.

[0241] Additionally, optionally, in single-finger or multi-finger touch scenarios, when not holding the device, the display device transforms the three-dimensional coordinates using a fixed scaling factor, thereby providing the user with more realistic display feedback. For example, in a drawing scenario, as the user's finger moves in the space above the touch device, the cursor (or displayed as a pen, etc.) can move proportionally on the display screen.

[0242] In some embodiments, the touch method provided in this application can detect not only the click, long press, and drag gestures mentioned above, but also more complex gestures such as two-finger pinch in multi-finger touch scenarios, thereby meeting users' richer touch operation needs.

[0243] For example, such as Figure 21As shown in (a), the touch device detects the three-dimensional coordinates 1 and 2 corresponding to two fingers respectively, and sends these three-dimensional coordinates 1 and 2 to the display device. Based on the received three-dimensional coordinates 1 and 2, the display device determines that a user's two-finger pinch operation has been detected and can display nearby cursors 211 and 212. For example, the distance between the x, y, and z values ​​indicated by the three-dimensional coordinates 1 and 2 is less than a threshold value of 1. Then, as... Figure 21 As shown in (b), the touch device detects the three-dimensional coordinates 3 and 4 corresponding to the two fingers respectively, and sends these three-dimensional coordinates 3 and 4 to the display device. Based on the received three-dimensional coordinates 3 and 4, the display device determines that it still detects the user's two-finger pinch operation, and determines that the distance between the x, y, and z values ​​indicated by the three-dimensional coordinates 3 and 4 is less than a threshold 2, where the threshold 2 is less than the threshold 1, and can display the closer cursors 211 and 212.

[0244] Thus, in a two-finger pinch scenario, different cursor display styles can be presented based on changes in the distance between three-dimensional coordinates, thereby helping users understand the meaning of the gesture. For example, based on... Figure 21 (a) to Figure 21 As shown in (b), the cursor change indicates that the user's finger is pinching more. In this way, for example, in some games, the display device can also enrich the user's touch experience by changing the display styles of other display elements (such as a bouncy ball).

[0245] In some embodiments, the touch area of ​​the touch device may be either not visible or visible.

[0246] For example, such as Figure 22 As shown in (a), the touch device does not have a display function. Instead, it sends the three-dimensional coordinates of the detected finger to the display device, which then performs the display. This reduces the transmission of display content between the touch device and the display device, thus lowering operation latency.

[0247] For example, such as Figure 22 As shown in (b), the touch device has a display function. The touch device receives and displays the display content transmitted back from the display device. While detecting the three-dimensional coordinates of the user's finger, the touch device can also simultaneously display the content displayed on the connected display device. This satisfies the user's need to directly view the display content on the touch device.

[0248] Optionally, the user can set whether or not the touch device displays content.

[0249] In some embodiments, touch devices may provide haptic feedback to users, thereby enriching the user experience.

[0250] For example, such as Figure 18 As shown in (a), the touch device includes, from top to bottom, a cover plate 181, a touch detection module 182, and a hover detection module 183. Therefore, as... Figure 23 As shown, in order to provide tactile feedback to the user, a tactile feedback module 231 can be configured under the cover plate 181.

[0251] Optionally, the haptic feedback module 231 may be, for example, a 3D haptic array such as ultrasound or high-frequency light.

[0252] For example, the haptic feedback module 231 is an ultrasonic array. After detecting the three-dimensional coordinates corresponding to the user's finger, the touch device can control the different ultrasonic signal transmitters included in the haptic feedback module 231 to send ultrasonic signals, ensuring that the ultrasonic signals sent by all the ultrasonic signal transmitters reach the center area of ​​the finger (such as the center area of ​​the fingertip) at the same time, so that the user can obtain haptic feedback. Subsequently, when the touch device determines that the three-dimensional coordinates corresponding to the user's finger have changed, it can again control the different ultrasonic signal transmitters included in the haptic feedback module 231 to send ultrasonic signals to trigger the corresponding haptic feedback, thereby achieving the effect of tracking the center area of ​​the user's finger to generate haptic enhancement and precise convergence.

[0253] For example, after the touch device determines the three-dimensional coordinates (x1, y1, z1) corresponding to the center area of ​​the user's finger, it instructs the ultrasonic signal transmitter farthest from the three-dimensional coordinates to send ultrasonic signal S1, and the other ultrasonic signal transmitters at different distances send ultrasonic signals S2...Sn based on ultrasonic signal S1, so that all ultrasonic signals arrive at the three-dimensional coordinate (x1, y1, z1) position at the same time, and resonate at the center area of ​​the finger corresponding to the three-dimensional coordinate (x1, y1, z1), thereby realizing tracking haptic feedback.

[0254] Optionally, haptic feedback may occur when the user's finger touches or is about to touch the touch panel; or haptic feedback may occur continuously as the user's finger gradually approaches the panel, either entirely or partially. Optionally, this continuous haptic feedback may continuously increase as the user's finger gets closer to the panel.

[0255] Optionally, while the touch device provides tactile feedback to the user, the display device can also present cursors with different display styles to provide display feedback to the user, thereby achieving a synchronous sensing effect of vision and touch and improving the user experience.

[0256] In some embodiments, the display device may display a two-dimensional image or a three-dimensional image. Therefore, during touch operation, the display device may also present corresponding two-dimensional or three-dimensional display effects based on changes in the three-dimensional coordinates of the user's finger.

[0257] For example, in a two-dimensional display scenario, the display device presents a drag-and-drop effect on the currently displayed icon based on the changes in the three-dimensional coordinates corresponding to the user's finger.

[0258] For example, in a 3D display scenario, the display device can present a pinching and deformation effect on the currently displayed 3D sponge based on the changes in the 3D coordinates of the user's finger. Or, it can present the effect of the cursor's height changing in the currently displayed 3D space.

[0259] In some embodiments, the touch device is configured with multiple usage modes, and in response to user operation, the touch device can switch between different usage modes. Optionally, the usage modes may include, for example, touch mode, remote control mode, etc.

[0260] For example, such as Figure 24 As shown, when the touch device is in touch mode, it can detect the three-dimensional coordinates corresponding to the movement of the user's finger in the space above it, thereby enabling touch operation on the display content of the display device. In some examples, in response to the user's inward folding of the touch device along the folding axis in the direction shown by reference numerals 241 and 242, at the folding angle... When the angle is 0 degrees (or less than a preset angle), the touch device can switch to remote control mode. This allows users to operate the display device using the remote control buttons located on the back of the touch device's detection area, thus enriching the usage scenarios of the touch device. Optionally, the remote control buttons can be similar in form to traditional remote controls, or they can be simplified buttons, providing directional remote control functionality in conjunction with components such as a positioning module. This functionality differs from the control capabilities and modes of the display device in touch mode. In other examples, users can directly switch the touch device's usage mode through interface settings, allowing the touch device to switch between touch mode and remote control mode without changing its physical form.

[0261] In some embodiments, the display device can be connected to at least one touch device, and multiple touch devices can meet the needs of multi-user interaction. The touch interaction process between each touch device and the display device can be referred to the above description of the touch interaction process between a single touch device and the display device. Optionally, multiple touch devices can be configured with distinct roles to trigger distinct scene functions, thereby achieving richer interactive scenarios. For example, in a game scenario, different touch devices can control different character display elements on the game interface.

[0262] In some solutions, multiple embodiments of this application can be combined, and the combined solution can be implemented. Optionally, some operations in the processes of each method embodiment may be combined, and / or the order of some operations may be changed. Furthermore, the execution order between the steps of each process is merely exemplary and does not constitute a limitation on the execution order between steps; other execution orders are also possible. It is not intended to indicate that the execution order is the only possible order in which these operations can be performed. Those skilled in the art will conceive of various ways to reorder the operations described herein. In addition, it should be noted that the process details involved in one embodiment of this document are similarly applicable to other embodiments, or different embodiments may be combined.

[0263] Furthermore, some steps in the method embodiments can be equivalently replaced with other possible steps. Alternatively, some steps in the method embodiments may be optional and can be deleted in certain use cases. Or, other possible steps may be added to the method embodiments.

[0264] Furthermore, the various method embodiments can be implemented individually or in combination.

[0265] For example, the various touch scenarios described above, whether in a holding or non-holding state, can be combined. For instance, as... Figure 14 or Figure 15 As shown, in a non-held state, the display device can show cursors with different display effects based on the different heights of the fingers relative to the touch device. Similarly, when the user holds the touch device, the display device can also show cursors with different display effects or different forms of display elements based on the different heights of the fingers relative to the touch device. For example, a user can hold the touch device with one hand, and while the other hand is in a non-held state, the user can still perform touch operations. In this way, the touch device can obtain the three-dimensional coordinates in both the held and non-held states, and the display device can display the corresponding cursor. This satisfies various user needs.

[0266] Figure 25 This is a flowchart illustrating a touch control method provided in an embodiment of this application. It should be noted that this method does not rely on... Figure 25 The specific order described below is a limitation. It should be understood that in other embodiments, the order of some steps in the method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:

[0267] S2501, The first electronic device obtains the position of a first finger when the user holds the first electronic device, the position of the first finger being at the first edge of a first region of the first electronic device.

[0268] The user's finger position includes the position relative to the first electronic device resulting from the user's finger performing a hovering or touching action on the first electronic device.

[0269] S2502, The first electronic device sends the position of the first finger to the second electronic device.

[0270] S2503, The second electronic device displays a first display element corresponding to the position of the first finger, the first display element being located at the first edge of the display area of ​​the second electronic device.

[0271] Display elements include, for example, the cursor displayed on the second electronic device, a game watch, and virtual characters.

[0272] For example, such as Figure 8 As shown in (a), the display area of ​​the display device is rectangular, and the detection area of ​​the touch device is cuboid (including the rectangular detection area). The long side of the display area corresponds to the long side of the touch area, and the short side of the display area corresponds to the short side of the touch area. When a user holds the touch device with their right hand, their right thumb is located within the detection area of ​​the touch device and can be used to control the movement of the cursor displayed on the display device. Optionally, the detection area of ​​the touch device includes a right-hand detectable area 81 (such as the first area), which is a portion of the detection area of ​​the touch device and is used to detect the position of the user's finger. Furthermore, when the user's finger is at any position within the right-hand detectable area 81, the corresponding cursor can be displayed at any position on the display screen. For example, as shown... Figure 8 As shown in (a), when the user's finger is located at the right edge 811 of the right-hand detectable area 81 (such as the first edge of the first area), the display device can display a cursor corresponding to the user's finger at the corresponding position on the right edge of the display area (such as the first edge of the display area).

[0273] S2504, The first electronic device obtains the position of a second finger when the user holds the first electronic device, the position of the second finger being at the second edge of a first region of the first electronic device.

[0274] S2505, The first electronic device sends the position of the second finger to the second electronic device.

[0275] S2506, The second electronic device displays a second display element corresponding to the position of the second finger, the second display element being located at the second edge of the display area of ​​the second electronic device.

[0276] For example, such as Figure 8As shown in (b), when the user's finger is located at the left edge 812 of the right-hand detectable area 81 (such as the second edge of the first area), the display device can display a cursor corresponding to the user's finger at the corresponding position on the left edge of the display area (such as the second edge of the display area).

[0277] In this way, by configuring a first area in the first electronic device that maps operations to the entire display area of ​​the first electronic device, the user's single-handed operation range is met, reducing the difficulty of operation. This avoids situations where the user's fingers cannot reach certain areas of the first electronic device, thus preventing operational disruptions.

[0278] Furthermore, by displaying and changing the cursor, users no longer need to switch their gaze back and forth between the first and second electronic devices. They can simply keep their eyes on the second electronic device to perform touch operations. This allows users to control a second electronic device from a distance using the first device, such as in games, where timely and consistent interactive feedback is required. Thus, it satisfies both the user's need for a larger display experience and their need for long-distance operation.

[0279] In some embodiments, the first electronic device acquires the positions of the user's third finger and fourth finger, wherein the third finger is at a first height distance from the first electronic device, and the fourth finger is at a second height distance from the first electronic device. Accordingly, when the third finger is at the first height distance from the first electronic device, the second electronic device displays a third display element with a first display effect; when the fourth finger is at the second height distance from the first electronic device, the second electronic device displays a fourth display element with a second display effect, the first display effect being different from the second display effect.

[0280] Optionally, display effects may include, for example, the size, color, and shape of the display elements. It should be understood that the third and fourth display elements can be the same display element with different display effects, such as cursors with different colors.

[0281] For example, such as Figure 15 As shown in (a)-(c), as the user's finger moves in the space above the first electronic device, the first electronic device sends the corresponding three-dimensional coordinates to the second electronic device. The second electronic device displays a cursor at different display positions based on the changes in the three-dimensional coordinates. Furthermore, as the user's finger decreases in height from the cover of the first electronic device, the cursor color gradually deepens until the user's finger touches the cover, at which point the cursor displays its darkest color. As the user's finger increases in height from the cover of the first electronic device, the cursor color gradually weakens until the finger height exceeds the detection distance of the first electronic device, i.e., it exceeds the detection area, and the first electronic device can no longer detect the finger, thus stopping the cursor display.

[0282] In this way, users can perceive the relative position of their fingers in space with the first electronic device based on changes in the display effects of the displayed elements, and adjust their finger positions in a timely manner to improve interaction efficiency.

[0283] In some embodiments, in response to a user's finger moving from a first finger position to a fifth finger position, the first electronic device acquires the position of the fifth finger. In response to a user's finger moving from a second finger position to a sixth finger position, the first electronic device acquires the position of the sixth finger. A first projected distance on the first electronic device between the first and fifth finger positions is equal to a second projected distance on the first electronic device between the second and sixth finger positions. Accordingly, in response to the first electronic device detecting the fifth finger position, the second electronic device displays a fifth display element corresponding to the fifth finger position. In response to the first electronic device detecting the sixth finger position, the second electronic device displays a sixth display element corresponding to the sixth finger position. A first distance between the first and fifth display elements is less than a second distance between the second and sixth display elements.

[0284] For example, such as Figure 11 In the scenario shown, the first area of ​​the detection area of ​​the first electronic device is the right-hand detectable area. Within the right-hand detectable area, the farther away from the base of the finger, the larger the scaling factor used for transforming the three-dimensional coordinates; the closer to the base of the finger, the smaller the scaling factor used for transforming the three-dimensional coordinates. Therefore, moving the finger position by the same distance near and far from the base of the finger results in different movement distances for the corresponding display elements. For example, moving the finger position closer to the base of the finger corresponds to a smaller movement distance for the display elements, while moving the finger position farther from the base of the finger corresponds to a larger movement distance for the display elements.

[0285] In this way, by changing the scaling factor, a relatively sensitive interactive experience can be ensured whether the user's finger is near or far from the touchpad. This prevents excessive finger span during touch operation, even if the first electronic device is relatively large for the user, thus improving the user experience.

[0286] In some embodiments, the first electronic device acquires the position of the user's seventh finger. In response to the first electronic device detecting the position of the seventh finger, the second electronic device displays a seventh display element corresponding to the position of the seventh finger and changes the display effect of the eighth display element originally displayed in the display position of the seventh display element.

[0287] Optionally, the modified eighth display element can be matched to the seventh display element.

[0288] For example, such as Figure 17As shown in (a), the first electronic device detects the three-dimensional coordinate 1 corresponding to the user's finger and sends this three-dimensional coordinate 1 to the second electronic device. The second electronic device displays cursor 171 based on this three-dimensional coordinate 1. Then, as the user's finger moves, as... Figure 17 As shown in (b), the first electronic device detects the three-dimensional coordinates 2 corresponding to the user's finger and sends these coordinates 2 to the second electronic device. Based on these coordinates 2, the second electronic device displays cursor 171. Furthermore, the second electronic device determines that the current display position of cursor 171 overlaps with the display area of ​​the smart living application icon, such as cursor 171 appearing above the smart living application icon. Therefore, the second electronic device can expand the display of the smart living application icon, thereby indicating to the user that the current cursor position is an operable location for the smart living application icon.

[0289] In this way, by changing the display of multiple elements, the user's interactive experience is enhanced.

[0290] In some embodiments, the detection area of ​​the first electronic device further includes a second area, which is a portion of the detection area of ​​the first electronic device, and the second area is used to detect the position of a user's finger; the first finger position and the second finger position are the positions of the user's right-hand fingers. The first electronic device acquires the position of an eighth finger when the user holds the first electronic device, and the eighth finger position is located at the first edge of the second area of ​​the first electronic device. The first electronic device acquires the position of a ninth finger when the user holds the first electronic device, and the ninth finger position is located at the second edge of the second area of ​​the first electronic device. Wherein, the first edge of the second area and the second edge of the second area are opposite edges of the second area, and the opposite edges of the second area are perpendicular to the long side of the detection area; the eighth finger position and the ninth finger position are the positions of the user's left-hand fingers; the first edge of the first area and the first edge of the second area are opposite edges of the detection area. Accordingly, in response to the first electronic device detecting the eighth finger position, the second electronic device displays a ninth display element corresponding to the eighth finger position, and the ninth display element is located at the second edge of the display area of ​​the second electronic device. In response to the first electronic device detecting the ninth finger position, the second electronic device displays a tenth display element corresponding to the ninth finger position, and the tenth display element is located at the first edge of the display area of ​​the second electronic device.

[0291] For example, such as Figure 10As shown, a user holds a first electronic device with both hands. The detection area of ​​the first electronic device includes a right-hand detectable area 81 (as in the first area) and a left-hand detectable area 91 (as in the second area). Optionally, the right-hand detectable area 81 and the left-hand detectable area 91 may not overlap and may be combined to form the detection area of ​​the first electronic device; alternatively, the right-hand detectable area 81 and the left-hand detectable area 91 may partially overlap. When the user's right-hand finger is located at the right edge of the right-hand detectable area 81 (as in the first edge of the first area), the second electronic device displays a cursor at the right edge of the display area (as in the first edge of the display area). When the user's right-hand finger is located at the left edge of the right-hand detectable area 81 (as in the second edge of the first area), the second electronic device displays a cursor at the left edge of the display area (as in the second edge of the display area). When the user's left-hand finger is located at the left edge of the left-hand detectable area 91 (as in the first edge of the second area), the second electronic device displays a cursor at the left edge of the display area (as in the second edge of the display area). When the user's left-hand finger is located at the right edge of the left-hand detectable area 91 (such as the second edge of the second area), the second electronic device displays a cursor at the right edge of the display area (such as the first edge of the display area).

[0292] Thus, by configuring a right-hand detectable area and / or a left-hand detectable area, and ensuring that both areas are mapped to the entire display area of ​​the display device, the user's two-handed operation needs are met, reducing the difficulty of single-handed operation. This avoids situations where the user's fingers cannot reach certain areas, thus preventing operational disruptions.

[0293] In some embodiments, a first electronic device acquires the position of a user's tenth finger. The first electronic device sends multiple first signals to the tenth finger position via a signal transmitting array, the multiple first signals arriving at the tenth finger position at the same or similar times.

[0294] Optionally, the first signal is ultrasound, high-frequency light, etc.

[0295] In this way, the first electronic device can provide tactile feedback to the user, thereby enriching the user experience.

[0296] In some examples, the first electronic device acquires the position of the user's eleventh finger. The tenth finger is at a third height from the first electronic device, and the eleventh finger is at a fourth height from the first electronic device. The first electronic device sends multiple second signals to the eleventh finger position via a signal transmitting array. These multiple second signals arrive at the eleventh finger position at the same or similar times, and the signal strengths of the multiple first signals differ from the signal strengths of the multiple second signals.

[0297] In this way, through the continuous tactile feedback that increases as the user's finger gets closer and closer to the cover, the user is prompted about the change in distance at the same time as the tactile feedback.

[0298] In some embodiments, the first electronic device acquires the position of a user's twelfth finger, which is at a fifth height from the first electronic device. In response to the first electronic device detecting the twelfth finger position, the second electronic device displays an eleventh display element corresponding to the twelfth finger position, the eleventh display element being displayed above the twelfth display element displayed by the second electronic device. When the fifth height is 0, a response event corresponding to the twelfth display element is triggered.

[0299] For example, such as Figure 17 As shown in (b), the user determines that the current cursor position (171) is operable by the enlarged Smart Life application icon. The user can then lower their finger to trigger the operation of the Smart Life application icon. Figure 17 As shown in (c), the first electronic device detects the three-dimensional coordinates 3 corresponding to the user's finger and sends these coordinates 3 to the second electronic device. Based on these coordinates 3, the second electronic device determines that z = 0, and can display the cursor 171 corresponding to the touch state. Furthermore, the second electronic device can determine that the user has clicked the Smart Life application icon. Therefore, the second electronic device can launch the Smart Life application and display... Figure 17 The smart living application interface shown in (d) is shown in the middle.

[0300] Thus, as the user's finger moves in space, the second electronic device can change the corresponding display elements to indicate the task that the user's finger can instruct the second electronic device to perform. Furthermore, in response to changes in the user's finger height, the second electronic device triggers corresponding response events to meet the user's interaction needs.

[0301] Optionally, the first electronic device may also perform the steps and functions performed by the touch device in the above embodiments, and the second electronic device may also perform the steps and functions performed by the display device in the above embodiments, thereby realizing the touch method provided in the above embodiments.

[0302] The above combination Figures 5-20 The touch method provided in the embodiments of this application is described in detail below. Figure 26 Detailed description of the first electronic device provided in the embodiments of this application, and in conjunction with Figure 27 The second electronic device provided in the embodiments of this application is described in detail.

[0303] In one possible design, Figure 26 This is a schematic diagram of the structure of the first electronic device provided in an embodiment of this application. Figure 26As shown, the first electronic device 2600 may include a transceiver unit 2601 and a processing unit 2602. The first electronic device 2600 can be used to implement the functions of the first electronic device (such as a touch device) involved in the above method embodiments.

[0304] Optionally, the transceiver unit 2601 is used to support the first electronic device 2600 in performing... Figure 25 S2502 and S2505 in the example.

[0305] Optionally, the processing unit 2602 is used to support the first electronic device 2600 in performing operations. Figure 25 S2501 and S2504 in the example.

[0306] The transceiver unit may include a receiving unit and a transmitting unit, and may be implemented by a transceiver or transceiver-related circuit components, and may be a transceiver or transceiver module. The operation and / or function of each unit in the first electronic device 2600 are respectively to implement the corresponding process of the touch method described in the above method embodiments. All relevant content of each step involved in the above method embodiments can be referred to the functional description of the corresponding functional unit, and will not be repeated here for the sake of brevity.

[0307] Optionally, Figure 26 The first electronic device 2600 shown may also include a storage unit ( Figure 26 (not shown in the image), this storage unit stores a program or instruction. When the transceiver unit 2601 and the processing unit 2602 execute the program or instruction, it causes... Figure 26 The first electronic device 2600 shown can perform the touch method described in the above method embodiments.

[0308] Figure 26 The technical effects of the first electronic device 2600 shown can be referred to the technical effects of the touch method described in the above method embodiments, and will not be repeated here.

[0309] In addition to being in the form of the first electronic device 2600, the technical solution provided in this application may also be a functional unit or chip in the first electronic device, or a device used in conjunction with the first electronic device.

[0310] In one possible design, Figure 27 This is a schematic diagram of the structure of the second electronic device provided in an embodiment of this application. Figure 27 As shown, the second electronic device 2700 may include a transceiver unit 2701, a processing unit 2702, and a display unit 2703. The second electronic device 2700 can be used to implement the functions of the second electronic device (such as a display device) involved in the above method embodiments.

[0311] Optionally, the transceiver unit 2701 is used to support the second electronic device 2700 in performing [operations]. Figure 25 S2502 and S2505 in the example.

[0312] Optionally, the processing unit 2702 is used to support the execution of the second electronic device 2700. Figure 25 S2503 and S2506 in the example.

[0313] Optionally, the display unit 2703 is used to support the execution of the second electronic device 2700. Figure 25 S2503 and S2506 in the example.

[0314] The transceiver unit may include a receiving unit and a transmitting unit, and may be implemented by a transceiver or transceiver-related circuit components, and may be a transceiver or transceiver module. The operation and / or function of each unit in the second electronic device 2700 are respectively to implement the corresponding process of the touch method described in the above method embodiments. All relevant content of each step involved in the above method embodiments can be referred to the functional description of the corresponding functional unit, and will not be repeated here for the sake of brevity.

[0315] Optionally, Figure 27 The second electronic device 2700 shown may also include a storage unit ( Figure 27 (not shown in the image), this storage unit stores a program or instruction. When the transceiver unit 2701, processing unit 2702, and display unit 2703 execute the program or instruction, it causes... Figure 27 The second electronic device 2700 shown can perform the touch method described in the above method embodiments.

[0316] Figure 27 The technical effects of the second electronic device 2700 shown can be referred to the technical effects of the touch method described in the above method embodiments, and will not be repeated here.

[0317] In addition to being in the form of a second electronic device 2700, the technical solution provided in this application may also be a functional unit or chip in a second electronic device, or a device used in conjunction with a second electronic device.

[0318] This application also provides a chip system, including: a processor coupled to a memory, the memory being used to store programs or instructions, wherein when the program or instructions are executed by the processor, the chip system implements the methods in any of the above method embodiments.

[0319] Optionally, the chip system may include one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0320] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.

[0321] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0322] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules in the processor.

[0323] This application also provides a computer-readable storage medium storing a computer program. When the computer program is run on a computer, it causes the computer to perform the aforementioned steps to implement the touch method in the above embodiments.

[0324] This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the touch method described in the above embodiments.

[0325] In addition, this application also provides an apparatus. Specifically, the apparatus may be a component or module, and may include one or more processors and a memory connected together. The memory is used to store a computer program. When the computer program is executed by one or more processors, the apparatus performs the touch methods described in the above-described method embodiments.

[0326] The apparatus, computer-readable storage medium, computer program product, or chip provided in the embodiments of this application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0327] The steps of the methods or algorithms described in conjunction with the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, portable hard disks, CD-ROMs, or any other form of storage medium well known in the art. An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can reside in an application-specific integrated circuit (ASIC).

[0328] Through the above description of the embodiments, those skilled in the art will clearly understand that, for the sake of convenience and brevity, the division of the above functional modules is only used as an example. In practical applications, the above functions can be assigned to different functional modules as needed; that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0329] In the several embodiments provided in this application, it should be understood that the disclosed methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of modules or units is only a logical functional division, and there may be other division methods in actual implementation; for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of modules or units may be electrical, mechanical or other forms.

[0330] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0331] Computer-readable storage media include, but are not limited to, any of the following: USB flash drive, portable hard drive, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and other media capable of storing program code.

[0332] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A touch control system, characterized in that, The system includes a first electronic device and a second electronic device; The first electronic device is used for: When the user holds the first electronic device with their left hand, a first area of ​​the first electronic device is determined as the area to map the operation to the display area of ​​the second electronic device. The location of the user's first finger is obtained. The location of the first finger is at the first edge of the first area of ​​the first electronic device. The first area is a part of the detection area of ​​the first electronic device. The first area is used to detect the location of the user's finger. The position of a second finger when the user holds the first electronic device is obtained, and the position of the second finger is at the second edge of the first region of the first electronic device; wherein the first edge and the second edge of the first region are opposite edges of the first region, and the opposite edges of the first region are perpendicular to the long side of the detection region; In response to the user's finger moving from the first finger position to the fifth finger position, the position of the fifth finger is obtained; In response to a user's finger moving from the second finger position to the sixth finger position, the sixth finger position is obtained; wherein, the first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position on the first electronic device; The second electronic device is used for: In response to the first electronic device detecting the position of the first finger, a first display element corresponding to the position of the first finger is displayed, the first display element being located at the first edge of the display area of ​​the second electronic device; In response to the first electronic device detecting the position of the second finger, a second display element corresponding to the position of the second finger is displayed, the second display element being located at the second edge of the display area of ​​the second electronic device; wherein the first edge and the second edge of the display area are opposite edges of the display area; In response to the first electronic device detecting the position of the fifth finger, a fifth display element corresponding to the position of the fifth finger is displayed; In response to the first electronic device detecting the position of the sixth finger, a sixth display element corresponding to the position of the sixth finger is displayed; wherein, the first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

2. The system according to claim 1, characterized in that, The first electronic device is used for: The positions of the user's third and fourth fingers are obtained, wherein the position of the third finger is at a first height from the first electronic device, and the position of the fourth finger is at a second height from the first electronic device; The second electronic device is used for: When the third finger is positioned at a first height from the first electronic device, a third display element with a first display effect is presented; When the fourth finger is at a second height from the first electronic device, a fourth display element with a second display effect is presented, and the first display effect is different from the second display effect.

3. The system according to claim 1 or 2, characterized in that, The first electronic device is used for: Get the location of the user's seventh finger; The second electronic device is used for: In response to the first electronic device detecting the position of the seventh finger, a seventh display element corresponding to the position of the seventh finger is displayed, and the display effect of the eighth display element originally displayed in the display position of the seventh display element is changed.

4. The system according to claim 3, characterized in that, The modified display effect of the eighth display element matches that of the seventh display element.

5. The system according to claim 1 or 2, characterized in that, The detection area of ​​the first electronic device further includes a second area, which is a portion of the detection area of ​​the first electronic device. The second area is used to detect the position of the user's finger. The second area is an operation mapping area determined when the user holds the first electronic device with their right hand. The first finger position and the second finger position are the positions of the user's right-hand fingers. The first electronic device is used for: The position of the eighth finger when the user holds the first electronic device is obtained, wherein the position of the eighth finger is at the first edge of the second region of the first electronic device; The position of the ninth finger when the user holds the first electronic device is obtained. The position of the ninth finger is located at the second edge of the second region of the first electronic device. The first edge and the second edge of the second region are opposite edges of the second region. The opposite edge of the second region is perpendicular to the long side of the detection region. The positions of the eighth and ninth fingers are the positions of the user's left hand fingers. The first edge of the first region and the first edge of the second region are opposite edges of the detection region. The second electronic device is used for: In response to the first electronic device detecting the position of the eighth finger, a ninth display element corresponding to the position of the eighth finger is displayed, the ninth display element being located at the second edge of the display area of ​​the second electronic device; In response to the first electronic device detecting the position of the ninth finger, a tenth display element corresponding to the position of the ninth finger is displayed, the tenth display element being located at the first edge of the display area of ​​the second electronic device.

6. The system according to claim 1 or 2, characterized in that, The first electronic device is used for: Get the position of the user's tenth finger; Multiple first signals are sent to the tenth finger position via a signal transmitting array, and the multiple first signals arrive at the tenth finger position at the same time.

7. The system according to claim 6, characterized in that, The first electronic device is used for: Obtain the position of the user's eleventh finger; wherein the position of the tenth finger is at a third height from the first electronic device, and the position of the eleventh finger is at a fourth height from the first electronic device; Multiple second signals are sent to the eleventh finger position through the signal transmitting array. The multiple second signals arrive at the eleventh finger position at the same time, and the signal strength of the multiple first signals is different from the signal strength of the multiple second signals.

8. The system according to claim 1 or 2, characterized in that, The first electronic device is used for: The position of the user's twelfth finger is obtained, and the position of the twelfth finger is at a distance of five heights from the first electronic device; The second electronic device is used for: In response to the first electronic device detecting the position of the twelfth finger, an eleventh display element corresponding to the position of the twelfth finger is displayed, and the eleventh display element is displayed on top of the twelfth display element displayed by the second electronic device; When the fifth height is 0, a response event corresponding to the twelfth display element is triggered.

9. The system according to claim 1 or 2, characterized in that, The user finger position includes the position relative to the first electronic device resulting from the user finger performing a hovering or touching action on the first electronic device.

10. A touch control method, characterized in that, Applied to a first electronic device, the method includes: When the user holds the first electronic device with their left hand, a first area of ​​the first electronic device is determined as the area to map the operation to the display area of ​​the second electronic device. The location of the user's first finger is obtained. The location of the first finger is at the first edge of the first area of ​​the first electronic device. The first area is a part of the detection area of ​​the first electronic device. The first area is used to detect the location of the user's finger. The position of a second finger when the user holds the first electronic device is obtained. The position of the second finger is at the second edge of the first region of the first electronic device. The first edge and the second edge of the first region are opposite edges of the first region. The opposite edge of the first region is perpendicular to the long side of the detection region. in, The position of the first finger corresponds to the first display element displayed by the second electronic device, and the first display element is located at the first edge of the display area of ​​the second electronic device; The position of the second finger corresponds to the second display element displayed by the second electronic device. The second display element is located at the second edge of the display area of ​​the second electronic device, and the first edge and the second edge of the display area are the opposite edges of the display area. In response to the user's finger moving from the first finger position to the fifth finger position, the position of the fifth finger is obtained; In response to a user's finger moving from the second finger position to the sixth finger position, the sixth finger position is obtained; wherein, the first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position on the first electronic device; in, The position of the fifth finger corresponds to the fifth display element displayed by the second electronic device, and the position of the sixth finger corresponds to the sixth display element displayed by the second electronic device. The first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

11. The method according to claim 10, characterized in that, The method further includes: The positions of the user's third and fourth fingers are obtained, wherein the position of the third finger is at a first height from the first electronic device, and the position of the fourth finger is at a second height from the first electronic device; in, The position of the third finger corresponds to the third display element with the first display effect presented by the second electronic device, and the position of the fourth finger corresponds to the fourth display element with the second display effect presented by the second electronic device. The first display effect is different from the second display effect.

12. The method according to claim 10 or 11, characterized in that, The method further includes: Get the location of the user's seventh finger; The position of the seventh finger corresponds to the seventh display element displayed by the second electronic device. Before and after the seventh display element is displayed at the display position corresponding to the seventh finger position, the display effect of the eighth display element originally displayed at the display position changes.

13. The method according to claim 12, characterized in that, The modified display effect of the eighth display element matches that of the seventh display element.

14. The method according to claim 10 or 11, characterized in that, The detection area of ​​the first electronic device further includes a second area, which is a portion of the detection area of ​​the first electronic device. The second area is used to detect the position of the user's finger; the first finger position and the second finger position are the positions of the user's right-hand fingers. The second region is an operation mapping region determined when the user holds the first electronic device with their right hand; the method further includes: The position of the eighth finger when the user holds the first electronic device is obtained, wherein the position of the eighth finger is at the first edge of the second region of the first electronic device; The position of the ninth finger when the user holds the first electronic device is obtained. The position of the ninth finger is located at the second edge of the second region of the first electronic device. The first edge and the second edge of the second region are opposite edges of the second region. The opposite edge of the second region is perpendicular to the long side of the detection region. The positions of the eighth and ninth fingers are the positions of the user's left hand fingers. The first edge of the first region and the first edge of the second region are opposite edges of the detection region. in, The position of the eighth finger corresponds to the ninth display element displayed by the second electronic device, and the ninth display element is located at the second edge of the display area of ​​the second electronic device; The position of the ninth finger corresponds to the tenth display element displayed by the second electronic device, which is located at the first edge of the display area of ​​the second electronic device.

15. The method according to claim 10 or 11, characterized in that, The method further includes: Get the position of the user's tenth finger; Multiple first signals are sent to the tenth finger position via a signal transmitting array, and the multiple first signals arrive at the tenth finger position at the same time.

16. The method according to claim 15, characterized in that, The method further includes: Obtain the position of the user's eleventh finger; wherein the position of the tenth finger is at a third height from the first electronic device, and the position of the eleventh finger is at a fourth height from the first electronic device; Multiple second signals are sent to the eleventh finger position through the signal transmitting array. The multiple second signals arrive at the eleventh finger position at the same time, and the signal strength of the multiple first signals is different from the signal strength of the multiple second signals.

17. The method according to claim 10 or 11, characterized in that, The method further includes: The position of the user's twelfth finger is obtained, and the position of the twelfth finger is at a distance of five heights from the first electronic device; The position of the twelfth finger corresponds to the eleventh display element displayed by the second electronic device. The eleventh display element is displayed above the twelfth display element displayed by the second electronic device. The fifth height of 0 indicates that the second electronic device is triggered to execute a response event corresponding to the twelfth display element.

18. The method according to claim 10 or 11, characterized in that, The user finger position includes the position relative to the first electronic device resulting from the user finger performing a hovering or touching action on the first electronic device.

19. An electronic device, characterized in that, include: A processor and a memory, the memory being coupled to the processor, the memory being used to store computer program code, the computer program code including computer instructions, which, when the processor reads the computer instructions from the memory, cause the electronic device to perform the method as described in any one of claims 10-18.

20. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a computer program that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 10-18.

21. A computer program product, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 10-18.

Images