Touch method, electronic device and system

Abstract

This application provides a touch control method, electronic device, and system, relating to the field of terminal technology. This application can detect the position of a user's finger within a partial area of ​​a detection region, meeting the user's need for single-handed operation. The method includes: a first electronic device acquiring the position of a first finger at a first edge of a first area within a first region of the first electronic device when the user holds the first electronic device; the first area being a partial area of ​​the detection region of the first electronic device; and acquiring the position of a second finger at a second edge of the first area within the first region when the user holds the first electronic device, wherein the first and second edges of the first area are opposite edges, and the opposite edge is perpendicular to the long side of the detection region. The first finger position corresponds to a first display element displayed by the second electronic device located at the first edge of the display area; the second finger position corresponds to a second display element displayed by the second electronic device located at the second edge of the display area, wherein the first and second edges of the display area are opposite edges.

Description

Touch control method, electronic device and system

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on December 27, 2023, with application number 202311837775.X and application name “Touch method, electronic device and system”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal technology, and in particular to a touch control method, electronic device, and system. Background Art

[0003] With the development of touch interaction technology, some remote display devices, such as TVs, car screens, and projectors, now support hand-eye separation touch interaction scenarios. For example, after launching an app on the TV, the app's display interface is projected onto the touch device, allowing the user to control the TV through touch operations on the touch device. Compared to the hand-eye synchronization scenario, the hand-eye separation scenario can meet users' needs for remote control of display devices.

[0004] However, in the above-mentioned hand-eye separation scenario, users need to frequently switch their gaze between the display device and the touch device, which makes continuous control impossible and the controllable range of interaction limited, affecting interaction efficiency.

[0005] Summary of the Invention

[0006] In order to solve the above-mentioned technical problems, the present application provides a touch method, electronic device and system. In the technical solution provided by the present application, the detection area of ​​the first electronic device includes a first area, which is a partial area in the detection area. When the user's finger position is located at each edge of the first area, the second electronic device can also display corresponding display elements at the edge of its own display area. In this way, when the user holds the first electronic device, the user's one-handed operation needs can be met by narrowing the first area of ​​the operation range, thereby improving the user's usage experience. Moreover, through the display of display elements, the user can correctly perform reverse control operations without switching his or her line of sight, thereby improving the interaction efficiency.

[0007] In order to achieve the above technical objectives, this application provides the following technical solutions:

[0008] In a first aspect, a touch control method is provided, which is applied to a first electronic device. The method includes: obtaining a first finger position when a user is holding the first electronic device, the first finger position being at a first edge of a first area of ​​the first electronic device, the first area being a portion of a detection area of ​​the first electronic device, and the first area being used to detect the user's finger position. Obtaining a second finger position when the user is holding the first electronic device, the second finger position being at a second edge of the first area of ​​the first electronic device, the first edge of the first area and the second edge of the first area being opposite edges of the first area, and the opposite edges of the first area being perpendicular to the long side of the detection area. The first finger position corresponds to a first display element displayed on the second electronic device, the first display element being located at the first edge of the display area of ​​the second electronic device. The second finger position corresponds to a second display element displayed on the second electronic device, the second display element being located at the second edge of the display area of ​​the second electronic device, and the first edge of the display area and the second edge of the display area being opposite edges of the display area.

[0009] In this way, by configuring the first electronic device to map the operation to the entire display area of ​​the second electronic device, the user's one-handed operation range requirements are met, reducing the user's operation difficulty. This avoids the user's operation being affected by the user's finger being unable to reach part of the first electronic device in some situations.

[0010] Furthermore, by displaying and changing display elements, users no longer need to switch their gaze between the first and second electronic devices. Instead, they can simply maintain their gaze on the second electronic device to perform touch operations. This allows users to control a remote second electronic device from their first electronic device in scenarios requiring timely and consistent interactive feedback, such as gaming. This allows users to enjoy a larger display experience while also meeting their needs for remote operation.

[0011] According to the first aspect, the method further includes: obtaining a third finger position and a fourth finger position of the user, wherein the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device. The third finger position corresponds to a third display element having a first display effect presented by the second electronic device, and the fourth finger position corresponds to a fourth display element having a second display effect presented by the second electronic device, wherein the first display effect is different from the second display effect.

[0012] Exemplarily, as the height of the user's finger from the cover of the first electronic device decreases, the color of the display element gradually deepens until the user's finger touches the cover. The color of the display element with the darkest color gradually weakens as the height of the user's finger from the cover of the first electronic device increases until the height of the finger exceeds the detection distance of the first electronic device, that is, exceeds the detection area range, and the first electronic device cannot detect the finger and stops displaying the display element.

[0013] In this way, the user can perceive the relative position of the finger and the first electronic device in space according to the change in the display effect of the display element, and adjust the finger position in time to improve the interaction efficiency.

[0014] According to the first aspect, or any implementation of the first aspect above, the method further includes: in response to the user's finger moving from the first finger position to the fifth finger position, obtaining the fifth finger position. In response to the user's finger moving from the second finger position to the sixth finger position, obtaining the sixth finger position; wherein the first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position on the first electronic device. wherein the fifth finger position corresponds to the fifth display element displayed by the second electronic device, the sixth finger position corresponds to the sixth display element displayed by the second electronic device, and the first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

[0015] For example, in the first region, the further away from the finger base, the larger the scaling factor used to convert the three-dimensional coordinates; the closer to the finger base, the smaller the scaling factor used to convert the three-dimensional coordinates. Thus, for finger positions that move the same distance near and far from the finger base, the corresponding display elements move different distances. For example, the display element moving distance mapped to the finger position near the finger base is smaller, while the display element moving distance mapped to the finger position far from the finger base is larger.

[0016] In this way, by changing the scale factor, a more sensitive interaction experience can be achieved whether the user's finger is near or far. In this way, even if the size of the first electronic device is large for the user, the problem of the user's finger span being too large during the touch process can be avoided, thereby improving the user's experience.

[0017] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining a seventh finger position of the user. The seventh finger position corresponds to a seventh display element displayed by the second electronic device, and before and after the seventh display element is displayed at the display position corresponding to the seventh finger position, the display effect of the eighth display element originally displayed at the display position changes.

[0018] According to the first aspect, or any implementation of the first aspect above, the changed display effect of the eighth display element matches that of the seventh display element.

[0019] In this way, the user's interactive experience is enhanced through the display changes of multiple display elements.

[0020] According to the first aspect, or any implementation of the first aspect above, the detection area of ​​the first electronic device further includes a second area, which is a portion of the detection area of ​​the first electronic device and is used to detect the position of a user's finger; the first and second finger positions are positions of fingers of the user's right hand; and the method further includes: obtaining the position of an eighth finger of the user when holding the first electronic device, the eighth finger position being at a first edge of the second area of ​​the first electronic device. Obtaining the position of a ninth finger of the user when holding the first electronic device, the ninth finger position being at a second edge of the second area of ​​the first electronic device; wherein the first edge of the second area and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area being perpendicular to a long side of the detection area; the eighth and ninth finger positions are positions of fingers of the user's left hand, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area. The eighth finger position corresponds to a ninth display element displayed on the second electronic device, the ninth display element being located at the second edge of the display area of ​​the second electronic device. The ninth finger position corresponds to a tenth display element displayed on the second electronic device, the tenth display element being located at the first edge of the display area of ​​the second electronic device.

[0021] In this way, by configuring the right-hand detectable area and / or the left-hand detectable area, and mapping both the right-hand detectable area and the left-hand detectable area to the entire display area of ​​the display device, the user's two-handed operation needs are met, and the difficulty of one-handed operation is reduced. This avoids the user's operation being affected by the user's fingers being unable to reach some areas.

[0022] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining a tenth finger position of the user, and transmitting multiple first signals to the tenth finger position via the signal transmission array, wherein the multiple first signals arrive at the tenth finger position at the same or similar time.

[0023] Optionally, the first signal is ultrasound, high-frequency light, etc.

[0024] In this way, the first electronic device can provide tactile feedback to the user, thereby enriching the user's usage experience.

[0025] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining a position of an eleventh finger of the user; wherein the tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device; and transmitting, via the signal transmitting array, a plurality of second signals to the eleventh finger position, wherein the plurality of second signals arrive at the eleventh finger position at the same or similar time, and the signal strength of the plurality of first signals is different from the signal strength of the plurality of second signals.

[0026] In this way, the user is prompted to change the distance at the same time as the tactile feedback is provided, by providing a continuous tactile feedback that is continuously enhanced as the user's finger gets closer to the cover.

[0027] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining a twelfth finger position of the user, where the twelfth finger position is at a fifth height from the first electronic device. The twelfth finger position corresponds to an eleventh display element displayed on the second electronic device, the eleventh display element is displayed above the twelfth display element displayed on the second electronic device, and the fifth height being zero indicates that the second electronic device is triggered to execute a response event corresponding to the twelfth display element.

[0028] In this way, as the user's finger moves in space, the second electronic device can change the corresponding display elements to prompt the user to instruct the second electronic device to perform the task. In addition, in response to the change in the height of the user's finger, the second electronic device triggers a corresponding response event to meet the user's interaction needs.

[0029] According to the first aspect, or any implementation of the first aspect above, the user finger position includes a position relative to the first electronic device generated by the user finger performing a hovering action or a touch action on the first electronic device.

[0030] In a second aspect, a first electronic device is provided. The first electronic device includes: a processor and a memory, the memory being coupled to the processor, the memory being configured to store computer program code, the computer program code comprising computer instructions. When the processor reads the computer instructions from the memory, the first electronic device is configured to: obtain a first finger position of a user while holding the first electronic device, the first finger position being at a first edge of a first area of ​​the first electronic device, the first area being a portion of a detection area of ​​the first electronic device, the first area being configured to detect the user's finger position; obtain a second finger position of the user while holding the first electronic device, the second finger position being at a second edge of the first area of ​​the first electronic device, the first edge of the first area and the second edge of the first area being opposite edges of the first area, the opposite edges of the first area being perpendicular to a long side of the detection area; wherein the first finger position corresponds to a first display element displayed on the second electronic device, the first display element being located at a first edge of the display area of ​​the second electronic device; and the second finger position corresponds to a second display element displayed on the second electronic device, the second display element being located at a second edge of the display area of ​​the second electronic device, the first edge of the display area and the second edge of the display area being opposite edges of the display area.

[0031] According to a second aspect, when the processor reads computer instructions from the memory, it further causes the first electronic device to execute: obtaining the position of a third finger and a fourth finger of the user, where the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device. The third finger position corresponds to a third display element having a first display effect presented by the second electronic device, and the fourth finger position corresponds to a fourth display element having a second display effect presented by the second electronic device, where the first display effect is different from the second display effect.

[0032] According to the second aspect, or any implementation of the second aspect above, when the processor reads the computer instructions from the memory, it also causes the first electronic device to execute: in response to the user's finger moving from the first finger position to the fifth finger position, obtain the fifth finger position. In response to the user's finger moving from the second finger position to the sixth finger position, obtain the sixth finger position; wherein, the first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position on the first electronic device. wherein, the fifth finger position corresponds to the fifth display element displayed by the second electronic device, the sixth finger position corresponds to the sixth display element displayed by the second electronic device, and the first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

[0033] According to the second aspect, or any implementation of the second aspect above, when the processor reads the computer instructions from the memory, it further causes the first electronic device to execute: obtaining the position of the user's seventh finger. The seventh finger position corresponds to a seventh display element displayed by the second electronic device, and before and after the seventh display element is displayed at the display position corresponding to the seventh finger position, the display effect of the eighth display element originally displayed at the display position changes.

[0034] According to the second aspect, or any implementation of the second aspect above, the changed display effect of the eighth display element matches that of the seventh display element.

[0035] According to the second aspect, or any implementation of the second aspect above, the detection area of ​​the first electronic device further includes a second area, which is a portion of the detection area of ​​the first electronic device and is used to detect the position of a user's finger; the first and second finger positions are positions of fingers on the user's right hand. When the processor reads computer instructions from the memory, it further causes the first electronic device to execute the following: obtaining the position of the user's eighth finger when holding the first electronic device, where the eighth finger is located at a first edge of the second area of ​​the first electronic device. Obtaining the position of the user's ninth finger when holding the first electronic device, where the ninth finger is located at a second edge of the second area of ​​the first electronic device; wherein the first edge of the second area and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area being perpendicular to the long side of the detection area; the eighth and ninth finger positions are positions of fingers on the user's left hand; and the first edge of the first area and the first edge of the second area are opposite edges of the detection area. The eighth finger position corresponds to a ninth display element displayed on the second electronic device, which is located at the second edge of the display area of ​​the second electronic device. The ninth finger position corresponds to a tenth display element displayed on the second electronic device, which is located at the first edge of the display area of ​​the second electronic device.

[0036] According to the second aspect, or any implementation of the second aspect, when the processor reads the computer instructions from the memory, the processor further causes the first electronic device to execute: obtaining the position of the user's tenth finger. Sending multiple first signals to the tenth finger position via the signal transmission array, the multiple first signals arriving at the tenth finger position at the same or similar time.

[0037] According to the second aspect, or any implementation of the second aspect, when the processor reads the computer instructions from the memory, the processor further causes the first electronic device to: obtain a position of an eleventh finger of the user; wherein the tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device; and transmit, via the signal transmitting array, a plurality of second signals to the eleventh finger position, wherein the plurality of second signals arrive at the eleventh finger position at the same or similar time, and the signal strength of the plurality of first signals is different from the signal strength of the plurality of second signals.

[0038] According to the second aspect, or any implementation of the second aspect above, when the processor reads the computer instructions from the memory, it further causes the first electronic device to execute: obtaining the position of the user's twelfth finger, where the twelfth finger position is at a fifth height from the first electronic device. The twelfth finger position corresponds to the eleventh display element displayed by the second electronic device, the eleventh display element is displayed above the twelfth display element displayed by the second electronic device, and the fifth height being zero indicates that the second electronic device is triggered to execute a response event corresponding to the twelfth display element.

[0039] According to the second aspect, or any implementation of the second aspect, the user finger position includes a position relative to the first electronic device generated by the user finger performing a hovering action or a touch action on the first electronic device.

[0040] According to a third aspect, a touch control system is provided. The system includes a first electronic device and a second electronic device. The first electronic device is configured to: obtain a first finger position when a user is holding the first electronic device, the first finger position being at a first edge of a first area of ​​the first electronic device, the first area being a portion of a detection area of ​​the first electronic device, and the first area being used to detect the user's finger position; obtain a second finger position when the user is holding the first electronic device, the second finger position being at a second edge of the first area of ​​the first electronic device; the first edge of the first area and the second edge of the first area being opposite edges of the first area, the opposite edges of the first area being perpendicular to the long side of the detection area; and the second electronic device is configured to: in response to the first electronic device detecting the first finger position, display a first display element corresponding to the first finger position, the first display element being located at a first edge of a display area of ​​the second electronic device. In response to the first electronic device detecting the second finger position, display a second display element corresponding to the second finger position, the second display element being located at a second edge of the display area of ​​the second electronic device; the first edge of the display area and the second edge of the display area being opposite edges of the display area.

[0041] According to a third aspect, a first electronic device is configured to obtain the positions of a third finger and a fourth finger of a user, where the third finger is at a first height from the first electronic device, and the fourth finger is at a second height from the first electronic device. A second electronic device is configured to present a third display element having a first display effect when the third finger is at the first height from the first electronic device. And present a fourth display element having a second display effect when the fourth finger is at the second height from the first electronic device, where the first display effect is different from the second display effect.

[0042] According to the third aspect, or any implementation of the first aspect above, the first electronic device is used to: in response to the user's finger moving from the first finger position to the fifth finger position, obtain the fifth finger position. In response to the user's finger moving from the second finger position to the sixth finger position, obtain the sixth finger position; wherein, the first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position on the first electronic device. The second electronic device is used to: in response to the first electronic device detecting the fifth finger position, display the fifth display element corresponding to the fifth finger position. In response to the first electronic device detecting the sixth finger position, display the sixth display element corresponding to the sixth finger position; wherein, the first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

[0043] According to the third aspect, or any implementation of the first aspect, the first electronic device is configured to obtain the position of a seventh finger of the user. The second electronic device is configured to, in response to the first electronic device detecting the position of the seventh finger, display a seventh display element corresponding to the position of the seventh finger and change the display effect of an eighth display element originally displayed at the position of the seventh display element.

[0044] According to the third aspect, or any implementation of the first aspect, the changed display effect of the eighth display element matches that of the seventh display element.

[0045] According to the third aspect, or any implementation of the first aspect above, the detection area of ​​the first electronic device further includes a second area, which is a portion of the detection area of ​​the first electronic device and is used to detect the position of a user's finger; the first and second finger positions are positions of fingers of the user's right hand. The first electronic device is configured to: obtain the position of an eighth finger of the user when holding the first electronic device, where the eighth finger is located at a first edge of the second area of ​​the first electronic device. Obtain the position of a ninth finger of the user when holding the first electronic device, where the ninth finger is located at a second edge of the second area of ​​the first electronic device; wherein the first edge of the second area and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area being perpendicular to a long side of the detection area; the eighth and ninth finger positions are positions of fingers of the user's left hand; and the first edge of the first area and the first edge of the second area are opposite edges of the detection area. The second electronic device is configured to: in response to the first electronic device detecting the eighth finger position, display a ninth display element corresponding to the eighth finger position, the ninth display element being located at the second edge of the display area of ​​the second electronic device. In response to the first electronic device detecting the ninth finger position, display a tenth display element corresponding to the ninth finger position, the tenth display element being located at the first edge of the display area of ​​the second electronic device.

[0046] According to the third aspect, or any implementation of the first aspect, the first electronic device is configured to obtain a position of a user's tenth finger by transmitting, via a signal transmitting array, multiple first signals to the tenth finger position, wherein the multiple first signals arrive at the tenth finger position at the same or similar time.

[0047] According to a third aspect, or any implementation of the first aspect, a first electronic device is configured to: obtain a position of an eleventh finger of a user; wherein the tenth finger is at a third height from the first electronic device, and the eleventh finger is at a fourth height from the first electronic device; and transmit, via a signal transmitting array, multiple second signals to the eleventh finger position, wherein the multiple second signals arrive at the eleventh finger position at the same or similar time, and wherein signal strengths of the multiple first signals are different from signal strengths of the multiple second signals.

[0048] According to the third aspect, or any implementation of the first aspect, the first electronic device is configured to: obtain the position of a user's twelfth finger, where the twelfth finger position is at a fifth height from the first electronic device. The second electronic device is configured to: in response to the first electronic device detecting the twelfth finger position, display an eleventh display element corresponding to the twelfth finger position, where the eleventh display element is displayed above the twelfth display element displayed on the second electronic device. When the fifth height is 0, trigger execution of a response event corresponding to the twelfth display element.

[0049] According to the third aspect, or any implementation of the third aspect, the user finger position includes a position relative to the first electronic device generated by the user finger performing a hovering action or a touch action on the first electronic device.

[0050] In a fourth aspect, a touch control method is provided for use with a first electronic device. The method includes detecting a first finger position corresponding to a user's finger, transmitting the first finger position to a second electronic device, and causing the second electronic device to display a first display element having a first display effect corresponding to the first finger position.

[0051] In some examples, when the user's finger is within the detection area of ​​the first electronic device, the first electronic device can detect a first finger position corresponding to the user's finger.

[0052] In this way, the first electronic device detects the position of the user's finger and displays a display element corresponding to the user's finger position on the second electronic device. This allows the user to control the touch screen by simply keeping their gaze on the second electronic device, without having to switch between the first and second electronic devices. This allows the user to control the remote second electronic device through the first electronic device in scenarios requiring timely and continuous interactive feedback, such as gaming. This allows the user to experience a greater display experience while also meeting their needs for remote operation.

[0053] According to a fourth aspect, a first signal is sent to a spatial position indicated by a first finger position through a signal transmission array.

[0054] According to the fourth aspect, or any implementation of the fourth aspect, the time at which the multiple first signals sent by the multiple signal transmitting arrays arrive at the spatial position indicated by the first finger position is the same or similar.

[0055] In this way, the first electronic device can provide tactile feedback to the user, thereby enriching the user's usage experience.

[0056] According to the fourth aspect, or any implementation of the fourth aspect above, a second finger position corresponding to a user's finger is detected, and the second finger position is sent to a second electronic device, where the second finger position is used by the second electronic device to display a second display element with a second display effect corresponding to the second finger position.

[0057] According to the fourth aspect, or any implementation method of the above fourth aspect, the first display effect of the first display element corresponds to the first height indicated by the first finger position, the second display effect of the second display element corresponds to the second height indicated by the second finger position, the first height is different from the second height, and the first display effect is different from the second display effect.

[0058] In this way, based on the different finger position heights, the second electronic device can present display elements with different display effects, helping the user understand the height of the current finger position from the first electronic device, so that the user does not have to switch his sight to the first electronic device, and can also control the display of the second electronic device.

[0059] In some examples, a user can use a first electronic device to operate a second electronic device with a single finger or multiple fingers, and the second electronic device can display a display element corresponding to a single finger, or one or more display elements corresponding to multiple fingers, thereby meeting the user's various usage needs.

[0060] In some examples, the multiple fingers can be different fingers of the same user, or can also be fingers of different users. In some examples, the user can be holding or not holding the first electronic device. When the user holds the first electronic device with one hand, the first display element displayed corresponds to the thumb of the user's holding hand, and the second display element that can be displayed simultaneously with the first display element corresponds to the user's other finger not holding the hand. Alternatively, when the user holds the first electronic device with both hands, the first display element and the second display element that can be displayed simultaneously correspond to the user's left thumb and right thumb, respectively.

[0061] According to the fourth aspect, or any implementation of the fourth aspect, the first display effect of the first display element matches the second display effect of the second display element.

[0062] For example, when a user performs a two-finger pinch operation in the detection space of the first electronic device, the second electronic device can display a first display element and a second display element corresponding to the two fingers, respectively, and the first display effect and the second display effect match to present different degrees of pinching.

[0063] In this way, by matching the display effects of display elements, a better operating experience is brought to the user.

[0064] According to the fourth aspect, or any implementation of the fourth aspect above, when the user is holding the first electronic device, the detection area of ​​the first electronic device includes a right-hand detectable area and / or a left-hand detectable area. Optionally, the right-hand detectable area and the left-hand detectable area may not overlap and are combined to form the detection area of ​​the first electronic device, or the right-hand detectable area and the left-hand detectable area may partially overlap. When the user's right finger is located at the right edge of the right-hand detectable area, the second electronic device displays a cursor at the right edge of the display area. When the user's right finger is located at the left edge of the right-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left finger is located at the left edge of the left-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left finger is located at the right edge of the left-hand detectable area, the second electronic device displays a cursor at the right edge of the display area.

[0065] In this way, by configuring the right-hand detectable area and / or the left-hand detectable area, and mapping both the right-hand detectable area and the left-hand detectable area to the entire display area of ​​the display device, the user's two-handed operation needs are met, and the difficulty of one-handed operation is reduced. This avoids the user's operation being affected by the user's fingers being unable to reach some areas.

[0066] According to the fourth aspect, or any implementation method of the above fourth aspect, when the user holds the first electronic device, in the right-hand detectable area and the left-hand detectable area, the user's finger moves a first projection distance close to the root position of the finger, and the user's finger moves a second projection distance away from the root position of the finger. When the first projection distance is equal to the second projection distance, the movement distance of the display element displayed on the display area of ​​the second electronic device corresponding to the first projection distance is smaller than the movement distance corresponding to the second projection distance.

[0067] This ensures that the user can obtain a relatively sensitive interactive experience whether the user's finger is at the near end or the far end. In this way, even if the size of the first electronic device is large for the user, the problem of the user's finger span being too large during the touch process can be avoided, thereby improving the user's usage experience.

[0068] In a fifth aspect, a touch control method is provided, applied to a second electronic device. The method includes: receiving a first finger position sent by a first electronic device; and presenting a first display element, wherein a first display effect of the first display element on the second electronic device indicates the first finger position.

[0069] In some examples, the second electronic device receives the second finger position sent by the first electronic device and presents a second display element, wherein a second display effect of the second display element on the second electronic device is used to indicate the second finger position.

[0070] In some examples, the first display effect of the first display element corresponds to the first height indicated by the first finger position, the second display effect of the second display element corresponds to the second height indicated by the second finger position, the first height is different from the second height, and the first display effect is different from the second display effect.

[0071] According to a fifth aspect, presenting the second display element includes: presenting the second display element during the process of presenting the first display element, or presenting the second display element after presenting the first display element.

[0072] According to the fifth aspect, or any implementation of the fifth aspect, the first display effect of the first display element matches the second display effect of the second display element.

[0073] According to the fifth aspect, or any implementation method of the above fifth aspect, the first horizontal and vertical coordinates indicated by the first finger position are within the area of ​​the third display element displayed by the second electronic device, and the method also includes: changing the third display effect of the third display element, and the third display effect of the changed third display element matches the first display effect of the first display element.

[0074] For example, when a second electronic device displays the desktop, it receives the first finger position and determines that the position to be displayed for the first finger position is above an application icon on the desktop. The second electronic device can then display the first display element corresponding to the first finger position in the upper layer and the application icon in a magnified form in the lower layer, thereby prompting the user that the application icon can be operated at the current finger position.

[0075] In this way, by coordinating the original display element with the display element corresponding to the finger position, the user's operation difficulty is further reduced and the operation is more interesting.

[0076] According to the fifth aspect, or any implementation of the above fifth aspect, presenting a first display element includes: proportionally determining a display position of the first display element based on the ratio between a first size of the display screen of the second electronic device and a second size of the detection area of ​​the first electronic device, and displaying the first display element at the display position.

[0077] In this way, the second electronic device displays the display element corresponding to the finger position at a fixed ratio, providing the user with more realistic display feedback. For example, in a drawing scene, as the user's finger moves in the space above the first electronic device, the cursor (or a paintbrush, etc.) can move proportionally on the display screen of the second electronic device.

[0078] According to the fifth aspect, or any implementation of the fifth aspect above, when the user is holding the first electronic device, the detection area of ​​the first electronic device includes a right-hand detectable area and / or a left-hand detectable area. Optionally, the right-hand detectable area and the left-hand detectable area may not overlap and are combined to form the detection area of ​​the first electronic device, or the right-hand detectable area and the left-hand detectable area may partially overlap. When the user's right finger is located at the right edge of the right-hand detectable area, the second electronic device displays a cursor at the right edge of the display area. When the user's right finger is located at the left edge of the right-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left finger is located at the left edge of the left-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left finger is located at the right edge of the left-hand detectable area, the second electronic device displays a cursor at the right edge of the display area.

[0079] According to the fifth aspect, or any implementation method of the above fifth aspect, when the user holds the first electronic device, in the right-hand detectable area and the left-hand detectable area, the user's finger moves a first projection distance near the root position of the finger, and the user's finger moves a second projection distance away from the root position of the finger. When the first projection distance is equal to the second projection distance, the movement distance of the display element displayed on the display area of ​​the second electronic device corresponding to the first projection distance is smaller than the movement distance corresponding to the second projection distance.

[0080] According to the fifth aspect, or any implementation of the fifth aspect above, when the height indicated by the first finger position is 0, the method further includes: executing a response event corresponding to the first finger position.

[0081] In a sixth aspect, an electronic device is provided, the electronic device having the function of implementing the touch control method described in the first aspect and any possible implementation thereof. The function can be implemented through hardware or through hardware executing corresponding software implementation. The hardware or software includes one or more modules corresponding to the above-mentioned functions.

[0082] In a seventh aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program (also referred to as instructions or code), which, when executed by an electronic device, causes the electronic device to execute the method of the first aspect or any one of the embodiments of the first aspect.

[0083] In an eighth aspect, a computer program product is provided. When the computer program product is run on an electronic device, the electronic device executes the method of the first aspect or any one of the embodiments of the first aspect.

[0084] In a ninth aspect, a circuit system is provided, the circuit system including a processing circuit, the processing circuit being configured to execute the method of the first aspect or any one of the embodiments of the first aspect.

[0085] In the tenth aspect, a chip system is provided, comprising at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor. When the at least one processor executes the instructions, the at least one processor executes the method of the first aspect or any one of the embodiments of the first aspect.

[0086] The technical effects of the aforementioned aspects can be referenced with each other and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0087] FIG1 is a schematic diagram of the working principle of a mouse provided in an embodiment of the present application;

[0088] FIG2 is a schematic diagram of a remote display device control scenario provided by an embodiment of the present application;

[0089] FIG3 is a schematic diagram of a communication system for applying the touch control method provided in an embodiment of the present application;

[0090] FIG4 is a schematic diagram of the hardware structure of a first electronic device provided in an embodiment of the present application;

[0091] FIG5 is a schematic diagram of module interaction provided in an embodiment of the present application;

[0092] FIG6 is a first schematic diagram of a touch scene provided in an embodiment of the present application;

[0093] FIG7 is a second schematic diagram of a touch scene provided in an embodiment of the present application;

[0094] FIG8 is a third schematic diagram of a touch scene provided in an embodiment of the present application;

[0095] FIG9 is a fourth schematic diagram of a touch scene provided in an embodiment of the present application;

[0096] FIG10 is a fifth schematic diagram of a touch scene provided in an embodiment of the present application;

[0097] FIG11 is a sixth schematic diagram of a touch scene provided in an embodiment of the present application;

[0098] FIG12 is a seventh schematic diagram of a touch scene provided in an embodiment of the present application;

[0099] FIG13 is a schematic diagram of the gripping state detection principle provided by an embodiment of the present application;

[0100] FIG14 is a schematic diagram of an eighth touch scene provided in an embodiment of the present application;

[0101] FIG15 is a ninth schematic diagram of a touch scene according to an embodiment of the present application;

[0102] FIG16 is a tenth schematic diagram of a touch scene provided in an embodiment of the present application;

[0103] FIG17 is a schematic diagram of a touch scene eleven provided in an embodiment of the present application;

[0104] FIG18 is a schematic diagram showing the working principle of the suspension detection module provided in an embodiment of the present application;

[0105] FIG19 is a schematic diagram of a touch scene 12 provided in an embodiment of the present application;

[0106] FIG20 is a schematic diagram thirteen of a touch scene provided in an embodiment of the present application;

[0107] FIG21 is a fourteenth schematic diagram of a touch scene provided in an embodiment of the present application;

[0108] FIG22 is a schematic diagram of a fifteenth touch scene according to an embodiment of the present application;

[0109] FIG23 is a schematic diagram of the working principle of the tactile feedback module provided in an embodiment of the present application;

[0110] FIG24 is a schematic diagram of a usage mode switching scenario provided by an embodiment of the present application;

[0111] FIG25 is a schematic diagram of a touch control method according to an embodiment of the present application;

[0112] FIG26 is a schematic structural diagram of a first electronic device provided in an embodiment of the present application;

[0113] FIG27 is a schematic structural diagram of a second electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0114] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to include expressions such as "one or more", unless there is a clear indication to the contrary in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two).

[0115] References to "one embodiment" or "some embodiments" etc. described in this specification mean that the specific features, structures or characteristics described in conjunction with the embodiment are included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in another way. The term "connected" includes direct and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0116] In the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.

[0117] In some embodiments, electronic devices such as mobile phones, televisions, car screens, and projectors can implement touch interaction. Touch scenarios include hand-eye synchronization scenarios and hand-eye separation scenarios. For example, in the hand-eye synchronization scenario, the display device and the touch device are the same device. For example, a mobile phone displays an application interface and performs corresponding tasks in response to the user's touch operations on the application interface. For another example, in the hand-eye separation scenario, the display device and the touch device are different devices. Optionally, the touch device can be, for example, a keyboard and mouse, an air mouse remote control, a touch screen device, etc., to facilitate user control of a remote display device.

[0118] For example, a display device (such as a computer) is equipped with a mouse as shown in FIG1 , so that a user can operate the display content of the display device through the mouse. The mouse illuminates an external sensing plane through a light-emitting diode (LED) and captures the external sensing plane through an image sensor. The mouse then compares the relative displacement between the two frames of image through the image sensor to determine the direction and distance of mouse movement. The mouse then sends the determined displacement direction and distance to the display device, which moves the cursor to execute a corresponding response event based on the displacement direction and distance.

[0119] As can be seen, the mouse must be located on a stable sensing surface to control the display device, limiting its usability. Furthermore, when operating simultaneously, each mouse corresponds to a single operating focus (e.g., a displayed cursor) on the display device. To implement multi-touch, the display device would need to be configured with multiple mice, making it difficult for users to operate multiple mice simultaneously.

[0120] As another example, as shown in Figure 2, the display device projects the displayed application interface onto the touch device for synchronous display. The user can then perform touch operations based on the displayed content on the touch device. The touch device sends touch data generated by the detected touch operation to the display device, and the display device displays the corresponding content based on the touch data. In this way, the user can reversely control the display device through touch operations on the touch device.

[0121] It can be seen that compared to the hand-eye synchronization scenario, the hand-eye separation scenario can meet the user's needs for remote control of the display device. However, in the above-mentioned hand-eye separation scenario, when operating the displayed content, the user needs to switch their gaze from the display device to the touch device, and then switch their gaze from the touch device to the display device after the operation is completed. In this way, the user needs to frequently switch their gaze between the display device and the touch device during the entire touch process, and continuous operation cannot be achieved, which affects the interaction efficiency. In addition, multiple data transmissions of display data and touch data are required between the touch device and the display device, which increases the touch delay.

[0122] In some scenarios, the display device can obtain the actual size of the touch-sensitive device and determine a scale factor based on the size of its own display area. A touch-sensitive device equipped with a floating screen can detect the hovering information of a user's finger corresponding to the floating screen. This hovering information includes the coordinates of the finger on the floating screen and the distance from the floating screen. The touch-sensitive device can then send this hovering information to the display device, which then displays an indicator icon based on this hovering information to help the user locate the finger's operating position.

[0123] In the above-mentioned touch scenario, the user can determine the finger movement position based on the indicator icon, reducing the switching of sight lines. However, since the display device displays the indicator icon based on the ratio coefficient between the actual size of the touch device and the size of its own display screen, that is, the display of the indicator icon is displayed on the display screen of the display device after the display position is determined in proportion. In some scenarios, users are accustomed to holding the touch device to play games and other operations. At this time, due to the limited finger movement distance, it is difficult for the user to move the finger to the edge position on the opposite side of the touch device to operate, resulting in some content in the display content of the display device being difficult for the user to operate. In addition, if the display device is large in size, such as a large-screen device, the operation difficulty will be further increased for the user, affecting the user experience.

[0124] Therefore, on the one hand, an embodiment of the present application provides a method for controlling the display screen to display elements by hovering a finger, and on this basis further provides a touch method, in which the detection area of ​​the touch device is designed to include a first area, and the first area is a partial area in the detection area. Through further scheme design, when the user's finger position is at each edge of the first area, the display device can also display corresponding display elements at the edge of its own display area. In this way, when the user holds the touch device, the user's one-handed operation needs can be met by narrowing the first area of ​​the operation range, thereby improving the user experience. Furthermore, through the display of display elements, the user can correctly perform reverse control operations without switching his or her line of sight, thereby improving the efficiency of interaction.

[0125] FIG3 is a schematic diagram of a communication system to which the touch control method provided in an embodiment of the present application is applied. As shown in FIG3 , the communication system includes a first electronic device 100 and a second electronic device 200 .

[0126] Optionally, the first electronic device 100 may be, for example, a dedicated touch device, or a device with a touch function. For example, the first electronic device 100 is a touch device specifically configured for the second electronic device 200. Alternatively, the first electronic device 100 may also be a terminal device such as a mobile phone, a tablet computer, a wearable device, an AI device, etc. The operating system installed on the first electronic device 100 includes but is not limited to Or other operating systems, the first electronic device 100 may also not have an operating system installed. This application does not limit the specific type of the first electronic device 100, whether an operating system is installed, and the installed operating system.

[0127] Optionally, the second electronic device 200 may be, for example, a television, a car screen, a projector, a computer, a tablet computer, a laptop computer, a mobile phone, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a wearable device, an artificial intelligence (AI) device, or other terminal device. The operating system installed on the second electronic device 200 includes but is not limited to: This application does not limit the specific type of the second electronic device 200 or the installed operating system.

[0128] In some embodiments, a wireless communication connection is established between the first electronic device 100 and the second electronic device 200. The wireless communication technology used to establish the wireless communication connection includes, but is not limited to, at least one of the following: wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT) (for example, traditional Bluetooth or Bluetooth low energy (BLE)), near field communication (NFC), Zigbee, frequency modulation (FM), infrared (IR), ultra wide band (UWB), star flash, etc.

[0129] Optionally, the first electronic device 100 and the second electronic device 200 may also establish a communication connection through a third-party device in the local area network, such as a router, a gateway, a server, etc.

[0130] In other embodiments, a wired communication connection is established between the first electronic device 100 and the second electronic device 200. The wired communication connection is established by, for example, connecting via a universal serial bus (USB) interface.

[0131] Optionally, Figure 4 is a schematic diagram of the hardware structure of the first electronic device 100 provided in an embodiment of the present application. As shown in Figure 4, the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, a wireless communication module 150, an audio module 160, a suspension detection module 170, a touch detection module 171, a button 180, and a motor 190, etc.

[0132] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0133] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0134] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0135] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0136] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0137] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor, charger, flash, camera 193, etc. via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor via the I2C interface, allowing the processor 110 to communicate with the touch sensor via the I2C bus interface, thereby implementing the touch function of the first electronic device 100.

[0138] The USB interface 130 is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the first electronic device 100, or to transfer data between the first electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect to other terminal devices, such as AR devices.

[0139] In some embodiments, the first electronic device establishes a wired communication connection with the second electronic device 200 via the USB interface 130. Subsequently, after detecting the position of the user's finger, the first electronic device 100 sends the position of the user's finger to the second electronic device 200 via the wired communication connection.

[0140] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative description and does not constitute a structural limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may also adopt a different interface connection method from the above embodiments, or a combination of multiple interface connection methods.

[0141] The wireless communication function of the first electronic device 100 can be implemented through an antenna, a wireless communication module 150, a modem processor, a baseband processor, and the like.

[0142] Antennas are used to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antennas can be reused as diversity antennas for wireless local area networks. In other embodiments, antennas can be used in conjunction with tuning switches.

[0143] The wireless communication module 150 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., applied on the first electronic device 100. The wireless communication module 150 can be one or more devices integrating at least one communication processing module. The wireless communication module 150 receives electromagnetic waves via an antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 150 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0144] In some embodiments, the first electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0145] In some embodiments, the suspension detection module 170 and the touch detection module 171 are used to detect the finger position of the user's finger in the detection area of ​​the first electronic device 100. Optionally, the detection area is a preset space range located above the cover of the first electronic device 100. The first electronic device 100 is a movable device or an immovable device. The top of the cover of the first electronic device 100 is used to indicate the direction corresponding to the cover of the first electronic device 100. In some examples, the direction corresponding to the cover of the first electronic device 100 is not necessarily above in a physical sense (such as the direction of the sky), that is, in the embodiment of the present application, the space above the cover of the first electronic device 100 is the space above the direction relative to the detection area. For example, the user holds the first electronic device 100 and the first electronic device 100 is tilted toward the user to facilitate user operation. Then, the top of the detection area of ​​the first electronic device 100 can also be the preset space range indicated by the detection area and tilted toward the user.

[0146] In some examples, the suspension detection module 170 is used to detect the suspension data of the user's finger, and the touch detection module 171 is used to detect the touch data of the user's finger. Optionally, the suspension data and the touch data are, for example, the three-dimensional coordinates of the user's finger in the detection area. The z in the three-dimensional coordinates corresponding to the touch data is 0, that is, when the user's finger touches the cover of the first electronic device 100, the height of the finger position relative to the cover of the first electronic device 100 is 0. In some examples, the suspension detection module 170 and the touch detection module 171 can be two independent modules or combined into one module. For other contents about the suspension detection module 170 and the touch detection module 171, please refer to the relevant description below.

[0147] In some examples, the first electronic device 100 establishes a wireless communication connection with the second electronic device 200 via the wireless communication module 150. After obtaining the finger position of the user's finger, the first electronic device 100 sends the finger position to the second electronic device 200 via the wireless communication module 150, so that the second electronic device 200 can display a corresponding display element (such as a cursor) at a corresponding position on the display screen based on the finger position.

[0148] In some embodiments, the first electronic device 100 is configured with a cover plate. Optionally, the cover plate is located above the suspension detection module 170 and the touch detection module 171. In some examples, the cover plate is part of the housing of the first electronic device 100. In some examples, the cover plate can also be used to display images, videos, etc. The cover plate includes a display panel. The display panel can be manufactured using a liquid crystal display (LCD), such as an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Mini-led, Micro-led, Micro-oled, a quantum dot light emitting diode (QLED), etc.

[0149] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the first electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored in the external memory card.

[0150] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the first electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the first electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0151] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the second electronic device 200. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0152] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the suspension detection module 170, the touch detection module 171, and the wireless communication module 150. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0153] The audio module 160 is used to convert digital audio information into analog audio signals for output, and is also used to convert analog audio input into digital audio signals. The audio module 160 can also be used to encode and decode audio signals. In some embodiments, the audio module 160 can be provided in the processor 110, or some functional modules of the audio module 160 can be provided in the processor 110. The first electronic device 100 can use the audio module 160 for functions such as music playback and recording. The audio module 160 may include a speaker, a receiver, a microphone, a headphone jack, and an application processor to implement audio functions.

[0154] The buttons 180 include a control button, a power button, a volume button, etc. The buttons 180 may be mechanical buttons or touch buttons. The first electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the first electronic device 100.

[0155] In some examples, the first electronic device 100 is configured with an image acquisition module, which can be used to capture user images, which can be used to determine the user's identity, for example; it can also be used to capture user finger images, which can be used to determine the user's finger position, the way the device is held, etc.

[0156] Optionally, the second electronic device 200 has a hardware structure that is the same as, similar to, or slightly different from that shown in Figure 4. For example, in addition to the hardware shown in Figure 4, the second electronic device 200 may further include hardware such as a display screen, a camera, and a sensor module.

[0157] In some examples, a display screen can be used to display images, videos, and the like. The display screen includes a display panel. The display panel can be manufactured using LCD, such as OLED, active-matrix organic light-emitting diode (AMOLED), FLED, Mini-LED, Micro-LED, Micro-OLED, QLED, and the like.

[0158] In some examples, the second electronic device 200 establishes a wireless communication connection with the first electronic device 100 via a wireless communication module. After receiving the user's finger position sent by the first electronic device 100, the wireless communication module of the second electronic device 200 sends the finger position to the processor. Based on the user's finger position, the processor determines the display position and display effect of the display element (such as a cursor) corresponding to the finger position. Afterwards, the second electronic device 200 can display the display element corresponding to the user's finger position at the determined display position and according to the determined display effect.

[0159] In some examples, the second electronic device 200 does not include the hover detection module 170 and the touch detection module 171 as shown in FIG4 . That is, the first electronic device 100 detects the position of the user's finger through the hover detection module 170 or the touch detection module 171, and the second electronic device 200 does not need to detect the position of the user's finger, but can directly receive the user's finger position sent by the first electronic device 100.

[0160] In some examples, the display screen can be a touch screen or a non-touch screen.

[0161] The camera is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the second electronic device 200 may include 1 or N cameras, where N is a positive integer greater than 1.

[0162] The sensor module may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0163] The touch control method provided in the embodiment of the present application is described in detail below by taking the first electronic device 100 as a touch control device and the second electronic device 200 as a display device as an example.

[0164] In some embodiments, a communication connection is established between the display device and the touch-sensitive device. The communication connection is a wired connection or a wireless connection. For example, the display device and the touch-sensitive device are connected via a USB interface or via a Bluetooth communication technology.

[0165] In some examples, the display device and the touch device are complementary devices, meaning that a display device is configured with at least one dedicated touch device. Alternatively, the touch device can establish communication connections with different display devices in response to user operations, making it convenient for users to carry the touch device and operate different display devices.

[0166] For example, as shown in FIG5 , a communication connection is established between the peripheral interface 521 of the display device 52 and the peripheral interface 511 of the touch device 51 to meet the communication requirements between the display device 52 and the touch device 51. Subsequently, after acquiring user data, the processing module 512 of the touch device 51 can send the user data to the display device 52 via the peripheral interface 511. Accordingly, the display device 52 receives the user data sent by the touch device 51 via the peripheral interface 521 and processes the user data via the processing module 522 to display relevant content via the display module 523. Optionally, the user data may include, for example, the position of a user's finger detected by the touch device 51 via the hover detection module 514 or the touch detection module 515, such as the three-dimensional coordinates of the user's finger relative to the touch device 51. Based on the user's finger position, the display device 52 can display a corresponding cursor to help the user determine the current operation location. This allows the user to complete touch operations while continuously viewing the display device 52 without having to switch their gaze, thereby improving the continuity of touch operations.

[0167] It should be understood that the structure illustrated in FIG5 does not constitute a specific limitation on the touch device 51. In other embodiments of the present application, the touch device 51 may include more or fewer components than shown, or combine or split certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. For example, the touch device 51 may also include a power management module 513 for supplying power to other modules. Similarly, the structure illustrated in FIG5 does not constitute a specific limitation on the display device 52. For example, the display device 52 may also include a power management module 524 for supplying power to other modules.

[0168] In some embodiments, a touch-sensitive device may be configured to detect the position of a user's finger within a detection area of ​​the touch-sensitive device, such as the three-dimensional coordinates corresponding to the center position of the user's finger, to satisfy the user's need to control the displayed content of a display device through touch. Optionally, the user's finger position includes the position of the user's finger relative to the touch-sensitive device resulting from a hovering action or a touch action on the touch-sensitive device.

[0169] In some examples, a user controls a cursor displayed on a display device by moving their finger in the space above the touch device. When the user's finger is hovering above the touch device or touching the touch device, the touch device detects changes in the three-dimensional coordinates of the user's finger in the space above the touch device and displays a moving cursor corresponding to the three-dimensional coordinates on the display device. This allows the user to monitor changes in the current finger's motion, such as direction, position, and altitude, without having to switch their gaze to the touch device.

[0170] Optionally, the display device displays a display element corresponding to the position of the user's finger. The display element may be the cursor described above, or may be in various forms such as a game controller, the outline of the user's finger, or an avatar. The following uses a cursor as an example to illustrate the display elements displayed by the display device.

[0171] Exemplarily, as shown in FIG6 , the touch device detects a user's finger located above the cover plate (which may also be described as a touch screen, touch panel, touch area, etc.) and determines the three-dimensional coordinates (x, y, z) corresponding to the user's finger. Afterwards, the touch device sends the three-dimensional coordinates (x, y, z) to the display device. Correspondingly, the display device receives the three-dimensional coordinates (x, y, z) and displays a cursor 61 at a corresponding position on the display screen based on the three-dimensional coordinates (x, y, z). Among them, if the user's finger is located near the center of the left edge above the cover plate of the touch device, the display device may also display a cursor 61 near the center of the left edge of its display screen, thereby helping the user understand the current finger operation position and facilitating the user to continue moving the finger to control the changes in the display content of the display device.

[0172] Among them, the “up”, “down”, “left” and “right” described in the subsequent embodiments all refer to the directions shown in FIG6 , and will not be described in detail below.

[0173] In some embodiments, the detection area of ​​the touch device includes a touch area located on the cover plate, which is used to detect the user's touch operation on the cover plate of the touch device. That is, the detection area of ​​the touch device includes the space within a preset height range above the touch area and the touch area. The display device can obtain size information of the touch area of ​​the touch device (such as the entire cover plate or a portion of the cover plate), such as length, width, etc. In this way, the display device can determine the size ratio coefficient between the touch area of ​​the touch device and the display area of ​​the display screen of the display device. For example, as shown in Figure 6, the length ratio is a and the width ratio is b. Then, after obtaining the three-dimensional coordinates sent by the touch device, the display device can adapt the three-dimensional coordinates to the current display area according to the determined ratio coefficient, such as the length ratio a and the width ratio b. In this way, the display device can display a cursor that moves with the finger position according to the ratio coefficient, thereby avoiding the mismatch between the movement of the user's finger position and the displayed position of the cursor, which may cause misunderstanding to the user. Furthermore, by constructing a proportional coefficient, it is not necessary to require the touch area of ​​the touch device and the display area of ​​the display device to be the same size, thereby reducing the user's operating difficulty through small-screen operation while meeting the user's demand for large-screen display.

[0174] For example, as shown in Figure 6, when a user's finger is within the detection area of ​​a touch device, the touch device can obtain the user's finger position and send the three-dimensional coordinates corresponding to the user's finger position to the display device. Accordingly, after receiving the three-dimensional coordinates (x, y, z), the display device obtains the coordinates (x*a, y*b) based on the x and y values ​​indicated in the three-dimensional coordinates, as well as the ratios a and b, and displays a cursor 61 at the coordinates (x*a, y*b).

[0175] In some embodiments, the touch-control device is a fixed device or a handheld mobile device. In some examples, while holding the touch-control device, the user may use the hand in a gripping state to perform touch operations. Upon determining that the user's hand is in a gripping state, the touch-control device may instruct the display device to display a cursor corresponding to the user's finger position based on the gripping state. Alternatively, the user may hold the touch-control device with one hand or with both hands.

[0176] For example, as shown in FIG7 , a user holds the touch-control device 100 with both hands to operate a game application displayed on the display device 200. Optionally, the touch-control device 100 can display the game application synchronously or not. Optionally, as shown in FIG16 , the display device 200 displays cursors corresponding to the left and right thumbs of the user's two hands when the touch-control device 100 is in a two-handed holding state. In this way, the user can determine the changes in the touch control status of both hands during the game based on the movement of the cursors. Optionally, the display device 200 can display the outlines of the user's two thumbs and the cursors in the center areas of the fingers; alternatively, the display device 200 can display the cursors in the center areas of the fingers alone without displaying the outlines of the two thumbs.

[0177] In this way, by displaying and changing the cursor, users no longer need to switch their gaze back and forth between the display device and the touchscreen device. Instead, they can simply maintain their gaze on the display device to perform touch operations. This allows users to control distant display devices through a touchscreen device in scenarios that require timely and consistent interactive feedback, such as gaming. This allows users to enjoy a larger display experience while also meeting their needs for remote operation.

[0178] In some cases, when a user holds a touch device and performs touch operations, operational flexibility is limited, such as a reduced finger reach. Therefore, the touch device can divide the entire detection area of ​​the touch device and determine the operable detection area based on the reach of the user's fingers when holding the touch device. This allows the user to freely control the display device over a wider range while holding the touch device.

[0179] For example, as shown in FIG8(a), the cover of the touch device and the display screen of the display device are rectangular, with the upper and lower sides being the long sides and the left and right sides being the short sides. When the user holds the touch device with one hand using the right hand, the right thumb is located in the detection area of ​​the touch device and can be used to control the movement of the cursor displayed on the display device. Optionally, the detection area of ​​the touch device includes a right-hand detectable area 81, which is a portion of the detection area of ​​the touch device for detecting the position of the user's finger. Moreover, when the user's finger is at any position in the right-hand detectable area 81, the cursor can be displayed at any corresponding position on the display screen. For example, as shown in FIG8(a), when the user's finger is located at the right edge 811 of the right-hand detectable area 81, the display device can display a cursor corresponding to the user's finger at the corresponding position on the right edge of the entire display area. For another example, as shown in FIG8(b), when the user's finger is located at the left edge 812 of the right-hand detectable area 81, the display device can display a cursor corresponding to the user's finger at the corresponding position on the left edge of the entire display area.

[0180] Optionally, the right-hand detectable area 81 includes the touch area within the reach of the right thumb and the space above it when the user holds the touch device with his right hand. For example, the long side of the touch area within the reach of the right thumb is smaller than the long side of the touch area of ​​the touch device, and / or the short side of the touch area within the reach of the right thumb is smaller than the short side of the touch area of ​​the touch device. As another example, as shown in (a) in Figure 9, the cover of the touch device and the display screen of the display device are rectangular, with the upper and lower sides being the long sides and the left and right sides being the short sides. When the user holds the touch device with one hand using his left hand, the left thumb is located in the detection area of ​​the touch device and can be used to control the movement of the cursor displayed on the display device. Optionally, the detection area of ​​the touch device includes a left-hand detectable area 91, which is a partial area in the detection area of ​​the touch device and is used to detect the position of the user's finger. Moreover, when the user's finger is at any position in the left-hand detectable area 91, the cursor can be displayed at any corresponding position on the display screen. For example, as shown in FIG9 (a), when the user's finger is located at the left edge 911 of the left-hand detectable area 91, the display device may display a cursor corresponding to the user's finger at a corresponding position on the left edge of the entire display area. For another example, as shown in FIG9 (b), when the user's finger is located at the right edge 912 of the left-hand detectable area 91, the display device may display a cursor corresponding to the user's finger at a corresponding position on the right edge of the entire display area.

[0181] Optionally, the left-hand detectable area 91 includes a touch area within the reach of the left thumb of the user's left hand and the space above it when the user holds the touch device with his left hand. For example, the long side of the touch area within the reach of the left thumb is smaller than the long side of the complete touch area of ​​the touch device, and / or the short side of the touch area within the reach of the left thumb is smaller than the short side of the complete touch area of ​​the touch device.

[0182] As another example, as shown in FIG10 , the detection area of ​​the touch device includes a right-hand detectable area 81 and a left-hand detectable area 91 to meet the needs of two-handed operation when a user holds the touch device with both hands. Optionally, the right-hand detectable area 81 and the left-hand detectable area 91 may or may not overlap. For example, the right-hand detectable area 81 and the left-hand detectable area 91 may not overlap and constitute the entire detection area, or the right-hand detectable area 81 and the left-hand detectable area 91 may partially overlap.

[0183] In this way, by configuring the right-hand detectable area and / or the left-hand detectable area, and mapping both the right-hand detectable area and the left-hand detectable area to the entire display area of ​​the display device, the user's one-handed operation needs are met and the difficulty of one-handed operation is reduced. This avoids the user's operation being affected by the user's fingers being unable to reach some areas.

[0184] Optionally, the size of the right-hand operable touch area or the left-hand operable touch area may be a preconfigured size in the touch device, and the display device may obtain the size after establishing a communication connection with the touch device. Alternatively, when the touch device (or display device) detects that the user is using the touch device for the first time, or detects that the user instructs to update the size of the operable touch area, it may prompt the user to collect the size of the operable touch area of ​​the user's fingers when the user is holding the touch device, so as to obtain the size of the operable touch area that is more suitable for the current user, or the device may automatically determine it according to the user's usage habits. Optionally, the area that can be used to detect one-handed operation when the user is holding the touch device may continue throughout the entire process of the user using the touch device; or it may be dynamically determined according to the way the user uses the touch device, such as when it is determined that the user is holding the touch device, dynamically adjusting the size of the operable detection area to a size suitable for one-handed operation when the user is holding it.

[0185] In some embodiments, such as the scenario shown in FIG6 above, the display device converts the three-dimensional coordinates corresponding to the user's finger position based on the size ratio coefficient between the display area of ​​the display screen and the touch area of ​​the touch device. Therefore, when the user holds the touch device, the display device can convert the three-dimensional coordinates based on the size ratio coefficient between the display area of ​​the display screen and the operable detection area of ​​the touch device.

[0186] Optionally, the user holding the touch device includes holding the touch device with one hand (such as left hand holding, right hand holding) or holding the touch device with both hands. Then, the touch device can determine the left hand detectable area and / or the right hand detectable area according to the state of the user holding the touch device.

[0187] For example, as shown in FIG11(a), the right-hand detectable area 81 is the area within a certain range to the left from the right edge of the touch device's detection area. As shown in FIG12(a), the left-hand detectable area 91 is the area within a certain range to the right from the left edge of the touch device's detection area.

[0188] Optionally, the left-hand detectable area and / or the right-hand detectable area are not necessarily mapped to the entire display area of ​​the display device, but correspond to designated parts of the entire display area of ​​the display device.

[0189] In some examples, the display device may convert the acquired three-dimensional coordinates according to a fixed ratio coefficient between its own display area and the operable touch area of ​​the touch device.

[0190] In other examples, when a user holds a touch device and performs a touch operation, the closer the center of the finger is to the base of the finger, the more flexible the user's operation and the easier the operation. However, the farther the center of the finger is from the base of the finger, the more difficult the user's operation and the higher the difficulty. Therefore, the display device can set a dynamically changing scale factor, so that the closer the center of the finger is to the base of the finger, the smaller the scale factor, and the farther the center of the finger is from the base of the finger, the larger the scale factor, thereby increasing touch sensitivity.

[0191] Optionally, when the user holds the touch device, the base of the finger will also fall into the three-dimensional detection area of ​​the touch device. It should be understood that the three-dimensional detection area is the area above the touch device where the three-dimensional coordinates corresponding to the user's finger can be detected. For example, as shown in (a) in Figure 13, the three-dimensional coordinates acquired by the touch device have a coordinate distribution characteristic extending inward from the edge of the detection area. Then, after acquiring the three-dimensional coordinates, the display device determines that the three-dimensional coordinates with the holding characteristics are acquired based on the coordinate distribution characteristics of these three-dimensional coordinates, and then determines that the user's hand is currently in a holding state, and can determine whether the user's hand is in a one-handed holding state (such as detecting a set of three-dimensional coordinates with holding characteristics) or a two-handed holding state (such as detecting two sets of three-dimensional coordinates with holding characteristics).

[0192] Optionally, after determining the three-dimensional coordinates corresponding to the base of the finger when the user is holding the touch device, the display device can determine the distribution of proportional coefficients within the detectable area based on the extended area of ​​the position, so that the proportional coefficient is smaller the closer to the base of the finger, and the proportional coefficient is larger the farther away from the base of the finger.

[0193] For example, as shown in Figure 13(a), the detection area of ​​the touch device is rectangular, with the intersection of the long and short sides in the lower right corner of the detection area serving as the origin of the three-dimensional coordinate system. The long side is the x-axis, and the short side is the y-axis. If the display device determines that the acquired three-dimensional coordinates include both three-dimensional coordinates with an x ​​value of 0 or less than a preset threshold of 1 and three-dimensional coordinates with an x ​​value greater than a preset threshold of 2, it can be determined that the base of the user's finger has been detected.

[0194] In some examples, as shown in Figures 13 (a) and (b), while a user is holding a touch device and performing a touch operation, the touch device can detect the three-dimensional coordinates corresponding to the center area of ​​the user's finger. Based on the change in the three-dimensional coordinates, the display device can determine the change in the distance between the center area of ​​the user's finger and the base of the user's finger, thereby determining the scaling factor required to convert the three-dimensional coordinates corresponding to the center area of ​​the user's finger.

[0195] For example, as shown in FIG11(a), when the user holds the touch device with both hands and the center area of ​​the right finger is located at a certain position on the right edge of the right-hand detectable area, the touch device sends the detected three-dimensional coordinates (x1, y1, z1) to the display device. The display device obtains the corresponding proportional coefficient (a1, b1) based on the received three-dimensional coordinates (x1, y1, z1) to determine the converted cursor display position coordinates (x1*a1, y1*b1) and displays the cursor at the coordinate position. Thereafter, as shown in FIG11(b), when the center area of ​​the user's right finger is located at a certain position in the upper left corner of the right-hand detectable area, the touch device sends the detected three-dimensional coordinates (x2, y2, z2) to the display device. The display device obtains the corresponding proportional coefficient (a2, b2) based on the received three-dimensional coordinates (x2, y2, z2) to determine the converted cursor display position coordinates (x2*a2, y2*b2) and displays the cursor at the coordinate position. Among them, a2>a1>a, b2>b1>b, a and b are the proportional coefficients of the display area of ​​the display device and the right-hand detectable area of ​​the touch device, or can also be the proportional coefficients of the display area of ​​the display device and the detection area of ​​the touch device.

[0196] For example, as shown in FIG12(a), when the user holds the touch device with both hands and the center area of ​​the left finger is located at a certain position on the left edge of the left hand detectable area, the touch device sends the detected three-dimensional coordinates (x3, y3, z3) to the display device. The display device obtains the corresponding scaling factor (a3, b3) based on the received three-dimensional coordinates (x3, y3, z3) to determine the converted cursor display position coordinates (x3*a3, y3*b3) and displays the cursor at this coordinate position. Subsequently, as shown in FIG12(b), when the center area of ​​the user's left finger is located at a certain position in the upper right corner of the left hand detectable area, the touch device sends the detected three-dimensional coordinates (x4, y4, z4) to the display device. The display device obtains the corresponding scaling factor (a4, b4) based on the received three-dimensional coordinates (x4, y4, z4) to determine the converted cursor display position coordinates (x4*a4, y4*b4) and displays the cursor at this coordinate position. Among them, a4>a3>a, b4>b3>b, a and b are the proportional coefficients of the display area of ​​the display device and the left-hand detectable area of ​​the touch device, or can also be the proportional coefficients of the display area of ​​the display device and the detection area of ​​the touch device.

[0197] In some examples, by setting different scaling coefficients for different positions in the detectable area, the user's finger moving the same distance in the detectable area can instruct the cursor displayed on the display device to move different distances, thereby compensating for the user's inflexibility when operating at a remote position away from the base of the finger.

[0198] For example, as shown in FIG11(a), in response to the touch device detecting finger position 1 located at the right edge of the right-hand detectable area, the display device displays display element 1 corresponding to finger position 1. In response to the user's finger moving inward from finger position 1 to finger position 2, finger position 2 is acquired. In response to the touch device detecting finger position 2, the display device displays display element 2 corresponding to finger position 2. As shown in FIG11(b), in response to the touch device detecting finger position 3 located at the left edge of the right-hand detectable area, the display device displays display element 3 corresponding to finger position 3. In response to the user's finger moving outward from finger position 3 to finger position 4, finger position 4 is acquired. In response to the touch device detecting finger position 4, the display device displays display element 4 corresponding to finger position 4. The projected distance between finger position 1 and finger position 2 on the touch area (cover plate) of the touch electronic device is equal to the projected distance between finger position 3 and finger position 4 on the touch area (cover plate) of the touch electronic device; and the distance between display element 1 and display element 2 is less than the distance between display element 3 and display element 4. That is, compared with the movement of the finger at a position closer to the base of the finger, the movement of the finger at a position farther away from the base of the finger by the same distance can control the cursor display position to move a larger distance, thereby achieving more flexible operation.

[0199] By changing the scale factor, the user can achieve a more sensitive interaction experience whether their finger is near or far. This prevents the user from having to touch the device too far, even if the device is too large for the user.

[0200] In some embodiments, as the user's finger moves, the touch-sensitive device can obtain multiple different three-dimensional coordinates. The touch-sensitive device can then send these different three-dimensional coordinates to a display device. The display device can then display a cursor based on these different three-dimensional coordinates, moving the cursor's display position on the display screen as the user's finger moves. This allows users to meet their long-distance touch needs even in hand-eye separation scenarios.

[0201] For example, in the scenario shown in FIG14 , the display device has obtained the proportional coefficient (a, b) between the touch area of ​​the touch device and the display area of ​​the display device. As shown in FIG14 (a), after the touch device sends the three-dimensional coordinates (x1, y1, z1) corresponding to the detected user's finger to the display device, the display device can display the cursor at the coordinates (x1*a, y1*b) on the display screen based on the three-dimensional coordinates and the proportional coefficient, such as displaying the cursor at the left position of the display screen. Afterwards, as shown in FIG14 (b), the touch device detects that the user's finger position has moved, and the corresponding three-dimensional coordinates change to (x2, y2, z2). After the touch device sends the changed three-dimensional coordinates to the display device, the display device can display the cursor at the coordinates (x2*a, y2*b) on the display screen based on the three-dimensional coordinates and the proportional coefficient, such as displaying the cursor at the center position of the display screen. Afterwards, as shown in (c) in Figure 14, the touch device detects the movement of the user's finger position, and the corresponding three-dimensional coordinate changes to (x3, y3, z3). After the touch device sends the changed three-dimensional coordinates to the display device, the display device can display the cursor at the coordinate position (x3*a, y3*b) on the display screen based on the three-dimensional coordinates and the scale coefficient, such as displaying the cursor on the right side of the display screen.

[0202] Optionally, the touch-sensitive device may directly transmit the three-dimensional coordinates corresponding to the detected user's finger position to the display device, which then converts the three-dimensional coordinates to a cursor position suitable for display on the display area of ​​the display screen. Alternatively, after detecting the three-dimensional coordinates corresponding to the user's finger position, the touch-sensitive device may first convert the three-dimensional coordinates and then transmit the converted three-dimensional coordinates to the display device. Upon receiving the converted three-dimensional coordinates, the display device may directly display the cursor at the corresponding display position.

[0203] It should be understood that in the finger movement scenario shown in Figure 14, the cursor position displayed by the display device changes continuously. The display device may follow the displayed movement trajectory, or may not display the entire movement trajectory, but only display the corresponding cursor at one or several set positions, or may not display the movement trajectory at all. Figures (a), (b), and (c) in Figure 14 are only schematic diagrams of the cursor position corresponding to a certain movement position during the user's finger movement process, and do not constitute a limitation on the entire movement process. This will not be further described in the following similar finger movement scenarios in space.

[0204] In this way, the touch device detects the changes in the three-dimensional coordinates of the user's finger in space, and displays the corresponding display elements (such as a cursor) on the display device in real time, thereby helping the user understand the current operation, realizing long-distance control of the display device without switching vision, and improving interaction efficiency.

[0205] In addition, during the control process, the display device no longer needs to send display data to the touch device, thereby reducing the operation delay by reducing the transmission of display data.

[0206] In some embodiments, the three-dimensional coordinates detected by the touch device include a z-coordinate, which indicates the height of the user's finger from the touch device's cover. After acquiring the three-dimensional coordinates, the display device can change the cursor display based on the z-coordinate. This provides the user with an indication of the current distance between the finger and the touch device, effectively reducing user operation difficulty.

[0207] For example, the display device prompts the height of the user's finger from the cover of the touch device by changing the depth of the cursor color. For example, as shown in (a)-(c) in Figure 15, as the user's finger moves in the space above the touch device, the touch device sends the corresponding three-dimensional coordinates to the display device. The display device displays the cursor at different display positions according to the changes in the three-dimensional coordinates. Moreover, as the height of the user's finger from the cover of the touch device decreases, the cursor color gradually deepens until the user's finger touches the cover and the darkest cursor is displayed. It should be understood that when z=0, it means that the user's finger has touched the cover. As the height of the user's finger from the cover of the touch device increases, the cursor color gradually weakens until the finger height exceeds the detection distance of the touch device, that is, exceeds the detection area range, the touch device cannot detect the finger, and the cursor stops displaying.

[0208] For another example, the display device prompts the height of the user's finger from the cover of the touch device through the change of the cursor size. For example, as shown in (a)-(c) in Figure 16, as the user's finger moves in the space above the touch device, the touch device sends the corresponding three-dimensional coordinates to the display device. The display device displays the cursor at different display positions according to the change of the three-dimensional coordinates. Moreover, as the height of the user's finger from the cover of the touch device decreases, the size of the cursor is gradually reduced until the user's finger touches the cover, and the smallest cursor is displayed. It should be understood that when z=0, it means that the user's finger touches the cover. As the height of the user's finger from the cover of the touch device increases, the size of the cursor is gradually increased until the height of the finger exceeds the detection distance of the touch device, that is, exceeds the detection area range, the touch device cannot detect the finger, and the cursor stops displaying. Optionally, the size of the cursor is measured by the area of ​​the display area occupied by the cursor.

[0209] Optionally, when determining that z=0 in the three-dimensional coordinates, the display device may display a cursor in a preset display state to prompt the user that a touch operation is currently triggered.

[0210] It should be understood that the display device may also simultaneously change the color and size of the cursor to indicate changes in the user's finger height. Alternatively, the display device may also indicate changes in the user's finger height in other ways based on the three-dimensional coordinates. For example, the display device may indicate changes in the user's finger height by changing the shape of the cursor.

[0211] In addition, the embodiments of the present application do not limit the display shape of the cursor. For example, the cursor can be displayed as an arrow, a circle, a square, or other shapes suitable for different application scenarios (such as a brush shape, a little man shape, etc.).

[0212] In this way, the user can perceive the relative position of the finger and the touch device in space based on the changes in the cursor display, adjust the finger position in time, and improve the interaction efficiency.

[0213] In some embodiments, as a user's finger moves in the space above the touch-sensitive device, one or more display elements on the display device change. For example, a cursor may be displayed on the display device, and the cursor's display may change. For another example, as the cursor's display position changes, other display elements at the corresponding position may also change, thereby more clearly indicating the user's currently available actions.

[0214] For example, as shown in Figure 17(a), the touch device detects the three-dimensional coordinate 1 corresponding to the user's finger and sends the three-dimensional coordinate 1 to the display device. The display device then displays a cursor 171 based on the three-dimensional coordinate 1. Subsequently, as the user's finger moves, as shown in Figure 17(b), the touch device detects the three-dimensional coordinate 2 corresponding to the user's finger and sends the three-dimensional coordinate 2 to the display device. The display device then displays a cursor 171 based on the three-dimensional coordinate 2. Furthermore, the display device determines that the current display position of cursor 171 overlaps with the display area of ​​the smart life application icon, such as when cursor 171 is displayed on top of the smart life application icon. In this case, the display device may expand the display of the smart life application icon to prompt the user that the current cursor position allows the smart life application icon to be operated.

[0215] In this way, the user's interactive experience is enhanced through the display changes of multiple display elements.

[0216] In some embodiments, when z=0 in the three-dimensional coordinates, it indicates that the user's finger touches the cover plate. Then, the display device can determine the task triggered by the user's instruction based on the touch operation to execute the corresponding response event.

[0217] For example, as shown in Figure 17(b), the user determines that the current cursor 171 can operate the smart life application icon based on the enlargement of the smart life application icon. The user can then lower the height of the finger to trigger the operation of the smart life application icon. As shown in Figure 17(c), the touch device detects the three-dimensional coordinate 3 corresponding to the user's finger and sends the three-dimensional coordinate 3 to the display device. The display device determines that z = 0 based on the three-dimensional coordinate 3 and displays the cursor 171 corresponding to the touch state. The display device can also determine that the user instructed to click the smart life application icon. The display device can then launch the smart life application and display the smart life application interface shown in Figure 17(d).

[0218] In this way, as the user's finger moves in space, the display device can change the corresponding display elements to prompt the user to indicate the task that the finger can currently perform on the display device. In addition, in response to changes in the height of the user's finger, the display device triggers corresponding response events to meet the user's interactive needs.

[0219] In some examples, such as the scenario shown in FIG17 above, the touch device detects a plurality of consecutive three-dimensional coordinates with a z value of 0, and sends the plurality of consecutive three-dimensional coordinates with a z value of 0 to the display device. Then, the display device can determine, based on the plurality of consecutive three-dimensional coordinates with a z value of 0, that the user has indicated a long press operation on the display element (such as an icon) corresponding to the current three-dimensional coordinate. Optionally, the display device can also determine, based on the x value and / or y value of the plurality of consecutive three-dimensional coordinates with a z value of 0, whether to perform a drag operation on the currently selected long-pressed display element. For example, if the range of change of the x value and / or the y value exceeds a preset threshold, the display device can perform a drag operation on the currently selected long-pressed display element.

[0220] It should be understood that the above uses single-click, long-press, and drag gestures as examples to illustrate the gesture triggering process in the spatial touch scene. Other gesture operations can also be applied to the touch method provided in the embodiment of the present application, and no further examples will be given.

[0221] In some embodiments, when a user's finger is positioned above a touch-sensitive device, the touch-sensitive device may detect the user's finger and determine the three-dimensional coordinates corresponding to the center of the finger. For example, if a user moves their index finger above the touch-sensitive device to manipulate content displayed on a display device, the touch-sensitive device may detect the index finger and send the three-dimensional coordinates corresponding to the center of the index finger's tip to the display device, triggering the display device to change the corresponding displayed content.

[0222] It should be understood that the three-dimensional coordinates sent by the touch device to the display device can be the three-dimensional coordinates corresponding to the center of the user's fingertip, or the three-dimensional coordinates corresponding to other finger positions. For example, if a user moves the side of a finger over the touch device to manipulate the display content of the display device, the touch device, after detecting the finger, may determine the three-dimensional coordinates corresponding to the position of the finger closest to the touch device's cover as the three-dimensional coordinates to be sent.

[0223] In some examples, as shown in FIG5 , the touch device 51 is configured with a hover detection module 514 and a touch detection module 515. The hover detection module 514 is configured to detect the corresponding three-dimensional coordinates when the finger is in a hovering state and is greater than a preset distance from the cover of the touch device 51. The touch detection module 515 is configured to detect the corresponding three-dimensional coordinates when the finger is less than or equal to the preset distance from the cover of the touch device 51 (including when the finger is in contact with the cover).

[0224] In some examples, the hover detection module 514 and the touch detection module 515 may be two separate modules, or may be one module having both hover detection and touch detection functions.

[0225] For example, as shown in FIG18( a ), a touch detection module 182 is disposed below the cover 181 of the touch-sensitive device. This touch detection module 182 detects touch operations performed by a user's finger, for example, through capacitive touch detection, resistive touch detection, surface acoustic wave touch detection, infrared touch detection, piezoelectric touch detection, etc. A hovering detection module 183 is disposed below the touch detection module 182. This hovering detection module 183 detects the three-dimensional coordinates corresponding to the user's finger, for example, through a high-sensitivity capacitor array, an invisible light array, an ultrasonic array, a camera, etc.

[0226] It should be understood that the structure shown in FIG18( a ) does not constitute a specific limitation on the touch-sensitive device. For example, the hovering detection module may also be located above the touch detection module.

[0227] Optionally, as shown in FIG18( a ), the hover detection module 183 is an invisible light emitting or receiving array. The touch device transmits light through the invisible light emitting array and determines the location with the strongest light signal intensity based on the intensity and distribution of the light signal received by the invisible light receiving array. The location is then used to determine the three-dimensional coordinates of the location, such as the center of the user's fingertip.

[0228] Optionally, as shown in FIG18( b ), the hover detection module 183 is an ultrasonic transmitting or receiving array. The touch device transmits ultrasonic waves through the ultrasonic transmitting array and determines the location with the strongest ultrasonic signal intensity based on the intensity and distribution of the ultrasonic signals received by the ultrasonic receiving array. The three-dimensional coordinates of the location are determined, for example, the center of the user's fingertip.

[0229] Optionally, as shown in FIG18( c ), the suspension detection module 183 is a camera, such as an ultra-wide-angle camera, a fisheye camera, or the like. The touch device uses the camera to focus closely on and capture an image, and performs image recognition on the image to determine the three-dimensional coordinates corresponding to the center position of the finger. For example, the three-dimensional coordinates corresponding to the center of the user's fingertip are determined through image recognition. Optionally, when the suspension detection module 183 is a camera, the cover of the touch device is, for example, a transparent cover, so that the suspension detection module 183 can see through the cover to capture the image.

[0230] In this way, the touch device can flexibly detect the three-dimensional coordinates corresponding to the finger in a variety of ways, improve the accuracy of user finger position detection, improve the tracking of cursor movement, and thus improve the user experience.

[0231] Optionally, when the touch device detects the three-dimensional coordinates corresponding to the user's finger through a high-sensitivity capacitive array, invisible light array, ultrasonic array, or camera, after detecting a capacitive signal, light signal, ultrasonic signal, or image that meets the characteristics of the base of the user's finger, it can indicate to the display device that the base of the user's finger is currently detected.

[0232] In some embodiments, the touch device can also detect the movement positions of multiple fingers located in the space above it, thereby meeting the user's multi-finger touch needs.

[0233] For example, as shown in FIG19 , a user's two fingers are positioned above a touch device. The touch device can detect three-dimensional coordinates 1 and 2 corresponding to the two fingers, respectively, and send these three-dimensional coordinates 1 and 2 to the display device. Accordingly, the display device displays cursors 191 and 192 corresponding to the three-dimensional coordinates of the user's two fingers, respectively, based on the received three-dimensional coordinates 1 and 2. The display style of multiple cursors displayed simultaneously on the display device varies depending on the height of the corresponding fingers, such as a lighter cursor color and a larger cursor size as the finger height increases.

[0234] In this way, when the user performs multi-finger operations, the display device can also display corresponding changes in multiple display elements, thereby enriching the interactive scene.

[0235] Optionally, the multi-touch scenario includes a multi-touch scenario in a gripping state or a non-gripping state. For example, when the user grips the touch device with both hands, the display device may also display two cursors corresponding to the user's left and right thumbs, respectively.

[0236] In some examples, in a multi-touch scenario, the scale factors corresponding to different cursor display positions are the same. Optionally, the scale factor is, for example, the size ratio between the display area of ​​the display device and the touch area of ​​the touch device.

[0237] For example, as shown in FIG20(a), after the touch device detects that the three-dimensional coordinates corresponding to the user's two fingers are (x1, y1, z1) and (x2, y2, z2), the three-dimensional coordinates are sent to the display device. After the display device obtains the three-dimensional coordinates, it converts the three-dimensional coordinates into cursor display position coordinates (x1*a, y1*b) and (x2*a, y2*b) adapted to the display area of ​​the current display screen according to the scale coefficients (a, b), and determines the display style of the cursor according to the z value in the three-dimensional coordinates. For example, as shown in FIG20(a), the display device displays cursor 201 and cursor 202.

[0238] Afterwards, the touch device detects the movement of the user's two fingers, and the three-dimensional coordinates corresponding to the moved positions are (x3, y3, z3) and (x4, y4, z4), and then sends the three-dimensional coordinates to the display device. After the display device obtains the three-dimensional coordinates, it converts the three-dimensional coordinates into cursor display position coordinates (x3*a, y3*b) and (x4*a, y4*b) that are adapted to the display area of ​​the current display screen based on the scale coefficients (a, b), and determines the cursor display style based on the z value in the three-dimensional coordinates. For example, as shown in Figure 20 (b), the display device displays the display cursor 201 and cursor 202 at the changed display position.

[0239] In other examples, in multi-finger touch scenarios, the proportional coefficients corresponding to different cursor display positions in the holding state are different. The proportional coefficient can be determined based on the left hand detectable area or the right hand detectable area. The specific implementation method can be referred to the relevant content above and will not be repeated here.

[0240] In this way, through the cooperation of the touch device and the display device, the user's multi-touch needs can be met, and the usage scenarios of remote control of the display device can be enriched.

[0241] Furthermore, in a multi-touch scenario, it is not limited whether the multiple fingers belong to the same user. For example, user A and user B each use one finger of their own to perform a touch operation on the same touch device to instruct the display device to display a corresponding cursor movement effect.

[0242] It should be understood that for other aspects of the multi-touch scenario, please refer to the relevant content described in the single-finger touch scenario above, and will not be repeated here. In addition, the above multi-touch scenario is introduced using two fingers as an example. The implementation of the user performing touch operations with more fingers is also applicable to the multi-touch scenario in the above example.

[0243] Additionally, in single-finger or multi-finger touch scenarios, the display device can optionally convert three-dimensional coordinates using a fixed scaling factor when not gripping the device, thereby providing the user with more realistic display feedback. For example, in a drawing scenario, as the user's finger moves in the space above the touch device, the cursor (or a brush, etc.) can move proportionally on the display screen of the display device.

[0244] In some embodiments, the touch method provided in the embodiments of the present application can not only detect the single-click, long-press, and drag gesture operations in the above examples, but also detect more complex gesture operations such as two-finger pinching in multi-finger touch scenarios, thereby meeting users' richer touch operation needs.

[0245] For example, as shown in FIG21(a), the touch device detects three-dimensional coordinates 1 and 2, respectively, corresponding to two fingers, and sends these coordinates 1 and 2 to the display device. Based on the received three-dimensional coordinates 1 and 2, the display device determines that a two-finger pinch operation has been detected, and may display cursors 211 and 212 closer together. For example, the distance between the x-values, y-values, and z-values ​​indicated by these coordinates 1 and 2 is less than threshold 1. Subsequently, as shown in FIG21(b), the touch device detects three-dimensional coordinates 3 and 4, respectively, corresponding to two fingers, and sends these coordinates 3 and 4 to the display device. Based on the received three-dimensional coordinates 3 and 4, the display device determines that a two-finger pinch operation has still been detected, and that the distance between the x-values, y-values, and z-values ​​indicated by these coordinates 3 and 4 is less than threshold 2, where threshold 2 is less than threshold 1. Therefore, cursors 211 and 212 may be displayed closer together.

[0246] In this way, in a two-finger pinching scenario, different cursor display style changes can also be presented according to the change in the distance between the three-dimensional coordinates, thereby helping users understand the meaning of the gesture operation. For example, based on the cursor change from Figure 21 (a) to Figure 21 (b), the user can determine that the current finger pinching degree has increased. In this way, for example, in some game scenarios, the display device can also enrich the user's touch experience by changing the display style of other display elements (such as elastic balls, etc.).

[0247] In some embodiments, the touch area of ​​the touch device may not be displayed, or may be displayed.

[0248] For example, as shown in Figure 22(a), the touch device does not have a display function. Instead, the touch device sends the three-dimensional coordinates corresponding to the detected finger to the display device, which then displays the coordinates. This reduces the transmission process of display content between the touch device and the display device, thus reducing operation latency.

[0249] As another example, as shown in FIG22(b), the touch device has a display function. The touch device receives and displays the display content transmitted back from the display device. While detecting the three-dimensional coordinates corresponding to the user's finger, the touch device can also synchronously display the display content displayed by the connected display device. This satisfies the user's need to view the display content directly on the touch device.

[0250] Optionally, whether the touch device displays or does not display content can be set by the user.

[0251] In some embodiments, the touch device can provide tactile feedback to the user, thereby enriching the user's experience.

[0252] For example, as shown in FIG18(a), the touch-sensitive device includes, from top to bottom, a cover plate 181, a touch detection module 182, and a hover detection module 183. As shown in FIG23, a tactile feedback module 231 may be disposed below the cover plate 181 to provide tactile feedback to the user.

[0253] Optionally, the tactile feedback module 231 is a 3D tactile array such as ultrasound, high-frequency light, etc.

[0254] For example, the tactile feedback module 231 is an ultrasonic array. After detecting the three-dimensional coordinates corresponding to the user's finger, the touch device can control the different ultrasonic signal transmitters included in the tactile feedback module 231 to send ultrasonic signals, and make the ultrasonic signals sent by all ultrasonic signal transmitters reach the center area of ​​the finger (such as the center area of ​​the fingertip) at the same time, so that the user can obtain tactile feedback. Afterwards, when the touch device determines that the three-dimensional coordinates corresponding to the user's finger have changed, it can again control the different ultrasonic signal transmitters included in the tactile feedback module 231 to send ultrasonic signals to trigger the corresponding tactile feedback, thereby achieving the effect of tracking the center area of ​​the user's finger to produce tactile enhancement and precise convergence.

[0255] For example, after the touch device determines the three-dimensional coordinates (x1, y1, z1) corresponding to the center area of ​​the user's finger, it instructs the ultrasonic signal transmitter farthest from the three-dimensional coordinates to send ultrasonic signal S1, and the remaining ultrasonic signal transmitters at different distances send ultrasonic signals S2...Sn based on the ultrasonic signal S1, so that all ultrasonic signals arrive at the three-dimensional coordinates (x1, y1, z1) at the same time, and resonate at the center area of ​​the finger corresponding to the three-dimensional coordinates (x1, y1, z1), thereby realizing tracking tactile sensation.

[0256] Optionally, the tactile feedback may occur when the user's finger touches or is about to touch the touch cover; or the tactile feedback may occur continuously throughout or partially as the user's finger gradually approaches the cover. Optionally, the continuously occurring tactile feedback may increase in intensity as the user's finger approaches the cover.

[0257] Optionally, while the touch device is providing tactile feedback to the user, the display device may also present cursors of different display styles to provide display feedback to the user, thereby achieving a synchronous sensing effect of vision and touch and improving the user experience.

[0258] In some embodiments, the display device can display a two-dimensional image or a three-dimensional image. Then, during the touch operation, the display device can also present a corresponding two-dimensional or three-dimensional display effect according to the changes in the three-dimensional coordinates corresponding to the user's finger.

[0259] For example, in a two-dimensional display scenario, the display device presents a dragging and moving effect on the currently displayed icon according to the changes in the three-dimensional coordinates corresponding to the user's finger.

[0260] For example, in a 3D display scenario, the display device can create a pinching effect on the currently displayed 3D sponge based on the changes in the 3D coordinates corresponding to the user's finger. Or, it can create a change in the height of the cursor in the currently displayed 3D space.

[0261] In some embodiments, the touch-sensitive device is configured with multiple usage modes. In response to user operations, the touch-sensitive device can switch between different usage modes. Optionally, the usage modes include, for example, a touch mode, a remote control mode, and the like.

[0262] For example, as shown in FIG24 , while in touch mode, the touch device can detect the three-dimensional coordinates corresponding to the movement of a user's finger in the space above it, thereby enabling touch operations on the display content of the display device through the touch device. In some examples, in response to the user folding the touch device inward along the folding axis in the directions indicated by reference numerals 241 and 242, when the folding angle φ1 is equal to 0 degrees (or less than a preset angle), the touch device can switch its usage mode to remote control mode. In this way, the user can operate the display device through the remote control button located in the remote control button area behind the detection area of ​​the touch device, thereby enriching the usage scenarios of the touch device. Optionally, the remote control button can be similar to the button form of a traditional remote control, or it can be a simplified version of the button, and in conjunction with the capabilities of components such as the positioning module, provide the user with a directional remote control function, which is different from the control capability and mode of the display device in touch mode. In other examples, the user can directly switch the usage mode of the touch device through the interface settings, so that the touch device can switch between touch mode and remote control mode without changing the form of the touch device.

[0263] In some embodiments, a display device can be connected to at least one touch device, and multiple touch devices can meet the needs of multi-user interaction. The touch interaction implementation process between each touch device in a multi-touch device and the display device can refer to the touch interaction implementation process between a single touch device and the display device described above. Optionally, multiple touch devices can be configured with different roles to trigger different scene functions, thereby realizing richer interactive scenarios. For example, in a game scene, different touch devices can control different character display elements in the game interface.

[0264] In some schemes, multiple embodiments of the present application can be combined and the combined scheme can be implemented. Optionally, some operations in the process of each method embodiment are optionally combined, and / or the order of some operations is optionally changed. In addition, the execution order between the steps of each process is only exemplary and does not constitute a limitation on the execution order between the steps. There can also be other execution orders between the steps. It is not intended to indicate that the execution order is the only order in which these operations can be performed. Ordinary technicians in this field will think of many ways to reorder the operations described herein. In addition, it should be noted that the process details involved in a certain embodiment of this article are also applicable to other embodiments in a similar manner, or different embodiments can be used in combination.

[0265] Furthermore, some steps in the method embodiments may be equivalently replaced with other possible steps. Alternatively, some steps in the method embodiments may be optional and may be deleted in certain usage scenarios. Alternatively, other possible steps may be added to the method embodiments.

[0266] Furthermore, the various method embodiments may be implemented separately or in combination.

[0267] For example, the various touch scenarios in the gripping state or non-gripping state in the above examples can be combined. For example, as shown in Figure 14 or Figure 15, in the non-gripping state, the display device can display cursors with different display effects based on the different heights of the finger position relative to the touch device. Among them, when the user holds the touch device, it can also be achieved that the display device can display cursors with different display effects or display elements of different forms based on the different heights of the finger position relative to the touch device. For example, the user can hold the touch device with one hand, and when the finger in the one-hand gripping state performs a touch operation, the user's other hand is in a non-gripping state and can also perform a touch operation. Then, the touch device can obtain the three-dimensional coordinates in the gripping state and the three-dimensional coordinates in the non-gripping state, and the display device can display the corresponding cursor accordingly. In this way, various usage needs of users are met.

[0268] Figure 25 is a flow chart of a touch control method provided by an embodiment of the present application. It should be noted that the method is not limited to the specific sequence shown in Figure 25 and described below. It should be understood that in other embodiments, the order of some steps in the method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:

[0269] S2501: The first electronic device obtains a first finger position of a user holding the first electronic device, where the first finger position is at a first edge of a first area of ​​the first electronic device.

[0270] The user's finger position includes a position relative to the first electronic device generated by the user's finger performing a hovering action or a touching action on the first electronic device.

[0271] S2502: The first electronic device sends the first finger position to the second electronic device.

[0272] S2503: The second electronic device displays a first display element corresponding to the first finger position, where the first display element is located at a first edge of a display area of ​​the second electronic device.

[0273] The display elements include, for example, a cursor, a game watch, a virtual character, etc. displayed by the second electronic device.

[0274] For example, as shown in FIG8(a), the display area of ​​the display device is a rectangle, and the detection area of ​​the touch device is a cuboid (including the rectangular detection area), wherein the long side of the display area corresponds to the long side of the touch area, and the short side of the display area corresponds to the short side of the touch area. When the user holds the touch device with one hand using his right hand, the right thumb is located in the detection area of ​​the touch device and can be used to control the movement of the cursor displayed on the display device. Optionally, the detection area of ​​the touch device includes a right-hand detectable area 81 (such as the first area), which is a partial area in the detection area of ​​the touch device for detecting the position of the user's finger. Moreover, when the user's finger is at any position in the right-hand detectable area 81, the corresponding cursor can be displayed at any position on the display screen. For example, as shown in FIG8(a), when the user's finger is at the right edge 811 (such as the first edge of the first area) of the right-hand detectable area 81, the display device can display a cursor corresponding to the user's finger at the corresponding position on the right edge of the display area (such as the first edge of the display area).

[0275] S2504: The first electronic device obtains a second finger position of the user when holding the first electronic device, where the second finger position is at a second edge of the first area of ​​the first electronic device.

[0276] S2505: The first electronic device sends the second finger position to the second electronic device.

[0277] S2506: The second electronic device displays a second display element corresponding to the second finger position, where the second display element is located at a second edge of the display area of ​​the second electronic device.

[0278] Exemplarily, as shown in (b) of Figure 8, when the user's finger is located at the left edge 812 of the right-hand detectable area 81 (such as the second edge of the first area), the display device may display a cursor corresponding to the user's finger at the corresponding position of the left edge of the display area (such as the second edge of the display area).

[0279] In this way, by configuring the first electronic device to map operations to the first area of ​​the entire display area of ​​the first electronic device, the user's one-handed operation range requirements are met, reducing the user's operating difficulty. This avoids the user's operation being affected by the user's fingers being unable to reach part of the first electronic device in some situations.

[0280] Furthermore, by displaying and changing the cursor, users no longer need to switch their gaze between the first and second electronic devices. Instead, they can simply maintain their gaze on the second electronic device to perform touch operations. This allows users to control a remote second electronic device from their first electronic device in scenarios requiring timely and consistent interactive feedback, such as gaming. This allows users to enjoy a larger display experience while also meeting their needs for remote operation.

[0281] In some embodiments, the first electronic device obtains the position of a user's third finger and fourth finger, where the third finger is at a first height from the first electronic device and the fourth finger is at a second height from the first electronic device. Accordingly, when the third finger is at the first height from the first electronic device, the second electronic device presents a third display element having a first display effect; and when the fourth finger is at the second height from the first electronic device, the second electronic device presents a fourth display element having a second display effect, where the first display effect is different from the second display effect.

[0282] Optionally, the display effect includes, for example, the size, color, shape, etc. of the display element. It should be understood that the third display element and the fourth display element may be the same display element with different display effects, such as cursors of different colors.

[0283] For example, as shown in (a)-(c) in Figure 15, as the user's finger moves in the space above the first electronic device, the first electronic device sends the corresponding three-dimensional coordinates to the second electronic device. The second electronic device displays the cursor at different display positions based on the changes in the three-dimensional coordinates. Moreover, as the height of the user's finger from the cover of the first electronic device decreases, the cursor color gradually deepens until the user's finger touches the cover and the darkest cursor is displayed. As the height of the user's finger from the cover of the first electronic device increases, the cursor color gradually weakens until the finger height exceeds the detection distance of the first electronic device, that is, exceeds the detection area range, the first electronic device cannot detect the finger, and the cursor display stops.

[0284] In this way, the user can perceive the relative position of the finger and the first electronic device in space according to the change in the display effect of the display element, and adjust the finger position in time to improve the interaction efficiency.

[0285] In some embodiments, in response to the user's finger moving from the first finger position to the fifth finger position, the first electronic device obtains the fifth finger position. In response to the user's finger moving from the second finger position to the sixth finger position, the first electronic device obtains the sixth finger position. Wherein, the first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position on the first electronic device. Accordingly, in response to the first electronic device detecting the fifth finger position, the second electronic device displays the fifth display element corresponding to the fifth finger position. In response to the first electronic device detecting the sixth finger position, the second electronic device displays the sixth display element corresponding to the sixth finger position. Wherein, the first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

[0286] For example, in the scenario shown in Figure 11, the first area in the detection area of ​​the first electronic device is the right-hand detectable area. In the right-hand detectable area, the farther away from the base of the finger, the larger the scale factor used to convert the three-dimensional coordinates; the closer to the base of the finger, the smaller the scale factor used to convert the three-dimensional coordinates. Therefore, when a finger moves the same distance near the base of the finger and away from the base of the finger, the corresponding display element moves by different distances. For example, the display element moves a smaller distance when the finger moves near the base of the finger, while the display element moves a larger distance when the finger moves away from the base of the finger.

[0287] In this way, by changing the scale factor, a more sensitive interaction experience can be achieved whether the user's finger is near or far. In this way, even if the size of the first electronic device is large for the user, the problem of the user's finger span being too large during the touch process can be avoided, thereby improving the user's experience.

[0288] In some embodiments, the first electronic device obtains the position of the user's seventh finger. In response to the first electronic device detecting the seventh finger position, the second electronic device displays a seventh display element corresponding to the seventh finger position and changes the display effect of an eighth display element originally displayed at the display position of the seventh display element.

[0289] Optionally, the changed display effect of the eighth display element matches that of the seventh display element.

[0290] For example, as shown in Figure 17(a), the first electronic device detects the three-dimensional coordinate 1 corresponding to the user's finger and sends the three-dimensional coordinate 1 to the second electronic device. The second electronic device then displays a cursor 171 based on the three-dimensional coordinate 1. Subsequently, as the user's finger moves, as shown in Figure 17(b), the first electronic device detects the three-dimensional coordinate 2 corresponding to the user's finger and sends the three-dimensional coordinate 2 to the second electronic device. The second electronic device then displays a cursor 171 based on the three-dimensional coordinate 2. Furthermore, the second electronic device determines that the current display position of cursor 171 overlaps with the display area of ​​a smart life application icon, such as if cursor 171 is displayed on top of the smart life application icon. In this case, the second electronic device can expand the display of the smart life application icon to prompt the user that the current cursor position allows the smart life application icon to be operated.

[0291] In this way, the user's interactive experience is enhanced through the display changes of multiple display elements.

[0292] In some embodiments, the detection area of ​​the first electronic device further includes a second area, which is a portion of the detection area of ​​the first electronic device. The second area is used to detect the position of a user's finger; the first and second finger positions are the positions of the user's right hand fingers. The first electronic device obtains the position of the user's eighth finger when holding the first electronic device. The eighth finger position is at the first edge of the second area of ​​the first electronic device. The first electronic device obtains the position of the user's ninth finger when holding the first electronic device. The ninth finger position is at the second edge of the second area of ​​the first electronic device. The first edge of the second area and the second edge of the second area are opposite edges of the second area, and the opposite edges of the second area are perpendicular to the long side of the detection area. The eighth and ninth finger positions are the positions of the user's left hand fingers, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area. Accordingly, in response to the first electronic device detecting the eighth finger position, the second electronic device displays a ninth display element corresponding to the eighth finger position. The ninth display element is located at the second edge of the display area of ​​the second electronic device. In response to the first electronic device detecting the ninth finger position, the second electronic device displays a tenth display element corresponding to the ninth finger position. The tenth display element is located at the first edge of the display area of ​​the second electronic device.

[0293] Exemplarily, as shown in FIG10 , the user holds the first electronic device with both hands, and the detection area of ​​the first electronic device includes a right-hand detectable area 81 (such as the first area) and a left-hand detectable area 91 (such as the second area). Optionally, the right-hand detectable area 81 and the left-hand detectable area 91 may not overlap and are combined to form the detection area of ​​the first electronic device, or the right-hand detectable area 81 and the left-hand detectable area 91 may partially overlap. When the user's right finger is located at the right edge of the right-hand detectable area 81 (such as the first edge of the first area), the second electronic device displays a cursor at the right edge of the display area (such as the first edge of the display area). When the user's right finger is located at the left edge of the right-hand detectable area 81 (such as the second edge of the first area), the second electronic device displays a cursor at the left edge of the display area (such as the second edge of the display area). When the user's left finger is located at the left edge of the left-hand detectable area 91 (such as the first edge of the second area), the second electronic device displays a cursor at the left edge of the display area (such as the second edge of the display area). When the user's left finger is located at the right edge of the left hand detectable area 91 (such as the second edge of the second area), the second electronic device displays a cursor at the right edge of the display area (such as the first edge of the display area).

[0294] In this way, by configuring the right-hand detectable area and / or the left-hand detectable area, and mapping both the right-hand detectable area and the left-hand detectable area to the entire display area of ​​the display device, the user's two-handed operation needs are met, and the difficulty of one-handed operation is reduced. This avoids the user's operation being affected by the user's fingers being unable to reach some areas.

[0295] In some embodiments, the first electronic device obtains the position of the user's tenth finger and sends multiple first signals to the position of the tenth finger through a signal transmission array, wherein the multiple first signals arrive at the tenth finger position at the same or similar time.

[0296] Optionally, the first signal is ultrasound, high-frequency light, etc.

[0297] In this way, the first electronic device can provide tactile feedback to the user, thereby enriching the user's usage experience.

[0298] In some examples, a first electronic device obtains the position of a user's eleventh finger. The tenth finger is at a third height from the first electronic device, and the eleventh finger is at a fourth height from the first electronic device. The first electronic device transmits multiple second signals to the eleventh finger position via a signal transmission array. The multiple second signals arrive at the eleventh finger position at the same or similar times, and the signal strengths of the multiple first signals are different from the signal strengths of the multiple second signals.

[0299] In this way, the user is prompted to change the distance at the same time as the tactile feedback is provided, by providing a continuous tactile feedback that is continuously enhanced as the user's finger gets closer to the cover.

[0300] In some embodiments, the first electronic device detects the position of a user's twelfth finger, which is at a fifth height from the first electronic device. In response to the first electronic device detecting the twelfth finger position, the second electronic device displays an eleventh display element corresponding to the twelfth finger position, with the eleventh display element displayed above the twelfth display element displayed on the second electronic device. When the fifth height is 0, a response event corresponding to the twelfth display element is triggered.

[0301] For example, as shown in Figure 17(b), the user determines that the current cursor 171 can operate the smart life application icon based on the enlargement of the smart life application icon. The user can then lower the height of the finger to trigger the operation of the smart life application icon. As shown in Figure 17(c), the first electronic device detects the three-dimensional coordinates 3 corresponding to the user's finger and sends the three-dimensional coordinates 3 to the second electronic device. The second electronic device determines that z=0 is indicated based on the three-dimensional coordinates 3 and can display the cursor 171 corresponding to the touch state. In addition, the second electronic device can determine that the user indicates to click on the smart life application icon. Then, the second electronic device can start the smart life application and display the smart life application interface shown in Figure 17(d).

[0302] In this way, as the user's finger moves in space, the second electronic device can change the corresponding display elements to prompt the user to instruct the second electronic device to perform the task. In addition, in response to the change in the height of the user's finger, the second electronic device triggers a corresponding response event to meet the user's interaction needs.

[0303] Optionally, the first electronic device may further execute the steps and functions executed by the touch device in the above embodiment, and the second electronic device may further execute the steps and functions executed by the display device in the above embodiment, thereby implementing the touch method provided by the above embodiment.

[0304] The touch control method provided by the embodiment of the present application is described in detail above with reference to Figures 5 to 20. The first electronic device provided by the embodiment of the present application is described in detail below with reference to Figure 26, and the second electronic device provided by the embodiment of the present application is described in detail with reference to Figure 27.

[0305] In one possible design, Figure 26 is a schematic diagram of the structure of a first electronic device provided in an embodiment of the present application. As shown in Figure 26, the first electronic device 2600 may include a transceiver unit 2601 and a processing unit 2602. The first electronic device 2600 may be used to implement the functions of the first electronic device (e.g., a touch device) involved in the above method embodiments.

[0306] Optionally, the transceiver unit 2601 is used to support the first electronic device 2600 to execute S2502 and S2505 in Figure 25.

[0307] Optionally, the processing unit 2602 is used to support the first electronic device 2600 to execute S2501 and S2504 in Figure 25.

[0308] The transceiver unit may include a receiving unit and a transmitting unit, and may be implemented by a transceiver or a transceiver-related circuit component, and may be a transceiver or a transceiver module. The operations and / or functions of each unit in the first electronic device 2600 are respectively for implementing the corresponding processes of the touch control method described in the above method embodiment. All relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional unit. For the sake of brevity, they are not repeated here.

[0309] Optionally, the first electronic device 2600 shown in FIG26 may further include a storage unit (not shown in FIG26 ) storing a program or instruction. When the transceiver unit 2601 and the processing unit 2602 execute the program or instruction, the first electronic device 2600 shown in FIG26 may perform the touch control method described in the above method embodiment.

[0310] The technical effects of the first electronic device 2600 shown in FIG. 26 may refer to the technical effects of the touch method described in the above method embodiment, and will not be repeated here.

[0311] In addition to being in the form of the first electronic device 2600, the technical solution provided in this application may also be a functional unit or chip in the first electronic device, or a device used in conjunction with the first electronic device.

[0312] In one possible design, Figure 27 is a schematic diagram of the structure of a second electronic device provided in an embodiment of the present application. As shown in Figure 27, the second electronic device 2700 may include: a transceiver unit 2701, a processing unit 2702, and a display unit 2703. The second electronic device 2700 may be used to implement the functions of the second electronic device (such as a display device) involved in the above method embodiments.

[0313] Optionally, the transceiver unit 2701 is used to support the second electronic device 2700 to execute S2502 and S2505 in Figure 25.

[0314] Optionally, the processing unit 2702 is used to support the second electronic device 2700 to execute S2503 and S2506 in Figure 25.

[0315] Optionally, the display unit 2703 is used to support the second electronic device 2700 to execute S2503 and S2506 in Figure 25.

[0316] The transceiver unit may include a receiving unit and a transmitting unit, and may be implemented by a transceiver or transceiver-related circuit components, and may be a transceiver or a transceiver module. The operations and / or functions of each unit in the second electronic device 2700 are respectively for implementing the corresponding processes of the touch method described in the above method embodiment. All relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional unit. For the sake of brevity, they are not repeated here.

[0317] Optionally, the second electronic device 2700 shown in FIG27 may further include a storage unit (not shown in FIG27 ) storing a program or instruction. When the transceiver unit 2701, the processing unit 2702, and the display unit 2703 execute the program or instruction, the second electronic device 2700 shown in FIG27 may execute the touch control method described in the above method embodiment.

[0318] The technical effects of the second electronic device 2700 shown in FIG. 27 may refer to the technical effects of the touch method described in the above method embodiment, and will not be repeated here.

[0319] In addition to being in the form of the second electronic device 2700, the technical solution provided in this application may also be a functional unit or chip in the second electronic device, or a device used in conjunction with the second electronic device.

[0320] An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, the memory is used to store programs or instructions, when the program or instructions are executed by the processor, the chip system implements the method in any of the above method embodiments.

[0321] Optionally, there may be one or more processors in the chip system. The processor may be implemented in hardware or software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0322] Optionally, the memory in the chip system may be one or more. The memory may be integrated with the processor or may be provided separately from the processor, which is not limited in the embodiments of the present application. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or provided on different chips. The embodiments of the present application do not specifically limit the type of memory or the configuration of the memory and the processor.

[0323] Exemplarily, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0324] It should be understood that each step in the above method embodiment can be completed by hardware integrated logic circuits in a processor or by software instructions. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0325] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the computer executes the above-mentioned related steps to implement the touch method in the above-mentioned embodiment.

[0326] The embodiment of the present application further provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the touch method in the above-mentioned embodiment.

[0327] In addition, embodiments of the present application further provide a device. Specifically, the device may be a component or module, and may include one or more processors and a memory connected to each other. The memory is configured to store a computer program. When the computer program is executed by one or more processors, the device performs the touch control method described in each of the aforementioned method embodiments.

[0328] The apparatus, computer-readable storage medium, computer program product, or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0329] The steps of the method or algorithm described in conjunction with the disclosure of the embodiments of the present application can be implemented in a hardware manner or can be implemented by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a register, a hard disk, a mobile hard disk, a read-only compact disc (CD-ROM) or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC).

[0330] Through the description of the above embodiments, those skilled in the art will clearly understand that for the sake of convenience and brevity, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed; that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working processes of the above-mentioned systems, devices, and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0331] In the several embodiments provided in this application, it should be understood that the disclosed methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of modules or units, which can be electrical, mechanical or other forms.

[0332] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0333] Computer-readable storage media include, but are not limited to, any of the following: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and other media that can store program code.

[0334] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A touch control system, characterized in that, The system includes a first electronic device and a second electronic device; The first electronic device is configured to: Obtain a first finger position when a user holds the first electronic device, where the first finger position is at a first edge of a first area of the first electronic device, the first area being a partial area of a detection area of the first electronic device, and the first area is used to detect the user's finger position; Obtain a second finger position when the user holds the first electronic device, where the second finger position is at a second edge of the first area of the first electronic device; wherein, the first edge and the second edge of the first area are opposite edges of the first area, and the opposite edges of the first area are perpendicular to the long side of the detection area; The second electronic device is configured to: In response to the first electronic device detecting the first finger position, display a first display element corresponding to the first finger position, where the first display element is located at a first edge of a display area of the second electronic device; In response to the first electronic device detecting the second finger position, display a second display element corresponding to the second finger position, where the second display element is located at a second edge of the display area of the second electronic device; wherein, the first edge and the second edge of the display area are opposite edges of the display area.

2. The system according to claim 1, wherein: The first electronic device is configured to: Obtain a third finger position and a fourth finger position of the user, where the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device; The second electronic device is configured to: When the third finger position is at the first height from the first electronic device, present a third display element with a first display effect; When the fourth finger position is at the second height from the first electronic device, present a fourth display element with a second display effect, where the first display effect is different from the second display effect.

3. The system according to claim 1 or 2, wherein: The first electronic device is configured to: In response to the user's finger moving from the first finger position to a fifth finger position, obtain the fifth finger position; In response to the user's finger moving from the second finger position to a sixth finger position, obtain the sixth finger position; wherein, a first projection distance on the first electronic device between the first finger position and the fifth finger position is equal to a second projection distance on the first electronic device between the second finger position and the sixth finger position; The second electronic device is configured to: In response to the first electronic device detecting the fifth finger position, display a fifth display element corresponding to the fifth finger position; In response to the first electronic device detecting the sixth finger position, display a sixth display element corresponding to the sixth finger position; wherein, a first distance between the first display element and the fifth display element is less than a second distance between the second display element and the sixth display element.

4. The system according to any one of claims 1-3, wherein: The first electronic device is configured to: Obtain the position of the seventh finger of the user; The second electronic device is configured to: In response to the first electronic device detecting the position of the seventh finger, display a seventh display element corresponding to the position of the seventh finger, and change the display effect of an eighth display element whose original display position is on the seventh display element.

5. The system according to claim 4, characterized in that, The display effect of the changed eighth display element matches that of the seventh display element.

6. The system according to any one of claims 1-5, characterized in that The detection area of the first electronic device further includes a second area, which is a partial area in the detection area of the first electronic device, and the second area is used to detect the position of the user's finger; the first finger position and the second finger position are the positions of the user's right hand fingers; The first electronic device is configured to: Obtain the position of the eighth finger when the user holds the first electronic device, and the position of the eighth finger is on the first edge of the second area of the first electronic device; Obtain the position of the ninth finger when the user holds the first electronic device, and the position of the ninth finger is on the second edge of the second area of the first electronic device; wherein, the first edge and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the eighth finger position and the ninth finger position are the positions of the user's left hand fingers, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area; The second electronic device is configured to: In response to the first electronic device detecting the position of the eighth finger, display a ninth display element corresponding to the position of the eighth finger, and the ninth display element is located on the second edge of the display area of the second electronic device; In response to the first electronic device detecting the position of the ninth finger, display a tenth display element corresponding to the position of the ninth finger, and the tenth display element is located on the first edge of the display area of the second electronic device.

7. The system according to any one of claims 1-6, wherein: The first electronic device is configured to: Obtain the position of the tenth finger of the user; Send a plurality of first signals to the position of the tenth finger through a signal emission array, and the plurality of first signals arrive at the position of the tenth finger at the same or approximately the same time.

8. The system according to claim 7, wherein: The first electronic device is configured to: Obtain the position of the eleventh finger of the user; wherein, the tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device; Send a plurality of second signals to the position of the eleventh finger through the signal emission array, the plurality of second signals arrive at the position of the eleventh finger at the same or approximately the same time, and the signal strength of the plurality of first signals is different from the signal strength of the plurality of second signals.

9. The system according to any one of claims 1-8, wherein: The first electronic device is configured to: Obtain the twelfth finger position of the user, where the twelfth finger position is at a fifth height from the first electronic device; The second electronic device is configured to: In response to the first electronic device detecting the twelfth finger position, display an eleventh display element corresponding to the twelfth finger position, and the eleventh display element is displayed above a twelfth display element displayed on the second electronic device; When the fifth height is 0, trigger the execution of a response event corresponding to the twelfth display element.

10. The system according to any one of claims 1-9, characterized in that, The user finger position includes the position of the user's finger relative to the first electronic device generated by the user performing a hovering action or a touching action on the first electronic device.

11. A touch control method, characterized in that, Applied to a first electronic device, the method includes: Obtain a first finger position when the user holds the first electronic device, where the first finger position is at a first edge of a first area of the first electronic device, and the first area is a partial area of the detection area of the first electronic device, and the first area is used to detect the user finger position; Obtain a second finger position when the user holds the first electronic device, where the second finger position is at a second edge of the first area of the first electronic device, and the first edge and the second edge of the first area are opposite edges of the first area, and the opposite edges of the first area are perpendicular to the long side of the detection area; Wherein, The first finger position corresponds to a first display element displayed on the second electronic device, and the first display element is located at a first edge of the display area of the second electronic device; The second finger position corresponds to a second display element displayed on the second electronic device, and the second display element is located at a second edge of the display area of the second electronic device, and the first edge and the second edge of the display area are opposite edges of the display area.

12. The method according to claim 11, wherein The method further includes: Obtain a third finger position and a fourth finger position of the user, where the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device; Wherein, The third finger position corresponds to a third display element presented on the second electronic device with a first display effect, and the fourth finger position corresponds to a fourth display element presented on the second electronic device with a second display effect, and the first display effect is different from the second display effect.

13. The method according to claim 11 or 12, characterized in that, The method further includes: In response to the user's finger moving from the first finger position to a fifth finger position, obtain the fifth finger position; In response to the user's finger moving from the second finger position to a sixth finger position, obtain the sixth finger position; wherein, the first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position on the first electronic device; Wherein, The fifth finger position corresponds to a fifth display element displayed on the second electronic device, the sixth finger position corresponds to a sixth display element displayed on the second electronic device, and a first distance between the first display element and the fifth display element is less than a second distance between the second display element and the sixth display element.

14. The method according to any one of claims 11 - 13, characterized in that, The method further includes: Obtaining a seventh finger position of the user; Wherein, the seventh finger position corresponds to a seventh display element displayed on the second electronic device, and before and after the seventh display element is displayed at a display position corresponding to the seventh finger position, a display effect of an eighth display element originally displayed at the display position is changed.

15. The method according to claim 14, wherein The changed display effect of the eighth display element matches the seventh display element.

16. The method according to any one of claims 11-15, characterized in that, The detection area of the first electronic device further includes a second area, the second area is a partial area in the detection area of the first electronic device, and the second area is used for detecting a user finger position; The first finger position and the second finger position are the right hand finger positions of the user; The method further includes: Obtaining an eighth finger position when the user holds the first electronic device, the eighth finger position is at a first edge of the second area of the first electronic device; Obtaining a ninth finger position when the user holds the first electronic device, the ninth finger position is at a second edge of the second area of the first electronic device; wherein, the first edge and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the eighth finger position and the ninth finger position are the left hand finger positions of the user, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area; Wherein, The eighth finger position corresponds to a ninth display element displayed on the second electronic device, and the ninth display element is located at a second edge of the display area of the second electronic device; The ninth finger position corresponds to a tenth display element displayed on the second electronic device, and the tenth display element is located at a first edge of the display area of the second electronic device.

17. The method according to any one of claims 11-16, characterized in that, The method further includes: Obtaining a tenth finger position of the user; Sending a plurality of first signals to the tenth finger position through a signal emission array, and the plurality of first signals arrive at the tenth finger position at the same or approximate time.

18. The method according to claim 17, wherein The method further includes: Obtaining an eleventh finger position of the user; wherein, the tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device; Sending a plurality of second signals to the eleventh finger position through the signal emission array, and the plurality of second signals arrive at the eleventh finger position at the same or approximate time, and signal intensities of the plurality of first signals are different from signal intensities of the plurality of second signals.

19. The method according to any one of claims 11-18, characterized in that, The method further includes: Obtaining a twelfth finger position of the user, the twelfth finger position is at a fifth height from the first electronic device; Among them, the twelfth finger position corresponds to the eleventh display element displayed on the second electronic device, the eleventh display element is displayed above the twelfth display element displayed on the second electronic device, and the fifth height being 0 indicates triggering the second electronic device to execute a response event corresponding to the twelfth display element.

20. The method according to any one of claims 11-19, characterized in that, The user finger position includes the position of the user finger relative to the first electronic device generated by the user finger performing a hovering action or a touch action on the first electronic device.

21. An electronic device, characterized in that, Including: A processor and a memory, the memory being coupled to the processor, the memory being used to store computer program code, the computer program code including computer instructions, when the processor reads the computer instructions from the memory, causing the electronic device to execute the method according to any one of claims 11-20.

22. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a computer program, when the computer program runs on an electronic device, causing the electronic device to execute the method according to any one of claims 11-20.

23. A computer program product, characterized in that, When the computer program product runs on a computer, causing the computer to execute the method according to any one of claims 11-20.

Images