Touch method, electronic equipment and system

Abstract

The invention provides a touch method, electronic equipment and a system, and relates to the technical field of terminals. The finger position of the user can be detected through the partial area in the detection area, and the single-hand operation requirement of the user is met. The method comprises the following steps: the first electronic equipment acquires a first finger position on a first edge of a first area when a user holds the first electronic equipment, wherein the first area is a partial area in a detection area of the first electronic equipment; the position of a second finger on the second edge of the first area when the user holds the first electronic equipment is obtained, the first edge and the second edge of the first area are opposite side edges, and the opposite side edges are perpendicular to the long edge of the detection area. The first finger position corresponds to a first display element which is displayed by the second electronic equipment and is located at a first edge of the display area; the second finger position corresponds to a second display element which is displayed by the second electronic equipment and is positioned on a second edge of the display area, and the first edge and the second edge of the display area are opposite side edges.

Description

Technical Field

[0001] This application relates to the technical field of terminals, and in particular, to a touch control method, an electronic device, and a system. Background Art

[0002] With the development of touch interaction technology, some long-distance display devices such as televisions, in-vehicle displays, projectors, etc. have realized touch interaction scenarios with hand-eye separation. For example, after a television starts an application, it projects the application display interface onto a touch control device, so that users can perform reverse control of the television through touch operations on the touch control device. Compared with the hand-eye synchronization scenario, the hand-eye separation scenario can meet the needs of users to remotely control display devices.

[0003] However, in the above hand-eye separation scenario, users need to frequently switch their line of sight between the display device and the touch control device, which cannot achieve continuous operation, and the interactive controllable range is also limited, affecting the interaction efficiency. Summary of the Invention

[0004] To solve the above technical problems, this application provides a touch control method, an electronic device, and a system. The detection area of the first electronic device provided by this application includes a first area, which is a partial area in the detection area. When the position of the user's finger is at the edges of the first area, the second electronic device can also correspondingly display corresponding display elements at the edges of its own display area. In this way, when the user holds the first electronic device, the first area with a reduced operation range can also be used to meet the user's one-handed operation needs and improve the user experience. Moreover, through the display of the display elements, users can perform correct reverse control operations without switching their line of sight, improving the interaction efficiency.

[0005] To achieve the above technical objectives, this application provides the following technical solutions:

[0006] In a first aspect, a touch control method is provided, which is applied to a first electronic device. The method includes: obtaining a first finger position when a user holds the first electronic device, where the first finger position is at a first edge of a first area of the first electronic device, the first area is a partial area of a detection area of the first electronic device, and the first area is used to detect the position of the user's finger. Obtaining a second finger position when the user holds the first electronic device, where the second finger position is at a second edge of the first area of the first electronic device, the first edge and the second edge of the first area are opposite edges of the first area, and the opposite edges of the first area are perpendicular to the long side of the detection area. Among them, the first finger position corresponds to a first display element displayed on a second electronic device, and the first display element is located at a first edge of a display area of the second electronic device. The second finger position corresponds to a second display element displayed on the second electronic device, and the second display element is located at a second edge of the display area of the second electronic device, and the first edge and the second edge of the display area are opposite edges of the display area.

[0007] In this way, by configuring the first area in the first electronic device that can map operations to the entire display area of the second electronic device, the requirement for the one-handed operation range of the user is met, and the operation difficulty of the user is reduced. Thus, it is avoided that the user's operation is affected because the user's finger cannot reach some areas of the first electronic device in some situations.

[0008] Moreover, through the display and display change of the display element, the user does not have to switch the line of sight back and forth between the first electronic device and the second electronic device, but only needs to keep the line of sight on the second electronic device to achieve touch control operations. Thus, in scenarios such as games that require timely and coherent interactive feedback, the user can also control the second electronic device at a distance through the first electronic device. In this way, while meeting the user's large display experience, the requirement for the user's long-distance operation is met.

[0009] According to the first aspect, the method further includes: obtaining a third finger position and a fourth finger position of the user, where the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device. Among them, the third finger position corresponds to a third display element with a first display effect presented on the second electronic device, and the fourth finger position corresponds to a fourth display element with a second display effect presented on the second electronic device, and the first display effect is different from the second display effect.

[0010] Exemplarily, as the height of the user's finger from the cover of the first electronic device decreases, the color of the display element is gradually deepened. Until after the user's finger touches the cover, as the height of the user's finger from the cover of the first electronic device increases, the color of the display element is gradually weakened. Until the finger height exceeds the detection distance of the first electronic device, that is, exceeds the detection area range, the first electronic device cannot detect the finger, and the display of the display element stops.

[0011] In this way, the user perceives the relative position relationship between the finger and the first electronic device in space according to the change of the display effect of the display element, adjusts the finger position in time, and improves the interaction efficiency.

[0012] According to the first aspect, or any one of the above implementation manners of the first aspect, the method further includes: in response to the user's finger moving from the first finger position to the fifth finger position, obtaining the fifth finger position. In response to the user's finger moving from the second finger position to the sixth finger position, obtaining the sixth finger position; wherein, the first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position on the first electronic device. Wherein, the fifth finger position corresponds to the fifth display element displayed on the second electronic device, the sixth finger position corresponds to the sixth display element displayed on the second electronic device, and the first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

[0013] Exemplarily, in the first region, the closer to the finger root position, the smaller the proportionality coefficient for converting three-dimensional coordinates; the farther from the finger root position, the larger the proportionality coefficient for converting three-dimensional coordinates. Then, for finger positions that move the same distance near and far from the finger root position respectively, the corresponding display element moves different distances. For example, the display element moved by the finger position near the finger root position moves a smaller distance, and the display element moved by the finger position far from the finger root position moves a larger distance.

[0014] In this way, through the change of the proportionality coefficient, it is ensured that when the user's finger is at the proximal or distal end, a more sensitive interaction experience can be obtained. In this way, even when the size of the first electronic device is relatively large for the user, the problem that the user's finger span is too large during the touch process can be avoided, thereby improving the user's experience.

[0015] According to the first aspect, or any one of the above implementation manners of the first aspect, the method further includes: obtaining the seventh finger position of the user. Wherein, the seventh finger position corresponds to the seventh display element displayed on the second electronic device, and before and after the seventh display element is displayed at the display position corresponding to the seventh finger position, the display effect of the eighth display element originally displayed at the display position changes.

[0016] According to the first aspect, or any implementation of the above first aspect, the display effect of the changed eighth display element matches that of the seventh display element.

[0017] In this way, by changing the display of multiple display elements, the user's interaction experience is improved.

[0018] According to the first aspect, or any implementation of the above first aspect, the detection area of the first electronic device further includes a second area, which is a partial area in the detection area of the first electronic device. The second area is used to detect the position of the user's finger; the first finger position and the second finger position are the positions of the user's right hand fingers; the method further includes: obtaining the eighth finger position when the user holds the first electronic device, and the eighth finger position is on the first edge of the second area of the first electronic device. Obtaining the ninth finger position when the user holds the first electronic device, and the ninth finger position is on the second edge of the second area of the first electronic device; wherein, the first edge and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the eighth finger position and the ninth finger position are the positions of the user's left hand fingers, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area. Among them, the eighth finger position corresponds to the ninth display element displayed on the second electronic device, and the ninth display element is located on the second edge of the display area of the second electronic device. The ninth finger position corresponds to the tenth display element displayed on the second electronic device, and the tenth display element is located on the first edge of the display area of the second electronic device.

[0019] In this way, by configuring the right hand detectable area and / or the left hand detectable area, and both the right hand detectable area and the left hand detectable area can be mapped to the entire display area of the display device, the operation requirements of the user's two-handed holding are met, and the difficulty of single-handed operation for the user in this process is reduced. Thus, it is avoided that the user's fingers cannot reach some areas, which affects the user's operation.

[0020] According to the first aspect, or any implementation of the above first aspect, the method further includes: obtaining the tenth finger position of the user. Sending a plurality of first signals to the tenth finger position through the signal emission array, and the plurality of first signals reach the tenth finger position at the same or similar times.

[0021] Optionally, the first signal is ultrasound, high-frequency light, etc.

[0022] In this way, the first electronic device can provide tactile feedback to the user, thus enriching the user's usage experience more.

[0023] According to the first aspect, or any implementation of the above first aspect, the method further includes: obtaining the position of the user's eleventh finger; wherein, the position of the tenth finger is at a third height from the first electronic device, and the position of the eleventh finger is at a fourth height from the first electronic device. Transmitting a plurality of second signals to the position of the eleventh finger through the signal emission array, the plurality of second signals arriving at the position of the eleventh finger at the same or similar times, and the signal intensities of the plurality of first signals being different from the signal intensities of the plurality of second signals.

[0024] In this way, through the continuously emerging tactile feedback that continuously increases as the user's finger gets closer to the cover plate, while providing the tactile feedback, it is possible to prompt the user of the change in distance.

[0025] According to the first aspect, or any implementation of the above first aspect, the method further includes: obtaining the position of the user's twelfth finger, the position of the twelfth finger being at a fifth height from the first electronic device. Wherein, the position of the twelfth finger corresponds to the eleventh display element displayed on the second electronic device, the eleventh display element being displayed above the twelfth display element displayed on the second electronic device, and a fifth height of 0 indicates triggering the second electronic device to execute a response event corresponding to the twelfth display element.

[0026] In this way, as the user's finger moves in space, the second electronic device can perform changes to the corresponding display elements to prompt the user of the tasks that the current finger can instruct the second electronic device to execute. And, in response to the change in the height of the user's finger, the second electronic device triggers the corresponding response event to meet the user's interaction needs.

[0027] According to the first aspect, or any implementation of the above first aspect, the user finger position includes the position of the user's finger relative to the first electronic device generated by performing a hovering action or a touching action on the first electronic device.

[0028] Second aspect, there is provided a first electronic device. The first electronic device includes: a processor and a memory, the memory being coupled to the processor, the memory being configured to store computer program code, the computer program code including computer instructions, when the processor reads the computer instructions from the memory, causing the first electronic device to perform: obtaining a first finger position when a user holds the first electronic device, the first finger position being at a first edge of a first area of the first electronic device, the first area being a partial area of a detection area of the first electronic device, the first area being used to detect the user's finger position. Obtaining a second finger position when the user holds the first electronic device, the second finger position being at a second edge of the first area of the first electronic device, the first edge and the second edge of the first area being opposite edges of the first area, the opposite edges of the first area being perpendicular to the long side of the detection area. Wherein, the first finger position corresponds to a first display element displayed on a second electronic device, the first display element being located at a first edge of a display area of the second electronic device. The second finger position corresponds to a second display element displayed on the second electronic device, the second display element being located at a second edge of the display area of the second electronic device, the first edge and the second edge of the display area being opposite edges of the display area.

[0029] According to the second aspect, when the processor reads the computer instructions from the memory, it further causes the first electronic device to perform: obtaining a third finger position and a fourth finger position of the user, the third finger position being at a first height from the first electronic device, the fourth finger position being at a second height from the first electronic device. Wherein, the third finger position corresponds to a third display element presented on the second electronic device with a first display effect, and the fourth finger position corresponds to a fourth display element presented on the second electronic device with a second display effect, the first display effect being different from the second display effect.

[0030] According to the second aspect, or any one of the implementation manners of the above second aspect, when the processor reads the computer instructions from the memory, it further causes the first electronic device to perform: in response to the user's finger moving from the first finger position to a fifth finger position, obtaining the fifth finger position. In response to the user's finger moving from the second finger position to a sixth finger position, obtaining the sixth finger position; wherein, a first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to a second projection distance between the second finger position and the sixth finger position on the first electronic device. Wherein, the fifth finger position corresponds to a fifth display element displayed on the second electronic device, and the sixth finger position corresponds to a sixth display element displayed on the second electronic device, a first distance between the first display element and the fifth display element being less than a second distance between the second display element and the sixth display element.

[0031] According to the second aspect, or any implementation manner of the above second aspect, when the processor reads computer instructions from the memory, it further causes the first electronic device to perform: obtaining the position of the seventh finger of the user. The position of the seventh finger corresponds to the seventh display element displayed on the second electronic device. Before and after the seventh display element is displayed at the display position corresponding to the position of the seventh finger, the display effect of the eighth display element originally displayed at the display position changes.

[0032] According to the second aspect, or any implementation manner of the above second aspect, the display effect of the changed eighth display element matches that of the seventh display element.

[0033] According to the second aspect, or any implementation manner of the above second aspect, the detection area of the first electronic device further includes a second area, which is a partial area in the detection area of the first electronic device. The second area is used to detect the position of the user's finger; the first finger position and the second finger position are the positions of the user's right hand fingers. When the processor reads computer instructions from the memory, it further causes the first electronic device to perform: obtaining the position of the eighth finger when the user holds the first electronic device. The position of the eighth finger is at the first edge of the second area of the first electronic device. Obtaining the position of the ninth finger when the user holds the first electronic device. The position of the ninth finger is at the second edge of the second area of the first electronic device; where the first edge and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the position of the eighth finger and the position of the ninth finger are the positions of the user's left hand fingers, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area. Wherein, the position of the eighth finger corresponds to the ninth display element displayed on the second electronic device, and the ninth display element is located at the second edge of the display area of the second electronic device. The position of the ninth finger corresponds to the tenth display element displayed on the second electronic device, and the tenth display element is located at the first edge of the display area of the second electronic device.

[0034] According to the second aspect, or any implementation manner of the above second aspect, when the processor reads computer instructions from the memory, it further causes the first electronic device to perform: obtaining the position of the tenth finger of the user. Sending a plurality of first signals to the position of the tenth finger through the signal emission array, and the plurality of first signals reach the position of the tenth finger at the same or similar time.

[0035] According to a second aspect, or any implementation of the above second aspect, when the processor reads computer instructions from the memory, it further causes the first electronic device to perform: obtaining the position of the eleventh finger of the user; wherein, the position of the tenth finger is at a third height from the first electronic device, and the position of the eleventh finger is at a fourth height from the first electronic device. Sending a plurality of second signals to the position of the eleventh finger through the signal emission array, the plurality of second signals arriving at the position of the eleventh finger at the same or similar time, and the signal intensities of the plurality of first signals being different from the signal intensities of the plurality of second signals.

[0036] According to a second aspect, or any implementation of the above second aspect, when the processor reads computer instructions from the memory, it further causes the first electronic device to perform: obtaining the position of the twelfth finger of the user, the position of the twelfth finger being at a fifth height from the first electronic device. Wherein, the position of the twelfth finger corresponds to the eleventh display element displayed on the second electronic device, the eleventh display element being displayed above the twelfth display element displayed on the second electronic device, and a fifth height of 0 indicates triggering the second electronic device to execute a response event corresponding to the twelfth display element.

[0037] According to a second aspect, or any implementation of the above second aspect, the user finger position includes the position of the user's finger relative to the first electronic device generated by performing a hovering action or a touching action on the first electronic device.

[0038] In a third aspect, a touch control system is provided. The system includes: a first electronic device and a second electronic device. Wherein, the first electronic device is configured to: obtain the position of the first finger when the user holds the first electronic device, the position of the first finger being at the first edge of the first area of the first electronic device, the first area being a partial area of the detection area of the first electronic device, and the first area being used to detect the position of the user's finger. Obtain the position of the second finger when the user holds the first electronic device, the position of the second finger being at the second edge of the first area of the first electronic device; wherein, the first edge and the second edge of the first area are opposite edges of the first area, and the opposite edges of the first area are perpendicular to the long side of the detection area. The second electronic device is configured to: in response to the first electronic device detecting the position of the first finger, display a first display element corresponding to the position of the first finger, the first display element being located at the first edge of the display area of the second electronic device. In response to the first electronic device detecting the position of the second finger, display a second display element corresponding to the position of the second finger, the second display element being located at the second edge of the display area of the second electronic device; wherein, the first edge and the second edge of the display area are opposite edges of the display area.

[0039] According to a third aspect, a first electronic device is configured to: obtain the positions of a third finger and a fourth finger of a user, where the position of the third finger is at a first height from the first electronic device, and the position of the fourth finger is at a second height from the first electronic device. A second electronic device is configured to: when the position of the third finger is at the first height from the first electronic device, present a third display element with a first display effect. When the position of the fourth finger is at the second height from the first electronic device, present a fourth display element with a second display effect, where the first display effect is different from the second display effect.

[0040] According to the third aspect, or any one of the implementation manners of the first aspect above, a first electronic device is configured to: in response to a user's finger moving from a first finger position to a fifth finger position, obtain the position of the fifth finger. In response to the user's finger moving from a second finger position to a sixth finger position, obtain the position of the sixth finger; where the first projected distance on the first electronic device between the first finger position and the fifth finger position is equal to the second projected distance on the first electronic device between the second finger position and the sixth finger position. A second electronic device is configured to: in response to the first electronic device detecting the position of the fifth finger, display a fifth display element corresponding to the position of the fifth finger. In response to the first electronic device detecting the position of the sixth finger, display a sixth display element corresponding to the position of the sixth finger; where the first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

[0041] According to the third aspect, or any one of the implementation manners of the first aspect above, a first electronic device is configured to: obtain the position of a seventh finger of a user. A second electronic device is configured to: in response to the first electronic device detecting the position of the seventh finger, display a seventh display element corresponding to the position of the seventh finger, and change the display effect of an eighth display element whose original display position is on the seventh display element.

[0042] According to the third aspect, or any one of the implementation manners of the first aspect above, the display effect of the changed eighth display element matches the seventh display element.

[0043] According to a third aspect, or any implementation of the first aspect above, the detection area of the first electronic device further includes a second area, which is a partial area in the detection area of the first electronic device, and the second area is used to detect the position of the user's finger; the first finger position and the second finger position are the positions of the user's right hand fingers. The first electronic device is configured to: obtain the eighth finger position when the user holds the first electronic device, and the eighth finger position is at the first edge of the second area of the first electronic device. Obtain the ninth finger position when the user holds the first electronic device, and the ninth finger position is at the second edge of the second area of the first electronic device; wherein, the first edge and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the eighth finger position and the ninth finger position are the positions of the user's left hand fingers, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area. The second electronic device is configured to: in response to the first electronic device detecting the eighth finger position, display a ninth display element corresponding to the eighth finger position, and the ninth display element is located at the second edge of the display area of the second electronic device. In response to the first electronic device detecting the ninth finger position, display a tenth display element corresponding to the ninth finger position, and the tenth display element is located at the first edge of the display area of the second electronic device.

[0044] According to a third aspect, or any implementation of the first aspect above, the first electronic device is configured to: obtain the tenth finger position of the user. Send a plurality of first signals to the tenth finger position through a signal emission array, and the plurality of first signals reach the tenth finger position at the same or similar time.

[0045] According to a third aspect, or any implementation of the first aspect above, the first electronic device is configured to: obtain the eleventh finger position of the user; wherein, the tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device. Send a plurality of second signals to the eleventh finger position through a signal emission array, the plurality of second signals reach the eleventh finger position at the same or similar time, and the signal strength of the plurality of first signals is different from the signal strength of the plurality of second signals.

[0046] According to a third aspect, or any implementation of the first aspect above, the first electronic device is configured to: obtain the twelfth finger position of the user, and the twelfth finger position is at a fifth height from the first electronic device. The second electronic device is configured to: in response to the first electronic device detecting the twelfth finger position, display an eleventh display element corresponding to the twelfth finger position, and the eleventh display element is displayed above the twelfth display element displayed on the second electronic device. When the fifth height is 0, trigger the execution of a response event corresponding to the twelfth display element.

[0047] According to a third aspect, or any implementation of the above third aspect, the user finger position includes the position of the user finger relative to the first electronic device generated by performing a hovering action or a touching action on the first electronic device.

[0048] A fourth aspect provides a touch control method applied to a first electronic device. The method includes: detecting a first finger position corresponding to a user finger; and sending the first finger position to a second electronic device, where the first finger position is used for the second electronic device to display a first display element corresponding to the first display effect of the first finger position.

[0049] In some examples, when the user finger is within the detection area of the first electronic device, the first electronic device can detect the first finger position corresponding to the user finger.

[0050] In this way, by the first electronic device detecting the user finger position and displaying a display element corresponding to the user finger position on the second electronic device. In this way, through the display and display change of the display element, the user does not have to switch the line of sight back and forth between the first electronic device and the second electronic device, but only needs to keep the line of sight on the second electronic device to achieve touch control operations. Thus, in scenarios such as games that require timely and coherent interactive feedback, the user can also control a second electronic device at a distance through the first electronic device. In this way, while meeting the user's large display experience, the demand for the user's long-distance operation is satisfied.

[0051] According to the fourth aspect, a first signal is sent to the spatial position indicated by the first finger position through a signal emission array.

[0052] According to the fourth aspect, or any implementation of the above fourth aspect, the times when multiple first signals sent by multiple signal emission arrays reach the spatial position indicated by the first finger position are the same or close.

[0053] In this way, the first electronic device can provide tactile feedback to the user, thus enriching the user experience more.

[0054] According to the fourth aspect, or any implementation of the above fourth aspect, a second finger position corresponding to the user finger is detected; and the second finger position is sent to the second electronic device, where the second finger position is used for the second electronic device to display a second display element corresponding to the second display effect of the second finger position.

[0055] According to the fourth aspect, or any implementation of the above fourth aspect, the first display effect of the first display element corresponds to a first height indicated by the first finger position, the second display effect of the second display element corresponds to a second height indicated by the second finger position, the first height is different from the second height, and the first display effect is different from the second display effect.

[0056] In this way, based on different finger position heights, the second electronic device can present display elements with different display effects, helping the user understand the height of the current finger position from the first electronic device. Thus, the user can control the display of the second electronic device without switching the line of sight to the first electronic device.

[0057] In some examples, the user can use the first electronic device to perform single-finger or multi-finger operations on the second electronic device. The second electronic device can display one display element corresponding to a single finger, or one or more display elements corresponding to multiple fingers, thus meeting various usage requirements of the user.

[0058] In some examples, multiple fingers can be different fingers of the same user, or can also be fingers of different users. In some examples, the user can hold or not hold the first electronic device. When the user holds the first electronic device with one hand, the first display element shown corresponds to the thumb of the hand holding the device, and the second display element that can be shown simultaneously corresponds to another finger of the non-holding hand. Or, when the user holds the first electronic device with both hands, the first display element and the second display element that can be shown simultaneously correspond to the left thumb and the right thumb of the user respectively.

[0059] According to the fourth aspect, or any implementation manner of the above fourth aspect, the first display effect of the first display element matches the second display effect of the second display element.

[0060] For example, when the user performs a two-finger pinching operation in the detection space of the first electronic device, the second electronic device can display the first display element and the second display element corresponding to the two fingers respectively, and the first display effect and the second display effect match to present different pinching degrees.

[0061] In this way, through the matching of the display effects of the display elements, a better operation experience is brought to the user.

[0062] According to a fourth aspect, or any implementation manner of the above fourth aspect, when a user holds a first electronic device, the detection area of the first electronic device includes a right - hand detectable area and / or a left - hand detectable area. Optionally, the right - hand detectable area and the left - hand detectable area may not overlap and are combined to form the detection area of the first electronic device, or the right - hand detectable area and the left - hand detectable area may partially overlap. When the user's right - hand finger is located at the right edge of the right - hand detectable area, the second electronic device displays a cursor at the right edge of the display area. When the user's right - hand finger is located at the left edge of the right - hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left - hand finger is located at the left edge of the left - hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left - hand finger is located at the right edge of the left - hand detectable area, the second electronic device displays a cursor at the right edge of the display area.

[0063] In this way, by configuring the right - hand detectable area and / or the left - hand detectable area, and both the right - hand detectable area and the left - hand detectable area can be mapped to the entire display area of the display device, the operation requirements of the user's two - hand holding are met, and the difficulty of single - hand operation for the user during this process is reduced. Thus, it is avoided that the user's fingers cannot reach some areas, which affects the user's operation.

[0064] According to a fourth aspect, or any implementation manner of the above fourth aspect, when a user holds a first electronic device, in the right - hand detectable area and the left - hand detectable area, the user's finger moves a first projection distance at a position close to the finger root, and the user's finger moves a second projection distance at a position far from the finger root. When the first projection distance is equal to the second projection distance, the moving distance corresponding to the first projection distance of the display element displayed on the display area of the second electronic device is less than the moving distance corresponding to the second projection distance.

[0065] In this way, it is ensured that when the user's finger is at the proximal or distal end, a relatively sensitive interaction experience can be obtained. In this way, even when the size of the first electronic device is relatively large for the user, the problem that the user's finger span is too large during the touch operation can be avoided, thereby improving the user's experience.

[0066] A fifth aspect provides a touch method applied to a second electronic device. The method includes: receiving a first finger position sent by a first electronic device; presenting a first display element, and a first display effect of the first display element on the second electronic device is used to indicate the first finger position.

[0067] In some examples, the second electronic device receives a second finger position sent by the first electronic device; presenting a second display element, and a second display effect of the second display element on the second electronic device is used to indicate the second finger position.

[0068] In some examples, a first display effect of a first display element corresponds to a first height indicated by a first finger position, a second display effect of a second display element corresponds to a second height indicated by a second finger position, the first height is different from the second height, and the first display effect is different from the second display effect.

[0069] According to a fifth aspect, presenting the second display element includes: presenting the second display element during the process of presenting the first display element, or presenting the second display element after presenting the first display element.

[0070] According to the fifth aspect, or any implementation manner of the fifth aspect, the first display effect of the first display element matches the second display effect of the second display element.

[0071] According to the fifth aspect, or any implementation of the fifth aspect above, the first horizontal and vertical coordinates indicated by the first finger position are within the area of ​​the third display element displayed by the second electronic device, and the method also includes: changing the third display effect of the third display element, and the third display effect of the changed third display element matches the first display effect of the first display element.

[0072] For example, when the second electronic device is displaying the desktop, it receives the first finger position and determines that the position to be displayed of the first finger position is located on the upper layer of an application icon on the desktop. Then, the second electronic device can display the first display element corresponding to the first finger position on the upper layer and display the enlarged application icon on the lower layer, thereby prompting the user that the current finger position can operate the application icon.

[0073] In this way, by coordinating the original display element with the display element corresponding to the finger position, the user's operation difficulty is further reduced and the interest of the operation is increased.

[0074] According to the fifth aspect, or any implementation of the fifth aspect above, presenting a first display element includes: determining a display position of the first display element in proportion to a ratio between a first size of a display screen of a second electronic device and a second size of a detection area of ​​a first electronic device, and displaying the first display element at the display position.

[0075] In this way, the second electronic device provides the user with more realistic display feedback by displaying the display element corresponding to the finger position at a fixed ratio. For example, in a drawing scene, as the user's finger moves in the space above the first electronic device, the cursor (or displayed as a brush, etc.) can move proportionally on the display screen of the second electronic device.

[0076] According to the fifth aspect, or any implementation manner of the above fifth aspect, when the user holds the first electronic device, the detection area of the first electronic device includes a right - hand detectable area and / or a left - hand detectable area. Optionally, the right - hand detectable area and the left - hand detectable area may not overlap and combine to form the detection area of the first electronic device, or the right - hand detectable area and the left - hand detectable area may partially overlap. When the user's right - hand finger is at the right edge of the right - hand detectable area, the second electronic device displays a cursor at the right edge of the display area. When the user's right - hand finger is at the left edge of the right - hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left - hand finger is at the left edge of the left - hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the user's left - hand finger is at the right edge of the left - hand detectable area, the second electronic device displays a cursor at the right edge of the display area.

[0077] According to the fifth aspect, or any implementation manner of the above fifth aspect, when the user holds the first electronic device, in the right - hand detectable area and the left - hand detectable area, at the position close to the finger root, the user's finger moves a first projection distance, and at the position far from the finger root, the user's finger moves a second projection distance. When the first projection distance is equal to the second projection distance, the movement distance of the display element displayed on the display area of the second electronic device corresponding to the first projection distance is less than the movement distance corresponding to the second projection distance.

[0078] According to the fifth aspect, or any implementation manner of the above fifth aspect, when the height indicated by the first finger position is 0, the method further includes: executing a response event corresponding to the first finger position.

[0079] In a sixth aspect, an electronic device is provided, which has a function of implementing the touch control method described in the first aspect and any possible implementation manner thereof above. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above - mentioned functions.

[0080] In a seventh aspect, a computer - readable storage medium is provided. The computer - readable storage medium stores a computer program (which can also be referred to as an instruction or code), and when the computer program is executed by an electronic device, the electronic device is caused to execute the method of the first aspect or any implementation manner of the first aspect.

[0081] In an eighth aspect, a computer program product is provided. When the computer program product runs on an electronic device, the electronic device is caused to execute the method of the first aspect or any implementation manner of the first aspect.

[0082] In a ninth aspect, a circuit system is provided. The circuit system includes a processing circuit configured to execute the method of the first aspect or any one of the implementation manners of the first aspect.

[0083] In a tenth aspect, a chip system is provided, including at least one processor and at least one interface circuit. The at least one interface circuit is configured to perform a transceiver function and send instructions to the at least one processor. When the at least one processor executes the instructions, the at least one processor executes the method of the first aspect or any one of the implementation manners of the first aspect.

[0084] The technical effects of the foregoing aspects may be referred to each other, and will not be elaborated herein. Description of the Drawings

[0085] Figure 1 Schematic diagram of the working principle of the mouse provided by the embodiment of the present application;

[0086] Figure 2 Schematic diagram of the control scenario of the long-distance display device provided by the embodiment of the present application;

[0087] Figure 3 Schematic diagram of the communication system to which the touch method provided by the embodiment of the present application is applied;

[0088] Figure 4 Schematic diagram of the hardware structure of the first electronic device provided by the embodiment of the present application;

[0089] Figure 5 Schematic diagram of module interaction provided by the embodiment of the present application;

[0090] Figure 6 Schematic diagram of the touch scenario provided by the embodiment of the present application Figure 1 ;

[0091] Figure 7 Schematic diagram of the touch scenario provided by the embodiment of the present application Figure 2 ;

[0092] Figure 8 Schematic diagram of the touch scenario provided by the embodiment of the present application Figure 3 ;

[0093] Figure 9 Schematic diagram of the touch scenario provided by the embodiment of the present application Figure 4 ;

[0094] Figure 10 Schematic diagram of the touch scenario provided by the embodiment of the present application Figure 5 ;

[0095] Figure 11 Schematic diagram of the touch scenario provided by the embodiment of the present application Figure 6 ;

[0096] Figure 12 Schematic diagram of a touch control scenario provided by an embodiment of the present application Figure 7 ;

[0097] Figure 13 Schematic diagram of the principle for detecting the holding state provided by an embodiment of the present application;

[0098] Figure 14 Schematic diagram of a touch control scenario provided by an embodiment of the present application Figure 8 ;

[0099] Figure 15 Schematic diagram of a touch control scenario provided by an embodiment of the present application Figure 9 ;

[0100] Figure 16 Schematic diagram of a touch control scenario provided by an embodiment of the present application Figure 10 ;

[0101] Figure 17 Schematic diagram of a touch control scenario provided by an embodiment of the present application Figure 10 One;

[0102] Figure 18 Schematic diagram of the working principle of the suspension detection module provided by an embodiment of the present application;

[0103] Figure 19 Schematic diagram of a touch control scenario provided by an embodiment of the present application Figure 10 Two;

[0104] Figure 20 Schematic diagram of a touch control scenario provided by an embodiment of the present application Figure 10 Three;

[0105] Figure 21 Schematic diagram of a touch control scenario provided by an embodiment of the present application Figure 10 Four;

[0106] Figure 22 Schematic diagram of a touch control scenario provided by an embodiment of the present application Figure 10 Five;

[0107] Figure 23 Schematic diagram of the working principle of the haptic feedback module provided by an embodiment of the present application;

[0108] Figure 24 Schematic diagram of the usage mode switching scenario provided by an embodiment of the present application;

[0109] Figure 25 Schematic diagram of the touch control method flow provided by an embodiment of the present application;

[0110] Figure 26 Schematic diagram of the structure of the first electronic device provided by an embodiment of the present application;

[0111] Figure 27 This is a schematic structural diagram of the second electronic device provided by the embodiments of the present application. Detailed implementation manners

[0112] Next, in combination with the accompanying drawings in the embodiments of the present application, the technical solutions in the embodiments of the present application will be described. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to limit the present application. As used in the specification and appended claims of the present application, the singular forms "a", "an", "the", "above-mentioned", "said", and "this" are intended to include expressions such as "one or more", unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of the present application, "at least one" and "one or more" mean one or more than two (including two).

[0113] Reference to "one embodiment" or "some embodiments" etc. described in this specification means that a specific feature, structure, or characteristic described in combination with that embodiment is included in one or more embodiments of the present application. Thus, statements such as "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments" etc. that appear in different places in this specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "include", "comprise", "have" and their variants all mean "including but not limited to", unless otherwise specifically emphasized in other ways. The term "connection" includes direct connection and indirect connection, unless otherwise stated. "First" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of the indicated technical features.

[0114] In the embodiments of the present application, words such as "exemplarily" or "for example" are used to represent examples, illustrations, or explanations. Any embodiment or design solution described as "exemplarily" or "for example" in the embodiments of the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplarily" or "for example" is intended to present relevant concepts in a specific manner.

[0115] In some embodiments, electronic devices such as mobile phones, TVs, in-vehicle displays, projectors, etc. can achieve touch interaction. Among them, touch scenarios include hand-eye synchronous scenarios and hand-eye separated scenarios. For example, in a hand-eye synchronous scenario, the display device and the touch device are the same device. For example, a mobile phone displays an application interface and executes corresponding tasks in response to a user's touch operation on the application interface. Also, for example, in a hand-eye separated scenario, the display device and the touch device are different devices. Optionally, the touch device is, for example, a keyboard and mouse, an air mouse remote control, a touch screen device, etc., thus facilitating the user's control of a remote display device.

[0116] Exemplarily, a display device (such as a computer) is configured with a mouse as shown in Figure 1 . In this way, the user can operate the display content of the display device through the mouse. Among them, the mouse irradiates an external perceived plane through a light-emitting diode (LED), and picks up the external perceived plane through an image sensor. After that, the mouse compares the relative displacement between two frames of images through the image sensor to determine the moving direction and distance of the mouse. Then, the mouse sends the determined displacement direction and distance to the display device, and the display device moves the cursor to execute corresponding response events according to the displacement direction and distance.

[0117] It can be seen that the mouse must be located on a stable perceived plane to achieve the control of the display device, and the usage environment is limited. Also, in the case of simultaneous operation, one mouse corresponds to one operation focus (such as the displayed cursor) on the display device. If multi-finger touch is required, the display device needs to be configured with multiple mice, and it is difficult for the user to operate multiple mice simultaneously.

[0118] Also exemplarily, as shown in Figure 2 , the display device projects the displayed application interface onto the touch device for synchronous display. Then, the user can perform touch operations according to the display content on the touch device, and the touch device sends the touch data generated by the detected touch operations to the display device, and the display device displays corresponding content according to the touch data. In this way, the user can achieve reverse control of the display device through touch operations on the touch device.

[0119] It can be seen that compared with the hand-eye synchronous scenario, the hand-eye separated scenario can meet the user's need for remote control of the display device. However, in the above hand-eye separated scenario, when the user operates the display content, the user needs to switch the line of sight from the display device to the touch device, and then switch the line of sight from the touch device to the display device after the operation is completed. Then, during the entire touch process, the user needs to frequently switch the line of sight between the display device and the touch device, and continuous manipulation cannot be achieved, which affects the interaction efficiency. Also, multiple data transmissions of display data and touch data are required between the touch device and the display device, increasing the touch latency.

[0120] In some scenarios, the display device can obtain the actual size of the touch device and determine the proportionality coefficient according to the size of its own display area. The touch device is configured with a floating screen, which can be used to detect the floating information of the user's finger corresponding to the floating screen. The floating information includes the coordinates of the finger on the floating screen and the distance from the floating screen. After that, the touch device can send the floating information to the display device, and the display device displays an indication icon according to the floating information to facilitate the user to locate the finger operation position.

[0121] In the above touch scenario, the user can determine the finger movement position according to the indication icon, reducing the line of sight switching. However, since the display device displays the indication icon according to the proportionality coefficient between the actual size of the touch device and the size of its own display screen, that is, the display of the indication icon is determined proportionally and then displayed on the display screen of the display device. In some scenarios, the user is used to holding the touch device to perform operations such as playing games. At this time, due to the limited finger movement distance, it is difficult for the user to move the finger to the vicinity of the opposite edge position of the touch device for operation, resulting in some parts of the display content of the display device being difficult for the user to operate. In addition, if the display device has a large size, such as a large screen device, the operation difficulty for the user will be further increased, affecting the user experience.

[0122] Therefore, on the one hand, the embodiment of the present application provides a method for using finger floating control to display elements on a display screen, and on this basis, further provides a touch method. The detection area of the touch device is designed to include a first area, which is a partial area in the detection area. Through further scheme design, when the user's finger position is at the edges of the first area, the display device can also correspondingly display corresponding display elements at the edges of its own display area. In this way, when the user holds the touch device, the first area with a reduced operation range can also be used to meet the user's one-handed operation needs and improve the user experience. Further, through the display of the display elements, the user can correctly perform the reverse control operation without switching the line of sight, improving the interaction efficiency.

[0123] Figure 3 It is a schematic diagram of a communication system to which the touch method provided by the embodiment of the present application is applied. As Figure 3 shown, the communication system includes a first electronic device 100 and a second electronic device 200.

[0124] Optionally, the first electronic device 100 can be, for example, a dedicated touch device, or can also be a device with touch function. For example, the first electronic device 100 is a touch device specially configured for the second electronic device 200. Or, the first electronic device 100 can also be a terminal device such as a mobile phone, a tablet computer, a wearable device, an AI device, etc. The operating system installed on the first electronic device 100 includes but is not limited to Or other operating systems. The first electronic device 100 may also not be installed with an operating system. This application does not limit the specific type of the first electronic device 100, whether it is installed with an operating system, and the installed operating system.

[0125] Optionally, the second electronic device 200 may be, for example, a television, a vehicle-mounted screen, a projector, a computer, a tablet computer, a laptop computer, a mobile phone, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a wearable device, an artificial intelligence (AI) device, etc. The operating system installed on the second electronic device 200 includes but is not limited to Or other operating systems. This application does not limit the specific type of the second electronic device 200 and the installed operating system.

[0126] In some embodiments, a wireless communication connection is established between the first electronic device 100 and the second electronic device 200. Among them, the wireless communication technologies for establishing the wireless communication connection include but are not limited to at least one of the following: wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT) (for example, traditional Bluetooth or Bluetooth low energy (BLE)), near field communication (NFC), Zigbee, frequency modulation (FM), infrared (IR), ultra wide band (UWB), StarFlash, etc.

[0127] Optionally, the first electronic device 100 and the second electronic device 200 may also establish a communication connection through a third-party device in a local area network. The third-party device is, for example, a router, a gateway, a server, etc.

[0128] In other embodiments, a wired communication connection is established between the first electronic device 100 and the second electronic device 200. Among them, the way to establish the wired communication connection is, for example, to establish a wired communication connection through a universal serial bus (USB) interface cable.

[0129] Optionally, Figure 4This is a schematic diagram of the hardware structure of the first electronic device 100 provided by the embodiments of the present application. As Figure 4 shown, the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, a wireless communication module 150, an audio module 160, a suspension detection module 170, a touch detection module 171, buttons 180, and a motor 190, etc.

[0130] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0131] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0132] The controller may generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0133] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0134] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0135] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be respectively coupled to a touch sensor, a charger, a flash, a camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor through the I2C interface, enabling the processor 110 to communicate with the touch sensor through the I2C bus interface to implement the touch function of the first electronic device 100.

[0136] The USB interface 130 is an interface that conforms to the USB standard specification, specifically, it may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the first electronic device 100, and can also be used for data transmission between the first electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other terminal devices, such as AR devices, etc.

[0137] In some embodiments, the first electronic device establishes a wired communication connection with the second electronic device 200 through the USB interface 130. Subsequently, after detecting the position of the user's finger, the first electronic device 100 sends the position of the user's finger to the second electronic device 200 through this wired communication connection.

[0138] It can be understood that the interface connection relationships between the modules illustrated in the embodiments of the present application are only illustrative descriptions and do not constitute a structural limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0139] The wireless communication function of the first electronic device 100 can be implemented through an antenna, a wireless communication module 150, a modulation and demodulation processor, a baseband processor, and the like.

[0140] The antenna is used to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example: The antenna can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0141] The wireless communication module 150 can provide solutions for wireless communications applied to the first electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), infrared technology (IR), and the like. The wireless communication module 150 can be one or more devices integrating at least one communication processing module. The wireless communication module 150 receives electromagnetic waves via the antenna, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 150 can also receive the signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna for radiation.

[0142] In some embodiments, the first electronic device 100 may communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), Beidou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).

[0143] In some embodiments, the suspension detection module 170 and the touch detection module 171 are used to detect the finger position of a user's finger in the detection area of the first electronic device 100. Optionally, the detection area is a preset space range located above the cover plate of the first electronic device 100. Wherein, the first electronic device 100 is a movable device or an immovable device. Above the cover plate of the first electronic device 100 is used to indicate the orientation corresponding to the cover plate of the first electronic device 100. In some examples, the orientation corresponding to the cover plate of the first electronic device 100 is not necessarily the upper side in the physical sense (such as the sky direction), that is, in the embodiments of the present application, the upper space of the cover plate of the first electronic device 100 is the upper space relative to the orientation where the detection area is located. For example, when the user holds the first electronic device 100 and the first electronic device 100 is tilted towards the user for easy operation by the user, then the upper side of the detection area of the first electronic device 100 may also be the preset space range tilted towards the user indicated by the detection area.

[0144] In some examples, the suspension detection module 170 is used to detect the suspension data of the user's finger, and the touch detection module 171 is used to detect the touch data of the user's finger. Optionally, the suspension data and the touch data are, for example, the three-dimensional coordinates of the user's finger in the detection area. Among them, the z in the three-dimensional coordinates corresponding to the touch data is 0, that is, when the user's finger touches the cover plate of the first electronic device 100, the height of the finger position relative to the cover plate of the first electronic device 100 is 0. In some examples, the suspension detection module 170 and the touch detection module 171 can be two independent modules or can be combined into one module. Among them, for other content about the suspension detection module 170 and the touch detection module 171, see the relevant description below.

[0145] In some examples, the first electronic device 100 establishes a wireless communication connection with the second electronic device 200 through the wireless communication module 150. After obtaining the finger position of the user's finger, the first electronic device 100 sends the finger position to the second electronic device 200 through the wireless communication module 150, so that the second electronic device 200 can display corresponding display elements (such as a cursor) at the corresponding position on the display screen based on the finger position.

[0146] In some embodiments, the first electronic device 100 is configured with a cover plate. Optionally, the cover plate is located above the suspension detection module 170 and the touch detection module 171. In some examples, the cover plate is a part of the housing of the first electronic device 100. In some examples, the cover plate can also be used to display images, videos, etc. The cover plate includes a display panel. The display panel can be a liquid crystal display (LCD), for example, an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini-led, a Micro-led, a Micro-oled, a quantum dot light-emitting diode (QLED), etc.

[0147] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the first electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to achieve the data storage function. For example, files such as music and videos are saved in the external memory card.

[0148] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system, application programs required for at least one function (such as a sound playback function, an image playback function, etc.). The data storage area can store data created during the use of the first electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 can include high-speed random access memory and can also include non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the first electronic device 100 by running the instructions stored in the internal memory 121 and / or the instructions stored in the memory provided in the processor.

[0149] The charging management module 140 is used to receive a charging input from a charger. Among them, the charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive the charging input of the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive the wireless charging input through the wireless charging coil of the second electronic device 200. While charging the battery 142, the charging management module 140 can also supply power to the electronic device through the power management module 141.

[0150] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives the input from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the suspension detection module 170, the touch detection module 171, the wireless communication module 150, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be provided in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.

[0151] The audio module 160 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 160 can also be used to encode and decode audio signals. In some embodiments, the audio module 160 can be disposed in the processor 110, or some functional modules of the audio module 160 can be disposed in the processor 110. The first electronic device 100 can perform functions such as music playback and recording through the audio module 160. The audio module 160 can include a speaker, a receiver, a microphone, a headphone jack, and an application processor to implement audio functions.

[0152] The keys 180 include a square control key, a power-on key, volume keys, etc. The keys 180 can be mechanical keys or touch keys. The first electronic device 100 can receive key inputs and generate key signal inputs related to the user settings and function controls of the first electronic device 100.

[0153] In some examples, the first electronic device 100 is configured with an image acquisition module, which can be used to acquire user images, and the user images can be used to determine the user's identity, for example; it can also be used to acquire user finger images, and the user finger images can be used to determine the position of the user's finger, the way of holding the device, etc.

[0154] Optionally, the second electronic device 200 has a hardware structure that is the same as, similar to, or has certain differences from Figure 4 that shown. For example, in addition to Figure 4 the hardware shown, the second electronic device 200 can further include hardware such as a display screen, a camera, and a sensor module.

[0155] In some examples, the display screen can be used to display images, videos, etc. The display screen includes a display panel. The display panel can be manufactured using LCD, such as using OLED, active matrix organic light-emitting diode or AMOLED, FLED, Mini-led, Micro-led, Micro-oled, QLED, etc.

[0156] In some examples, the second electronic device 200 establishes a wireless communication connection with the first electronic device 100 through a wireless communication module. After the wireless communication module of the second electronic device 200 receives the user finger position sent by the first electronic device 100, it sends the finger position to the processor. The processor determines the display position and display effect of the display element (such as a cursor) corresponding to the finger position based on the user finger position. Then, the second electronic device 200 can display the display element corresponding to the user finger position at the determined display position according to the determined display effect.

[0157] In some examples, the second electronic device 200 does not include such as Figure 4The suspended detection module 170 and the touch detection module 171 shown. That is, the first electronic device 100 detects the position of the user's finger through the suspended detection module 170 or the touch detection module 171. The second electronic device 200 does not need to detect the position of the user's finger, but can directly receive the position of the user's finger sent by the first electronic device 100.

[0158] In some examples, the display screen can be a touch screen or a non-touch screen.

[0159] The camera is used to capture still images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB or YUV. In some embodiments, the second electronic device 200 may include one or N cameras, where N is a positive integer greater than 1.

[0160] The sensor module may include a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0161] Hereinafter, taking the first electronic device 100 as a touch control device and the second electronic device 200 as a display device as an example, the touch control method provided by the embodiments of the present application will be introduced in detail.

[0162] In some embodiments, a communication connection is established between the display device and the touch control device. Among them, the communication connection is a wired connection or a wireless connection. For example, a wired connection is established between the display device and the touch control device through a USB interface, or a Bluetooth communication connection is established through wireless Bluetooth communication technology.

[0163] In some examples, the display device and the touch control device are supporting devices, that is, one display device is configured with at least one dedicated touch control device. Or, the touch control device can establish a communication connection with different display devices in response to user operations, which is convenient for users to carry the touch control device to operate different display devices.

[0164] Exemplarily, such as Figure 5As shown, a communication connection is established between the peripheral interface 521 of the display device 52 and the peripheral interface 511 of the touch device 51 to meet the communication requirements between the display device 52 and the touch device 51. After that, after the processing module 512 of the touch device 51 obtains user data, the user data can be sent to the display device 52 through the peripheral interface 511. Correspondingly, the display device 52 receives the user data sent by the touch device 51 through the peripheral interface 521, and processes the user data through the processing module 522 to display relevant content through the display module 523. Optionally, the user data is, for example, the position of the user's finger detected by the touch device 51 through the suspension detection module 514 or the touch detection module 515, such as the three-dimensional coordinates of the user's finger relative to the touch device 51. According to the position of the user's finger, the display device 52 can display a corresponding cursor to help the user determine the position of the current operation. In this way, the user can always watch the display device 52 without having to switch the line of sight and can also complete the touch operation, thereby improving the coherence of the touch operation.

[0165] It should be understood that Figure 5 the schematic structure does not constitute a specific limitation on the touch device 51. In other embodiments of the present application, the touch device 51 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The illustrated components can be implemented in hardware, software, or a combination of software and hardware. For example, the touch device 51 may further include a power management module 513 for powering other modules. Similarly, Figure 5 the schematic structure does not constitute a specific limitation on the display device 52. For example, the display device 52 may further include a power management module 524 for powering other modules.

[0166] In some embodiments, the touch device can be used to detect the position of the user's finger within the detection area of the touch device, such as the three-dimensional coordinates corresponding to the center position of the user's finger, to meet the user's need to control the display content of the display device by touch. Optionally, the position of the user's finger includes the position of the user's finger relative to the touch device generated by performing a suspension action or a touch action on the touch device.

[0167] In some examples, the user controls the cursor displayed on the display device by moving the finger in the space above the touch device. Among them, during the movement process in which the user's finger is in a suspended state above the touch device or touches the touch device, etc., the touch device detects the change in the three-dimensional coordinates of the user's finger in the space above the touch device and realizes the display of a moving cursor corresponding to the three-dimensional coordinates on the display device. In this way, the user does not have to switch the line of sight to the touch device and can also know the change in the movement state of the current finger, such as the moving direction, position, height, etc.

[0168] Optionally, the display device displays a display element corresponding to the position of the user's finger. The display element can be the above-mentioned cursor, or can be in various forms such as a game controller, the outline of the user's finger, a virtual character, etc. Hereinafter, taking the cursor as an example, the display element displayed by the display device will be illustrated by examples.

[0169] Exemplarily, as Figure 6 shown, the touch device detects the user's finger above the cover plate (which can also be described as a touch screen, a touch panel, a touch area, etc.) and determines the three-dimensional coordinates (x, y, z) corresponding to the user's finger. Then, the touch device sends the three-dimensional coordinates (x, y, z) to the display device. Correspondingly, the display device receives the three-dimensional coordinates (x, y, z) and, based on the three-dimensional coordinates (x, y, z), displays a cursor 61 at the corresponding position on the display screen. For example, if the user's finger is at the center position near the left edge above the cover plate of the touch device, then the display device can also display the cursor 61 at the position near the center of the left edge of its display screen, so as to help the user understand the current finger operation position and facilitate the user to continue moving the finger to control the change of the display content of the display device later.

[0170] Among them, the "up", "down", "left" and "right" described in subsequent embodiments all refer to Figure 6 the orientation shown, and this will not be elaborated hereinafter.

[0171] In some embodiments, the detection area of the touch device includes a touch area on the cover plate, and this touch area is used to detect the touch operation of the user on the cover plate of the touch device. That is, the detection area of the touch device includes the space within a preset height range above the touch area and the touch area. The display device can obtain the size information of the touch area of the touch device (such as the entire cover plate or a partial area in the cover plate), such as length, width, etc. In this way, the display device can determine the size ratio coefficient between the touch area of the touch device and the display area of the display screen of the display device. For example, as Figure 6 shown, the length ratio is a and the width ratio is b. Then subsequently, after the display device obtains the three-dimensional coordinates sent by the touch device, it can, according to the determined ratio coefficients, including the length ratio a and the width ratio b, adapt the three-dimensional coordinates to the current display area. In this way, the display device can display a cursor that moves with the finger position, thereby avoiding the situation where the movement of the user's finger position does not correspond to the display position of the cursor, which may cause misunderstanding to the user. And by constructing the ratio coefficient, it is not necessary to require the touch area of the touch device and the display area of the display device to have the same size, which can reduce the user operation difficulty through small-screen operation while meeting the user's demand for large-screen display.

[0172] For example, as Figure 6As shown, the user's finger is within the detection area of the touch device. The touch device can obtain the position of the user's finger and send the three-dimensional coordinates corresponding to the position of the user's finger to the display device. Correspondingly, after receiving the three-dimensional coordinates (x, y, z), the display device obtains the coordinates (x*a, y*b) according to the x and y indicated in the three-dimensional coordinates, as well as the ratios a and b, and displays the cursor 61 at the position of the coordinates (x*a, y*b).

[0173] In some embodiments, the touch device is a fixed device or a handheld mobile device. In some examples, during the process of the user holding the touch device, the user may use the hand in the holding state to perform touch operations. Then, when the touch device determines that the user's hand is in the holding state, it can instruct the display device to display the cursor corresponding to the position of the user's finger based on this holding state. Optionally, the user can hold the touch device with one hand or both hands.

[0174] Exemplarily, as Figure 7 shown, the user holds the touch device 100 with both hands to operate the game application displayed on the display device 200. Optionally, the touch device 100 can synchronously display the game application or not display it. Optionally, as Figure 16 shown, when the user's two hands are in the holding state, the display device 200 displays the cursors corresponding to the two thumbs of the left and right hands. In this way, the user can determine the changes in the two-handed touch situation during the game process according to the movement of the cursors. Optionally, the display device 200 can display the outlines of the user's two thumbs and the cursors in the finger center areas; or the display device 200 can also separately display the cursors in the finger center areas without displaying the outlines of the two thumbs.

[0175] In this way, through the display and display changes of the cursors, the user does not need to switch the line of sight back and forth between the display device and the touch device, but only needs to keep the line of sight on the display device to achieve touch operations. Thus, in scenarios such as games that require timely and coherent interactive feedback, the user can also control the remote display device through the touch device. In this way, while meeting the user's large display experience, the demand for the user's remote operation is also met.

[0176] In some examples, during the process of the user holding the touch device to perform touch operations, the flexibility of the operation is limited, such as the reach range of the fingers is reduced. Therefore, the touch device can divide the entire detection area of the touch device and determine the operable detection area according to the reach range of the fingers when the user holds the touch device, so as to facilitate the user to use the touch device to freely control the display device in a larger range in the holding state.

[0177] Exemplarily, as Figure 8As shown in (a), taking the cover plate of the touch device and the display screen of the display device as a rectangle, with the upper and lower sides being the long sides and the left and right sides being the short sides as an example. When the user holds the touch device with one hand using the right hand, the right thumb is located in the detection area of the touch device and can be used to control the movement of the cursor displayed on the display device. Optionally, the detection area of the touch device includes a right-hand detectable area 81, which is a partial area in the detection area of the touch device and is used to detect the position of the user's finger. Moreover, when the user's finger is at any position within the right-hand detectable area 81, the cursor can be displayed at any corresponding position on the display screen. For example, as Figure 8 shown in (a), when the user's finger is at the right edge 811 of the right-hand detectable area 81, the display device can display a cursor corresponding to the user's finger at the corresponding position on the right edge of the entire display area. Another example is, as Figure 8 shown in (b), when the user's finger is at the left edge 812 of the right-hand detectable area 81, the display device can display a cursor corresponding to the user's finger at the corresponding position on the left edge of the entire display area.

[0178] Optionally, the right-hand detectable area 81 includes the touch area within the reach of the right thumb when the user holds the touch device with the right hand and the space above it. For example, the long side of the touch area within the reach of the right thumb is less than the long side of the touch area of the touch device, and / or the short side of the touch area within the reach of the right thumb is less than the short side of the touch area of the touch device. Another example is, as Figure 9 shown in (a), taking the cover plate of the touch device and the display screen of the display device as a rectangle, with the upper and lower sides being the long sides and the left and right sides being the short sides as an example. When the user holds the touch device with one hand using the left hand, the left thumb is located in the detection area of the touch device and can be used to control the movement of the cursor displayed on the display device. Optionally, the detection area of the touch device includes a left-hand detectable area 91, which is a partial area in the detection area of the touch device and is used to detect the position of the user's finger. Moreover, when the user's finger is at any position within the left-hand detectable area 91, the cursor can be displayed at any corresponding position on the display screen. For example, as Figure 9 shown in (a), when the user's finger is at the left edge 911 of the left-hand detectable area 91, the display device can display a cursor corresponding to the user's finger at the corresponding position on the left edge of the entire display area. Another example is, as Figure 9 shown in (b), when the user's finger is at the right edge 912 of the left-hand detectable area 91, the display device can display a cursor corresponding to the user's finger at the corresponding position on the right edge of the entire display area.

[0179] Optionally, the left - hand detectable area 91 includes a touch area corresponding to the reach of the user's left thumb and the space above it when the user holds the touch device with the left hand. For example, the long side of the touch area that matches the reach of the left thumb is less than the long side of the complete touch area of the touch device, and / or the short side of the touch area that matches the reach of the left thumb is less than the short side of the complete touch area of the touch device.

[0180] Exemplarily again, as Figure 10 shown, the detection area of the touch device includes a right - hand detectable area 81 and a left - hand detectable area 91 to meet the dual - hand operation requirements when the user holds the touch device with both hands. Optionally, there may or may not be an overlapping area between the right - hand detectable area 81 and the left - hand detectable area 91. For example, the right - hand detectable area 81 and the left - hand detectable area 91 do not overlap and form the entire detection area, or a partial area of the right - hand detectable area 81 and the left - hand detectable area 91 overlaps.

[0181] In this way, by configuring the right - hand detectable area and / or the left - hand detectable area, and both the right - hand detectable area and the left - hand detectable area can be mapped to the entire display area of the display device, meeting the user's single - hand operation requirements and reducing the difficulty of the user's single - hand operation. Thus, it is avoided that the user's fingers cannot reach some areas, which affects the user's operation.

[0182] Optionally, the size of the right - hand operable touch area or the left - hand operable touch area can be a pre - configured size in the touch device. After the display device establishes a communication connection with the touch device, this size can be obtained. Or, when the touch device (or the display device) detects that the user uses the touch device for the first time, or detects an operation indicating an update of the size of the operable touch area, it can prompt the user to collect the size of the operable touch area of the fingers when the user holds the touch device, in order to obtain a more suitable operable touch area size for the current user, or it can also be automatically determined by the device according to the user's usage habits. Optionally, the area that can be used to detect single - hand operation when the user holds the touch device can be continuous throughout the process of the user using the touch device; or it can be dynamically determined according to the way the user uses the touch device. For example, when it is determined that the user holds the touch device, the size of the operable detection area is dynamically adjusted to a size suitable for single - hand operation when the user holds it.

[0183] In some embodiments, as in the scenario above Figure 6 shown, the display device converts the three - dimensional coordinates corresponding to the position of the user's finger according to the size ratio coefficient between the display area of the display screen and the touch area of the touch device. Then, when the user holds the touch device, the display device can convert the three - dimensional coordinates according to the size ratio coefficient between the display area of the display screen and the operable detection area of the touch device.

[0184] Optionally, the user-held touch device includes a single-handed touch device (such as holding with the left hand or the right hand), or a two-handed touch device. Then, the touch device can determine the left-hand detectable area and / or the right-hand detectable area according to the state of the user holding the touch device.

[0185] Exemplarily, as Figure 11 shown in (a) below, the right-hand detectable area 81 is the area within a certain range from the right edge of the detection area of the touch device to the left. As Figure 12 shown in (a) below, the left-hand detectable area 91 is the area within a certain range from the left edge of the detection area of the touch device to the right.

[0186] Optionally, the left-hand detectable area and / or the right-hand detectable area do not necessarily map to the entire display area of the display device respectively, but rather correspond to the specified parts in the entire display area of the display device respectively.

[0187] In some examples, the display device can convert the obtained three-dimensional coordinates according to the fixed proportional coefficient between its own display area and the operable touch area of the touch device.

[0188] In other examples, during the process of the user holding the touch device for touch operations, when the finger center area is closer to the finger root, the user's operation is more flexible and the operation difficulty is lower; while when the finger center area is farther from the finger root, the user's operation is more difficult and the operation difficulty is higher. Therefore, the display device can set a dynamically changing proportional coefficient, such that when the finger center area is closer to the finger root, the proportional coefficient is smaller, and when the finger center area is farther from the finger root, the proportional coefficient is larger, thereby increasing the touch sensitivity.

[0189] Optionally, when the user holds the touch device, the finger root will also fall into the three-dimensional detection area of the touch device. It should be understood that the three-dimensional detection area is the area above the touch device where the three-dimensional coordinates corresponding to the user's finger can be detected. For example, as Figure 13 shown in (a) below, the three-dimensional coordinates obtained by the touch device have the coordinate distribution characteristic of extending inward from the edge of the detection area. Then, after the display device obtains the three-dimensional coordinates, according to the coordinate distribution characteristics of these three-dimensional coordinates, it determines the three-dimensional coordinates with the holding feature obtained, and further determines that the user's hand is currently in the holding state, and can determine whether the user's hand is in the single-handed holding state (such as detecting a group of three-dimensional coordinates with the holding feature) or the two-handed holding state (such as detecting two groups of three-dimensional coordinates with the holding feature).

[0190] Optionally, after the display device determines the three-dimensional coordinates corresponding to the root of the finger when the user is holding the touch device, it can determine the distribution of the proportionality coefficients within the detectable area according to the extended area of this position, such that the proportionality coefficient is smaller closer to the root of the finger and larger farther away from the root of the finger.

[0191] For example, as Figure 13 shown in (a) below, the detection area of the touch device is rectangular. Taking the intersection of the long side and the short side at the lower right corner of the detection area as the origin of the three-dimensional coordinate system, the long side is in the x-axis direction, and the short side is in the y-axis direction. Then, if the display device determines that the obtained three-dimensional coordinates include three-dimensional coordinates with an x value of 0 or less than a preset threshold 1 and also include three-dimensional coordinates with an x value greater than a preset threshold 2, it can determine that the root of the user's finger has been detected.

[0192] In some examples, as Figure 13 shown in (a) and (b) below, during the process of the user holding the touch device for touch operations, the touch device can detect the three-dimensional coordinates corresponding to the central area of the user's finger. The display device can determine the change in the distance between the central area of the user's finger and the root of the user's finger according to the change in the three-dimensional coordinates, so as to determine the proportionality coefficient required to convert the three-dimensional coordinates corresponding to the central area of the user's finger.

[0193] Exemplarily, as Figure 11 shown in (a) below, when the user holds the touch device with both hands and the central area of the right hand finger is at a certain position on the right edge of the detectable area of the right hand, the touch device sends the detected three-dimensional coordinates (x1, y1, z1) to the display device. The display device obtains the corresponding proportionality coefficients (a1, b1) according to the received three-dimensional coordinates (x1, y1, z1) to determine the converted cursor display position coordinates (x1*a1, y1*b1) and displays the cursor at this coordinate position. After that, as Figure 11 shown in (b) below, when the central area of the user's right hand finger is at a certain position in the upper left corner of the detectable area of the right hand, the touch device sends the detected three-dimensional coordinates (x2, y2, z2) to the display device. The display device obtains the corresponding proportionality coefficients (a2, b2) according to the received three-dimensional coordinates (x2, y2, z2) to determine the converted cursor display position coordinates (x2*a2, y2*b2) and displays the cursor at this coordinate position. Among them, a2 > a1 > a, b2 > b1 > b, where a and b are the proportionality coefficients of the display area of the display device and the detectable area of the right hand of the touch device, or can also be the proportionality coefficients of the display area of the display device and the detection area of the touch device.

[0194] Exemplarily, as Figure 12As shown in (a), when the user holds the touch device with both hands and the center area of the left - hand fingers is at a certain position on the left edge of the left - hand detectable area, the touch device sends the detected three - dimensional coordinates (x3, y3, z3) to the display device. The display device obtains the corresponding scale factors (a3, b3) based on the received three - dimensional coordinates (x3, y3, z3) to determine the converted cursor display position coordinates (x3*a3, y3*b3) and displays the cursor at this coordinate position. After that, as Figure 12 As shown in (b), when the center area of the user's left - hand fingers is at a certain position in the upper - right corner of the left - hand detectable area, the touch device sends the detected three - dimensional coordinates (x4, y4, z4) to the display device. The display device obtains the corresponding scale factors (a4, b4) based on the received three - dimensional coordinates (x4, y4, z4) to determine the converted cursor display position coordinates (x4*a4, y4*b4) and displays the cursor at this coordinate position. Among them, a4 > a3 > a, b4 > b3 > b, where a and b are the scale factors of the display area of the display device and the left - hand detectable area of the touch device, or can also be the scale factors of the display area of the display device and the detection area of the touch device.

[0195] In some examples, by setting different scale factors at different positions in the detectable area, it is realized that when the user's finger moves the same distance in the detectable area, the cursor displayed on the display device can move different distances, thus compensating for the problem of inflexibility when the user operates at the distal position far from the finger root.

[0196] Exemplarily, as Figure 11 As shown in (a), in response to the touch device detecting the finger position 1 on the right edge of the right - hand detectable area, the display device displays the display element 1 corresponding to the finger position 1. In response to the user's finger moving from the finger position 1 inward to the finger position 2, the finger position 2 is obtained. In response to the touch device detecting the finger position 2, the display device displays the display element 2 corresponding to the finger position 2. As Figure 11As shown in (b), in response to the touch device detecting the finger position 3 located at the left edge of the right hand detectable area, the display device displays the display element 3 corresponding to the finger position 3. In response to the user's finger moving outward from the finger position 3 to the finger position 4, the finger position 4 is acquired. In response to the touch device detecting the finger position 4, the display device displays the display element 4 corresponding to the finger position 4. Among them, the projection distance between the finger position 1 and the finger position 2 on the touch area (cover plate) of the touch electronic device is equal to the projection distance between the finger position 3 and the finger position 4 on the touch area (cover plate) of the touch electronic device; the distance between the display element 1 and the display element 2 is less than the distance between the display element 3 and the display element 4. That is, relative to the movement of the finger at a position closer to the root of the finger, the finger moves the same distance at a position farther from the root of the finger, and the cursor display position can be controlled to move a larger distance, thereby achieving more flexible operation.

[0197] In this way, by changing the proportional coefficient, the user can obtain a more sensitive interactive experience when the finger is near or far. In this way, even if the size of the touch device is large for the user, the problem of the user's finger span being too large during the touch process can be avoided, thereby improving the user's experience.

[0198] In some embodiments, as the user's finger moves, the touch device can obtain multiple different three-dimensional coordinates. Then, the touch device can send the multiple different three-dimensional coordinates to the display device. In this way, the display device can display a cursor according to the multiple different three-dimensional coordinates, and move the cursor display position on the display screen as the user's finger moves. In this way, in the hand-eye separation scenario, the user's long-distance touch needs can also be met.

[0199] For example, Figure 14 In the scenario shown, the display device has obtained the ratio coefficient (a, b) between the touch area of ​​the touch device and the display area of ​​the display device. Figure 14 As shown in (a), after the touch device sends the three-dimensional coordinates (x1, y1, z1) corresponding to the detected user's finger to the display device, the display device can display the cursor at the coordinate (x1*a, y1*b) position on the display screen according to the three-dimensional coordinates and the scale factor, such as displaying the cursor at the left side of the display screen. Figure 14 As shown in (b), the touch device detects the movement of the user's finger position, and the corresponding three-dimensional coordinate changes to (x2, y2, z2). After the touch device sends the changed three-dimensional coordinates to the display device, the display device can display the cursor at the coordinate (x2*a, y2*b) position on the display screen according to the three-dimensional coordinates and the scale factor, such as displaying the cursor in the middle of the display screen. Figure 14As shown in (c), the touch device detects the movement of the user's finger position, and the corresponding three-dimensional coordinate changes to (x3, y3, z3). After the touch device sends the changed three-dimensional coordinates to the display device, the display device can display the cursor at the coordinate position (x3*a, y3*b) on the display screen based on the three-dimensional coordinates and the scale factor, such as displaying the cursor on the right side of the display screen.

[0200] Optionally, the touch device may directly send the three-dimensional coordinates corresponding to the detected user's finger position to the display device, and the display device converts the three-dimensional coordinates to convert them into a cursor position suitable for display on the display area of ​​the display screen. Alternatively, after the touch device detects the three-dimensional coordinates corresponding to the user's finger position, it may first convert the three-dimensional coordinates and then send the converted three-dimensional coordinates to the display device. Then, after receiving the converted three-dimensional coordinates, the display device may directly display the cursor at the corresponding display position.

[0201] It should be understood that Figure 14 In the finger movement scenario shown, the cursor position displayed by the display device changes continuously. The display device may follow the displayed movement trajectory, or may not display the complete movement trajectory, but only display the corresponding cursor at one or several set positions, or may not display the movement trajectory at all. Figure 14 (a), (b), and (c) are only schematic diagrams of the cursor position corresponding to a certain moving position during the movement of the user's finger, and do not constitute a restriction on the entire movement process. In the following similar finger movement scene in space, this will not be repeated.

[0202] In this way, the touch device detects the changes in the three-dimensional coordinates of the user's finger in space, and displays the corresponding display elements (such as a cursor) on the display device in real time, thereby helping the user understand the current operation, realizing long-distance control of the display device without switching vision, and improving interaction efficiency.

[0203] In addition, during the control process, the display device no longer needs to send display data to the touch control device, thereby reducing the operation delay by reducing the transmission of display data.

[0204] In some embodiments, the three-dimensional coordinates detected by the touch device include a z coordinate, which is used to indicate the height of the user's finger from the cover of the touch device. Then, after obtaining the three-dimensional coordinates, the display device can change the display effect of the cursor according to the z coordinate, thereby prompting the user the distance between the current finger and the touch device, effectively reducing the difficulty of user operation.

[0205] For example, the display device prompts the user's finger to the height of the touch device cover by changing the depth of the cursor color. Figure 15As shown in (a)-(c), as the user's finger moves in the space above the touch device, the touch device sends corresponding three-dimensional coordinates to the display device. The display device displays a cursor at different display positions according to the change of the three-dimensional coordinates. Moreover, as the height of the user's finger from the cover plate of the touch device decreases, the color of the cursor gradually deepens until the user's finger touches the cover plate, and then the cursor with the darkest color is displayed. It should be understood that when z = 0, it means that the user's finger touches the cover plate. As the height of the user's finger from the cover plate of the touch device increases, the color of the cursor gradually weakens until the finger height exceeds the detection distance of the touch device, that is, beyond the detection area range, and the touch device cannot detect the finger, then the display of the cursor stops.

[0206] For another example, the display device prompts the height of the user's finger from the cover plate of the touch device by changing the size of the cursor. Exemplarily, as Figure 16 shown in (a)-(c), as the user's finger moves in the space above the touch device, the touch device sends corresponding three-dimensional coordinates to the display device. The display device displays a cursor at different display positions according to the change of the three-dimensional coordinates. Moreover, as the height of the user's finger from the cover plate of the touch device decreases, the size of the cursor gradually decreases until the user's finger touches the cover plate, and then the cursor with the smallest size is displayed. It should be understood that when z = 0, it means that the user's finger touches the cover plate. As the height of the user's finger from the cover plate of the touch device increases, the size of the cursor gradually increases until the finger height exceeds the detection distance of the touch device, that is, beyond the detection area range, and the touch device cannot detect the finger, then the display of the cursor stops. Optionally, the size of the cursor is measured by the area of the display area occupied by the cursor.

[0207] Optionally, when the display device determines that z = 0 in the three-dimensional coordinates, it can display a cursor in a preset display state to prompt the user that a touch operation is currently triggered.

[0208] It should be understood that the display device can also prompt the change of the user's finger height by changing the color and size of the cursor simultaneously. Or, the display device can also prompt the change of the user's finger height in other ways according to the three-dimensional coordinates. For example, the display device prompts the change of the user's finger height by changing the shape of the cursor.

[0209] In addition, the embodiments of the present application do not limit the display shape of the cursor. For example, the cursor can be displayed as an arrow, a circle, a square, or other shapes adapted to different application scenarios (such as a paintbrush shape, a little person shape, etc.).

[0210] In this way, the user perceives the relative position relationship between the finger and the touch device in the space according to the change of the cursor display, adjusts the finger position in time, and improves the interaction efficiency.

[0211] In some embodiments, as the user's finger moves in the space above the touch device, one or more display elements on the display device change. For example, a cursor is displayed on the display device and the display of the cursor changes. For another example, as the display position of the cursor changes, other display elements at the corresponding position change accordingly, so as to more prominently prompt the user about the currently executable operations.

[0212] Exemplarily, as Figure 17 shown in (a) below, the touch device detects the three-dimensional coordinate 1 corresponding to the user's finger and sends the three-dimensional coordinate 1 to the display device, and the display device displays the cursor 171 according to the three-dimensional coordinate 1. Then, as the user's finger moves, as Figure 17 shown in (b) below, the touch device detects the three-dimensional coordinate 2 corresponding to the user's finger and sends the three-dimensional coordinate 2 to the display device, and the display device displays the cursor 171 according to the three-dimensional coordinate 2. Moreover, the display device determines that the display position of the current cursor 171 overlaps with the display area of the smart life application icon, such as the cursor 171 being displayed on top of the smart life application icon. Then, the display device can expand the display of the smart life application icon, so as to prompt the user that the current cursor position can operate the smart life application icon.

[0213] In this way, through the display changes of multiple display elements, the user's interaction experience is improved.

[0214] In some embodiments, when z = 0 in the three-dimensional coordinates, it means that the user's finger touches the cover plate. Then, the display device can determine the task triggered by the user's indication according to the touch operation to execute the corresponding response event.

[0215] Exemplarily, as Figure 17 shown in (b) below, the user determines that the current cursor 171 can operate the smart life application icon according to the enlargement of the smart life application icon, then the user can lower the finger height to trigger the operation of the smart life application icon. As Figure 17 shown in (c) below, the touch device detects the three-dimensional coordinate 3 corresponding to the user's finger and sends the three-dimensional coordinate 3 to the display device, and the display device determines that z = 0 indicated therein and can display the cursor 171 corresponding to the touch state according to the three-dimensional coordinate 3. Moreover, the display device can determine that the user indicates to click on the smart life application icon. Then, the display device can start the smart life application and display the smart life application interface as Figure 17 shown in (d) below.

[0216] In this way, as the user's finger moves in the space, the display device can execute the change of the corresponding display elements to prompt the user about the task that the current finger can indicate the display device to execute. And in response to the change in the height of the user's finger, the display device triggers the corresponding response event to meet the user's interaction needs.

[0217] In some examples, as described above Figure 17 In the scenario shown, the touch device detects multiple consecutive three-dimensional coordinates with z value being 0, and sends the multiple consecutive three-dimensional coordinates with z value being 0 to the display device. Then, the display device can determine, based on the multiple consecutive three-dimensional coordinates with z value being 0, that the user instructs to perform a long-press operation on the display element (such as an icon) corresponding to the current three-dimensional coordinates. Optionally, the display device can also determine whether to perform a drag operation on the currently selected and long-pressed display element according to the x value and / or y value of the multiple consecutive three-dimensional coordinates with z value being 0. For example, if the change range of the x value and / or y value exceeds a preset threshold, the display device can perform a drag operation on the currently selected and long-pressed display element.

[0218] It should be understood that the above examples illustrate the gesture triggering process in the spatial touch scenario by taking single-click, long-press, and drag gestures as examples. Other gesture operations can also be applied to the touch method provided in the embodiments of the present application, and no further examples will be given here.

[0219] In some embodiments, when the user's finger is in the space above the touch device, the touch device can detect the user's finger and determine the three-dimensional coordinates corresponding to the center of the finger. For example, when the user moves the index finger above the touch device to operate the display content of the display device, the touch device can detect the index finger and send the three-dimensional coordinates corresponding to the center of the fingertip of the index finger to the display device to trigger the display device to change the corresponding display content.

[0220] It should be understood that the three-dimensional coordinates sent by the touch device to the display device can be the three-dimensional coordinates corresponding to the center of the user's fingertip, or the three-dimensional coordinates corresponding to other finger positions. For example, when the user moves the side of the finger above the touch device to operate the display content of the display device, after detecting the finger, the touch device can determine the three-dimensional coordinates corresponding to the position of the finger closest to the cover plate of the touch device as the three-dimensional coordinates to be sent.

[0221] In some examples, as Figure 5 shown, a suspension detection module 514 and a touch detection module 515 are configured in the touch device 51. Among them, the suspension detection module 514 is used to detect the three-dimensional coordinates corresponding to the finger in a suspended state and at a distance greater than a preset distance from the cover plate of the touch device 51, and the touch detection module 515 is used to detect the three-dimensional coordinates corresponding to the finger at a distance less than or equal to the preset distance from the cover plate of the touch device 51 (including the finger touching the cover plate).

[0222] In some examples, the suspension detection module 514 and the touch detection module 515 can be two separate modules, or can be a single module with suspension detection function and touch detection function.

[0223] Exemplarily, as Figure 18As shown in (a), a touch detection module 182 is disposed below the cover plate 181 of the touch device. The touch detection module 182 detects the touch operation of the user's finger, for example, by means of capacitive touch detection, resistive touch detection, surface acoustic wave touch detection, infrared touch detection, piezoelectric touch detection, etc. A suspension detection module 183 is disposed below the touch detection module 182. The suspension detection module 183 realizes the detection of the three-dimensional coordinates corresponding to the user's finger, for example, through a high-sensitivity capacitance array, an invisible light array, an ultrasonic array, a camera, etc.

[0224] It should be understood that Figure 18 the structure shown in (a) does not constitute a specific limitation on the touch device. For example, the suspension detection module may also be located above the touch detection module, etc.

[0225] Optionally, as Figure 18 shown in (a), the suspension detection module 183 is an invisible light emission or reception array. The touch device emits light through the invisible light emission array, and determines the position with the strongest light signal intensity and the three-dimensional coordinates of the position by the intensity and distribution of the light signals received by the invisible light reception array. This position is, for example, the center of the user's finger pad.

[0226] Optionally, as Figure 18 shown in (b), the suspension detection module 183 is an ultrasonic emission or reception array. The touch device emits ultrasonic waves through the ultrasonic emission array, and determines the position with the strongest ultrasonic signal intensity and the three-dimensional coordinates of the position by the intensity and distribution of the ultrasonic signals received by the ultrasonic reception array. This position is, for example, the center of the user's finger pad.

[0227] Optionally, as Figure 18 shown in (c), the suspension detection module 183 is a camera, such as an ultra-wide-angle camera, a fish-eye camera, etc. The touch device captures pictures by close focusing through the camera, and performs image recognition on the pictures to determine the three-dimensional coordinates corresponding to the finger center position. For example, the three-dimensional coordinates corresponding to the center of the user's finger pad are determined through image recognition. Optionally, when the suspension detection module 183 is a camera, the cover plate of the touch device is, for example, a transparent cover plate, so that the suspension detection module 183 can take pictures through the cover plate.

[0228] In this way, the touch device can flexibly detect the three-dimensional coordinates corresponding to the finger in multiple ways, improve the accuracy of detecting the position of the user's finger, improve the followability of the cursor movement, and thus improve the user experience.

[0229] Optionally, when the touch device detects the three-dimensional coordinates corresponding to the user's finger through a highly sensitive capacitance array, an invisible light array, an ultrasonic array, or a camera, etc., after detecting a capacitance signal, a light signal, an ultrasonic signal, or an image that meets the characteristics of the user's finger root, it can instruct the display device that the user's finger root is currently detected.

[0230] In some embodiments, the touch device can also detect the moving positions of multiple fingers in the space above it, so as to meet the user's multi-finger touch requirements.

[0231] Exemplarily, as Figure 19 shown, two fingers of the user are in the space above the touch device. The touch device can respectively detect the three-dimensional coordinates 1 and three-dimensional coordinates 2 corresponding to these two fingers, and send the three-dimensional coordinates 1 and three-dimensional coordinates 2 to the display device. Then correspondingly, the display device displays the cursor 191 and cursor 192 corresponding to the three-dimensional coordinates of the user's two fingers according to the received three-dimensional coordinates 1 and three-dimensional coordinates 2. Among them, the display styles of multiple cursors simultaneously displayed by the display device present corresponding display effects according to the corresponding finger height, such as the higher the finger height, the lighter the cursor color and the larger the cursor size, etc.

[0232] In this way, in the case of the user's multi-finger operation, the display device can also display the changes of corresponding multiple display elements, thus enriching the interaction scenario.

[0233] Optionally, the above multi-finger touch scenario includes a multi-finger touch scenario in a holding state or a non-holding state. For example, when the user holds the touch device with both hands, the display device can also display two cursors respectively corresponding to the user's left and right thumb.

[0234] In some examples, in the multi-finger touch scenario, the proportionality coefficients corresponding to different cursor display positions are the same. Optionally, the proportionality coefficient is, for example, the size ratio between the display area of the display device and the touch area of the touch device, etc.

[0235] Exemplarily, as Figure 20 shown in (a) below, after the touch device detects that the three-dimensional coordinates corresponding to the user's two fingers are (x1, y1, z1) and (x2, y2, z2) respectively, it sends the three-dimensional coordinates to the display device. After obtaining the three-dimensional coordinates, the display device converts the three-dimensional coordinates into the cursor display position coordinates (x1*a, y1*b) and (x2*a, y2*b) adapted to the current display area of the display screen according to the proportionality coefficients (a, b), and determines the display style of the cursor according to the z value in the three-dimensional coordinates. For example, as Figure 20 shown in (a) below, the display device displays the cursor 201 and cursor 202.

[0236] After that, when the touch device detects that two fingers of the user move, and the three-dimensional coordinates corresponding to the moved positions are (x3, y3, z3) and (x4, y4, z4) respectively, the touch device sends the three-dimensional coordinates to the display device. After obtaining the three-dimensional coordinates, the display device converts the three-dimensional coordinates into the cursor display position coordinates (x3*a, y3*b) and (x4*a, y4*b) adapted to the display area of the current display screen according to the proportionality coefficients (a, b), and determines the display style of the cursor according to the z value in the three-dimensional coordinates. For example, as shown in (b) of Figure 20 The display device displays the display cursor 201 and the cursor 202 at the changed display positions.

[0237] In some other examples, in a multi-finger touch scenario, the proportionality coefficients corresponding to different cursor display positions in the held state are different, and the proportionality coefficients can be determined according to the detectable area of the left hand or the detectable area of the right hand. The specific implementation method can refer to the relevant content above and will not be elaborated here.

[0238] In this way, through the cooperation of the touch device and the display device, the multi-finger touch requirements of the user are met, and the usage scenarios of remotely controlling the display device are enriched.

[0239] In addition, optionally, in a multi-finger touch scenario, there is no restriction on whether the multiple fingers belong to the same user. For example, user A and user B respectively use one finger of their own to perform touch operations on the same touch device to indicate the corresponding cursor movement effect on the display device.

[0240] It should be understood that other contents of the multi-finger touch scenario can refer to the relevant contents described in the above single-finger touch scenario and will not be elaborated here. In addition, the above uses two fingers as an example to introduce the multi-finger touch scenario, and the implementation of the user performing touch operations with more fingers is also applicable to the multi-finger touch scenario of the above examples.

[0241] In addition, optionally, in a single-finger or multi-finger touch scenario, in the non-held state, the display device converts the three-dimensional coordinates through fixed proportionality coefficients, so as to provide more realistic display feedback for the user. For example, in a painting scenario, as the user's finger moves in the space above the touch device, the cursor (or displayed as a paintbrush, etc.) can move proportionally on the display screen of the display device.

[0242] In some embodiments, the touch method provided by the embodiments of the present application, in addition to being able to detect the single-click, long-press, drag gesture operations in the above examples, in a multi-finger touch scenario, can also detect more complex gesture operations such as two-finger pinching, so as to meet the more diverse touch operation requirements of the user.

[0243] Exemplarily, as Figure 21As shown in (a), the touch device detects the three-dimensional coordinates 1 and three-dimensional coordinates 2 corresponding to two fingers respectively, and sends the three-dimensional coordinates 1 and three-dimensional coordinates 2 to the display device. The display device determines that a two-finger pinch operation of the user is detected based on the received three-dimensional coordinates 1 and three-dimensional coordinates 2, and can display the approaching cursor 211 and cursor 212. For example, the distance between the x value, y value, and z value indicated by the three-dimensional coordinates 1 and three-dimensional coordinates 2 is less than threshold 1. After that, as Figure 21 As shown in (b), the touch device detects the three-dimensional coordinates 3 and three-dimensional coordinates 4 corresponding to two fingers respectively, and sends the three-dimensional coordinates 3 and three-dimensional coordinates 4 to the display device. The display device determines that the two-finger pinch operation of the user is still detected based on the received three-dimensional coordinates 3 and three-dimensional coordinates 4, and determines that the distance between the x value, y value, and z value indicated by the three-dimensional coordinates 3 and three-dimensional coordinates 4 is less than threshold 2, where threshold 2 is less than threshold 1, and can display the closer cursor 211 and cursor 212.

[0244] In this way, in the two-finger pinch scenario, different cursor display style changes can also be presented according to the distance change between the three-dimensional coordinates, so as to help the user understand the meaning of the gesture operation. For example, according to the cursor change from Figure 21 in (a) to Figure 21 in (b), the user can determine that the current finger pinch degree increases. In this way, for example, in some scenarios such as games, the display device can also enrich the user's touch experience through the display style changes of other display elements (such as elastic balls, etc.).

[0245] In some embodiments, the touch area of the touch device may not be displayable or may be displayable.

[0246] Exemplarily, as Figure 22 shown in (a), the touch device does not have a display function, and the touch device is used to send the three-dimensional coordinates corresponding to the detected fingers to the display device, and the display device performs the display. In this way, the transmission process of the display content between the touch device and the display device is reduced, and the operation delay is reduced.

[0247] Exemplarily again, as Figure 22 shown in (b), the touch device has a display function, and the touch device receives the display content reversely transmitted by the display device and displays the display content. During the process of detecting the three-dimensional coordinates corresponding to the user's fingers, the touch device can also synchronously display the display content displayed by the connected display device. In this way, the user's demand for directly viewing the display content on the touch device is met.

[0248] Optionally, whether the above touch device displays content or not can be set by the user.

[0249] In some embodiments, the touch device can provide haptic feedback to the user, thus enriching the user experience.

[0250] Exemplarily, as Figure 18 shown in (a) of, the touch device includes a cover plate 181, a touch detection module 182, and a suspension detection module 183 arranged in sequence from top to bottom. Then, as Figure 23 shown, to provide haptic feedback to the user, a haptic feedback module 231 can be configured below the cover plate 181.

[0251] Optionally, the haptic feedback module 231 is, for example, a 3D haptic array such as ultrasound, high-frequency light, etc.

[0252] For example, the haptic feedback module 231 is an ultrasound array. After the touch device detects the three-dimensional coordinates corresponding to the user's finger, it can control different ultrasound signal transmitters included in the haptic feedback module 231 to send ultrasound signals, and make the ultrasound signals sent by all the ultrasound signal transmitters reach the finger center area (such as the center area of the finger pulp) at the same time, so that the user can obtain haptic feedback. After that, when the touch device determines that the three-dimensional coordinates corresponding to the user's finger change, it can control different ultrasound signal transmitters included in the haptic feedback module 231 to send ultrasound signals again to trigger the corresponding haptic feedback, so as to achieve the effect of tracking the finger center area to generate enhanced haptic and precise convergence.

[0253] For example, after the touch device determines the three-dimensional coordinates (x1, y1, z1) corresponding to the user's finger center area, it instructs the ultrasound signal transmitter farthest from the three-dimensional coordinates to send an ultrasound signal S1, and the other ultrasound signal transmitters at different distances send ultrasound signals S2... Sn based on the ultrasound signal S1, so that all the ultrasound signals reach the position of the three-dimensional coordinates (x1, y1, z1) at the same time, and resonance occurs at the finger center area position corresponding to the three-dimensional coordinates (x1, y1, z1), thus realizing tracking haptics.

[0254] Optionally, the haptic feedback can occur when the user's finger touches or is about to touch the touch cover plate; or the haptic feedback can continuously appear during the whole or part of the process when the user's finger gradually approaches the cover plate. Optionally, the continuously appearing haptic feedback can continuously increase as the user's finger gets closer to the cover plate.

[0255] Optionally, during the process of the touch device providing haptic feedback to the user, the display device can also present cursors in different display styles to provide display feedback to the user, so as to achieve the synchronous induction effect of vision and touch and improve the user experience.

[0256] In some embodiments, the display device can display a two-dimensional screen or a three-dimensional screen. Then, during a touch operation, the display device can also present corresponding two-dimensional or three-dimensional display effects according to the changes in the three-dimensional coordinates corresponding to the user's finger.

[0257] For example, in a two-dimensional display scenario, the display device presents a drag-and-move effect on the currently displayed icon according to the changes in the three-dimensional coordinates corresponding to the user's finger.

[0258] Also, for example, in a three-dimensional display scenario, the display device presents a pinching and deforming effect on the currently displayed three-dimensional sponge according to the changes in the three-dimensional coordinates corresponding to the user's finger. Or, it presents the height change effect of the cursor in the currently displayed three-dimensional space.

[0259] In some embodiments, the touch device is configured with multiple usage modes, and in response to user operations, the touch device can switch between different usage modes. Optionally, the usage modes include, for example, a touch mode, a remote control mode, etc.

[0260] Exemplarily, as Figure 24 shown, during the touch device being in the touch mode, it can detect the three-dimensional coordinates corresponding to the movement of the user's finger in the space above it, thereby realizing touch operations on the display content of the display device through the touch device. In some examples, in response to the user's operation of folding the touch device inward along the folding axis in the directions shown by reference numerals 241 and 242, when the folding angle is equal to 0 degrees (or less than a preset angle), the touch device can switch the usage mode to the remote control mode. In this way, the user can operate the display device through the remote control buttons in the remote control button area on the back of the detection area of the touch device, thus enriching the usage scenarios of the touch device. Optionally, the remote control buttons can be in the form of buttons similar to traditional remote controls, or can be simplified buttons, and cooperate with components such as positioning modules to provide the user with a pointing remote control function, which is different from the control capabilities and modes of the display device in the touch mode. In some other examples, the user can directly switch the usage mode of the touch device through the interface settings, so that the touch device can switch between the touch mode and the remote control mode without changing the form of the touch device.

[0261] In some embodiments, the display device can be connected to at least one touch device, and multiple touch devices can meet the multi-user interaction usage requirements. Among them, the implementation process of the touch interaction between each touch device in the multiple touch devices and the display device can refer to the above-mentioned implementation process of the touch interaction between a single touch device and the display device. Optionally, multiple touch devices can be configured with distinguishable roles to trigger distinguishable scenario functions, thereby realizing more diverse interaction scenarios. For example, in a game scenario, different touch devices can correspond to controlling different character display elements in the game interface, etc.

[0262] In some solutions, multiple embodiments of the present application can be combined and the combined solution can be implemented. Optionally, some operations in the processes of the method embodiments are optionally combined, and / or the order of some operations is optionally changed. Moreover, the execution order between the steps of each process is merely exemplary and does not constitute a limitation on the execution order between the steps. The steps can also be in other execution orders. It is not intended to indicate that the described execution order is the only order in which these operations can be performed. Those of ordinary skill in the art will think of various ways to reorder the operations described herein. In addition, it should be noted that the process details involved in a certain embodiment herein also apply to other embodiments in a similar manner, or different embodiments can be used in combination.

[0263] In addition, some steps in the method embodiments can be equivalently replaced with other possible steps. Or, some steps in the method embodiments can be optional and can be deleted in some usage scenarios. Or, other possible steps can be added to the method embodiments.

[0264] Moreover, the method embodiments can be implemented separately or in combination.

[0265] For example, various touch scenarios in the held state or non-held state in the above examples can be combined. Exemplarily, as Figure 14 or Figure 15 shown, in the non-held state, based on the different heights of the finger position relative to the touch device, the display device can display cursors with different display effects. Among them, when the user holds the touch device by hand, it is also possible to implement that based on the different heights of the finger position relative to the touch device, the display device can display cursors with different display effects or different forms of display elements. Another example is that the user can hold the touch device with one hand. When the finger in this one-handed holding state performs a touch operation, the user's other hand is in the non-held state and can also perform a touch operation. Then, the touch device can obtain the three-dimensional coordinates in the held state and the three-dimensional coordinates in the non-held state, and the display device can correspondingly display the corresponding cursors. In this way, various usage requirements of the user are met.

[0266] Figure 25 is a schematic flowchart of a touch method provided by an embodiment of the present application. It should be noted that this method is not limited by Figure 25 the specific order described below. It should be understood that in other embodiments, the order of some steps of this method can be interchanged according to actual needs, or some of the steps can also be omitted or deleted. The method includes the following steps:

[0267] S2501. The first electronic device obtains the position of the first finger when the user holds the first electronic device, and the position of the first finger is at the first edge of the first area of the first electronic device.

[0268] Among them, the position of the user's finger includes the position relative to the first electronic device generated by the user's finger performing a hovering action or a touching action on the first electronic device.

[0269] S2502. The first electronic device sends the position of the first finger to the second electronic device.

[0270] S2503. The second electronic device displays a first display element corresponding to the position of the first finger, and the first display element is located at the first edge of the display area of the second electronic device.

[0271] Among them, the display element includes, for example, the cursor, game watch, virtual character, etc. displayed on the second electronic device.

[0272] Exemplarily, as Figure 8 shown in (a) of, the display area of the display device is rectangular, and the detection area of the touch device is a cuboid (including a rectangular detection area), where the long side of the display area corresponds to the long side of the touch area, and the short side of the display area corresponds to the short side of the touch area. When the user holds the touch device with the right hand, the right thumb is located in the detection area of the touch device and can be used to control the movement of the cursor displayed on the display device. Optionally, the detection area of the touch device includes a right-hand detectable area 81 (such as the first area), and the right-hand detectable area 81 is a partial area in the detection area of the touch device for detecting the position of the user's finger. And when the user's finger is at any position in the right-hand detectable area 81, a corresponding cursor can be displayed at any position on the display screen. For example, as Figure 8 shown in (a) of, when the user's finger is located at the right edge 811 of the right-hand detectable area 81 (such as the first edge of the first area), the display device can display a cursor corresponding to the user's finger at the corresponding position on the right edge of the display area (such as the first edge of the display area).

[0273] S2504. The first electronic device obtains the position of the second finger when the user holds the first electronic device, and the position of the second finger is at the second edge of the first area of the first electronic device.

[0274] S2505. The first electronic device sends the position of the second finger to the second electronic device.

[0275] S2506. The second electronic device displays a second display element corresponding to the position of the second finger, and the second display element is located at the second edge of the display area of the second electronic device.

[0276] Exemplarily, as Figure 8As shown in (b) of [FIGURE REFERENCE], when the user's finger is located at the left edge 812 of the right-hand detectable area 81 (such as the second edge of the first area), the display device can display a cursor corresponding to the user's finger at a corresponding position on the left edge of the display area (such as the second edge of the display area).

[0277] In this way, by configuring the first area in the first electronic device that can map operations to the entire display area of the first electronic device, the one-handed operation range requirements of the user are met, and the operation difficulty of the user is reduced. Thus, it is avoided that the user's operation is affected because the finger cannot reach some areas of the first electronic device in some situations.

[0278] Moreover, through the display and display changes of the cursor, the user does not have to switch the line of sight back and forth between the first electronic device and the second electronic device, but only needs to keep the line of sight on the second electronic device to achieve touch operations. Thus, in scenarios such as games that require timely and coherent interactive feedback, the user can also control the second electronic device at a distance through the first electronic device. In this way, while meeting the user's large display experience, the user's demand for remote operation is also met.

[0279] In some embodiments, the first electronic device obtains the positions of the user's third finger and fourth finger, where the position of the third finger is at a first height from the first electronic device, and the position of the fourth finger is at a second height from the first electronic device. Correspondingly, when the position of the third finger is at the first height from the first electronic device, the second electronic device presents a third display element with a first display effect; when the position of the fourth finger is at the second height from the first electronic device, the second electronic device presents a fourth display element with a second display effect, and the first display effect is different from the second display effect.

[0280] Optionally, the display effect may include, for example, the size, color, shape, etc. of the display element. It should be understood that the third display element and the fourth display element may be the same display element with different display effects, such as cursors with different colors.

[0281] Exemplarily, as Figure 15 shown in (a)-(c) of [FIGURE REFERENCE], as the user's finger moves in the space above the first electronic device, the first electronic device sends corresponding three-dimensional coordinates to the second electronic device. The second electronic device displays the cursor at different display positions according to the change of the three-dimensional coordinates. Moreover, as the height of the user's finger from the cover plate of the first electronic device decreases, the color of the cursor gradually deepens until the user's finger touches the cover plate, and then the cursor with the darkest color is displayed. As the height of the user's finger from the cover plate of the first electronic device increases, the color of the cursor gradually weakens until the finger height exceeds the detection distance of the first electronic device, that is, exceeds the detection area range, and the first electronic device cannot detect the finger, and the display of the cursor stops.

[0282] In this way, based on the change in the display effect of the display element, the user perceives the relative positional relationship between the finger and the first electronic device in space, and can timely adjust the finger position to improve the interaction efficiency.

[0283] In some embodiments, in response to the user's finger moving from the first finger position to the fifth finger position, the first electronic device acquires the fifth finger position. In response to the user's finger moving from the second finger position to the sixth finger position, the first electronic device acquires the sixth finger position. Wherein, the first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position on the first electronic device. Correspondingly, in response to the first electronic device detecting the fifth finger position, the second electronic device displays a fifth display element corresponding to the fifth finger position. In response to the first electronic device detecting the sixth finger position, the second electronic device displays a sixth display element corresponding to the sixth finger position. Wherein, the first distance between the first display element and the fifth display element is less than the second distance between the second display element and the sixth display element.

[0284] Exemplarily, as Figure 11 shown in the scenario, the first area in the detection area of the first electronic device is a right - hand detectable area. In the right - hand detectable area, the larger the proportional coefficient for converting three - dimensional coordinates is, the farther away from the finger root position; the smaller the proportional coefficient for converting three - dimensional coordinates is, the closer to the finger root position. Then, for finger positions that move the same distance respectively near the finger root position and far from the finger root position, the moving distances of the corresponding display elements are different. For example, the moving distance of the display element mapped by the finger position near the finger root position is smaller, and the moving distance of the display element mapped by the finger position far from the finger root position is larger.

[0285] In this way, through the change of the proportional coefficient, it is ensured that when the user's finger is at the proximal or distal end, a relatively sensitive interaction experience can be obtained. In this way, even when the size of the first electronic device is relatively large for the user, the problem that the user's finger span is too large during the touch process can be avoided, thereby improving the user experience.

[0286] In some embodiments, the first electronic device acquires the seventh finger position of the user. In response to the first electronic device detecting the seventh finger position, the second electronic device displays a seventh display element corresponding to the seventh finger position, and changes the display effect of the eighth display element whose original display position is on the seventh display element.

[0287] Optionally, the changed display effect of the eighth display element matches the seventh display element.

[0288] Exemplarily, as Figure 17As shown in (a), the first electronic device detects the three-dimensional coordinate 1 corresponding to the user's finger and sends the three-dimensional coordinate 1 to the second electronic device, and the second electronic device displays the cursor 171 according to the three-dimensional coordinate 1. After that, as the user's finger moves, as Figure 17 shown in (b), the first electronic device detects the three-dimensional coordinate 2 corresponding to the user's finger and sends the three-dimensional coordinate 2 to the second electronic device, and the second electronic device displays the cursor 171 according to the three-dimensional coordinate 2. Moreover, the second electronic device determines that the display position of the current cursor 171 overlaps with the display area of the smart life application icon, such as the cursor 171 is displayed on top of the smart life application icon. Then, the second electronic device can expand the display of the smart life application icon, so as to prompt the user that the current cursor position can operate the smart life application icon.

[0289] In this way, through the display changes of multiple display elements, the user's interaction experience is improved.

[0290] In some embodiments, the detection area of the first electronic device further includes a second area, which is a partial area in the detection area of the first electronic device, and the second area is used to detect the position of the user's finger; the first finger position and the second finger position are the positions of the user's right hand fingers. The first electronic device obtains the eighth finger position when the user holds the first electronic device, and the eighth finger position is on the first edge of the second area of the first electronic device. The first electronic device obtains the ninth finger position when the user holds the first electronic device, and the ninth finger position is on the second edge of the second area of the first electronic device. Among them, the first edge and the second edge of the second area are the opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the eighth finger position and the ninth finger position are the positions of the user's left hand fingers, and the first edge of the first area and the first edge of the second area are the opposite edges of the detection area. Correspondingly, in response to the first electronic device detecting the eighth finger position, the second electronic device displays the ninth display element corresponding to the eighth finger position, and the ninth display element is located on the second edge of the display area of the second electronic device. In response to the first electronic device detecting the ninth finger position, the second electronic device displays the tenth display element corresponding to the ninth finger position, and the tenth display element is located on the first edge of the display area of the second electronic device.

[0291] Exemplarily, such as Figure 10As shown, the user holds the first electronic device with both hands. The detection area of the first electronic device includes a right - hand detectable area 81 (such as the first area) and a left - hand detectable area 91 (such as the second area). Optionally, the right - hand detectable area 81 and the left - hand detectable area 91 may not overlap and together form the detection area of the first electronic device, or the right - hand detectable area 81 and the left - hand detectable area 91 may partially overlap. When the user's right - hand fingers are located at the right edge of the right - hand detectable area 81 (such as the first edge of the first area), the second electronic device displays a cursor at the right edge of the display area (such as the first edge of the display area). When the user's right - hand fingers are located at the left edge of the right - hand detectable area 81 (such as the second edge of the first area), the second electronic device displays a cursor at the left edge of the display area (such as the second edge of the display area). When the user's left - hand fingers are located at the left edge of the left - hand detectable area 91 (such as the first edge of the second area), the second electronic device displays a cursor at the left edge of the display area (such as the second edge of the display area). When the user's left - hand fingers are located at the right edge of the left - hand detectable area 91 (such as the second edge of the second area), the second electronic device displays a cursor at the right edge of the display area (such as the first edge of the display area).

[0292] In this way, by configuring the right - hand detectable area and / or the left - hand detectable area, and both the right - hand detectable area and the left - hand detectable area can be mapped to the entire display area of the display device, meeting the operation requirements of the user's two - hand holding and reducing the difficulty of single - hand operation for the user during this process. Thus, it is avoided that the user's fingers cannot reach some areas, which affects the user's operation.

[0293] In some embodiments, the first electronic device obtains the position of the tenth finger of the user. The first electronic device sends a plurality of first signals to the position of the tenth finger through a signal emission array, and the plurality of first signals reach the position of the tenth finger at the same or similar times.

[0294] Optionally, the first signal is ultrasound, high - frequency light, etc.

[0295] In this way, the first electronic device can provide tactile feedback to the user, thus enriching the user's usage experience more.

[0296] In some examples, the first electronic device obtains the position of the eleventh finger of the user. Among them, the position of the tenth finger is at the third height from the first electronic device, and the position of the eleventh finger is at the fourth height from the first electronic device. The first electronic device sends a plurality of second signals to the position of the eleventh finger through a signal emission array, and the plurality of second signals reach the position of the eleventh finger at the same or similar times, and the signal intensities of the plurality of first signals are different from the signal intensities of the plurality of second signals.

[0297] In this way, through the continuously emerging haptic feedback that continuously strengthens as the user's finger gets closer and closer to the cover plate, while providing the haptic feedback, the change in distance is prompted to the user.

[0298] In some embodiments, the first electronic device obtains the position of the user's twelfth finger, and the position of the twelfth finger is at a fifth height from the first electronic device. In response to the first electronic device detecting the position of the twelfth finger, the second electronic device displays an eleventh display element corresponding to the position of the twelfth finger, and the eleventh display element is displayed above the twelfth display element displayed on the second electronic device. When the fifth height is 0, a response event corresponding to the twelfth display element is triggered for execution.

[0299] Exemplarily, as Figure 17 shown in (b) below, based on the enlargement of the smart life application icon, the user determines that the current cursor 171 can operate the smart life application icon, so the user can lower the finger height to trigger the operation of the smart life application icon. As Figure 17 shown in (c) below, the first electronic device detects the three-dimensional coordinates 3 corresponding to the user's finger and sends the three-dimensional coordinates 3 to the second electronic device. The second electronic device determines that z = 0 indicated therein and can display the cursor 171 corresponding to the touch state. And the second electronic device can determine that the user indicates to click on the smart life application icon. Then, the second electronic device can start the smart life application and display the smart life application interface as Figure 17 shown in (d) below.

[0300] In this way, as the user's finger moves in space, the second electronic device can perform corresponding changes to the display elements to prompt the user about the tasks that the current finger can indicate the second electronic device to perform. And in response to the change in the user's finger height, the second electronic device triggers corresponding response events to meet the user's interaction needs.

[0301] Optionally, the first electronic device can also perform the steps and functions executed by the touch control device in the above embodiments, and the second electronic device can also perform the steps and functions executed by the display device in the above embodiments, so as to implement the touch control method provided in the above embodiments.

[0302] The above has Figures 5 - 20 described in detail the touch control method provided in the embodiments of the present application. The following will Figure 26 describe in detail the first electronic device provided in the embodiments of the present application, and will Figure 27 describe in detail the second electronic device provided in the embodiments of the present application.

[0303] In a possible design, Figure 26 is the structural schematic diagram of the first electronic device provided in the embodiments of the present application. As Figure 26As shown in the figure, the first electronic device 2600 may include: a transceiver unit 2601 and a processing unit 2602. The first electronic device 2600 can be used to implement the functions of the first electronic device (such as a touch device) involved in the above method embodiments.

[0304] Optionally, the transceiver unit 2601 is used to support the first electronic device 2600 to execute Figure 25 S2502 and S2505 in

[0305] Optionally, the processing unit 2602 is used to support the first electronic device 2600 to execute Figure 25 S2501 and S2504 in

[0306] Among them, the transceiver unit may include a receiving unit and a sending unit, and can be implemented by a transceiver or transceiver-related circuit components, and can be a transceiver or a transceiver module. The operations and / or functions of each unit in the first electronic device 2600 are respectively for implementing the corresponding processes of the touch method described in the above method embodiments. All relevant contents of each step involved in the above method embodiments can be cited in the function descriptions of the corresponding functional units. For the sake of brevity, they will not be elaborated here.

[0307] Optionally, Figure 26 the first electronic device 2600 shown in the figure may further include a storage unit ( Figure 26 not shown in the figure), and a program or instruction is stored in the storage unit. When the transceiver unit 2601 and the processing unit 2602 execute the program or instruction, Figure 26 the first electronic device 2600 shown in the figure can execute the touch method described in the above method embodiments.

[0308] Figure 26 The technical effects of the first electronic device 2600 shown in the figure can refer to the technical effects of the touch method described in the above method embodiments, and will not be elaborated here.

[0309] In addition to being in the form of the first electronic device 2600, the technical solution provided in this application can also be a functional unit or chip in the first electronic device, or a device used in conjunction with the first electronic device.

[0310] In a possible design, Figure 27 is a schematic structural diagram of a second electronic device provided in an embodiment of this application. As Figure 27 shown in the figure, the second electronic device 2700 may include: a transceiver unit 2701, a processing unit 2702, and a display unit 2703. The second electronic device 2700 can be used to implement the functions of the second electronic device (such as a display device) involved in the above method embodiments.

[0311] Optionally, the transceiver unit 2701 is used to support the second electronic device 2700 to execute Figure 25 S2502 and S2505 in.

[0312] Optionally, the processing unit 2702 is used to support the second electronic device 2700 to execute Figure 25 S2503 and S2506 in.

[0313] Optionally, the display unit 2703 is used to support the second electronic device 2700 to execute Figure 25 S2503 and S2506 in.

[0314] Among them, the transceiver unit may include a receiving unit and a sending unit, and may be implemented by a transceiver or a transceiver-related circuit component, and may be a transceiver or a transceiver module. The operations and / or functions of each unit in the second electronic device 2700 are respectively to implement the corresponding process of the touch method described in the above method embodiment. All relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional unit, and for the sake of brevity, they will not be repeated here.

[0315] Optionally, Figure 27 The second electronic device 2700 shown may also include a storage unit ( Figure 27 (not shown), the storage unit stores a program or instruction. When the transceiver unit 2701, the processing unit 2702 and the display unit 2703 execute the program or instruction, Figure 27 The second electronic device 2700 shown can execute the touch method described in the above method embodiment.

[0316] Figure 27 The technical effects of the second electronic device 2700 shown can refer to the technical effects of the touch method described in the above method embodiment, which will not be repeated here.

[0317] In addition to being in the form of the second electronic device 2700, the technical solution provided by the present application may also be a functional unit or chip in the second electronic device, or a device used in conjunction with the second electronic device.

[0318] An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, the memory is used to store programs or instructions, when the program or instructions are executed by the processor, the chip system implements the method in any of the above method embodiments.

[0319] Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor that implements functions by reading software code stored in a memory.

[0320] Optionally, the memory in the chip system may also be one or more. The memory may be integrated with the processor or may be separately provided from the processor, which is not limited in the embodiments of the present application. Exemplarily, the memory may be a non-transitory processor, such as a read-only memory (ROM). It may be integrated with the processor on the same chip or may be separately provided on different chips. The embodiments of the present application do not specifically limit the type of the memory and the setting manner of the memory and the processor.

[0321] Exemplarily, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processing unit (CPU), a network processor (NP), a digital signal processing circuit (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0322] It should be understood that the steps in the above method embodiments may be completed by the integrated logic circuit in the hardware of the processor or by instructions in the form of software. The method steps disclosed in combination with the embodiments of the present application may be directly implemented by the execution of the hardware processor or may be implemented by the combination of the hardware and software modules in the processor.

[0323] The embodiments of the present application further provide a computer-readable storage medium, in which a computer program is stored. When the computer program runs on a computer, the computer is enabled to execute the above-related steps to implement the touch control method in the above embodiments.

[0324] The embodiments of the present application further provide a computer program product. When the computer program product runs on a computer, the computer is enabled to execute the above-related steps to implement the touch control method in the above embodiments.

[0325] In addition, an embodiment of the present application further provides a device. The device may specifically be a component or a module, and the device may include one or more processors and a memory connected thereto. Among them, the memory is used to store a computer program. When the computer program is executed by one or more processors, the device executes the touch method in each of the above method embodiments.

[0326] Among them, the device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be elaborated here.

[0327] The steps of the methods or algorithms described in connection with the disclosed content of the embodiments of the present application may be implemented in a hardware manner or by a processor executing software instructions. The software instructions may be composed of corresponding software modules, and the software modules may be stored in a random access memory (RAM), flash memory, read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), registers, hard disk, removable hard disk, CD-ROM, or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium may also be a part of the processor. The processor and the storage medium may be located in an application specific integrated circuit (ASIC).

[0328] Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of description, only the above division of each functional module is used as an example. In practical applications, the above functions may be allocated to different functional modules as needed; that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working processes of the systems, devices, and units described above may refer to the corresponding processes in the foregoing method embodiments, and will not be elaborated here.

[0329] In several embodiments provided by this application, it should be understood that the disclosed method can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, and the indirect couplings or communication connections of the modules or units can be in electrical, mechanical or other forms.

[0330] In addition, in each embodiment of this application, each functional unit can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0331] The computer-readable storage medium includes, but is not limited to, any of the following: USB flash drive, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disc, etc., various media that can store program codes.

[0332] As described above, it is only the specific implementation manner of this application, but the protection scope of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be covered by the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

1. A touch control system, characterized in that, The system includes a first electronic device and a second electronic device; The first electronic device is configured to: Obtain a first finger position when a user holds the first electronic device, where the first finger position is at a first edge of a first area of the first electronic device, the first area being a partial area of a detection area of the first electronic device, and the first area is used to detect the user's finger position; Obtain a second finger position when the user holds the first electronic device, where the second finger position is at a second edge of the first area of the first electronic device; wherein, the first edge and the second edge of the first area are opposite edges of the first area, and the opposite edges of the first area are perpendicular to the long side of the detection area; The second electronic device is configured to: In response to the first electronic device detecting the first finger position, display a first display element corresponding to the first finger position, where the first display element is located at a first edge of a display area of the second electronic device; In response to the first electronic device detecting the second finger position, display a second display element corresponding to the second finger position, where the second display element is located at a second edge of the display area of the second electronic device; wherein, the first edge and the second edge of the display area are opposite edges of the display area.

2. The system according to claim 1, wherein The first electronic device is configured to: Obtain a third finger position and a fourth finger position of the user, where the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device; The second electronic device is configured to: When the third finger position is at the first height from the first electronic device, present a third display element with a first display effect; When the fourth finger position is at the second height from the first electronic device, present a fourth display element with a second display effect, where the first display effect is different from the second display effect.

3. The system according to claim 1 or 2, wherein The first electronic device is configured to: In response to the user's finger moving from the first finger position to a fifth finger position, obtain the fifth finger position; In response to the user's finger moving from the second finger position to a sixth finger position, obtain the sixth finger position; wherein, a first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to a second projection distance between the second finger position and the sixth finger position on the first electronic device; The second electronic device is configured to: In response to the first electronic device detecting the fifth finger position, display a fifth display element corresponding to the fifth finger position; In response to the first electronic device detecting the sixth finger position, display a sixth display element corresponding to the sixth finger position; wherein, a first distance between the first display element and the fifth display element is less than a second distance between the second display element and the sixth display element.

4. The system according to any one of claims 1-3, characterized in that the first electronic device is configured to: acquire the position of the seventh finger of the user; the second electronic device is configured to: in response to the first electronic device detecting the position of the seventh finger, display a seventh display element corresponding to the position of the seventh finger, and change the display effect of an eighth display element whose original display position is on the seventh display element.

5. The system according to claim 4, wherein The display effect of the changed eighth display element matches that of the seventh display element.

6. The system according to any one of claims 1-5, characterized in that, The detection area of the first electronic device further includes a second area, which is a partial area in the detection area of the first electronic device, and the second area is used to detect the position of the user's finger; the first finger position and the second finger position are the positions of the user's right hand fingers; the first electronic device is configured to: acquire the position of the eighth finger when the user holds the first electronic device, and the position of the eighth finger is on the first edge of the second area of the first electronic device; acquire the position of the ninth finger when the user holds the first electronic device, and the position of the ninth finger is on the second edge of the second area of the first electronic device; wherein, the first edge and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the eighth finger position and the ninth finger position are the positions of the user's left hand fingers, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area; the second electronic device is configured to: in response to the first electronic device detecting the position of the eighth finger, display a ninth display element corresponding to the position of the eighth finger, and the ninth display element is located on the second edge of the display area of the second electronic device; in response to the first electronic device detecting the position of the ninth finger, display a tenth display element corresponding to the position of the ninth finger, and the tenth display element is located on the first edge of the display area of the second electronic device.

7. The system according to any one of claims 1-6, characterized in that the first electronic device is configured to: acquire the position of the tenth finger of the user; send a plurality of first signals to the position of the tenth finger through a signal emission array, and the plurality of first signals reach the position of the tenth finger at the same or approximately the same time.

8. The system according to claim 7, characterized in that the first electronic device is configured to: acquire the position of the eleventh finger of the user; wherein, the tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device; send a plurality of second signals to the position of the eleventh finger through the signal emission array, the plurality of second signals reach the position of the eleventh finger at the same or approximately the same time, and the signal intensity of the plurality of first signals is different from the signal intensity of the plurality of second signals.

9. The system according to any one of claims 1-8, characterized in that the first electronic device is configured to: Obtain the twelfth finger position of the user, where the twelfth finger position is at a fifth height from the first electronic device; The second electronic device is configured to: In response to the first electronic device detecting the twelfth finger position, display an eleventh display element corresponding to the twelfth finger position, and the eleventh display element is displayed above a twelfth display element displayed on the second electronic device; When the fifth height is 0, trigger the execution of a response event corresponding to the twelfth display element.

10. The system according to any one of claims 1-9, characterized in that, The user finger position includes the position of the user's finger relative to the first electronic device generated by performing a hovering action or a touching action on the first electronic device.

11. A touch control method, characterized in that, Applied to a first electronic device, the method includes: Obtain a first finger position when the user holds the first electronic device, where the first finger position is at a first edge of a first area of the first electronic device, and the first area is a partial area of the detection area of the first electronic device, and the first area is used to detect the user finger position; Obtain a second finger position when the user holds the first electronic device, where the second finger position is at a second edge of the first area of the first electronic device, and the first edge and the second edge of the first area are opposite edges of the first area, and the opposite edges of the first area are perpendicular to the long side of the detection area; Wherein, The first finger position corresponds to a first display element displayed on the second electronic device, and the first display element is located at a first edge of the display area of the second electronic device; The second finger position corresponds to a second display element displayed on the second electronic device, and the second display element is located at a second edge of the display area of the second electronic device, and the first edge and the second edge of the display area are opposite edges of the display area.

12. The method according to claim 11, wherein The method further includes: Obtain a third finger position and a fourth finger position of the user, where the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device; Wherein, The third finger position corresponds to a third display element presented on the second electronic device with a first display effect, and the fourth finger position corresponds to a fourth display element presented on the second electronic device with a second display effect, and the first display effect is different from the second display effect.

13. The method according to claim 11 or 12, characterized in that, The method further includes: In response to the user's finger moving from the first finger position to a fifth finger position, obtain the fifth finger position; In response to the user's finger moving from the second finger position to a sixth finger position, obtain the sixth finger position; wherein, the first projection distance between the first finger position and the fifth finger position on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position on the first electronic device; Wherein, The fifth finger position corresponds to the fifth display element displayed on the second electronic device, the sixth finger position corresponds to the sixth display element displayed on the second electronic device, and a first distance between the first display element and the fifth display element is less than a second distance between the second display element and the sixth display element.

14. The method according to any one of claims 11-13, characterized in that The method further includes: Obtaining a seventh finger position of the user; Wherein, the seventh finger position corresponds to a seventh display element displayed on the second electronic device, and before and after the seventh display element is displayed at a display position corresponding to the seventh finger position, a display effect of an eighth display element originally displayed at the display position changes.

15. The method according to claim 14, characterized in that, The changed display effect of the eighth display element matches the seventh display element.

16. The method according to any one of claims 11-15, characterized in that, The detection area of the first electronic device further includes a second area, the second area is a partial area in the detection area of the first electronic device, and the second area is used to detect the user's finger position; The first finger position and the second finger position are the finger positions of the user's right hand; The method further includes: Obtaining an eighth finger position when the user holds the first electronic device, the eighth finger position is at a first edge of the second area of the first electronic device; Obtaining a ninth finger position when the user holds the first electronic device, the ninth finger position is at a second edge of the second area of the first electronic device; wherein, the first edge and the second edge of the second area are opposite edges of the second area, the opposite edges of the second area are perpendicular to the long side of the detection area, the eighth finger position and the ninth finger position are the finger positions of the user's left hand, and the first edge of the first area and the first edge of the second area are opposite edges of the detection area; Wherein, The eighth finger position corresponds to a ninth display element displayed on the second electronic device, and the ninth display element is located at a second edge of the display area of the second electronic device; The ninth finger position corresponds to a tenth display element displayed on the second electronic device, and the tenth display element is located at a first edge of the display area of the second electronic device.

17. The method according to any one of claims 11-16, characterized in that, The method further includes: Obtaining a tenth finger position of the user; Sending a plurality of first signals to the tenth finger position through a signal emission array, and the plurality of first signals arrive at the tenth finger position at the same time or approximately the same time.

18. The method according to claim 17, wherein The method further includes: Obtaining an eleventh finger position of the user; wherein, the tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device; Sending a plurality of second signals to the eleventh finger position through the signal emission array, the plurality of second signals arrive at the eleventh finger position at the same time or approximately the same time, and signal intensities of the plurality of first signals are different from signal intensities of the plurality of second signals.

19. The method according to any one of claims 11-18, characterized in that, The method further includes: Obtaining a twelfth finger position of the user, the twelfth finger position is at a fifth height from the first electronic device; Among them, the position of the twelfth finger corresponds to the eleventh display element displayed on the second electronic device, the eleventh display element is displayed above the twelfth display element displayed on the second electronic device, and the fifth height being 0 indicates triggering the second electronic device to execute a response event corresponding to the twelfth display element.

20. The method according to any one of claims 11-19, characterized in that The position of the user's finger includes the position of the user's finger relative to the first electronic device generated by performing a hovering action or a touching action on the first electronic device.

21. An electronic device, characterized in that, Including: A processor and a memory, the memory being coupled to the processor, the memory being used to store computer program code, the computer program code including computer instructions, and when the processor reads the computer instructions from the memory, causing the electronic device to execute the method according to any one of claims 11-20.

22. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a computer program, and when the computer program runs on an electronic device, causing the electronic device to execute the method according to any one of claims 11-20.

23. A computer program product, characterized in that, When the computer program product runs on a computer, causing the computer to execute the method according to any one of claims 11-20.

Images