Touch control method, electronic device and system

Abstract

This application provides touch control methods, electronic devices and systems relating to the field of terminal technology. In this application, the position of a user's finger can be detected based on a portion of a detection area in order to satisfy the operating requirement of holding the device with one hand. The method includes the following: When a user holds the first electronic device, a first finger position is obtained at a first edge of a first area of ​​the first electronic device, where the first area is a portion of the detection area of ​​the first electronic device; when a user holds the first electronic device, a second finger position is obtained at a second edge of the first area of ​​the first electronic device, where the first edge and the second edge of the first area are opposite edges, and the opposite edges are perpendicular to the long side of the detection area. The first finger position corresponds to a first display element displayed on the second electronic device and located at the first edge of a display area; the second finger position corresponds to a second display element displayed on the second electronic device and located at the second edge of a display area, where the first edge and the second edge of the display area are opposite edges.

Description

Technical Field

[0001] [Cross - reference to Related Applications] This application claims priority to Chinese Patent Application No. 202311837775.X, titled "TOUCH CONTROL METHOD, ELECTRONIC DEVICE, AND SYSTEM", filed with the China National Intellectual Property Administration on December 27, 2023, the entire content of which is incorporated herein by reference. [Technical Field] This application relates to the field of terminal technologies, and particularly to touch control methods, electronic devices, and systems.

Background Art

[0002] With the development of touch control interaction technologies, some long - distance display devices such as televisions, in - vehicle screens, and projectors have realized a hand - eye separation touch control interaction scenario. For example, after starting an application, the television projects the display interface of the application onto a touch control device. In this way, the user can inversely control the television by performing touch operations on the touch control device. Compared with the hand - eye synchronization scenario, the hand - eye separation scenario can meet the user's requirements for remotely controlling the display device.

[0003] However, in the above - mentioned hand - eye separation scenario, the user needs to frequently switch the line of sight between the display device and the touch control device, and continuous control cannot be achieved. As a result, the range of interaction control is limited, and the interaction efficiency is affected.

Summary of the Invention

[0004] To solve the above technical problems, this application provides a touch control method, electronic device, and system. According to the technical solution provided in this application, the detection area of ​​a first electronic device includes a first area, and the first area is a part of the detection area. When the user's finger position is located at each end of the first area, the second electronic device may, in correspondence, display a corresponding display element at the end of the display area of ​​the second electronic device. In this way, when the user holds the first electronic device, the first area of ​​the operating range is also narrowed to satisfy the operating requirement of holding the device with one hand and improve the user experience. Furthermore, the display of the display element allows the user to perform the reverse control operation appropriately without switching their gaze, resulting in improved interaction efficiency.

[0005] To achieve the above technical objectives, this application provides the following technical solutions.

[0006] According to a first embodiment, a touch control method is provided which is applied to a first electronic device. The method includes the steps of: obtaining a first finger position when a user holds the first electronic device, the first finger position being at a first edge of a first area of ​​the first electronic device, the first area being part of a detection area of ​​the first electronic device, and the first area being used to detect the user's finger position; and obtaining a second finger position when a user holds the first electronic device, the second finger position being at a second edge of a first area of ​​the first electronic device, the first edge and the second edge of the first area being opposite edges of the first area, and the opposite edges of the first area being perpendicular to the long side of the detection area. The first finger position corresponds to a first display element displayed on a second electronic device, the first display element being located at a first edge of a display area of ​​the second electronic device. The second finger position corresponds to a second display element displayed on the second electronic device, the second display element is located at the second edge of the display area of ​​the second electronic device, and the first and second edges of the display area are opposite edges of the display area.

[0007] Thus, the first electronic device is configured to map its operation to a first area of ​​the entire display area of ​​the second electronic device, satisfying the user's one-handed operation range requirement and reducing the difficulty of user operation. Therefore, in some cases, user operation is unaffected because the user's fingers cannot touch a portion of the area of ​​the first electronic device.

[0008] Furthermore, as display elements are shown and changed, the user does not need to switch their gaze back and forth between the first and second electronic devices; they only need to maintain their gaze on the second electronic device to perform touch control operations. Therefore, in scenarios requiring timely and consistent interactive feedback, such as games, the user may also control the second electronic device, which is located at a distance, by using the first electronic device. In this way, the user's requirements for long-distance operation are met while also satisfying their large-screen viewing experience.

[0009] According to the first aspect, the method further includes the step of obtaining a third finger position and a fourth finger position of a user, wherein the third finger position is at a first height from the first electronic device and the fourth finger position is at a second height from the first electronic device. The third finger position corresponds to a third display element having a first display effect and displayed on the second electronic device, and the fourth finger position corresponds to a fourth display element having a second display effect and displayed on the second electronic device, wherein the first display effect is different from the second display effect.

[0010] For example, as the height between the user's finger and the cover of the first electronic device decreases, the color of the display element gradually becomes darker. When the user's finger touches the cover, the display element with the darkest color is displayed. As the height between the user's finger and the cover of the first electronic device increases, the color of the display element gradually becomes lighter. When the height of the finger exceeds the detection distance of the first electronic device, i.e., when it exceeds the detection area range, the first electronic device cannot detect the finger, and the display of the display element stops.

[0011] In this way, the user perceives the relative positional relationship between their finger in space and the first electronic device based on changes in the display effect of the display elements, and adjusts their finger position in a timely manner to improve interaction efficiency.

[0012] According to either the first embodiment or the implementation of the first embodiment, the method further includes the steps of: acquiring a fifth finger position in response to the movement of the user's finger from a first finger position to a fifth finger position; and acquiring a sixth finger position in response to the movement of the user's finger from a second finger position to a sixth finger position, wherein a first projection distance between the first finger position and the fifth finger position and on the first electronic device is equal to a second projection distance between the second finger position and the sixth finger position and on the first electronic device. The fifth finger position corresponds to a fifth display element displayed on the second electronic device, the sixth finger position corresponds to a sixth display element displayed on the second electronic device, and the first distance between the first display element and the fifth display element is smaller than the second distance between the second display element and the sixth display element.

[0013] For example, in the first region, a greater distance from the base of the finger corresponds to a larger ratio coefficient used to transform the 3D coordinates, and a smaller distance from the base of the finger corresponds to a smaller ratio coefficient used to transform the 3D coordinates. In this case, when a finger position close to the base of the finger and a finger position far from the base of the finger move by the same distance, the corresponding movement distance of the display element will be different. For example, when a finger position close to the base of the finger moves, the movement distance of the mapped display element is small, and when a finger position far from the base of the finger moves, the movement distance of the mapped display element is large.

[0014] In this way, by changing the ratio coefficient, it is ensured that the user's fingers can obtain a sensitive interaction experience at either the near or far end. Thus, even if the size of the first electronic device is large for the user, the problem of excessively large finger spread in the touch control process can be avoided, and as a result, the user experience is improved.

[0015] According to either the first embodiment or an implementation of the first embodiment, the method further includes the step of obtaining the position of the user's seventh finger. The position of the seventh finger corresponds to a seventh display element displayed on a second electronic device, and the display effect of an eighth display element that was originally displayed at the display position changes before and after the seventh display element is displayed at the display position corresponding to the seventh finger position.

[0016] According to either the first embodiment or the implementation method of the first embodiment, the changed display effect of the eighth display element is consistent with that of the seventh display element.

[0017] Thus, the user interaction experience can be improved by changing the display of multiple elements.

[0018] According to either the first embodiment or an implementation of the first embodiment, the detection area of ​​the first electronic device further includes a second area, the second area being part of the detection area of ​​the first electronic device, the second area being used to detect the user's finger position, the first finger position and the second finger position being the finger positions of the user's right hand, the method being a step of obtaining an eighth finger position when the user holds the first electronic device, the eighth finger position being at the first end of the second area of ​​the first electronic device, The steps include: a step of obtaining a ninth finger position when the user holds a first electronic device, the ninth finger position being at the second end of a second region of the first electronic device, the first end of the second region and the second end of the second region being opposite ends of the second region, the opposite ends of the second region being perpendicular to the long side of the detection region, the eighth finger position and the ninth finger position being the finger positions of the user's left hand, the first end of the first region and the first end of the second region being opposite ends of the detection region; the eighth finger position corresponding to a ninth display element displayed on the second electronic device, the ninth display element being located at the second end of the display region of the second electronic device; the ninth finger position corresponding to a tenth display element displayed on the second electronic device, the tenth display element being located at the first end of the display region of the second electronic device.

[0019] In this way, a right-hand detectable area and / or a left-hand detectable area are configured, and both the right-hand and left-hand detectable areas are mapped to the entire display area of ​​the display device, satisfying the user's two-handed holding requirement and reducing the difficulty of one-handed operation in this process. Therefore, user operation is unaffected because the user's fingers cannot touch certain areas.

[0020] According to either the first embodiment or an implementation of the first embodiment, the method further includes the steps of: obtaining the position of a user's tenth finger; and transmitting a plurality of first signals to the tenth finger position using a signal transmission array, wherein the time it takes for the plurality of first signals to arrive at the tenth finger position is the same or similar.

[0021] The first signal can be optionally selected from ultrasound, high-frequency light, etc.

[0022] Thus, the first electronic device may enrich the user experience by providing haptic feedback to the user.

[0023] According to either the first embodiment or an implementation of the first embodiment, the method further includes the steps of: obtaining the position of the user's eleventh finger, wherein the tenth finger position is at a third height from the first electronic device and the eleventh finger position is at a fourth height from the first electronic device; and transmitting a plurality of second signals to the eleventh finger position by using a signal transmission array, wherein the time it takes for the plurality of second signals to arrive at the eleventh finger position is the same or similar, and the signal strength of the plurality of first signals is different from the signal strength of the plurality of second signals.

[0024] In this way, as the user's finger moves closer to the cover, the haptic feedback increases continuously, prompting the user to change their distance.

[0025] According to either the first embodiment or an implementation of the first embodiment, the method further includes the step of obtaining the position of a twelfth finger of a user, wherein the twelfth finger position is at a fifth height from the first electronic device. The twelfth finger position corresponds to an eleventh display element displayed on the second electronic device, the eleventh display element is displayed above the twelfth display element displayed on the second electronic device, and a fifth height of 0 indicates that the second electronic device is triggered to perform a response event corresponding to the twelfth display element.

[0026] Thus, as the user's finger moves in space, the second electronic device may perform a corresponding change in the display element to prompt the user for a task that the current finger can be instructed to perform on the second electronic device. Further, in response to a change in the height of the user's finger, the second electronic device triggers a corresponding response event to meet the user's interaction requirements.

[0027] According to any one of the first aspect or the implementation manners of the first aspect, the finger position of the user is a position relative to the first electronic device, and includes a position generated when the user's finger performs a floating action or a touch action on the first electronic device.

[0028] According to a second aspect, a first electronic device is provided. The first electronic device includes a processor and a memory. The memory is coupled to the processor and is configured to store computer program code. The computer program code includes computer instructions. When the processor reads the computer instructions from the memory, the first electronic device is capable of obtaining a first finger position when the user holds the first electronic device. The first finger position is at a first end of a first area of the first electronic device. The first area is a part of the detection area of the first electronic device and is used for detecting the finger position of the user. When the user holds the first electronic device, the first electronic device is capable of obtaining a second finger position. The second finger position is at a second end of the first area of the first electronic device. The first end and the second end of the first area are opposite ends of the first area. The opposite ends of the first area are perpendicular to the long side of the detection area. The first finger position corresponds to a first display element displayed on the second electronic device. The first display element is located at a first end of the display area of the second electronic device. The second finger position corresponds to a second display element displayed on the second electronic device. The second display element is located at a second end of the display area of the second electronic device. The first end and the second end of the display area are opposite ends of the display area.

[0029] According to the second aspect, when the processor reads computer instructions from the memory, the first electronic device is further capable of obtaining the user's third finger position and fourth finger position, where the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device. The third finger position corresponds to a third display element having a first display effect and displayed on the second electronic device, the fourth finger position corresponds to a fourth display element having a second display effect and displayed on the second electronic device, and the first display effect is different from the second display effect.

[0030] According to either one of the second aspect or the implementation manner of the second aspect, when the processor reads computer instructions from the memory, the first electronic device is further capable of obtaining the fifth finger position according to the movement of the user's finger from the first finger position to the fifth finger position, and obtaining the sixth finger position according to the movement of the user's finger from the second finger position to the sixth finger position, where a first projection distance that is between the first finger position and the fifth finger position and on the first electronic device is equal to a second projection distance that is between the second finger position and the sixth finger position and on the first electronic device. The fifth finger position corresponds to a fifth display element displayed on the second electronic device, the sixth finger position corresponds to a sixth display element displayed on the second electronic device, and a first distance between the first display element and the fifth display element is smaller than a second distance between the second display element and the sixth display element.

[0031] According to either one of the second aspect or the implementation manner of the second aspect, when the processor reads computer instructions from the memory, the first electronic device is further capable of obtaining the user's seventh finger position. The seventh finger position corresponds to a seventh display element displayed on the second electronic device, and before and after the seventh display element is displayed at the display position corresponding to the seventh finger position, the display effect of an eighth display element originally displayed at the display position changes.

[0032] According to either the second embodiment or the implementation method of the second embodiment, the changed display effect of the eighth display element is consistent with that of the seventh display element.

[0033] According to either the second embodiment or the implementation of the second embodiment, the detection area of ​​the first electronic device further includes a second area, the second area being a part of the detection area of ​​the first electronic device, the second area being used to detect the user's finger position, and the first finger position and the second finger position being the finger positions of the user's right hand. When the processor reads a computer instruction from memory, the first electronic device can further perform the following actions: when the user holds the first electronic device, the first finger position is obtained, the eighth finger position is located at the first edge of the second region of the first electronic device; when the user holds the first electronic device, the ninth finger position is located at the second edge of the second region of the first electronic device, the first and second edges of the second region are opposite edges of the second region, the opposite edges of the second region are perpendicular to the long side of the detection region; the eighth and ninth finger positions are the finger positions of the user's left hand; and the first edge of the first region and the first edge of the second region are opposite edges of the detection region. The eighth finger position corresponds to a ninth display element displayed on the second electronic device, the ninth display element is located at the second edge of the display region of the second electronic device. The ninth finger position corresponds to a tenth display element displayed on the second electronic device, and the tenth display element is located at the first edge of the display area of ​​the second electronic device.

[0034] According to either the second embodiment or an implementation of the second embodiment, when the processor reads a computer instruction from memory, the first electronic device can further obtain the position of the user's tenth finger and transmit a plurality of first signals to the tenth finger position using a signal transmission array, wherein the time it takes for the plurality of first signals to arrive at the tenth finger position is the same or similar.

[0035] According to either the second embodiment or an implementation of the second embodiment, when a processor reads a computer instruction from memory, the first electronic device can further perform the following: obtain the user's eleventh finger position, the tenth finger position being at a third height from the first electronic device, the eleventh finger position being at a fourth height from the first electronic device, and transmit a plurality of second signals to the eleventh finger position using a signal transmission array, the time it takes for the plurality of second signals to arrive at the eleventh finger position is the same or similar, and the signal strength of the plurality of first signals is different from the signal strength of the plurality of second signals.

[0036] According to either the second embodiment or an implementation of the second embodiment, when the processor reads a computer instruction from memory, the first electronic device can further obtain the position of the user's twelfth finger, the twelfth finger position being at a fifth height from the first electronic device. The twelfth finger position corresponds to an eleventh display element displayed on the second electronic device, the eleventh display element is displayed above the twelfth display element displayed on the second electronic device, and a fifth height of 0 indicates that the second electronic device is triggered to perform a response event corresponding to the twelfth display element.

[0037] According to either the second embodiment or the implementation of the second embodiment, the user's finger position is a position relative to the first electronic device and includes a position generated when the user's finger performs a floating action or a touch action on the first electronic device.

[0038] According to a third aspect, a touch control system is provided, which includes a first electronic device and a second electronic device. The first electronic device is configured to acquire a first finger position when a user holds the first electronic device, the first finger position being at a first edge of a first region of the first electronic device, the first region being part of a detection region of the first electronic device, and the first region being used to detect the user's finger position; and to acquire a second finger position when a user holds the first electronic device, the second finger position being at a second edge of a first region of the first electronic device, the first edge and the second edge of the first region being opposite edges of the first region, and the opposite edges of the first region being perpendicular to the long side of the detection region. The second electronic device is configured to display a first display element corresponding to a first finger position in response to the detection of a first finger position by the first electronic device, wherein the first display element is located at the first edge of the display area of ​​the second electronic device, and to display a second display element corresponding to a second finger position in response to the detection of a second finger position by the first electronic device, wherein the second display element is located at the second edge of the display area of ​​the second electronic device, and the first edge and the second edge of the display area are opposite edges of the display area.

[0039] According to a third embodiment, the first electronic device is configured to acquire the user's third finger position and fourth finger position, wherein the third finger position is at a first height from the first electronic device and the fourth finger position is at a second height from the first electronic device. The second electronic device is configured to display a third display element having a first display effect when the third finger position is at a first height from the first electronic device, and to display a fourth display element having a second display effect when the fourth finger position is at a second height from the first electronic device, wherein the first display effect is different from the second display effect.

[0040] According to either the third embodiment or the implementation method of the first embodiment, the first electronic device is configured to acquire the fifth finger position in response to the movement of the user's finger from the first finger position to the fifth finger position, and to acquire the sixth finger position in response to the movement of the user's finger from the second finger position to the sixth finger position, wherein the first projected distance between the first finger position and the fifth finger position and on the first electronic device is equal to the second projected distance between the second finger position and the sixth finger position and on the first electronic device. The second electronic device is configured to display a fifth display element corresponding to the fifth finger position in response to the detection of the fifth finger position by the first electronic device, and to display a sixth display element corresponding to the sixth finger position in response to the detection of the sixth finger position by the first electronic device, wherein the first distance between the first display element and the fifth display element is smaller than the second distance between the second display element and the sixth display element.

[0041] According to either the third embodiment or the implementation method of the first embodiment, the first electronic device is configured to acquire the position of the user's seventh finger. The second electronic device is configured to display a seventh display element corresponding to the seventh finger position and to change the display effect of an eighth display element that was originally displayed at the display position of the seventh display element, in response to the detection of the seventh finger position by the first electronic device.

[0042] According to either the third embodiment or the implementation method of the first embodiment, the modified display effect of the eighth display element is consistent with that of the seventh display element.

[0043] According to either the third embodiment or the implementation of the first embodiment, the detection area of ​​the first electronic device further includes a second area, the second area being part of the detection area of ​​the first electronic device, the second area being used to detect the user's finger position, and the first and second finger positions being the finger positions of the user's right hand. The first electronic device is configured to acquire an eighth finger position when a user holds the first electronic device, the eighth finger position being at the first edge of the second region of the first electronic device, and to acquire a ninth finger position when a user holds the first electronic device, the ninth finger position being at the second edge of the second region of the first electronic device, the first edge and the second edge of the second region being opposite edges of the second region being perpendicular to the long side of the detection region, the eighth finger position and the ninth finger position being the finger positions of the user's left hand, and the first edge and the first edge of the first region being opposite edges of the detection region. The second electronic device is configured to display a ninth display element corresponding to the eighth finger position in response to the detection of the eighth finger position by the first electronic device, wherein the ninth display element is located at the second edge of the display area of ​​the second electronic device, and to display a tenth display element corresponding to the ninth finger position in response to the detection of the ninth finger position by the first electronic device, wherein the tenth display element is located at the first edge of the display area of ​​the second electronic device.

[0044] According to either the third embodiment or the implementation of the first embodiment, the first electronic device is configured to acquire the position of the user's tenth finger and to transmit a plurality of first signals to the tenth finger position using a signal transmission array, wherein the time it takes for the plurality of first signals to arrive at the tenth finger position is the same or similar.

[0045] According to either the third embodiment or the implementation of the first embodiment, the first electronic device is configured to acquire the user's eleventh finger position, wherein the tenth finger position is at a third height from the first electronic device and the eleventh finger position is at a fourth height from the first electronic device, and to transmit a plurality of second signals to the eleventh finger position by using a signal transmission array, wherein the time it takes for the plurality of second signals to arrive at the eleventh finger position is the same or similar, and the signal strength of the plurality of first signals is different from the signal strength of the plurality of second signals.

[0046] According to either the third embodiment or the implementation method of the first embodiment, the first electronic device is configured to acquire the position of the user's 12th finger, and to determine that the 12th finger position is at a 5th height from the first electronic device. The second electronic device is configured to display an 11th display element corresponding to the 12th finger position in response to the detection of the 12th finger position by the first electronic device, and to display the 11th display element on top of the 12th display element displayed on the second electronic device, and to trigger the execution of a response event corresponding to the 12th display element when the 5th height is 0.

[0047] According to either the third embodiment or the implementation of the third embodiment, the user's finger position is a position relative to the first electronic device and includes a position generated when the user's finger performs a floating action or a touch action on the first electronic device.

[0048] According to a fourth aspect, a touch control method is provided which is applied to a first electronic device. The method includes the steps of detecting a first finger position corresponding to a user's finger, and transmitting the first finger position to a second electronic device, wherein the first finger position is used by the second electronic device to display a first display element corresponding to a first display effect at the first finger position.

[0049] In some examples, when a user's finger is within the detection area of ​​the first electronic device, the first electronic device can detect a first finger position corresponding to the user's finger.

[0050] Thus, the first electronic device detects the user's finger position and displays a display element corresponding to the user's finger position on the second electronic device. Because the display element is displayed and modified in this way, the user does not need to shift their gaze back and forth between the first and second electronic devices; they only need to maintain their gaze on the second electronic device to perform touch control operations. Therefore, in scenarios requiring timely and consistent interactive feedback, such as games, the user may also use the first electronic device to control the second electronic device, which may be located at a distance. In this way, the user's requirements for long-distance operation are met while also satisfying their large-screen viewing experience.

[0051] According to the fourth embodiment, the first signal is transmitted to a spatial position indicated by a first finger position by using a signal transmission array.

[0052] According to either the fourth embodiment or the implementation of the fourth embodiment, the time it takes for a plurality of first signals transmitted by a plurality of signal transmission arrays to arrive at a spatial position indicated by a first finger position is the same or similar.

[0053] Thus, the first electronic device may enrich the user experience by providing haptic feedback to the user.

[0054] According to either the fourth embodiment or an implementation of the fourth embodiment, the method further includes the steps of detecting a second finger position corresponding to a user's finger, and transmitting the second finger position to a second electronic device, wherein the second finger position is used by the second electronic device to display a second display element corresponding to a second display effect at the second finger position.

[0055] According to either the fourth embodiment or the implementation method of the fourth embodiment, the first display effect of the first display element corresponds to a first height indicated by the first finger position, the second display effect of the second display element corresponds to a second height indicated by the second finger position, the first height is different from the second height, and the first display effect is different from the second display effect.

[0056] In this way, based on the different heights of the finger position, the second electronic device can display display elements with different display effects, helping the user understand the height difference between the current finger position and the first electronic device. As a result, the user can also control the display of the second electronic device without switching their gaze to the first electronic device.

[0057] In some examples, the user may operate the second electronic device with one or more fingers by using the first electronic device, and the second electronic device may display one display element corresponding to one finger or one or more display elements corresponding to multiple fingers. In this way, multiple user requirements are met.

[0058] In some examples, the multiple fingers may be different fingers of the same user or fingers of different users. In some examples, the user may or may not hold the first electronic device. When the user holds the first electronic device with one hand, the first display element that is displayed corresponds to the thumb of the user's hand holding the first electronic device, and the second display element that can be displayed simultaneously with the first display element corresponds to another finger of the user's hand that is not holding the first electronic device. Alternatively, when the user holds the first electronic device with both hands, the first and second display elements that can be displayed simultaneously correspond to the thumb of the user's left hand and the thumb of their right hand, respectively.

[0059] According to either the fourth embodiment or the implementation method of the fourth embodiment, the first display effect of the first display element is consistent with the second display effect of the second display element.

[0060] For example, when a user performs a two-finger pinch gesture within the detection space of the first electronic device, the second electronic device may display a first display element and a second display element corresponding to each of the two fingers, and the first display effect coincides with the second display effect to present different degrees of pinching.

[0061] In this way, aligning the display effects of display elements provides users with a better user experience.

[0062] According to either the fourth embodiment or the implementation method of the fourth embodiment, when a user holds the first electronic device, the detection area of ​​the first electronic device includes a right-hand detectable area and / or a left-hand detectable area. Optionally, the right-hand detectable area and the left-hand detectable area do not have to overlap, are combined with the detection area of ​​the first electronic device, or partially overlap. When the fingers of the user's right hand are located at the right edge of the right-hand detectable area, the second electronic device displays a cursor at the right edge of the display area. When the fingers of the user's right hand are located at the left edge of the right-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the fingers of the user's left hand are located at the left edge of the left-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the fingers of the user's left hand are located at the right edge of the left-hand detectable area, the second electronic device displays a cursor at the right edge of the display area.

[0063] In this way, a right-hand detectable area and / or a left-hand detectable area are configured, and both the right-hand and left-hand detectable areas are mapped to the entire display area of ​​the display device, satisfying the user's two-handed holding requirement and reducing the difficulty of one-handed operation in this process. Therefore, user operation is unaffected because the user's fingers cannot touch certain areas.

[0064] According to either the fourth embodiment or the implementation method of the fourth embodiment, when a user holds the first electronic device, in the right-hand detectable area and the left-hand detectable area, the user's fingers move by a first projection distance near the base of the fingers and by a second projection distance far from the base of the fingers. When the first projection distance is equal to the second projection distance, the movement distance of the display elements displayed in the display area of ​​the second electronic device corresponding to the first projection distance is smaller than the movement distance corresponding to the second projection distance.

[0065] In this way, it is ensured that the user's fingers can obtain a sensitive interaction experience at the near or far end. Thus, even if the size of the first electronic device is large for the user, the problem of the user's excessively large finger spread in the touch control process can be avoided, and as a result, the user experience is improved.

[0066] According to a fifth aspect, a touch control method is provided which is applied to a second electronic device. The method includes the steps of: receiving a first finger position transmitted by a first electronic device; and displaying a first display element, wherein a first display effect of the first display element on the second electronic device indicates the first finger position.

[0067] In some examples, a second electronic device receives a second finger position transmitted by a first electronic device, displays a second display element, and the second display effect of the second display element on the second electronic device indicates the second finger position.

[0068] In some examples, the first display effect of the first display element corresponds to a first height indicated by a first finger position, the second display effect of the second display element corresponds to a second height indicated by a second finger position, the first height is different from the second height, and the first display effect is different from the second display effect.

[0069] According to the fifth aspect, the step of displaying a second display element includes a step of displaying a second display element in the process of displaying a first display element, or a step of displaying a second display element after the first display element has been displayed.

[0070] According to either the fifth embodiment or the implementation method of the fifth embodiment, the first display effect of the first display element is consistent with the second display effect of the second display element.

[0071] According to either the fifth embodiment or the implementation of the fifth embodiment, the first horizontal and vertical coordinates indicated by the first finger position are within the area of ​​a third display element displayed on a second electronic device, the method further includes modifying a third display effect of the third display element, the modified third display effect of the third display element being consistent with the first display effect of the first display element.

[0072] For example, in the process of displaying the desktop by a second electronic device, a first finger position is received, and it is determined that the position where the first finger position should be displayed is located on a higher layer of the application icons on the desktop. In this case, the second electronic device may display the first display element corresponding to the first finger position on the higher layer and the enlarged application icon on the lower layer. In this way, the user is prompted to know that the application icon can be operated at the current finger position.

[0073] In this way, the original display element works in conjunction with the display element corresponding to the finger position to further reduce the difficulty of user operation and increase the user's interest in the operation.

[0074] According to either the fifth embodiment or the implementation of the fifth embodiment, the step of displaying a first display element includes the step of determining the display position of the first display element in proportion to the ratio between the first size of the display of the second electronic device and the second size of the detection area of ​​the first electronic device, and the step of displaying the first display element at the display position.

[0075] In this way, the second electronic device displays display elements corresponding to the finger position based on a fixed ratio, providing the user with more reliable display feedback. For example, in a drawing scenario, as the user's finger moves across the space on the first electronic device, the cursor (or displayed as a paintbrush, etc.) can move proportionally on the display of the second electronic device.

[0076] According to either the fifth embodiment or the implementation method of the fifth embodiment, when a user holds the first electronic device, the detection area of ​​the first electronic device includes a right-hand detectable area and / or a left-hand detectable area. Optionally, the right-hand detectable area and the left-hand detectable area do not have to overlap, are combined with the detection area of ​​the first electronic device, or partially overlap. When the fingers of the user's right hand are located at the right edge of the right-hand detectable area, the second electronic device displays a cursor at the right edge of the display area. When the fingers of the user's right hand are located at the left edge of the right-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the fingers of the user's left hand are located at the left edge of the left-hand detectable area, the second electronic device displays a cursor at the left edge of the display area. When the fingers of the user's left hand are located at the right edge of the left-hand detectable area, the second electronic device displays a cursor at the right edge of the display area.

[0077] According to either the fifth embodiment or the implementation method of the fifth embodiment, when a user holds the first electronic device, in the right-hand detectable area and the left-hand detectable area, the user's fingers move by a first projection distance near the base of the fingers and by a second projection distance far from the base of the fingers. When the first projection distance is equal to the second projection distance, the movement distance of the display elements displayed in the display area of ​​the second electronic device corresponding to the first projection distance is smaller than the movement distance corresponding to the second projection distance.

[0078] According to either the fifth embodiment or the implementation of the fifth embodiment, when the height indicated by the first finger position is 0, the method further includes the step of performing a response event corresponding to the first finger position.

[0079] According to a sixth aspect, an electronic device is provided. The electronic device has a function that implements a touch control method according to either the first aspect or a possible implementation of the first aspect. The function may be implemented by hardware, or by hardware running corresponding software. The hardware or software includes one or more modules corresponding to the function.

[0080] According to the seventh aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program (which may also be called instructions or code). When the computer program is executed by an electronic device, the electronic device becomes capable of performing a method according to the first aspect or any possible implementation of the first aspect.

[0081] According to the eighth aspect, a computer program product is provided. When the computer program product is executed on an electronic device, the electronic device becomes capable of performing a method according to either the first aspect or a possible implementation of the first aspect.

[0082] According to the ninth aspect, a circuit system is provided. The circuit system includes a processing circuit, which is configured to perform a method according to either the first aspect or a possible implementation of the first aspect.

[0083] According to a tenth aspect, a chip system is provided that includes at least one processor and at least one interface circuit. The at least one interface circuit is configured to perform a transceiver function and transmit instructions to at least one processor. When at least one processor executes an instruction, the at least one processor performs a method according to either the first aspect or one of the possible implementations of the first aspect.

[0084] The technical effects of the above embodiments are to be discussed by mutual reference. Further details are not described again in this specification. [Brief explanation of the drawing]

[0085] [Figure 1] This figure shows the operating principle of a mouse according to an embodiment of this application. [Figure 2] This is a diagram illustrating a scenario for remotely controlling a display device according to an embodiment of this application. [Figure 3] This is a diagram of a communication system to which the touch control method according to an embodiment of this application is applied. [Figure 4] This is a diagram of the hardware structure of a first electronic device according to an embodiment of this application. [Figure 5] This is a diagram of the module interaction according to the embodiment of this application. [Figure 6] Figure 1 shows a touch control scenario according to an embodiment of this application. [Figure 7] Figure 2 shows a touch control scenario according to an embodiment of this application. [Figure 8] Figure 3 shows a touch control scenario according to an embodiment of this application. [Figure 9] Figure 4 shows a touch control scenario according to an embodiment of this application. [Figure 10] Figure 5 shows a touch control scenario according to an embodiment of this application. [Figure 11] Figure 6 shows a touch control scenario according to an embodiment of this application. [Figure 12]Figure 7 shows a touch control scenario according to an embodiment of this application. [Figure 13] This is a diagram illustrating the principle of holding state detection according to the embodiment of this application. [Figure 14] Figure 8 shows a touch control scenario according to an embodiment of this application. [Figure 15] Figure 9 shows a touch control scenario according to an embodiment of this application. [Figure 16] Figure 10 shows a touch control scenario according to an embodiment of this application. [Figure 17(a)] Figure 11 shows a touch control scenario according to an embodiment of this application. [Figure 17(b)] Figure 11 shows a touch control scenario according to an embodiment of this application. [Figure 17(c)] Figure 11 shows a touch control scenario according to an embodiment of this application. [Figure 17(d)] Figure 11 shows a touch control scenario according to an embodiment of this application. [Figure 18] This is a diagram illustrating the operating principle of the floating detection module according to an embodiment of this application. [Figure 19] Figure 12 shows a touch control scenario according to an embodiment of this application. [Figure 20] Figure 13 shows a touch control scenario according to an embodiment of this application. [Figure 21] Figure 14 shows a touch control scenario according to an embodiment of this application. [Figure 22] Figure 15 shows a touch control scenario according to an embodiment of this application. [Figure 23] This is a diagram illustrating the operating principle of a haptic feedback module according to an embodiment of this application. [Figure 24] This is a diagram illustrating the usage mode switching scenario according to the embodiment of this application. [Figure 25] This is a flowchart of a touch control method according to an embodiment of this application. [Figure 26] This is a diagram showing the structure of a first electronic device according to an embodiment of this application. [Figure 27] This is a diagram showing the structure of a second electronic device according to an embodiment of this application. [Modes for carrying out the invention]

[0086] The technical solutions in the embodiments of this application will be described below with reference to the accompanying drawings. In describing the embodiments of this application, the terms used in the following embodiments are intended to describe the purpose of a particular embodiment and are not intended to limit this application. The singular terms “one,” “a,” and “this” used in this specification and in the claims attached to this application are also intended to include expressions such as “one or more,” unless otherwise clearly specified in the context. In the following embodiments of this application, it should be further understood that “at least one” and “one or more” mean one, two, or more.

[0087] References to “embodiments,” “some embodiments,” etc., in the specification indicate that one or more embodiments of this application include certain features, structures, or characteristics described by reference to the embodiments. Accordingly, phrases such as “in some embodiments,” “in some other embodiments,” and “in other embodiments,” appearing elsewhere in this specification, do not necessarily refer to the same embodiments, but rather, unless specifically emphasized, mean “one or more embodiments, but not all of them.” “Include,” “comprise,” “have,” and their variations all mean “include, but not limited to,” unless specifically emphasized. The term “connection” includes direct and indirect connections unless specifically specified. “First” and “second” are intended solely for illustrative purposes and should not be understood as indicating or implying relative importance, or as an implied indication of the number of technical features shown.

[0088] In embodiments of this application, the terms “example” or “for example” are used to indicate that an example, illustration, or explanation is being given. No embodiment or design described as “example” or “for example” in embodiments of this application should be construed as being preferable to or having more advantages than another embodiment or design. More precisely, the use of terms such as “example” or “for example” is intended to present the relevant concepts in a particular manner.

[0089] In some embodiments, electronic devices such as mobile phones, televisions, in-car screens, and projectors may implement touch-controlled interactions. Touch control scenarios include hand-eye synchronization scenarios and hand-eye separation scenarios. For example, in a hand-eye synchronization scenario, the display device and the touch control device are the same device. For instance, a mobile phone displays an application interface and performs corresponding tasks in response to touch-controlled operations performed by the user on the application interface. In another example, in a hand-eye separation scenario, the display device and the touch control device are different devices. Optionally, the touch control device may be, for example, a keyboard and mouse, an air mouse remote control, or a touchscreen device, as a result of which the user can conveniently control a long-range display device.

[0090] For example, a display device (e.g., a computer) includes a mouse as shown in Figure 1. In this way, the user can manipulate the display content of the display device by using the mouse. The mouse illuminates an externally detected surface using a light-emitting diode (LED) and acquires the externally detected surface using an image sensor. The mouse then determines the direction and distance of movement of the mouse by obtaining the relative displacement between two image frames through comparison using the image sensor. The mouse then transmits the determined displacement direction and distance to the display device, which moves the cursor based on the displacement direction and distance and executes the corresponding response event.

[0091] The mouse needs to be positioned on a smooth sensing surface to control the display device, which limits its usability. Furthermore, in the case of simultaneous operation, one mouse corresponds to one focus on the display device (e.g., the displayed cursor). If multi-finger touch control is required, the display device needs to have multiple mouse devices, and it is difficult for the user to operate multiple mouse devices simultaneously.

[0092] In another example, as shown in Figure 2, the display device may project the displayed application interface onto a touch control device for synchronous display, and the user may then perform touch operations based on the content displayed on the touch control device. The touch control device sends touch control data generated based on the detected touch operations to the display device, and the display device displays the corresponding content based on the touch control data. In this way, the user can control the display device by performing touch operations on the touch control device.

[0093] Compared to a hand-eye synchronization scenario, a hand-eye separation scenario can meet the user's requirements for remotely controlling a display device. However, in a hand-eye separation scenario, when manipulating the display content, the user must switch their gaze from the display device to the touch control device, and then switch their gaze back from the touch control device to the display device after the operation is complete. In this case, the user must frequently switch their gaze between the display device and the touch control device throughout the entire touch control process. As a result, continuous control cannot be achieved, and interaction efficiency is affected. Furthermore, multiple data transmissions of display data and touch control data must be performed between the touch control device and the display device, thereby increasing touch control delay.

[0094] In some scenarios, the display device may obtain the actual size of the touch control device and determine a ratio factor based on the size of the display area of ​​the display device. The touch control device may include a floating screen, which may be used to detect floating information of the user's finger corresponding to the floating screen, and the floating information includes the coordinates of the finger on the floating screen and the distance between the finger and the floating screen. The touch control device may then transmit the floating information to the display device, which displays an instruction icon based on the floating information, thereby allowing the user to identify the finger operation position.

[0095] In the touch control scenario described above, the user can determine finger position based on the instruction icon, resulting in reduced eye movement. However, the display device displays the instruction icon based on a ratio coefficient between the actual size of the touch control device and the size of the display device's screen. In other words, the instruction icon is displayed on the display device's screen after its display position has been proportionally determined. In some scenarios, users are accustomed to holding the touch control device to perform actions such as playing games. In this case, the distance the finger can move is limited, making it difficult for the user to move their finger close to the side edge of the touch control device to perform an action. As a result, it becomes difficult for the user to interact with some of the content displayed on the display device. Furthermore, if the display device is large, for example, a large-screen device, the difficulty of operation for the user increases even further, affecting the user experience.

[0096] Accordingly, embodiments of this application provide a method for controlling a display to display elements by using a finger in a floating manner, and further provide a touch control method based on such a method. The detection area of ​​the touch control device is designed to include a first area, the first area being part of the detection area. Through a further design solution, when the user's finger position is at each end of the first area, the display device may, correspondingly, display the corresponding display element at the end of the display area of ​​the display device. In this way, when the user holds the touch control device, the first area of ​​the operating range may also be narrowed to satisfy the operating requirement of holding with one hand and improve the user experience. Furthermore, the display of the display elements allows the user to perform the reverse control operation appropriately without switching their gaze, resulting in improved interaction efficiency.

[0097] Figure 3 is a diagram of a communication system to which the touch control method according to an embodiment of this application is applied. As shown in Figure 3, the communication system includes a first electronic device 100 and a second electronic device 200.

[0098] Optionally, the first electronic device 100 may be, for example, a dedicated touch control device or a device having touch control functionality. For example, the first electronic device 100 is a touch control device specifically configured for the second electronic device 200. Alternatively, the first electronic device 100 may be a terminal device such as a mobile phone, tablet computer, wearable device, or AI device. The operating system installed on the first electronic device 100 may include, but is not limited to, iOS®, Android®, Harmony®, Windows®, Linux®, or another operating system. Alternatively, the first electronic device 100 may not have an operating system installed. The specific type of the first electronic device 100, whether or not an operating system is installed on the first electronic device 100, and the operating system installed on the first electronic device 100 are not limited in this application.

[0099] Optionally, the second electronic device 200 may be a terminal device such as a television, car screen, projector, computer, tablet computer, notebook computer, mobile phone, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), wearable device, or artificial intelligence (AI) device. The operating system installed on the second electronic device 200 includes, but is not limited to, iOS®, Android®, Harmony®, Windows®, Linux®, or another operating system. The specific type of the second electronic device 200 and the operating system installed on the second electronic device 200 are not limited in this application.

[0100] In some embodiments, a wireless communication connection is established between a first electronic device 100 and a second electronic device 200. Wireless communication technologies for establishing the wireless communication connection include, but are not limited to, at least one of the following: wireless local area network (WLAN) (e.g., wireless fidelity, Wi-Fi network), Bluetooth (BT) (e.g., conventional Bluetooth or Bluetooth low energy, BLE), near field communication (NFC), Zigbee, frequency modulation (FM), infrared (IR), ultra wide band (UWB), and SparkLink.

[0101] Optionally, the first electronic device 100 and the second electronic device 200 may establish a communication connection by using a third-party device within the local area network. The third-party device may be, for example, a router, gateway, or server.

[0102] In some other embodiments, a wired communication connection is established between the first electronic device 100 and the second electronic device 200. One method of establishing the wired communication connection is to establish it through a universal serial bus (USB) interface connection line.

[0103] Optionally, Figure 4 is a diagram of the hardware structure of a first electronic device 100 according to an embodiment of this application. As shown in Figure 4, the first electronic device 100 may include a processor 110, an external memory interface 120, internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, a wireless communication module 150, an audio module 160, a floating detection module 170, a touch detection module 171, a button 180, a motor 190, and the like.

[0104] It can be understood that the structures shown in this embodiment of this application do not constitute any particular limitation to the first electronic device 100. In some other embodiments of this application, the first electronic device 100 may include more or fewer components than those shown in the drawings, or combinations of some components, or divisions from some components, or different layouts of components. The components shown in the drawings may be implemented using hardware, software, or a combination of software and hardware.

[0105] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a neural network processing unit (NPU), etc. Different processing units may be independent components or may be integrated into one or more processors.

[0106] The controller may generate an operation control signal based on the instruction operation code and time-series signals to complete the control of instruction fetching and instruction execution.

[0107] Memory may be further located within the processor 110 and configured to store instructions and data. In some embodiments, the memory within the processor 110 is cache memory. The memory may store instructions or data that are being used or used periodically by the processor 110. If the processor 110 needs to use the instructions or data again, the processor 110 may retrieve the instructions or data directly from memory. This avoids repeated access, reduces latency for the processor 110, and improves system efficiency.

[0108] In some embodiments, the processor 110 may include one or more interfaces. These interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, a universal serial bus (USB) interface, and the like.

[0109] The I2C interface is a bidirectional synchronous serial bus and includes one serial data line (SDA) and one serial clock line (SCL). In some embodiments, the processor 110 may include a group of multiple I2C buses. The processor 110 may be coupled separately to touch sensors, chargers, flashes, cameras 193, etc., through different I2C bus interfaces. For example, the processor 110 may be coupled to a touch sensor through an I2C interface, and as a result, the processor 110 communicates with the touch sensor through the I2C bus interface to realize the touch functionality of the first electronic device 100.

[0110] The USB interface 130 is an interface compliant with the USB standard, and may specifically be a mini USB interface, a micro USB interface, a USB Type-C interface, etc. The USB interface 130 may be configured to connect to a charger to charge the first electronic device 100, or to transmit data between the first electronic device 100 and peripheral devices, or to connect to a headset to play audio through the headset. The interface may be further configured to connect to another terminal device, such as an AR device.

[0111] In some embodiments, the first electronic device establishes a wired communication connection to the second electronic device 200 via a USB interface 130. Subsequently, after detecting the user's finger position, the first electronic device 100 transmits the user's finger position to the second electronic device 200 via the wired communication connection.

[0112] It should be understood that the interface connections between modules shown in the embodiments of this application are merely illustrative examples and do not constitute a limitation on the structure of the first electronic device 100. In some other embodiments of this application, the first electronic device 100 may, instead, use a different interface connection scheme or a group of interface connection schemes than those in the embodiments described above.

[0113] The wireless communication function of the first electronic device 100 may be realized by using an antenna, a wireless communication module 150, a modem processor, a baseband processor, and the like.

[0114] The antenna is configured to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device 100 may be configured to cover one or more communication bands. Different antennas may be further reused to improve antenna utilization. For example, an antenna may be reused as a diversity antenna in a wireless local area network. In some other embodiments, the antenna may be used in combination with a tuning switch.

[0115] The wireless communication module 150 is applied to the first electronic device 100 and may provide a wireless communication solution including wireless local area network (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC) technology, infrared (IR) technology, etc. The wireless communication module 150 may also be one or more components integrating at least one communication processor module. The wireless communication module 150 receives electromagnetic waves through an antenna, performs frequency modulation and filtering on the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 150 may further receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into an electromagnetic wave for radiation through an antenna.

[0116] In some embodiments, the first electronic device 100 may communicate with a network and other devices by using wireless communication technology. Wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long-term evolution (LTE), BT, GNSS, WLAN, NFC, FM, IR technology, etc. GNSS may include the Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), BeiDou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite-Based Augmentation Systems (SBAS).

[0117] In some embodiments, the floating detection module 170 and the touch detection module 171 are configured to detect the finger position of a user's finger within the detection area of ​​the first electronic device 100. Optionally, the detection area is a predefined spatial range located above the cover of the first electronic device 100. The first electronic device 100 is either a movable or immovable device. The space above the cover of the first electronic device 100 indicates the orientation corresponding to the cover of the first electronic device 100. In some examples, the orientation corresponding to the cover of the first electronic device 100 is not necessarily the top in a physical sense (e.g., the sky). In other words, in this embodiment of this application, the space above the cover of the first electronic device 100 is the space relative to the orientation of the detection area. For example, the user holds the first electronic device 100, and the first electronic device 100 is tilted toward the user to facilitate user operation. In this case, the space above the detection area of ​​the first electronic device 100 may, alternatively, be a pre-defined spatial range indicated by the detection area and inclined toward the user.

[0118] In some examples, the floating detection module 170 is configured to detect floating data of the user's finger, and the touch detection module 171 is configured to detect touch data of the user's finger. Optionally, the floating data and touch data are, for example, the three-dimensional coordinates of the user's finger within the detection area, where the z-coordinate of the three-dimensional coordinates corresponding to the touch data is 0. In other words, when the user's finger touches the cover of the first electronic device 100, the height of the finger position relative to the cover of the first electronic device 100 is 0. In some examples, the floating detection module 170 and the touch detection module 171 may be two separate modules or combined into a single module. For further details on the floating detection module 170 and the touch detection module 171, see the relevant descriptions below.

[0119] In some examples, the first electronic device 100 establishes a wireless communication connection to the second electronic device 200 by using a wireless communication module 150. After obtaining the finger position of the user's finger, the first electronic device 100 transmits the finger position to the second electronic device 200 using the wireless communication module 150, and as a result, the second electronic device 200 displays a corresponding display element (e.g., a cursor) at the corresponding position on the display based on the finger position.

[0120] In some embodiments, the first electronic device 100 includes a cover. Optionally, the cover is located on a floating detection module 170 and a touch detection module 171. In some examples, the cover is part of the housing of the first electronic device 100. In some examples, the cover may be further configured to display images, videos, etc. The cover includes a display panel. The display panel may be made from a liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode (AMOLED), flexible light-emitting diode (FLED), mini-LED, micro-LED, micro-OLED, quantum dot light-emitting diode (QLED), etc.

[0121] The external memory interface 120 may be used to extend the storage capacity of the first electronic device 100 by connecting to an external memory card, such as a microSD card. The external memory card communicates with the processor 110 through the external memory interface 120 to implement data storage functionality. Files such as music and videos may be stored on the external memory card.

[0122] The internal memory 121 may be configured to store computer executable program code. Executable program code includes instructions. The internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, applications required by at least one function (e.g., audio playback function or image playback function), etc. The data storage area may store data created in a process using the first electronic device 100 (e.g., audio data and address book), etc. Furthermore, the internal memory 121 may include high-speed random access memory, or non-volatile memory, such as at least one magnetic disk storage device, flash memory, or universal flash storage (UFS). The processor 110 executes various functional applications and data processing of the first electronic device 100 by executing instructions stored in the internal memory 121 and / or instructions stored in memory located in the processor.

[0123] The charge management module 140 is configured to receive a charge input from a charger. The charger may be a wireless charger or a wired charger. In some embodiments of wired charging, the charge management module 140 may receive the charge input from the wired charger through the USB interface 130. In some embodiments of wireless charging, the charge management module 140 may receive the wireless charge input through the wireless charging coil of the second electronic device 200. The charge management module 140 charges the battery 142 while supplying power to the electronic device through the power management module 141.

[0124] The power management module 141 is configured to connect to the battery 142, the charge management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charge management module 140 and supplies power to the processor 110, internal memory 121, floating detection module 170, touch detection module 171, wireless communication module 150, etc. The power management module 141 may be further configured to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage or impedance). In some other embodiments, the power management module 141 may be located in the processor 110 instead. In some other embodiments, the power management module 141 and the charge management module 140 may be located in the same component instead.

[0125] The audio module 160 is configured to convert digital audio information into an analog audio signal for output, and is also configured to convert an analog audio input into a digital audio signal. The audio module 160 may be further configured to encode and decode audio signals. In some embodiments, the audio module 160 may be located in the processor 110, or some functional modules of the audio module 160 may be located in the processor 110. The first electronic device 100 may perform music playback, recording, etc., through the audio module 160. The audio module 160 may include a speaker, receiver, microphone, headset jack, application processor, etc.

[0126] Button 180 includes square control buttons, power buttons, volume buttons, etc. Button 180 may be a mechanical button or a touch button. The first electronic device 100 may receive button inputs and generate button signal inputs related to user settings and function control of the first electronic device 100.

[0127] In some examples, the first electronic device 100 includes an image acquisition module. The image acquisition module may be configured to acquire user images, which may be used, for example, to determine user identification, or it may be configured to acquire user finger images, which may be used, for example, to determine the user's finger position, the way the device is held, etc.

[0128] Optionally, the second electronic device 200 may have the same, similar, or different hardware structure as shown in Figure 4. For example, in addition to the hardware shown in Figure 4, the second electronic device 200 may further include hardware such as a display, camera, and sensor module.

[0129] In some examples, the display may be configured to display images, videos, etc. The display includes a display panel. The display panel may be manufactured using LCDs, for example, OLEDs, active-matrix organic light-emitting diodes, AMOLEDs, FLEDs, mini-LEDs, micro-LEDs, micro-OLEDs, QLEDs, etc.

[0130] In some examples, the second electronic device 200 establishes a wireless communication connection to the first electronic device 100 by using a wireless communication module. After receiving the user's finger position transmitted by the first electronic device 100, the wireless communication module of the second electronic device 200 transmits the finger position to a processor. Based on the user's finger position, the processor determines the display position and display effect of a display element (e.g., a cursor) corresponding to the finger position. The second electronic device 200 may then display the display element corresponding to the user's finger position at the determined display position, based on the determined display effect.

[0131] In some examples, the second electronic device 200 does not include the floating detection module 170 and the touch detection module 171 shown in Figure 4. Specifically, the first electronic device 100 detects the user's finger position by using the floating detection module 170 or the touch detection module 171, and the second electronic device 200 does not need to detect the user's finger position but directly receives the user's finger position transmitted by the first electronic device 100.

[0132] In some examples, the display may be a touchscreen or a non-touchscreen.

[0133] The camera is configured to capture still images or video. An optical image of the subject is generated through a lens and projected onto a photosensitive element. The photosensitive element may be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal and then transmits the electrical signal to an ISP to convert the electrical signal into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB or YUV. In some embodiments, the second electronic device 200 may include one or N cameras, where N is a positive integer greater than 1.

[0134] The sensor module may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, acceleration sensors, distance sensors, optical proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, etc.

[0135] The touch control method provided in the embodiments of this application will be described in detail below by using an example in which the first electronic device 100 is a touch control device and the second electronic device 200 is a display device.

[0136] In some embodiments, a communication connection is established between a display device and a touch control device. The communication connection can be wired or wireless. For example, a wired connection may be established between the display device and the touch control device via a USB interface, or a Bluetooth communication connection may be established by using wireless Bluetooth communication technology.

[0137] In some examples, the display device and the touch control device are complementary devices. In other words, at least one dedicated touch control device is configured for one display device. Alternatively, in response to user interaction, the touch control device may establish communication connections to different display devices, making it convenient for the user to operate different display devices by using the touch control device.

[0138] For example, as shown in Figure 5, a communication connection is established between the peripheral interface 521 of the display device 52 and the peripheral interface 511 of the touch control device 51 to satisfy the communication requirements between the display device 52 and the touch control device 51. Then, after acquiring user data, the processing module 512 of the touch control device 51 may transmit the user data to the display device 52 through the peripheral interface 511. Correspondingly, the display device 52 receives the user data transmitted by the touch control device 51 through the peripheral interface 521, processes the user data using the processing module 522, and displays the relevant content using the display module 523. Optionally, the user data is, for example, the user's finger position detected by the touch control device 51 using a floating detection module 514 or a touch detection module 515, e.g., the three-dimensional coordinates of the user's finger relative to the touch control device 51. The display device 52 may display a corresponding cursor based on the user's finger position to help the user determine the position of the current operation. In this way, the user can continue to look at the display device 52 and complete touch control operations without switching their gaze, resulting in improved continuity of touch control operations.

[0139] It should be understood that the structure shown in Figure 5 does not constitute a particular limitation to the touch control device 51. In some other embodiments of this application, the touch control device 51 may include more or fewer components than those shown in the drawings, or combinations of some components, or divisions from some components, or different layouts of components. The components shown in the drawings may be implemented using hardware, software, or a combination of software and hardware. For example, the touch control device 51 may further include a power management module 513 configured to supply power to other modules. Similarly, the structure shown in Figure 5 does not constitute a particular limitation to the display device 52. For example, the display device 52 may further include a power management module 524 configured to supply power to other modules.

[0140] In some embodiments, the touch control device may be configured to detect the user's finger position within the detection area of ​​the touch control device, for example, a three-dimensional coordinate corresponding to the center position of the user's finger, in order to satisfy the user's requirement to control the display content of the display device via touch. Optionally, the user's finger position is a position relative to the touch control device and includes the position generated when the user's finger performs a floating action or touch action on the touch control device.

[0141] In some examples, the user controls a cursor displayed on a display device by moving their finger in the space above the touch control device. While the user's finger is floating above the touch control device or in the process of touching the touch control device, the touch control device detects changes in the three-dimensional coordinates of the user's finger in the space above the touch control device and displays a moving cursor on the display device corresponding to the three-dimensional coordinates. In this way, the user may know the current state of finger movement, such as changes in direction, position, or height, without switching their gaze to the touch control device.

[0142] Optionally, the display device will display a display element corresponding to the user's finger position. This display element may be the cursor described above, or it may take multiple forms such as a game controller, the user's finger outline, and a virtual character. Below, we will use the cursor as an example to explain the display elements displayed on the display device.

[0143] For example, as shown in Figure 6, the touch control device detects the user's finger located on the cover (which may also be described as a touch control screen, touch control panel, touch control area, etc.) and determines the three-dimensional coordinates (x, y, z) corresponding to the user's finger. The touch control device then transmits the three-dimensional coordinates (x, y, z) to the display device. Correspondingly, the display device receives the three-dimensional coordinates (x, y, z) and displays a cursor 61 at the corresponding position on the display based on the three-dimensional coordinates (x, y, z). If the user's finger is located near the center of the left edge of the cover of the touch control device, the display device may also display a cursor 61 near the center of the left edge of the display device's screen to help the user understand the current position of their finger and to help the user continue to move their finger to control changes in the display content of the display device.

[0144] In the following embodiments, "up," "down," "left," and "right" refer to the orientation shown in Figure 6. Further details will not be explained below.

[0145] In some embodiments, the detection area of ​​a touch control device includes a touch control area located on the cover, which is used to detect touch operations performed by a user on the cover of the touch control device. In other words, the detection area of ​​a touch control device includes the touch control area and the space within a predetermined height range above it. A display device may obtain size information such as the length and width of the touch control area of ​​the touch control device (e.g., the entire cover or several areas on the cover). Thus, the display device can determine a size ratio coefficient between the touch control area of ​​the touch control device and the display area of ​​the display device's display. For example, as shown in Figure 6, the ratio of length is a and the ratio of width is b. After obtaining the three-dimensional coordinates transmitted by the touch control device, the display device can then adapt the three-dimensional coordinates to the current display area based on the determined ratio coefficients, e.g., the ratio of length a and the ratio of width b. Thus, the display device can display a cursor that moves with the finger position based on the ratio coefficients, thereby avoiding misunderstandings caused to the user due to the user's finger movement not corresponding to the cursor's display position. Furthermore, by constructing a ratio coefficient, the size of the touch control area of ​​the touch control device does not need to be the same as the size of the display area of ​​the display device. As a result, the user's requirements for large screen displays are met, while the difficulty of operation for the user is reduced simply by performing operations on a smaller screen.

[0146] For example, as shown in Figure 6, the user's finger may be located in the detection area of ​​the touch control device, and the touch control device may acquire the user's finger position and transmit the 3D coordinates corresponding to the user's finger position to the display device. Correspondingly, after receiving the 3D coordinates (x, y, z), the display device acquires coordinates (x*a, y*b) based on x and y, ratio a, and ratio b shown in the 3D coordinates, and displays the cursor 61 at the position with coordinates (x*a, y*b).

[0147] In some embodiments, the touch control device is a fixed device or a handheld mobile device. In some examples, during the process of a user holding the touch control device, the user may perform touch control operations by using the holding hand. In this case, when it is determined that the user's hand is in a holding position, the touch control device may instruct a display device to display a cursor corresponding to the user's finger position based on the holding position. Optionally, the user may hold the touch control device with one hand or with both hands.

[0148] For example, as shown in Figure 7, the user holds the touch control device 100 with both hands and performs operations on the game application displayed on the display device 200. Optionally, the touch control device 100 may display the game application synchronously, or it may not display the game application. Optionally, as shown in Figure 16, the display device 200 displays cursors corresponding to the two thumbs of the left and right hands when the user is holding the device with both hands. In this way, the user may determine changes in the two-handed touch control state during the game process based on the movement of the cursors. Optionally, the display device 200 may display the contours of the user's two thumbs and the cursors in the central area of ​​the fingers, or the display device 200 may display the cursors in the central area of ​​the fingers separately and not display the contours of the two thumbs.

[0149] Thus, through the display and changes in the cursor, the user does not need to switch their gaze back and forth between the display device and the touch control device; they only need to maintain their gaze on the display device to perform touch control operations. Therefore, in scenarios that require timely and consistent interactive feedback, such as games, the user may also use the touch control device to control a display device at a long distance. In this way, the user's requirements for long-distance operation are met while also satisfying the user's large-screen viewing experience.

[0150] In some cases, the process of a user holding a touch control device to perform touch control operations can limit the flexibility of the operation, for example, by reducing the reach of the fingers. Therefore, the touch control device may divide its overall detection area and determine the operable detection area based on the reach of the fingers when the user is holding the touch control device, thereby allowing the user to freely control the display device over a wider range while holding the touch control device.

[0151] For example, as shown in Figure 8(a), the cover of the touch control device and the display of the display device are rectangular, with the top and bottom edges being the longer sides and the left and right edges being the shorter sides. When a user holds the touch control device with their right hand, the thumb of the right hand may be positioned in the detection area of ​​the touch control device and used to control the movement of a cursor displayed on the display device. Optionally, the detection area of ​​the touch control device includes a right-hand detectable area 81. The right-hand detectable area 81 is part of the detection area of ​​the touch control device and is used to detect the position of the user's finger. Furthermore, when the user's finger is at any position within the right-hand detectable area 81, a cursor can be displayed at any corresponding position on the display. For example, as shown in Figure 8(a), when the user's finger is at the right edge 811 of the right-hand detectable area 81, the display device may display a cursor corresponding to the user's finger at the corresponding position at the right edge of the entire display area. In another example, as shown in Figure 8(b), when the user's finger is located at the left edge 812 of the right-hand detectable area 81, the display device may display a cursor corresponding to the user's finger at the corresponding position at the left edge of the entire display area.

[0152] Optionally, the right-hand detectable area 81 includes the touch control area and the space above the touch control area that are within reach of the right thumb when the touch control device is held by the user's right hand. For example, the long side of the touch control area within the reachable area of ​​the right thumb is smaller than the long side of the touch control area of ​​the touch control device, and / or the short side of the touch control area within reach of the right thumb is smaller than the short side of the touch control area of ​​the touch control device. In another example, as shown in Figure 9(a), the cover of the touch control device and the display of the display device are rectangular, with the top and bottom sides being the long sides and the left and right sides being the short sides. When the user holds the touch control device with their left hand, the left thumb may be located in the detection area of ​​the touch control device and used to control the movement of a cursor displayed on the display device. Optionally, the detection area of ​​the touch control device includes the left-hand detectable area 91. The left-hand detectable area 91 is part of the detection area of ​​the touch control device and is used to detect the position of the user's fingers. Furthermore, when the user's finger is at any position within the left-hand detectable area 91, a cursor can be displayed at a corresponding position on the display. For example, as shown in Figure 9(a), when the user's finger is located at the left edge 911 of the left-hand detectable area 91, the display device may display a cursor corresponding to the user's finger at the corresponding position at the left edge of the entire display area. In another example, as shown in Figure 9(b), when the user's finger is located at the right edge 912 of the left-hand detectable area 91, the display device may display a cursor corresponding to the user's finger at the corresponding position at the right edge of the entire display area.

[0153] Optionally, the left-hand detectable area 91 includes a touch control area and space above the touch control area that is set for the user when the user holds the touch control device with their left hand and that corresponds to the reachability of the left thumb. For example, the longer side of the touch control area corresponding to the reachability of the left thumb is smaller than the longer side of the entire touch control area of ​​the touch control device, and / or the shorter side of the touch control area corresponding to the reachability of the left thumb is smaller than the shorter side of the entire touch control area of ​​the touch control device.

[0154] In another example, as shown in Figure 10, the detection area of ​​a touch control device includes a right-hand detectable area 81 and a left-hand detectable area 91 to satisfy the user's two-handed operation requirement when the user holds the touch control device with both hands. Optionally, there may be an overlapping area between the right-hand detectable area 81 and the left-hand detectable area 91, or there may be no overlapping area. For example, the right-hand detectable area 81 and the left-hand detectable area 91 may not overlap and form an overall detection area, or they may partially overlap.

[0155] In this way, a right-hand detectable area and / or a left-hand detectable area are configured, and both the right-hand and left-hand detectable areas are mapped to the entire display area of ​​the display device, satisfying the user's one-handed operation requirement and reducing the difficulty of one-handed operation for the user. Therefore, user operation is not affected because the user's fingers cannot touch certain areas.

[0156] Optionally, the size of the right-hand or left-hand touch control area may be a pre-configured size in the touch control device. The display device may obtain the size after establishing a communication connection to the touch control device. Alternatively, when the touch control device (or display device) detects that the user is using the touch control device for the first time, or when it detects an action that instructs the user to update the size of the touch control area, the touch control device (or display device) may prompt the user to collect the size of the touch control area that can be operated by the fingers when the user holds the touch control device, thereby obtaining a size of the touch control area that is more suitable for the current user. Alternatively, the size of the touch control area may be automatically determined by the device based on the user's usage habits. Optionally, the area that can be used to detect one-handed operation when the user holds the touch control device may remain constant throughout the entire process of the user using the touch control device. Alternatively, the size of the touch detection area may be dynamically determined based on how the user uses the touch control device. For example, when it is determined that the user is holding the touch control device, the size of the touch detection area is dynamically adjusted to a size suitable for one-handed operation when the user is holding the touch control device.

[0157] In some embodiments, in the scenario shown in Figure 6, the display device transforms the three-dimensional coordinates corresponding to the user's finger position based on the size ratio coefficient of the display area of ​​the display and the size ratio coefficient of the touch control area of ​​the touch control device. In this case, when the user holds the touch control device, the display device may transform the three-dimensional coordinates based on the size ratio coefficient of the display area of ​​the display and the operable detection area of ​​the touch control device.

[0158] Optionally, the user holding the touch control device includes holding the touch control device with one hand (e.g., holding the touch control device with the left hand or the right hand) or holding the touch control device with both hands. In this case, the touch control device may determine the left-hand detectable area and / or right-hand detectable area based on how the user is holding the touch control device.

[0159] For example, as shown in Figure 11(a), the right-hand detectable area 81 is the area within a specific range to the left of the right edge of the detection area of ​​the touch control device. As shown in Figure 12(a), the left-hand detectable area 91 is the area within a specific range to the right of the left edge of the detection area of ​​the touch control device.

[0160] Optionally, the left-hand and / or right-hand detectable areas are not necessarily mapped separately to the entire display area of ​​the display device, but rather correspond separately to specified portions of the entire display area of ​​the display device.

[0161] In some examples, the display device may transform the acquired 3D coordinates based on a fixed ratio coefficient between the display area of ​​the display device and the operable touch control area of ​​the touch control device.

[0162] In some other examples, in the process of a user holding a touch control device to perform a touch control operation, when the central area of ​​the finger is closer to the base of the finger, the user can perform the operation more flexibly and with less difficulty. However, when the central area of ​​the finger is further from the base of the finger, the user can perform the operation with greater difficulty and with greater difficulty. Therefore, the display device may set a dynamically changing ratio coefficient, resulting in a smaller ratio coefficient when the central area of ​​the finger is closer to the base of the finger, or a larger ratio coefficient when the central area of ​​the finger is further from the base of the finger, thereby increasing the sensitivity of the touch control.

[0163] Optionally, when a user holds a touch control device, the base of the fingers also enters the 3D detection area of ​​the touch control device. The 3D detection area should be understood as the area on the touch control device where 3D coordinates corresponding to the user's fingers can be detected. For example, as shown in Figure 13(a), the 3D coordinates acquired by the touch control device have a coordinate distribution feature that extends inward from the edge of the detection area. In this case, after acquiring the 3D coordinates, the display device may determine, based on the coordinate distribution feature of the 3D coordinates, that 3D coordinates with a holding feature have been acquired, further determine that the user's hand is currently in a holding state, and determine whether the user's hand is in a one-handed holding state (e.g., one group of 3D coordinates with a holding feature is detected) or a two-handed holding state (e.g., two groups of 3D coordinates with a holding feature are detected).

[0164] Optionally, after determining the three-dimensional coordinates corresponding to the base of the fingers when the user holds the touch control device, the display device may determine the distribution of ratio coefficients within the detectable area based on the extended area of ​​the position, resulting in smaller ratio coefficients for positions closer to the base of the fingers and larger ratio coefficients for positions further away from the base of the fingers.

[0165] For example, as shown in Figure 13(a), the detection area of ​​the touch control device is rectangular. The intersection of the long and short sides at the lower right corner of the detection area is used as the origin of the 3D coordinate system. The long side is the x-axis direction, and the short side is the y-axis direction. In this case, the display device may determine that the base of the user's finger has been detected if it determines that the acquired 3D coordinates include 3D coordinates where the x value is 0 or less than a preset threshold of 1, and further include 3D coordinates where the x value is greater than a preset threshold of 2.

[0166] In some examples, as shown in Figures 13(a) and (b), in the process of a user holding a touch control device to perform a touch control operation, the touch control device may detect three-dimensional coordinates corresponding to the central region of the user's finger. Based on the change in three-dimensional coordinates, the display device may determine the change in the distance between the central region of the user's finger and the base of the user's finger, and determine a ratio coefficient that needs to be used to transform the three-dimensional coordinates corresponding to the central region of the user's finger.

[0167] For example, as shown in Figure 11(a), when a user holds the touch control device with both hands and the central area of ​​the fingers of the right hand is located at the right edge of the right-hand detectable area, the touch control device transmits the detected 3D coordinates (x1, y1, z1) to the display device. Based on the received 3D coordinates (x1, y1, z1), the display device obtains the corresponding ratio coefficients (a1, b1), determines the transformed coordinates (x1*a1, y1*b1) of the cursor's display position, and displays the cursor at the coordinate position. Next, as shown in Figure 11(b), when the central area of ​​the fingers of the user's right hand is located at the upper left corner of the right-hand detectable area, the touch control device transmits the detected 3D coordinates (x2, y2, z2) to the display device. Based on the received 3D coordinates (x2, y2, z2), the display device obtains the corresponding ratio coefficients (a2, b2), determines the transformed coordinates (x2*a2, y2*b2) of the cursor's display position, and displays the cursor at the coordinate position. Here, a2>a1>a and b2>b1>b, where a and b are either ratio coefficients between the display area of ​​the display device and the right-hand detectable area of ​​the touch control device, or ratio coefficients between the display area of ​​the display device and the detection area of ​​the touch control device.

[0168] For example, as shown in Figure 12(a), when a user holds the touch control device with both hands and the central area of ​​the fingers of the left hand is located at the left edge of the left-hand detectable area, the touch control device transmits the detected 3D coordinates (x3, y3, z3) to the display device. Based on the received 3D coordinates (x3, y3, z3), the display device obtains the corresponding ratio coefficients (a3, b3), determines the transformed coordinates (x3*a3, y3*b3) of the cursor's display position, and displays the cursor at the coordinate position. Next, as shown in Figure 12(b), when the central area of ​​the fingers of the user's left hand is located at the upper right corner of the left-hand detectable area, the touch control device transmits the detected 3D coordinates (x4, y4, z4) to the display device. Based on the received 3D coordinates (x4, y4, z4), the display device obtains the corresponding ratio coefficients (a4, b4), determines the transformed coordinates (x4*a4, y4*b4) of the cursor's display position, and displays the cursor at the coordinate position. Here, a4>a3>a and b4>b3>b, where a and b are either ratio coefficients between the display area of ​​the display device and the left-hand detectable area of ​​the touch control device, or ratio coefficients between the display area of ​​the display device and the detection area of ​​the touch control device.

[0169] In some examples, different ratio coefficients are set for different positions within the detectable area, so that the same distance traveled by the user's finger within the detectable area can represent different distances traveled by the cursor displayed on the display device, compensating for the problem of the user not being flexible in performing operations at remote positions away from the base of their finger.

[0170] For example, as shown in Figure 11(a), the display device displays a display element 1 corresponding to finger position 1 in response to the touch control device detecting finger position 1 located at the right edge of the right-hand detectable area. Finger position 2 is acquired as the user's finger moves inward from finger position 1 to finger position 2. The display device displays a display element 2 corresponding to finger position 2 in response to the touch control device detecting finger position 2. As shown in Figure 11(b), the display device displays a display element 3 corresponding to finger position 3 in response to the touch control device detecting finger position 3 located at the left edge of the right-hand detectable area. Finger position 4 is acquired as the user's finger moves inward from finger position 3 to finger position 4. The display device displays a display element 4 corresponding to finger position 4 in response to the touch control device detecting finger position 4. The projected distance between finger position 1 and finger position 2 on the touch control area (cover) of the touch control electronic device is equal to the projected distance between finger position 3 and finger position 4 on the touch control area (cover) of the touch control electronic device. The distance between display element 1 and display element 2 is smaller than the distance between display element 3 and display element 4. In other words, finger movement at a position far from the base of the finger travels the same distance as finger movement at a position close to the base of the finger. As a result, the cursor's display position can be controlled to move by a larger distance, enabling more flexible operation.

[0171] In this way, by changing the ratio coefficient, it is ensured that the user's fingers can obtain a sensitive interaction experience at either the near or far end. Thus, even if the size of the touch control device is large for the user, the problem of the user's excessively large finger spread during the touch control process can be avoided, resulting in an improved user experience.

[0172] In some embodiments, as the user's finger position changes, the touch control device may acquire multiple different 3D coordinates. In this case, the touch control device may transmit multiple different 3D coordinates to the display device. Thus, the display device may display a cursor based on multiple different 3D coordinates, and as a result, the cursor's display position moves on the display as the user's finger position changes. Therefore, in hand-eye separation scenarios, the user's long-range touch control requirements can also be met.

[0173] For example, in the scenario shown in Figure 14, the display device obtains a ratio coefficient (a,b) between the touch control area of ​​the touch control device and the display area of ​​the display device. As shown in Figure 14(a), after the touch control device transmits the detected 3D coordinates (x1,y1,z1) corresponding to the user's finger to the display device, the display device displays a cursor at the position with coordinates (x1*a,y1*b) on the display based on the 3D coordinates and the ratio coefficient. For example, the cursor is displayed at the left position on the display. Next, as shown in Figure 14(b), the touch control device detects that the user's finger position has changed and the corresponding 3D coordinates have changed to (x2,y2,z2). After the touch control device transmits the changed 3D coordinates to the display device, the display device displays a cursor at the position with coordinates (x2*a,y2*b) on the display based on the 3D coordinates and the ratio coefficient. For example, the cursor is displayed at the center position on the display. Next, as shown in Figure 14(c), the touch control device detects that the user's finger position has changed and the corresponding 3D coordinates have changed to (x3, y3, z3). After the touch control device transmits the changed 3D coordinates to the display device, the display device displays a cursor at the position with coordinates (x3*a, y3*b) on the display, based on the 3D coordinates and ratio coefficients. For example, the cursor is displayed at the right position on the display.

[0174] Optionally, the touch control device may directly transmit the detected 3D coordinates corresponding to the user's finger position to the display device, which then transforms the 3D coordinates into a cursor position adapted for display within the display area of ​​the display. Alternatively, after detecting the 3D coordinates corresponding to the user's finger position, the touch control device may first transform the 3D coordinates and then transmit the transformed 3D coordinates to the display device. In this case, after receiving the transformed 3D coordinates, the display device may directly display the cursor at the corresponding position on the display.

[0175] In the finger movement scenario shown in Figure 14, it should be understood that the position where the display device displays the cursor changes continuously. The display device may display the movement trajectory, or it may not display the entire movement trajectory, or it may display the corresponding cursor only at one or more specified positions, or it may not display the movement trajectory at all. Figures 14(a), (b), and (c) are merely diagrams of cursor positions corresponding to movement positions in the user's finger movement process and do not constitute a limitation on the overall movement process. Further details will not be provided for the following similar finger movement scenarios in space.

[0176] Thus, the touch control device detects changes in the three-dimensional coordinates of the user's finger in space and displays corresponding display elements (e.g., a cursor) on the display device in real time, helping the user understand the current operation, enabling remote control of the display device without eye-tracking, and improving interaction efficiency.

[0177] Furthermore, in the control process, the display device does not need to transmit display data to the touch control device, and as a result, operation delay is reduced by reducing the transmission of display data.

[0178] In some embodiments, the three-dimensional coordinates detected by the touch control device include a z-coordinate indicating the height from the user's finger to the cover of the touch control device. In this case, after obtaining the three-dimensional coordinates, the display device may change the cursor display effect based on the z-coordinate. In this way, the user is informed of the current distance between their finger and the touch control device, and as a result, the difficulty of user operation is effectively reduced.

[0179] For example, the display device notifies the user of the height of the finger from the cover of the touch control device based on the change in the cursor color. For example, as shown in Figures 15(a) to (c), as the user's finger moves in the space above the touch control device, the touch control device transmits the corresponding 3D coordinates to the display device. The display device displays the cursor at different display positions based on the change in 3D coordinates. Furthermore, as the height of the user's finger from the cover of the touch control device decreases, the cursor color gradually becomes darker. When the user's finger touches the cover, the cursor with the darkest color is displayed. It should be understood that when z is equal to 0, it indicates that the user's finger has touched the cover. As the height of the user's finger from the cover of the touch control device increases, the cursor color gradually decreases. When the finger height exceeds the detection distance of the touch control device, i.e., when it exceeds the detection area range, the touch control device cannot detect the finger and stops displaying the cursor.

[0180] In other examples, the display device informs the user of the height of the finger from the cover of the touch control device based on changes in cursor size. For example, as shown in Figures 16(a)-(c), as the user's finger moves across the space above the touch control device, the touch control device transmits the corresponding 3D coordinates to the display device. The display device displays the cursor at different display positions based on the change in 3D coordinates. Furthermore, as the height of the user's finger from the cover of the touch control device decreases, the cursor size gradually decreases. When the user's finger touches the cover, the cursor with the smallest size is displayed. It should be understood that when z is equal to 0, it indicates that the user's finger has touched the cover. As the height of the user's finger from the cover of the touch control device increases, the cursor size gradually increases. When the finger height exceeds the detection distance of the touch control device, i.e., beyond the detection area range, the touch control device cannot detect the finger and stops displaying the cursor. Optionally, the cursor size is measured using the size of the display area occupied by the cursor.

[0181] Optionally, when it is determined that z in 3D coordinates is equal to 0, the display device may display a cursor in a pre-configured display state to prompt the user that a touch operation is currently triggered.

[0182] It should also be understood that the display device may prompt the user to change finger height by changing both the color and size of the cursor. Alternatively, the display device may prompt the user to change finger height in other ways based on three-dimensional coordinates. For example, the display device may prompt the user to change finger height by using a change in the shape of the cursor.

[0183] Furthermore, the display shape of the cursor is not limited to this embodiment of the application. For example, the cursor may be displayed as an arrow, a circle, a square, or another shape (e.g., the shape of a paintbrush or a small person) adapted to different application scenarios.

[0184] In this way, users perceive the relative positional relationship between their finger in space and the touch control device based on changes in the cursor display, and adjust their finger position in a timely manner to improve interaction efficiency.

[0185] In some embodiments, as the user's finger moves across the space above the touch control device, one or more display elements on the display device change. For example, a cursor appears on the display device, and the cursor's appearance changes. In another example, as the cursor's position changes, another display element at the corresponding position changes accordingly to more clearly prompt the user about the actions that can now be performed.

[0186] For example, as shown in Figure 17(a), the touch control device detects a 3D coordinate 1 corresponding to the user's finger and transmits 3D coordinate 1 to the display device. The display device displays a cursor 171 based on 3D coordinate 1. Then, as the user's finger moves, as shown in Figure 17(b), the touch control device detects a 3D coordinate 2 corresponding to the user's finger and transmits 3D coordinate 2 to the display device. The display device displays a cursor 171 based on 3D coordinate 2. Furthermore, the display device determines that the current display position of the cursor 171 overlaps with the display area of ​​the AI ​​Life application icon. For example, the cursor 171 is displayed above the AI ​​Life application icon. In this case, the display device may enlarge the display of the AI ​​Life application icon to prompt the user that the AI ​​Life application icon can be operated at the current cursor position.

[0187] Thus, the user interaction experience can be improved by changing the display of multiple elements.

[0188] In some embodiments, when z in three-dimensional coordinates is equal to 0, it indicates that the user's finger has touched the cover. In this case, the display device may determine a task triggered by a user command based on the touch operation and execute a corresponding response event.

[0189] For example, as shown in Figure 17(b), as the AI ​​Life app icon enlarges, the user determines that the current cursor 171 can interact with the AI ​​Life app icon. In this case, the user may trigger an interaction on the AI ​​Life application icon by reducing the height of their finger. As shown in Figure 17(c), the touch control device detects the 3D coordinate 3 corresponding to the user's finger and transmits the 3D coordinate 3 to the display device. Based on the 3D coordinate 3, the display device may determine that the z value indicated by the 3D coordinate 3 is equal to 0 and display the cursor 171 corresponding to the touch state. Furthermore, the display device may determine that the user is going to tap the AI ​​Life application icon. In this case, the display device may start the AI ​​Life application and display the AI ​​Life application interface shown in Figure 17(d).

[0190] Thus, as the user's finger moves through space, the display device may perform corresponding changes to display elements to prompt the user for tasks that the current finger can instruct the display device to perform. Furthermore, in response to changes in the user's finger height, the display device may trigger corresponding response events to satisfy the user's interaction requirements.

[0191] In some examples, as shown in the scenarios in Figures 17(a) to 17(d), the touch control device detects a series of consecutive 3D coordinates where the z value is 0 and transmits these series of 3D coordinates to the display device. In this case, the display device may decide, based on the series of consecutive 3D coordinates where the z value is 0, to indicate that the user is performing a touch-and-hold operation on the display element (e.g., an icon) corresponding to the current 3D coordinates. Optionally, the display device may further decide, based on the x and / or y values ​​of the series of consecutive 3D coordinates where the z value is 0, whether or not to perform a drag operation on the currently selected and held display element. For example, if the range of change in the x value and / or the y value exceeds a preset threshold, the display device may perform a drag operation on the currently selected and held display element.

[0192] Tap gestures, touch-and-hold gestures, and drag gestures should be understood as examples used to illustrate the gesture triggering process in spatial touch control scenarios. Other gesture operations may also be applicable to the touch control methods provided in this embodiment of this application. Examples will not be described one by one.

[0193] In some embodiments, when a user's finger is positioned in space above the touch control device, the touch control device may detect the user's finger and determine the three-dimensional coordinates corresponding to the center of the finger. For example, a user manipulates the display content on a display device by moving their index finger over the touch control device. The touch control device may detect the index finger and send the three-dimensional coordinates corresponding to the center of the index finger pad to the display device, triggering the display device to change the corresponding display content.

[0194] It should be understood that the three-dimensional coordinates transmitted by the touch control device to the display device may be the three-dimensional coordinates corresponding to the center of the user's fingertip, or they may be the three-dimensional coordinates corresponding to a different finger position. For example, a user manipulates the display content of the display device by moving the side of their finger over the touch control device. After detecting a finger, the touch control device may determine that the three-dimensional coordinates corresponding to the finger position closest to the cover of the touch control device are the three-dimensional coordinates to be transmitted.

[0195] In some examples, as shown in Figure 5, a floating detection module 514 and a touch detection module 515 are configured in the touch control device 51. The floating detection module 514 is configured to detect the corresponding 3D coordinates when a finger is floating and the distance between the finger and the cover of the touch control device 51 is greater than a preset distance. The touch detection module 515 is configured to detect the corresponding 3D coordinates when the distance between the finger and the cover of the touch control device 51 is less than or equal to a preset distance (including when the finger touches the cover).

[0196] In some examples, the floating detection module 514 and the touch detection module 515 may be two separate modules, or they may be a single module having both floating detection and touch detection functions.

[0197] For example, as shown in Figure 18(a), the touch detection module 182 is located under the cover 181 of the touch control device, and the touch detection module 182 detects the user's finger touch operation through, for example, capacitive touch detection, resistive touch detection, surface acoustic wave touch detection, infrared touch detection, or piezoelectric touch detection. The floating detection module 183 is located below the touch detection module 182. The floating detection module 183 detects the three-dimensional coordinates corresponding to the user's finger by, for example, using a high-sensitivity capacitor array, an invisible light array, an ultrasonic array, or a camera.

[0198] It should be understood that the structure shown in Figure 18(a) does not constitute a specific limitation on the touch control device. For example, the floating detection module may, alternatively, be located above the touch detection module.

[0199] Optionally, as shown in Figure 18(a), the floating detection module 183 is an invisible light emitting or receiving array. The touch control device emits light by using the invisible light emitting array and determines the location with the strongest light signal intensity based on the intensity and distribution of the light signal received by the invisible light receiving array, and then determines the three-dimensional coordinates of that location. The location is, for example, the center of the fingertip of the user's finger.

[0200] Optionally, as shown in Figure 18(b), the floating detection module 183 is an ultrasonic transmitting or receiving array. The touch control device transmits ultrasound using the ultrasonic transmitting array and determines the location with the strongest ultrasonic signal intensity based on the intensity and distribution of the ultrasonic signals received by the ultrasonic receiving array, and determines the three-dimensional coordinates of that location. The location is, for example, the center of the fingertip of the user's finger.

[0201] Optionally, as shown in Figure 18(c), the floating detection module 183 is a camera, for example, an ultra-wide-angle camera or a fisheye camera. The touch control device captures a photograph through close-range focusing using the camera, performs image recognition on the photograph, and determines the three-dimensional coordinates corresponding to the center position of the finger. For example, through image recognition, the three-dimensional coordinates corresponding to the center of the fingertip of the user's finger are determined. Optionally, when the floating detection module 183 is a camera, the cover of the touch control device is, for example, a transparent cover, and as a result, the floating detection module 183 takes a photograph through the cover.

[0202] Thus, touch control devices may improve the accuracy of detecting the user's finger position, reduce touch latency for cursor movement, and enhance the user experience by flexibly detecting the 3D coordinates corresponding to the finger in multiple ways.

[0203] Optionally, in the process of detecting the three-dimensional coordinates corresponding to the user's finger by using a high-sensitivity capacitor array, invisible light array, ultrasonic array, camera, etc., the touch control device detects a capacitive signal, optical signal, ultrasonic signal, or image that satisfies the characteristics of the base of the user's finger, and then indicates to the display device that the base of the user's finger is currently detected.

[0204] In some embodiments, the touch control device may further detect the movement positions of multiple fingers located in the space above the touch control device to satisfy the user's multi-finger touch control requirements.

[0205] For example, as shown in Figure 19, the user's two fingers are positioned in the space above the touch control device. The touch control device may separately detect 3D coordinates 1 and 3D coordinates 2 corresponding to the two fingers and transmit 3D coordinates 1 and 3D coordinates 2 to the display device. Correspondingly, the display device displays cursors 191 and 192, respectively, corresponding to the 3D coordinates of the user's two fingers, based on the received 3D coordinates 1 and 3D coordinates 2. The display styles of multiple cursors displayed simultaneously on the display device present corresponding display effects based on the height of the corresponding fingers. For example, a higher finger height indicates a brighter cursor color and a larger cursor size.

[0206] Thus, when a user performs a multi-finger gesture, the display device may also display changes to multiple corresponding display elements to enrich the interaction scenario.

[0207] Optionally, multi-finger touch control scenarios include either a held multi-finger touch control scenario or a non-held multi-finger touch control scenario. For example, when a user holds the touch control device with both hands, the display device may also display two cursors corresponding to the user's left and right thumbs, respectively.

[0208] In some examples, different cursor positions in multi-finger touch control scenarios correspond to the same ratio coefficient. Optionally, the ratio coefficient is, for example, the size ratio between the display area of ​​the display device and the touch control area of ​​the touch control device.

[0209] For example, as shown in Figure 20(a), after detecting that the 3D coordinates corresponding to the user's two fingers are (x1, y1, z1) and (x2, y2, z2), the touch control device transmits the 3D coordinates to the display device. After obtaining the 3D coordinates, the display device converts the 3D coordinates to cursor display position coordinates (x1*a, y1*b) and (x2*a, y2*b) that fit the display area of ​​the current display, based on a ratio coefficient (a, b), and determines the cursor display style based on the z value in the 3D coordinates. For example, as shown in Figure 20(a), the display device displays cursor 201 and cursor 202.

[0210] Next, after detecting that the 3D coordinates corresponding to the user's two fingers have moved to their respective positions are (x3, y3, z3) and (x4, y4, z4), the touch control device transmits the 3D coordinates to the display device. After obtaining the 3D coordinates, the display device converts the 3D coordinates to cursor display position coordinates (x3*a, y3*b) and (x4*a, y4*b) that fit the current display area of ​​the display, based on a ratio coefficient (a, b), and determines the cursor display style based on the z value in the 3D coordinates. For example, as shown in Figure 20(b), the display device displays display cursor 201 and cursor 202 at the changed display position.

[0211] In some other examples, in multi-finger touch control scenarios, different cursor display positions in the hold state correspond to different ratio coefficients. The ratio coefficient may be determined based on the left-hand or right-hand detectable area. For specific implementations, please refer to the relevant content above. Further details will not be described again in this specification.

[0212] In this way, collaboration between the touch control device and the display device satisfies the user's multi-finger touch control requirements and enriches the use scenarios for remotely controlling the display device.

[0213] Furthermore, optionally, in multi-finger touch control scenarios, it is not limited to whether the multiple fingers belong to the same user or not. For example, user A and user B can each use one finger to perform touch control operations separately on the same touch control device, instructing the display device to display the corresponding cursor movement effect.

[0214] For further details regarding multi-finger touch control scenarios, it should be understood that the relevant content in the single-finger touch control scenario described above should be referenced. Further details will not be explained again in this specification. Additionally, two fingers are used as an example to illustrate multi-finger touch control scenarios. The implementation method of performing touch control operations by using more fingers is also applicable to the multi-finger touch control scenario in the example above.

[0215] Furthermore, optionally, in single-finger or multi-finger touch control scenarios, when not holding down, the display device transforms the 3D coordinates based on a fixed ratio coefficient to provide the user with more reliable display feedback. For example, in a drawing scenario, as the user's finger moves across the space above the touch control device, the cursor (or displayed as a paintbrush, etc.) can move proportionally on the display of the display device.

[0216] In some embodiments, according to the touch control method provided in this embodiment of the application, in addition to the tap, touch-and-hold, and drag gesture operations in the above examples, more complex gesture operations such as two-finger pinches may be detected in multi-finger touch control scenarios to satisfy the user's requirements for richer touch control operations.

[0217] For example, as shown in Figure 21(a), the touch control device detects 3D coordinates 1 and 3D coordinates 2 corresponding to two fingers and transmits 3D coordinates 1 and 3D coordinates 2 to the display device. Based on the received 3D coordinates 1 and 3D coordinates 2, the display device determines that a two-finger pinch operation by the user has been detected and may display cursors 211 and 212 that are close to each other. For example, the distance between the x, y, and z values ​​indicated by 3D coordinates 1 and 3D coordinates 2 is less than threshold 1. Next, as shown in Figure 21(b), the touch control device detects 3D coordinates 3 and 3D coordinates 4 corresponding to two fingers and transmits 3D coordinates 3 and 3D coordinates 4 to the display device. Based on the received 3D coordinates 3 and 3D coordinates 4, the display device determines that a two-finger pinch operation by the user has still been detected and determines that the distance between the x, y, and z values ​​indicated by 3D coordinates 3 and 3D coordinates 4 is less than threshold 2. If threshold 2 is smaller than threshold 1, cursors 211 and 212, which are close to each other, may be displayed.

[0218] Thus, in a two-finger pinch scenario, different cursor display styles may be presented based on changes in the distance between three-dimensional coordinates to help the user understand the meaning of the gesture. For example, based on the cursor changes shown from Figure 21(a) to Figure 21(b), the user may determine that the current pinch degree has increased. In this way, in some scenarios, such as games, the display device may further enrich the user's touch control experience by changing the display style of another display element (e.g., an elastic ball).

[0219] In some embodiments, the touch control area of ​​a touch control device may or may not be displayable.

[0220] For example, as shown in Figure 22(a), the touch control device does not have a display function. The touch control device is configured to transmit detected 3D coordinates corresponding to a finger to a display device, and the display device performs the display. In this way, the process of transmitting display content between the touch control device and the display device is reduced, and operation delay is reduced.

[0221] In another example, as shown in Figure 22(b), the touch control device has a display function and receives display content transmitted in reverse by the display device and displays the content. In the process of detecting the three-dimensional coordinates corresponding to the user's finger, the touch control device may also synchronously display the content displayed on the connected display device. In this way, the user's requirement to directly view the content displayed on the touch control device is met.

[0222] The user may optionally configure whether or not the touch control device displays the content.

[0223] In some embodiments, the touch control device may provide haptic feedback to the user to enrich the user experience.

[0224] For example, as shown in Figure 18(a), the touch control device includes a cover 181, a touch detection module 182, and a floating detection module 183 arranged sequentially from top to bottom. In this case, as shown in Figure 23, a haptic feedback module 231 may be located beneath the cover 181 to provide haptic feedback to the user.

[0225] Optionally, the haptic feedback module 231 is a 3D haptic array, such as an ultrasonic array or a high-frequency light array.

[0226] For example, the haptic feedback module 231 is an ultrasonic array. After detecting the three-dimensional coordinates corresponding to the user's finger, the touch control device controls different ultrasonic signal transmitters included in the haptic feedback module 231 to transmit ultrasonic signals, and as a result, the ultrasonic signals transmitted by all ultrasonic signal transmitters simultaneously reach the central region of the finger (e.g., the central region of the fingertip). In this way, the user can obtain haptic feedback. Then, when it is determined that the three-dimensional coordinates corresponding to the user's finger have changed, the touch control device may again control different ultrasonic signal transmitters included in the haptic feedback module 231 to transmit ultrasonic signals and trigger the corresponding haptic feedback. In this way, by tracking the central region of the user's finger, the effects of haptic enhancement and precise aggregation are achieved.

[0227] For example, after determining the 3D coordinates (x1, y1, z1) corresponding to the central region of the user's finger, the touch control device instructs the ultrasonic signal transmitter furthest from the 3D coordinates to transmit ultrasonic signal S1, and instructs other ultrasonic signal transmitters at different distances to transmit ultrasonic signals S2, ..., and Sn using ultrasonic signal S1 as a reference. As a result, all ultrasonic signals reach the 3D coordinates (x1, y1, z1) simultaneously, generating resonance at the location of the central region of the finger corresponding to the 3D coordinates (x1, y1, z1), thereby achieving a tracking tactile sensation.

[0228] Optionally, haptic feedback may occur when the user's finger touches or attempts to touch the touch control cover. Alternatively, haptic feedback may occur continuously throughout or as part of the process by which the user's finger gradually approaches the cover. Optionally, continuously occurring haptic feedback may be continuously amplified as the user's finger approaches the cover.

[0229] Optionally, in the process in which a touch-controlled device provides haptic feedback to the user, the display device may also provide display feedback to the user by presenting cursors with different display styles, thereby achieving a synchronized sensing effect between visual and haptic sensations and improving the user experience.

[0230] In some embodiments, the display device may display a two-dimensional or three-dimensional image. In this case, during the touch control operation process, the display device may also present a corresponding two-dimensional or three-dimensional display effect based on a change in the three-dimensional coordinates corresponding to the user's finger.

[0231] For example, in a 2D display scenario, the display device presents drag and move effects on the currently displayed icon based on changes in the 3D coordinates corresponding to the user's finger.

[0232] In another example, in a 3D display scenario, the display device presents a pinch deformation effect on the currently displayed 3D sponge based on changes in the 3D coordinates corresponding to the user's finger. Alternatively, the display device presents a height change effect for the cursor in the currently displayed 3D space.

[0233] In some embodiments, the touch control device is configured with multiple usage modes, and the touch control device may switch between different usage modes in response to user operation. Optionally, the usage modes include, for example, a touch control mode and a remote control mode.

[0234] For example, as shown in Figure 24, in a process where the touch control device is in touch mode, the touch control device may detect the three-dimensional coordinates corresponding to the movement of the user's finger in the space above the touch control device and perform touch control operations on the display content of the display device by using the touch control device. In some examples, in response to an operation in which the user folds the touch control device inward along the folding axis in the direction indicated by reference numerals 241 and 242, the touch control device may switch its usage mode to remote control mode when the folding angle φ1 is equal to 0 degrees (or less than a preset angle). In this way, the user may enrich the usage scenario of the touch control device by operating the display device using a remote control button located in a remote control button area on the back of the detection area of ​​the touch control device. Optionally, the remote control button may be in the same form as conventional remote control buttons, or it may be a simplified button. The remote control button, in cooperation with the capabilities of components such as a positioning module, provides the user with directional remote control functionality. The functionality is different from the control capabilities and control modes of the display device in touch control mode. In some other examples, the user may directly switch the usage mode of the touch control device through interface settings, and as a result, the touch control device can switch between touch control mode and remote control mode without changing the form of the touch control device.

[0235] In some embodiments, the display device may be connected to at least one touch control device, and multiple touch control devices may satisfy the multi-user interaction requirement. For the process of realizing touch control interaction between each of the multiple touch control devices and the display device, refer to the touch control interaction realization process between one touch control device and the display device described above. Optionally, different roles may be configured for the multiple touch control devices to trigger different scenario functions and realize richer interaction scenarios. For example, in a game scenario, different touch control devices may correspondingly control different role display elements in the game interface.

[0236] In some solutions, multiple embodiments of this application may be combined to realize the combined solution. Optionally, some operations in the processes of the embodiments of the above methods may be combined randomly, and / or the order of some operations may be changed randomly. Furthermore, the execution order of the steps in each procedure is merely an example and does not limit the order in which the steps are executed. The steps may be executed in a different order as an alternative. The execution order is not intended to indicate that these operations can be performed in only one order. Those skilled in the art will be able to understand multiple ways of rearranging the operations described in this specification. Furthermore, it should be noted that the process details relating to a particular embodiment in this specification are applicable in a similar manner to other embodiments, or different embodiments may be used in combination.

[0237] Furthermore, some steps in the embodiment of the method may be replaced with equivalent steps. Alternatively, some steps in the embodiment of the method may be optional and may be omitted in some use scenarios. Alternatively, other possible steps may be added to the embodiment of the method.

[0238] Furthermore, embodiments of the method may be implemented separately or in combination.

[0239] For example, multiple touch control scenarios in the held and unheld states in the above example may be combined. For instance, as shown in Figure 14 or Figure 15, in the unheld state, the display device may display cursors with different display effects based on different finger positions relative to the touch control device. When the user holds the touch control device, the display device may also display cursors with different display effects or different types of display elements based on different finger positions relative to the touch control device. In another example, the user may hold the touch control device with one hand. When the finger in the one-handed holding state performs a touch control operation, the user's other hand may be in an unheld state and also perform a touch control operation. In this case, the touch control device may obtain the 3D coordinates in the held state and the 3D coordinates in the unheld state, and the display device may display the corresponding cursors accordingly. In this way, various user requirements are met.

[0240] Figure 25 is a schematic flowchart of a touch control method according to an embodiment of this application. It should be noted that the method is not limited to the specific order shown in Figure 25 and below. It should be understood that in other embodiments, the order of some steps in the method may be changed according to the actual requirements, or some steps in the method may be omitted or deleted. The method includes the following steps:

[0241] S2501: When a user holds the first electronic device, the first electronic device acquires a first finger position, the first finger position being at the first edge of a first area of ​​the first electronic device.

[0242] The user's finger position is the position relative to the first electronic device, and includes the position generated when the user's finger performs a floating action or a touch action on the first electronic device.

[0243] S2502: The first electronic device transmits the first finger position to the second electronic device.

[0244] S2503: The second electronic device displays a first display element corresponding to a first finger position, and the first display element is located at the first edge of the display area of ​​the second electronic device.

[0245] The display elements include, for example, a cursor, a game watch, and a virtual character displayed on a second electronic device.

[0246] For example, as shown in Figure 8(a), the display area of ​​the display device is rectangular, and the detection area of ​​the touch control device is a cuboid (a detection area containing a rectangle). The longer side of the display area corresponds to the longer side of the touch control area, and the shorter side of the display area corresponds to the shorter side of the touch control area. When a user holds the touch control device with their right hand, the thumb of the right hand may be positioned in the detection area of ​​the touch control device and used to control the movement of a cursor displayed on the display device. Optionally, the detection area of ​​the touch control device includes a right-hand detectable area 81 (e.g., a first area). The right-hand detectable area 81 is part of the detection area of ​​the touch control device and is used to detect the position of the user's finger. Furthermore, when the user's finger is at any position within the right-hand detectable area 81, the corresponding cursor can be displayed at any position on the display. For example, as shown in Figure 8(a), when the user's finger is located at the right edge 811 of the right-hand detectable area 81 (for example, the first edge of the first area), the display device may display a cursor corresponding to the user's finger at the corresponding position at the right edge of the entire display area (for example, the first edge of the display area).

[0247] S2504: When the user holds the first electronic device, the first electronic device acquires a second finger position, the second finger position being at the second edge of the first area of ​​the first electronic device.

[0248] S2505: The first electronic device transmits the second finger position to the second electronic device.

[0249] S2506: The second electronic device displays a second display element corresponding to a second finger position, and the second display element is located at the second edge of the display area of ​​the second electronic device.

[0250] For example, as shown in Figure 8(b), when the user's finger is located at the left edge 812 of the right-hand detectable area 81 (for example, the second edge of the first area), the display device may display a cursor corresponding to the user's finger at the corresponding position at the left edge of the entire display area (for example, the second edge of the display area).

[0251] Thus, the first electronic device is configured to map operations to a first area of ​​the entire display area of ​​the first electronic device, satisfying the user's one-handed operation range requirement and reducing the difficulty of user operation. Therefore, in some cases, user operation is unaffected because the user's fingers cannot touch a portion of the area of ​​the first electronic device.

[0252] Furthermore, because the cursor is displayed and changes, the user does not need to switch their gaze back and forth between the first and second electronic devices; they only need to maintain their gaze on the second electronic device to perform touch control operations. Therefore, in scenarios that require timely and consistent interactive feedback, such as games, the user may also control the second electronic device, which is located at a distance, by using the first electronic device. In this way, the user's requirements for long-distance operation are met while also satisfying their large-screen viewing experience.

[0253] In some embodiments, the first electronic device acquires the user's third and fourth finger positions, where the third finger position is at a first height from the first electronic device and the fourth finger position is at a second height from the first electronic device. Correspondingly, when the third finger position is at the first height from the first electronic device, the second electronic device displays a third display element having a first display effect. When the fourth finger position is at a second height from the first electronic device, the second electronic device displays a fourth display element having a second display effect, where the first display effect is different from the second display effect.

[0254] Optionally, the display effects include, for example, the size, color, and shape of the display elements. It should be understood that the third and fourth display elements may be the same display element with different display effects, for example, cursors with different colors.

[0255] For example, as shown in Figures 15(a) to (c), as the user's finger moves across the space above the first electronic device, the first electronic device transmits the corresponding three-dimensional coordinates to the second electronic device. The second electronic device displays a cursor at different display positions based on the change in three-dimensional coordinates. Furthermore, as the height of the user's finger from the cover of the first electronic device decreases, the color of the cursor gradually darkens. When the user's finger touches the cover, the cursor with the darkest color is displayed. As the height of the user's finger from the cover of the first electronic device increases, the color of the cursor gradually darkens. When the finger height exceeds the detection distance of the first electronic device, i.e., when it exceeds the detection area range, the first electronic device cannot detect the finger and stops displaying the cursor.

[0256] In this way, the user perceives the relative positional relationship between their finger in space and the first electronic device based on changes in the display effect of the display elements, and adjusts their finger position in a timely manner to improve interaction efficiency.

[0257] In some embodiments, the first electronic device acquires the fifth finger position in response to the user's finger moving from a first finger position to a fifth finger position. The first electronic device acquires the sixth finger position in response to the user's finger moving from a second finger position to a sixth finger position. A first projection distance between the first finger position and the fifth finger position and on the first electronic device is equal to a second projection distance between the second finger position and the sixth finger position and on the first electronic device. Correspondingly, the second electronic device displays a fifth display element corresponding to the fifth finger position in response to the first electronic device detecting the fifth finger position. The second electronic device displays a sixth display element corresponding to the sixth finger position in response to the first electronic device detecting the sixth finger position. A first distance between the first display element and the fifth display element is smaller than a second distance between the second display element and the sixth display element.

[0258] For example, in the scenario shown in Figure 11, the first region within the detection area of ​​the first electronic device is the right-hand detectable region. In the right-hand detectable region, greater distances from the base of the fingers represent larger ratio coefficients used to transform the 3D coordinates, and smaller distances from the base of the fingers represent smaller ratio coefficients used to transform the 3D coordinates. In this case, when finger positions close to the base of the fingers and finger positions far from the base of the fingers move by the same distance, the corresponding movement distance of the display element will be different. For example, when a finger position close to the base of the fingers moves, the movement distance of the mapped display element is small, and when a finger position far from the base of the fingers moves, the movement distance of the mapped display element is large.

[0259] In this way, by changing the ratio coefficient, it is ensured that the user's fingers can obtain a sensitive interaction experience at either the near or far end. Thus, even if the size of the first electronic device is large for the user, the problem of excessively large finger spread in the touch control process can be avoided, and as a result, the user experience is improved.

[0260] In some embodiments, a first electronic device acquires the position of the user's seventh finger. A second electronic device, in response to the detection of the seventh finger position by the first electronic device, displays a seventh display element corresponding to the seventh finger position and modifies the display effect of an eighth display element that was originally displayed at the display position of the seventh display element.

[0261] Optionally, the modified display effect of the 8th display element will match that of the 7th display element.

[0262] For example, as shown in Figure 17(a), the first electronic device detects a 3D coordinate 1 corresponding to the user's finger and transmits the 3D coordinate 1 to the second electronic device. The second electronic device displays a cursor 171 based on the 3D coordinate 1. Then, as the user's finger moves, as shown in Figure 17(b), the first electronic device detects a 3D coordinate 2 corresponding to the user's finger and transmits the 3D coordinate 2 to the second electronic device. The second electronic device displays a cursor 171 based on the 3D coordinate 2. Furthermore, the second electronic device determines that the current display position of the cursor 171 overlaps with the display area of ​​the AI ​​Life application icon. For example, the cursor 171 is displayed above the AI ​​Life application icon. In this case, the second electronic device may enlarge the display of the AI ​​Life application icon to prompt the user that the AI ​​Life application icon can be operated at the current cursor position.

[0263] Thus, the user interaction experience can be improved by changing the display of multiple elements.

[0264] In some embodiments, the detection area of ​​the first electronic device further includes a second area, which is part of the detection area of ​​the first electronic device and is used to detect the user's finger position, where the first and second finger positions are the finger positions of the user's right hand. The first electronic device acquires an eighth finger position when the user holds the first electronic device, where the eighth finger position is at the first end of the second area of ​​the first electronic device. The first electronic device acquires a ninth finger position when the user holds the first electronic device, where the ninth finger position is at the second end of the second area of ​​the first electronic device. The first and second ends of the second area are opposite ends of the second area, which are perpendicular to the long side of the detection area, where the eighth and ninth finger positions are the finger positions of the user's left hand, and the first ends of the first and second areas are opposite ends of the detection area. Correspondingly, the second electronic device displays a ninth display element corresponding to the eighth finger position in response to the detection of the eighth finger position by the first electronic device, and the ninth display element is located at the second edge of the display area of ​​the second electronic device. The second electronic device displays a tenth display element corresponding to the ninth finger position in response to the detection of the ninth finger position by the first electronic device, and the tenth display element is located at the first edge of the display area of ​​the second electronic device.

[0265] For example, as shown in Figure 10, the user holds the first electronic device with both hands, and the detection area of ​​the first electronic device includes a right-hand detectable area 81 (e.g., the first area) and a left-hand detectable area 91 (e.g., the second area). Optionally, the right-hand detectable area 81 and the left-hand detectable area 91 do not have to overlap and are combined with the detection area of ​​the first electronic device, or the right-hand detectable area 81 and the left-hand detectable area 91 may partially overlap. When the user's right-hand fingers are positioned at the right edge of the right-hand detectable area 81 (e.g., the first edge of the first area), the second electronic device displays a cursor at the right edge of the display area (e.g., the first edge of the display area). When the user's right-hand fingers are positioned at the left edge of the right-hand detectable area 81 (e.g., the second edge of the first area), the second electronic device displays a cursor at the left edge of the display area (e.g., the second edge of the display area). When the user's left hand fingers are positioned at the left edge of the left-hand detectable area 91 (for example, the first edge of the second area), the second electronic device displays a cursor at the left edge of the display area (for example, the second edge of the display area). When the user's left hand fingers are positioned at the right edge of the left-hand detectable area 91 (for example, the second edge of the second area), the second electronic device displays a cursor at the right edge of the display area (for example, the first edge of the display area).

[0266] In this way, a right-hand detectable area and / or a left-hand detectable area are configured, and both the right-hand and left-hand detectable areas are mapped to the entire display area of ​​the display device, satisfying the user's two-handed holding requirement and reducing the difficulty of one-handed operation in this process. Therefore, user operation is unaffected because the user's fingers cannot touch certain areas.

[0267] In some embodiments, a first electronic device acquires the position of the user's tenth finger. The first electronic device transmits a plurality of first signals to the tenth finger position using a signal transmission array, the time it takes for the plurality of first signals to arrive at the tenth finger position is the same or similar.

[0268] The first signal can be optionally selected from ultrasound, high-frequency light, etc.

[0269] Thus, the first electronic device may enrich the user experience by providing haptic feedback to the user.

[0270] In some examples, a first electronic device acquires the position of the user's eleventh finger. The tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device. The first electronic device transmits multiple second signals to the eleventh finger position by using a signal transmission array, where the time it takes for the multiple second signals to arrive at the eleventh finger position is the same or similar, and the signal strength of the multiple first signals is different from the signal strength of the multiple second signals.

[0271] In this way, as the user's finger moves closer to the cover, the haptic feedback increases continuously, prompting the user to change their distance.

[0272] In some embodiments, the first electronic device acquires the position of the user's 12th finger, which is at a 5th height from the first electronic device. The second electronic device, in response to the detection of the 12th finger position by the first electronic device, displays an 11th display element corresponding to the 12th finger position, which is displayed on top of the 12th display element displayed on the second electronic device. When the 5th height is 0, the execution of a response event corresponding to the 12th display element is triggered.

[0273] For example, as shown in FIG. 17(b), as the AI Life app icon grows larger, the user determines that the current cursor 171 can operate the AI Life app icon. In this case, the user may reduce the height of the finger to trigger an operation on the AI Life application icon. As shown in FIG. 17(c), the first electronic device detects the three-dimensional coordinates 3 corresponding to the user's finger and transmits the three-dimensional coordinates 3 to the second electronic device. The second electronic device may determine that z shown in the three-dimensional coordinates 3 is equal to 0 based on the three-dimensional coordinates 3 and display a cursor 171 corresponding to the touch state. Further, the second electronic device may determine that the user indicates tapping the AI Life application icon. In this case, the second electronic device may start the AI Life application and display the AI Life application interface shown in FIG. 17(d).

[0274] Thus, as the user's finger moves in space, the second electronic device may perform a corresponding change in the display element to prompt the user for a task that the current finger can instruct the second electronic device to perform. Further, in response to a change in the height of the user's finger, the second electronic device may trigger a corresponding response event to meet the user's interaction requirements.

[0275] Optionally, the first electronic device may further perform the steps and functions executed by the touch control device in the above embodiment, and the second electronic device may further perform the steps and functions executed by the display device in the above embodiment to implement the touch control method provided in the above embodiment.

[0276] Referring to FIGS. 5 to 20, the touch control method provided in the embodiments of this application is described in detail above. Hereinafter, referring to FIG. 26, the first electronic device provided in this embodiment of this application will be described in detail, and referring to FIG. 27, the second electronic device provided in this embodiment of this application will be described in detail.

[0277] In a possible design, FIG. 26 is a diagram of the structure of a first electronic device according to an embodiment of this application. As shown in FIG. 26, the first electronic device 2600 may include a transceiver unit 2601 and a processing unit 2602. The first electronic device 2600 may be configured to implement the functions of the first electronic device (for example, a touch control device) in the embodiment of the above method.

[0278] Optionally, the transceiver unit 2601 is configured to support the first electronic device 2600 when executing S2502 and S2505 in FIG. 25.

[0279] Optionally, the processing unit 2602 is configured to support the first electronic device 2600 when executing S2501 and S2504 in FIG. 25.

[0280] The transceiver unit may include a receiving unit and a transmitting unit, and may be implemented by a transceiver or transceiver-related circuit components, or may be a transceiver or a transceiver module. The operations and / or functions of the units within the first electronic device 2600 are separately used to implement the corresponding procedures of the touch control method in the embodiment of the above method. All relevant contents of the steps in the embodiment of the above method may be cited in the function descriptions of the corresponding functional units. For the sake of brevity, details are not described again in this specification.

[0281] Optionally, the first electronic device 2600 shown in FIG. 26 may further include a storage unit (not shown in FIG. 26), and the storage unit stores programs or instructions. When the transceiver unit 2601 and the processing unit 2602 execute the programs or instructions, the first electronic device 2600 shown in FIG. 26 can execute the touch control method in the embodiment of the above method.

[0282] For the technical effects of the first electronic device 2600 shown in Figure 26, refer to the technical effects of the touch control method shown in the embodiment of the method described above. Further details will not be described again in this specification.

[0283] In addition to the form of the first electronic device 2600, the technical solutions provided in this application may also be functional units or chips within the first electronic device, or devices used together with the first electronic device.

[0284] In a possible design, Figure 27 shows the structure of a second electronic device according to an embodiment of this application. As shown in Figure 2, the second electronic device 2700 may include a transceiver unit 2701, a processing unit 2702, and a display unit 2703. The second electronic device 2700 may be configured to implement the functions of the second electronic device (e.g., a display device) in the embodiment of the method described above.

[0285] Optionally, the transceiver unit 2701 is configured to support the second electronic device 2700 when performing steps S2502 and S2505 in Figure 25.

[0286] Optionally, the processing unit 2702 is configured to support the second electronic device 2700 when executing S2503 and S2506 in Figure 25.

[0287] Optionally, the display unit 2703 is configured to support the second electronic device 2700 when performing steps S2503 and S2506 in Figure 25.

[0288] The transceiver unit may include a receiving unit and a transmitting unit, may be implemented by a transceiver or transceiver-related circuit component, or may be a transceiver or transceiver module. The operation and / or function of the units within the second electronic device 2700 are used separately to implement the corresponding steps of the touch control method in the embodiments of the above method. All relevant details of the steps in the embodiments of the above method may be referenced in the functional description of the corresponding functional unit. For brevity, further details are not described herein.

[0289] Optionally, the second electronic device 2700 shown in Figure 27 may further include a storage unit (not shown in Figure 27) which stores a program or instruction. When the transceiver unit 2701, processing unit 2702, and display unit 2703 execute the program or instruction, the second electronic device 2700 shown in Figure 27 becomes capable of executing the touch control method in the embodiment of the above method.

[0290] For the technical effects of the second electronic device 2700 shown in Figure 27, refer to the technical effects of the touch control method shown in the embodiment of the method described above. Further details will not be described again in this specification.

[0291] In addition to the form of the second electronic device 2700, the technical solutions provided in this application may also be functional units or chips within the second electronic device, or devices used together with the second electronic device.

[0292] Embodiments of this application further provide a chip system including a processor, wherein the processor is coupled to memory, and the memory is configured to store a program or instructions. When the program or instructions are executed by the processor, the chip system can implement a method according to any one of the embodiments of the method described above.

[0293] Optionally, one or more processors may be present within the chip system. A processor may be implemented using hardware or using software. When a processor is implemented using hardware, it may be a logic circuit, integrated circuit, etc. When a processor is implemented using software, it may be a general-purpose processor, implemented by reading software code stored in memory.

[0294] Optionally, one or more memories may be present within the chip system. The memory may be integrated with the processor or located separately from the processor. This is not limited to the embodiments of this application. For example, the memory may be a non-transient processor, such as a read-only memory ROM. The memory and processor may be integrated on the same chip or located separately on different chips. The type of memory and the arrangement of the memory and processor are not particularly limited to the embodiments of this application.

[0295] For example, a chip system may be a field programmable gate array (FPGA), application-specific integrated circuit (ASIC), system on chip (SoC), central processing unit (CPU), network processor (NP), digital signal processor (DSP), microcontroller unit (MCU), programmable logic device (PLD), or another integrated chip.

[0296] It should be understood that the steps in the embodiments of the above method may be completed by using integrated logic circuits of hardware in a processor or instructions in the form of software. The steps of the method disclosed in reference to the embodiments of this application may be directly executed by a hardware processor, or may be executed through a combination of hardware and software modules in a processor.

[0297] Embodiments of this application further provide a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed on a computer, the computer can execute the above related steps to realize the touch control method in the above embodiments.

[0298] Embodiments of this application further provide a computer program product. When the computer program product is executed on a computer, the computer can execute the above related steps to realize the touch control method in the above embodiments.

[0299] Furthermore, embodiments of this application further provide an apparatus. The apparatus may specifically be components or modules. The apparatus may include one or more processors and memories connected to each other. The memory is configured to store a computer program. When the computer program is executed by one or more processors, the apparatus can execute the touch control method in the embodiments of the above method.

[0300] The apparatus, computer-readable storage medium, computer program product or chip provided in the embodiments of this application are all configured to execute the corresponding method provided above. Therefore, for the beneficial effects that can be achieved, reference is made to the beneficial effects in the corresponding method provided above, and details will not be described again in this specification.

[0301] The methods or algorithmic steps described in combination with those disclosed in this embodiment of this application may be implemented by hardware or by a processor by executing software instructions. The software instructions may include corresponding software modules. The software modules may be stored in random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EPROM, EEPROM), registers, hard disks, removable hard disks, compact disk read-only memory (CD-ROM), or any other form of storage medium known in the art. For example, the storage medium may be coupled to a processor, as a result of which the processor can read information from and write information to the storage medium. Obviously, the storage medium may also be a component of the processor. The processor and the storage medium may be located in an application-specific integrated circuit (ASIC).

[0302] The above description of the implementation method allows those skilled in the art to clearly understand that, for the purpose of convenient and concise explanation, the division of the functional modules described above is used merely as an example for illustrative purposes. In actual application, the above functions may be assigned to different functional modules for implementation based on requirements. That is, the internal structure of the device is divided into different functional modules to implement all or part of the above functions. The specific operating processes of the above systems, devices, and units are described by referring to the corresponding processes in the embodiments of the above method, and the details are not described again here.

[0303] In some embodiments provided in this application, it should be understood that the disclosed methods may be implemented in other ways. The embodiments of the apparatus described above are merely examples. For example, the division into modules or units is merely a logical functional division, and other divisions may be used in actual implementations. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not performed. Furthermore, the mutual coupling, direct coupling, or communication connection indicated or discussed may be implemented through some interfaces. Indirect coupling or communication connection between modules or units may be implemented electronically, mechanically, or in other forms.

[0304] Furthermore, the functional units in the embodiments of this application may be integrated into a single processing unit, each unit may exist physically independently, or two or more units may be integrated into a single unit. The integrated unit may be implemented in hardware form or in the form of a software functional unit.

[0305] Computer-readable storage media include, but are not limited to, any one of the following: USB flash drives, removable hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks—any medium capable of storing program code.

[0306] The above description is merely a specific way of realizing this application and is not intended to limit the scope of protection of this application. Any modification or substitution within the scope of the technical scope disclosed in this application shall fall within the scope of protection of this application. Accordingly, the scope of protection of this application shall be subject to the scope of protection of the claims.

Claims

1. A touch control system comprising a first electronic device and a second electronic device, The first electronic device is When a user holds the first electronic device, a first finger position is obtained, the first finger position being at the first edge of a first region of the first electronic device, the first region being part of a detection region of the first electronic device, and the first region being used to detect the user's finger position. When the user holds the first electronic device, a second finger position is obtained, the second finger position being at the second edge of the first region of the first electronic device, the first edge of the first region and the second edge of the first region being opposite edges of the first region, and the opposite edges of the first region being perpendicular to the long side of the detection region. It is configured to do the following: The aforementioned second electronic device is In response to the detection of the first finger position by the first electronic device, a first display element corresponding to the first finger position is displayed, wherein the first display element is located at the first edge of the display area of ​​the second electronic device. In response to the detection of the second finger position by the first electronic device, a second display element corresponding to the second finger position is displayed, wherein the second display element is located at the second end of the display area of ​​the second electronic device, and the first end and the second end of the display area are opposite ends of the display area. A system configured to perform the following actions.

2. The first electronic device is The objective is to obtain the third and fourth finger positions of the user, wherein the third finger position is at a first height from the first electronic device, and the fourth finger position is at a second height from the first electronic device. It is configured to do the following: The aforementioned second electronic device is When the third finger position is at the first height from the first electronic device, a third display element having a first display effect is displayed, When the fourth finger position is at the second height from the first electronic device, a fourth display element having a second display effect is displayed, wherein the first display effect is different from the second display effect. The system according to claim 1, configured to perform the following:

3. The first electronic device is The fifth finger position is obtained in accordance with the movement of the user's finger from the first finger position to the fifth finger position, The sixth finger position is obtained in accordance with the movement of the user's finger from the second finger position to the sixth finger position, and the first projection distance between the first finger position and the fifth finger position and on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position and on the first electronic device. It is configured to do the following: The aforementioned second electronic device is In response to the detection of the fifth finger position by the first electronic device, a fifth display element corresponding to the fifth finger position is displayed. In response to the detection of the sixth finger position by the first electronic device, a sixth display element corresponding to the sixth finger position is displayed, wherein the first distance between the first display element and the fifth display element is smaller than the second distance between the second display element and the sixth display element. The system according to claim 1 or 2, configured to perform the following:

4. The first electronic device is To obtain the position of the user's seventh finger. It is configured to do the following: The aforementioned second electronic device is In response to the detection of the seventh finger position by the first electronic device, a seventh display element corresponding to the seventh finger position is displayed, To change the display effect of the 8th display element which was originally displayed at the display position of the 7th display element, A system according to any one of claims 1 to 3, configured to perform the following:

5. The system according to claim 4, wherein the modified display effect of the eighth display element is consistent with that of the seventh display element.

6. The detection area of ​​the first electronic device further includes a second area, the second area being a part of the detection area of ​​the first electronic device, the second area being used to detect the user's finger position, and the first and second finger positions being the finger positions of the user's right hand. The first electronic device is When the user holds the first electronic device, an eighth finger position is obtained, wherein the eighth finger position is at the first edge of the second region of the first electronic device. The objective is to obtain a ninth finger position when the user holds the first electronic device, the ninth finger position being at the second end of the second region of the first electronic device, the first end of the second region and the second end of the second region being opposite ends of the second region, the opposite ends of the second region being perpendicular to the long side of the detection region, the eighth finger position and the ninth finger position being the finger positions of the user's left hand, and the first end of the first region and the first end of the second region being opposite ends of the detection region. It is configured to do the following: The aforementioned second electronic device is In response to the detection of the eighth finger position by the first electronic device, a ninth display element corresponding to the eighth finger position is displayed, wherein the ninth display element is located at the second edge of the display area of ​​the second electronic device. In response to the detection of the 9th finger position by the first electronic device, a 10th display element corresponding to the 9th finger position is displayed, wherein the 10th display element is located at the first edge of the display area of ​​the second electronic device. A system according to any one of claims 1 to 5, configured to perform the following:

7. The first electronic device is To obtain the position of the user's tenth finger, The method involves transmitting multiple first signals to the tenth finger position using a signal transmission array, wherein the time it takes for the multiple first signals to arrive at the tenth finger position is the same or similar. A system according to any one of claims 1 to 6, configured to perform the following:

8. The first electronic device is The objective is to obtain the position of the user's eleventh finger, wherein the tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device. The signal transmission array is used to transmit a plurality of second signals to the 11th finger position, wherein the time it takes for the plurality of second signals to arrive at the 11th finger position is the same or similar, and the signal intensity of the plurality of first signals is different from the signal intensity of the plurality of second signals. The system according to claim 7, configured to perform the following:

9. The first electronic device is The objective is to obtain the position of the user's twelfth finger, wherein the twelfth finger position is at a fifth height from the first electronic device. It is configured to do the following: The aforementioned second electronic device is In response to the detection of the 12th finger position by the first electronic device, an 11th display element corresponding to the 12th finger position is displayed, wherein the 11th display element is displayed on top of the 12th display element displayed on the second electronic device. When the height of the fifth element is 0, the execution of the response event corresponding to the 12th display element is triggered. The system according to any one of claims 1 to 8, configured to perform the following:

10. The system according to any one of claims 1 to 9, wherein the user's finger position is a position relative to the first electronic device and includes a position generated when the user's finger performs a floating action or a touch action on the first electronic device.

11. A touch control method applied to a first electronic device, Steps include: obtaining a first finger position when a user holds the first electronic device, wherein the first finger position is at a first edge of a first region of the first electronic device, the first region being part of a detection region of the first electronic device, and the first region being used to detect the user's finger position; Steps include obtaining a second finger position when the user holds the first electronic device, wherein the second finger position is at the second edge of the first region of the first electronic device, the first edge of the first region and the second edge of the first region are opposite edges of the first region, and the opposite edges of the first region are perpendicular to the long side of the detection region, and Includes, The first finger position corresponds to a first display element displayed on a second electronic device, and the first display element is located at the first edge of the display area of ​​the second electronic device. The method wherein the second finger position corresponds to a second display element displayed on the second electronic device, the second display element is located at the second end of the display area of ​​the second electronic device, and the first end and the second end of the display area are opposite ends of the display area.

12. This method is The step of obtaining the third and fourth finger positions of the user, further comprising the steps of the third finger position being at a first height from the first electronic device and the fourth finger position being at a second height from the first electronic device, The method according to claim 11, wherein the third finger position has a first display effect and corresponds to a third display element displayed on the second electronic device, the fourth finger position has a second display effect and corresponds to a fourth display element displayed on the second electronic device, and the first display effect is different from the second display effect.

13. This method is A step of obtaining the fifth finger position in response to the movement of the user's finger from the first finger position to the fifth finger position, A step of acquiring the sixth finger position in accordance with the movement of the user's finger from the second finger position to the sixth finger position, wherein the first projection distance between the first finger position and the fifth finger position and on the first electronic device is equal to the second projection distance between the second finger position and the sixth finger position and on the first electronic device, and It further includes, The method according to claim 11 or 12, wherein the fifth finger position corresponds to a fifth display element displayed on the second electronic device, the sixth finger position corresponds to a sixth display element displayed on the second electronic device, and the first distance between the first display element and the fifth display element is smaller than the second distance between the second display element and the sixth display element.

14. This method is The process further includes the step of obtaining the position of the user's seventh finger, The method according to any one of claims 11 to 13, wherein the seventh finger position corresponds to a seventh display element displayed on the second electronic device, and the display effect of the eighth display element that was originally displayed at the display position changes before and after the seventh display element is displayed at the display position corresponding to the seventh finger position.

15. The method according to claim 14, wherein the changed display effect of the eighth display element is consistent with that of the seventh display element.

16. The detection area of ​​the first electronic device further includes a second area, the second area being a part of the detection area of ​​the first electronic device, the second area being used to detect the user's finger position, and the first and second finger positions being the finger positions of the user's right hand. This method is The steps include obtaining an eighth finger position when the user holds the first electronic device, wherein the eighth finger position is at the first edge of the second region of the first electronic device, Steps include obtaining a ninth finger position when the user holds the first electronic device, wherein the ninth finger position is at the second end of the second region of the first electronic device, the first end of the second region and the second end of the second region are opposite ends of the second region, the opposite ends of the second region are perpendicular to the long side of the detection region, the eighth finger position and the ninth finger position are the finger positions of the user's left hand, and the first end of the first region and the first end of the second region are opposite ends of the detection region, and It further includes, The eighth finger position corresponds to a ninth display element displayed on the second electronic device, and the ninth display element is located at the second edge of the display area of ​​the second electronic device. The method according to any one of claims 11 to 15, wherein the ninth finger position corresponds to a tenth display element displayed on the second electronic device, and the tenth display element is located at the first edge of the display area of ​​the second electronic device.

17. This method is The steps include obtaining the position of the user's tenth finger, The steps include transmitting a plurality of first signals to the 10th finger position using a signal transmission array, wherein the time it takes for the plurality of first signals to arrive at the 10th finger position is the same or similar, and The method according to any one of claims 11 to 16, further comprising:

18. This method is The steps include obtaining the position of the user's eleventh finger, wherein the tenth finger position is at a third height from the first electronic device, and the eleventh finger position is at a fourth height from the first electronic device, The steps include transmitting a plurality of second signals to the 11th finger position using the signal transmission array, wherein the time it takes for the plurality of second signals to arrive at the 11th finger position is the same or similar, and the signal intensity of the plurality of first signals is different from the signal intensity of the plurality of second signals. The method according to claim 17, further comprising:

19. This method is The step of obtaining the position of the user's 12th finger, further including the step that the 12th finger position is at a 5th height from the first electronic device, The method according to any one of claims 11 to 18, wherein the 12th finger position corresponds to an 11th display element displayed on the second electronic device, the 11th display element is displayed on the 12th display element displayed on the second electronic device, and the height of the 5 being 0 indicates that the second electronic device is triggered to perform a response event corresponding to the 12th display element.

20. The method according to any one of claims 11 to 19, wherein the user's finger position is a position relative to the first electronic device and includes a position generated when the user's finger performs a floating action or a touch action on the first electronic device.

21. An electronic device including a processor and memory, An electronic device wherein the memory is coupled to the processor, the memory is configured to store computer program code, the computer program code includes computer instructions, and when the processor reads the computer instructions from the memory, the electronic device becomes capable of performing the method according to any one of claims 11 to 20.

22. A computer-readable storage medium, The computer-readable storage medium includes a computer program, and when the computer program is executed on an electronic device, the electronic device becomes capable of performing the method according to any one of claims 11 to 20.

23. A computer program product, A computer program product wherein, when the computer program product is executed on a computer, the computer becomes capable of performing the method according to any one of claims 11 to 20.

Images