Touch-control method, electronic device, and system

Abstract

The present application relates to the technical field of terminals. Provided are a touch-control method, an electronic device, and a system. By means of the present application, more flexible interaction experience can be provided for a user in a hand-eye separated scenario. The method comprises: on the basis of a first holding state in which a user performs holding, a first electronic device acquiring that a user interaction position moves from a first position to a second position in a detection area; and on the basis of a second holding state in which the user performs holding, acquiring that the user interaction position moves from the first position to the second position in the detection area, wherein in the case of the first holding state, the distance between a first element corresponding to the first position that is displayed by a second electronic device and a second element corresponding to the second position that is displayed by the second electronic device is a first distance, in the case of the second holding state, the distance between the first element corresponding to the first position that is displayed by the second electronic device and the second element corresponding to the second position that is displayed by the second electronic device is a second distance, and the first holding state is different from the second holding state, and the first distance is different from the second distance.

Description

Touch methods, electronic devices and systems

[0001] This application claims priority to Chinese patent application filed on January 26, 2025, with application number 202510125400.3 and entitled "Touch Method, Electronic Device and System", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to a touch control method, electronic device and system. Background Technology

[0003] With the development of touch interaction technology, electronic devices (such as mobile phones and computers) support hand-eye synchronized touch scenarios, such as touch operations on the display screen using a mouse or fingers. Optionally, some display devices, such as smart screens and projectors, also support hand-eye separation touch scenarios. For example, when a smart screen is connected to a touch device, the touch device can send received touch events to the smart screen, allowing the user to control the smart screen via touch operations on the touch device. Compared to hand-eye synchronized touch scenarios, hand-eye separation touch scenarios can meet the user's need to control display devices from a distance.

[0004] In touch scenarios where hand-eye separation is required, the display device can proportionally control cursor movement based on the relative distance the user's finger travels on the touchscreen. However, because the cursor's display position on the screen differs from the user's finger's position on the touchscreen, the user needs to continuously monitor the cursor's movement, making it difficult to operate the cursor based on muscle memory, thus impacting the user experience. Furthermore, simultaneous operation of multiple cursors is challenging. Summary of the Invention

[0005] To address the aforementioned technical issues, this application provides a touch control method, electronic device, and system. The technical solution provided by this application can adaptively adjust the projection effect based on the user's holding position, thereby providing a more flexible interactive experience for users in hand-eye separation scenarios.

[0006] To achieve the above-mentioned technical objectives, this application provides the following technical solution:

[0007] A first aspect provides a touch control method applied to a first electronic device. The method includes: based on a first holding state of a user holding the first electronic device, obtaining a user interaction position that moves from a first position to a second position within a detection area of ​​the first electronic device; and based on a second holding state of the user holding the first electronic device, obtaining a user interaction position that moves from the first position to the second position within the detection area of ​​the first electronic device. In the first holding state, the distance between a first element corresponding to the first position and a second element corresponding to the second position displayed on the second electronic device is a first distance. In the second holding state, the distance between the first element corresponding to the first position and the second element corresponding to the second position displayed on the second electronic device is a second distance. The first and second holding states differ, and therefore the first and second distances differ as well.

[0008] In this way, the movement distance of the display elements of the second electronic device can be flexibly adjusted according to the user's holding state. This makes the touch method provided in this application applicable to various interaction scenarios under different holding states, meeting the user's flexible usage needs for the first electronic device, avoiding recognition anomalies, and avoiding impact on the user experience.

[0009] According to the first aspect, based on a user's first holding state of holding the first electronic device, obtaining the user interaction position moving from a first position to a second position within the detection area of ​​the first electronic device includes: when the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays a third element corresponding to a third position, the holding state of the first electronic device is the first holding state. Based on the user's first holding state of holding the first electronic device, obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device includes: when the user holds the first electronic device again, the user's finger enters the detection area, and the second electronic device displays a fourth element corresponding to a fourth position, the holding state of the first electronic device is the second holding state. Based on the user's second holding state of holding the first electronic device, obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device.

[0010] For example, the first electronic device acquires the user's first holding state through a sensor array or signal detection module, such as the user holding the first electronic device with their left hand while their right hand operates within the detection area of ​​the first electronic device. Correspondingly, the second electronic device can display the element corresponding to the interaction position of the user's right hand within the detection area of ​​the first electronic device, such as the second electronic device displaying a third element corresponding to a third position. Subsequently, the user stops holding the first electronic device. Afterward, the first electronic device again detects the user holding the first electronic device through the sensor array or signal detection module, acquiring the user's second holding state, such as the user holding the first electronic device with both hands and operating within the detection area of ​​the first electronic device using their left or right thumb. Correspondingly, the second electronic device can display the element corresponding to the interaction position of the user's left or right thumb within the detection area of ​​the first electronic device (such as the left-hand detection area or the right-hand detection area within the detection area), such as the second electronic device displaying a fourth element corresponding to a fourth position.

[0011] According to the first aspect, or any implementation of the first aspect above, when the user holds the first electronic device and the holding state changes, the first electronic device will not temporarily adjust the mapping method. Instead, after the current holding process ends, it will detect the user holding the first electronic device again and trigger the holding state detection. Then, the first electronic device will determine the corresponding mapping method based on the newly detected holding state. For example, corresponding to the above example, when the user holds the first electronic device again, the user's finger enters the detection area, and the second electronic device displays the fourth element corresponding to the fourth position, the holding state of the first electronic device is the second holding state. Based on the second holding state, the first electronic device obtains that the user's interaction position has moved from the first position to the second position in the detection area of ​​the first electronic device. Accordingly, the second electronic device displays the first element corresponding to the first position and the second element corresponding to the second position according to the mapping method corresponding to the second holding state.

[0012] Optionally, under different mapping methods, the scaling factor used in the process of mapping the coordinates of the user interaction position detected by the first electronic device to the display area of ​​the second electronic device is different.

[0013] In this way, the first electronic device can trigger a grip state detection after detecting that the user is holding it, and trigger the second electronic device to display corresponding elements after the user's finger enters the detection area, thereby meeting the user's interaction needs. Furthermore, during a single grip, the element display of the second electronic device is triggered by a mapping method corresponding to the same grip state, providing the user with the same grip experience during this grip process, ensuring the stability of the grip experience, and avoiding misunderstandings.

[0014] According to the first aspect, or any implementation thereof, obtaining the user interaction position moving from a first position to a second position within the detection area of ​​the first electronic device based on a first holding state of the user holding the first electronic device includes: when the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays a fifth element corresponding to a fifth position, the holding state of the first electronic device is the first holding state. Obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the user's first holding state of the first electronic device includes: when the state of at least some of the user's fingers holding the first electronic device changes, the holding state of the first electronic device switches from the first holding state to the second holding state. Obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the user's second holding state of the first electronic device includes:

[0015] According to the first aspect, or any implementation of the first aspect above, when the holding state of the first electronic device switches from a first holding state to a second holding state, before obtaining the user interaction position moving from the first position to the second position in the detection area of ​​the first electronic device based on the user's second holding state, the method further includes: obtaining the user interaction position moving from a sixth position to a seventh position in the detection area of ​​the first electronic device based on the user's second holding state, wherein the distance between the sixth and seventh positions is the same as the distance between the first and second positions. Wherein, in the second holding state, the distance between the sixth element corresponding to the sixth position and the seventh element corresponding to the seventh position displayed by the second electronic device is a third distance, which is between the first and second distances. For example, the first electronic device obtains the user's first holding state through a sensor array or signal detection module, such as the user holding the first electronic device with their left hand while their right hand operates within the detection area of ​​the first electronic device. Correspondingly, the second electronic device can display the element corresponding to the interaction position of the user's right hand in the detection area of ​​the first electronic device, such as the second electronic device displaying the fifth element corresponding to the fifth position. Subsequently, during the holding process, the user's grip or operation of either hand may change, and the corresponding grip state may change. In turn, the first electronic device can also adjust the mapping method immediately or gradually in response to the change in grip state.

[0016] For example, in the first holding state where the device is held with the left hand and operated with the right hand, the mapping method is to map the detection area of ​​the first electronic device to the display area of ​​the second electronic device, with a scaling factor of scaling factor A. In the second holding state where the device is held with both hands, or where the device is held with the left hand and operated with the left hand, the mapping method is to map the left-hand detection area (or right-hand detection area) of the first electronic device to the display area of ​​the second electronic device, with a scaling factor of scaling factor B.

[0017] Therefore, in response to the change from the first holding state to the second holding state, if the first electronic device immediately changes the mapping mode, then the first electronic device will immediately change the scaling factor used from scaling factor A to scaling factor B.

[0018] Alternatively, in response to a change from a first holding state to a second holding state, if the first electronic device changes its mapping method through gradual compensation, then as the user's finger moves within the detection area, the scaling factor used by the first electronic device will gradually change from scaling factor A to scaling factor B. Based on this, during the gradual scaling factor compensation process, if the user's interaction position moves the same distance within the detection area, the third distance mapped to the change in element position in the display area must be between the first distance of the element position change before compensation and the second distance of the element position change after compensation. For example, first distance < third distance < second distance.

[0019] Alternatively, in response to a change from the first holding state to the second holding state, if the first electronic device does not change its mapping method, it will continue to use scaling factor A until the current holding process ends. Subsequently, if the user holds the first electronic device again, and the first electronic device determines that the user's holding state is the second holding state, then the first electronic device can use scaling factor B.

[0020] In this way, the first electronic device can trigger a holding state detection after detecting that a user is holding the device, and it can also detect the user's holding state while the user is using the device. Thus, by continuously detecting the holding state, the user's need to flexibly change their operating methods during use can be met.

[0021] According to the first aspect, or any implementation of the first aspect above, the first holding state includes single-handed holding and the operating finger is a non-holding hand; the second holding state includes two-handed holding state, or single-handed holding state and the operating finger is a holding hand.

[0022] For example, the first holding state is a horizontal grip with the left hand and operation with the right hand; or, the first holding state is a horizontal grip with the right hand and operation with the left hand; or, the first holding state is a vertical grip with the left hand and operation with the right hand; or, the first holding state is a vertical grip with the right hand and operation with the left hand. For example, the second holding state is a two-handed grip. Or, the second holding state is a vertical grip with the left hand and operation with the left hand, or a vertical grip with the right hand and operation with the right hand, such as a scenario where the user holds the device with one hand and refreshes the video using their thumb.

[0023] According to the first aspect, or any of the above implementations of the first aspect, the first distance is less than the second distance.

[0024] For example, under different gripping states, based on the same distance the user's finger moves in the detection area, the corresponding element can be moved different distances in the display area. For instance, for the same finger movement distance, the distance the element moves is greater when the user is holding the device (the operating hand) than when the user is not holding the device. Thus, even when the user's hand is affected by gripping operations, different scaling factors under different mapping methods can provide a flexible interactive experience for the user in various scenarios.

[0025] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining an eighth position of the user interaction location within a first area of ​​the first electronic device based on a second holding state of the user holding the first electronic device, wherein the first area is a portion of the detection area, and the eighth position is located at the edge opposite the holding edge of the first electronic device within the first area. The eighth element displayed by the second electronic device corresponding to the eighth position is located at the edge of the display area of ​​the second electronic device.

[0026] For example, a user holds a first electronic device with both hands. The detection area of ​​the first electronic device includes a first area, such as a right-hand detection area. The user's right thumb is located at the left edge of the right-hand detection area. The right edge of the right-hand detection area is the user's gripping edge, and the eighth position on the left edge is the interaction position of the user's right thumb. In this case, a second electronic device can display a cursor corresponding to the user's finger, such as the eighth element, at a corresponding position on the left edge of the entire display area.

[0027] Thus, by configuring a right-hand detection area and / or a left-hand detection area in the first electronic device, and ensuring that both areas are mapped to the entire display area of ​​the second electronic device, the user's single-handed operation needs are met, reducing the difficulty of single-handed operation. This avoids situations where the user's fingers cannot reach certain areas, thus preventing operational disruptions.

[0028] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining a ninth position of the user interaction location within the detection area of ​​the first electronic device based on a first holding state of the user holding the first electronic device, wherein the ninth position is located at the edge opposite the holding edge of the first electronic device within the detection area. The ninth element displayed by the second electronic device corresponding to the ninth position is located at the edge of the display area of ​​the second electronic device.

[0029] For example, a user holds the first electronic device with their left hand while interacting with it in the detection area using their right hand. The first electronic device can then detect this first holding state. Subsequently, based on the user's interaction position being located at the ninth position slightly to the right of the center of the detection area, the first electronic device can trigger the second electronic device to display the corresponding element at the corresponding position slightly to the right of the center of the display area.

[0030] In this way, by detecting the holding state, the confusion between single-handed and two-handed holding scenarios is avoided, and the cursor mapping display that the user expects to be to the right is implemented on the second electronic device as a mapping to the left side of the display screen, thereby providing the user with an interactive experience that meets the actual needs.

[0031] According to the first aspect, or any implementation of the first aspect above, the four-sided edge region within the space below the cover of the first electronic device includes a sensor array, and / or, at least two opposite regions within the four-sided edge region within the space below the back panel of the first electronic device include a sensor array; wherein, the sensor array includes at least one of a capacitor array, an invisible light array, an ultrasonic array, and a camera sensor array, and the sensor array is used to detect the state of the user holding the first electronic device.

[0032] It should be understood that the first electronic device may configure the sensor array individually in the four peripheral regions of the space below the cover plate. Alternatively, the first electronic device may configure the sensor array individually in at least two opposite regions of the four peripheral regions of the space below the back plate. Alternatively, the first electronic device may configure the sensor array in the four peripheral regions of the space below the cover plate, and also configure the sensor array in at least two opposite regions of the four peripheral regions of the space below the back plate.

[0033] In this way, the first electronic device can detect the user's holding state through the configured sensor array, so as to select the appropriate mapping method according to different holding states.

[0034] According to the first aspect, or any implementation of the first aspect above, a signal detection module is installed on the edge of the first electronic device. The signal detection module is at least one of millimeter-wave radar, ultra-wideband UWB radar, inertial measurement unit (IMU), WiFi signal receiving module, and infrared transceiver module. The signal detection module is used to detect the state of the user holding the first electronic device.

[0035] In this way, the first electronic device can determine whether the user is holding the first electronic device and how the user is holding the first electronic device through various methods, thereby determining the current holding scenario and selecting an appropriate mapping method.

[0036] According to the first aspect, or any implementation of the first aspect above, the first holding state also includes a lateral holding state or a longitudinal holding state.

[0037] According to the first aspect, or any implementation of the first aspect above, the second holding state also includes a lateral holding state.

[0038] According to the first aspect, or any implementation of the first aspect above, in the horizontal holding state, the long side of the detection area corresponds to the long side of the display area of ​​the second electronic device, and the short side of the detection area corresponds to the short side of the display area; in the vertical holding state, the long side of the detection area corresponds to the short side of the display area, and the short side of the detection area corresponds to the long side of the display area.

[0039] In this way, a matching ratio coefficient can be obtained based on different holding states, thereby providing users with an interactive experience that matches the holding state.

[0040] According to the first aspect, or any implementation of the first aspect above, the user interaction position includes the position relative to the first electronic device generated by the user's finger performing a hovering or touching action on the first electronic device.

[0041] In this way, the first electronic device can detect the interaction position generated by the user's hovering or touching actions, obtain relevant information about the interaction position, and then trigger the second electronic device to display corresponding elements based on the relevant information, thereby meeting the user's hand-eye separation interaction needs.

[0042] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining, based on a first holding state of the user holding the first electronic device, the tenth position of the user interaction location within the detection area of ​​the first electronic device and a first scaling factor; obtaining, based on the tenth position and the first scaling factor, a first display position, which is used by the second electronic device to display the tenth element corresponding to the tenth position; obtaining, based on a second holding state of the user holding the first electronic device, the tenth position of the user interaction location within the detection area of ​​the first electronic device and a second scaling factor; obtaining, based on the tenth position and the second scaling factor, a second display position, which is used by the second electronic device to display the tenth element corresponding to the tenth position. Wherein, the first scaling factor and the second scaling factor are different, and the first display position and the second display position are different.

[0043] Optionally, the first electronic device can detect the interaction position of the user's finger in the detection area, thereby obtaining the three-dimensional coordinates corresponding to the interaction position. These three-dimensional coordinates can be mapped to the corresponding display position in the display area of ​​the second electronic device to display elements. In this process, the mapping method needs to be determined. Different mapping methods result in different scaling factors for mapping the three-dimensional coordinates to the display position. Optionally, the determination of the mapping method, the transformation of the three-dimensional coordinates, and the determination of the scaling factor can be performed by the first or second electronic device, or it can be performed through a cloud server.

[0044] Thus, the first electronic device calculates a scaling factor adapted to different holding states, and then transforms the three-dimensional coordinates to a suitable display position in the display area of ​​the second electronic device based on the scaling factor. This triggers the second electronic device to display elements corresponding to the user's interaction position at the appropriate display location, satisfying the user's interaction needs in different holding scenarios.

[0045] Secondly, a first electronic device is provided. The first electronic device includes a processor and a memory, the memory being coupled to the processor. The memory stores computer program code, which includes computer instructions. When the processor reads the computer instructions from the memory, the first electronic device executes: based on a first holding state of the user holding the first electronic device, it moves the user interaction position from a first position to a second position within a detection area of ​​the first electronic device. Based on a second holding state of the user holding the first electronic device, it moves the user interaction position from the first position to the second position within the detection area of ​​the first electronic device. In the first holding state, the distance between a first element corresponding to the first position and a second element corresponding to the second position displayed by the second electronic device is a first distance. In the second holding state, the distance between the first element corresponding to the first position and the second element corresponding to the second position displayed by the second electronic device is a second distance. The first and second holding states differ, and therefore the first and second distances differ as well.

[0046] According to the second aspect, based on a user's first holding state of holding the first electronic device, obtaining the user interaction position moving from a first position to a second position within the detection area of ​​the first electronic device includes: when the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays a third element corresponding to a third position, the holding state of the first electronic device is the first holding state. Based on the user's first holding state of holding the first electronic device, obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device includes: when the user holds the first electronic device again, the user's finger enters the detection area, and the second electronic device displays a fourth element corresponding to a fourth position, the holding state of the first electronic device is the second holding state. Based on the user's second holding state of holding the first electronic device, obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device.

[0047] According to the second aspect, or any implementation thereof, obtaining the user interaction position moving from a first position to a second position within the detection area of ​​the first electronic device based on the user's first holding state of holding the first electronic device includes: when the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays a fifth element corresponding to a fifth position, the holding state of the first electronic device is the first holding state. Obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the user's first holding state of holding the first electronic device includes: when the state of at least some of the user's fingers holding the first electronic device changes, the holding state of the first electronic device switches from the first holding state to the second holding state. Obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the user's second holding state of holding the first electronic device includes:

[0048] According to the second aspect, or any implementation of the second aspect above, when the holding state of the first electronic device switches from a first holding state to a second holding state, before obtaining the user interaction position from the first position to the second position in the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device, when the processor reads computer instructions from memory, it further causes the first electronic device to execute: obtaining the user interaction position from the sixth position to the seventh position in the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device, wherein the distance between the sixth position and the seventh position is the same as the distance between the first position and the second position. Wherein, in the second holding state, the distance between the sixth element corresponding to the sixth position and the seventh element corresponding to the seventh position displayed by the second electronic device is a third distance, which is between the first distance and the second distance.

[0049] According to the second aspect, or any implementation of the second aspect above, the first holding state includes single-handed holding and the operating finger is a non-holding hand; the second holding state includes two-handed holding state, or single-handed holding state and the operating finger is a holding hand.

[0050] According to the second aspect, or any implementation of the second aspect above, the first distance is less than the second distance.

[0051] According to the second aspect, or any implementation of the second aspect above, when the processor reads computer instructions from memory, it further causes the first electronic device to execute: based on a second holding state of the user holding the first electronic device, obtaining an eighth position of the user interaction location within a first region of the first electronic device, where the first region is a portion of the detection region, and the eighth position is located at the edge opposite the holding edge of the first electronic device within the first region. The eighth element displayed by the second electronic device corresponding to the eighth position is located at the edge of the display area of ​​the second electronic device.

[0052] According to the second aspect, or any implementation thereof, when the processor reads computer instructions from memory, it further causes the first electronic device to execute: based on a first holding state of the user holding the first electronic device, obtaining a ninth position of the user interaction location within the detection area of ​​the first electronic device, wherein the ninth position is located at the edge opposite the holding edge of the first electronic device within the detection area. The ninth element displayed by the second electronic device corresponding to the ninth position is located at the edge of the display area of ​​the second electronic device.

[0053] According to the second aspect, or any implementation of the second aspect above, the four-sided edge region of the space below the cover of the first electronic device includes a sensor array, and / or, at least two opposite regions of the four-sided edge region of the space below the back panel of the first electronic device include a sensor array; wherein, the sensor array includes at least one of a capacitor array, an invisible light array, an ultrasonic array, and a camera sensor array, and the sensor array is used to detect the state of the user holding the first electronic device.

[0054] According to the second aspect, or any implementation of the second aspect above, a signal detection module is installed on the edge of the first electronic device. The signal detection module is at least one of millimeter-wave radar, ultra-wideband UWB radar, inertial measurement unit (IMU), WiFi signal receiving module, and infrared transceiver module. The signal detection module is used to detect the state of the user holding the first electronic device.

[0055] According to the second aspect, or any implementation of the second aspect above, the first holding state also includes a horizontal holding state or a vertical holding state.

[0056] According to the second aspect, or any implementation of the second aspect above, in the horizontal holding state, the long side of the detection area corresponds to the long side of the display area of ​​the second electronic device, and the short side of the detection area corresponds to the short side of the display area; in the vertical holding state, the long side of the detection area corresponds to the short side of the display area, and the short side of the detection area corresponds to the long side of the display area.

[0057] According to the second aspect, or any implementation of the second aspect above, the user interaction position includes the position relative to the first electronic device generated by the user's finger performing a hovering or touching action on the first electronic device.

[0058] According to the second aspect, or any implementation thereof, when the processor reads computer instructions from memory, it further causes the first electronic device to execute: Based on a first holding state of the user holding the first electronic device, obtaining the tenth position of the user interaction location within the detection area of ​​the first electronic device and a first scaling factor. Based on the tenth position and the first scaling factor, obtaining a first display position, which is used by the second electronic device to display the tenth element corresponding to the tenth position. Based on a second holding state of the user holding the first electronic device, obtaining the tenth position of the user interaction location within the detection area of ​​the first electronic device and a second scaling factor. Based on the tenth position and the second scaling factor, obtaining a second display position, which is used by the second electronic device to display the tenth element corresponding to the tenth position. Wherein, the first scaling factor and the second scaling factor are different, and the first display position and the second display position are different.

[0059] Thirdly, a touch control system is provided. The system includes a first electronic device and a second electronic device. The first electronic device is configured to: based on a first holding state of a user holding the first electronic device, determine whether the user interaction position moves from a first position to a second position within a detection area of ​​the first electronic device; and based on a second holding state of the user holding the first electronic device, determine whether the user interaction position moves from the first position to the second position within the detection area of ​​the first electronic device. The second electronic device is configured to: in the first holding state, define a first distance between a first element corresponding to the first position and a second element corresponding to the second position; and in the second holding state, define a second distance between the first element corresponding to the first position and the second element corresponding to the second position. The first and second holding states differ, and therefore the first and second distances differ as well.

[0060] According to a third aspect, a first electronic device is configured to: obtain a user interaction position moving from a first position to a second position within a detection area of ​​the first electronic device based on a first holding state of the user holding the first electronic device, including: when the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays a third element corresponding to a third position, the holding state of the first electronic device is the first holding state. Obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the first holding state of the user holding the first electronic device includes: when the user holds the first electronic device again, the user's finger enters the detection area, and the second electronic device displays a fourth element corresponding to a fourth position, the holding state of the first electronic device is the second holding state. Obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device.

[0061] According to the third aspect, or any implementation thereof, a first electronic device is configured to: obtain a user interaction position moving from a first position to a second position within a detection area of ​​the first electronic device based on a first holding state of the user holding the first electronic device, including: when the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays a fifth element corresponding to a fifth position, the holding state of the first electronic device is the first holding state. Obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the first holding state of the user holding the first electronic device. Obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on a second holding state of the user holding the first electronic device includes: when the state of at least some of the user's fingers holding the first electronic device changes, the holding state of the first electronic device switches from the first holding state to the second holding state. Obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device.

[0062] According to the third aspect, or any implementation of the third aspect above, when the holding state of the first electronic device switches from a first holding state to a second holding state, before the user interaction position is moved from a first position to a second position in the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device, the first electronic device is configured to: based on the second holding state of the user holding the first electronic device, move the user interaction position from a sixth position to a seventh position in the detection area of ​​the first electronic device, wherein the distance between the sixth position and the seventh position is the same as the distance between the first position and the second position. The second electronic device is configured to: in the second holding state, define the distance between the sixth element corresponding to the sixth position and the seventh element corresponding to the seventh position as a third distance. Wherein, the third distance is between the first distance and the second distance.

[0063] According to the third aspect, or any of the above implementations of the third aspect, the first holding state includes single-handed holding with the operating fingers belonging to a non-holding hand; the second holding state includes a two-handed holding state, or a single-handed holding state with the operating fingers belonging to a holding hand.

[0064] According to the third aspect, or any of the above implementations of the third aspect, the first distance is less than the second distance.

[0065] According to the third aspect, or any implementation thereof, the first electronic device is configured to: obtain an eighth position of the user interaction location within a first area of ​​the first electronic device based on a second holding state of the user holding the first electronic device, wherein the first area is a portion of the detection area, and the eighth position is located at the edge opposite the holding edge of the first electronic device within the first area. The second electronic device is configured to: display an eighth element corresponding to the eighth position, wherein the eighth element is located at the edge of the display area of ​​the second electronic device.

[0066] According to the third aspect, or any implementation thereof, the first electronic device is configured to: obtain a ninth position of the user interaction location within the detection area of ​​the first electronic device based on a first holding state of the user holding the first electronic device, wherein the ninth position is located at the edge opposite to the holding edge of the first electronic device within the detection area. The second electronic device is configured to: display a ninth element corresponding to the ninth position, wherein the ninth element is located at the edge of the display area of ​​the second electronic device.

[0067] According to the third aspect, or any implementation of the third aspect above, the four-sided edge region within the space below the cover of the first electronic device includes a sensor array, and / or, at least two opposite regions within the four-sided edge region within the space below the back panel of the first electronic device include a sensor array; wherein, the sensor array includes at least one of a capacitor array, an invisible light array, an ultrasonic array, and a camera sensor array, and the sensor array is used to detect the state of the user holding the first electronic device.

[0068] According to the third aspect, or any implementation of the third aspect above, a signal detection module is installed on the edge of the first electronic device. The signal detection module is at least one of millimeter-wave radar, ultra-wideband UWB radar, inertial measurement unit (IMU), WiFi signal receiving module, and infrared transceiver module. The signal detection module is used to detect the state of the user holding the first electronic device.

[0069] According to the third aspect, or any of the above implementations of the third aspect, the first holding state also includes a horizontal holding state or a vertical holding state.

[0070] According to the third aspect, or any implementation of the third aspect above, in the horizontal holding state, the long side of the detection area corresponds to the long side of the display area of ​​the second electronic device, and the short side of the detection area corresponds to the short side of the display area; in the vertical holding state, the long side of the detection area corresponds to the short side of the display area, and the short side of the detection area corresponds to the long side of the display area.

[0071] According to the third aspect, or any implementation of the third aspect above, the user interaction position includes the position relative to the first electronic device generated by the user's finger performing a hovering or touching action on the first electronic device.

[0072] According to the third aspect, or any implementation thereof, a first electronic device is configured to: obtain, based on a first holding state of the user holding the first electronic device, a tenth position of the user interaction location within a detection area of ​​the first electronic device and a first scaling factor; obtain a first display position based on the tenth position and the first scaling factor; obtain, based on a second holding state of the user holding the first electronic device, a tenth position of the user interaction location within a detection area of ​​the first electronic device and a second scaling factor; and obtain a second display position based on the tenth position and the second scaling factor. A second electronic device is configured to: in the first holding state, display a tenth element corresponding to the tenth position at the first display position; and in the second holding state, display a tenth element corresponding to the tenth position at the second display position. Wherein, the first scaling factor and the second scaling factor are different, and the first display position and the second display position are different.

[0073] Fourthly, an electronic device is provided that has the function of implementing the touch method as described in the first aspect and any of its possible implementations. This function can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the described function.

[0074] Fifthly, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program (also referred to as instructions or code) that, when executed by an electronic device, causes the electronic device to perform the method of the first aspect or any embodiment of the first aspect.

[0075] In a sixth aspect, a computer program product is provided that, when the computer program product is run on an electronic device, causes the electronic device to perform the method of the first aspect or any one of the embodiments of the first aspect.

[0076] In a seventh aspect, a circuit system is provided, the circuit system including processing circuitry configured to perform the method of the first aspect or any embodiment of the first aspect.

[0077] Eighthly, a chip system is provided, including at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor, and when the at least one processor executes the instructions, the at least one processor performs the method of the first aspect or any embodiment of the first aspect.

[0078] The technical effects of the aforementioned aspects can be referenced from each other, and will not be elaborated further here. Attached Figure Description

[0079] Figure 1 is a schematic diagram of a touch scenario provided in an embodiment of this application;

[0080] Figure 2 is a second schematic diagram of a touch scenario provided in an embodiment of this application;

[0081] Figure 3 is a schematic diagram of a touch scenario provided in an embodiment of this application;

[0082] Figure 4 is a schematic diagram of the communication system in which the touch method provided in the embodiments of this application is applied;

[0083] Figure 5 is a schematic diagram of the hardware structure of the first electronic device provided in an embodiment of this application;

[0084] Figure 6 is a schematic diagram of module interaction provided in an embodiment of this application;

[0085] Figure 7 is a schematic diagram of a touch scenario provided in an embodiment of this application;

[0086] Figure 8 is a schematic diagram of a capacitance data detection scenario provided in an embodiment of this application;

[0087] Figure 9 is a schematic diagram of the working principle of the position detection module provided in the embodiment of this application;

[0088] Figure 10 is a schematic diagram of the position of the holding state detection module provided in an embodiment of this application;

[0089] Figure 11 is a schematic diagram of a holding state detection scenario provided in an embodiment of this application;

[0090] Figure 12 is a schematic diagram of a second holding state detection scenario provided in an embodiment of this application;

[0091] Figure 13 is a schematic diagram of a gripping state detection scenario provided in an embodiment of this application;

[0092] Figure 14 is a schematic diagram of a grip state detection scenario provided in an embodiment of this application;

[0093] Figure 15 is a schematic diagram of a gripping state detection scenario provided in an embodiment of this application;

[0094] Figure 16 is a schematic diagram of the position of the grip state detection module provided in an embodiment of this application;

[0095] Figure 17 is a schematic diagram of the position of the grip state detection module provided in the embodiment of this application;

[0096] Figure 18 is a schematic diagram of a touch scenario provided in an embodiment of this application;

[0097] Figure 19 is a schematic diagram of a touch scenario provided in an embodiment of this application;

[0098] Figure 20 is a schematic diagram of a touch scenario provided in an embodiment of this application;

[0099] Figure 21 is a schematic diagram of a touch scenario provided in an embodiment of this application;

[0100] Figure 22 is a schematic diagram of a touch scenario provided in an embodiment of this application;

[0101] Figure 23 is a schematic diagram of a touch scenario provided in an embodiment of this application;

[0102] Figure 24 is a schematic diagram of a touch scenario provided in an embodiment of this application;

[0103] Figure 25 is a schematic flowchart of the touch method provided in an embodiment of this application;

[0104] Figure 26 is a schematic diagram of the structure of the first electronic device provided in an embodiment of this application;

[0105] Figure 27 is a schematic diagram of the structure of the second electronic device provided in an embodiment of this application. Detailed Implementation

[0106] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings. In the description of the embodiments of this application, the terminology used in the following embodiments is for the purpose of describing specific embodiments only and is not intended to be a limitation of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include expressions such as “one or more,” unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, “at least one” and “one or more” refer to one or more (including two).

[0107] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized. The term "connection" includes direct connections and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.

[0108] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.

[0109] In some embodiments, electronic devices such as mobile phones, smart screens, in-vehicle screens, and projectors can achieve touch interaction. Touch scenarios include hand-eye synchronization scenarios and hand-eye separation scenarios. For example, in a hand-eye synchronization scenario, the display device and the touch device are the same device. For instance, a mobile phone displays an application interface and responds to the user's touch operations on the application interface, executing corresponding tasks. Alternatively, in a hand-eye separation scenario, the display device and the touch device are different devices. Optionally, the touch device may be, for example, a keyboard and mouse, an air mouse remote control, or a touchscreen device, thereby facilitating user control of a distant display device.

[0110] In some examples, in hand-eye separation scenarios, the display device can proportionally control the movement of the cursor based on the relative distance the user's finger moves on the touch device.

[0111] For example, a wired or wireless communication connection is established between the display device and the touch device, and the display device and / or the touch device can obtain a scaling factor between the display device and the touch device. This scaling factor is, for example, the scaling factor between the display area of ​​the display device and the detection area on the cover plate of the touch device. As shown in Figure 1, after the touch device detects the movement distance Δd of the user's finger on the cover plate, it can send the movement distance Δd as a touch event to the display device. Correspondingly, when the display device receives the touch event while displaying the cursor, it can obtain the movement distance Δd' according to the scaling factor and move the display cursor according to the movement distance Δd', thereby providing the user with a hand-eye separation touch interaction experience.

[0112] However, in the aforementioned hand-eye separation scenario, any touch operation by the user at any location on the detection area of ​​the touch device can control the cursor on the display device to move proportionally a corresponding distance. That is, the cursor's display position on the display device is inconsistent with the user's finger's position on the touch device. Therefore, during interaction, the user needs to continuously monitor the cursor's movement, making it difficult to operate the cursor based on muscle memory, thus impacting the user experience. Furthermore, simultaneous operation of multiple cursors is difficult.

[0113] In other examples, corresponding to the hand-eye separation scenario described above, a correspondence can be established between the coordinates of the detection area on the touch device and the coordinates of the display area on the screen. This allows the user's operation position on the touch device to be mapped onto the display device according to a proportional coefficient, thus displaying the cursor at the corresponding position. Therefore, the user can flexibly control the cursor display based on the position of their finger on the touch device.

[0114] Optionally, in the scenario of holding the touch device with both hands as shown in Figure 2, the detection area of ​​the touch device can be further divided into a left-hand detection area and a right-hand detection area. The left-hand detection area is the left-hand portion of the entire detection area, which can be mapped to the entire display area of ​​the display device; the right-hand detection area is the right-hand portion of the entire detection area, which can also be mapped to the entire display area of ​​the display device. The left-hand and right-hand detection areas may or may not overlap. For example, as shown in Figure 2, each coordinate position in both the left-hand and right-hand holding areas can be mapped to the entire display area of ​​the display device. Thus, in the holding scenario, the user can also operate the cursor displayed on the display device with one hand on the touch device.

[0115] In the aforementioned holding scenarios, the touch device needs to first identify the left and right hands, and then implement the corresponding mapping scheme based on the left and right hands. However, if the finger is misidentified, it may lead to abnormal projection. For example, if the touch device identifies the left thumb as the right thumb, and the user moves the left thumb to the right edge of the left hand detection area, after projection, the cursor will be projected onto the left edge of the display area of ​​the display device, affecting user experience.

[0116] Furthermore, in scenarios where a user holds a touchscreen device with one hand, if the user operates the device with their other, unheld hand, the range of motion of the unheld fingers is not limited by the gesture and can easily cover the entire detection area of ​​the touchscreen device. However, due to the aforementioned mapping scheme, if the touch operation of the unheld hand exceeds the corresponding left-hand or right-hand detection area, it may lead to recognition anomalies, causing abnormal cursor display and affecting user experience. For example, as shown in Figure 3, if a user holds the touchscreen device with their left hand, the touchscreen device recognizes the current holding state and needs to map the left-hand or right-hand detection area to the display area. However, in reality, if the user operates within the detection area of ​​the touchscreen device using their right hand, the range of motion of the right-hand fingers covers the entire detection area. In one possible scenario, if the user's right-hand fingers touch the left edge of the right-hand detection area, the user expects this operation to display the cursor near the center of the display area (as shown in Figure 3, the expected cursor display position). However, after the touch device sends the touch event to the display device, the display device will display the cursor on the left edge of the display area according to the mapping between the right-hand detection area and the display area (as shown in Figure 3). Obviously, the current cursor display position is not the display position expected by the user.

[0117] Therefore, this application provides a touch control method that can adaptively adjust the projection effect according to the user's holding state, thereby providing users with a more flexible touch control experience in hand-eye separation scenarios.

[0118] Figure 4 is a schematic diagram of a communication system for the touch method provided in this application embodiment. As shown in Figure 4, the communication system includes a first electronic device 100 and a second electronic device 200.

[0119] Optionally, the first electronic device 100 may be a dedicated touch device or a device with touch functionality. For example, the first electronic device 100 may be a touch device specifically configured for the second electronic device 200. Alternatively, the first electronic device 100 may be a terminal device such as a mobile phone, tablet, wearable device, or AI device. The first electronic device 100 may be a device with a display screen or a device without a display screen. When the first electronic device 100 has a display screen, it can provide touch functionality on the screen using related components, or the display and touch functions may be set in separate areas. When the first electronic device 100 does not have a display screen, it can provide touch functionality through a touchpad or a combination of touchpads with other components. The operating system installed on the first electronic device 100 includes, but is not limited to, […]. Alternatively, the first electronic device 100 may use other operating systems, or it may not have an operating system installed. This application does not limit the specific type of the first electronic device 100, whether it has an operating system installed, or the operating system installed.

[0120] Optionally, the second electronic device 200 may be a smart screen, in-vehicle screen, projector, computer, tablet computer, laptop computer, mobile phone, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), wearable device, artificial intelligence (AI) device, or other terminal device. The operating system installed on the second electronic device 200 may include, but is not limited to, […]. Alternatively, other operating systems may be used. This application does not limit the specific type of the second electronic device 200 or the operating system installed on it.

[0121] In some embodiments, a wireless communication connection is established between the first electronic device 100 and the second electronic device 200. The wireless communication technology used to establish this connection includes, but is not limited to, at least one of the following: wireless local area networks (WLAN) (such as Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT) (e.g., classic Bluetooth or Bluetooth Low Energy (BLE)), near field communication (NFC), Zigbee, frequency modulation (FM), infrared (IR), ultra-wideband (UWB), and star-flash technology.

[0122] Optionally, the first electronic device 100 and the second electronic device 200 can also establish a communication connection through a third-party device in the local area network, such as a router, gateway, or server.

[0123] In other embodiments, a wired communication connection is established between the first electronic device 100 and the second electronic device 200. This wired communication connection can be established, for example, via a Universal Serial Bus (USB) interface.

[0124] Optionally, the first electronic device 100 can be used as a set with the second electronic device 200, serving as a dedicated touch device for the second electronic device 200. Alternatively, the first electronic device 100 can be sold or used independently, and after establishing a communication connection with the second electronic device 200, it can become a usable touch device for the second electronic device 200.

[0125] Optionally, the second electronic device 200 can establish a communication connection with one or more first electronic devices 100, thereby enabling multiple people to control the second electronic device 200 through different first electronic devices 100.

[0126] Optionally, Figure 5 is a schematic diagram of the hardware structure of the first electronic device 100 provided in an embodiment of this application. As shown in Figure 5, the first electronic device 100 may include a processor 110, a memory 120, a wireless communication module 130, a power management module 140, a grip state detection module 150, a position detection module 160, an audio module 170, buttons 180, and a motor 190, etc.

[0127] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the first electronic device 100. In other embodiments of this application, the first electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0128] For example, the first electronic device 100 may also include a USB interface. This USB interface conforms to the USB standard specification and can specifically be a Mini USB interface, Micro USB interface, USB Type-C interface, etc. The USB interface can be used to connect a charger to charge the first electronic device 100, or to transfer data between the first electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback.

[0129] In some embodiments, the first electronic device establishes a wired communication connection with the second electronic device 200 via a USB interface. Subsequently, after detecting the location of the user's finger, the first electronic device 100 sends the location of the user's finger to the second electronic device 200 via the wired communication connection.

[0130] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0131] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0132] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0133] The wireless communication function of the first electronic device 100 can be implemented through an antenna, a wireless communication module 130, a modem processor, and a baseband processor.

[0134] Antennas are used to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antennas can be multiplexed as diversity antennas for a wireless local area network. In some other embodiments, antennas can be used in conjunction with tuning switches.

[0135] The wireless communication module 130 can provide solutions for wireless communication applications applied to the first electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 130 can be one or more devices integrating at least one communication processing module. The wireless communication module 130 receives electromagnetic waves via an antenna, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to the processor 110. The wireless communication module 130 can also receive signals to be transmitted from the processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via the antenna.

[0136] In some embodiments, the first electronic device establishes a wireless communication connection with the second electronic device 200 via the wireless communication module 130. Subsequently, after detecting the position of a user's finger, the first electronic device 100 sends the position of the user's finger to the second electronic device 200 via the wireless communication connection, so that the second electronic device 200 can display a corresponding display element (e.g., a cursor) at the corresponding position on the display screen based on the finger position.

[0137] The position detection module 160 is used to detect the position of a user's finger in the detection area of ​​the first electronic device 100. Optionally, the detection area is a preset space range located above the cover of the first electronic device 100. The first electronic device 100 can be a mobile device or a non-mobile device. The space above the cover of the first electronic device 100 is used to indicate the orientation corresponding to the cover of the first electronic device 100. In some examples, the orientation corresponding to the cover of the first electronic device 100 is not necessarily physically above (such as the sky direction). That is, in this embodiment, the space above the cover of the first electronic device 100 is the space above the orientation of the detection area. For example, if a user holds the first electronic device 100 and the first electronic device 100 is tilted towards the user for easier operation, then the space above the detection area of ​​the first electronic device 100 can also be the preset space range tilted towards the user as indicated by the detection area.

[0138] In some embodiments, the position detection module 160 may include a hover detection module and a touch detection module. Optionally, the hover detection module is used to detect hover data of the user's finger, and the touch detection module is used to detect touch data of the user's finger. Optionally, the hover data and touch data are, for example, the three-dimensional coordinates of the user's finger located in the detection area. The z-coordinate of the touch data is 0, meaning that when the user's finger touches the cover of the first electronic device 100, the height of the finger position relative to the cover of the first electronic device 100 is 0. In some examples, the hover detection module and the touch detection module may be combined into a single position detection module 160, or the hover detection module and the touch detection module may be two independent modules.

[0139] In some embodiments, the first electronic device 100 is configured with a cover plate. Optionally, the cover plate is located above the position detection module 160. In some examples, the cover plate is part of the housing of the first electronic device 100. In some examples, the cover plate can also be used to display images, videos, etc. The cover plate includes a display panel. The display panel can be manufactured using a liquid crystal display (LCD), such as an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini-LED, a Micro-LED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc.

[0140] In some embodiments, the holding state detection module 150 is used to detect how the user holds the first electronic device 100. Optionally, the way the user holds the first electronic device 100 may include holding it with both hands or holding it with one hand.

[0141] In some examples, the grip detection module 150 and the position detection module 160 can be the same module. For example, the position detection module 160 is located under the entire cover and is used to detect user operations at any position in the detection area above the cover. However, a user typically only grips a portion of the cover surface located at the four edges, while the central area is used for touch or hover operations. Therefore, the portion corresponding to the four edges in the position detection module 160 can be described as the grip detection module 150, used to detect the user's grip state on the first electronic device 100.

[0142] In other examples, the grip state detection module 150 and the position detection module 160 may not be the same module. For example, the front of the first electronic device 100 is the plane where the cover plate is located. Then, the grip state detection module 150 can also be configured on the back of the first electronic device 100. That is, the grip state detection module 150 includes the portion corresponding to the four edges of the position detection module 160 and the portion laid out on the back of the first electronic device 100.

[0143] Alternatively, the grip state detection module 150 may be a separate module, distinct from the position detection module 160, installed around the first electronic device 100.

[0144] The specific implementation methods of the position detection module 160 and the grip state detection module 150 are described in detail below.

[0145] In some embodiments, the first electronic device 100 is equipped with an image acquisition module, which can be used to acquire user images, such as those used to determine user identity; it can also be used to acquire user finger images, such as those used to determine the position of the user's fingers, the way the device is held, etc.

[0146] Optionally, the second electronic device 200 has the same, similar, or slightly different hardware structure as shown in Figure 5. For example, in addition to the hardware shown in Figure 5, the second electronic device 200 may also include hardware such as a display screen, a camera, and a sensor module.

[0147] In some embodiments, the display screen can be used to display images, videos, etc. The display screen includes a display panel. The display panel can be manufactured using LCD, such as OLED, active-matrix organic light-emitting diode or AMOLED, FLED, Mini-led, Micro-led, Micro-oled, QLED, etc.

[0148] In some embodiments, the second electronic device 200 establishes a wireless communication connection with the first electronic device 100 via a wireless communication module. After receiving the user's finger position sent by the first electronic device 100, the wireless communication module of the second electronic device 200 sends the finger position to a processor. Based on the user's finger position, the processor determines the display position and display effect of the display element (such as a cursor) corresponding to the finger position. Then, the second electronic device 200 can display the display element corresponding to the user's finger position at the determined display position and according to the determined display effect.

[0149] In some embodiments, the second electronic device 200 may not include the grip state detection module 150 and the position detection module 160 as shown in FIG. 5. For example, the first electronic device 100 detects the user's grip state through the grip state detection module 150, and the second electronic device 200 does not need to detect the user's grip state. The first electronic device 100 detects the user's finger position through the position detection module 160, and the second electronic device 200 does not need to detect the user's finger position, but can directly receive the user's finger position sent by the first electronic device 100.

[0150] The following section uses the first electronic device 100 as a touch device and the second electronic device 200 as a display device as an example to describe in detail the touch method provided in the embodiments of this application.

[0151] In some embodiments, a communication connection is established between the display device and the touch device. This communication connection can be wired or wireless. For example, the display device and the touch device can establish a wired connection via a USB interface, or a Bluetooth communication connection via Bluetooth technology.

[0152] In some examples, the display device and the touch device are complementary devices, meaning that one display device is equipped with at least one dedicated touch device. Alternatively, the touch device can respond to user input and establish communication connections with different display devices, making it convenient for users to operate different display devices while carrying the touch device.

[0153] For example, as shown in FIG6, a communication connection is established between the peripheral interface 621 of the display device 62 and the peripheral interface 611 of the touch device 61 to meet the communication requirements between the display device 62 and the touch device 61. Afterwards, the processing module 612 of the touch device 61, upon acquiring user data, can send the user data to the display device 62 through the peripheral interface 611. Correspondingly, the display device 62 receives the user data sent by the touch device 61 through the peripheral interface 621 and processes the user data through the processing module 622 to display relevant content through the display module 623. Optionally, the user data may include, for example, the position of the user's finger detected by the position detection module 615 of the touch device 61, such as the three-dimensional coordinates of the user's finger relative to the touch device 61. Based on the position of the user's finger, the display device 62 can display a corresponding cursor to help the user determine the current location of the operation. Optionally, the user data may also include, for example, the grip state data detected by the grip state detection module 614 of the touch device 61. The grip state data is used to indicate the user's grip state on the touch device 61. For example, grip states include single-handed grip, double-handed grip, etc., where single-handed grip can further include single-handed side grip, single-handed center grip, etc. Optionally, different grip states correspond to different projection scenarios, and different projection scenarios have different applicable scaling factors. Therefore, the display device 62 can combine the grip state data to obtain the scaling factor applicable to the current projection scenario. Then, the display device 62 can convert the three-dimensional coordinates indicated by the user data according to this scaling data to respond to the user's touch events, such as displaying the cursor, at a more suitable position on the display area. The implementation process of the display device 61 obtaining the scaling factor based on the grip state data is described in detail below and will not be repeated here.

[0154] It should be understood that the structure illustrated in FIG6 does not constitute a specific limitation on the touch device 61. In other embodiments of this application, the touch device 61 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. For example, the touch device 61 may also include a power management module 613 for powering other modules. Similarly, the structure illustrated in FIG6 does not constitute a specific limitation on the display device 62; for example, the display device 62 may also include a power management module 624 for powering other modules.

[0155] In some embodiments, the touch device can be used to detect the position of a user's finger within the detection area of ​​the touch device, such as the three-dimensional coordinates corresponding to the center position of the user's finger, to meet the user's need to control the displayed content of the display device via touch. Optionally, the user's finger position includes the position relative to the touch device resulting from the user's finger performing a hovering or touching action on the touch device.

[0156] It should be understood that this application embodiment uses three-dimensional coordinates as an example to describe the user's finger position. Optionally, the touch device may not support hover detection. In that case, the user's finger position obtained by the touch device or display device is the two-dimensional coordinates detected after the user's finger touches the detection area. In addition, this application embodiment also supports users to perform touch operations through a stylus or the like, and is not limited to touch operations with the user's finger.

[0157] In some examples, users control a cursor displayed on a screen by moving their fingers in the space above the touch device. Specifically, as the user's finger hovers above the touch device or touches it, the touch device detects changes in the three-dimensional coordinates of the user's finger in the space above it and displays a moving cursor corresponding to those coordinates on the screen. This way, the user can be aware of the current movement of their finger, such as direction, position, and height, without having to switch their gaze to the touch device.

[0158] Optionally, the display device displays a display element corresponding to the position of the user's finger. This display element can be the cursor mentioned above, or it can be a game controller, the outline of the user's finger, a virtual character, or other forms. The following section uses a cursor as an example to illustrate the display elements displayed by the display device.

[0159] For example, as shown in Figure 7, the touch device detects a user's finger located in the corresponding detection area of ​​the cover plate (which can also be described as a touch screen, touch panel, etc.) and determines the three-dimensional coordinates (x, y, z) of the user's finger. Then, the touch device sends these three-dimensional coordinates (x, y, z) to the display device. Correspondingly, the display device receives these three-dimensional coordinates (x, y, z) and displays a cursor 71 at the corresponding position on the display screen based on these coordinates. For instance, if the user's finger is located near the center of the left edge above the cover plate of the touch device, the display device can also display the cursor 71 near the center of the left edge of its display screen, thereby helping the user understand the current finger position and facilitating subsequent finger movement to control changes in the displayed content.

[0160] In subsequent embodiments, the terms "up", "down", "left" and "right" refer to the orientation shown in Figure 7, and will not be repeated below.

[0161] In some embodiments, the detection area of ​​the touch device includes a space within a preset height range above a cover plate and a touch area on the surface of the cover plate. The detection area is used to detect hovering touch operations of a user's finger above the cover plate, as well as touch operations on the cover plate of the touch device.

[0162] In some embodiments, the display device can acquire the size information of the detection area of ​​the touch device (such as the entire cover plate or a portion thereof), such as length and width. This allows the display device to determine the size ratio between the detection area of ​​the touch device and the display area of ​​the display screen, for example, as shown in Figure 7, where the length ratio is 'a' and the width ratio is 'b'. Subsequently, after acquiring the three-dimensional coordinates sent by the touch device, the display device can adapt these coordinates to the current display area based on the determined size ratio, including length ratio 'a' and width ratio 'b'. This allows the display device to display a cursor that moves with the finger position according to the size ratio, thus avoiding misinterpretations caused by a mismatch between the user's finger movement and the cursor's display position. Furthermore, by constructing the size ratio, it is not necessary for the detection area of ​​the touch device and the display area of ​​the display device to be the same size, simplifying user operation with a smaller screen while meeting the user's need for a larger screen display.

[0163] For example, as shown in Figure 7, when a user's finger is located within the detection area of ​​the touch device, the touch device can obtain the position of the user's finger and send the corresponding three-dimensional coordinates to the display device. Correspondingly, after receiving the three-dimensional coordinates (x, y, z), the display device obtains the coordinates (x*a, y*b) based on the x and y values ​​indicated in the three-dimensional coordinates, as well as the scales a and b, and displays the cursor 71 at the coordinate (x*a, y*b) position.

[0164] In some embodiments, the touch device is a fixed device or a handheld mobile device. In some examples, the user may hold the touch device in different ways, and in these different ways, the user will use different operating methods to operate within the detection area of ​​the touch device. In these different operating methods, the area accessible to the user's fingers within the detection area varies, resulting in different sizes of the operating area that actually needs to be mapped onto the display area of ​​the display device.

[0165] For example, in the scenario shown in Figure 7, the user may not be holding the touch device or may be holding it with their left hand, but operating it with their right hand. In this mode of operation, the reachable area of ​​the user's finger (e.g., the right index finger) is the entire detection area. Therefore, the display device can map the user's finger position on the touch device to the corresponding position on the display area based on the size ratio between the display area of ​​the display device and the detection area of ​​the touch device.

[0166] For example, a user holds the touch device with both hands or one hand and operates it using the hand in the holding position within the device's detection area. The touch device can then redetermine the scaling factor based on the reach of the user's fingers within the detection area. For instance, if the user holds the touch device with both hands and operates it using their left thumb and / or right thumb, the touch device can determine the left-hand operation ratio between the left-hand detection area and the left-hand operation ratio between the right-hand detection area. Subsequently, the display device can map the user's finger position on the touch device to the corresponding position on the display area based on the scaling factor, the left-hand operation ratio, and the right-hand operation ratio. Alternatively, the display device can directly map the operation position to the corresponding position on the display area based on the scaling factor between the display area and the left-hand detection area, and directly based on the scaling factor between the display area and the right-hand detection area.

[0167] Optionally, the touch device sends a detection event to the display device, which includes the detected position (e.g., three-dimensional coordinates) of the user's finger within the detection area. Optionally, the detection event may also include a scaling factor. For example, the touch device can obtain the size information of the display area of ​​the display device and determine the user's finger's operating area based on the current grip state, thereby determining the scaling factor. Alternatively, the detection event may also include the size information of the operating area, allowing the display device to obtain the scaling factor based on the size information of the operating area and the size information of the display area. Alternatively, the detection event may also include grip state data, allowing the display device to determine the operating area based on the grip state data, and thus determine the scaling factor between the operating area and the display area. That is, this embodiment does not limit whether the size data of the operating area or the scaling factor is determined by the touch device or the display device.

[0168] In this way, the mapping method can be flexibly determined according to the user's holding state, making the touch method provided in this application applicable to a variety of touch scenarios, meeting the user's flexible use needs for touch devices, avoiding recognition abnormalities, and affecting the user's user experience.

[0169] The following section provides a detailed explanation of the process for determining the user's holding state.

[0170] In some embodiments, a position detection module, including a sensor array, is disposed beneath the cover of the touch device. When a user's finger approaches the surface of the touch device's cover, the detection data corresponding to the position detection module changes, allowing the touch device to determine that a user's hand is currently near the detection area. In this embodiment, as a specific implementation, using a capacitor array as the sensor array and capacitance as the corresponding detection data, the process by which the touch device determines the presence of a user's hand entering the detection area is described.

[0171] The capacitor array may include one or more capacitor modules. When a user's hand or other charged conductor enters the detection area of ​​the touch device (or, as described, approaches or touches the cover), the capacitance value of these one or more capacitor modules changes (e.g., increases or decreases), allowing the touch device to determine that a user's hand has entered the detection area. In some embodiments, these one or more capacitor modules may be distributed in different areas under the cover. When a user's hand or other charged conductor approaches a certain area within the detection area of ​​the touch device, the capacitance value of the capacitor module distributed in the corresponding area changes, allowing the touch device to determine which area within the detection area the user's hand has approached. In other words, in this embodiment, the touch device can not only determine whether a user's hand is approaching the cover, but also determine which area within the detection area the user's hand has approached, thereby determining the user's operating position.

[0172] Optionally, the aforementioned one or more capacitor modules can be composed of horizontally arranged electrode arrays and vertically arranged electrode arrays. In some implementations, as shown in Figure 8(a), two sets of electrodes (such as horizontal electrode 81 and vertical electrode 82) form a capacitor 83 at their intersection. That is, a horizontally arranged electrode and the vertically arranged electrode that intersects with it each form the two poles of a capacitor, thus forming a capacitor module. When the user's hand approaches the cover of the touch device, it affects the coupling between the two electrodes near the position, thereby changing the capacitance between the two electrodes and causing the capacitance value to change, which in turn changes the capacitance value of the capacitor module near the position. When detecting the capacitance value, the horizontally arranged electrodes can sequentially emit excitation signals, and all the vertically arranged electrodes simultaneously receive signals. In this way, the capacitance values ​​of all intersection points (such as capacitor 83) on the display screen can be obtained, that is, the capacitance value of each capacitor module can be obtained.

[0173] Of course, in other implementations, horizontally arranged electrodes and vertically arranged electrodes can also form a capacitor with ground, that is, form a capacitor module. Alternatively, the capacitance value of all the capacitors to ground on the display screen can be obtained by detecting the capacitance between the electrodes and ground, that is, the capacitance value of each capacitor module can be obtained.

[0174] Optionally, the aforementioned horizontally arranged electrode array and vertically arranged electrode array can be achieved by etching different ITO conductive circuit modules on two different nano-indium tin oxide (ITO) conductive glass coatings, with the etched patterns on the two modules being perpendicular to each other.

[0175] In other embodiments, the above-mentioned one or more capacitor modules may also be configured in other ways or have other arrangements, and this application embodiment does not impose specific limitations on this.

[0176] In some embodiments, the change in capacitance value of the position detection module under the cover of the touch device is relatively slight when the user's hand approaches the cover, affecting the determination of the user's operation position. Therefore, to improve the accuracy of the user's operation position and reduce errors, the touch device can use time-domain aggregation to determine whether the capacitance value of the position detection module has changed. Time-domain aggregation refers to the touch device detecting the capacitance value of the position detection module within a preset time period. When it is determined that the capacitance value of the position detection module meets a preset condition within the preset time period, it is determined that the capacitance of the position detection module has changed, thereby determining that a user's hand has entered the detection area of ​​the touch device. For example, in this embodiment, the preset condition may include a capacitance value change greater than or equal to a preset change threshold. Optionally, the change may include, for example, the difference between the average capacitance value detected over a period of time and a preset capacitance value. Optionally, the change may also include, for example, the difference between the average capacitance value of a certain area of ​​the touch device's display screen detected over a period of time and a preset capacitance value. The preset capacitance value is, for example, a pre-configured reference capacitance value. The reference capacitance value can be the average value measured by the position detection module of the touch device in the past when no other conductors were nearby.

[0177] Optionally, by combining spatial and temporal aggregation, the capacitance value of a certain area on the position detection module of the touch device can be determined. This area can be the region where the user's hand is near, i.e., the region where the capacitance value changes slightly. When the capacitance value of this region meets a preset condition within a preset time period, it is determined that the capacitance of the position detection module has changed, thus determining which area of ​​the detection region the user's hand is near. As shown in Figure 8(b), when the user's hand approaches region 801 on the position detection module of the touch device, the touch device detects a slight change in the capacitance value in region 801. Optionally, region 801 can include one or more capacitor modules as described above. The capacitance value of region 801 can be determined based on the capacitance value of each of these capacitor modules, such as the mean, median, or other numerical representations of these capacitor modules. Then, it is detected whether the capacitance value of region 801 meets the preset condition within a preset time period. If the preset condition is met, the touch device can determine that the user's hand is near region 801 on the position detection module of the touch device.

[0178] In the above embodiment, the sensor array in the position detection module of the touch device is a capacitor array and the detection data is capacitance data, which is used as an example to introduce the process of determining the operation position of the user's hand. In other embodiments, the detection data can also be parameters converted from capacitance, such as current and voltage.

[0179] Similarly, the sensor array in the position detection module can also be of other types, such as invisible light array, ultrasonic array, or camera, etc., to determine the user's hand operation position by detecting the corresponding light signal, ultrasonic signal, or image.

[0180] In some examples, the position detection module may include a hover detection module and a touch detection module. It should be understood that the hover detection module and the touch detection module can also be two separate modules used to detect the user's hand position.

[0181] For example, as shown in Figure 9(a), a touch detection module 92 is disposed below the cover plate 91 of the touch device. This touch detection module 92 detects the user's finger touch operation through methods such as capacitive touch detection, resistive touch detection, surface acoustic wave touch detection, infrared touch detection, piezoelectric touch detection, etc. Below the touch detection module 92, a hover detection module 93 is disposed. This hover detection module 93 detects the three-dimensional coordinates corresponding to the user's finger through methods such as a high-sensitivity capacitive array, invisible light array, ultrasonic array, camera, etc.

[0182] It should be understood that the structure shown in Figure 9(a) does not constitute a specific limitation on the touch device. For example, the hover detection module may also be located above the touch detection module.

[0183] Optionally, as shown in Figure 9(a), the levitation detection module 93 is an invisible light emitting or receiving array. The touch device emits light through the invisible light emitting array and determines the location with the strongest light signal intensity by measuring the intensity and distribution of the light signal received by the invisible light receiving array, and determines the three-dimensional coordinates of that location, such as the center of the user's fingertip.

[0184] Optionally, as shown in Figure 9(b), the levitation detection module 93 is an ultrasonic transmitting or receiving array. The touch device emits ultrasonic waves through the ultrasonic transmitting array and determines the location with the strongest ultrasonic signal intensity by analyzing the intensity and distribution of the ultrasonic signal received by the ultrasonic receiving array, and determines the three-dimensional coordinates of that location, such as the center of the user's fingertip.

[0185] Optionally, as shown in Figure 9(c), the hover detection module 93 is a camera, such as an ultra-wide-angle camera or a fisheye camera. The touch device captures an image by focusing at close range through the camera and performs image recognition on the image to determine the three-dimensional coordinates corresponding to the center position of the finger. For example, the three-dimensional coordinates corresponding to the center of the user's fingertip are determined through image recognition. Optionally, when the hover detection module 93 is a camera, the cover of the touch device is, for example, a transparent cover, so that the hover detection module 93 can capture images through the cover.

[0186] In this way, touch devices can flexibly detect the three-dimensional coordinates of the finger in various ways, improve the accuracy of finger position detection, improve the responsiveness of cursor movement, and thus enhance the user experience.

[0187] The following section uses a capacitor array as an example to describe in detail the process of detecting the user's holding state.

[0188] In some embodiments, when a user holds a touch device, a portion of their hand may touch certain areas on the edge of the cover surface, such as a portion of the area around the perimeter of the cover surface. This portion can then be designated as a grip state detection area. The touch device can determine the user's grip state based on data detected in the grip state detection area. Optionally, a grip state detection module is used to determine the user's grip state based on data detected in the grip state detection area. This grip state detection module is part of a position detection module and is located at the perimeter of the position detection module.

[0189] For example, as shown in Figure 10, the grip state detection module includes the leftmost column K1, the rightmost column K2, the bottom row K3, and the top row K4 in the sensor array of the position detection module. The grip state detection area may include, for example, the S1 area corresponding to the leftmost column K1, the S2 area corresponding to the rightmost column K2, the S3 area corresponding to the bottom row K3, and the S4 area corresponding to the top row K4 in the sensor array corresponding to the cover plate. During the user's gripping of the touch device, the capacitance data of at least one of these four grip state detection areas will change. Therefore, based on the detected changes in capacitance data, the touch device can determine the area touched by the user's hand, and thus determine the user's grip state.

[0190] Optionally, as described above, the touch device determines whether the user's hand is near or touches the cover plate based on whether the detected capacitance data meets preset conditions. These preset conditions may include a change in capacitance value greater than or equal to a preset change threshold. Therefore, the touch device can determine whether the user's hand is near or touches the grip detection area based on whether the average capacitance value of the corresponding grip detection area is equal to or equal to the preset change threshold.

[0191] For example, the average capacitance values ​​of the four holding state detection areas, S1, S2, S3, and S4, are as follows: The preset change threshold is C th .

[0192] For example, in In such cases, the touch device can determine that the current user is not holding the touch device, indicating that the touch device is in a no-hold scenario.

[0193] For example, as shown in Figure 11, in and In this case, the touch device can determine that the user is currently holding the touch device with both hands, such as when the touch device is held with both hands.

[0194] For example, as shown in Figure 12, in and In this case, the touch device can determine that the current user is holding the touch device with their left hand, indicating that the touch device is in a one-handed holding scenario.

[0195] For example, as shown in Figure 13, in and In this case, the touch device can determine that the current user is holding the touch device with their right hand, indicating that the touch device is in a one-handed holding scenario.

[0196] For example, as shown in Figure 14, in and In this case, the touch device can determine the top and bottom edges of the touch device currently being held by the user, such as when the touch device is being held in a one-handed scenario.

[0197] In this way, the touch device can determine the user's grip state based on the change in capacitance value of the grip state detection area, so that the display device can obtain a more accurate response position on the display area during subsequent operation position mapping.

[0198] Optionally, the sensitivity of the sensor array for detecting the user's grip, located in the perimeter area beneath the cover of the touch device, can be higher than that of sensor arrays in other locations. This allows the touch device to more accurately detect the user's grip through the sensor array in this perimeter area. Alternatively, the touch device can improve the sensitivity of the sensor array through different circuit structures or other methods.

[0199] Alternatively, the sensor array can be arranged only in the four peripheral areas of the space beneath the cover of the touch device. For example, as mentioned above, the sensor array for detecting the user's grip is part of a sensor array for detecting the user's interaction position in the detection area. Alternatively, the touch device can have a separate sensor array arranged in the four peripheral areas of the space beneath the cover, while the user's interaction position in the detection area is detected by other means. For example, the three-dimensional coordinates of the user's finger can be detected using radar or similar methods.

[0200] Optionally, users may use different operating methods to operate on the detection area of ​​the touch device in different holding scenarios. For example, in a two-handed holding scenario as shown in Figure 11, the user may need to operate on the detection area of ​​the touch device using their left thumb and / or right thumb. As another example, in a one-handed holding scenario as shown in Figures 12, 13, or 14, the user may need to operate on the detection area of ​​the touch device using their other hand that is not holding the touch device.

[0201] Optionally, the reachable area of ​​a user's finger within the detection area varies depending on the operation method, resulting in different sizes of the actual reachable area that needs to be mapped to the display area of ​​the display device. For example, in the two-handed grip scenario shown in Figure 11, the user operates with their thumb within the detection area of ​​the touch device. The reachable area of ​​the thumb within the detection area is only a portion of that area. Therefore, mapping the entire detection area to the display area of ​​the display device would lead to an incorrect mapping position. Thus, the touch device needs to map the reachable area to the display area to obtain the correct mapping position. As another example, in the one-handed grip scenario shown in Figures 12, 13, or 14, the user operates with a non-handed grip within the detection area. The reachable area of ​​the non-handed grip within the detection area could be, for example, the entire detection area. Therefore, mapping the entire detection area to the display area of ​​the display device will yield the correct mapping position. Furthermore, in the non-handed grip scenario, the reachable area of ​​the user's finger within the detection area could be, for example, the entire detection area. Therefore, mapping the entire detection area to the display area of ​​the display device will yield the correct mapping position.

[0202] It should be understood that the above-mentioned mapping position is used to indicate the position on the display area of ​​the display device by mapping the three-dimensional coordinates corresponding to the user's operation in the detection area of ​​the touch device to the display area of ​​the display device according to the scaling factor.

[0203] Thus, by determining the holding scenario, it becomes easier to correctly determine the scaling factor used for mapping 3D coordinates. The specific mapping method is described in detail below and will not be repeated here.

[0204] In some embodiments, relying solely on capacitance values ​​may lead to incorrect judgments regarding the grip scenario. For example, in a one-handed grip scenario as shown in Figure 12, where the user holds the touch device with their left hand, they can operate the device using either their right hand or their left thumb within the detection area. The proportional coefficients for these different operation methods differ. Similarly, in a one-handed grip scenario as shown in Figure 14, where the user holds the touch device by its top and bottom edges, the user can choose to continue operating the touch device in landscape mode or opt for the more convenient portrait mode. The proportional coefficients for these different grip directions also differ.

[0205] Therefore, touch devices can further refine touch scenarios by combining detection data from one or more sensors configured in the touch device, or user selection data.

[0206] For example, in a one-handed grip scenario as shown in Figure 12 or Figure 13, if a user operates the touch device's detection area using their thumb while holding the device, the touch device can acquire three-dimensional coordinates, as shown in Figure 15, which have a coordinate distribution extending inward from the edge of the detection area. Therefore, the touch device or display device can determine, based on the acquired three-dimensional coordinate distribution characteristics, that the user is currently operating within the touch device's detection area while holding the device. This is an example of a one-handed grip scenario involving hand-holding.

[0207] Alternatively, if the touch device detects that it is currently in a holding scenario, it can send a touch scenario selection request to the display device. In response to this touch scenario selection request, the display device can display a prompt message to prompt the user to select either a scenario where the current holding scenario is a one-handed holding without handshake operation, or a scenario where the current holding scenario is a one-handed holding with handshake operation.

[0208] For example, touch devices are equipped with gyroscope sensors. In a one-handed holding scenario as shown in Figure 14, the touch device can determine whether it is in landscape or portrait mode based on the gyroscope sensor's detection data, thus determining whether it is a landscape or portrait one-handed holding scenario. For instance, in a landscape one-handed holding scenario, the scaling factor includes the ratio of the longer side of the display area to the longer side of the detection area, and the ratio of the shorter side of the display area to the shorter side of the detection area; in a portrait one-handed holding scenario, the scaling factor includes the ratio of the shorter side of the display area to the longer side of the detection area, and the ratio of the longer side of the display area to the shorter side of the detection area.

[0209] In this way, touch devices can combine various detection data to obtain a more accurate holding scenario, which makes it easier to obtain the mapping position of user operation according to different holding scenarios.

[0210] In some embodiments, when a user holds a touch device, their hand will touch the back of the device. Therefore, a sensor array can also be configured on the back of the touch device to more accurately determine the user's holding state and thus identify the correct holding scenario. Optionally, the holding state detection module includes this sensor array located on the back of the touch device. Optionally, the sensor array can be configured on a portion or all of the area on the back of the touch device corresponding to the holding state detection area.

[0211] For example, as shown in Figure 16(a), a sensor array is installed on the edge areas of the two short sides of the back of the touch device to increase the accuracy of determining whether the user is holding the device with both hands or with one hand. Alternatively, as shown in Figure 16(b), a sensor array can also be installed on the four edges of the back of the touch device to increase the accuracy of determining whether the user is holding the device with both hands, holding it with one hand on the side, or holding it with one hand in the middle.

[0212] In some embodiments, the present application does not limit the determination of the holding scenario to the detection data of the sensor array described above. For example, the holding state detection module can also be implemented as a mounting signal detection module installed on the edge of the touch device. Optionally, the signal detection module may be, for example, a millimeter-wave radar, an ultra-wideband (UWB) radar, an inertial measurement unit (IMU), a WiFi signal receiving module, an infrared transceiver module, etc.

[0213] For example, as shown in Figure 17, millimeter-wave radars are installed around the four edges of the touch device. These millimeter-wave radars can transmit and receive millimeter-wave radar signals. If the touch device determines that the echo energy P of a millimeter-wave radar signal received by a certain millimeter-wave radar is similar to the energy of the transmitted millimeter-wave radar signal, it can determine that the edge where the millimeter-wave radar is located is not obstructed by the user's hand, i.e., the user is not holding that edge. If the touch device determines that the energy difference between the echo energy P of a millimeter-wave radar signal received by a certain millimeter-wave radar and the energy of the transmitted millimeter-wave radar signal is greater than a preset difference threshold, the touch device can determine that the edge where the millimeter-wave radar is located is obstructed by the user's hand, i.e., the user is holding that edge.

[0214] For example, as shown in Figure 17, the echo energies of the millimeter-wave radars installed around the edges of the touch device are P1, P2, P3, and P4, respectively. The touch device can then determine whether the millimeter-wave radar at a corresponding location is obstructed based on these changes in echo energy, thereby determining the corresponding holding state. For instance, if the energy difference between the echo energy P1 received by the left-side millimeter-wave radar and the energy of the transmitted millimeter-wave radar signal is greater than a preset difference threshold, the touch device can determine that the left edge of the touch device is obstructed by the user's hand, i.e., the user is holding the touch device with their left hand.

[0215] Thus, based on the energy changes of transmitting and receiving millimeter-wave signals, it is possible to determine whether the user is holding the touch device and how they are holding it, thereby determining the current holding scenario.

[0216] For example, the space where the touch device is located may also contain a WiFi signal transmitting module (such as a router), and a WiFi signal receiving module installed on the edge of the touch device may receive the WiFi signal transmitted by the WiFi signal transmitting module and determine the received signal strength indicator (RSSI). Therefore, if the RSSI of a WiFi signal received by a certain WiFi signal receiving module is less than a signal strength threshold, the touch device can determine that the edge where the WiFi signal receiving module is located is blocked by the user's hand, i.e., the user is holding that edge.

[0217] Optionally, the touch device can also combine detection data from the edge-mounted signal detection module and the detection data from the sensor array mounted on the back to determine the user's holding status.

[0218] In this way, the touch device can combine various detection data to determine whether the user is holding the touch device and how they are holding it, thereby determining the current holding scenario.

[0219] The above section introduced the process of determining the holding scenario; the following section introduces the mapping methods in different holding scenarios.

[0220] In some embodiments, when a user holds a touch device and operates it using their thumb within the detection area of ​​the touch device, the flexibility of operation is limited, such as the reduced reach of the fingers. Therefore, the touch device can be divided into its entire detection area, and the operable detection area can be determined based on the reach of the user's fingers when holding the touch device, so as to facilitate a wider range of free control of the display device by the user while holding it.

[0221] For example, as shown in Figure 18(a), taking the cover of the touch device and the display screen of the display device as rectangles, with the top and bottom sides as long sides and the left and right sides as short sides, when the user holds the touch device with their right hand, their right thumb is located in the detection area of ​​the touch device and can be used to control the movement of the cursor displayed on the display device. Optionally, the detection area of ​​the touch device includes a right-hand detection area 181, which is a portion of the detection area of ​​the touch device and is used to detect the position of the user's finger. Furthermore, when the user's finger is at any position in the right-hand detection area 181, the cursor can be displayed at any corresponding position on the display screen. For example, as shown in Figure 18(a), when the user's finger is located at the right edge 1811 of the right-hand detection area 181, the display device can display the cursor corresponding to the user's finger at the corresponding position on the right edge of the entire display area. As another example, as shown in Figure 18(b), when the user's finger is located at the left edge 1812 of the right-hand detection area 181, the display device can display the cursor corresponding to the user's finger at the corresponding position on the left edge of the entire display area.

[0222] Optionally, the right-hand detection area 181 includes the touch area within the reach of the right thumb and the space above it when the user holds the touch device with their right hand. For example, the longer side of the detection area within the reach of the right thumb is smaller than the longer side of the detection area of ​​the touch device, and / or the shorter side of the detection area within the reach of the right thumb is smaller than the shorter side of the detection area of ​​the touch device.

[0223] For example, as shown in Figure 19(a), taking the cover of the touch device and the display screen of the display device as rectangles, with the top and bottom sides as long sides and the left and right sides as short sides, when the user holds the touch device with their left hand, the left thumb is located in the detection area of ​​the touch device and can be used to control the movement of the cursor displayed on the display device. Optionally, the detection area of ​​the touch device includes a left-hand detection area 191, which is a part of the detection area of ​​the touch device and is used to detect the position of the user's finger. Furthermore, when the user's finger is at any position in the left-hand detection area 191, the cursor can be displayed at any corresponding position on the display screen. For example, as shown in Figure 19(a), when the user's finger is located at the left edge 1911 of the left-hand detection area 191, the display device can display the cursor corresponding to the user's finger at the corresponding position on the left edge of the entire display area. As another example, as shown in Figure 19(b), when the user's finger is located at the right edge 1912 of the left-hand detection area 191, the display device can display the cursor corresponding to the user's finger at the corresponding position on the right edge of the entire display area.

[0224] Optionally, the left-hand detection area 191 includes the touch area within the reach of the user's left thumb and the space above it when the user holds the touch device with their left hand. For example, the longer side of the touch area within the reach of the left thumb is smaller than the longer side of the detection area of ​​the touch device, and / or the shorter side of the detection area within the reach of the left thumb is smaller than the shorter side of the detection area of ​​the touch device.

[0225] As another example, as shown in Figure 20, the detection area of ​​the touch device includes a right-hand detection area 181 and a left-hand detection area 191 to meet the two-hand operation requirements when a user holds the touch device with both hands. Optionally, the right-hand detection area 181 and the left-hand detection area 191 may or may not overlap. For example, the right-hand detection area 181 and the left-hand detection area 191 may not overlap, forming the entire detection area, or the right-hand detection area 181 and the left-hand detection area 191 may partially overlap. Both the right-hand detection area 181 and the left-hand detection area 191 can be mapped to the entire display area of ​​the display device.

[0226] Thus, by configuring a right-hand detection area and / or a left-hand detection area, and ensuring that both areas are mapped to the entire display area of ​​the device, the user's one-handed operation needs are met, reducing the difficulty of one-handed operation. This avoids situations where the user's fingers cannot reach certain areas, thus preventing operational disruptions.

[0227] The above examples illustrate left-hand, right-hand, and two-handed holding scenarios, all of which can be determined using the sensor arrays and other methods described above. The following section details the mapping process for different user operation methods within these various holding scenarios.

[0228] In some embodiments, a user may choose to operate the touch device by holding it with their hands or one hand while holding the touch device. As described above, the touch device can detect the user's actions in the corresponding left-hand detection area and / or right-hand detection area, and then display the corresponding element (such as a cursor) or trigger the corresponding operation on the display area of ​​the display device. That is, the display device maps the user's operation to the display area according to a ratio between the size of the detection area where the user actually operates and the size of the display area. For example, the ratio between the size of the left-hand detection area and the display area size for a left-hand grip is used to map left-hand grip operations; the ratio between the size of the right-hand detection area and the display area size for a right-hand grip is used to map right-hand grip operations.

[0229] Optionally, the left-hand detection area and / or right-hand detection area are not necessarily mapped to the entire display area of ​​the display device, but rather correspond to designated portions of the entire display area of ​​the display device.

[0230] Optionally, the size of the right-hand detection area or the left-hand detection area can be a pre-configured size in the touch device, which can be obtained by the display device after establishing a communication connection with the touch device. Alternatively, if the touch device (or display device) detects that the user is using the touch device for the first time, or detects that the user has indicated an operation to update the right-hand detection area or the left-hand detection area, it can prompt the user to collect the size of the right-hand detection area or the left-hand detection area corresponding to the user's fingers when holding the touch device, so as to obtain a size of the right-hand detection area or the left-hand detection area that is more suitable for the current user, or it can be automatically determined by the device based on the user's usage habits. Optionally, the size of the right-hand detection area or the left-hand detection area can be updated while the user is holding the touch device.

[0231] In some examples, the display device can map and transform the acquired three-dimensional coordinates according to a fixed ratio coefficient between its own display area and the right-hand or left-hand detection area of ​​the touch device.

[0232] For example, when a user holds the touch device with their right hand and operates it using their right thumb within the detection area of ​​the touch device, the ratio between the display area of ​​the display device and the right-hand detection area of ​​the touch device is (a, b). As shown in Figure 18(a), the touch device, through the detection data of the holding state detection module, determines that the current holding state is a right-hand single-hand grip with the hand being the operating hand. Therefore, the touch device can obtain the right-hand detection area 181 and its size. Subsequently, the touch device, through the position detection module, obtains the current user finger operation position coordinates as (x1, y1, z1). The touch device sends these coordinates (x1, y1, z1) to the display device. Optionally, the touch device sends the size of the right-hand detection area 181 to the display device so that the display device can obtain the ratio (a1, b1) between the size of the right-hand detection area 181 and the size of the display area. Alternatively, the touch device may know the size of the display area of ​​the display device. In this case, the touch device can obtain the ratio and send it to the display device. Alternatively, the display device may know the dimensions or scaling factor (a1, b1) of the right-hand detection area 181. Then, when the touch device sends an instruction to the display device that the device is holding and operating with its right hand, the display device can directly obtain the scaling factor (a1, b1). Subsequently, the display device can determine the mapped coordinates (x1*a1, y1*b1) based on the coordinates (x1, y1, z1) and the scaling factor (a1, b1), and respond to corresponding events at those coordinate positions, such as displaying a cursor. Here, a1 = a, b1 = b.

[0233] The display device performs coordinate transformation according to a fixed scaling factor. Therefore, any operation performed by the user at any position within the right-hand detection area 181 can be displayed in the display area according to this fixed scaling factor. For example, as shown in Figure 18(b), if the user moves their right-hand finger to the left edge of the right-hand detection area, the display device can determine the mapped coordinates as (x2*a2, y2*b2) based on the coordinates (x2, y2, z2) and the scaling factor (a2, b2). Here, a2 = a, b2 = b.

[0234] For example, if a user holds the touch device with their left hand and operates it using their left thumb within the detection area of ​​the touch device, the ratio between the display area of ​​the display device and the left-hand detection area of ​​the touch device is (a, b). As shown in Figure 19(a), the touch device, through the detection data of the holding state detection module, determines that the current holding state is a left-hand single-hand grip with the hand being the operating hand. Therefore, the touch device can obtain the left-hand detection area 191 and its size. Subsequently, the touch device, through the position detection module, obtains the current user finger operation position coordinates as (x3, y3, z3). The touch device sends these coordinates (x3, y3, z3) to the display device. Optionally, the touch device sends the size of the left-hand detection area 191 to the display device so that the display device can obtain the ratio (a3, b3) between the size of the left-hand detection area 191 and the size of the display area. Alternatively, the touch device may know the size of the display area of ​​the display device. In this case, the touch device can obtain the ratio and send it to the display device. Alternatively, the display device may know the dimensions or scale factor (a3, b3) of the left-hand detection area 191. Then, when the touch device sends an instruction to the display device that the left hand is holding and operating the device, the display device can directly obtain the scale factor (a3, b3). Subsequently, the display device can determine the mapped coordinates (x3*a3, y3*b3) based on the coordinates (x3, y3, z3) and the scale factor (a3, b3), and respond to corresponding events at that coordinate position, such as displaying a cursor. Here, a3 = a, b3 = b.

[0235] The display device performs coordinate transformation according to a fixed scaling factor. Therefore, any operation performed by the user at any position within the left-hand detection area 191 will be displayed in the display area according to this fixed scaling factor. For example, as shown in Figure 19(b), if the user moves their left-hand finger to the left edge of the left-hand detection area, the display device can determine the mapped coordinates as (x4*a4, y4*b4) based on the coordinates (x4, y4, z4) and the scaling factor (a4, b4). Here, a4 = a, b4 = b.

[0236] It should be understood that the ratio coefficients between the display area of ​​the display device and the right-hand detection area of ​​the touch device, and the ratio coefficients between the display area of ​​the display device and the left-hand detection area of ​​the touch device, may be the same or different. In this embodiment, the example where both are the same (a, b) is used to illustrate the coordinate mapping transformation process.

[0237] In this way, by setting the scaling factor, the user's operation in the detection area of ​​the touch device can be mapped to the display device with a larger display area for display, thus meeting the user's need for flexible control of the display device.

[0238] In other examples, during touch operation, the closer the center of the finger is to the base of the finger, the more flexible and easier the operation; conversely, the farther the center of the finger is from the base, the more difficult and challenging the operation. Therefore, the display device can be set with a dynamically changing scaling factor, so that the scaling factor is smaller when the center of the finger is closer to the base and larger when the center of the finger is farther from the base, thereby increasing touch sensitivity.

[0239] For example, in the scenario illustrated in Figures 18(a) and (b) above, where the right hand holds the touch device and operates it in the detection area of ​​the touch device using the right thumb, for example, a2 > a1 > a, b2 > b1 > b. Optionally, a and b can also be ratio coefficients between the display area of ​​the display device and the detection area of ​​the touch device.

[0240] For example, in the scenario illustrated in Figures 19(a) and (b) above, where the left hand holds the touch device and operates it in the detection area of ​​the touch device using the left thumb, for example, a4 > a3 > a, b4 > b3 > b. Optionally, a and b can also be ratio coefficients between the display area of ​​the display device and the detection area of ​​the touch device.

[0241] In this way, by varying the scaling factor, a relatively responsive interactive experience is ensured whether the user's finger is near or far from the touchpad. This prevents excessive finger span during touch operation, even when the touch device is relatively large for the user, thus improving the user experience.

[0242] Based on the above description of users holding the touch device with their right hand and left hand, in some embodiments, as shown in FIG20, when the user holds the touch device with both hands, when the touch device sends the three-dimensional coordinates corresponding to the detected user operation to the display device, it can carry an indication in the three-dimensional coordinates whether the three-dimensional coordinates are coordinates in the left-hand detection area or the right-hand detection area. In this way, after receiving the three-dimensional coordinates, the display device can also realize the transformation of the three-dimensional coordinates according to the corresponding scaling factor, and then display a cursor or trigger other response events at the corresponding position in the display area. Optionally, the scaling factor can be a fixed scaling factor or a dynamically changing scaling factor.

[0243] As shown in Figure 21(a), the touch method provided in this embodiment of the application, through the detection of the holding state, can realize the mapping and transformation of three-dimensional coordinates when the user operates by holding the hand. This allows a shorter distance of finger movement to be mapped to a longer distance on the display device, meeting the user's need for flexible operation. Compared to Figure 21(b), where the user's finger moves the same distance but cannot control the cursor movement distance on the display device, the touch method provided in this embodiment of the application can provide users with a user experience that better meets their actual needs.

[0244] In some embodiments, when a user holds a touch device with one hand, they may operate within the detection area of ​​the touch device using a non-handheld grip. The non-handheld finger can operate at any position within the detection area. Therefore, during the 3D coordinate mapping process, it is no longer necessary to separately distinguish between the left-hand and right-hand detection areas. Instead, the detected 3D coordinates can be directly mapped to the display area of ​​the display device for cursor display or to trigger other response events.

[0245] For example, as shown in Figure 12, the touch device determines that the current holding state is a left-hand single-handed grip by detecting the user's grip state. Then, the touch device can determine that the current mapping scenario is a mapping of the entire detection area, not just the left-hand detection area. Alternatively, the touch device can determine that the current holding state is a left-hand single-handed grip and not a right-handed operation by detecting the user's grip state. Then, the touch device can determine that the current mapping scenario is a mapping of the entire detection area, not just the left-hand detection area.

[0246] For example, as shown in Figure 13, the touch device determines that the current holding state is a right-handed single-handed grip by detecting the user's grip state. Then, the touch device can determine that the current mapping scenario is a mapping of the entire detection area, not just the right-handed detection area. Alternatively, the touch device can determine that the current holding state is a right-handed single-handed grip and not a left-handed operation by detecting the user's grip state. Then, the touch device can determine that the current mapping scenario is a mapping of the entire detection area, not just the right-handed detection area.

[0247] As another example, as shown in Figure 14, the touch device determines that the current holding state is a single-handed grip (left or right hand holding in the middle). Then, the touch device can determine that the current mapping scenario is a mapping of the entire detection area, rather than a mapping of the left-hand or right-hand detection area. Alternatively, the touch device can determine that the current holding state is a single-handed grip with the non-holding hand operating. Afterward, the touch device can determine that the current mapping scenario is a mapping of the entire detection area, rather than a mapping of the left-hand or right-hand detection area.

[0248] Optionally, in the holding scenario shown in Figure 14, the user can choose to hold the touch device horizontally or vertically. Therefore, during the mapping of the entire detection area, a mapping ratio coefficient also needs to be determined. For example, as shown in Figure 22, during horizontal holding, the ratio coefficient includes the ratio of the long side of the display area of ​​the display device to the long side of the detection area of ​​the touch device, and the ratio of the short side of the display area of ​​the display device to the short side of the detection area of ​​the touch device. As shown in Figure 23, during vertical holding, the ratio coefficient includes the ratio of the long side of the display area of ​​the display device to the short side of the detection area of ​​the touch device, and the ratio of the short side of the display area of ​​the display device to the long side of the detection area of ​​the touch device.

[0249] It should be understood that the single-handed holding scenario shown in Figure 12 or Figure 13 is also a horizontal holding scenario. The two-handed holding scenario in Figure 11 is also a horizontal holding scenario, but in this horizontal holding scenario, the right-hand ratio factor includes the ratio of the long side of the display area to the long side of the right-hand detection area, and the ratio of the short side of the display area to the short side of the right-hand detection area; the left-hand ratio factor includes the ratio of the long side of the display area to the long side of the left-hand detection area, and the ratio of the short side of the display area to the short side of the left-hand detection area.

[0250] As shown in Figure 24(a), the touch method provided in this embodiment of the application can achieve three-dimensional coordinate mapping transformation when the user operates without holding the device, by detecting the holding state. This allows the user's operation in the right-hand position of the detection area of ​​the touch device to be mapped and displayed in the right-hand position of the display area. This avoids the confusion between single-handed and two-handed holding scenarios, as shown in Figure 24(b), where the user's expected right-handed cursor mapping is actually mapped to the left side of the display screen.

[0251] Thus, by detecting the holding state, the touch device can flexibly select the mapping method, making the touch method provided in this application embodiment flexibly applicable to different user scenarios and meeting the user's flexible usage needs.

[0252] In some embodiments, the touch device can also detect the user's grip state while the user is using the touch device. After the grip state changes, the touch device can choose not to switch the mapping method temporarily, or it can choose to switch to the corresponding mapping method to meet the mapping requirements of the new grip state.

[0253] For example, when a user changes their grip on a touch device, the device does not change the mapping method but continues to use the original mapping method to transform the detected 3D coordinates. This avoids sudden changes in the mapping method during use, which could cause user misunderstanding. Optionally, the mapping method may include, for example, a horizontal or vertical mapping of the entire detection area to the display area of ​​the display device, or a mapping of the left-hand or right-hand detection area to the display area of ​​the display device.

[0254] For example, when a user uses a touch device, after determining that the user has changed their grip, the touch device obtains the mapping method corresponding to the new grip. Then, the touch device or display device transforms the detected three-dimensional coordinates according to the new mapping method so that the cursor display meets the new user requirements.

[0255] For example, when a user uses a touch device, after determining that the user has changed their grip and this change has lasted for a period of time, the touch device obtains the mapping method corresponding to the new grip state, such as a horizontal or vertical mapping of the entire detection area, or a mapping of the left-hand or right-hand detection area. Then, the touch device or display device transforms the detected three-dimensional coordinates according to the new mapping method so that the cursor display meets the user's needs. Optionally, for a period of time after the grip state changes to the new grip state, the touch device gradually compensates for the mapping changes caused by the new mapping method, thereby avoiding misunderstandings caused by abrupt changes in the mapping method while still meeting the user's usage needs after switching grip states.

[0256] For example, in the two-handed holding scenario shown in Figure 11, the touch device detects that the user's right hand is no longer holding the touch device while detecting the three-dimensional coordinates of the user's fingers in the detection area. For example, the holding state changes from two-handed holding to single-handed holding with the left hand.

[0257] Subsequently, while the user is holding the device with their left hand, regardless of whether the user's right hand will hold the touch device again, the touch device still uses the mapping method corresponding to two-handed holding to convert the three-dimensional coordinates of the user's fingers. For example, the touch device converts the three-dimensional coordinates of the fingers detected in the left-hand detection area using a scaling factor between the left-hand detection area and the display area, or converts the three-dimensional coordinates of the fingers detected in the right-hand detection area using a scaling factor between the right-hand detection area and the display area. Afterwards, if the user's left hand no longer holds the touch device, the touch device can again determine the user's holding state using the detection method exemplified in the above embodiment to determine the mapping method corresponding to the new holding state.

[0258] Alternatively, based on the change in right-hand grip, the touch device determines the new grip as a left-hand single-hand grip. Then, the touch device directly converts the three-dimensional coordinates of the user's fingers according to the mapping method corresponding to the left-hand single-hand grip. For example, the touch device converts the three-dimensional coordinates detected in the left-hand detection area using a scaling factor between the left-hand detection area and the display area.

[0259] Alternatively, based on the change in right-hand grip, the touch device determines the new grip as a left-hand single-hand grip. Afterward, the touch device doesn't immediately change the mapping method, but gradually compensates for element movement distance based on changes in the user's finger position within the detection area until the new mapping method is achieved. For example, the scaling factor between the left-hand or right-hand detection area and the display area is greater than the scaling factor between the detection area and the display area. This ensures that for the same finger movement within the detection area, the thumb in a gripping hand can trigger a longer movement of the corresponding element in the display area, increasing the flexibility of thumb-based operation. After the mapping state changes, the touch device slowly adjusts the element movement distance corresponding to the old mapping method to match the new mapping method, helping the user gradually adapt to the new mapping method's element movement distance. In this way, by detecting the grip state, the user's need for flexible operation during use is met.

[0260] In some embodiments, the touch device can also detect the movement of multiple fingers in the space above it, thereby meeting the user's multi-finger touch needs.

[0261] In some embodiments, the touch method provided in this application can detect not only single-click, long-press, and drag gestures, but also more complex gestures such as two-finger pinch in multi-finger touch scenarios, thereby meeting users' richer touch operation needs.

[0262] Figure 25 is a flowchart illustrating a touch control method provided in an embodiment of this application. It should be noted that this method is not limited to the specific order described in Figure 25 and below. It should be understood that in other embodiments, the order of some steps in this method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:

[0263] S2501. The first electronic device obtains the user interaction position from the first position to the second position in the detection area of ​​the first electronic device based on the first holding state of the user holding the first electronic device.

[0264] S2502, The first electronic device sends information about the user's interaction location to the second electronic device.

[0265] S2503, In the first holding state, the distance between the first element corresponding to the first position and the second element corresponding to the second position displayed by the second electronic device is the first distance.

[0266] In some embodiments, while holding the first electronic device, the user can control the display area of ​​the second electronic device to display corresponding elements, control the display position of the corresponding elements to change, or control the animation changes, etc., by moving their fingers in the detection area of ​​the first electronic device.

[0267] Optionally, the user interaction position includes the position relative to the first electronic device resulting from the user's finger performing a hovering or touching action on the first electronic device.

[0268] Optionally, the user interaction location is determined by the first electronic device based on the user's interaction intent within the detection area. This user interaction location may perfectly match the user's intended interaction location. Alternatively, due to differences in recognition technology, there may be a deviation between the user interaction location and the user's intended interaction location.

[0269] Optionally, the first electronic device can detect the interaction position of the user's finger in the detection area, thereby obtaining the three-dimensional coordinates corresponding to the interaction position. These three-dimensional coordinates can be mapped to the corresponding display position in the display area of ​​the second electronic device to display elements. In this process, the mapping method needs to be determined. Different mapping methods result in different scaling factors for mapping the three-dimensional coordinates to the display position. Optionally, the determination of the mapping method, the transformation of the three-dimensional coordinates, and the determination of the scaling factor can be performed by either the first or second electronic device, or it can be performed through a cloud server. Optionally, the user interaction position information sent by the first electronic device to the second electronic device includes one or more of the following: three-dimensional coordinates, scaling factor, mapping method information, and time information corresponding to the user interaction position.

[0270] In this way, the first electronic device can detect the interaction position generated by the user's hovering or touching actions, obtain relevant information about the interaction position, and then trigger the second electronic device to display corresponding elements based on the relevant information, thereby meeting the user's hand-eye separation interaction needs.

[0271] S2504. The first electronic device obtains the user interaction position from the first position to the second position in the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device.

[0272] S2505, The first electronic device sends information about the user's interaction location to the second electronic device.

[0273] S2506. In the second holding state, the distance between the first element corresponding to the first position and the second element corresponding to the second position displayed by the second electronic device is the second distance. The first holding state and the second holding state are different, and therefore the first distance and the second distance are different.

[0274] In some embodiments, the peripheral edge regions within the space beneath the cover of the first electronic device include sensor arrays, and / or, at least two opposite regions within the peripheral edge regions within the space beneath the back panel of the first electronic device include sensor arrays. The sensor arrays include at least one of a capacitive array, an invisible light array, an ultrasonic array, and a camera sensor array, and are used to detect the state of a user holding the first electronic device.

[0275] For example, as shown in Figure 10, the grip state detection module includes the leftmost column K1, the rightmost column K2, the bottom row K3, and the top row K4 of the sensor array in the position detection module. The grip state detection area may include, for example, the S1 area corresponding to the leftmost column K1, the S2 area corresponding to the rightmost column K2, the S3 area corresponding to the bottom row K3, and the S4 area corresponding to the top row K4 of the sensor array corresponding to the cover plate. During the process of the user holding the first electronic device, the capacitance data of at least one of these four grip state detection areas will change. Then, the first electronic device can determine the area touched by the user's hand based on the detected change in capacitance data, and thus determine the user's grip state. Optionally, the grip state detection module can also be implemented as a separately configured sensor array, different from the sensor array in the position detection module, such as the sensitivity of the sensor array in the grip state detection module being higher than the sensitivity of the sensor array in the position detection module; or, the first electronic device may not have a position detection module configured.

[0276] As an example, as shown in FIG16(a), a sensor array is installed on the edge regions of the two short sides of the back of the first electronic device (such as a touch device) to increase the accuracy of determining whether the user is holding the device with both hands or with one hand. Alternatively, as shown in FIG16(b), a sensor array can also be installed on the four edges of the back of the first electronic device (such as a touch device) to increase the accuracy of determining whether the user is holding the device with both hands, holding it with one hand on the side, or holding it with one hand in the middle.

[0277] It should be understood that the first electronic device may configure the sensor array individually in the four peripheral regions of the space below the cover plate. Alternatively, the first electronic device may configure the sensor array individually in at least two opposite regions of the four peripheral regions of the space below the back plate. Alternatively, the first electronic device may configure the sensor array in the four peripheral regions of the space below the cover plate, and also configure the sensor array in at least two opposite regions of the four peripheral regions of the space below the back plate.

[0278] In this way, the first electronic device can detect the user's holding state through the configured sensor array, so as to select the appropriate mapping method according to different holding states.

[0279] Optionally, the first holding state further includes a horizontal holding state or a vertical holding state. In the horizontal holding state, the long side of the detection area corresponds to the long side of the display area of ​​the second electronic device, and the short side of the detection area corresponds to the short side of the display area; in the vertical holding state, the long side of the detection area corresponds to the short side of the display area, and vice versa. Optionally, the second holding state also includes a horizontal holding state.

[0280] For example, during the mapping process of the entire detection area, a mapping ratio coefficient needs to be determined to map the detection area of ​​the first electronic device to the display area of ​​the second electronic device, thereby mapping the user's interactive position in the detection area to the element displayed at the corresponding position in the display area. For example, as shown in Figure 22, during horizontal holding, the ratio coefficient includes the ratio of the long side of the display area to the long side of the detection area, and the ratio of the short side of the display area to the short side of the detection area. As shown in Figure 23, during vertical holding, the ratio coefficient includes the ratio of the long side of the display area to the short side of the detection area, and the ratio of the short side of the display area to the long side of the detection area.

[0281] In this way, a matching ratio coefficient can be obtained based on different holding states, thereby providing users with an interactive experience that matches the holding state.

[0282] In some other embodiments, or any implementation of the third aspect above, a signal detection module is installed on the edge of the first electronic device. The signal detection module is at least one of millimeter-wave radar, ultra-wideband UWB radar, inertial measurement unit (IMU), WiFi signal receiving module, and infrared transceiver module. The signal detection module is used to detect the state of the user holding the first electronic device.

[0283] For example, as shown in Figure 17, millimeter-wave radars are installed around the four edges of a first electronic device. These millimeter-wave radars can transmit and receive millimeter-wave radar signals. If the first electronic device determines that the echo energy P of a millimeter-wave radar signal received by a certain millimeter-wave radar is similar to the energy of the transmitted millimeter-wave radar signal, it can determine that the edge where the millimeter-wave radar is located is not obstructed by the user's hand, i.e., the user is not holding that edge. If the first electronic device determines that the energy difference between the echo energy P of a millimeter-wave radar signal received by a certain millimeter-wave radar and the energy of the transmitted millimeter-wave radar signal is greater than a preset difference threshold, the first electronic device can determine that the edge where the millimeter-wave radar is located is obstructed by the user's hand, i.e., the user is holding that edge. Thus, based on the energy changes of the transmitted and received millimeter-wave signals, it is possible to determine whether the user is holding the first electronic device and how they are holding it, thereby determining the current holding scenario.

[0284] In this way, the first electronic device can determine whether the user is holding the first electronic device and how the user is holding the first electronic device through various methods, thereby determining the current holding scenario and selecting an appropriate mapping method.

[0285] In some embodiments, the first electronic device determines the user's holding state by using detection data output from the sensor array or signal detection module of the example described above. Optionally, the first holding state includes single-handed holding with the operating finger in a non-holding position. The second holding state includes two-handed holding or single-handed holding with the operating finger in a holding position.

[0286] For example, the first holding state is the left-hand horizontal grip as shown in Figure 12, with the right hand operating; or, the first holding state is the right-hand horizontal grip as shown in Figure 13, with the left hand operating; or, the first holding state is the left-hand vertical grip as shown in Figure 14, with the right hand operating; or, the first holding state is the right-hand vertical grip with the left hand operating. For example, the second holding state is the two-hand grip as shown in Figure 11. Alternatively, the second holding state is either the left-hand vertical grip with the left hand operating, or the right-hand vertical grip with the right hand operating, such as a scenario where the user holds the device with one hand and refreshes the video using their thumb.

[0287] Optionally, the first distance is less than the second distance.

[0288] For example, in the first holding state, the entire detection area of ​​the first electronic device is mapped to the display area of ​​the second electronic device; in the second holding state, a portion of the detection area of ​​the first electronic device (such as the left-hand detection area or the right-hand detection area) can be mapped to the display area of ​​the second electronic device. Thus, even when the user is holding the device, they can still control elements to be displayed in the entire display area by operating within a portion of the detection area, thereby achieving more flexible control of the second electronic device. Therefore, in the scenarios exemplified by steps S2501-S2506 above, in different holding states, based on the same distance the user's finger moves in the detection area, the corresponding element can be moved different distances in the display area. For example, for the same finger movement distance, the distance the element moves when the user is holding the device is greater than the distance when the user is not holding the device. Thus, even when the user's hand needs to perform holding operations, affecting touch operations, a flexible interactive experience can be provided to the user in different scenarios through different mapping ratios.

[0289] For example, as shown in Figure 24(a), when a user holds a first electronic device (such as a touch device) with their left hand and operates it through the detection area of ​​the first electronic device with their right hand, the first electronic device can obtain the current first holding state. Furthermore, based on the user's interaction, the first electronic device can detect that the user's right hand fingers move from a first position located at the right edge of the detection area to a second position approximately in the middle of the detection area. Correspondingly, in the first holding state, in response to the movement of the user's interaction position, the elements displayed by the second electronic device (such as a display device) will also move accordingly, such as the distance between the first element corresponding to the first position and the second element corresponding to the second position displayed by the second electronic device being a first distance. As another example, as shown in Figure 21(a), when a user holds a first electronic device (such as a touch device) with both hands and operates it through the right-hand detection area of ​​the first electronic device using their right thumb, which is a portion of the detection area slightly to the right, the first electronic device can obtain the current second holding state. Furthermore, based on the user's interaction, the first electronic device can detect that the user's right thumb moves from a first position located at the right edge of the right-hand detection area to a second position located at the left edge of the right-hand detection area, for example, at a position approximately in the middle of the entire detection area. Correspondingly, in the second holding state, in response to the movement of the user's interaction position, the elements displayed by the second electronic device (such as a display device) will also move accordingly. For example, the distance between the first element corresponding to the first position and the second element corresponding to the second position displayed by the second electronic device is called the second distance. It can be seen that the first distance corresponding to the first holding state is smaller than the second distance corresponding to the second holding state.

[0290] In this way, the movement distance of the display elements of the second electronic device can be flexibly adjusted according to the user's holding state. This makes the touch method provided in this application applicable to various interaction scenarios under different holding states, meeting the user's flexible usage needs for the first electronic device, avoiding recognition anomalies, and avoiding impact on the user experience.

[0291] It should be understood that the first distance can also be greater than or equal to the second distance. For example, the first electronic device can use the same scaling factor in different holding states.

[0292] In some embodiments, the first electronic device determines the user interaction position's movement from a first position to a second position within the detection area of ​​the first electronic device based on a first holding state of the user holding the first electronic device. This includes: when the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays a third element corresponding to a third position, the holding state of the first electronic device is the first holding state. The first electronic device determines the user interaction position's movement from the first position to the second position within the detection area of ​​the first electronic device based on the first holding state of the user holding the first electronic device. The first electronic device determines the user interaction position's movement from the first position to the second position within the detection area of ​​the first electronic device based on a second holding state of the user holding the first electronic device. This includes: when the user holds the first electronic device again, the user's finger enters the detection area, and the second electronic device displays a fourth element corresponding to a fourth position, the holding state of the first electronic device is the second holding state. The first electronic device determines the user interaction position's movement from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device.

[0293] For example, as shown in Figure 12, a first electronic device (such as a touch device) acquires the user's first holding state through a sensor array or signal detection module, such as the user holding the first electronic device with their left hand while their right hand operates within the detection area of ​​the first electronic device. Correspondingly, a second electronic device can display the element corresponding to the interaction position of the user's right hand within the detection area of ​​the first electronic device, such as the second electronic device displaying a third element corresponding to a third position. Subsequently, the user stops holding the first electronic device. Then, as shown in Figure 11, the first electronic device (such as a touch device) again detects the user holding the first electronic device through the sensor array or signal detection module, acquiring the user's second holding state, such as the user holding the first electronic device with both hands and operating within the detection area of ​​the first electronic device using their left or right thumb. Correspondingly, the second electronic device can display the element corresponding to the interaction position of the user's left or right thumb within the detection area of ​​the first electronic device (such as the left-hand detection area or the right-hand detection area within the detection area), such as the second electronic device displaying a fourth element corresponding to a fourth position.

[0294] In this way, the first electronic device can trigger a grip state detection after detecting that the user is holding it, and trigger the second electronic device to display corresponding elements after the user's finger enters the detection area, thereby meeting the user's interaction needs. Furthermore, during a single grip, the element display of the second electronic device is triggered by a mapping method corresponding to the same grip state, providing the user with the same grip experience during this grip process, ensuring the stability of the grip experience, and avoiding misunderstandings.

[0295] In some embodiments, the first electronic device determines whether the user interaction position moves from a first position to a second position within the detection area of ​​the first electronic device based on a first holding state of the user holding the first electronic device. This includes: when the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays a fifth element corresponding to a fifth position, the holding state of the first electronic device is the first holding state. The user interaction position moves from the first position to the second position within the detection area of ​​the first electronic device based on the first holding state of the user holding the first electronic device. The user interaction position moves from the first position to the second position within the detection area of ​​the first electronic device based on a second holding state of the user holding the first electronic device, including: when the state of at least some of the user's fingers holding the first electronic device changes, the holding state of the first electronic device switches from the first holding state to the second holding state. The user interaction position moves from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device.

[0296] For example, as shown in Figure 12, a first electronic device (such as a touch device) acquires the user's first holding state through a sensor array or signal detection module, such as the user holding the first electronic device with their left hand while their right hand operates within the detection area of ​​the first electronic device. Correspondingly, a second electronic device can display the element corresponding to the interaction position of the user's right hand within the detection area of ​​the first electronic device, such as displaying the fifth element corresponding to the fifth position. Subsequently, during the holding process, the holding or operation of either of the user's hands may change, thus changing the corresponding holding state. The first electronic device can then adjust the mapping method immediately or gradually in response to this change in holding state. For example, the first electronic device uses a scaling factor A to map the detected three-dimensional coordinates in the first holding state. After detecting a change in holding state to the second holding state, the first electronic device immediately uses the corresponding scaling factor B to map the detected three-dimensional coordinates. Alternatively, during the mapping of three-dimensional coordinates, the scaling factor used by the first electronic device gradually changes from scaling factor A to scaling factor B. Or, after the holding state changes, the first electronic device does not temporarily adjust the mapping method, but triggers the holding state detection after the current holding process ends and the user is detected holding the first electronic device again. Subsequently, the first electronic device determines the corresponding mapping method based on the newly detected holding state. For example, corresponding to the above example, when the user holds the first electronic device again, the user's finger enters the detection area, and the second electronic device displays the fourth element corresponding to the fourth position, the holding state of the first electronic device is the second holding state. Based on the second holding state of the user holding the first electronic device, the first electronic device obtains that the user interaction position moves from the first position to the second position in the detection area of ​​the first electronic device. Accordingly, the second electronic device displays the first element corresponding to the first position and the second element corresponding to the second position according to the mapping method corresponding to the second holding state.

[0297] For example, as shown in Figure 12, when a user is holding the first electronic device with their left hand, their right hand leaves the detection area, and then the user's right hand re-enters the detection area and holds the first electronic device, for example, the user's holding state changes to a two-handed holding state as shown in Figure 11. During this process, the first electronic device can detect this switched second holding state through a sensor array or signal detection module, in which the user holds the first electronic device with both hands and operates using their left or right thumb in the detection area of ​​the first electronic device. Correspondingly, the second electronic device can display the element corresponding to the interaction position of the user's left or right thumb in the detection area of ​​the first electronic device (such as the left-hand detection area or the right-hand detection area within the detection area). As another example, as shown in Figure 12, when a user is holding the first electronic device with their left hand, their right hand leaves the detection area, and then the user operates using their left hand in the detection area, for example, the user's holding state changes to a one-handed holding state with the operating fingers in a gripping state. During this process, the first electronic device can detect this switched second holding state through a sensor array or signal detection module. Correspondingly, the second electronic device can display the element corresponding to the interaction position of the user's left thumb in the detection area of ​​the first electronic device (such as the left-hand detection area).

[0298] For the scenario described above where the first holding state changes to a second holding state, for example, when the first holding state is held with the left hand and operated with the right hand, the mapping method is to map the detection area of ​​the first electronic device to the display area of ​​the second electronic device, with a scaling factor of scaling factor A. When the second holding state is held with both hands, or when the second holding state is held with the left hand and operated with the left hand, the mapping method is to map the left-hand detection area (or right-hand detection area) of the first electronic device to the display area of ​​the second electronic device, with a scaling factor of scaling factor B.

[0299] So, after the first holding state changes to the second holding state, the first electronic device immediately changes the mapping mode, and the first electronic device immediately changes the scaling factor used from scaling factor A to scaling factor B.

[0300] Alternatively, after the first holding state changes to the second holding state, the first electronic device changes its mapping method through gradual compensation. As the user's finger moves within the detection area, the scaling factor used by the first electronic device gradually changes from scaling factor A to scaling factor B. For example, when the holding state of the first electronic device changes from the first holding state to the second holding state, before the user interaction position moves from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state, the first electronic device, based on the second holding state, moves the user interaction position from the sixth position to the seventh position within the detection area of ​​the first electronic device. The distance between the sixth and seventh positions is the same as the distance between the first and second positions. In the second holding state, the distance between the sixth element corresponding to the sixth position and the seventh element corresponding to the seventh position displayed by the second electronic device is the third distance. This third distance is between the first and second distances. For instance, during the gradual scaling factor compensation process, the user interaction position moves the same distance within the detection area, and the third distance mapped to the change in element position in the display area is between the first distance of the element position change before compensation and the second distance of the element position change after compensation. Optionally, the first distance < the third distance < the second distance.

[0301] Alternatively, if the first electronic device does not change its mapping method after the first holding state changes to the second holding state, it will continue to use scaling factor A until the holding process ends. Subsequently, if the user holds the first electronic device again and determines that the user's holding state is the second holding state, the first electronic device can use scaling factor B.

[0302] In this way, the first electronic device can trigger a holding state detection after detecting that a user is holding the device, and it can also detect the user's holding state while the user is using the device. Thus, by continuously detecting the holding state, the user's need to flexibly change their operating methods during use can be met.

[0303] In some embodiments, the first electronic device obtains an eighth position of the user interaction location within a first area of ​​the first electronic device based on a second holding state of the user holding the first electronic device. The first area is a portion of the detection area, and the eighth position is located at the edge opposite the holding edge of the first electronic device within the first area. The second electronic device displays an eighth element corresponding to the eighth position. The eighth element is located at the edge of the display area of ​​the second electronic device.

[0304] For example, as shown in Figure 18(b), a user holds a first electronic device (such as a touch device) with both hands. The detection area of ​​the first electronic device includes a first area, such as a right-hand detection area 181. The user's right thumb is located at the left edge 1812 of the right-hand detection area 181. The right edge of the right-hand detection area 181 is the user's gripping edge, and the eighth position on the left edge is the interaction position of the user's right thumb. In this case, a second electronic device (such as a display device) can display a cursor corresponding to the user's finger, such as the eighth element, at a corresponding position on the left edge of the entire display area.

[0305] For example, as shown in Figure 21(a), when a user holds the first electronic device with both hands and the right thumb is in the middle of the detection area, such as the left edge of the detection area, the second electronic device can be triggered to display the corresponding element at the left edge of the display area.

[0306] Thus, by configuring a right-hand detection area and / or a left-hand detection area in the first electronic device, and ensuring that both areas are mapped to the entire display area of ​​the second electronic device, the user's single-handed operation needs are met, reducing the difficulty of single-handed operation. This avoids situations where the user's fingers cannot reach certain areas, thus preventing operational disruptions.

[0307] In some embodiments, the first electronic device obtains a ninth position of the user interaction location within a detection area of ​​the first electronic device based on a first holding state of the user holding the first electronic device. The ninth position is located at the edge of the detection area opposite the holding edge of the first electronic device. The second electronic device displays a ninth element corresponding to the ninth position. The ninth element is located at the edge of the display area of ​​the second electronic device.

[0308] For example, as shown in Figure 24(a), a user holds the first electronic device with their left hand and interacts with it using their right hand in the detection area. The first electronic device can then detect this first holding state. Subsequently, based on the user's interaction position being located at the ninth position slightly to the right of the center of the detection area, the first electronic device can trigger the second electronic device to display the corresponding element at the corresponding position slightly to the right of the center of the display area.

[0309] In this way, by detecting the holding state, the confusion between single-handed and two-handed holding scenarios is avoided, and the cursor mapping display that the user expects to be to the right is implemented on the second electronic device as a mapping to the left side of the display screen, thereby providing the user with an interactive experience that meets the actual needs.

[0310] In some embodiments, the first electronic device obtains the tenth position of the user interaction location within the detection area of ​​the first electronic device and a first scaling factor based on a first holding state of the user holding the first electronic device. A first display position is obtained based on the tenth position and the first scaling factor. The first electronic device obtains the tenth position of the user interaction location within the detection area of ​​the first electronic device and a second scaling factor based on a second holding state of the user holding the first electronic device. A second display position is obtained based on the tenth position and the second scaling factor. Accordingly, in the first holding state, the second electronic device displays the tenth element corresponding to the tenth position at the first display position. In the second holding state, the second electronic device displays the tenth element corresponding to the tenth position at the second display position. The first scaling factor and the second scaling factor are different, and the first display position and the second display position are different.

[0311] Thus, the first electronic device calculates a scaling factor adapted to different holding states, and then transforms the three-dimensional coordinates to a suitable display position in the display area of ​​the second electronic device based on the scaling factor. This triggers the second electronic device to display elements corresponding to the user's interaction position at the appropriate display location, satisfying the user's interaction needs in different holding scenarios.

[0312] It should be understood that the conversion of three-dimensional coordinates or the determination of scaling factors can also be performed by a second electronic device or server.

[0313] Optionally, the first electronic device may also perform the steps and functions performed by the touch device in the above embodiments, and the second electronic device may also perform the steps and functions performed by the display device in the above embodiments, thereby realizing the touch method provided in the above embodiments.

[0314] In some solutions, multiple embodiments of this application can be combined, and the combined solution can be implemented. Optionally, some operations in the processes of each method embodiment may be combined, and / or the order of some operations may be changed. Furthermore, the execution order between the steps of each process is merely exemplary and does not constitute a limitation on the execution order between steps; other execution orders are also possible. It is not intended to indicate that the execution order is the only possible order in which these operations can be performed. Those skilled in the art will conceive of various ways to reorder the operations described herein. In addition, it should be noted that the process details involved in one embodiment of this document are similarly applicable to other embodiments, or different embodiments may be combined.

[0315] Furthermore, some steps in the method embodiments can be equivalently replaced with other possible steps. Alternatively, some steps in the method embodiments may be optional and can be deleted in certain use cases. Or, other possible steps may be added to the method embodiments.

[0316] Furthermore, the various method embodiments can be implemented individually or in combination.

[0317] For example, the various touch scenarios described above, whether in a holding or non-holding state, can be combined. For instance, as shown in Figure 14 or 15, in a non-holding state, the display device can show cursors with different display effects based on the different heights of the finger relative to the touch device. Similarly, when the user holds the touch device, the display device can also show cursors with different display effects or different forms of display elements based on the different heights of the finger relative to the touch device. As another example, a user can hold the touch device with one hand, and while the finger in this single-handed holding state performs a touch operation, the user's other hand can also perform a touch operation even when it is not holding the device. In this way, the touch device can obtain the three-dimensional coordinates in both the holding and non-holding states, and the display device can display the corresponding cursor. This satisfies various user needs.

[0318] The touch method provided by the embodiments of this application has been described in detail above with reference to Figures 6-25. The first electronic device provided by the embodiments of this application is described in detail below with reference to Figure 26, and the second electronic device provided by the embodiments of this application is described in detail below with reference to Figure 27.

[0319] In one possible design, Figure 26 is a schematic diagram of the structure of a first electronic device provided in an embodiment of this application. As shown in Figure 26, the first electronic device 2600 may include a processing unit 2601 and a transceiver unit 2602. The first electronic device 2600 can be used to implement the functions of the first electronic device (such as a touch device) involved in the above method embodiments.

[0320] Optionally, the processing unit 2601 is used to support the first electronic device 2600 in executing S2501 and S2504 in FIG25.

[0321] Optionally, the transceiver unit 2602 is used to support the first electronic device 2600 in performing S2502 and S2505 in FIG25.

[0322] The transceiver unit may include a receiving unit and a transmitting unit, and may be implemented by a transceiver or transceiver-related circuit components, and may be a transceiver or transceiver module. The operation and / or function of each unit in the first electronic device 2600 are respectively to implement the corresponding process of the touch method described in the above method embodiments. All relevant content of each step involved in the above method embodiments can be referred to the functional description of the corresponding functional unit, and will not be repeated here for the sake of brevity.

[0323] Optionally, the first electronic device 2600 shown in FIG26 may further include a storage unit (not shown in FIG26) storing a program or instructions. When the processing unit 2601 and the transceiver unit 2602 execute the program or instructions, the first electronic device 2600 shown in FIG26 can perform the touch method described in the above method embodiments.

[0324] The technical effects of the first electronic device 2600 shown in Figure 26 can be referred to the technical effects of the touch method described in the above method embodiments, and will not be repeated here.

[0325] In addition to being in the form of the first electronic device 2600, the technical solution provided in this application may also be a functional unit or chip in the first electronic device, or a device used in conjunction with the first electronic device.

[0326] In one possible design, Figure 27 is a schematic diagram of the structure of a second electronic device provided in an embodiment of this application. As shown in Figure 27, the second electronic device 2700 may include a processing unit 2701 and a transceiver unit 2702. The second electronic device 2700 can be used to implement the functions of the second electronic device (such as a display device) involved in the above method embodiments.

[0327] Optionally, the processing unit 2701 is used to support the second electronic device 2700 in executing S2503 and S2506 in FIG25.

[0328] Optionally, the transceiver unit 2702 is used to support the second electronic device 2700 in performing S2502 and S2505 in FIG25.

[0329] The transceiver unit may include a receiving unit and a transmitting unit, and may be implemented by a transceiver or transceiver-related circuit components, and may be a transceiver or transceiver module. The operation and / or function of each unit in the second electronic device 2700 are respectively to implement the corresponding process of the touch method described in the above method embodiments. All relevant content of each step involved in the above method embodiments can be referred to the functional description of the corresponding functional unit, and will not be repeated here for the sake of brevity.

[0330] Optionally, the second electronic device 2700 shown in FIG27 may further include a storage unit (not shown in FIG27) storing a program or instructions. When the processing unit 2701 and the transceiver unit 2702 execute the program or instructions, the second electronic device 2700 shown in FIG27 can perform the touch method described in the above method embodiments.

[0331] The technical effects of the second electronic device 2700 shown in Figure 27 can be referred to the technical effects of the touch method described in the above method embodiments, and will not be repeated here.

[0332] In addition to being in the form of a second electronic device 2700, the technical solution provided in this application may also be a functional unit or chip in a second electronic device, or a device used in conjunction with a second electronic device.

[0333] This application also provides a chip system, including: a processor coupled to a memory, the memory being used to store programs or instructions, wherein when the program or instructions are executed by the processor, the chip system implements the methods in any of the above method embodiments.

[0334] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0335] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.

[0336] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0337] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules in the processor.

[0338] This application also provides a computer-readable storage medium storing a computer program. When the computer program is run on a computer, it causes the computer to perform the aforementioned steps to implement the touch method in the above embodiments.

[0339] This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the touch method described in the above embodiments.

[0340] In addition, this application also provides an apparatus. Specifically, the apparatus may be a component or module, and may include one or more processors and a memory connected together. The memory is used to store a computer program. When the computer program is executed by one or more processors, the apparatus performs the touch methods described in the above-described method embodiments.

[0341] The apparatus, computer-readable storage medium, computer program product, or chip provided in the embodiments of this application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0342] The steps of the methods or algorithms described in conjunction with the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, portable hard disks, CD-ROMs, or any other form of storage medium well known in the art. An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can reside in an application-specific integrated circuit (ASIC).

[0343] Through the above description of the embodiments, those skilled in the art will clearly understand that, for the sake of convenience and brevity, the division of the above functional modules is only used as an example. In practical applications, the above functions can be assigned to different functional modules as needed; that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0344] In the several embodiments provided in this application, it should be understood that the disclosed methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of modules or units is only a logical functional division, and there may be other division methods in actual implementation; for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of modules or units may be electrical, mechanical or other forms.

[0345] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0346] Computer-readable storage media include, but are not limited to, any of the following: USB flash drive, portable hard drive, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and other media capable of storing program code.

[0347] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

A touch system, characterized in that, The system includes a first electronic device and a second electronic device; The first electronic device is used for: Based on the user's first holding state of the first electronic device, the user's interaction position moves from the first position to the second position within the detection area of ​​the first electronic device; Based on the second holding state of the user holding the first electronic device, the user interaction position moves from the first position to the second position within the detection area of ​​the first electronic device; The second electronic device is used for: In the first holding state, the distance between the first element corresponding to the first position and the second element corresponding to the second position is the first distance; In the second holding state, the distance between the first element corresponding to the first position and the second element corresponding to the second position is the second distance; The first holding state and the second holding state are different, and the first distance and the second distance are different. The system according to claim 1, characterized in that, The first electronic device is used for: The step of obtaining the user interaction position moving from a first position to a second position within the detection area of ​​the first electronic device based on the user's first holding state of holding the first electronic device includes: When the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays the third element corresponding to the third position, the holding state of the first electronic device is the first holding state; Based on the user's first gripping state of the first electronic device, the user's interaction position moves from the first position to the second position within the detection area of ​​the first electronic device; The step of obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device includes: When the user holds the first electronic device again, the user's finger enters the detection area, and the second electronic device displays the fourth element corresponding to the fourth position, the holding state of the first electronic device is the second holding state; The user interaction position is obtained by moving from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device. The system according to claim 1, characterized in that, The first electronic device is used for: The step of obtaining the user interaction position moving from a first position to a second position within the detection area of ​​the first electronic device based on the user's first holding state of holding the first electronic device includes: When the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays the fifth element corresponding to the fifth position, the holding state of the first electronic device is the first holding state; Based on the user's first gripping state of the first electronic device, the user's interaction position moves from the first position to the second position within the detection area of ​​the first electronic device; The step of obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device includes: When the state of at least some of the user's fingers holding the first electronic device changes, the holding state of the first electronic device switches from the first holding state to the second holding state; Based on the second holding state of the user holding the first electronic device, the user interaction position is obtained as moving from the first position to the second position within the detection area of ​​the first electronic device. The system according to claim 3 is characterized in that, When the holding state of the first electronic device changes from the first holding state to the second holding state, before the user interaction position moves from the first position to the second position in the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device, The first electronic device is used for: Based on the second holding state of the user holding the first electronic device, the user interaction position moves from the sixth position to the seventh position in the detection area of ​​the first electronic device, and the distance between the sixth position and the seventh position is the same as the distance between the first position and the second position; The second electronic device is used for: In the second holding state, the distance between the sixth element corresponding to the sixth position and the seventh element corresponding to the seventh position is the third distance; The third distance is between the first distance and the second distance. The system according to any one of claims 1-4 is characterized in that, The first holding state includes holding with one hand and the operating fingers are in a non-holding grip; the second holding state includes holding with both hands or holding with one hand and the operating fingers are in a holding grip. The system according to claim 5 is characterized in that, The first distance is less than the second distance. The system according to any one of claims 1-6 is characterized in that, The first electronic device is used for: Based on the second holding state of the user holding the first electronic device, the eighth position of the user interaction position in the first area of ​​the first electronic device is obtained. The first area is a part of the detection area, and the eighth position is located on the edge opposite to the holding edge of the first electronic device in the first area. The second electronic device is used for: Display the eighth element corresponding to the eighth position, the eighth element being located at the edge of the display area of ​​the second electrical device. The system according to any one of claims 1-7 is characterized in that, The first electronic device is used for: Based on the first holding state of the user holding the first electronic device, the ninth position of the user interaction position in the detection area of ​​the first electronic device is obtained, and the ninth position is located on the edge opposite to the holding edge of the first electronic device in the detection area; The second electronic device is used for: Display the ninth element corresponding to the ninth position, the ninth element being located at the edge of the display area of ​​the second electrical device. The system according to any one of claims 1-8 is characterized in that, The four-sided edge region within the space below the cover of the first electronic device includes a sensor array, and / or, at least two opposite regions within the four-sided edge region within the space below the back panel of the first electronic device include a sensor array; wherein, the sensor array includes at least one of a capacitor array, an invisible light array, an ultrasonic array, and a camera sensor array, and the sensor array is used to detect the state of the user holding the first electronic device. The system according to any one of claims 1-9 is characterized in that, A signal detection module is installed on the edge of the first electronic device. The signal detection module is at least one of millimeter-wave radar, ultra-wideband UWB radar, inertial measurement unit (IMU), WiFi signal receiving module, and infrared transceiver module. The signal detection module is used to detect the state of the user holding the first electronic device. The system according to any one of claims 1-10 is characterized in that, The first holding state also includes a horizontal holding state or a vertical holding state. The system according to claim 11 is characterized in that, In a horizontal holding state, the long side of the detection area corresponds to the long side of the display area of ​​the second electronic device, and the short side of the detection area corresponds to the short side of the display area; in a vertical holding state, the long side of the detection area corresponds to the short side of the display area, and the short side of the detection area corresponds to the long side of the display area. The system according to any one of claims 1-12 is characterized in that, The user interaction position includes the position relative to the first electronic device generated by the user's finger performing a hovering or touching action on the first electronic device. The system according to any one of claims 1-13 is characterized in that, The first electronic device is used for: Based on the first holding state of the user holding the first electronic device, the tenth position of the user interaction position in the detection area of ​​the first electronic device and the first proportional coefficient are obtained; The first display position is obtained based on the tenth position and the first proportional coefficient; Based on the second holding state of the user holding the first electronic device, the tenth position and the second proportional coefficient of the user interaction position in the detection area of ​​the first electronic device are obtained; The second display position is obtained based on the tenth position and the second proportional coefficient; The second electronic device is used for: In the first holding state, the tenth element corresponding to the tenth position is displayed at the first display position; In the second holding state, the tenth element corresponding to the tenth position is displayed at the second display position; The first scaling factor is different from the second scaling factor, and the first display position is different from the second display position. A touch control method, characterized in that, The method is applied to a first electronic device, and the method includes: Based on the user's first holding state of the first electronic device, the user's interaction position moves from the first position to the second position within the detection area of ​​the first electronic device; Based on the second holding state of the user holding the first electronic device, the user interaction position moves from the first position to the second position within the detection area of ​​the first electronic device; in, In the first holding state, the distance between the first element corresponding to the first position and the second element corresponding to the second position displayed by the second electronic device is the first distance; In the second holding state, the distance between the first element corresponding to the first position and the second element corresponding to the second position displayed by the second electronic device is the second distance; The first holding state and the second holding state are different, and the first distance and the second distance are different. The method according to claim 15, characterized in that, The step of obtaining the user interaction position moving from a first position to a second position within the detection area of ​​the first electronic device based on the user's first holding state of holding the first electronic device includes: When the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays the third element corresponding to the third position, the holding state of the first electronic device is the first holding state; Based on the user's first gripping state of the first electronic device, the user's interaction position moves from the first position to the second position within the detection area of ​​the first electronic device; The step of obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device includes: When the user holds the first electronic device again, the user's finger enters the detection area, and the second electronic device displays the fourth element corresponding to the fourth position, the holding state of the first electronic device is the second holding state; The user interaction position is obtained by moving from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device. The method according to claim 15, characterized in that, The step of obtaining the user interaction position moving from a first position to a second position within the detection area of ​​the first electronic device based on the user's first holding state of holding the first electronic device includes: When the user holds the first electronic device, the user's finger enters the detection area, and the second electronic device displays the fifth element corresponding to the fifth position, the holding state of the first electronic device is the first holding state; Based on the user's first gripping state of the first electronic device, the user's interaction position moves from the first position to the second position within the detection area of ​​the first electronic device; The step of obtaining the user interaction position moving from the first position to the second position within the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device includes: When the state of at least some of the user's fingers holding the first electronic device changes, the holding state of the first electronic device switches from the first holding state to the second holding state; Based on the second holding state of the user holding the first electronic device, the user interaction position is obtained as moving from the first position to the second position within the detection area of ​​the first electronic device. The method according to claim 17, characterized in that, When the holding state of the first electronic device changes from the first holding state to the second holding state, before obtaining the user interaction position moving from the first position to the second position in the detection area of ​​the first electronic device based on the second holding state of the user holding the first electronic device, the method further includes: Based on the second holding state of the user holding the first electronic device, the user interaction position moves from the sixth position to the seventh position in the detection area of ​​the first electronic device, and the distance between the sixth position and the seventh position is the same as the distance between the first position and the second position; In the second holding state, the distance between the sixth element corresponding to the sixth position and the seventh element corresponding to the seventh position displayed by the second electronic device is a third distance, which is between the first distance and the second distance. The method according to any one of claims 15-18, characterized in that, The first holding state includes holding with one hand and the operating fingers are in a non-holding grip; the second holding state includes holding with both hands or holding with one hand and the operating fingers are in a holding grip. The method according to claim 19, characterized in that, The first distance is less than the second distance. The method according to any one of claims 15-20, characterized in that, The method further includes: Based on the second holding state of the user holding the first electronic device, the eighth position of the user interaction position in the first area of ​​the first electronic device is obtained. The first area is a part of the detection area, and the eighth position is located on the edge opposite to the holding edge of the first electronic device in the first area. The eighth element, corresponding to the eighth position, displayed by the second electronic device is located at the edge of the display area of ​​the second electronic device. The method according to any one of claims 15-21, characterized in that, The method further includes: Based on the first holding state of the user holding the first electronic device, the ninth position of the user interaction position in the detection area of ​​the first electronic device is obtained, and the ninth position is located on the edge opposite to the holding edge of the first electronic device in the detection area; The ninth element, corresponding to the ninth position, displayed by the second electronic device is located at the edge of the display area of ​​the second electronic device. The method according to any one of claims 15-22, characterized in that, The four-sided edge region within the space below the cover of the first electronic device includes a sensor array, and / or, at least two opposite regions within the four-sided edge region within the space below the back panel of the first electronic device include a sensor array; wherein, the sensor array includes at least one of a capacitor array, an invisible light array, an ultrasonic array, and a camera sensor array, and the sensor array is used to detect the state of the user holding the first electronic device. The method according to any one of claims 15-23 is characterized in that, A signal detection module is installed on the edge of the first electronic device. The signal detection module is at least one of millimeter-wave radar, ultra-wideband UWB radar, inertial measurement unit (IMU), WiFi signal receiving module, and infrared transceiver module. The signal detection module is used to detect the state of the user holding the first electronic device. The method according to any one of claims 15-24, characterized in that, The first holding state also includes a horizontal holding state or a vertical holding state. The method according to claim 25, characterized in that, In a horizontal holding state, the long side of the detection area corresponds to the long side of the display area of ​​the second electronic device, and the short side of the detection area corresponds to the short side of the display area; in a vertical holding state, the long side of the detection area corresponds to the short side of the display area, and the short side of the detection area corresponds to the long side of the display area. The method according to any one of claims 15-26, characterized in that, The user interaction position includes the position relative to the first electronic device generated by the user's finger performing a hovering or touching action on the first electronic device. The method according to any one of claims 15-27, characterized in that, The method further includes: Based on the first holding state of the user holding the first electronic device, the tenth position of the user interaction position in the detection area of ​​the first electronic device and the first proportional coefficient are obtained; A first display position is obtained based on the tenth position and the first proportional coefficient. The first display position is used by the second electronic device to display the tenth element corresponding to the tenth position. Based on the second holding state of the user holding the first electronic device, the tenth position and the second proportional coefficient of the user interaction position in the detection area of ​​the first electronic device are obtained; A second display position is obtained based on the tenth position and the second proportional coefficient. The second display position is used by the second electronic device to display the tenth element corresponding to the tenth position. The first scaling factor is different from the second scaling factor, and the first display position is different from the second display position. An electronic device, characterized in that, include: A processor and a memory, the memory being coupled to the processor, the memory being used to store computer program code, the computer program code including computer instructions, which, when the processor reads the computer instructions from the memory, cause the electronic device to perform the method as described in any one of claims 15-28. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a computer program that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 15-28. A computer program product, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 15-28.

Images