Interaction method, apparatus and vehicle

Abstract

The application provides an interaction method and device and a vehicle, relates to the touch control technical field, and is applied to a terminal device including a touch screen. The method comprises the following steps: determining a first motion state of the terminal device; determining a first judgment threshold according to the first motion state and a reference correspondence relationship, wherein the reference correspondence relationship is used for representing the correspondence relationship between a plurality of motion states of the terminal device and the judgment threshold; acquiring a first touch point and a second touch point in a first operation of a user for the touch screen; determining a first offset according to the first touch point and the second touch point; and determining that the first operation is a click operation or a sliding operation according to the first judgment threshold and the first offset. Based on the scheme, the recognition accuracy of the touch screen for the operation intention of the user can be improved, the use experience of the user for the vehicle-mounted man-machine interaction system is improved, and the safe driving of the user is ensured. The scheme can be applied to a new energy automobile.

Description

Technical Field

[0001] This application relates to the field of touch technology, specifically to interaction methods, devices, and vehicles. Background Technology

[0002] With the development of intelligent vehicle technology, in-vehicle human-machine interaction systems have become a crucial module affecting the user's driving experience. Thanks to the intuitive and convenient operation of touchscreens, they have become the primary interaction medium for in-vehicle human-machine interaction systems.

[0003] In most cases, users interact with the in-vehicle human-machine interface system via touchscreen while the vehicle is in motion. Due to the complexity of the driving environment (such as driving through curves and bumpy roads), the accuracy of touchscreen input decreases while driving. This may cause the in-vehicle human-machine interface system to fail to respond to the user's actual actions, thus reducing the accuracy of human-machine interaction and the user experience. Summary of the Invention

[0004] This application provides an interaction method, device, and vehicle that can improve the accuracy of touch screen in recognizing user operation intentions, thereby enhancing the user experience of the in-vehicle human-machine interaction system and providing assurance for the user's safe driving.

[0005] In a first aspect, an interaction method is provided, applied to a terminal device including a touchscreen. The method includes: determining a first motion state of the terminal device; determining a first judgment threshold based on the first motion state and a reference correspondence, wherein the reference correspondence represents the correspondence between multiple motion states of the terminal device and the judgment threshold; acquiring a first touch point and a second touch point in a first operation performed by a user on the touchscreen; determining a first offset based on the first touch point and the second touch point; and determining whether the first operation is a click operation or a swipe operation based on the first judgment threshold and the first offset.

[0006] For example, the aforementioned terminal device can also be a complete vehicle, and the touch screen in the terminal device can be the central control screen in the vehicle's cabin, or a touch-enabled screen from other in-vehicle terminals. Alternatively, the aforementioned terminal device can be a portable terminal fixed to the vehicle's cabin by rigid fasteners; or, the aforementioned terminal device can be an in-vehicle terminal integrated into the vehicle's cabin.

[0007] For example, the motion state of a terminal device can be twofold: stationary or in motion.

[0008] For example, the motion state of a terminal device can be multiple. For instance, motion state can be represented by acceleration and / or velocity, with different accelerations and / or velocities corresponding to different motion states. Similarly, motion state can be represented by acceleration ranges and / or velocity ranges, with different acceleration ranges and / or velocity ranges corresponding to different motion states.

[0009] For example, based on the aforementioned first judgment threshold, an offset range (which can be called the first offset range) can be determined. A larger first judgment threshold indicates a larger first offset range, and a smaller first judgment threshold indicates a smaller first offset range. The position of this first offset range can be determined based on a touch point in the user's touchscreen operation, such as the starting point of the touch operation or other touch points. The position of this first offset range on the touchscreen is related to the user's operation position on the touchscreen.

[0010] For example, a relationship (e.g., a relationship table) can be established between the motion state of the terminal device and a judgment threshold, and this relationship can be represented by the relationship information. When the first motion state is obtained, the first judgment threshold can be determined by looking up the relationship information, and the user's current touch operation can be responded to based on the first judgment threshold. This relationship information can be obtained through one or more methods such as experience, theoretical derivation, experimentation, or simulation.

[0011] For example, the correspondence between these multiple motion states and judgment thresholds can be modeled to represent this reference correspondence. When the first motion state is obtained, it is input into the model to obtain the corresponding first judgment threshold, and then the user's current touch operation is responded to based on the first judgment threshold.

[0012] For example, the above reference correspondence can also be represented in other forms, such as a relationship diagram obtained by visualizing the above reference correspondence.

[0013] For example, when a touchscreen responds to a user's first action, it samples the trajectory of that action on the screen. If the trajectory is a single point, the sampled touchpoint is also a single point. If the trajectory is a swipe, the sampled touchpoints are multiple, and these touchpoints are all time-dependent. Therefore, the first and second touchpoints in the first action can be any two touchpoints from the multiple touchpoints sampled after the first action. For example, they could be the start and end points of multiple touchpoints in a time sequence, or the second or second-to-last touchpoint, etc.

[0014] For example, the first offset mentioned above can be used to represent the straight-line distance between the first touch point and the second touch point.

[0015] For example, the first judgment threshold and the first offset are the same type of physical parameters, both used to represent distance.

[0016] For example, the first touch point mentioned above can be the starting point in the first operation. Considering that the first offset range can be determined based on the first judgment threshold and the position of the first touch point, the first operation can be determined to be a sliding operation or a clicking operation based on the positional relationship between each touch point in the first operation and the first offset range. When all touch points in the first operation are within the first offset range, the first operation can be determined to be a clicking operation; when there are touch points outside the first offset range, the first operation can be determined to be a sliding operation.

[0017] Based on the above technical solution, by improving the touchscreen's response mechanism, even if there is uncertain and continuous relative displacement between the user's limb or stylus and the terminal device, the terminal device can accurately recognize the user's operating intention, improving the touchscreen's accuracy in recognizing user operating intentions. This makes user operations on the terminal device smoother and more accurate. This not only enhances the user experience, especially when operating the touchscreen of an in-vehicle human-machine interaction system, making interaction between the user and the touchscreen more convenient and efficient while driving, but also provides a guarantee for safe driving.

[0018] In conjunction with the first aspect, in some implementations of the first aspect, the first touch point is the starting point of the first operation, and the second touch point is the ending point of the first operation.

[0019] Based on the above technical solutions, computational overhead can be further reduced, computational efficiency can be improved, and the response speed of the touch screen can be increased.

[0020] In conjunction with the first aspect, in some implementations of the first aspect, the terminal device is a vehicle, and the first gear information of the terminal device is obtained; based on the first gear information, the first motion state is determined.

[0021] For example, the aforementioned first gear information is used to indicate the current gear type of the terminal device, such as drive gear and non-drive gear. The drive gear can be forward, reverse, sport, high speed, low speed, or gears corresponding to multiple speed ranges; the non-drive gear can be parking gear.

[0022] For example, the non-driving gear of the terminal device can also include neutral. When the terminal device is in neutral, it's not possible to directly determine whether it's in a moving state (e.g., coasting downhill or being towed) or a stationary state based solely on this. Therefore, other sensors mounted on the terminal device can be used to determine its current motion state. When the terminal device is a vehicle, data collected by its wheel speed sensors can be used to determine whether the wheels are rotating. If they are rotating, the terminal device is in motion; if they are not rotating, it is stationary. Alternatively, data collected by the terminal device's inertial measurement unit or transmitter speed sensor can also be used to determine whether the terminal device is in motion.

[0023] Based on the above technical solution, when the terminal device is a vehicle, the terminal device represents its own motion state by obtaining the vehicle's gear information. Since the vehicle's gear information is relatively easy to obtain, the complexity of implementing this method is reduced.

[0024] In conjunction with the first aspect, in some implementations of the first aspect, the first gear information is used to indicate that the terminal device is in drive gear; the second gear information of the terminal device is obtained, and the second gear information is used to indicate that the terminal device is in park gear; based on the second gear information and the reference correspondence, a second judgment threshold is determined, and the second judgment threshold is less than the first judgment threshold.

[0025] Based on the above technical solution, when the terminal device is a vehicle, the terminal device acquires the vehicle's gear information to characterize its own movement state, thereby dynamically adjusting the judgment threshold. That is, in the moving state, a larger judgment threshold is used to identify a small swipe operation as a click operation, which helps to avoid misidentifying the user's operation intention; in the stationary state, a smaller judgment threshold is used to ensure accurate identification of the user's operation intention.

[0026] In conjunction with the first aspect, in some implementations of the first aspect, the first gear information is used to indicate that the terminal device is in the first sub-drive gear in the drive gear; the third gear information of the terminal device is obtained, and the third gear information is used to indicate that the terminal device is in the second sub-drive gear in the drive gear, and the second sub-drive gear is lower than the first sub-drive gear; based on the third gear information and the reference correspondence, a third judgment threshold is determined, and the third judgment threshold is less than the first judgment threshold.

[0027] For example, the terminal device mentioned above can be a terminal device fixed in the vehicle cabin by a rigid fastener, or an in-vehicle terminal integrated in the vehicle cabin. In this case, the terminal device can also indirectly determine its own motion state by obtaining the vehicle's gear information.

[0028] Based on the above technical solution, when the terminal device is a vehicle, the terminal device acquires the vehicle's gear information to characterize its own movement state, thereby dynamically adjusting the judgment threshold. Moreover, the driving gear is divided in detail, that is, different judgment thresholds correspond to different driving gears, so that at a faster movement speed, a larger judgment threshold can be used to identify a small swipe operation as a click operation, further improving the accuracy of recognizing the user's operation intention.

[0029] In conjunction with the first aspect, in some implementations of the first aspect, a first motion state is used to indicate that the terminal device is moving, a second motion state of the terminal device is determined, the second motion state is used to indicate that the terminal device is stationary; a second judgment threshold is determined based on the second motion state and a reference correspondence, the second judgment threshold being less than the first judgment threshold.

[0030] For example, the terminal device may have a built-in speed sensor and / or acceleration sensor, so the motion state of the terminal device can be determined by the data collected by the speed sensor and / or acceleration sensor.

[0031] For example, the terminal device in this example can be a vehicle, a terminal device fixed to a vehicle by a rigid fastener, or an in-vehicle terminal integrated inside the vehicle's cabin.

[0032] For example, based on speed information, the motion state of the terminal device can be divided into two types: moving and stationary. Accordingly, based on this division of motion states, the reference correspondence can also include two sets, one of which is the first judgment threshold corresponding to when the terminal device is moving, and the other of which is the second judgment threshold corresponding to when the terminal device is stationary.

[0033] For example, the motion state of the terminal device can be further divided into multiple states based on speed; correspondingly, the reference correspondence can also include multiple sets to record the judgment thresholds corresponding to each motion state of the terminal device.

[0034] Based on the above technical solution, the terminal device acquires its own movement speed through an integrated speed sensor to determine its motion state, thereby dynamically adjusting the judgment threshold. Specifically, a larger judgment threshold is used when the device is moving, and an even larger threshold is used at faster movement speeds. This allows for the identification of subtle swipe gestures as clicks, avoiding misinterpretation of the user's intent. Furthermore, the terminal device in this solution can be a vehicle, an in-vehicle terminal, or other types of terminals fixed within a vehicle, demonstrating its broad applicability and suitability for a wider range of application scenarios.

[0035] In conjunction with the first aspect, in some implementations of the first aspect, the first offset is the straight-line distance between the first touch point and the second touch point. When the first offset is less than or equal to the first judgment threshold, the first operation is determined to be a click operation; or, when the first offset is greater than the first judgment threshold, the first operation is determined to be a swipe operation; or, when the horizontal component of the first offset is less than or equal to the first judgment threshold and the vertical component of the first offset is less than or equal to the first judgment threshold, the first operation is determined to be a click operation; or, when the horizontal component of the first offset is greater than the first judgment threshold or the vertical component of the first offset is greater than the first judgment threshold, the first operation is determined to be a swipe operation.

[0036] Based on the above technical solution, by simply judging the relationship between the first offset and the first judgment threshold, a minor swipe operation can be identified as a click operation, avoiding misidentification of the user's operation intent and making the user's operations on the terminal device smoother and more accurate. Furthermore, this method has low computational complexity, low overhead, and is easy to implement.

[0037] In conjunction with the first aspect, in some implementations of the first aspect, the terminal device is a vehicle. Based on the first motion state, a first driving scenario of the terminal device is determined. Based on the first driving scenario and a reference correspondence, a first judgment threshold is determined. The reference correspondence includes the correspondence between multiple driving scenarios of the terminal device and the judgment threshold. The multiple driving scenarios include at least two of the following: parking scenario, turning scenario, driving on a bumpy road scenario, and turning scenario performed on a bumpy road scenario.

[0038] For example, when the terminal device is a vehicle, its motion state can be represented not only by its own gear information or directly by a speed sensor, but also indirectly by physical parameters obtained from other types of sensors. For instance, by using tire pressure sensors to obtain the force state of the tires—that is, by analyzing the force points, directions, and magnitudes—the current motion state of the terminal device can be obtained, such as whether it is driving straight, turning left, turning right, reversing, or stationary, thus indirectly obtaining the lateral acceleration of the terminal device. Alternatively, by using suspension pressure sensors to obtain the airbag pressure, hydraulic pressure, etc., the current motion state of the terminal device can be obtained based on these pressure parameters, such as whether it is driving on a bumpy road and the degree of bumpiness, thus indirectly obtaining the longitudinal acceleration of the terminal device.

[0039] For example, when the terminal device is an in-vehicle terminal or a terminal device fixed to a vehicle, the terminal device can also establish a communication connection with the vehicle system to obtain the pressure sensors of the tires, suspension, etc., to obtain the corresponding physical parameters and indirectly obtain the motion state of the vehicle. Since the terminal device is fixed to the vehicle and the two remain relatively stationary, obtaining the motion state of the vehicle is equivalent to obtaining the motion state of the terminal device itself.

[0040] Based on the above technical solution, when the terminal device is a vehicle, the terminal device analyzes its own driving scenario and designs differentiated judgment thresholds for different driving scenarios. This allows the touch screen to dynamically adjust its touch response to the user in different driving scenarios, which helps to increase the accuracy of recognizing the user's operation intention.

[0041] In conjunction with the first aspect, in some implementations of the first aspect, the first motion state includes a first acceleration and / or a first velocity. The first acceleration includes a first sub-acceleration and a second sub-acceleration. The direction of the first sub-acceleration is along the first horizontal axis of the first coordinate system, and the direction of the second sub-acceleration is along the first vertical axis of the first coordinate system. The first coordinate system is established based on a touch screen, and the first horizontal axis is perpendicular to the first vertical axis. The first velocity includes a first sub-velocity and a second sub-velocity. The direction of the first sub-velocity is along the first horizontal axis, and the direction of the second sub-velocity is along the first vertical axis.

[0042] For example, the origin of the first coordinate system can be the center, centroid, or other reference point of the touch surface or display surface.

[0043] For example, the first sub-acceleration or the second sub-acceleration can be 0; the first sub-velocity and the second sub-velocity can be 0.

[0044] For example, the touchscreen of a terminal device can have multiple display modes, such as landscape and portrait modes. Taking a vehicle as an example, and the touchscreen as an in-vehicle central control screen, the touchscreen can be rotated 90 degrees clockwise (switching to portrait display mode) or other angles, or 90 degrees counterclockwise (switching back to landscape display mode) or other angles via a rotating component. During the screen rotation, the aforementioned first coordinate system can remain stationary to ensure that the first horizontal axis of the first coordinate system is parallel to the horizontal plane of the user's location. This is because the lateral acceleration of the terminal device is always relative to the horizontal plane.

[0045] Based on the above technical solution, the acceleration and / or velocity of the terminal device are decomposed into horizontal and vertical components, which helps to classify the motion state of the terminal device in more detail. Correspondingly, the reference correspondence can also include more correspondences between motion states and judgment thresholds, thereby helping to further improve the accuracy of recognizing user operation intentions.

[0046] In conjunction with the first aspect, in some implementations of the first aspect, the first horizontal axis is parallel to the horizontal plane where the user is located.

[0047] Based on the above technical solution, by fixing the first horizontal axis of the first coordinate system parallel to the horizontal plane of the user's position, the consistency of the user interaction experience during the rotation of the touch screen is ensured.

[0048] In conjunction with the first aspect, in some implementations of the first aspect, the terminal device is a vehicle, or the terminal device is fixed to the vehicle by a rigid fastener, and acquires the vehicle's first driving acceleration and / or first driving speed; based on the first driving acceleration and / or first driving speed, a first motion state is determined, wherein the first driving acceleration includes a first driving sub-acceleration and a second driving sub-acceleration, the direction of the first driving sub-acceleration is along the second horizontal axis of the second coordinate system, the direction of the second driving sub-acceleration is along the second vertical axis of the second coordinate system, the first driving speed includes a first driving sub-velocity and a second driving sub-velocity, the direction of the first driving sub-velocity is along the second horizontal axis, the second driving sub-velocity is along the second vertical axis, the second vertical axis is consistent with the direction of the first vertical axis, and the second horizontal axis is consistent with the direction of the first horizontal axis.

[0049] For example, the aforementioned second coordinate system can be a three-dimensional coordinate system based on the vehicle. The origin of the second coordinate system can correspond to the center, center of gravity, or other reference point of the vehicle. The second vertical axis of the second coordinate system is aligned with the vehicle's forward direction. The second horizontal axis of the second coordinate system is perpendicular to the second vertical axis and corresponds to the left and right sides of the vehicle. The second vertical axis of the second coordinate system is perpendicular to the plane in which the vehicle is located.

[0050] For example, since the fixed position and orientation of the touch screen inside different vehicles may not be fixed, when the first plane and the second plane are not parallel, it is necessary to transform the position of the second coordinate system so that the direction of the second horizontal axis of the transformed second coordinate system is consistent with the direction of the first horizontal axis of the first coordinate system.

[0051] Based on the above technical solution, the vehicle's speed can be obtained in the first coordinate system established based on the touch screen by means of coordinate system transformation, thereby expanding the application scenarios applicable to this solution.

[0052] In conjunction with the first aspect, in some implementations of the first aspect, the correspondence relationship includes the correspondence between the first acceleration interval and / or the first velocity interval and the first judgment threshold. The first acceleration interval includes the first lateral acceleration interval and the first longitudinal acceleration interval. The first velocity interval includes the first lateral velocity interval and the first longitudinal velocity interval. The first judgment threshold is determined based on the fact that the first sub-acceleration belongs to the first lateral acceleration interval and the second sub-acceleration belongs to the first longitudinal acceleration interval, and / or based on the fact that the first sub-velocity belongs to the first lateral velocity interval and the second sub-velocity belongs to the first longitudinal velocity interval.

[0053] For example, the direction of acceleration indicated by the first lateral acceleration interval is parallel to the first horizontal axis of the first coordinate system, and the direction of acceleration indicated by the first longitudinal acceleration interval is parallel to the first vertical axis of the first coordinate system; similarly, the direction of velocity indicated by the first lateral velocity interval is parallel to the first horizontal axis of the first coordinate system, and the direction of velocity indicated by the first longitudinal velocity interval is parallel to the first vertical axis of the first coordinate system.

[0054] For example, taking a first motion state including a first acceleration and a first velocity as an example, when the first acceleration of the terminal device is obtained, the first acceleration can be decomposed into a vector based on the first coordinate system, that is, the first acceleration is decomposed into an acceleration component along the first horizontal axis (used to represent the first sub-acceleration) and an acceleration component along the first vertical axis (used to represent the second sub-acceleration); similarly, when the first velocity of the terminal device is obtained, the first velocity can be decomposed into a vector based on the first coordinate system, that is, the first velocity is decomposed into a velocity component along the first horizontal axis (used to represent the first sub-velocity) and a velocity component along the first vertical axis (used to represent the second sub-velocity). Then, based on the aforementioned first sub-acceleration, second sub-acceleration, first sub-velocity, and second sub-velocity, and in conjunction with the aforementioned reference correspondence, it is determined that the first sub-acceleration belongs to the first lateral acceleration interval, the second sub-acceleration belongs to the first longitudinal acceleration interval, the first sub-velocity belongs to the first lateral velocity interval, and the second sub-velocity belongs to the first longitudinal velocity interval. The first lateral acceleration interval, the first longitudinal acceleration interval, the first lateral velocity interval, and the first longitudinal velocity interval belong to the first correspondence in the reference correspondence. This first correspondence also includes a first judgment threshold. Then, based on the first offset between the first touch point and the second touch point in the user's first operation and the first judgment threshold, it is determined whether the first operation is a click operation or a swipe operation.

[0055] For example, since the above reference correspondence also divides the acceleration interval and / or velocity interval into parameter intervals in two directions (e.g., lateral and longitudinal), the judgment thresholds corresponding to the acceleration interval and / or velocity interval can also be divided into components in two directions.

[0056] Based on the above technical solution, since the motion state of the terminal device can be more finely divided by acceleration and / or velocity, the corresponding reference relationship can also include a larger number of correspondences between motion states and judgment thresholds, thereby helping to further improve the accuracy of recognizing user operation intentions.

[0057] In conjunction with the first aspect, in certain implementations of the first aspect, the first judgment threshold includes a first lateral judgment threshold and a first longitudinal judgment threshold to determine a second motion state of the terminal device. The second motion state includes a second acceleration and / or a second velocity. The second acceleration includes a third sub-acceleration and a fourth sub-acceleration, the direction of the third sub-acceleration being along the first lateral axis and the direction of the fourth sub-acceleration being along the first longitudinal axis. The second velocity includes a third sub-velocity and a fourth sub-velocity, the direction of the third sub-velocity being along the first lateral axis and the direction of the fourth sub-velocity being along the first longitudinal axis. The third sub-acceleration is less than the first sub-acceleration, the fourth sub-acceleration is less than the second sub-acceleration, the third sub-velocity is less than the first sub-velocity, and the fourth sub-velocity is less than the fourth sub-velocity. Based on the second motion state and a reference correspondence, a second judgment threshold is determined. The second judgment threshold includes a second lateral judgment threshold and a second longitudinal judgment threshold, the second lateral judgment threshold being less than the first lateral judgment threshold, and the second longitudinal judgment threshold being less than the first longitudinal judgment threshold.

[0058] For example, the greater the acceleration and / or speed of the terminal device in one direction, the more lenient the judgment of click operations in that direction during the touch screen's response to user operations; the smaller the acceleration and / or speed in one direction, the more stringent the judgment of click operations in that direction during the touch screen's response to user operations.

[0059] Based on the above technical solution, when there is a difference between the lateral acceleration and longitudinal acceleration of the terminal device, and / or a difference between the lateral velocity and the longitudinal velocity, the judgment threshold is also divided into a lateral judgment threshold and a longitudinal judgment threshold. The judgment thresholds in the two directions are designed differently, which helps to increase the accuracy of recognizing the user's operation intention.

[0060] In conjunction with the first aspect, in some implementations of the first aspect, the first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold. When the horizontal component of the first offset is less than or equal to the first horizontal judgment threshold and the vertical component of the first offset is less than or equal to the first vertical judgment threshold, the first operation is determined to be a click operation; or, when the horizontal component of the first offset is greater than the first horizontal judgment threshold or the vertical component of the first offset is greater than the first vertical judgment threshold, the first operation is determined to be a swipe operation.

[0061] Based on the above technical solution, by acquiring the acceleration and / or velocity of the terminal device in real time, the motion state of the terminal device can be determined, thereby dynamically adjusting the sensitivity of the terminal touch screen, recognizing minor swipe operations as click operations, avoiding incorrect recognition of the user's operation intention, and helping to improve the stability of the terminal device touch screen interaction experience and the accuracy of user intention recognition.

[0062] In conjunction with the first aspect, in some implementations of the first aspect, the first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold. Based on the first horizontal judgment threshold and the first vertical judgment threshold, a first elliptical range is determined, and the center of the first elliptical range is the first touch point. When the first offset is less than or equal to the radial distance of the first elliptical range, the first operation is determined to be a click operation; or, when the first offset is greater than at least one radial distance of the first elliptical range, the first operation is determined to be a swipe operation.

[0063] Based on the above technical solution, by acquiring the acceleration and / or velocity of the terminal device in real time, the motion state of the terminal device can be determined, thereby dynamically adjusting the sensitivity of the terminal touch screen, recognizing minor swipe operations as click operations, avoiding incorrect recognition of the user's operation intention, and helping to improve the stability of the terminal device touch screen interaction experience and the accuracy of user intention recognition.

[0064] In a second aspect, an interactive device is provided, applied to a terminal device, the terminal device including a touch screen. The device includes: a determining unit, configured to determine a first motion state of the terminal device; determine a first judgment threshold based on the first motion state and a reference correspondence, the reference correspondence representing the correspondence between multiple motion states of the terminal device and the judgment threshold; an acquiring unit, configured to acquire a first touch point and a second touch point in a first operation performed by a user on the touch screen; and a judging unit, configured to determine a first offset based on the first touch point and the second touch point; and determine whether the first operation is a click operation or a swipe operation based on the first judgment threshold and the first offset.

[0065] In conjunction with the second aspect, in some implementations of the second aspect, the first touch point is the starting point of the first operation, and the second touch point is the ending point of the first operation.

[0066] In conjunction with the second aspect, in some implementations of the second aspect, the terminal device is a vehicle, and the determining unit is specifically used to: obtain the first gear information of the terminal device; and determine the first motion state based on the first gear information.

[0067] In conjunction with the second aspect, in some implementations of the second aspect, the first gear information is used to indicate that the terminal device is in drive gear, and the determining unit is further used to: obtain the second gear information of the terminal device, the second gear information being used to indicate that the terminal device is in park gear; the second determining unit is further used to: determine a second judgment threshold based on the second gear information and a reference correspondence, the second judgment threshold being less than the first judgment threshold.

[0068] In conjunction with the second aspect, in some implementations of the second aspect, the first gear information is used to indicate that the terminal device is in the first sub-drive gear in the drive gear, and the determining unit is further used to: obtain the third gear information of the terminal device, the third gear information being used to indicate that the terminal device is in the second sub-drive gear in the drive gear, the second sub-drive gear being lower than the first sub-drive gear; and determine a third judgment threshold based on the third gear information and a reference correspondence, the third judgment threshold being less than the first judgment threshold.

[0069] In conjunction with the second aspect, in some implementations of the second aspect, the first motion state is used to indicate that the terminal device is moving, and the determining unit is further used to: determine the second motion state of the terminal device, the second motion state being used to indicate that the terminal device is stationary; and determine a second judgment threshold based on the second motion state and a reference correspondence, wherein the second judgment threshold is less than the first judgment threshold.

[0070] In conjunction with the second aspect, in some implementations of the second aspect, the first offset is the straight-line distance between the first touch point and the second touch point, and the judgment unit is specifically used to: determine the first operation as a click operation when the first offset is less than or equal to the first judgment threshold; or, determine the first operation as a swipe operation when the first offset is greater than the first judgment threshold; or, determine the first operation as a click operation when the horizontal component of the first offset is less than or equal to the first judgment threshold and the vertical component of the first offset is less than or equal to the first judgment threshold; or, determine the first operation as a swipe operation when the horizontal component of the first offset is greater than the first judgment threshold or the vertical component of the first offset is greater than the first judgment threshold.

[0071] In conjunction with the second aspect, in some implementations of the second aspect, the terminal device is a vehicle, and the determining unit is specifically used to: determine a first driving scenario of the terminal device based on a first motion state; and determine a first judgment threshold based on the first driving scenario and a reference correspondence relationship, wherein the reference correspondence relationship includes the correspondence relationship between multiple driving scenarios of the terminal device and the judgment threshold, and the multiple driving scenarios include at least two of the following: parking scenario, turning scenario, driving on a bumpy road scenario, and performing a turning scenario on a bumpy road scenario.

[0072] In conjunction with the second aspect, in some implementations of the second aspect, the first motion state includes a first acceleration and / or a first velocity. The first acceleration includes a first sub-acceleration and a second sub-acceleration. The direction of the first sub-acceleration is along the first horizontal axis of the first coordinate system, and the direction of the second sub-acceleration is along the first vertical axis of the first coordinate system. The first coordinate system is established based on a touch screen, and the first horizontal axis is perpendicular to the first vertical axis. The first velocity includes a first sub-velocity and a second sub-velocity. The direction of the first sub-velocity is along the first horizontal axis, and the direction of the second sub-velocity is along the first vertical axis.

[0073] In conjunction with the second aspect, in some implementations of the second aspect, the first horizontal axis is parallel to the horizontal plane where the user is located.

[0074] In conjunction with the second aspect, in some implementations of the second aspect, the terminal device is a vehicle, or the terminal device is fixed to the vehicle by a rigid fastener. The determining unit is specifically used to: acquire the first driving acceleration and / or the first driving speed of the vehicle; determine a first motion state based on the first driving acceleration and / or the first driving speed, wherein the first driving acceleration includes a first driving sub-acceleration and a second driving sub-acceleration, the direction of the first driving sub-acceleration is along the second horizontal axis of the second coordinate system, the direction of the second driving sub-acceleration is along the second vertical axis of the second coordinate system, the first driving speed includes a first driving sub-velocity and a second driving sub-velocity, the direction of the first driving sub-velocity is along the second horizontal axis, the direction of the second driving sub-velocity is along the second vertical axis, the direction of the second vertical axis is consistent with the direction of the first vertical axis, and the direction of the second horizontal axis is consistent with the direction of the first horizontal axis.

[0075] In conjunction with the second aspect, in some implementations of the second aspect, the reference correspondence includes the correspondence between the first acceleration interval and / or the first velocity interval and the first judgment threshold. The first acceleration interval includes the first lateral acceleration interval and the first longitudinal acceleration interval, and the first velocity interval includes the first lateral velocity interval and the first longitudinal velocity interval. The determining unit is specifically used to: determine the first judgment threshold based on the fact that the first sub-acceleration belongs to the first lateral acceleration interval and the second sub-acceleration belongs to the first longitudinal acceleration interval, and / or based on the fact that the first sub-velocity belongs to the first lateral velocity interval and the second sub-velocity belongs to the first longitudinal velocity interval.

[0076] In conjunction with the second aspect, in some implementations of the second aspect, the first judgment threshold includes a first lateral judgment threshold and a first longitudinal judgment threshold. The determining unit is further configured to: determine a second motion state of the terminal device, the second motion state including a second acceleration and / or a second velocity, the second acceleration including a third sub-acceleration and a fourth sub-acceleration, the direction of the third sub-acceleration being along a first lateral axis and the direction of the fourth sub-acceleration being along a first longitudinal axis, the second velocity including a third sub-velocity and a fourth sub-velocity, the direction of the third sub-velocity being along a first lateral axis and the direction of the fourth sub-velocity being along a first longitudinal axis, wherein the third sub-acceleration is less than the first sub-acceleration, the fourth sub-acceleration is less than the second sub-acceleration, the third sub-velocity is less than the first sub-velocity, and the fourth sub-velocity is less than the fourth sub-velocity; and determine a second judgment threshold based on the second motion state and a reference correspondence, the second judgment threshold including a second lateral judgment threshold and a second longitudinal judgment threshold, the second lateral judgment threshold being less than the first lateral judgment threshold and the second longitudinal judgment threshold being less than the first longitudinal judgment threshold.

[0077] In conjunction with the second aspect, in some implementations of the second aspect, the first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold. The judgment unit is specifically used to: determine the first operation as a click operation when the horizontal component of the first offset is less than or equal to the first horizontal judgment threshold and the vertical component of the first offset is less than or equal to the first vertical judgment threshold; or, determine the first operation as a swipe operation when the horizontal component of the first offset is greater than the first horizontal judgment threshold or the vertical component of the first offset is greater than the first vertical judgment threshold.

[0078] In conjunction with the second aspect, in some implementations of the second aspect, the first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold. The judgment unit is specifically used to: determine a first elliptical range based on the first horizontal judgment threshold and the first vertical judgment threshold, wherein the center of the first elliptical range is the first touch point; determine the first operation as a click operation when the first offset is less than or equal to the radial distance of the first elliptical range; or determine the first operation as a swipe operation when the first offset is greater than at least one radial distance of the first elliptical range.

[0079] Thirdly, a terminal device is provided, including a touch screen; a memory for storing one or more programs; and at least one processor for calling one or more programs stored in the memory to cause the terminal device to execute a method as described in any possible implementation of the method design of the first aspect above.

[0080] Fourthly, a vehicle is provided, including a touch screen and an interactive device in any possible implementation of the method design described in the second aspect above.

[0081] Fifthly, a chip is provided, including a circuit for performing the method in any possible implementation of the method design of the first aspect described above.

[0082] In a sixth aspect, a computer-readable storage medium is provided storing a computer program or instructions for implementing the method in any possible implementation of the method design of the first aspect.

[0083] In a seventh aspect, a computer program product is provided, wherein when the computer program code or instructions are executed on a computer, the computer performs the method in any possible implementation of the method design of the first aspect described above. Attached Figure Description

[0084] Figure 1 This is a functional block diagram of a vehicle provided in an embodiment of this application;

[0085] Figure 2 This is a schematic diagram of a vehicle cabin scenario provided in an embodiment of this application;

[0086] Figure 3 These are the two forms of representation for the offset range proposed at this stage;

[0087] Figure 4 This is a schematic diagram of the architecture of a terminal device 400 applicable to an embodiment of this application;

[0088] Figure 5 This is a flowchart illustrating an interaction method 500 proposed in an embodiment of this application;

[0089] Figure 6 This is a schematic diagram illustrating the principle of recognizing user operations based on the interaction method proposed in the embodiments of this application.

[0090] Figure 7 This is a flowchart illustrating a method 700 for determining the motion state of a terminal device according to an embodiment of this application.

[0091] Figure 8 This is a flowchart illustrating another method 800 for determining the motion state of a terminal device according to an embodiment of this application;

[0092] Figure 9 This is a schematic diagram illustrating the first judgment threshold corresponding to different driving scenarios of the terminal device as proposed in the embodiments of this application;

[0093] Figure 10 This is a schematic diagram of the first coordinate system proposed in the embodiments of this application;

[0094] Figure 11This is a flowchart illustrating another method 1100 for determining the motion state of a terminal device according to an embodiment of this application;

[0095] Figure 12 This is a schematic diagram of a second coordinate system proposed in an embodiment of this application;

[0096] Figure 13 This is another schematic diagram illustrating the principle of recognizing user operations based on the interaction method proposed in the embodiments of this application;

[0097] Figure 14 This is a schematic diagram of an interactive device 1400 proposed in an embodiment of this application. Detailed Implementation

[0098] It should be noted that, in the description of the embodiments of this application, unless otherwise stated, " / " means "or". For example, A / B can mean A or B. The "and / or" in this article is merely a description of the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone.

[0099] In the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more, and "at least one" and "one or more" refer to one, two, or more than two. The singular expressions "a," "an," "the," "the," "the," and "this" are intended to also include expressions such as "one or more," unless the context explicitly indicates otherwise.

[0100] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0101] In this application, "for indication" can be understood as "enabling," which can include direct and indirect enabling. When describing information as enabling A, it can include whether the information directly or indirectly enables A, but does not necessarily mean that the information carries A. The information enabled by the information is called the information to be enabled. In the specific implementation process, there are many ways to enable the information to be enabled, such as, but not limited to, directly enabling the information to be enabled, such as the information to be enabled itself or its index. It can also indirectly enable the information to be enabled by enabling other information, where there is a correlation between the other information and the information to be enabled. It can also enable only a part of the information to be enabled, while the other parts are known or pre-agreed. For example, enabling specific information can be achieved by using a pre-agreed (e.g., protocol-defined) arrangement order of various information, thereby reducing enabling overhead to some extent. At the same time, common parts of various information can be identified and enabled uniformly to reduce the enabling overhead caused by individually enabling the same information.

[0102] In this application, "pre-configuration" may include pre-defined terms, such as protocol definitions. These "pre-defined terms" can be implemented by pre-storing corresponding codes, tables, or other means of indicating relevant information in the device (e.g., including various network elements). This application does not limit the specific implementation method.

[0103] The term "storage" or "preservation" in this application can refer to storage in one or more memory devices. These memory devices can be separately configured or integrated into an encoder, decoder, processor, or communication device. Alternatively, some memory devices can be separately configured, while others can be integrated into the decoder, processor, or communication device. The type of memory can be any form of storage medium, and this is not limited.

[0104] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0105] The technical solutions in this application embodiment can be applied to vehicles. Figure 1 This is a functional block diagram of a vehicle provided in an embodiment of this application. For example... Figure 1As shown, the vehicle 100 may include a screen 130 and a computing platform 150. The screen 130 in the cabin is mainly divided into two categories: the first is an in-vehicle display screen; the second is a projection display screen, such as a head-up display (HUD). An in-vehicle display screen is a physical display screen and an important component of the in-vehicle infotainment system. Multiple displays can be installed in the cabin, such as a digital instrument cluster display, a central control screen, a display screen in front of the front passenger (also known as the front-seat passenger), a display screen in front of the left rear passenger, and a display screen in front of the right rear passenger; even the vehicle windows can be used as displays. A head-up display, also known as a head-up display system, is mainly used to display driving information such as speed and navigation on a display device in front of the driver (such as the windshield). This reduces the driver's eye-shifting time, avoids pupil changes caused by eye-shifting, and improves driving safety and comfort. HUDs include, for example, combiner-HUD (C-HUD) systems, windshield-HUD (W-HUD) systems, and augmented reality HUD (AR-HUD) systems.

[0106] Some or all of the functions of vehicle 100 can be controlled by computing platform 150. Computing platform 150 may include processors 151 to 15n. A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU), microprocessor, graphics processing unit (GPU) (which can be understood as a type of microprocessor), or digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships are fixed or reconfigurable. For example, the processor may be a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field-programmable gate array (FPGA). In reconfigurable hardware circuits, the process of the processor loading configuration documents to configure the hardware circuit can be understood as the process of the processor loading instructions to implement related functions. Furthermore, the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing unit (DPU), etc. In addition, the computing platform 150 may also include a memory for storing instructions. Some or all of the processors 151 to 15n can call the instructions in the memory to implement the corresponding functions.

[0107] Optionally, the structure of the vehicle 100 described above is merely illustrative. In actual applications, various components of the vehicle 100 may be added or removed as needed.

[0108] The vehicles involved in this application can include road vehicles, water vehicles, air vehicles, industrial equipment, agricultural equipment, or entertainment equipment. For example, vehicles can include driverless vehicles. The term "vehicle" is used broadly and can refer to various types of vehicles, such as transportation vehicles (e.g., commercial vehicles, passenger cars, motorcycles, flying cars, trains), industrial vehicles (e.g., forklifts, trailers, tractors), engineering vehicles (e.g., excavators, bulldozers, cranes), agricultural equipment (e.g., lawnmowers, harvesters), amusement equipment, and toy vehicles. This application does not specifically limit the type of vehicle. For ease of description, this application uses an autonomous vehicle as an example for detailed explanation.

[0109] Figure 2 This is a schematic diagram of a vehicle cabin scenario provided in an embodiment of this application. The intelligent cabin is equipped with one or more in-vehicle displays (or in-vehicle screens), including but not limited to display screen 201 (or central control screen), display screen 202 (or passenger entertainment screen), display screen 203 (or driver's headrest rear screen), display screen 204 (or passenger headrest rear screen), display screen 205 (or second-row entertainment screen) mounted on the cabin ceiling, door panel screen 206 mounted on the rear seats, armrest screen 207 mounted on the rear seats, and instrument panel screen. Further, displays 201 to 207 can display a graphical user interface (GUI), which may include icons for one or more applications, and / or one or more cards. For example, Figure 1 The screen 130 shown can be one or more of displays 201 to 207. In some possible implementations, display 201 can also be a long, continuous screen extending into the passenger area. Additionally, display 205 can be a projection screen associated with a projector, which can be associated with a desktop launcher to manage applications projected onto the projection screen. Alternatively, display 205 can also be a rollable screen.

[0110] Figure 2 The cockpit can also be equipped with one or more cameras to capture images inside or outside the cockpit, such as cameras from a driver monitor system (DMS), a cabin monitor system (CMS), and a dashcam. These cameras can be the same or different cameras. In addition, one or more pressure sensors and acoustic sensors are installed in the cockpit to monitor the presence and location of users.

[0111] It should be understood that the following embodiments are based on Figure 2The embodiments shown are illustrated using a 5-seat vehicle as an example, but the present application is not limited to this. For example, for a 7-seat sport / suburban utility vehicle (SUV), the cabin may include a central control screen, a passenger entertainment screen, a screen behind the driver's headrest, a screen behind the passenger's headrest, entertainment screens in the left-hand area of ​​the third row, and entertainment screens in the right-hand area of ​​the third row. As another example, for a bus, the cabin may include front and rear entertainment screens; or, the cabin may include a display screen in the driver's area and an entertainment screen in the passenger area. Furthermore, the following embodiments use a left-hand drive vehicle (i.e., the driver is on the left side of the vehicle) as an example; in actual implementation, the vehicle may also be a right-hand drive vehicle (i.e., the driver is on the right side of the vehicle).

[0112] With the development of intelligent vehicle technology, in-vehicle human-machine interaction systems have become a crucial module affecting the user's driving experience. Thanks to the intuitive and convenient operation of touchscreens, they have become the primary interaction medium for in-vehicle human-machine interaction systems.

[0113] However, when users interact with the in-vehicle human-machine interface system via touchscreen, the vehicle is usually in motion. Due to the complexity of the driving environment (such as driving through curves and road bumps), when a user intends to click on the touchscreen while driving, the vehicle's lateral swaying or vertical bumps may cause a slight swipe instead of a click. If the touchscreen directly recognizes this as a swipe, it cannot provide the user with the interactive interface or information that would follow the click, such as showing the content displayed by the touched control based on the swipe, or it may not respond at all. When users cannot receive quick and accurate feedback from the touchscreen, it not only directly reduces the user experience but may also cause negative emotions (such as anxiety, irritability, and anger), affecting driving and creating safety hazards. Therefore, improving the accuracy of touchscreen recognition of user operations is crucial for enhancing user experience and ensuring safe driving.

[0114] For ease of understanding and description, the following explanations are provided for several terms used in this application.

[0115] Considering that users' actual operation on the touchscreen can be divided into two basic forms: clicking and swiping, the swiping trajectory can be equivalent to multiple trajectory points left by the user on the touchscreen. Among these trajectory points, there are two key points: the initial touch point, which refers to the starting point when the user operates on the touchscreen (i.e., the trajectory start point); and the final touch point, which refers to the ending point when the user operates on the touchscreen (i.e., the trajectory end point).

[0116] Furthermore, considering that users' actual operations on the touchscreen may deviate from the intended action—for example, a user's intention might be to tap the screen, but the actual operation might be a slight swipe—this deviation in user operation can be termed touch offset. This touch offset can be quantified as the coordinate distance between the initial and final touch points in the same coordinate system.

[0117] In order to make the touch screen response meet the user's intention, such a small swipe operation can be equivalent to a click operation. Therefore, the concept of offset range has been proposed. The offset range is centered on the initial touch point. That is, the position of the offset range is based on the initial touch point in the user operation and moves with the initial touch point, but the area of ​​the offset range is fixed.

[0118] Figure 3 These are the two offset range representations proposed at this stage.

[0119] refer to Figure 3 In (a), the offset range is a rectangular area centered on the initial touch point during user operation. The vertical distance between the upper and lower boundaries of this rectangular area and the initial touch point can be called the vertical judgment threshold, and the vertical distance between the left and right boundaries of this rectangular area and the initial touch point can be called the horizontal judgment threshold. Based on this offset range, the following user operation recognition method is proposed at this stage:

[0120] If the horizontal touch offset xn (e.g., the horizontal distance between the user's operation endpoint and the starting point) corresponding to the user's actual operation on the touchscreen is less than or equal to the above-mentioned horizontal judgment threshold, and / or the vertical touch offset yn (e.g., the vertical distance between the user's operation endpoint and the starting point) is less than or equal to the vertical judgment threshold, then the operation is considered a click operation; if the horizontal touch offset xn corresponding to the user's actual operation on the touchscreen is greater than the above-mentioned horizontal judgment threshold, and / or the vertical touch offset yn is greater than the vertical judgment threshold, then the operation is considered a swipe operation.

[0121] refer to Figure 3 In (b), the offset range is a circular area centered on the initial touch point during user operation. The radius of this circular area can be called the radial judgment threshold. Based on the offset range of this presentation format, the following user operation recognition method is proposed at this stage:

[0122] If the touch offset rn corresponding to the user's actual operation on the touchscreen (e.g., the distance between the user's operation end point and the starting point) is less than or equal to the above radial judgment threshold, the operation is considered a click operation; if the touch offset rn corresponding to the user's actual operation on the touchscreen is greater than the above radial judgment threshold, the operation is considered a swipe operation.

[0123] The proposed offset-range-based user operation response scheme essentially reduces the sensitivity of the touchscreen to a certain extent, preventing the user's limbs from being unstable relative to the touchscreen and causing the user's click operation to be executed as a slight swipe. If the touchscreen happens to recognize the operation as a swipe, the touchscreen's response will not match the user's intention.

[0124] However, taking in-vehicle human-machine interaction systems as an example, in vehicle usage scenarios, there exists a dual-modal scenario of vehicle movement and stillness. When the vehicle is moving, due to turning or driving on bumpy roads, there is usually a large and unstable relative displacement between the user's limbs and the touchscreen. In this case, the user operation recognition method based on fixed judgment thresholds proposed at this stage can increase the accuracy of recognizing the user's operation intention to a certain extent, but the effect is limited, that is, there are still some defects, which are as follows:

[0125] In scenarios where the vehicle is stationary or traveling straight on a smooth road, the use of a fixed threshold to identify user actions reduces the sensitivity of the touchscreen and may misidentify swiping actions as clicks, which is inconsistent with the user's intention.

[0126] In scenarios involving vehicle movement, assuming user actions are identified based on a fixed threshold, when the lateral acceleration (due to turning) and / or vertical acceleration (due to road bumps) of the vehicle are large, there is still a significant possibility that the user's intended click action (which is actually executed as a swipe action on the touchscreen due to the vehicle's lateral and / or vertical acceleration) will be identified as a swipe action, which is inconsistent with the user's intent.

[0127] In scenarios involving vehicle movement, the vehicle may only exhibit lateral acceleration or only longitudinal acceleration. Since user actions are identified based on a fixed threshold, the touchscreen's sensitivity to lateral and vertical swipes is reduced. Therefore, when the vehicle only exhibits lateral acceleration, a vertical swipe on the touchscreen might be misidentified as a click; similarly, when the vehicle only exhibits lateral acceleration, a lateral swipe might be misidentified as a click, contradicting the user's intent.

[0128] In summary, even with current methods that address the low accuracy of touchscreen recognition of user intentions in vehicle driving scenarios using fixed thresholds, the methods lack flexibility, have limited effectiveness, and may even increase the probability of misrecognition in certain situations. Therefore, this application proposes an interaction method, device, and vehicle that analyzes the motion state of the terminal device on which the touchscreen is mounted and adaptively adjusts the offset range to further improve the accuracy of the touchscreen in recognizing user intentions. This enhances the user experience of the in-vehicle human-machine interaction system and provides assurance for safe driving.

[0129] Figure 4 This is a schematic diagram of the architecture of a terminal device 400 applicable to an embodiment of this application.

[0130] refer to Figure 4 As shown, the terminal device 400 includes a touch screen 410, which includes a display panel 411, a touch sensor layer 412, and a processing module 413.

[0131] Display panel 411 is the visual output part of touch screen 410, used to display images, text, videos and other content.

[0132] The touch sensor layer 412 is responsible for detecting user touch operations. For example, when a user's finger or stylus touches the screen, the sensor layer can capture this action, convert it into an electrical signal, and then send the electrical signal to the processing module 413.

[0133] When the processing module 413 receives the electrical signal sent by the touch sensor layer 412, it identifies the operation type (click, swipe, etc.) through an algorithm, calculates the specific coordinates of the touch point, and calls the corresponding function or application of the terminal device according to the operation type and coordinate position.

[0134] In some possible embodiments, the terminal device 400 can be an in-vehicle terminal integrated into the vehicle cabin, such as an in-vehicle infotainment system, vehicle control system, or integrated in-vehicle terminal; of course, the terminal device 400 can also be integrated into other mobile carriers, such as trains, ships, and airplanes. Furthermore, the terminal device 400 can also be other portable terminal devices, such as tablets, mobile phones, and laptops, but these portable terminal devices need to be fixed to the mobile carrier by rigid fasteners. Regardless of whether the terminal device 400 is integrated into the mobile carrier or is a portable terminal device fixed to the mobile carrier by rigid fasteners, it is necessary to ensure that the terminal device 400 moves with the mobile carrier. The user, riding in the mobile carrier, performs touch operations on the touchscreen 410 of the terminal device 400 within the mobile carrier. This serves as the basic application scenario for the interaction method proposed in the embodiments of this application, which can be executed by the processing module 413.

[0135] In some possible embodiments, the terminal device 400 described above can also be understood as a vehicle, and the touch screen 410 in the terminal device 400 can be the central control screen in the vehicle cabin, or the touch screen of other vehicle terminals.

[0136] Figure 5 This is a flowchart illustrating an interaction method 500 proposed in an embodiment of this application. The interaction method 500 can be applied to any of the terminal devices proposed in the above embodiments, and the terminal device includes a touchscreen.

[0137] refer to Figure 5 As shown, the interaction method 500 may include the following steps:

[0138] S510: Determine the first motion state of the terminal device.

[0139] In some possible embodiments, the motion state of the terminal device can be two: one is stationary, and the other is in motion.

[0140] In some possible embodiments, the motion state of the terminal device can be multiple. For example, the motion state can be represented by acceleration and / or velocity, with different accelerations and / or velocities corresponding to different motion states. Similarly, the motion state can be represented by acceleration ranges and / or velocity ranges, with different acceleration ranges and / or velocity ranges corresponding to different motion states.

[0141] Therefore, the aforementioned first motion state is one of several motion states of the terminal device. Furthermore, the motion state of the terminal device is its motion relative to the ground or relative to a geographic coordinate system. Thus, the first motion state of the terminal device can be determined in the following way:

[0142] In some possible embodiments, when a speed sensor and / or an acceleration sensor are built into the terminal device, the first motion state of the terminal device can be determined by the speed sensor and / or acceleration sensor.

[0143] In some possible embodiments, the terminal device is a portable terminal fixed to the vehicle end by a rigid fastener (i.e., the terminal device and the vehicle are relatively stationary), or an in-vehicle terminal integrated into the cabin, or even a whole vehicle. In this case, the first motion state of the terminal device can be determined by acquiring the motion state of the vehicle. The motion state of the vehicle can be acquired by sensors mounted on the vehicle, or determined based on the working state of the drive hardware (e.g., gear position).

[0144] In some possible embodiments, when the terminal device is a portable terminal fixed inside the cockpit or an in-vehicle terminal integrated into the cockpit, a communication connection can be established between the terminal device and the vehicle control service system to obtain the current gear information of the vehicle and determine the motion state of the terminal device. Alternatively, a communication connection can be established between the terminal device and a corresponding system capable of acquiring the real-time acceleration and / or speed of the vehicle, so that the terminal device can acquire data collected by wheel speed sensors and / or acceleration sensors to determine the motion state of the terminal device.

[0145] S520: Determine a first judgment threshold based on the first motion state and the reference correspondence, wherein the reference correspondence is used to represent the correspondence between multiple motion states of the terminal device and the judgment threshold.

[0146] The user's trajectory on the touchscreen can be a sliding motion or a single touch point. Furthermore, based on the aforementioned first judgment threshold, an offset range (which can be called the first offset range) can be determined. A larger first judgment threshold indicates a larger first offset range, and a smaller threshold indicates a smaller first offset range. The position of this first offset range can be determined based on a single touch point in the user's touchscreen operation, such as the starting point of the touch operation or other touch points. Therefore, the position of this first offset range on the touchscreen is related to the user's position on the touchscreen.

[0147] As can be seen from the foregoing, the larger the first judgment threshold, the larger the first offset range, in order to cope with scenarios where the terminal device has large lateral swings or vertical bumps, and there is an uncertain relative displacement between the user's limbs and the touch screen due to their own inertia; conversely, the smaller the first judgment threshold, the smaller the first offset range, in order to cope with scenarios where the user can accurately touch the touch screen when the terminal device is moving smoothly or stationary.

[0148] In some possible embodiments, multiple motion states may correspond to different judgment thresholds; or, a portion of the multiple motion states may correspond to one judgment threshold, another portion of the multiple motion states may correspond to another judgment threshold, and so on.

[0149] In some possible embodiments, the above reference correspondence may be predetermined.

[0150] In some possible embodiments, a relationship (e.g., a relationship table) between the motion state of the terminal device and a judgment threshold can be established, and this relationship can be used to characterize the reference correspondence. When the first motion state is obtained, the first judgment threshold can be determined by looking up the relationship information, and the user's current touch operation can be responded to based on the first judgment threshold. This relationship information can be obtained through one or more methods such as experience, theoretical derivation, experimentation, or simulation.

[0151] In some possible embodiments, the correspondence between the multiple motion states and the judgment thresholds can be modeled, and the reference correspondence can be represented by the model. When the first motion state is obtained, the first motion state is input into the model to obtain the corresponding first judgment threshold, and then the user's current touch operation is responded to based on the first judgment threshold.

[0152] In some possible embodiments, the above reference correspondence can also be represented in other forms, such as a relationship diagram obtained by visualizing the above reference correspondence.

[0153] S530: Obtain the first touch point and the second touch point in the user's first operation on the touch screen.

[0154] In some possible embodiments, during the process of responding to the user's first operation, the touch screen samples the trajectory of the user's first operation on the touch screen. If the trajectory is a single point, then the sampled touch point is a single point; if the trajectory is a swipe, then the number of sampled touch points is multiple, and these touch points are all correlated with time. Therefore, the first touch point and the second touch point in the aforementioned first operation can be any two touch points from the multiple touch points obtained after sampling the first operation, such as the start and end points of multiple touch points in a time sequence, or the second or second-to-last touch point, etc.

[0155] In some possible embodiments, if the trajectory point sampled during the first operation is a single trajectory point, it can be assumed that the first touch point and the second touch point simultaneously correspond to that trajectory point.

[0156] S540: Determine the first offset based on the first touch point and the second touch point.

[0157] In some possible embodiments, the first offset can be used to represent the straight-line distance between the first touch point and the second touch point.

[0158] In some possible embodiments, during method 500, a coordinate system can be established based on the touch surface of the touch screen to obtain the coordinates of the first touch point and the second touch point. Based on the coordinates of these two touch points, the first offset can be determined.

[0159] S550: Based on the first judgment threshold and the first offset, determine whether the first operation is a click operation or a swipe operation.

[0160] Among them, the first judgment threshold and the first offset are the same type of physical parameters, both used to represent distance.

[0161] Figure 6 This is a schematic diagram illustrating the principle of user operation recognition based on the interaction method proposed in the embodiments of this application. This schematic diagram is only an example, and for ease of viewing, the influence of the touch point radius on the comparison between the first offset and the first judgment threshold is ignored.

[0162] In some possible embodiments, the aforementioned first offset can be the straight-line distance between the first touch point and the second touch point. Then, the first operation can be determined as either a click operation or a swipe operation in the following way:

[0163] refer to Figure 6 In (a), when the first offset is less than or equal to the first judgment threshold, the first operation can be determined to be a click operation.

[0164] refer to Figure 6 In (b), when the first offset is greater than the first judgment threshold, the first operation can be determined to be a sliding operation.

[0165] According to the above Figure 6 (a) and Figure 6 As can be seen from (b) in the figure, the shape of the first offset range determined based on the first judgment threshold is circular, and the size of the first judgment threshold is equal to the radius of the circle.

[0166] refer to Figure 6 In step (c), when the horizontal component of the first offset is less than or equal to the first judgment threshold and the vertical component of the first offset is less than or equal to the first judgment threshold, the first operation is determined to be a click operation.

[0167] refer to Figure 6In step (d), when the horizontal component of the first offset is greater than the first judgment threshold or the vertical component of the first offset is greater than the first judgment threshold, the first operation is determined to be a sliding operation.

[0168] According to the above Figure 6 (c) and Figure 6 As can be seen from (d) in the figure, the shape of the first offset range determined based on the first judgment threshold is a square, and the size of the first judgment threshold is equal to 1 / 2 of the side length of the square.

[0169] In some possible embodiments, the offset region defined based on the judgment threshold can have various shapes, such as rectangles, ellipses, etc., depending on the different motion states of the terminal device. Figure 6 The shape of the sliding region shown is presented only as an example.

[0170] In some possible embodiments, assuming that the number of touch points sampled during the first operation is multiple, when the first touch point and the second touch point are two designated points among the multiple touch points, after performing a comparison between the first offset and the first judgment threshold, the first operation can be directly determined to be a sliding operation or a clicking operation.

[0171] In some possible embodiments, assuming that the number of touch points sampled during the first operation is multiple, and the first touch point and the second touch point are any two of the multiple touch points, in the complete process of determining whether the first operation is a swipe operation or a click operation, it is necessary to compare the offset between any two touch points sampled during the first operation with a first judgment threshold. When it is determined that the offset between two touch points is greater than the first judgment threshold, the first operation can be directly determined to be a swipe operation; when the offset between any two touch points is compared with the first judgment threshold and no offset greater than the first judgment threshold is found, the first operation can be determined to be a click operation.

[0172] In some possible embodiments, the first touch point can be the starting point in the first operation. Considering that the first offset range can be determined based on the first judgment threshold and the position of the first touch point, the first operation can be determined to be a sliding operation or a clicking operation based on the positional relationship between each touch point and the first offset range in the first operation. Figure 6The principle illustrated involves comparing the offset of each touch point from the first touch point with a first judgment threshold. If the offset of any touch point from the first touch point is greater than the first judgment threshold, the first operation is considered a swipe operation. If the offsets of all touch points from the first touch point are less than or equal to the first judgment threshold, the first operation is considered a click operation. In other words, if all touch points in the first operation are within the first offset range, the first operation can be determined as a click operation; if there are touch points outside the first offset range, the first operation can be determined as a swipe operation.

[0173] Based on the above judgment mechanism, it can be seen that when the touch screen can respond to the user's circle drawing operation, the trajectory of the circle drawing operation that the touch screen can respond to is usually greater than the offset range defined by sensitivity. This means that when the first operation is a circle drawing operation, there will inevitably be some trajectory points outside the first offset range. Even if the starting point and ending point of the trajectory of the first operation are both within the first offset range, the circle drawing operation will not be identified as a click operation, so that the touch screen response result matches the user's intention.

[0174] Based on the above technical solution, by improving the touchscreen's response mechanism, even if there is uncertain and continuous relative displacement between the user's limb or stylus and the terminal device, the terminal device can accurately recognize the user's operating intention, improving the touchscreen's accuracy in recognizing user operating intentions. This makes user operations on the terminal device smoother and more accurate. This not only enhances the user experience, especially when operating the touchscreen of an in-vehicle human-machine interaction system, making interaction between the user and the touchscreen more convenient and efficient while driving, but also provides a guarantee for safe driving.

[0175] In some possible embodiments, considering that in determining whether the user's first operation is a swipe operation or a click operation, it is necessary to determine whether the distance between multiple touch points and the first touch point is greater than a first judgment threshold, in order to further reduce computational overhead, improve computational efficiency and improve the response speed of the touch screen, the starting point of the first operation can be taken as the first touch point and the ending point of the first operation can be taken as the second touch point. Then, by judging the relationship between the first offset between these two points and the first judgment threshold, the first operation can be directly determined to be a swipe operation or a click operation.

[0176] When the terminal device is a vehicle, the motion state of the terminal device can be determined in the following ways.

[0177] Figure 7 This is a flowchart illustrating a method 700 for determining the motion state of a terminal device according to an embodiment of this application.

[0178] Taking the determination of the first motion state mentioned above as an example, this method 700 refers to... Figure 7 As shown, the method 700 includes the following operations:

[0179] S710: Obtain the first gear information of the terminal device.

[0180] S720: Determine the first motion state of the terminal device based on the first gear information.

[0181] In some possible embodiments, the aforementioned first gear information is used to indicate the current gear type of the terminal device, such as a drive gear or a non-drive gear. The drive gear can be a forward gear, reverse gear, sport gear, high gear, low gear, or a gear corresponding to multiple speed ranges; the non-drive gear can be a parking gear.

[0182] In some possible embodiments, based on method 700, the first motion state of the terminal device can be characterized by the first gear information, and the reference correspondence is used to represent the correspondence between multiple motion states of the terminal device and the judgment threshold. Therefore, the reference correspondence can also be directly used to represent the correspondence between the gear information and the judgment threshold. In this case, the reference correspondence can be represented by the following formula (1):

[0183]

[0184] Where G represents gear information, P represents non-driving gear, D represents driving gear, Touchslop represents the judgment threshold, and T... P and T D It is a preset fixed value, and T P <T D .

[0185] In some possible embodiments, the operations of S710 to S720 described above can be performed periodically, for example, once every 1 second, or once at other time intervals. Alternatively, the operations of S710 to S720 can be triggered when the user touches the touchscreen. Or, when changing gears, the changed gear information can be actively fed back to the functional module used to determine the motion state of the terminal device, so that the terminal device can respond to the change in motion state in a timely manner.

[0186] In some possible embodiments, assuming the first gear information is used to indicate that the terminal device is in drive gear, and the gear information of the terminal device is subsequently obtained again, it is determined that the gear information of the terminal device is converted into second gear information. When the second gear information is used to indicate that the terminal device is in park gear, the second judgment threshold can be determined according to the reference correspondence expressed by formula (1) above. In this scenario, the second judgment threshold is less than the first judgment threshold.

[0187] In some possible embodiments, the above reference correspondence (represented by formula (1)) can also be represented by Table 1 below. Table 1 can be stored locally on the terminal device or on a cloud server, and the terminal device can retrieve the table.

[0188] Table 1

[0189] motion state Determine the threshold drive gear First judgment threshold Parking gear Second judgment threshold

[0190] The first judgment threshold is greater than the second judgment threshold. Based on this, after the terminal device obtains its own gear position information, it can determine whether the judgment threshold is the first judgment threshold or the second judgment threshold by retrieving Table 1 above.

[0191] In some possible embodiments, the driving gears of the terminal device (e.g., a vehicle) may include multiple gears, and the driving speed range of the terminal device is different in each driving gear. Therefore, when the terminal device is in different driving gears, the motion state of the terminal device can be further divided into multiple categories. Correspondingly, the reference correspondence may also include multiple sets to record the judgment thresholds corresponding to each motion state of the terminal device. At this time, the reference correspondence can be represented by the following formula (2):

[0192]

[0193] Where D1 represents the first sub-drive gear, D2 represents the second sub-drive gear, and the speed range corresponding to the first sub-drive gear is shorter than the speed range corresponding to the second sub-drive gear. T P T D1 T D2 The values ​​are preset to fixed values. However, when the terminal device moves at high speeds, turning, or when the road surface is bumpy, the uncertain relative displacement between the user's limbs or stylus and the touchscreen may increase further. Therefore, T can be set. P <T D1 <T D2 .

[0194] In some possible embodiments, assuming the first gear information is used to indicate that the terminal device is in the first sub-drive gear in the drive gear, and the gear information of the terminal device is subsequently obtained again, it is determined that the gear information of the terminal device is converted into third gear information. When the third gear information is used to indicate that the terminal device is in the second sub-drive gear in the parking gear, a third judgment threshold can be determined according to the reference correspondence expressed by formula (2) above, wherein the second sub-drive gear is lower than the first sub-drive gear. Then, in this scenario, the third judgment threshold is less than the first judgment threshold.

[0195] In some possible embodiments, the above reference correspondence (represented by formula (2)) can also be represented by Table 2 below. Table 2 can be stored locally on the terminal device or on a cloud server, and the terminal device can retrieve the table.

[0196] Table 2

[0197] motion state Judgment threshold First drive gear First judgment threshold Second drive gear Second judgment threshold Third drive gear Third judgment threshold …… …… Parking gear Fourth judgment threshold

[0198] Specifically, the speed range of the first sub-drive gear is higher than that of the second sub-drive gear, the speed range of the second sub-drive gear is higher than that of the third sub-drive gear, and so on. Correspondingly, the first judgment threshold > the second judgment threshold > the third judgment threshold > ... > the fourth judgment threshold. Based on this, after the terminal device obtains its current gear information, it can determine the judgment threshold corresponding to its current gear by retrieving Table 2 above.

[0199] In some possible embodiments, the non-driving gear of the terminal device may also include neutral. When the terminal device is in neutral, it is not possible to directly determine whether the terminal device is in a moving state (e.g., coasting downhill or being towed) or a stationary state based solely on this neutral position. Therefore, other sensors mounted on the terminal device can be used to determine its current motion state. When the terminal device is a vehicle, data collected by its wheel speed sensors can be used to determine whether the wheels are rotating. If they are rotating, the terminal device is in motion; if they are not rotating, it is stationary. Alternatively, data collected by the terminal device's inertial measurement unit or transmitter speed sensor can also be used to determine whether the terminal device is in motion.

[0200] In some possible embodiments, when the terminal device is in neutral and the vehicle is determined to be stationary according to the relevant sensors, the corresponding judgment threshold is the fourth judgment threshold, as can be seen from Table 2 above. When the terminal device is in neutral and the vehicle is determined to be in motion according to the relevant sensors, the corresponding judgment threshold can be preset to other judgment thresholds in Table 2 besides the fourth judgment threshold, or a judgment threshold can be set separately for the motion state, such as the fifth judgment threshold.

[0201] Based on the above technical solution, when the terminal device is a vehicle, the terminal device acquires the vehicle's gear information to characterize its own movement state, thereby dynamically adjusting the judgment threshold. Specifically, a larger judgment threshold is used when the device is moving, and an even larger threshold is used at faster speeds to identify minute swipe operations as click operations, avoiding misinterpretation of the user's intentions. A smaller judgment threshold is used when the device is stationary to ensure accurate recognition of the user's intentions. Furthermore, since vehicle gear information is relatively easy to obtain, the complexity of implementing this method is reduced.

[0202] In some possible embodiments, the terminal device can be a terminal device fixed in the vehicle cabin by a rigid fastener, or an in-vehicle terminal integrated in the vehicle cabin. In this case, the terminal device can also indirectly determine its own motion state by obtaining the vehicle's gear information.

[0203] Based on the above technical solution, when the terminal device is fixed to the vehicle, it indirectly determines its own motion state by acquiring the vehicle's gear information. This allows for dynamic adjustment of the judgment threshold: a larger threshold is used when the device is moving, and an even larger threshold is used at faster speeds to identify minor swipes as clicks, avoiding misinterpretation of the user's intent; a smaller threshold is used when the device is stationary to ensure accurate recognition of the user's intent. Furthermore, since the vehicle's gear information is relatively easy to obtain, the complexity of implementing this method is reduced.

[0204] In addition, some terminal devices may be equipped with speed sensors, so the terminal device can determine its own motion state through its own speed sensor.

[0205] Figure 8 This is a flowchart illustrating another method 800 for determining the motion state of a terminal device according to an embodiment of this application. (See reference) Figure 8 As shown, the method 800 includes the following operations:

[0206] S810: Obtain the current first speed information of the terminal device.

[0207] S820: Determine the first motion state of the terminal device based on the first speed information.

[0208] In some possible embodiments, the terminal device described above can be a vehicle, a terminal device fixed to a vehicle by a rigid fastener, or an in-vehicle terminal integrated inside the vehicle cabin.

[0209] In some possible embodiments, the motion state of the terminal device can be divided into two types based on the speed information: moving and stationary. Accordingly, based on this division of motion states, the reference correspondence can also include two sets, one set being the judgment threshold corresponding to when the terminal device is moving, and the other set being the judgment threshold corresponding to when the terminal device is stationary. This reference correspondence can be represented by the following formula (3):

[0210]

[0211] Where v represents the current speed of the terminal device (belonging to speed information), Touchslop represents the judgment threshold, T0 and T1 are preset fixed values, and T0 < T1.

[0212] In some possible embodiments, the operation may be executed once every 1 second, or once at other time intervals. Alternatively, the operations described in S810 to S820 may be triggered when the user touches the touchscreen. Or, when changing gears, the changed gear information may be actively fed back to the functional module used to determine the motion state of the terminal device, so that the terminal device can respond to the change in motion state in a timely manner.

[0213] In some possible embodiments, the above reference correspondence (represented by formula (3)) can also be represented by Table 3 as follows. Table 3 can be stored locally on the terminal device or on a cloud server, and the terminal device can retrieve the table.

[0214] Table 3

[0215] motion state Judgment threshold Speed ​​greater than 0 First judgment threshold Speed ​​equals 0 Second judgment threshold

[0216] The first judgment threshold is greater than the second judgment threshold. Based on this, after the terminal device obtains its own speed, it can determine whether the judgment threshold is the first judgment threshold or the second judgment threshold by retrieving Table 3 above.

[0217] In some possible embodiments, the motion state of the terminal device can be further divided into multiple states based on speed; correspondingly, the reference correspondence can also include multiple sets to record the judgment thresholds corresponding to the terminal device in each motion state. In this case, the reference correspondence can be represented by the following formula (4):

[0218]

[0219] Wherein, V1 is used to represent the upper limit of speed in the first movement state, V2 is used to represent the upper limit of speed in the second movement state, V2>V1, and T0, T1, T2, etc. are preset fixed values. Since when the terminal device moves at a high speed, when the terminal device turns or is bumpy, or when the terminal device is fixed in a turning or bumpy vehicle, it may be easier to cause the uncertain relative displacement between the user's limbs or stylus and the touch screen to increase further. Therefore, T0<T1<T2 can be set.

[0220] In some possible embodiments, the above reference correspondence (represented by formula (4)) can also be represented by Table 4 below. Table 4 can be stored locally on the terminal device or on a cloud server, and the terminal device can retrieve the table.

[0221] Table 4

[0222] motion state Judgment threshold First speed range First judgment threshold Second speed range Second judgment threshold Third speed range Third judgment threshold …… ……

[0223] The first speed range is generally higher than the second speed range, the second speed range is generally higher than the third speed range, and so on. Correspondingly, the first judgment threshold > the second judgment threshold > the third judgment threshold > ... Based on this, after the terminal device obtains its own speed, it can retrieve Table 4 above to determine the speed range in which its speed falls, and thus determine the corresponding judgment threshold.

[0224] Based on the above technical solution, the terminal device acquires its own movement speed through an integrated speed sensor to determine its motion state, thereby dynamically adjusting the judgment threshold. Specifically, a larger judgment threshold is used when the device is moving, and an even larger threshold is used at faster movement speeds. This allows for the identification of subtle swipe gestures as clicks, avoiding misinterpretation of the user's intent. Furthermore, the terminal device in this solution can be a vehicle, an in-vehicle terminal, or other types of terminals fixed within a vehicle, demonstrating its broad applicability and suitability for a wider range of application scenarios.

[0225] In some possible embodiments, taking a vehicle as an example, the motion state of the terminal device can be characterized not only by its own gear information or directly by a speed sensor, but also indirectly by physical parameters obtained from other types of sensors. For example, by using tire pressure sensors to obtain the force state of the tires, that is, by analyzing the force point, force direction, and force magnitude, the current motion state of the terminal device can be obtained, such as driving straight, turning left, turning right, reversing, or stationary, thereby indirectly obtaining the lateral acceleration of the terminal device; or, by using suspension pressure sensors to obtain the airbag pressure, hydraulic pressure, etc. of the suspension, the current motion state of the terminal device can be obtained based on these pressure parameters, such as whether it is driving on a bumpy road and the degree of bumpiness, thereby indirectly obtaining the longitudinal acceleration of the terminal device.

[0226] In some possible embodiments, when the terminal device is an in-vehicle terminal or a terminal device fixed to a vehicle, the terminal device can also establish a communication connection with the whole vehicle system to obtain the pressure sensors of the tires, the pressure sensors of the suspension, etc., to obtain the corresponding physical parameters and indirectly obtain the motion state of the vehicle. Since the terminal device is fixed to the vehicle and the two remain relatively stationary, obtaining the motion state of the vehicle is equivalent to obtaining the motion state of the terminal device itself.

[0227] Therefore, the acceleration of the terminal device can also be considered an important factor affecting the magnitude of the judgment threshold.

[0228] In some possible embodiments, taking a vehicle as an example, after determining the motion state of the terminal device, the current driving scenario of the terminal device can be further analyzed. The aforementioned reference correspondence can include the correspondence between different driving scenarios and judgment thresholds, thereby representing the correspondence between different motion states and judgment thresholds. Taking the aforementioned interaction method 500 as an example, the first judgment threshold in this method can be obtained as follows: Based on the first motion state, determine the first driving scenario of the terminal device; based on the first driving scenario and the reference correspondence, determine the first judgment threshold. The reference correspondence includes the correspondence between multiple driving scenarios of the terminal device and the judgment threshold. These multiple driving scenarios include at least two of the following: parking scenario, turning scenario, driving on a bumpy road scenario, and turning on a bumpy road scenario. The acceleration of the terminal device's motion differs under different driving scenarios.

[0229] Figure 9 This is a schematic diagram of the first judgment threshold corresponding to different driving scenarios of the terminal device proposed in the embodiments of this application.

[0230] This embodiment determines the offset range for different presentation formats by designing a first judgment threshold.

[0231] refer to Figure 9 As shown in (a), when the driving scenario of the vehicle is a parking scenario, the first judgment threshold can be equal to T0. Accordingly, the offset range determined based on T0 can be a square or a circle, where half the side length of the square or the radius of the circle is equal to T0, and the center of the square or the center of the circle can be the first touch point.

[0232] refer to Figure 9 As shown in (b), when the vehicle is driving in a turning scenario, there is a difference between the vehicle's lateral and vertical accelerations. Specifically, the vehicle may not have vertical acceleration or its acceleration may be less than a certain threshold, while it does have lateral acceleration. Therefore, the first judgment threshold can include lateral and longitudinal threshold components, which can be denoted as the first lateral judgment threshold and the first longitudinal judgment threshold. The first lateral judgment threshold can be equal to T1, and the first longitudinal judgment threshold can be less than T1, for example, T0, where T0 < T1. Correspondingly, the offset range determined based on T0 and T1 can be a rectangle or an ellipse, where half the longer side of the rectangle or the semi-major axis of the ellipse is equal to T1, and half the longer side of the rectangle or the shortest axis of the ellipse is equal to T0. The center of the rectangle or ellipse can be the first touch point.

[0233] The horizontal and vertical axes of the threshold are relative to the touchscreen, while the horizontal and vertical axes of the acceleration are relative to the vehicle. The vertical axis of the touchscreen can be considered to be consistent with the vertical axis of the vehicle, both being perpendicular to the horizontal plane on which the vehicle is traveling.

[0234] refer to Figure 9 As shown in (c), when the vehicle is driving on a bumpy road, there is a difference between the vehicle's lateral and vertical accelerations. Specifically, the vehicle has no lateral acceleration or its acceleration is less than a certain threshold, while it has vertical acceleration. Therefore, the first judgment threshold can be represented by a first lateral judgment threshold and a first longitudinal judgment threshold. The first longitudinal judgment threshold can be equal to T1, and the first lateral judgment threshold is less than T0. Correspondingly, the offset range determined based on T0 and T1 can be a rectangle or an ellipse, where half the longer side of the rectangle or the semi-major axis of the ellipse is equal to T1, and half the shorter side of the rectangle or the shortest axis of the ellipse is equal to T0. The center of the rectangle or ellipse can be the first touch point.

[0235] refer to Figure 9As shown in (d), when the vehicle is driving on a bumpy road and turning, since there is significant acceleration in both the lateral and vertical directions of the vehicle, the first judgment threshold can be equal to T1. Accordingly, the offset range determined based on T1 can be a square or a circle, where half the side length of the square or the radius of the circle is equal to T1, and the center of the square or the center of the circle can be the first touch point.

[0236] In some possible embodiments, the driving scenario of the vehicle described above can be determined by relevant vehicle sensors, such as tire pressure sensors, suspension pressure sensors, accelerometers, steering wheel torque sensors, steering wheel steering angle sensors, or related electronic control units.

[0237] In some possible embodiments, the reference correspondence between driving scenarios and judgment thresholds can be represented in the form of Table 5 below.

[0238] Table 5

[0239]

[0240]

[0241] Based on the above technical solution, when the terminal device is a vehicle, the terminal device analyzes its own driving scenario and designs differentiated judgment thresholds for different driving scenarios. This allows the touch screen to dynamically adjust its touch response to the user in different driving scenarios, which helps to increase the accuracy of recognizing the user's operation intention.

[0242] In some possible embodiments, when the terminal device is an in-vehicle terminal or a terminal device fixed to a vehicle, since the terminal device is fixed to the vehicle and the two remain relatively stationary, obtaining the motion state of the vehicle is equivalent to obtaining the motion state of the terminal device itself. Therefore, the terminal device can also analyze the driving state of the vehicle based on the vehicle's motion state and determine the corresponding judgment threshold based on the driving state.

[0243] In some possible embodiments, considering the acceleration of the terminal device, the motion state of the terminal device can be directly characterized by acceleration, or acceleration and velocity. Taking the first motion state mentioned in the above embodiment as an example, the first motion state may include a first acceleration, or a first acceleration and a first velocity. Considering that acceleration is a vector, and the uncertain relative displacement between the user's limb or stylus and the touch screen is generated based on the horizontal and vertical directions of the touch screen, the first acceleration may further include a first sub-acceleration and a second sub-acceleration. The direction of the first sub-acceleration is along the first horizontal axis (denoted as X1) of the first coordinate system, and the direction of the second sub-acceleration is along the first vertical axis (denoted as Y1) of the first coordinate system. The first coordinate system is established based on the touch screen, and the first horizontal axis is perpendicular to the first vertical axis. Figure 10 This is a schematic diagram of the first coordinate system proposed in an embodiment of this application. (Reference) Figure 10 As shown, the first coordinate system is a two-dimensional coordinate system, and the plane containing this first coordinate system is the touch surface or display surface of the touch screen. The first sub-acceleration or the second sub-acceleration can be 0.

[0244] In some possible embodiments, the origin of the first coordinate system may be the center, centroid, or other reference point of the touch surface or display surface.

[0245] In some possible embodiments, if the first motion state further includes a first velocity, the first velocity may further include a first sub-velocity and a second sub-velocity, wherein the direction of the first sub-velocity is along a first horizontal axis and the direction of the second sub-velocity is along a first vertical axis. The first sub-velocity and the second sub-velocity can both be 0.

[0246] In some possible embodiments, the touchscreen of the terminal device can have multiple display modes, such as landscape and portrait modes. Taking a vehicle as an example, and the touchscreen as an in-vehicle central control screen, the touchscreen can be rotated 90 degrees clockwise (switching to portrait display mode) or other angles, or 90 degrees counterclockwise (switching back to landscape display mode) or other angles via a rotating component. During the screen rotation, the aforementioned first coordinate system may not rotate with the touchscreen to ensure that the first horizontal axis of the first coordinate system is parallel to the horizontal plane of the user's position. This is because the lateral acceleration of the terminal device is always relative to the horizontal plane.

[0247] Based on the above technical solution, by fixing the first horizontal axis of the first coordinate system parallel to the horizontal plane of the user's position, the consistency of the user interaction experience during the rotation of the touch screen is ensured.

[0248] In some possible embodiments, taking a vehicle as the terminal device, or a terminal device fixed to a vehicle as an example, assuming the plane of the touchscreen is perpendicular to the direction the vehicle is traveling straight, that is, the terminal device is fixed in front of the vehicle's cabin, with the touchscreen facing the driver's seat, then the aforementioned first sub-acceleration can be generated by the vehicle turning, and the aforementioned second sub-acceleration can be generated by the vehicle traveling on an uneven road and experiencing vertical bumps. Similarly, the aforementioned first sub-velocity can also be generated by the vehicle turning, and the aforementioned second sub-velocity can also be generated by the vehicle traveling on an uneven road and experiencing vertical bumps.

[0249] In some possible embodiments, taking a vehicle as the terminal device, or a terminal device fixed to a vehicle as an example, assuming the touchscreen is fixed to the side of the vehicle's cabin, such as at the side door, with the touchscreen facing the driver's seat, then the aforementioned first sub-acceleration can be generated by the vehicle accelerating or decelerating straight ahead, and will also generate an acceleration component along the horizontal axis of the first coordinate system when the vehicle turns. The aforementioned second sub-acceleration can be generated by the vehicle traveling on an uneven road and experiencing vertical bumps, and will not change due to the fixed position and orientation of the terminal device. Similarly, in this scenario, the aforementioned first sub-velocity can be generated by the vehicle accelerating or decelerating straight ahead, and will also generate a velocity component along the horizontal axis of the first coordinate system when the vehicle turns. The aforementioned second sub-velocity is still generated by the vehicle traveling on an uneven road and experiencing vertical bumps.

[0250] In summary, the factors contributing to the acceleration component and velocity component of the first acceleration will adapt to different fixed positions and orientations of the touchscreen within the vehicle. The interaction method proposed in this application focuses on the magnitudes of the acceleration and velocity components along the first horizontal and / or first vertical axes in a first coordinate system. The causes of the acceleration and velocity components can be used as a basis for obtaining them. For example, obtaining the vehicle's wheel steering or the deformation direction of the vehicle's suspension springs can be used as a basis for determining the direction of the acceleration or velocity components.

[0251] Because the motion state of a terminal device can be characterized by detailed acceleration and / or velocity, the motion state of the terminal device can be divided more finely. The motion state of the terminal device can be determined as follows. The following example illustrates how to obtain the first motion state described above.

[0252] Figure 11 This is a flowchart illustrating another method 1100 for determining the motion state of a terminal device according to an embodiment of this application.

[0253] In method 1100, the terminal device can be a vehicle, or an in-vehicle terminal or other type of terminal device fixed to the vehicle by rigid fasteners, see reference. Figure 11 As shown, the interaction method 1100 includes the following operations:

[0254] S1110: Obtain the vehicle's first driving acceleration and / or first driving speed.

[0255] S1120: Determine a first motion state based on a first driving acceleration and / or a first driving speed, wherein the first driving acceleration includes a first driving sub-acceleration and a second driving sub-acceleration, the direction of the first driving sub-acceleration is along the second horizontal axis of the second coordinate system, the direction of the second driving sub-acceleration is along the second vertical axis of the second coordinate system, the first driving speed includes a first driving sub-velocity and a second driving sub-velocity, the direction of the first driving sub-velocity is along the second horizontal axis, the second driving sub-velocity is along the second vertical axis, the second vertical axis is consistent with the direction of the first vertical axis, and the second horizontal axis is consistent with the direction of the first horizontal axis.

[0256] In some possible embodiments, the second coordinate system described above can be a three-dimensional coordinate system based on the vehicle.

[0257] Figure 12 This is a schematic diagram of a second coordinate system proposed in an embodiment of this application.

[0258] refer to Figure 12 As shown, the origin of the second coordinate system can correspond to the center of the vehicle, the center of gravity, or other reference points. The second vertical axis (X2) of the second coordinate system is consistent with the direction of the vehicle's movement. The second horizontal axis (Y2) of the second coordinate system is perpendicular to the second vertical axis and corresponds to the left and right sides of the vehicle. The second vertical axis (Z2) of the second coordinate system is perpendicular to the plane in which the vehicle is located. In this example, the plane in which the touch screen is located is perpendicular to the direction in which the vehicle is moving straight. That is, the touch screen is fixed in front of the vehicle's cabin and faces the driver's seat. Therefore, the plane represented by the first coordinate system (denoted as the first plane) is parallel to the plane represented by Y2 and Z2 of the second coordinate system (denoted as the second plane).

[0259] In some possible embodiments, since the fixed position and orientation of the touch screen inside different vehicles may not be fixed, when the first plane and the second plane are not parallel, it is necessary to transform the position of the second coordinate system so that the second plane in the transformed second coordinate system is parallel to the first plane, that is, the second horizontal axis of the transformed second coordinate system is in the same direction as the first horizontal axis of the first coordinate system.

[0260] Since the motion state of the terminal device can be more finely divided by acceleration and / or velocity, the reference correspondence can correspondingly include a larger number of motion states and judgment thresholds. Taking the first motion state including the first acceleration and / or the first velocity as an example, assuming the reference correspondence includes the correspondence between the first acceleration interval and / or the first velocity interval and the first judgment threshold, the first acceleration interval includes the first lateral acceleration interval and the first longitudinal acceleration interval, and the first velocity interval includes the first lateral velocity interval and the first longitudinal velocity interval.

[0261] The direction of acceleration indicated by the first lateral acceleration interval is parallel to the first horizontal axis of the first coordinate system, and the direction of acceleration indicated by the first longitudinal acceleration interval is parallel to the first vertical axis of the first coordinate system. Similarly, the direction of velocity indicated by the first lateral velocity interval is parallel to the first horizontal axis of the first coordinate system, and the direction of velocity indicated by the first longitudinal velocity interval is parallel to the first vertical axis of the first coordinate system.

[0262] The operation of determining the first judgment threshold based on the first motion state of the terminal device and the reference correspondence can be implemented in the following way:

[0263] A first judgment threshold is determined based on the fact that the first sub-acceleration belongs to the first lateral acceleration interval and the second sub-acceleration belongs to the first longitudinal acceleration interval, and / or based on the fact that the first sub-velocity belongs to the first lateral velocity interval and the second sub-velocity belongs to the first longitudinal velocity interval.

[0264] For example, the above reference correspondence includes a first correspondence, which can be represented in the following form:

[0265] First lateral acceleration interval - First longitudinal acceleration interval - First lateral velocity interval - First longitudinal velocity interval - First judgment threshold;

[0266] Alternatively, the first lateral acceleration interval - the first longitudinal acceleration interval - the first judgment threshold;

[0267] Alternatively, the first lateral velocity range - the first longitudinal velocity range - the first judgment threshold;

[0268] Taking the first motion state, which includes a first acceleration and a first velocity, as an example, when the first acceleration of the terminal device is obtained, the first acceleration can be decomposed into a vector based on the first coordinate system, that is, the first acceleration is decomposed into an acceleration component along the first horizontal axis (used to represent the first sub-acceleration) and an acceleration component along the first vertical axis (used to represent the second sub-acceleration); similarly, when the first velocity of the terminal device is obtained, the first velocity can be decomposed into a vector based on the first coordinate system, that is, the first velocity is decomposed into a velocity component along the first horizontal axis (used to represent the first sub-velocity) and a velocity component along the first vertical axis (used to represent the second sub-velocity).

[0269] Then, based on the aforementioned first sub-acceleration, second sub-acceleration, first sub-velocity, and second sub-velocity, and in conjunction with the aforementioned reference correspondence, it is determined that the first sub-acceleration belongs to the first lateral acceleration interval, the second sub-acceleration belongs to the first longitudinal acceleration interval, the first sub-velocity belongs to the first lateral velocity interval, and the second sub-velocity belongs to the first longitudinal velocity interval. The first lateral acceleration interval, the first longitudinal acceleration interval, the first lateral velocity interval, and the first longitudinal velocity interval belong to the first correspondence in the reference correspondence. This first correspondence also includes a first judgment threshold. Then, based on the first offset between the first touch point and the second touch point in the user's first operation and the first judgment threshold, it is determined whether the first operation is a click operation or a swipe operation.

[0270] In some possible embodiments, since the acceleration range and / or velocity range are also divided into parameter ranges in two directions (e.g., lateral and longitudinal) in the above reference correspondence, the judgment thresholds corresponding to the acceleration range and / or velocity range can also be divided into components in two directions.

[0271] In some possible embodiments, the above reference correspondence can be further modeled. Assuming that the first plane of the first coordinate system is parallel to the second plane of the second coordinate system, and assuming that the motion state of the terminal device in the reference correspondence includes acceleration and velocity, then the reference correspondence can be represented by the following formula (5):

[0272]

[0273] Touchslop x This parameter, used to represent the judgment threshold in the first horizontal axis direction of the first coordinate system, affects the width of the target offset range in the first horizontal axis direction; Touchslop yThe parameter used to represent the judgment threshold in the first coordinate system along the first vertical axis affects the width of the target offset range along the first vertical axis; T represents the base value of the judgment threshold, which is a preset fixed value; k1 is the acceleration weight, which affects the degree to which acceleration influences the size of the judgment threshold; k2 is the velocity weight, which affects the degree to which velocity influences the size of the judgment threshold; a y Used to represent the acceleration component of the mobile device on the second horizontal axis of the second coordinate system; a z Used to represent the acceleration component of the mobile device on the second vertical axis of the second coordinate system; v y Used to represent the velocity component of the mobile device on the second horizontal axis of the second coordinate system; v z Used to represent the velocity component of the mobile device on the second vertical axis of the second coordinate system.

[0274] In some possible embodiments, the above formula (5) can also be represented in the form of a relational table.

[0275] In some possible embodiments, the motion state of the terminal device may also be represented by acceleration alone. In this case, the formula for representing the above reference correspondence can be adapted by removing the monomial about velocity from the formula. Similarly, if the motion state of the terminal device is represented by velocity alone, the formula for representing the above reference correspondence can be adapted by removing the monomial about acceleration from the formula.

[0276] In some possible embodiments, the operations of S1110 to S1120 described above can be performed periodically, for example, once every 1 second, or once at other time intervals. Alternatively, the operations of S1110 to S1120 described above can be triggered when the user touches the touchscreen.

[0277] In some possible embodiments, assuming that the first judgment threshold determined based on the first motion state of the terminal device and the reference correspondence includes a first lateral judgment threshold and a first longitudinal judgment threshold; then assuming that the motion state of the terminal device is subsequently determined to change to a second motion state, the second motion state includes a second acceleration and / or a second velocity, the second acceleration includes a third sub-acceleration and a fourth sub-acceleration, the direction of the third sub-acceleration is along the first lateral axis, the direction of the fourth sub-acceleration is along the first longitudinal axis, the second velocity includes a third sub-velocity and a fourth sub-velocity, the direction of the third sub-velocity is along the first lateral axis, the direction of the fourth sub-velocity is along the first longitudinal axis, wherein the third sub-acceleration is less than the first sub-acceleration, the fourth sub-acceleration is less than the second sub-acceleration, the third sub-velocity is less than the first sub-velocity, and the fourth sub-velocity is less than the fourth sub-velocity; then, based on the second motion state and the reference correspondence, a second judgment threshold can be determined, similar to the first judgment threshold, the second judgment threshold includes a second lateral judgment threshold and a second longitudinal judgment threshold, then based on the aforementioned comparison between the second motion state and the first motion state, it can be seen that the second lateral judgment threshold is less than the first lateral judgment threshold, and the second longitudinal judgment threshold is less than the first longitudinal judgment threshold.

[0278] Based on the above technical solution, when there is a difference between the lateral acceleration and longitudinal acceleration of the terminal device, and / or a difference between the lateral velocity and the longitudinal velocity, the judgment threshold is also divided into a lateral judgment threshold and a longitudinal judgment threshold. The judgment thresholds in the two directions are designed differently, which helps to increase the accuracy of recognizing the user's operation intention.

[0279] Based on the above-mentioned differentiated design of judgment thresholds for different directions, it can be realized that the greater the acceleration and / or speed of the terminal device in one direction, the more lenient the judgment of click operation in that direction during the touch screen's response to user operation; and the smaller the acceleration and / or speed in one direction, the more strict the judgment of click operation in that direction during the touch screen's response to user operation.

[0280] Figure 13 This is another schematic diagram illustrating the principle of recognizing user operations based on the interaction method proposed in the embodiments of this application.

[0281] In some possible embodiments, the aforementioned first offset can be the straight-line distance between the first touch point and the second touch point. Taking the terminal device in a first motion state as an example, assuming that the corresponding first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold, then the first operation can be determined as a click operation or a swipe operation in the following way:

[0282] refer to Figure 13In (a), when the horizontal component of the first offset is less than or equal to the first horizontal judgment threshold and the vertical component of the first offset is less than or equal to the first vertical judgment threshold, the first operation is determined to be a click operation.

[0283] refer to Figure 13 In (b), when the horizontal component of the first offset is greater than the first horizontal judgment threshold or the vertical component of the first offset is greater than the first vertical judgment threshold, the first operation is determined to be a sliding operation.

[0284] According to the above Figure 13 (a) and Figure 13 As shown in (b), the shape of the first offset range determined based on the first judgment threshold is a rectangle. The size of the first horizontal judgment threshold is equal to 1 / 2 of the top or bottom edge of the rectangle, and the size of the first vertical judgment threshold is equal to 1 / 2 of the side edge of the rectangle.

[0285] In some possible embodiments, if the first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold, a first elliptical range (i.e., a first offset range) can also be determined based on the first horizontal judgment threshold and the first vertical judgment threshold, with the center of the first elliptical range being the first touch point. Then, the first operation can be determined as a click operation or a swipe operation based on the following method:

[0286] refer to Figure 13 In step (c), when the first offset is less than or equal to the radial distance of the first ellipse range, the first operation is determined to be a click operation.

[0287] refer to Figure 13 In step (d), when the first offset is greater than at least one radial distance of the first ellipse range, the first operation is determined to be a sliding operation.

[0288] According to the above Figure 13 (c) and Figure 13 As can be seen from (d) in the figure, the shape of the first offset range determined based on the first judgment threshold is an ellipse, the size of the first horizontal judgment threshold is equal to the length of the semi-axis a of the ellipse, and the size of the first vertical judgment threshold is equal to the length of the semi-axis b of the ellipse.

[0289] In some possible embodiments, assuming the coordinates of the first touch point in the first coordinate system are (x1, y1), the coordinates of the second touch point in the first coordinate system are (x2, y2), the first horizontal judgment threshold is T1, and the first vertical judgment threshold is T2, then the first offset can be determined according to the following formula (6) to determine whether the first offset is greater than any radial distance of the first ellipse range.

[0290]

[0291] When the above formula (6) is satisfied, it can be determined that the second touch point is located within or at the edge of the first ellipse, thereby determining that the first operation is a click operation.

[0292] If the above formula (6) is not satisfied, it can be determined that the second touch point is outside the range of the first ellipse, thus determining that the first operation is a sliding operation.

[0293] Based on the above technical solution, by acquiring the acceleration and / or velocity of the terminal device in real time, the motion state of the terminal device can be determined, thereby dynamically adjusting the sensitivity of the terminal touch screen, recognizing minor swipe operations as click operations, avoiding incorrect recognition of the user's operation intention, and helping to improve the stability of the terminal device touch screen interaction experience and the accuracy of user intention recognition.

[0294] In addition, embodiments of this application also provide an apparatus for implementing any of the above methods. For example, an interactive device is provided, which includes a unit (or means) for implementing any of the above interactive methods.

[0295] Figure 14 This is a schematic diagram of an interactive device 1400 according to an embodiment of this application. The interactive device 1400 can be applied to a terminal device, which includes a touchscreen. The terminal device can be a mobile carrier, such as a vehicle, or a terminal device or portable terminal fixed inside the mobile carrier by rigid fasteners.

[0296] In some possible embodiments, the interactive device 1400 may also be integrated into Figure 4 In the processing module 413 of the terminal device 400 shown.

[0297] refer to Figure 14 As shown, the interactive device 1400 includes:

[0298] The determining unit 1410 is used to determine a first motion state of the terminal device; and to determine a first judgment threshold based on the first motion state and a reference correspondence relationship, wherein the reference correspondence relationship is used to represent the correspondence between multiple motion states of the terminal device and the judgment threshold.

[0299] The acquisition unit 1420 is used to acquire the first touch point and the second touch point in the user's first operation on the touch screen;

[0300] The judgment unit 1430 is used to determine a first offset based on the first touch point and the second touch point; and to determine whether the first operation is a click operation or a swipe operation based on the first judgment threshold and the first offset.

[0301] In some possible embodiments, the first touch point is the starting point of the first operation, and the second touch point is the ending point of the first operation.

[0302] In some possible embodiments, when the terminal device is a vehicle, the determining unit 1410 is specifically used to: obtain the first gear information of the terminal device; and determine the first motion state based on the first gear information.

[0303] In some possible embodiments, when the first gear position information is used to indicate that the terminal device is in drive gear, the determining unit 1410 is further configured to: obtain the second gear position information of the terminal device, the second gear position information being used to indicate that the terminal device is in park gear; the second determining unit is further configured to: determine a second judgment threshold based on the second gear position information and a reference correspondence, the second judgment threshold being less than the first judgment threshold.

[0304] In some possible embodiments, when the first gear information is used to indicate that the terminal device is in the first sub-drive gear in the drive gear, the determining unit 1410 is further configured to: obtain the third gear information of the terminal device, the third gear information being used to indicate that the terminal device is in the second sub-drive gear in the drive gear, the second sub-drive gear being lower than the first sub-drive gear; and determine a third judgment threshold based on the third gear information and a reference correspondence, the third judgment threshold being less than the first judgment threshold.

[0305] In some possible embodiments, when the first motion state is used to indicate that the terminal device is moving, the determining unit 1410 is further configured to: determine a second motion state of the terminal device, the second motion state being used to indicate that the terminal device is stationary; and determine a second judgment threshold based on the second motion state and a reference correspondence, the second judgment threshold being less than the first judgment threshold.

[0306] In some possible embodiments, the first offset is the straight-line distance between the first touch point and the second touch point. Based on this, the determination unit 1430 is specifically used to: determine the first operation as a click operation when the first offset is less than or equal to the first determination threshold; or determine the first operation as a swipe operation when the first offset is greater than the first determination threshold; or determine the first operation as a click operation when the horizontal component of the first offset is less than or equal to the first determination threshold and the vertical component of the first offset is less than or equal to the first determination threshold; or determine the first operation as a swipe operation when the horizontal component of the first offset is greater than the first determination threshold or the vertical component of the first offset is greater than the first determination threshold.

[0307] In some possible embodiments, when the terminal device is a vehicle, the determining unit 1410 is specifically used to: determine a first driving scenario of the terminal device based on a first motion state; and determine a first judgment threshold based on the first driving scenario and a reference correspondence, wherein the reference correspondence includes the correspondence between multiple driving scenarios of the terminal device and the judgment threshold, and the multiple driving scenarios include at least two of the following: parking scenario, turning scenario, driving on a bumpy road scenario, and performing a turning scenario on a bumpy road scenario.

[0308] In some possible embodiments, the first motion state described above includes a first acceleration and / or a first velocity, wherein the first acceleration includes a first sub-acceleration and a second sub-acceleration, the direction of the first sub-acceleration is along the first horizontal axis of the first coordinate system, the direction of the second sub-acceleration is along the first vertical axis of the first coordinate system, the first coordinate system is established based on the touch screen, and the first horizontal axis is perpendicular to the first vertical axis; the first velocity includes a first sub-velocity and a second sub-velocity, the direction of the first sub-velocity is along the first horizontal axis, and the direction of the second sub-velocity is along the first vertical axis.

[0309] In some possible embodiments, the first horizontal axis is parallel to the horizontal plane at the user's location.

[0310] In some possible embodiments, when the terminal device is fixed to the vehicle by a rigid fastener, the determining unit 1410 is specifically used to: acquire the first driving acceleration and / or the first driving speed of the vehicle; determine a first motion state based on the first driving acceleration and / or the first driving speed, wherein the first driving acceleration includes a first driving sub-acceleration and a second driving sub-acceleration, the direction of the first driving sub-acceleration is along the second horizontal axis of the second coordinate system, the direction of the second driving sub-acceleration is along the second vertical axis of the second coordinate system, the first driving speed includes a first driving sub-speed and a second driving sub-speed, the direction of the first driving sub-speed is along the second horizontal axis, the direction of the second driving sub-speed is along the second vertical axis, the second vertical axis is consistent with the direction of the first vertical axis, and the second horizontal axis is consistent with the direction of the first horizontal axis.

[0311] In some possible embodiments, the above reference correspondence may include the correspondence between the first acceleration interval and / or the first velocity interval and the first judgment threshold. The first acceleration interval includes a first lateral acceleration interval and a first longitudinal acceleration interval, and the first velocity interval includes a first lateral velocity interval and a first longitudinal velocity interval. The determining unit 1410 is specifically used to: determine the first judgment threshold based on the fact that the first sub-acceleration belongs to the first lateral acceleration interval and the second sub-acceleration belongs to the first longitudinal acceleration interval, and / or based on the fact that the first sub-velocity belongs to the first lateral velocity interval and the second sub-velocity belongs to the first longitudinal velocity interval.

[0312] In some possible embodiments, the first judgment threshold may include a first lateral judgment threshold and a first longitudinal judgment threshold. The determining unit 1410 is further configured to: determine a second motion state of the terminal device, the second motion state including a second acceleration and / or a second velocity, the second acceleration including a third sub-acceleration and a fourth sub-acceleration, the direction of the third sub-acceleration being along a first lateral axis and the direction of the fourth sub-acceleration being along a first longitudinal axis, the second velocity including a third sub-velocity and a fourth sub-velocity, the direction of the third sub-velocity being along a first lateral axis and the direction of the fourth sub-velocity being along a first longitudinal axis, wherein the third sub-acceleration is less than the first sub-acceleration, the fourth sub-acceleration is less than the second sub-acceleration, the third sub-velocity is less than the first sub-velocity, and the fourth sub-velocity is less than the fourth sub-velocity; and determine a second judgment threshold according to the second motion state and a reference correspondence, the second judgment threshold including a second lateral judgment threshold and a second longitudinal judgment threshold, the second lateral judgment threshold being less than the first lateral judgment threshold and the second longitudinal judgment threshold being less than the first longitudinal judgment threshold.

[0313] In some possible embodiments, the first judgment threshold may include a first horizontal judgment threshold and a first vertical judgment threshold. The judgment unit 1430 is specifically used to: determine the first operation as a click operation when the horizontal component of the first offset is less than or equal to the first horizontal judgment threshold and the vertical component of the first offset is less than or equal to the first vertical judgment threshold; or determine the first operation as a swipe operation when the horizontal component of the first offset is greater than the first horizontal judgment threshold or the vertical component of the first offset is greater than the first vertical judgment threshold.

[0314] In some possible embodiments, the first judgment threshold may include a first horizontal judgment threshold and a first vertical judgment threshold. The judgment unit 1430 is specifically used to: determine a first elliptical range based on the first horizontal judgment threshold and the first vertical judgment threshold, wherein the center of the first elliptical range is the first touch point; determine the first operation as a click operation when the first offset is less than or equal to the radial distance of the first elliptical range; or determine the first operation as a swipe operation when the first offset is greater than at least one radial distance of the first elliptical range.

[0315] This application provides another terminal device, which includes a touch screen, a memory, and at least one processor. The memory is used to store one or more programs, and the at least one processor is used to call one or more programs stored in the memory to cause the terminal device to execute any of the interaction methods proposed in this application.

[0316] This application provides a chip that includes circuitry for executing any of the interactive methods proposed in this application.

[0317] In some possible embodiments, the chip described above can be a digital signal processor (DSP) chip.

[0318] Furthermore, embodiments of this application also propose a vehicle that serves as a terminal device, including a touchscreen and any of the interactive devices proposed in embodiments of this application.

[0319] This application also provides a computer program product, which includes computer program code that, when run on a computer, causes the computer to perform the methods described in the above embodiments.

[0320] This application also provides a computer-readable medium storing program code that, when run on a computer, causes the computer to perform the methods described in the above embodiments.

[0321] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0322] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0323] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0324] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0325] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0326] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application.

[0327] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An interaction method, characterized in that, Applied to a terminal device, the terminal device including a touch screen, the method includes: Determine the first motion state of the terminal device; Based on the first motion state and the reference correspondence, a first judgment threshold is determined, wherein the reference correspondence is used to represent the correspondence between multiple motion states of the terminal device and the judgment threshold; Obtain the first touch point and the second touch point in the user's first operation on the touch screen; Based on the first touch point and the second touch point, determine the first offset; Based on the first judgment threshold and the first offset, the first operation is determined to be a click operation or a swipe operation.

2. The method according to claim 1, characterized in that, The first touch point is the starting point of the first operation, and the second touch point is the ending point of the first operation.

3. The method according to claim 1 or 2, characterized in that, The terminal device is a vehicle, and determining the first motion state of the terminal device includes: Obtain the first gear information of the terminal device; The first motion state is determined based on the first gear information.

4. The method according to claim 3, characterized in that, The first gear position information is used to indicate that the terminal device is in drive gear, and the method further includes: Obtain the second gear position information of the terminal device, the second gear position information being used to indicate that the terminal device is in the parking gear; Based on the second gear information and the reference correspondence, a second judgment threshold is determined, wherein the second judgment threshold is less than the first judgment threshold.

5. The method according to claim 3 or 4, characterized in that, The first gear position information is used to indicate that the terminal device is in the first sub-drive gear position in the drive gear, and the method further includes: Obtain the third gear information of the terminal device, the third gear information is used to indicate that the terminal device is in the second sub-drive gear in the drive gear, the second sub-drive gear is lower than the first sub-drive gear; Based on the third gear information and the reference correspondence, a third judgment threshold is determined, wherein the third judgment threshold is less than the first judgment threshold.

6. The method according to claim 1 or 2, characterized in that, The first motion state is used to indicate that the terminal device is moving, and the method further includes: Determine a second motion state of the terminal device, the second motion state being used to indicate that the terminal device is stationary; A second judgment threshold is determined based on the second motion state and the reference correspondence, wherein the second judgment threshold is less than the first judgment threshold.

7. The method according to any one of claims 1 to 6, characterized in that, The first offset is the straight-line distance between the first touch point and the second touch point. Determining whether the first operation is a click or a swipe operation based on the first judgment threshold and the first offset includes: When the first offset is less than or equal to the first judgment threshold, the first operation is determined to be a click operation; or... When the first offset is greater than the first judgment threshold, the first operation is determined to be a sliding operation; or, When the horizontal component of the first offset is less than or equal to the first judgment threshold and the vertical component of the first offset is less than or equal to the first judgment threshold, the first operation is determined to be a click operation; or... When the horizontal component of the first offset is greater than the first judgment threshold or the vertical component of the first offset is greater than the first judgment threshold, the first operation is determined to be a sliding operation.

8. The method according to claim 1 or 2, characterized in that, The terminal device is a vehicle, and determining the first judgment threshold based on the first motion state and the reference correspondence includes: Based on the first motion state, the first driving scenario of the terminal device is determined; Based on the first driving scenario and the reference correspondence, the first judgment threshold is determined. The reference correspondence includes the correspondence between various driving scenarios of the terminal device and the judgment threshold. The various driving scenarios include at least two of the following: parking scenario, turning scenario, driving on a bumpy road scenario, and turning on a bumpy road scenario.

9. The method according to claim 1 or 2, characterized in that, The first motion state includes a first acceleration and / or a first velocity. The first acceleration includes a first sub-acceleration and a second sub-acceleration. The direction of the first sub-acceleration is along the first horizontal axis of the first coordinate system, and the direction of the second sub-acceleration is along the first vertical axis of the first coordinate system. The first coordinate system is established based on the touch screen, and the first horizontal axis is perpendicular to the first vertical axis. The first velocity includes a first sub-velocity and a second sub-velocity, the direction of the first sub-velocity is along the first horizontal axis, and the direction of the second sub-velocity is along the first vertical axis.

10. The method according to claim 9, characterized in that, The first horizontal axis is parallel to the horizontal plane at the user's location.

11. The method according to claim 9 or 10, characterized in that, The terminal device is a vehicle, or the terminal device is fixed to a vehicle by a rigid fastener, and determining the first motion state of the terminal device includes: Obtain the first driving acceleration and / or the first driving speed of the vehicle; The first motion state is determined based on the first driving acceleration and / or the first driving speed. The first driving acceleration includes a first driving sub-acceleration and a second driving sub-acceleration. The direction of the first driving sub-acceleration is along the second horizontal axis of the second coordinate system, and the direction of the second driving sub-acceleration is along the second vertical axis of the second coordinate system. The first driving speed includes a first driving sub-velocity and a second driving sub-velocity. The direction of the first driving sub-velocity is along the second horizontal axis, and the second driving sub-velocity is along the second vertical axis. The second vertical axis is aligned with the direction of the first vertical axis, and the second horizontal axis is aligned with the direction of the first horizontal axis.

12. The method according to any one of claims 9 to 11, characterized in that, The reference correspondence includes the correspondence between the first acceleration interval and / or the first velocity interval and the first judgment threshold. The first acceleration interval includes a first lateral acceleration interval and a first longitudinal acceleration interval. The first velocity interval includes a first lateral velocity interval and a first longitudinal velocity interval. Determining the first judgment threshold based on the first motion state and the reference correspondence includes: The first judgment threshold is determined based on the fact that the first sub-acceleration belongs to the first lateral acceleration interval and the second sub-acceleration belongs to the first longitudinal acceleration interval, and / or based on the fact that the first sub-velocity belongs to the first lateral velocity interval and the second sub-velocity belongs to the first longitudinal velocity interval.

13. The method according to any one of claims 9 to 12, characterized in that, The first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold, and the method further includes: A second motion state of the terminal device is determined, the second motion state including a second acceleration and / or a second velocity, the second acceleration including a third sub-acceleration and a fourth sub-acceleration, the direction of the third sub-acceleration being along the first horizontal axis, the direction of the fourth sub-acceleration being along the first vertical axis, the second velocity including a third sub-velocity and a fourth sub-velocity, the direction of the third sub-velocity being along the first horizontal axis, the direction of the fourth sub-velocity being along the first vertical axis, wherein the third sub-acceleration is less than the first sub-acceleration, the fourth sub-acceleration is less than the second sub-acceleration, the third sub-velocity is less than the first sub-velocity, and the fourth sub-velocity is less than the fourth sub-velocity; Based on the second motion state and the reference correspondence, a second judgment threshold is determined. The second judgment threshold includes a second lateral judgment threshold and a second longitudinal judgment threshold. The second lateral judgment threshold is less than the first lateral judgment threshold, and the second longitudinal judgment threshold is less than the first longitudinal judgment threshold.

14. The method according to any one of claims 8 to 13, characterized in that, The first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold. Determining whether the first operation is a click operation or a swipe operation based on the first judgment threshold and the first offset includes: When the horizontal component of the first offset is less than or equal to the first horizontal threshold and the vertical component of the first offset is less than or equal to the first vertical threshold, the first operation is determined to be a click operation; or... When the lateral component of the first offset is greater than the first lateral judgment threshold or the vertical component of the first offset is greater than the first vertical judgment threshold, the first operation is determined to be a sliding operation.

15. The method according to any one of claims 8 to 14, characterized in that, The first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold. Determining whether the first operation is a click operation or a swipe operation based on the first judgment threshold and the first offset includes: Based on the first horizontal judgment threshold and the first vertical judgment threshold, the range of the first ellipse is determined, and the center of the range of the first ellipse is the first touch point. When the first offset is less than or equal to the radial distance of the first ellipse range, the first operation is determined to be a click operation; or, When the first offset is greater than at least one radial distance of the range of the first ellipse, the first operation is determined to be a sliding operation.

16. An interactive device, characterized in that, Applied to a terminal device, the terminal device including a touch screen, the device includes: A determining unit is configured to determine a first motion state of the terminal device; and to determine a first judgment threshold based on the first motion state and a reference correspondence, wherein the reference correspondence is used to represent the correspondence between multiple motion states of the terminal device and the judgment threshold. The acquisition unit is used to acquire the first touch point and the second touch point in the user's first operation on the touch screen; The judgment unit is used to determine a first offset based on the first touch point and the second touch point; and to determine whether the first operation is a click operation or a swipe operation based on the first judgment threshold and the first offset.

17. The apparatus according to claim 16, characterized in that, The first touch point is the starting point of the first operation, and the second touch point is the ending point of the first operation.

18. The apparatus according to claim 16 or 17, characterized in that, The terminal device is a vehicle, and the determining unit is specifically used for: Obtain the first gear information of the terminal device; The first motion state is determined based on the first gear information.

19. The apparatus according to claim 18, characterized in that, The first gear position information is used to indicate that the terminal device is in drive gear, and the determining unit is further used to: The second gear position information of the terminal device is obtained, wherein the second gear position information is used to indicate that the terminal device is in parking gear; the second determining unit is further used to: Based on the second gear information and the reference correspondence, a second judgment threshold is determined, wherein the second judgment threshold is less than the first judgment threshold.

20. The apparatus according to claim 18 or 19, characterized in that, The first gear position information is used to indicate that the terminal device is in the first sub-drive gear position in the drive gear, and the determining unit is further used to: Obtain the third gear information of the terminal device, the third gear information is used to indicate that the terminal device is in the second sub-drive gear in the drive gear, the second sub-drive gear is lower than the first sub-drive gear; Based on the third gear information and the reference correspondence, a third judgment threshold is determined, wherein the third judgment threshold is less than the first judgment threshold.

21. The apparatus according to claim 16 or 17, characterized in that, The first motion state is used to indicate that the terminal device is moving, and the determining unit is further used to: Determine a second motion state of the terminal device, the second motion state being used to indicate that the terminal device is stationary; A second judgment threshold is determined based on the second motion state and the reference correspondence, wherein the second judgment threshold is less than the first judgment threshold.

22. The apparatus according to any one of claims 16 to 21, characterized in that, The first offset is the straight-line distance between the first touch point and the second touch point, and the determination unit is specifically used for: When the first offset is less than or equal to the first judgment threshold, the first operation is determined to be a click operation; or, When the first offset is greater than the first judgment threshold, the first operation is determined to be a sliding operation; or, When the horizontal component of the first offset is less than or equal to the first judgment threshold and the vertical component of the first offset is less than or equal to the first judgment threshold, the first operation is determined to be a click operation. or, When the horizontal component of the first offset is greater than the first judgment threshold or the vertical component of the first offset is greater than the first judgment threshold, the first operation is determined to be a sliding operation.

23. The apparatus according to claim 16 or 17, characterized in that, The terminal device is a vehicle, and the determining unit is specifically used for: Based on the first motion state, the first driving scenario of the terminal device is determined; Based on the first driving scenario and the reference correspondence, the first judgment threshold is determined. The reference correspondence includes the correspondence between various driving scenarios of the terminal device and the judgment threshold. The various driving scenarios include at least two of the following: parking scenario, turning scenario, driving on a bumpy road scenario, and turning on a bumpy road scenario.

24. The apparatus according to claim 16 or 17, characterized in that, The first motion state includes a first acceleration and / or a first velocity. The first acceleration includes a first sub-acceleration and a second sub-acceleration. The direction of the first sub-acceleration is along the first horizontal axis of the first coordinate system, and the direction of the second sub-acceleration is along the first vertical axis of the first coordinate system. The first coordinate system is established based on the touch screen, and the first horizontal axis is perpendicular to the first vertical axis. The first velocity includes a first sub-velocity and a second sub-velocity, the direction of the first sub-velocity is along the first horizontal axis, and the direction of the second sub-velocity is along the first vertical axis.

25. The apparatus according to claim 24, characterized in that, The first horizontal axis is parallel to the horizontal plane at the user's location.

26. The apparatus according to claim 24 or 25, characterized in that, The terminal device is a vehicle, or the terminal device is fixed to the vehicle by a rigid fastener, and the determining unit is specifically used for: Obtain the first driving acceleration and / or the first driving speed of the vehicle; The first motion state is determined based on the first driving acceleration and / or the first driving speed. The first driving acceleration includes a first driving sub-acceleration and a second driving sub-acceleration. The direction of the first driving sub-acceleration is along the second horizontal axis of the second coordinate system, and the direction of the second driving sub-acceleration is along the second vertical axis of the second coordinate system. The first driving speed includes a first driving sub-velocity and a second driving sub-velocity. The direction of the first driving sub-velocity is along the second horizontal axis, and the second driving sub-velocity is along the second vertical axis. The second vertical axis is aligned with the direction of the first vertical axis, and the second horizontal axis is aligned with the direction of the first horizontal axis.

27. The apparatus according to any one of claims 24 to 26, characterized in that, The reference correspondence includes the correspondence between the first acceleration interval and / or the first velocity interval and the first judgment threshold. The first acceleration interval includes a first lateral acceleration interval and a first longitudinal acceleration interval. The first velocity interval includes a first lateral velocity interval and a first longitudinal velocity interval. The determining unit is specifically used for: The first judgment threshold is determined based on the fact that the first sub-acceleration belongs to the first lateral acceleration interval and the second sub-acceleration belongs to the first longitudinal acceleration interval, and / or based on the fact that the first sub-velocity belongs to the first lateral velocity interval and the second sub-velocity belongs to the first longitudinal velocity interval.

28. The apparatus according to any one of claims 24 to 27, characterized in that, The first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold, and the determining unit is further configured to: A second motion state of the terminal device is determined, the second motion state including a second acceleration and / or a second velocity, the second acceleration including a third sub-acceleration and a fourth sub-acceleration, the direction of the third sub-acceleration being along the first horizontal axis, the direction of the fourth sub-acceleration being along the first vertical axis, the second velocity including a third sub-velocity and a fourth sub-velocity, the direction of the third sub-velocity being along the first horizontal axis, the direction of the fourth sub-velocity being along the first vertical axis, wherein the third sub-acceleration is less than the first sub-acceleration, the fourth sub-acceleration is less than the second sub-acceleration, the third sub-velocity is less than the first sub-velocity, and the fourth sub-velocity is less than the fourth sub-velocity; Based on the second motion state and the reference correspondence, a second judgment threshold is determined. The second judgment threshold includes a second lateral judgment threshold and a second longitudinal judgment threshold. The second lateral judgment threshold is less than the first lateral judgment threshold, and the second longitudinal judgment threshold is less than the first longitudinal judgment threshold.

29. The apparatus according to any one of claims 23 to 28, characterized in that, The first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold, and the judgment unit is specifically used for: When the horizontal component of the first offset is less than or equal to the first horizontal judgment threshold and the vertical component of the first offset is less than or equal to the first vertical judgment threshold, the first operation is determined to be a click operation. or, When the lateral component of the first offset is greater than the first lateral judgment threshold or the vertical component of the first offset is greater than the first vertical judgment threshold, the first operation is determined to be a sliding operation.

30. The apparatus according to any one of claims 23 to 29, characterized in that, The first judgment threshold includes a first horizontal judgment threshold and a first vertical judgment threshold, and the judgment unit is specifically used for: Based on the first horizontal judgment threshold and the first vertical judgment threshold, the range of the first ellipse is determined, and the center of the range of the first ellipse is the first touch point. When the first offset is less than or equal to the radial distance of the first ellipse range, the first operation is determined to be a click operation; or, When the first offset is greater than at least one radial distance of the range of the first ellipse, the first operation is determined to be a sliding operation.

31. A terminal device, characterized in that, include: Touch screen; Memory, used to store one or more programs; At least one processor is configured to invoke one or more programs stored in the memory to cause the terminal device to perform the method as described in any one of claims 1 to 15.

32. A vehicle, characterized in that, It includes a touch screen and an interactive device as described in any one of claims 16 to 30.

33. A chip, characterized in that, Includes a circuit for performing the method as described in any one of claims 1 to 15.

34. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that is executed by a processor to implement the method as described in any one of claims 1 to 15.

35. A computer program product, characterized in that, It includes instructions that, when executed by a processor, cause the method as described in any one of claims 1 to 15 to be performed.

Images