Touch response method and device based on vehicle-mounted display screen and electronic equipment

Abstract

The invention discloses a touch response method and device based on a vehicle-mounted display screen and electronic equipment, and relates to the field of data processing. In the method, a touch signal on the surface of a vehicle-mounted display screen is obtained, and the touch signal comprises an initial touch position, a touch track and touch duration; based on the initial touch position and the touch duration, judging whether the touch signal is a mistaken touch operation or not; if it is determined that the touch signal is not the mistaken touch operation, feature extraction is conducted on the touch track to obtain a track feature vector, and the track feature vector comprises the track length, the track curvature and the track direction; inputting the track feature vector into a preset gesture recognition model, and recognizing a corresponding touch gesture; according to the touch gesture, determining a touch response area in combination with interface display information of the vehicle-mounted display screen; and in the touch response area, generating a touch response event according to a preset interaction rule, and displaying the touch response event on the vehicle-mounted display screen. By implementing the technical scheme provided by the invention, the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of data processing, and specifically to a touch response method, device and electronic equipment based on a vehicle-mounted display screen. Background Art

[0002] With the development of technology and the popularization of smart vehicles, in-vehicle infotainment systems have become standard in modern cars. These systems provide a variety of functions through the in-vehicle display, such as navigation, media playback, vehicle settings, etc. In order to improve driving safety and operating convenience, touch screens have become the main interactive interface. Users can quickly access and control system functions through intuitive touch operations, which greatly improves the convenience of operation and driving safety.

[0003] At present, although the in-vehicle touch control system has made significant progress in terms of functionality, there are still some technical defects. First, false touch is a common problem, especially when driving due to bumps or driver distraction, which leads to unexpected touch operations. Second, the current touch control system is inefficient in recognizing complex gestures, which limits the user experience during use and leads to a low user experience.

[0004] Therefore, there is an urgent need for a touch response method, device and electronic equipment based on a vehicle-mounted display screen. Summary of the invention

[0005] The present application provides a touch response method, device and electronic equipment based on a vehicle-mounted display screen, which improves the user experience.

[0006] In a first aspect of the present application, a touch response method based on a vehicle-mounted display screen is provided, the method comprising: obtaining a touch signal on the surface of the vehicle-mounted display screen, the touch signal comprising an initial touch position, a touch trajectory and a touch duration; judging whether the touch signal is a false touch operation based on the initial touch position and the touch duration; if it is determined that the touch signal is not a false touch operation, performing feature extraction on the touch trajectory to obtain a trajectory feature vector, the trajectory feature vector comprising a trajectory length, a trajectory curvature and a trajectory direction; inputting the trajectory feature vector into a preset gesture recognition model to identify a corresponding touch gesture; determining a touch response area according to the touch gesture and in combination with the interface display information of the vehicle-mounted display screen; within the touch response area, generating a touch response event according to a preset interaction rule, and displaying the touch response event on the vehicle-mounted display screen.

[0007] By adopting the above technical solution, by acquiring the touch signal on the surface of the vehicle display screen, including the initial touch position, touch trajectory and touch duration, the user's touch operation data on the vehicle display screen can be comprehensively collected, providing sufficient information basis for subsequent touch intention recognition. By using the initial touch position and touch duration to determine whether the touch signal is a false touch operation, invalid touch operations can be effectively filtered out, the amount of calculation and time overhead of subsequent processing can be reduced, and the operation efficiency can be improved. The touch trajectory of the effective touch signal is extracted to obtain a trajectory feature vector including the trajectory length, trajectory curvature and trajectory direction, which can fully characterize the geometric features and motion features of the touch trajectory and provide rich feature representation for gesture recognition. By using the preset gesture recognition model to classify the trajectory feature vector, the user's touch gesture can be quickly and accurately identified, and the mapping from low-level touch trajectory to high-level gesture semantics can be realized. Combining the identified touch gesture and the interface display information of the vehicle display screen to determine the touch response area, the user's touch intention can be inferred according to the current interface layout and content, and the pertinence and accuracy of the touch response can be improved. In the touch response area, touch response events are generated and displayed according to preset interaction rules, which can achieve a natural mapping of touch operations to interface feedback and provide a smooth and intuitive human-computer interaction experience.

[0008] Optionally, judging whether the touch signal is a false touch operation based on the initial touch position and the touch duration specifically includes: obtaining the type of interface element corresponding to the initial touch position; judging whether the interface element type is a clickable element; if it is determined that the interface element type is the clickable element, judging the relationship between the touch duration and a preset duration threshold; if it is determined that the touch duration is greater than or equal to the preset duration threshold, judging that the touch signal is not a false touch operation; if it is determined that the touch duration is less than the preset duration threshold, judging that the touch signal is a false touch operation; if it is determined that the interface element type is not the clickable element, judging that the touch signal is a false touch operation.

[0009] By adopting the above technical solution, by obtaining the interface element type corresponding to the initial touch position, it is determined whether the interface element is a clickable element. According to the interface layout and functional attributes, it is possible to quickly identify which specific control or area the user touches and whether it has an interactive function, thereby providing an important basis for false touch judgment. By comparing the touch duration with the preset duration threshold, a reasonable time threshold can be set according to empirical data to distinguish between valid touch and false touch operations. Through the division of the duration threshold, two types of touch behaviors can be accurately identified. For touch signals with a touch duration greater than or equal to the threshold and located on a clickable element, it can be determined as a valid touch and enter the subsequent gesture recognition process; for touch signals with a touch duration less than the threshold or located on a non-clickable element, it can be directly determined as a false touch operation, and the processing can be exited in time to avoid unnecessary waste of resources. At the same time, combining the two factors of initial touch position and touch duration for false touch judgment can effectively improve the reliability of the judgment and reduce the occurrence of missed judgments or false judgments, thereby ensuring the stability and availability of the in-vehicle human-computer interaction system.

[0010] Optionally, before inputting the trajectory feature vector into a preset gesture recognition model to identify the corresponding touch gesture, the method also includes: collecting touch operation samples of multiple users on the vehicle-mounted display screen, the touch operation samples including touch trajectories and corresponding touch gesture labels; preprocessing the touch operation samples to obtain a preprocessed touch operation sample set; extracting touch trajectory features from the touch operation sample set to construct a touch trajectory feature set; and using the touch trajectory feature set and the corresponding touch gesture labels to train and generate a preset gesture recognition model, the preset gesture recognition model adopting a support vector machine classification algorithm.

[0011] By adopting the above technical solution, by collecting touch operation samples of multiple users on the vehicle display screen, a large amount of real user interaction data can be obtained, covering the touch habits and behavior patterns of different users, providing rich and diverse data support for the training of the preset gesture recognition model, which helps to improve the generalization ability and robustness of the model.

[0012] Optionally, if it is determined that the touch signal is not a false touch operation, feature extraction is performed on the touch trajectory to obtain a trajectory feature vector, specifically including: preprocessing the touch trajectory to obtain a target touch trajectory, the preprocessing including denoising and smoothing; resampling the target touch trajectory to obtain a trajectory point sequence; based on the trajectory point sequence, extracting the trajectory length, the trajectory curvature and the trajectory direction to generate the trajectory feature vector.

[0013] By adopting the above technical solution, the touch trajectory is preprocessed, including denoising and smoothing, which can eliminate high-frequency noise and abnormal points collected during the touch process, improve the stability and continuity of the trajectory data, and resample the preprocessed target touch trajectory to normalize and standardize the time and space distribution of the trajectory points, so that the intervals of the trajectory points are more uniform and the number is more uniform, which is convenient for subsequent feature calculation and comparison. Based on the trajectory point sequence obtained by resampling, features such as trajectory length, trajectory curvature, and trajectory direction are extracted to form a trajectory feature vector, which can characterize the characteristics and semantics of the touch trajectory from different angles and provide rich and comprehensive feature information for gesture recognition.

[0014] Optionally, before determining the touch response area according to the touch gesture in combination with the interface layout information of the vehicle display screen, the method also includes: obtaining environmental information of the vehicle, the environmental information including the light intensity inside the vehicle and the light intensity outside the vehicle; inputting the light intensity inside the vehicle and the light intensity outside the vehicle into a preset display brightness model to obtain a target brightness; and determining to use the target brightness as the interface display information of the vehicle display screen.

[0015] By adopting the above technical solution, the environmental information of the vehicle, including the light intensity inside the vehicle and the light intensity outside the vehicle, can be obtained, and the lighting conditions and changes inside and outside the vehicle can be perceived in real time, providing objective and accurate environmental parameters for the display brightness adjustment of the vehicle display screen, so that the display brightness can be dynamically adjusted with the change of the ambient light intensity, and always maintain the best visual effect and observation comfort. The light intensity inside the vehicle and the light intensity outside the vehicle are input into the preset display brightness model, and the preset display brightness model is used to calculate the optimal target brightness value according to the ambient light intensity. The adaptive adjustment of the display brightness can reduce the impact of the change of ambient light intensity on the display quality and visual perception, such as increasing the brightness in strong light to offset light interference, and reducing the brightness in weak light to relieve glare discomfort, thereby improving the usability and readability of the vehicle display screen in complex lighting environments, and providing drivers with a more comfortable and reliable human-computer interaction interface.

[0016] Optionally, after generating a touch response event in the touch response area according to preset interaction rules and displaying the touch response time on the vehicle-mounted display screen, the method further includes: obtaining a facial image of the driver; analyzing the facial image to obtain the driver's line of sight direction and gaze duration; determining whether the line of sight direction is the direction of gaze at the vehicle-mounted display screen; if it is determined that the line of sight direction is the direction of gaze at the vehicle-mounted display screen, determining whether the gaze duration is greater than or equal to a preset time; if it is determined that the gaze duration is greater than or equal to the preset time, adjusting the target brightness to a preset brightness and sending a voice prompt, wherein the voice prompt is used to guide the driver to shift his line of sight to the road conditions outside the vehicle, and the preset brightness is lower than the target brightness.

[0017] By adopting the above technical solution, the driver's facial image is obtained, the facial image is analyzed, and the driver's line of sight direction and gaze duration are obtained. The driver's visual attention distribution can be monitored in real time to understand whether the driver is concentrating on observing the road conditions outside the car or frequently looking at the on-board display screen, providing an objective basis for evaluating the driver's attention state. By judging whether the driver's line of sight is the direction of looking at the on-board display screen, it can be determined whether the driver's current visual focus is on the display screen. If the driver looks at the display screen for a long time, it means that the driver may be overly immersed in the displayed information and there is a risk of distracted driving. Further judging whether the driver's gaze time on the display screen exceeds the preset time threshold, a reasonable time upper limit can be set according to the experience value of safe driving. When the gaze time exceeds the upper limit, it can be considered that the driver's attention continues to deviate from the road ahead and needs timely reminders and warnings. Once it is detected that the driver is looking at the display screen for a long time, the brightness of the display screen is automatically adjusted to a lower preset brightness to reduce the attractiveness and significance of the displayed information. At the same time, the driver is guided to shift his sight to the road conditions outside the car through voice prompts, which can effectively divert the driver's attention from the display screen, so that he can refocus on driving tasks and road observation, thereby improving driving safety. Through line of sight monitoring and attention prompts, the distraction and interference of in-vehicle human-computer interaction on the driver's attention can be reduced, reducing the risk of visual fatigue and distracted driving.

[0018] Optionally, the method also includes: obtaining vehicle driving status information, the vehicle driving status information including vehicle speed and steering angle; determining whether the vehicle speed is greater than or equal to a preset vehicle speed threshold, and whether the steering angle is greater than or equal to a preset angle threshold; if it is determined that the vehicle speed is greater than or equal to the preset vehicle speed threshold, and the steering angle is greater than or equal to the preset angle threshold, then stopping obtaining the touch signal on the surface of the vehicle display screen.

[0019] By adopting the above technical solution, the vehicle's driving state information, including vehicle speed and steering angle, can be obtained. The vehicle's motion state and driving conditions can be monitored in real time to understand whether the vehicle is in a straight-line driving, turning driving or parking state, etc., providing a judgment basis for the dynamic control of touch interaction. By judging whether the vehicle speed is greater than or equal to the preset vehicle speed threshold, a safe speed limit can be set according to factors such as road type and vehicle performance. When the vehicle speed exceeds the upper limit, it means that the vehicle is driving at high speed and the driver needs higher attention and control input. At this time, touch interaction may interfere with and distract the driver's attention, posing a safety hazard. By judging whether the steering angle is greater than or equal to the preset angle threshold, when the steering angle exceeds the critical value, it means that the vehicle is performing a steering operation, such as changing lanes, turning, etc. At this time, the driver also pays more attention, and hand control is also restricted, so touch interaction is not suitable. When the vehicle speed and steering angle exceed their respective thresholds at the same time, it can be judged that the vehicle is in a relatively complex and high-risk driving state, requiring the driver to concentrate on controlling the vehicle. The system will automatically stop collecting and responding to touch signals and temporarily turn off the touch interaction function. This can effectively avoid the distraction and interference of touch interaction on the driver's attention, reduce driving risks, and improve driving safety.

[0020] In a second aspect of the present application, a touch response device based on a vehicle-mounted display screen is provided, the device comprising: an acquisition module and a processing module, the acquisition module being used to acquire a touch signal on the surface of the vehicle-mounted display screen, the touch signal comprising an initial touch position, a touch trajectory and a touch duration; the processing module being used to determine whether the touch signal is a false touch operation based on the initial touch position and the touch duration; the processing module being used to perform feature extraction on the touch trajectory to obtain a trajectory feature vector if it is determined that the touch signal is not a false touch operation, the trajectory feature vector comprising a trajectory length, a trajectory curvature and a trajectory direction; the processing module being used to input the trajectory feature vector into a preset gesture recognition model to identify a corresponding touch gesture; the processing module being used to determine a touch response area according to the touch gesture and in combination with the interface display information of the vehicle-mounted display screen; the processing module being used to generate a touch response event within the touch response area according to a preset interaction rule, and display the touch response event on the vehicle-mounted display screen.

[0021] In the third aspect of the present application, an electronic device is provided, including a processor, a memory, a user interface and a network interface, the memory is used to store instructions, the user interface and the network interface are both used to communicate with other devices, and the processor is used to execute the instructions stored in the memory so that the electronic device executes any one of the methods described above.

[0022] In a fourth aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores instructions, and when the instructions are executed, any of the methods described above is executed.

[0023] In summary, one or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. By acquiring the touch signal on the surface of the vehicle display screen, including the initial touch position, touch trajectory and touch duration, the user's touch operation data on the vehicle display screen can be fully collected to provide sufficient information basis for subsequent touch intention recognition. By using the initial touch position and touch duration to determine whether the touch signal is a false touch operation, invalid touch operations can be effectively filtered out, reducing the amount of calculation and time overhead of subsequent processing, and improving operation efficiency. The touch trajectory of the effective touch signal is feature extracted to obtain a trajectory feature vector including trajectory length, trajectory curvature and trajectory direction, which can fully characterize the geometric features and motion features of the touch trajectory and provide rich feature representation for gesture recognition. By using the preset gesture recognition model to classify the trajectory feature vector, the user's touch gesture can be quickly and accurately identified, realizing the mapping from low-level touch trajectory to high-level gesture semantics. Combining the identified touch gesture and the interface display information of the vehicle display screen to determine the touch response area, the user's touch intention can be inferred based on the current interface layout and content, improving the pertinence and accuracy of the touch response. In the touch response area, touch response events are generated and displayed according to preset interaction rules, which can achieve a natural mapping of touch operations to interface feedback and provide a smooth and intuitive human-computer interaction experience.

[0024] 2. By obtaining the interface element type corresponding to the initial touch position and judging whether the interface element is a clickable element, the user can quickly identify which specific control or area is touched by the user and whether it has interactive functions according to the interface layout and functional attributes, thereby providing an important basis for false touch judgment. By comparing the touch duration with the preset duration threshold, a reasonable time threshold can be set according to empirical data to distinguish between valid touch and false touch operations. Through the division of duration thresholds, two types of touch behaviors can be accurately identified. For touch signals with a touch duration greater than or equal to the threshold and located on clickable elements, they can be determined as valid touches and enter the subsequent gesture recognition process; for touch signals with a touch duration less than the threshold or located on non-clickable elements, they can be directly determined as false touch operations and exit processing in time to avoid unnecessary waste of resources. At the same time, combining the two factors of initial touch position and touch duration for false touch judgment can effectively improve the reliability of judgment and reduce the occurrence of missed judgments or false judgments, thereby ensuring the stability and availability of the in-vehicle human-computer interaction system.

[0025] 3. By collecting touch operation samples of multiple users on the in-vehicle display screen, a large amount of real user interaction data can be obtained, covering the touch habits and behavior patterns of different users, providing rich and diverse data support for the training of the preset gesture recognition model, which helps to improve the generalization ability and robustness of the model. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a flow chart of a touch response method based on a vehicle-mounted display screen disclosed in an embodiment of the present application; Figure 2 It is a module schematic diagram of a touch response device based on a vehicle-mounted display screen disclosed in an embodiment of the present application; Figure 3 It is a structural schematic diagram of an electronic device disclosed in an embodiment of the present application.

[0027] Explanation of the reference numerals: 201, acquisition module; 202, processing module; 300, electronic device; 301, processor; 302, communication bus; 303, user interface; 304, network interface; 305, memory. DETAILED DESCRIPTION

[0028] In order to enable technicians in this field to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments.

[0029] In the description of the embodiments of the present application, words such as "for example" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "for example" or "for example" is intended to present related concepts in a specific way.

[0030] In the description of the embodiments of the present application, the meaning of the term "multiple" refers to two or more. For example, multiple systems refer to two or more systems, and multiple screen terminals refer to two or more screen terminals. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. The terms "include", "comprise", "have" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

[0031] This application provides a touch response method based on a vehicle-mounted display screen, referring to Figure 1 , Figure 1 This is a flow chart of a touch response method based on a vehicle display screen provided in an embodiment of the present application. The method is applied to a server, which is a server that executes a touch response program of a vehicle display screen and is used to provide background services for user devices. The server can be a single server, or a server cluster composed of multiple servers, or a cloud computing service center. The method includes steps S101 to S106, which are as follows: Step S101: Acquire a touch signal on the surface of the vehicle-mounted display screen, where the touch signal includes an initial touch position, a touch track, and a touch duration.

[0032] In step S101, the server establishes a communication connection with the vehicle display screen to obtain the touch signal on the surface of the vehicle display screen in real time. Specifically, the vehicle display screen has a built-in touch sensor. When the user touches the surface of the vehicle display screen, the touch sensor can sense the position coordinates of the touch point, the touch track and the touch duration information, and encapsulate this information into a touch signal.

[0033] The communication connection between the server and the vehicle display can be established by wired or wireless means. For example, data transmission can be achieved through communication interfaces and protocols such as USB, Ethernet, Wi-Fi, and Bluetooth. After the communication connection is established, the vehicle display sends the collected touch signal to the server in real time. The initial touch position in the touch signal indicates the coordinates of the first touch point when the user starts to touch the vehicle display, usually expressed by two-dimensional coordinates (x, y), where x indicates the horizontal position of the touch point on the display, and y indicates the vertical position of the touch point on the display. The touch trajectory indicates the movement trajectory of the touch point when the user slides on the surface of the vehicle display, which can be expressed by a series of coordinate points, such as (x1, y1), (x2, y2), ..., (xn, yn), which are arranged in chronological order and record the movement process of the touch point. The touch duration indicates the duration from the time when the user starts to touch the vehicle display to the time when the finger leaves the display, usually in milliseconds.

[0034] Step S102: Based on the touch track and the touch duration, determine whether the touch signal is a false touch operation.

[0035] In step S102, based on the initial touch position and touch duration, it is determined whether the touch signal is a false touch operation, specifically including: obtaining the type of interface element corresponding to the initial touch position; determining whether the interface element type is a clickable element; if it is determined that the interface element type is a clickable element, determining the relationship between the touch duration and a preset duration threshold; if it is determined that the touch duration is greater than or equal to the preset duration threshold, determining that the touch signal is not a false touch operation; if it is determined that the touch duration is less than the preset duration threshold, determining that the touch signal is a false touch operation; if it is determined that the interface element type is not a clickable element, determining that the touch signal is a false touch operation.

[0036] Specifically, the server determines whether the touch signal is a false touch operation based on the touch trajectory and touch duration. Specifically, the server first obtains the type of interface element corresponding to the initial touch position, and then comprehensively determines whether the touch signal is a false touch operation based on the type of interface element and the touch duration. Specifically, after receiving the touch signal, the server analyzes the coordinates of the initial touch position and matches it with the interface layout information currently displayed on the vehicle display screen to determine the type of interface element corresponding to the initial touch position. Interface element types can be divided into two categories: clickable elements and non-clickable elements. Clickable elements usually include buttons, icons, hyperlinks, etc., which trigger corresponding interactive events after being touched. Non-clickable elements usually include background images, text labels, dividing lines, etc. These elements mainly play the role of display and layout, and touching them will not produce an interactive response.

[0037] The server determines whether the interface element type is a clickable element in order to distinguish the user's touch intention. If the user touches a clickable element, it means that the user may have a clear operation purpose and hopes to activate a function or perform an operation through touch. On the contrary, if the user touches a non-clickable element, it is more likely to be an accidental or unintentional touch.

[0038] When it is determined that the type of interface element corresponding to the initial touch position is a clickable element, the server further determines the relationship between the touch duration and the preset duration threshold. The preset duration threshold is an empirical value, which is usually set according to the actual application scenario and user habits. For example, it can be set to 500 milliseconds, and this application does not limit this. If the touch duration is greater than or equal to the preset duration threshold, it means that the user has a clearer and continuous touch action on the clickable element, and the touch time is long enough, and it is unlikely to be a false touch. On the contrary, if the touch duration is less than the preset duration threshold, the touch action is too short and is more likely to be a false touch by the user.

[0039] For example, suppose there is a navigation button on the car display screen, which is used to open the navigation application. When the user touches the button, the server obtains the interface element type corresponding to the initial touch position as "button", which is a clickable element. Then, the server determines that the touch duration is 800 milliseconds, which is greater than the preset duration threshold of 500 milliseconds, and therefore determines that the touch signal is not an accidental touch operation, but the user intends to open the navigation application.

[0040] For another example, suppose a user accidentally touches a text label on the car display screen, and the touch duration is only 100 milliseconds. The server obtains the interface element type corresponding to the initial touch position as "text", which is a non-clickable element, so it directly determines that the touch signal is an accidental touch operation and does not trigger any interaction event.

[0041] Step S103: If it is determined that the touch signal is not an accidental touch operation, feature extraction is performed on the touch trajectory to obtain a trajectory feature vector, where the trajectory feature vector includes a trajectory length, a trajectory curvature, and a trajectory direction.

[0042] In step S103, if it is determined that the touch signal is not a false touch operation, feature extraction is performed on the touch trajectory to obtain a trajectory feature vector, specifically including: preprocessing the touch trajectory to obtain a target touch trajectory, the preprocessing includes denoising and smoothing; resampling the target touch trajectory to obtain a trajectory point sequence; based on the trajectory point sequence, extracting the trajectory length, trajectory curvature and trajectory direction to generate a trajectory feature vector.

[0043] Specifically, the server preprocesses the touch trajectory, including denoising and smoothing. Due to the complexity of the vehicle environment and the sensitivity of the touch device, the original collected touch trajectory may contain some noise points or jitters, which may come from factors such as vehicle vibration, road bumps, finger jitter, etc. In order to improve the accuracy of feature extraction, the server denoises the touch trajectory and removes those points that deviate significantly from the overall trend of the trajectory. Denoising can use some common algorithms, such as median filtering and Kalman filtering. After denoising, the server smoothes the touch trajectory to make the trajectory curve smoother and more continuous, and reduce jagged edges and sharp corners. Smoothing can use moving average and Gaussian filtering methods. After denoising and smoothing, the preprocessed target touch trajectory is obtained.

[0044] Next, the server resamples the target touch trajectory. Since the original touch trajectory is sampled at a certain time interval, the distances between the sampling points may be different, which will affect the calculation and comparison of subsequent features. In order to normalize the touch trajectory, the server resamples the target touch trajectory so that the sampling points are evenly distributed on the trajectory and the distances between adjacent sampling points are equal. Resampling can use linear interpolation and spline interpolation methods. After resampling, a normalized trajectory point sequence can be obtained.

[0045] Finally, based on the trajectory point sequence, the server extracts features such as trajectory length, trajectory curvature, and trajectory direction to generate a trajectory feature vector. The trajectory length represents the total length of the touch trajectory, which can be obtained by calculating the Euclidean distance between adjacent trajectory points and then summing them up. The trajectory length reflects the size and range of the touch action. The trajectory curvature represents the degree of curvature of the touch trajectory, which can be obtained by calculating the first-order derivative and second-order derivative of the trajectory points. The trajectory curvature reflects the smoothness and rate of change of the touch action. The trajectory direction represents the main direction of the touch trajectory, which can be measured by calculating the angle between the line connecting the starting point and the end point of the trajectory and the horizontal direction. The trajectory direction reflects the trend and preference of the touch action.

[0046] For example, a user draws a letter "S" on the car display screen. The server obtains the feature vector of the touch track through step S103, as shown below: track length, 200 pixels; track curvature, 0.8; track direction, 45 degrees. The above feature vectors indicate that the total length of the touch track is 200 pixels, the average curvature is 0.8, and the main direction is 45 degrees to the horizontal direction. These feature values ​​can better describe the shape characteristics of the letter "S", which is helpful for subsequent gesture recognition.

[0047] Step S104: inputting the trajectory feature vector into a preset gesture recognition model to recognize the corresponding touch gesture.

[0048] Before step S104, the method also includes: collecting touch operation samples of multiple users on the vehicle-mounted display screen, the touch operation samples including touch tracks and corresponding touch gesture labels; preprocessing the touch operation samples to obtain a preprocessed touch operation sample set; extracting touch track features from the touch operation sample set to construct a touch track feature set; using the touch track feature set and the corresponding touch gesture labels to train and generate a preset gesture recognition model, the preset gesture recognition model using a support vector machine classification algorithm.

[0049] Specifically, the server collects touch operation samples of multiple users on the vehicle display screen. During the collection process, the user's touch trajectory data must be recorded, and each touch operation sample must be manually labeled to obtain the corresponding touch gesture label, such as "swipe up", "swipe down", "swipe left", "swipe right", "double-click", etc. Then, the server preprocesses the collected touch operation samples. The purpose of preprocessing is to remove noise and outliers in the sample data and improve data quality. Preprocessing can include deduplication, filtering, and normalization operations. Deduplication refers to deleting duplicate sample data; filtering refers to removing high-frequency noise and outliers in sample data; normalization refers to scaling the sample data to a uniform range, such as the [0, 1] interval. After preprocessing, a set of preprocessed touch operation samples is obtained.

[0050] Then, the server extracts the touch trajectory features from the touch operation sample set and constructs a touch trajectory feature set. This step is similar to step S103, and the feature extraction is performed on the trajectory data of each touch operation sample to obtain a feature vector including features such as trajectory length, trajectory curvature, and trajectory direction. The feature vectors of all samples are combined to form a touch trajectory feature set, which is used as input data for training the gesture recognition model. Finally, the server uses the touch trajectory feature set and the corresponding touch gesture label to train and generate a preset gesture recognition model. The server uses the support vector machine (SVM) classification algorithm to construct the preset gesture recognition model. SVM is a binary classification model that can find the optimal classification hyperplane in a high-dimensional space. During the training process, the server uses the touch trajectory feature set as input and the touch gesture label as the expected output, and uses the SVM algorithm to find the optimal classification boundary. The performance of the model can be optimized by adjusting parameters such as the kernel function and penalty coefficient of the SVM. The training process usually requires multiple iterations until the preset gesture recognition model achieves a satisfactory accuracy on the validation set.

[0051] In step S104, the server inputs the trajectory feature vector into the preset gesture recognition model to identify the corresponding touch gesture. Specifically, the server combines the trajectory feature vector obtained in step S103, such as trajectory length, trajectory curvature, trajectory direction, etc., into a multi-dimensional feature vector as the input of the preset gesture recognition model. The preset gesture recognition model is a trained support vector machine classifier, which can map the input feature vector to a specific touch gesture category, such as "upward stroke", "downward stroke", "leftward stroke", "rightward stroke", "double-click", etc. The server inputs the trajectory feature vector into the preset gesture recognition model, and the preset gesture recognition model calculates the probability or confidence that the feature vector belongs to each gesture category based on its internal classification rules and decision boundaries, and selects the category with the highest probability as the recognition result. For example, if the input trajectory feature vector represents a long-distance slide from left to right, the preset gesture recognition model may recognize it as a "rightward stroke" gesture and return the gesture category.

[0052] Step S105: Determine a touch response area according to the touch gesture and the interface display information of the vehicle-mounted display screen.

[0053] In a possible implementation, before step S105, the method further includes: determining the touch response area based on the touch gesture in combination with the interface layout information of the vehicle display screen, the method further includes: obtaining environmental information of the vehicle, the environmental information including the light intensity inside the vehicle and the light intensity outside the vehicle; inputting the light intensity inside the vehicle and the light intensity outside the vehicle into a preset display brightness model to obtain a target brightness; and determining to use the target brightness as the interface display information of the vehicle display screen.

[0054] Specifically, the server dynamically adjusts the display brightness of the vehicle display screen according to the environmental information of the vehicle to adapt to different lighting conditions. Specifically, the server obtains two environmental parameters, namely, the light intensity inside the vehicle and the light intensity outside the vehicle, and inputs them into the preset display brightness model to obtain the target brightness value as the current display brightness of the vehicle display screen. First, the server obtains the data of the light intensity inside the vehicle and the light intensity outside the vehicle. The light intensity inside the vehicle can be measured by a light sensor installed inside the vehicle, which can detect the ambient light intensity inside the vehicle in real time and transmit the data to the server. The light intensity outside the vehicle can be measured by a light sensor installed outside the vehicle, such as a sensor installed on the front windshield or rearview mirror, which is used to detect the light intensity of the vehicle's driving environment. The server establishes a communication connection with these sensors to regularly obtain the data of the light intensity inside and outside the vehicle as input for subsequent adjustment of the display brightness.

[0055] Next, the server inputs the obtained light intensity inside the car and outside the car into the preset display brightness model to obtain a target brightness value. The preset display brightness model is an algorithm model that calculates the display brightness based on the ambient light intensity. It comprehensively considers factors such as the lighting conditions inside and outside the car, the display characteristics, and the visual characteristics of the human eye, and obtains a display brightness value suitable for the current environment through a certain calculation formula or lookup table. For example, when the light intensity inside the car is low and the light intensity outside the car is high (such as driving on a road in direct sunlight during the day), the preset display brightness model will calculate a higher target brightness value to improve the recognition and contrast of the displayed content; when the light intensity inside the car is high and the light intensity outside the car is low (such as driving on a road illuminated at night), the preset display brightness model calculates a lower target brightness value to reduce the glare and glare of the display. The preset display brightness model is constructed using a large amount of ambient lighting data and user feedback data, and is trained through a machine learning algorithm.

[0056] Finally, the server uses the target brightness value calculated by the preset display brightness model as the current display brightness of the vehicle display screen, and sends it to the vehicle display screen through control instructions or parameter configuration. The vehicle display screen adjusts its backlight brightness or pixel brightness according to the received target brightness value to achieve the optimal brightness of the displayed content.

[0057] In step S105, the server determines the touch response area based on the recognized touch gesture and the interface display information of the vehicle-mounted display screen. The touch response area refers to the operating range or target area corresponding to the touch gesture, which is closely related to the content and layout displayed on the current interface. The server determines the touch response area based on the type, direction and position of the touch gesture, as well as the position and attributes of elements such as buttons, icons, and lists on the interface. For example, if the recognized touch gesture is "right swipe" and the current interface displays a horizontally scrolling list of pictures, the touch response area is the visible area of ​​the picture list; if the recognized touch gesture is "double-click" and the current interface displays a thumbnail, the touch response area may be the location of the thumbnail. By analyzing the touch gesture and the interface display information, the server can accurately determine the target area that the user wants to operate, providing a basis for subsequent interactive responses.

[0058] Step S106: Generate a touch response event in the touch response area according to a preset interaction rule, and display the touch response event on the vehicle display screen.

[0059] In step S106, the server generates a touch response event in the touch response area according to the preset interaction rules, and displays the touch response event on the vehicle display screen. The preset interaction rules are a set of mapping relationships, which define the operations or effects triggered by different touch gestures on different interface elements. For example, a "right swipe" gesture on the picture list may trigger the "next picture" operation, and a "double-click" gesture on the thumbnail may trigger the "full screen display" operation. The server generates a corresponding touch response event based on the preset interaction rules, combined with the identified touch gesture and the determined touch response area. The touch response event can be an interface update instruction, an animation effect, a function call, etc., which is used to realize the interactive feedback of the touch gesture. Finally, the server sends the generated touch response event to the vehicle display screen, which is responsible for rendering and presenting, so that the user can intuitively feel the effect of the touch operation. For example, when the user "swipes right" on the picture list, the display screen may perform a left translation animation to switch to the next picture; when the user "double-clicks" on the thumbnail, the display screen may pop up a full-screen picture preview interface.

[0060] After step S106, the method also includes: acquiring a facial image of the driver; analyzing the facial image to obtain the driver's line of sight direction and gaze duration; determining whether the line of sight direction is the direction of looking at the vehicle-mounted display screen; if it is determined that the line of sight direction is the direction of looking at the vehicle-mounted display screen, determining whether the gaze duration is greater than or equal to a preset time; if it is determined that the gaze duration is greater than or equal to the preset time, adjusting the target brightness to the preset brightness, and sending a voice prompt, the voice prompt is used to guide the driver to shift his line of sight to the road conditions outside the vehicle, and the preset brightness is lower than the target brightness.

[0061] Specifically, the server analyzes the driver's facial image to determine whether the driver has been looking at the in-vehicle display screen for a long time, and gives corresponding brightness adjustments and safety tips to ensure that the driver's eyes are focused on the road conditions outside the car and improve driving safety. First, the server obtains the driver's facial image. This can be achieved through a camera installed in the car, which is generally located just above the steering wheel or near the rearview mirror and can capture the driver's front or side image. The server establishes a connection with the camera and regularly obtains the driver's facial image data as input for subsequent analysis.

[0062] Next, the server analyzes the acquired facial image to obtain the driver's line of sight direction and gaze duration. Line of sight direction refers to the direction in which the driver's eyes are looking, which can be estimated through facial key point detection and eye tracking algorithms. Specifically, the server first performs face detection and key point positioning on the facial image to obtain the coordinates of key parts such as the eyes, nose, and mouth; then, the server calculates the three-dimensional rotation angle of the eyeball based on the image features of the eye area, such as the position of the pupil and the direction of the white of the eye, thereby obtaining the line of sight direction. Gaze duration refers to the time that the driver continuously gazes in a certain direction, which can be calculated by accumulating the number of continuous frames in the line of sight direction. For example, if the line of sight for 30 consecutive frames is directed to the vehicle display screen, and the time interval between each frame is 0.5 seconds, the gaze duration is 30x0.5=15 seconds.

[0063] Then, the server determines whether the obtained sight direction is the direction of looking at the vehicle display screen. The server considers factors such as the position, size, and installation angle of the vehicle display screen, as well as the angle between the sight direction and the normal direction of the display screen. For example, if the vehicle display screen is located on the center console, and the angle between the sight direction and the normal direction of the display screen is less than 30 degrees, it can be determined as the direction of looking at the display screen. By setting the angle threshold, the server can accurately determine whether the driver is looking at the vehicle display screen.

[0064] If it is determined that the driver's line of sight is in the direction of the in-vehicle display screen, the server needs to determine whether the gaze duration is greater than or equal to the preset time. The preset time is a safety threshold, which indicates the maximum time the driver can continuously gaze at the in-vehicle display screen, which is generally set to 2 to 3 seconds. If the gaze duration exceeds the preset time, it means that the driver may be overly immersed in the information on the display screen and ignore the road conditions outside the car, which poses a certain safety hazard.

[0065] When it is determined that the driver's gaze duration is greater than or equal to the preset time, the server will take two measures to remind the driver to shift his attention. The first is to adjust the brightness of the vehicle display to the preset brightness. The preset brightness is generally a lower value, which can reduce the attractiveness of the display and make it easier for the driver to shift his eyes away from the display. The second is to send a voice prompt to remind the driver to shift his eyes to the road conditions outside the car. The voice prompt can be played through the vehicle's audio system, and the content can be short and clear instructions such as "Please pay attention to the road conditions in front of the car" and "Please keep your eyes on the road."

[0066] In a possible implementation, the method also includes: obtaining vehicle driving status information, the vehicle driving status information including vehicle speed and steering angle; determining whether the vehicle speed is greater than or equal to a preset vehicle speed threshold, and whether the steering angle is greater than or equal to a preset angle threshold; if it is determined that the vehicle speed is greater than or equal to the preset vehicle speed threshold, and the steering angle is greater than or equal to the preset angle threshold, then stopping obtaining the touch signal on the surface of the vehicle display screen.

[0067] Specifically, the server continuously obtains the vehicle's driving status information, mainly including two parameters: vehicle speed and steering angle. Vehicle speed refers to the vehicle's driving speed, which can be obtained through wheel speed sensors, GPS positioning, etc. Steering angle refers to the angle at which the vehicle turns, which is generally measured by a steering wheel angle sensor. These sensors are all connected to the vehicle's electronic control unit (ECU), and the ECU can send the collected vehicle speed and steering angle data to the server in real time. The server establishes a communication connection with the ECU and periodically obtains the vehicle's driving status information as a basis for determining whether touch interaction needs to be turned off.

[0068] Next, the server determines whether the acquired vehicle speed is greater than or equal to the preset vehicle speed threshold, and whether the steering angle is greater than or equal to the preset angle threshold. The preset vehicle speed threshold and the preset angle threshold are two key parameters, which define the driving conditions under which touch interaction needs to be turned off. Specifically, the preset vehicle speed threshold means that when the vehicle speed exceeds this value, touch interaction needs to be turned off; the preset angle threshold means that when the steering angle exceeds this value, touch interaction also needs to be turned off. The setting of these two thresholds requires comprehensive consideration of factors such as road type, vehicle performance, and driver habits. They can generally be determined through a large amount of driving data and user feedback, and this application does not limit this.

[0069] If the server determines that the current vehicle speed is greater than or equal to the preset vehicle speed threshold, and the steering angle is greater than or equal to the preset angle threshold, it means that the vehicle is performing more complex driving operations, such as high-speed driving, sharp turns, etc. At this time, the driver needs to concentrate on controlling the vehicle and is not suitable for touch interaction. Therefore, the server will stop acquiring touch signals on the surface of the vehicle display and temporarily turn off the touch interaction function. Specifically, the server can send a control instruction to the vehicle display to notify it to stop collecting and reporting touch signals; at the same time, the server itself will also stop receiving and processing touch signals to ensure that the entire touch interaction process is completely interrupted. In this way, the driver's attention is distracted and disturbed by touch interaction, which improves safety during driving.

[0070] Reference Figure 2 The present application also provides a touch response device based on a vehicle-mounted display screen, which is a server. The server includes an acquisition module 201 and a processing module 202. The acquisition module 201 is used to acquire a touch signal on the surface of the vehicle-mounted display screen, and the touch signal includes an initial touch position, a touch trajectory, and a touch duration; the processing module 202 is used to determine whether the touch signal is a false touch operation based on the initial touch position and the touch duration; the processing module 202 is also used to extract features from the touch trajectory to obtain a trajectory feature vector if it is determined that the touch signal is not a false touch operation, and the trajectory feature vector includes a trajectory length, a trajectory curvature, and a trajectory direction; the processing module 202 is also used to input the trajectory feature vector into a preset gesture recognition model to identify the corresponding touch gesture; the processing module 202 is also used to determine a touch response area according to the touch gesture and in combination with the interface display information of the vehicle-mounted display screen; the processing module 202 is also used to generate a touch response event in the touch response area according to a preset interaction rule, and display the touch response event on the vehicle-mounted display screen.

[0071] In a possible implementation, the processing module 202 determines whether the touch signal is a false touch operation based on the initial touch position and the touch duration, specifically including: the acquisition module 201 acquires the interface element type corresponding to the initial touch position; the processing module 202 determines whether the interface element type is a clickable element; if the processing module 202 determines that the interface element type is a clickable element, it determines the relationship between the touch duration and a preset duration threshold; if the processing module 202 determines that the touch duration is greater than or equal to the preset duration threshold, it determines that the touch signal is not a false touch operation; if the processing module 202 determines that the touch duration is less than the preset duration threshold, it determines that the touch signal is a false touch operation; if the processing module 202 determines that the interface element type is not a clickable element, it determines that the touch signal is a false touch operation.

[0072] In a possible implementation, before the processing module 202 inputs the trajectory feature vector into a preset gesture recognition model to identify the corresponding touch gesture, the method also includes: the processing module 202 collects touch operation samples of multiple users on the vehicle-mounted display screen, and the touch operation samples include touch trajectories and corresponding touch gesture labels; the processing module 202 preprocesses the touch operation samples to obtain a preprocessed touch operation sample set; the processing module 202 extracts touch trajectory features from the touch operation sample set to construct a touch trajectory feature set; the processing module 202 uses the touch trajectory feature set and the corresponding touch gesture labels to train and generate a preset gesture recognition model, and the preset gesture recognition model adopts a support vector machine classification algorithm.

[0073] In a possible implementation, if the processing module 202 determines that the touch signal is not a false touch operation, it performs feature extraction on the touch trajectory to obtain a trajectory feature vector, specifically including: the processing module 202 preprocesses the touch trajectory to obtain a target touch trajectory, and the preprocessing includes denoising and smoothing; the processing module 202 resamples the target touch trajectory to obtain a trajectory point sequence; the processing module 202 extracts the trajectory length, trajectory curvature and trajectory direction based on the trajectory point sequence to generate a trajectory feature vector.

[0074] In a possible implementation, before the processing module 202 determines the touch response area based on the touch gesture and the interface layout information of the vehicle display screen, the method also includes: the acquisition module 201 acquires the vehicle's environmental information, the environmental information including the light intensity inside the vehicle and the light intensity outside the vehicle; the processing module 202 inputs the light intensity inside the vehicle and the light intensity outside the vehicle into a preset display brightness model to obtain the target brightness; the processing module 202 determines to use the target brightness as the interface display information of the vehicle display screen.

[0075] In a possible implementation, after the processing module 202 generates a touch response event in the touch response area according to preset interaction rules, and displays the touch response time on the vehicle-mounted display screen, the method also includes: the acquisition module 201 acquires the driver's facial image; the processing module 202 analyzes the facial image to obtain the driver's line of sight direction and gaze duration; the processing module 202 determines whether the line of sight direction is the direction of looking at the vehicle-mounted display screen; if the processing module 202 determines that the line of sight direction is the direction of looking at the vehicle-mounted display screen, it determines whether the gaze duration is greater than or equal to the preset time; if the processing module 202 determines that the gaze duration is greater than or equal to the preset time, it adjusts the target brightness to the preset brightness and sends a voice prompt, the voice prompt is used to guide the driver to shift his line of sight to the road conditions outside the vehicle, and the preset brightness is lower than the target brightness.

[0076] In a possible implementation, the method also includes: an acquisition module 201 acquires vehicle driving status information, the vehicle driving status information including vehicle speed and steering angle; a processing module 202 determines whether the vehicle speed is greater than or equal to a preset vehicle speed threshold, and whether the steering angle is greater than or equal to a preset angle threshold; if the processing module 202 determines that the vehicle speed is greater than or equal to the preset vehicle speed threshold, and the steering angle is greater than or equal to the preset angle threshold, then stops acquiring the touch signal on the surface of the vehicle display screen.

[0077] It should be noted that: when the device provided in the above embodiment realizes its function, only the division of the above functional modules is used as an example. In actual application, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0078] The present application also provides an electronic device. Figure 3 , Figure 3 The electronic device 300 may include: at least one processor 301 , at least one network interface 304 , a user interface 303 , a memory 305 , and at least one communication bus 302 .

[0079] The communication bus 302 is used to realize the connection and communication between these components.

[0080] The user interface 303 may include a display screen (Display) and a camera (Camera). Optionally, the user interface 303 may also include a standard wired interface and a wireless interface.

[0081] The network interface 304 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0082] Among them, the processor 301 may include one or more processing cores. The processor 301 uses various interfaces and lines to connect various parts in the entire server, and executes various functions of the server and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 305, and calling data stored in the memory 305. Optionally, the processor 301 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 301 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 301, and it can be implemented separately through a chip.

[0083] Among them, the memory 305 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 305 includes a non-transitory computer-readable storage medium. The memory 305 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 305 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 305 may optionally also be at least one storage device located away from the aforementioned processor 301. Refer to Figure 3 The memory 305 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an application program of a touch response method based on a vehicle display screen.

[0084] exist Figure 3In the electronic device 300 shown, the user interface 303 is mainly used to provide an input interface for the user and obtain the data input by the user; and the processor 301 can be used to call the memory 305 to store an application program for a touch response method based on a vehicle display screen. When executed by one or more processors 301, the electronic device 300 executes one or more of the methods described in the above embodiments. It should be noted that for the aforementioned method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited to the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required for the present application.

[0085] The present application also provides a computer-readable storage medium, which stores instructions. When executed by one or more processors 301, the electronic device 300 executes one or more of the methods described in the above embodiments.

[0086] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0087] In the several embodiments provided in this application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0088] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0089] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0090] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the various embodiments of the present application. The aforementioned memory includes: various media that can store program codes, such as USB flash drives, mobile hard drives, magnetic disks or optical disks.

[0091] The above is only an exemplary embodiment of the present disclosure and cannot be used to limit the scope of the present disclosure. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the disclosure of the specification and the truth of practice, those skilled in the art will easily think of other embodiments of the present disclosure.

[0092] This application is intended to cover any variation, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the art not described in the present disclosure. The description and examples are to be regarded as exemplary only, and the scope and spirit of the present disclosure are defined by the claims.

Claims

1. A touch response method based on a vehicle-mounted display screen, characterized in that: The method comprises: Acquire a touch signal on the surface of the vehicle display screen, wherein the touch signal includes an initial touch position, a touch track, and a touch duration; Based on the initial touch position and the touch duration, determining whether the touch signal is an accidental touch operation; If it is determined that the touch signal is not an accidental touch operation, feature extraction is performed on the touch trajectory to obtain a trajectory feature vector, where the trajectory feature vector includes a trajectory length, a trajectory curvature, and a trajectory direction; Inputting the trajectory feature vector into a preset gesture recognition model to recognize the corresponding touch gesture; Determine a touch response area according to the touch gesture and the interface display information of the vehicle-mounted display screen; In the touch response area, a touch response event is generated according to a preset interaction rule, and the touch response event is displayed on the vehicle-mounted display screen.

2. The method according to claim 1, characterized in that The determining, based on the initial touch position and the touch duration, whether the touch signal is a false touch operation specifically includes: Obtaining the interface element type corresponding to the initial touch position; Determine whether the interface element type is a clickable element; If it is determined that the interface element type is the clickable element, determining the magnitude relationship between the touch duration and a preset duration threshold; If it is determined that the touch duration is greater than or equal to the preset duration threshold, it is determined that the touch signal is not an accidental touch operation; if it is determined that the touch duration is less than the preset duration threshold, it is determined that the touch signal is an accidental touch operation; If it is determined that the interface element type is not the clickable element, then it is determined that the touch signal is an accidental touch operation.

3. The method according to claim 1, characterized in that Before inputting the trajectory feature vector into a preset gesture recognition model to recognize the corresponding touch gesture, the method further includes: Collecting touch operation samples of multiple users on the vehicle-mounted display screen, wherein the touch operation samples include touch tracks and corresponding touch gesture labels; Preprocessing the touch operation samples to obtain a preprocessed touch operation sample set; Extracting touch trajectory features from the touch operation sample set to construct a touch trajectory feature set; The touch trajectory feature set and the corresponding touch gesture labels are used to train and generate a preset gesture recognition model, wherein the preset gesture recognition model adopts a support vector machine classification algorithm.

4. The method according to claim 1, characterized in that: If it is determined that the touch signal is not an accidental touch operation, then feature extraction is performed on the touch trajectory to obtain a trajectory feature vector, specifically including: Preprocessing the touch trajectory to obtain a target touch trajectory, wherein the preprocessing includes denoising and smoothing; Resampling the target touch trajectory to obtain a trajectory point sequence; Based on the trajectory point sequence, the trajectory length, the trajectory curvature and the trajectory direction are extracted to generate the trajectory feature vector.

5. The method according to claim 1, characterized in that: Before determining the touch response area according to the touch gesture in combination with the interface layout information of the vehicle-mounted display screen, the method further includes: Acquiring environmental information of the vehicle, wherein the environmental information includes light intensity inside the vehicle and light intensity outside the vehicle; Inputting the vehicle interior light intensity and the vehicle exterior light intensity into a preset display brightness model to obtain a target brightness; Determine to use the target brightness as interface display information of the vehicle-mounted display screen.

6. The method according to claim 5, characterized in that In the touch response area, after generating a touch response event according to a preset interaction rule and displaying the touch response time on the vehicle-mounted display screen, the method further includes: Obtaining a facial image of the driver; Analyzing the facial image to obtain the driver's sight direction and gaze duration; Determining whether the line of sight is in the direction of looking at the vehicle-mounted display screen; If it is determined that the line of sight direction is the direction of gazing at the vehicle-mounted display screen, determining whether the gazing time is greater than or equal to a preset time; If it is determined that the gaze duration is greater than or equal to the preset time, the target brightness is adjusted to the preset brightness and a voice prompt is sent, wherein the voice prompt is used to guide the driver to shift his gaze to the road conditions outside the vehicle, and the preset brightness is lower than the target brightness.

7. The method according to claim 1, characterized in that The method further comprises: Acquiring vehicle driving state information, wherein the vehicle driving state information includes vehicle speed and steering angle; Determining whether the vehicle speed is greater than or equal to a preset vehicle speed threshold, and whether the steering angle is greater than or equal to a preset angle threshold; If it is determined that the vehicle speed is greater than or equal to the preset vehicle speed threshold, and the steering angle is greater than or equal to the preset angle threshold, then the acquisition of the touch signal on the surface of the vehicle display screen is stopped.

8. A touch response device based on a vehicle-mounted display screen, characterized in that: The device comprises an acquisition module (201) and a processing module (202), wherein: The acquisition module (201) is used to acquire a touch signal on the surface of the vehicle-mounted display screen, wherein the touch signal includes an initial touch position, a touch track, and a touch duration; The processing module (202) is used to determine whether the touch signal is an erroneous touch operation based on the initial touch position and the touch duration; The processing module (202) is further configured to extract features from the touch track to obtain a track feature vector if it is determined that the touch signal is not an accidental touch operation, wherein the track feature vector includes a track length, a track curvature, and a track direction; The processing module (202) is further used to input the trajectory feature vector into a preset gesture recognition model to recognize the corresponding touch gesture; The processing module (202) is further used to determine a touch response area according to the touch gesture in combination with the interface display information of the vehicle-mounted display screen; The processing module (202) is further configured to generate a touch response event in the touch response area according to a preset interaction rule, and display the touch response event on the vehicle-mounted display screen.

9. An electronic device, characterized in that: The electronic device (300) comprises a processor (301), a memory (305), a user interface (303) and a network interface (304), wherein the memory (305) is used to store instructions, the user interface (303) and the network interface (304) are used to communicate with other devices, and the processor (301) is used to execute the instructions stored in the memory (305) so that the electronic device (300) executes the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed, the method according to any one of claims 1 to 7 is executed.

Images