Vehicle control method, device and vehicle
By installing driving and media touch controls on the steering wheel, combined with vehicle speed and gaze point monitoring, physical isolation and safety control of vehicle functions are achieved, solving the problem of driver distraction when using in-vehicle functions and improving driving safety and convenience.
Patent Information
- Application Number
- CN202610277617.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-03-09
- Publication Date
- 2026-06-16
AI Technical Summary
When using in-vehicle functions while driving, the driver's eyes need to be diverted, leading to a loss of attention and posing a safety risk.
The steering wheel is equipped with driving and media touch controls. These devices physically isolate driving-related functions from entertainment-related functions and, in conjunction with vehicle speed and gaze point monitoring, determine the appropriate control strategies to execute the functions.
Vehicle functions can be controlled without distracting the driver's attention, reducing the risk of distracted driving caused by looking down at the screen and improving driving safety and convenience.
Smart Images

Figure CN122211200A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of vehicle technology, and more specifically to a vehicle control method, device, and vehicle. Background Technology
[0002] In driving scenarios, drivers need to focus on the road ahead to respond to unexpected traffic situations in real time. Traditionally, if a driver needs to use in-vehicle functions such as navigation, multimedia, or air conditioning while driving, they must shift their gaze from the road to the in-vehicle screen interface and operate the functions visually. However, this method distracts the driver and poses road safety risks.
[0003] Therefore, how to achieve vehicle function control without distracting the driver's attention, so that the driver can conveniently use the vehicle's functions and improve the safety of the vehicle during driving, has become an urgent technical problem to be solved. Summary of the Invention
[0004] In view of the above shortcomings, the purpose of this application is to provide a vehicle control method, device and vehicle, which aims to solve the technical problem of how to achieve vehicle function control without distracting the driver's line of sight.
[0005] In a first aspect, embodiments of this application provide a vehicle control method applied to a vehicle. The vehicle's steering wheel is equipped with a driving touch control device and a media touch control device. The driving touch control device is used to trigger driving control functions on the vehicle's infotainment screen, and the media touch control device is used to trigger media control functions on the vehicle's infotainment screen. The vehicle control method includes: in response to receiving a touch operation on the driving touch control device or the media touch control device, determining whether the driver's gaze point is located within the display area of the vehicle's infotainment screen; if the gaze point is not located within the display area, determining a corresponding driving control strategy or in-vehicle media control strategy based on the vehicle's current speed and the touch operation; and executing the driving control strategy or the in-vehicle media control strategy.
[0006] By incorporating driving and media touch controls on the steering wheel, a physical separation is achieved between driving-related and entertainment-related functions. This allows the driver to distinguish between driving-related and entertainment-related functions using only tactile feedback, avoiding confusion caused by functions being mixed in the same touch area. Upon receiving a touch operation on either the driving or media control, the system detects whether the driver's gaze is within the display area of the vehicle's screen, establishing a correlation between input and visual attention. This determines whether the driver is looking at the screen or operating blindly. Furthermore, if the gaze is not within the display area, it confirms the driver is not looking at the screen. In this case, the vehicle's current speed determines its safety risk status, and the touch operation indicates the driver's desired function. Therefore, the system determines and executes the corresponding driving or media control strategy based on the vehicle's current speed and the touch operation. This ensures that the driver can safely control the vehicle or media entertainment without looking at the screen, reducing the risk of distracted driving caused by the driver looking down at the screen to confirm functions and improving driving safety.
[0007] In one possible embodiment, when the touch operation is a driving touch operation for a driving touch device, a corresponding driving control strategy is determined based on the vehicle's current speed and the touch operation, including: determining multiple driving control function controls displayed on the vehicle screen based on the vehicle's current speed; determining the target driving control function control indicated by the driving touch operation among the multiple driving control function controls based on the driving touch operation; and determining a driving control strategy based on the target driving control function corresponding to the target driving control function control.
[0008] When the touch operation is for the driver's touch control device, the system determines the multiple driving control function controls displayed on the vehicle's screen based on the vehicle's current speed. It intelligently filters and displays only the most relevant and frequently used functions in the current scenario, thus reducing screen information density. Then, by establishing a precise mapping between physical touch input and the dynamic virtual interface, the system can identify the target driving control function indicated by the touch operation from among multiple controls. This allows for accurate identification of the desired driving control function control on the vehicle's screen even when the driver's eyes are off the screen, based on the driver's touch operation and the current interface layout, achieving precise positioning even in blind operation. Subsequently, based on the target driving control function corresponding to the target driving control control, the system determines the driving control strategy, translating the identified driver intent into specific vehicle execution commands, completing a full logical loop from physical operation to dynamic vehicle response. Thus, the driver does not need to navigate through layers of menus while stationary or moving, nor does they need to look away to confirm finger position; they can quickly and conveniently determine the specific function they want to use simply by using the driving touch control on the steering wheel and the current vehicle speed.
[0009] In one possible embodiment, based on the vehicle's current speed, multiple driving control function controls displayed on the vehicle's infotainment screen are determined, including: when the current speed is less than a first speed threshold, displaying driving control function controls corresponding to all driving control functions supported by the vehicle on the infotainment screen, so that the driver can trigger any driving control function based on the driving touch device; when the current speed is greater than or equal to the first speed threshold, displaying driving control function controls corresponding to candidate driving control functions on the infotainment screen, so that the driver can trigger any candidate driving control function based on the driving touch device; the candidate driving control function is a driving control function with a priority greater than or equal to a preset priority threshold among all driving control functions.
[0010] When the touch operation is for the driver's touch control device, if the current vehicle speed is below a first speed threshold, it can be determined that the vehicle is in a low-speed driving state, requiring less driver attention and allowing the driver to focus more on selecting desired driving functions. In this case, a more comprehensive set of driving control function controls can be displayed on the vehicle's screen, giving the driver more function options. If the current vehicle speed is greater than or equal to the first speed threshold, it can be determined that the vehicle is in a high-speed driving state, requiring higher driver attention. The driver needs to concentrate on the road to respond to unexpected situations. In this case, driving functions that are unnecessary at high speeds or may pose a safety risk due to misoperation can be disabled. The core functions that are frequently used and suitable for high-speed driving scenarios can be displayed on the vehicle's screen, allowing the driver to quickly select the desired function. Thus, by using the first speed threshold as a safety boundary and intelligently switching between two different function presentation modes, it is possible to display more driving control functions at low speeds to meet the diverse needs of the driver, while simultaneously simplifying the number of driving control functions at high speeds to meet the driver's need for quick selection of required functions.
[0011] In one possible embodiment, when the touch operation is a media touch operation targeting a media touch device, a corresponding in-vehicle media control strategy is determined based on the vehicle's current speed and the touch operation. This includes: when the current vehicle speed is greater than or equal to a second vehicle speed threshold, generating a media control instruction to be processed based on the driver's touch operation on the media touch device, and storing the media control instruction to be processed in an instruction cache queue; wherein, the media control instruction to be processed includes: a target media control function, and the instruction cache queue is used to indicate that an in-vehicle media control strategy is determined based on the media control instruction to be processed when the current vehicle speed is less than the second vehicle speed threshold; when the current vehicle speed is less than the second vehicle speed threshold, determining a target media control function from multiple preset media control functions based on the driver's touch operation on the media touch device, and controlling the vehicle to determine the in-vehicle media control strategy based on the target media control function.
[0012] When the touch operation is directed at a media touch device, determining whether the current vehicle speed is greater than or equal to a second speed threshold can ascertain whether the vehicle is currently operating at high or low speed, thus mitigating the risk of using media control functions while driving. If the current vehicle speed is greater than or equal to the second speed threshold, the vehicle is currently operating at high speed, and executing the target media control function at this time may distract the driver. Therefore, by storing the generated pending media control commands in a command cache queue, the driver's media touch operation can be recorded first, and the corresponding target media control function can be executed after the vehicle speed decreases, avoiding the immediate switching of media states that could distract the driver's attention from the road. If the current vehicle speed is less than the second speed threshold, the vehicle is currently operating at low speed, requiring less driver attention. In this case, the driver's media touch operation can be responded to quickly, meeting the driver's entertainment needs and improving the driving experience. In this way, by dividing the media control strategy into two modes, namely cache delay and immediate execution, through the second vehicle speed threshold, it is possible to achieve dynamic decoupling between media interaction behavior and vehicle driving risks. This allows the driver to pre-set media playback plans through the touch device while driving at high speeds, without having to bear the risk of distraction caused by operation execution. The previous operation instructions will be automatically executed after the vehicle speed is reduced to a safe range.
[0013] In one possible embodiment, based on a driving touch operation, determining the target driving control function control indicated by the driving touch operation among multiple driving control function controls includes: when the touch operation is a driving touch operation targeting a driving touch device, parsing the actual motion trajectory of the driving touch operation in the coordinate system of the driving touch device; correcting the actual motion trajectory based on the steering wheel angle to obtain the target motion trajectory; the direction of motion of the target motion trajectory in the vehicle coordinate system is the same as the direction of motion of the actual motion trajectory in the coordinate system corresponding to the driving touch device; and determining the target driving control function control indicated by the driving touch operation among multiple driving control function controls based on the target motion trajectory.
[0014] When the touch operation is for a driver's touch device, by analyzing the actual motion trajectory of the touch operation in the coordinate system of the driver's touch device, the original data such as the sliding direction and distance relative to the steering wheel can be determined. Because when the driver operates the touch device, if the steering wheel angle changes, the driver will still maintain the original sliding trend based on the relative position when the steering angle did not change, ignoring the rotation of the steering wheel itself, thus easily selecting the wrong function. This application corrects the actual motion trajectory based on the steering wheel angle to obtain the target motion trajectory. This ensures that the direction of the corrected target motion trajectory in the vehicle coordinate system is logically consistent with the direction of the actual motion trajectory in the coordinate system of the touch device that rotates with the steering wheel. This reduces the mapping deviation caused by the change in the relative angle between the touch device and the vehicle screen due to steering wheel rotation, ensuring that regardless of the steering wheel's rotation angle, the driver's limb movement direction can be accurately restored to the logical operation direction on the screen. Thus, by determining the target driving control function indicated by the driving touch operation among multiple driving control function controls based on the target motion trajectory, the driver does not need to consider how the corresponding touch operation should change after the steering wheel changes. This allows the driver to quickly and conveniently select the desired driving control function, reducing the occurrence of safety accidents caused by selecting the wrong driving control function and improving the safety of vehicle driving.
[0015] In one possible embodiment, the vehicle control method further includes: in response to receiving a function proxy operation for a media touch device, controlling the media touch device to be in a driving control function proxy mode so that the media touch device can be used to trigger driving control functions in the vehicle infotainment screen; and / or: in response to receiving a function proxy operation for a driving touch device, controlling the driving touch device to be in a media function proxy mode so that the driving touch device can be used to trigger media control functions in the vehicle infotainment screen.
[0016] Drivers can perform function proxy operations on the driving touchscreen to switch from controlling driving-related functions to controlling media and entertainment-related functions. Alternatively, drivers can perform function proxy operations on the media touchscreen to switch from controlling media and entertainment-related functions to controlling driving-related functions. In this way, by recognizing specific proxy operation commands, the left and right touchscreens can temporarily exceed their original functional boundaries, achieving role interchange or function takeover. This allows drivers to reconfigure control resources as needed, catering to different driving habits and preferences, and improving the driving experience.
[0017] In one possible embodiment, the vehicle control method further includes: when the gaze point is located within the display area, determining the target screen area corresponding to the gaze point in the vehicle screen; associating the target function corresponding to the target function control displayed in the target screen area with the driving touch device or media touch device, so that the driver can realize the target function through the driving touch device or media touch device; wherein, the target function control is a driving control function control or a media control function control, and the target function is a driving control function or a media control function.
[0018] When the gaze point is within the display area, it indicates that the driver is looking at the screen. At this point, by identifying the target screen area corresponding to the gaze point on the vehicle's infotainment screen, we can determine exactly which area and which function icon the driver's gaze is focused on, thus establishing a connection between visual attention and screen elements. Associating the target function control displayed in the target screen area with the driver's touchscreen or media touchscreen allows us to map the function the driver is looking at onto that device. This enables the driver to control the target function control simply by operating the touchscreen or media touchscreen, allowing them to achieve the desired function. By establishing a rapid pathway from visual to physical control, we can improve driver convenience and driving safety.
[0019] In one possible embodiment, the vehicle control method further includes: in response to receiving a touch operation on a driving touch device and / or a media touch device, displaying a target function control on the vehicle screen, the target function control indicating the position of the function control corresponding to the driving control function or media control function indicated by the touch operation on the vehicle screen; and / or; outputting prompt voice information; the prompt voice information indicating the driving control function or media control function indicated by the touch operation; and / or; controlling the vibration of the steering wheel to indicate that the driving control function or media control function has been selected.
[0020] In response to a touch operation received from the driver's touch control and / or media touch control, the system can display the target function control on the vehicle's infotainment screen. This establishes a confirmation mechanism linking touch operation with visual feedback. When the driver performs blind operation on the steering wheel, the system provides an optional visual confirmation channel by highlighting, flashing, or dynamically displaying the location of the currently selected function control on the screen. This allows the driver to perceive the current operation progress even without focusing on the screen, simply by glancing at it out of the corner of their eye. Simultaneously, the system can output voice prompts, establishing a voice feedback channel for touch operations. By announcing the name of the currently selected function or its status change, the driver can understand the operation result without any visual input. Furthermore, the system can control steering wheel vibration, allowing the driver to directly perceive the operation feedback through touch and confirm the corresponding driving or media control function. This multi-dimensional real-time feedback mechanism can be triggered simultaneously, providing confirmation information through screen highlighting, voice prompts, and steering wheel vibration—either in parallel or in combination—when the driver operates the vehicle's infotainment screen via the driver's touch control and / or media touch control. This adapts to different driver preferences and the needs of different driving scenarios.
[0021] Secondly, this application provides a vehicle control device applied to a vehicle. The vehicle's steering wheel is equipped with a driving touch control device and a media touch control device. The driving touch control device is used to trigger driving control functions on the vehicle's infotainment screen, and the media touch control device is used to trigger media control functions on the vehicle's infotainment screen. The vehicle control device includes: a response module, a gaze point determination module, a strategy determination module, and a strategy execution module. A response module for responding to a received touch operation on a driving touch device or a media touch device.
[0022] The gaze point determination module is used to determine whether the driver's gaze point is located within the display area of the vehicle's infotainment screen; The strategy determination module is used to determine the corresponding driving control strategy or in-vehicle media control strategy based on the vehicle's current speed and touch operation when the gaze point is not located within the display area. The strategy execution module is used to execute driving control strategies or in-vehicle media control strategies.
[0023] In one possible embodiment, the vehicle control device further includes: a control determination module; The control determination module is used to determine the multiple driving control function controls displayed on the vehicle screen based on the vehicle's current speed when the touch operation is a driving touch operation for the driving touch device. The control determination module is also used to determine the target driving control function control indicated by the driving touch operation among multiple driving control function controls based on the driving touch operation. The strategy determination module is used to determine the driving control strategy based on the target driving control function corresponding to the target driving control function control.
[0024] In one possible embodiment, the vehicle control device further includes: a function display module; The function display module is used to display the driving control function controls corresponding to all driving control functions supported by the vehicle on the vehicle screen when the current vehicle speed is less than the first vehicle speed threshold, so that the driver can trigger any driving control function based on the driving touch device. The function display module is also used to display the driving control function controls corresponding to the candidate driving control functions on the vehicle screen when the current vehicle speed is greater than or equal to the first vehicle speed threshold, so that the driver can trigger any candidate driving control function based on the driving touch device; the candidate driving control function is the driving control function with a priority greater than or equal to the preset priority threshold among all driving control functions.
[0025] Thirdly, this application provides a vehicle that includes the vehicle control device as described in the second aspect. Attached Figure Description
[0026] To more clearly illustrate the technical solutions in the embodiments of this application or the background art, the accompanying drawings used in the embodiments of this application will be described below.
[0027] Figure 1 This is a schematic diagram of the structure of a vehicle disclosed in an embodiment of this application; Figure 2 This is a schematic diagram of the structure of another vehicle disclosed in an embodiment of this application; Figure 3 This is a schematic flowchart of a vehicle control method disclosed in an embodiment of this application; Figure 4 This is a schematic diagram illustrating an example of a driver performing touch operations on a steering wheel, as disclosed in an embodiment of this application. Figure 5 This is a schematic diagram illustrating another example of a driver performing touch operations on the steering wheel, as disclosed in an embodiment of this application. Figure 6 This is a schematic diagram illustrating another example of a driver performing touch operations on the steering wheel, as disclosed in an embodiment of this application. Figure 7 This is a schematic diagram of the structure of a vehicle control device disclosed in an embodiment of this application; Figure 8 This is a schematic diagram of another vehicle control device disclosed in an embodiment of this application. Detailed Implementation
[0028] The terms “first,” “second,” etc., are used for descriptive purposes only and have no sequential or technical meaning, nor should they be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.
[0029] In the embodiments of this application, "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship.
[0030] Furthermore, the terms "comprising" and "having," and any variations thereof, used in the description of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or modules is not limited to the steps or modules listed, but may optionally include other steps or modules not listed, or may optionally include other steps or modules inherent to such process, method, product, or device.
[0031] Furthermore, in the embodiments of this application, the words "exemplary" or "for example" are used to indicate that they are examples, illustrations, or descriptions. Any embodiment or design that is described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design options. Specifically, the use of the words "exemplary" or "for example" is intended to present concepts in a concrete manner.
[0032] This application provides a vehicle control method. By incorporating a driving touch control device and a media touch control device on the steering wheel, a physical isolation is achieved between vehicle driving-related functions and vehicle entertainment-related functions. This allows the driver to distinguish between driving-related and entertainment-related functions using only tactile feedback, avoiding confusion caused by functions being mixed in the same touch area. Upon receiving a touch operation on either the driving or media touch control device, the method determines whether the driver's gaze is within the display area of the vehicle's infotainment screen. This establishes a correlation monitoring mechanism between input and visual attention, determining whether the driver is operating while looking at the screen or blindly. Furthermore, if the gaze is not within the display area, it can be determined that the driver is not looking at the screen. At this point, the vehicle's current safety risk status can be determined based on its current speed, and the driver's desired function can be determined based on the touch operation. Thus, a corresponding driving control strategy or in-vehicle media control strategy can be determined and executed based on the vehicle's current speed and the touch operation. This ensures that the driver can safely control the vehicle or media entertainment without looking at the screen, reducing the risk of distracted driving caused by the driver looking down at the screen to confirm functions and improving driving safety.
[0033] The vehicle control method provided in this application can be applied to a vehicle control device, specifically to the processor of that device. This vehicle control device can be a controller within a vehicle, or it can be the vehicle itself. The vehicle can be, but is not limited to, a pure electric vehicle (PEV / BEV), a hybrid electric vehicle (HEV), a range-extended electric vehicle (REEV), a plug-in hybrid electric vehicle (PHEV), or a new energy vehicle (NEV). This application does not limit the specific form of the vehicle. Alternatively, the vehicle control device can be an external server connected to the vehicle, or a server cluster consisting of multiple external servers. In some implementations, the server cluster can be a distributed cluster server. This application does not impose any limitations in this regard.
[0034] The implementation environment of the embodiments of this application is described below.
[0035] For example, such as Figure 1 The diagram shows a structural schematic of a vehicle. The vehicle includes: a vehicle control unit 1, a steering wheel body 2, a driving touch control unit 3, a media touch control unit 4, and a vehicle infotainment screen 5. The vehicle control unit 1 is connected to both the steering wheel body 2 and the vehicle infotainment screen 5. The driving touch control unit 3 and the media touch control unit 4 are mounted on the surface of the steering wheel body 2. The driving touch control unit 3 and the media touch control unit 4 are respectively located on both sides of the steering wheel body 2.
[0036] The driving touch control 3 and the media touch control 4 are located on both sides of the steering wheel. They can be arranged symmetrically or asymmetrically; this application does not limit their specific locations. For example, the driving touch control 3 may be located on the right side of the steering wheel body 2, inclined relative to the radial plane of the steering wheel body 2, and the media touch control 4 may also be located on the right side of the steering wheel body 2, inclined relative to the radial plane of the steering wheel body 2. A first preset safety distance is provided between the driving touch control 3 and the edge of the steering wheel body 2, and a second preset safety distance is provided between the media touch control 4 and the edge of the steering wheel body 2. By providing the first preset safety distance between the driving touch control and the edge of the steering wheel body, and the second preset safety distance between the media touch control and the edge of the steering wheel body, the risk of the driver accidentally touching either the driving touch control 3 or the media touch control 4 can be reduced.
[0037] For example, the horizontal distance between the central axis of the steering wheel body 2 and the rightmost edge of the driving touch device 3 is 118.8 mm, the width of the driving touch device 3 is 30 mm, the tilt angle of the driving touch device 3 relative to the radial plane of the steering wheel is 13.15 degrees, the arc transition radius of the upper right corner of the driving touch device 3 is 15 mm, and the distance from the center of the rounded corner of the upper right corner of the driving touch device 3 to the inner side of the outer rim of the steering wheel is 25.89 mm. This allows the sliding direction of the driving touch device 3 to match the movement direction of the driver's right thumb, and the sliding direction of the media touch device 4 to match the movement direction of the driver's left thumb, thus facilitating the driver's up, down, left, and right sliding. The size of the media touch device 4 can be the same as or different from that of the driving touch device 3; this application does not impose any limitations on this.
[0038] The driving touch control device 3 can be a touch display screen, a capacitive touchpad, a pressure-sensitive touch surface, or a resistive touch strip. This application does not limit the specific form of the driving touch control device 3. For a description of the media touch control device 4, please refer to the description of the driving touch control device 3; this application will not repeat it here. By setting up the driving touch control device 3 and the media touch control device 4, the problem of long-distance screen touch control can be solved, making it easier for the driver to operate the vehicle's infotainment screen, increasing the utilization rate of the screen's functions, and improving the convenience of vehicle-to-vehicle interaction. The driving touch control device and the media touch control device can be completely identical physical entities in terms of hardware configuration. The different names used in this application are only for the convenience of distinguishing their current functional logic or interactive scenarios. In practical applications, the names of these two devices are not fixed but can be dynamically determined or renamed according to their specific control functions, installation locations, or software-defined roles. That is, the same touch hardware can operate as both a driving touch control device and a media touch control device.
[0039] In this embodiment, the vehicle control device 1 is used to respond to receiving a touch operation on the driving touch device 3 or the media touch device 4, and to determine the corresponding driving control function or media control function based on the vehicle's current speed and the touch operation, and to determine the corresponding driving control strategy or in-vehicle media control strategy. The driving control function is a function related to vehicle driving control, such as activating cruise control, deactivating cruise control, cruise speed control, following distance adjustment, high / low beam headlight switching, rearview mirror angle adjustment, air conditioning temperature adjustment, or driving mode switching. The media control function is a function related to in-vehicle media control, such as volume adjustment, song switching, audiobook playback, or video playback.
[0040] In this embodiment, the steering wheel body 2 is used to control the vehicle's driving direction. The driving touch control device 3 is used to interact with the driver and trigger the driving control functions corresponding to the driving control function controls on the vehicle screen 5. The media touch control device 4 is used to interact with the driver and trigger the media control functions corresponding to the media control function controls on the vehicle screen 5. For example, the driving control function can be adjusting the air conditioning level, swiping up to increase the fan speed or swiping down to decrease the fan speed. The media control function can be adjusting the volume, swiping up to increase the volume, swiping down to decrease the volume, or double-tapping to pause or start playback.
[0041] In this embodiment, the vehicle screen 5 is used to display driving control function controls and / or media control function controls, wherein the driving control function controls correspond to driving control functions and the media control function controls correspond to media control functions.
[0042] The vehicle can also be equipped with a vibration motor and speakers, allowing the driver to know the functions selected on the in-vehicle infotainment screen.
[0043] For example, such as Figure 2 As shown, the vehicle also includes: an eye movement recognition device 6, a driving vibration motor 7, a media vibration motor 8, and a speaker 9. The steering wheel body 2 is also equipped with the eye movement recognition device 6, the driving vibration motor 7, and the media vibration motor 8. The eye movement recognition device 6 is located between the driving touch control device 3 and the media touch control device 4. When the steering wheel body 2 turns sharply, the eye movement recognition device 6 rotates with the steering wheel body 2, at which point it cannot recognize the driver's eye movements. The driving vibration motor 7 is located at the bottom of the driving touch control device 3, and the media vibration motor 8 is located at the bottom of the media touch control device 4. Both the driving touch control device 3 and the media touch control device 4 are connected to the speaker 9. This application does not limit the specific installation position of the speaker 9 inside the vehicle. For example, the speaker 9 can be located on the left side of the steering wheel body 2 or on the right side of the steering wheel body 2.
[0044] In this embodiment, the eye movement recognition device 6 is used to acquire the driver's eye movement data and determine whether the driver's gaze point is located based on the eye movement data. Figure 1 Within the display area of CRRC's computer screen 5.
[0045] In this embodiment, the driving vibration motor 7 is used to vibrate the steering wheel to indicate the driving control function indicated by the driving touch operation. The media vibration motor 8 is used to vibrate the steering wheel to indicate the media control function indicated by the media touch operation.
[0046] In this embodiment, the speaker 9 is used to output prompt voice information; the prompt voice information is used to prompt the driving control function or media control function indicated by the touch operation.
[0047] When the driver's gaze is within the display area of the vehicle's infotainment screen, the touchpad can control the screen and act as a function confirmation button when the driver interacts with the driving or media touch controls. A vibration motor located below the touchpad provides haptic feedback, simulating the tactile feel of a physical button. By incorporating both driving and media vibration motors, function selection and execution can be achieved through speaker announcements even when the driver's gaze is not within the display area of the infotainment screen, thus creating a complete, all-scenario human-machine interaction logic.
[0048] For example, when a driver touches the driving or media touchscreen while driving, the vehicle determines whether the touchscreen operation corresponds to a preset function. If the touchscreen operation corresponds to a preset function, the vehicle executes the preset function. If the touchscreen operation does not correspond to a preset function, the vehicle determines whether the driver is looking at the vehicle's infotainment screen. When the driver's gaze is determined to be within the display area of the infotainment screen, the vehicle displays the cursor on the screen and moves it to the function control corresponding to the driver's gaze. Then, after selecting the function control using the driving or media touchscreen, the driver can double-click the driving or media touchscreen to allow the vehicle to confirm and execute the function corresponding to that control. When the driver's gaze is not within the display area of the infotainment screen, the vehicle displays the cursor on the screen. Then, based on the driver's touchscreen operation, the vehicle moves the cursor between multiple function controls displayed on the screen and controls the speaker to announce the name of the function control the cursor has swept over. At the same time, when the cursor sweeps over the function controls, the driving vibration motor or media vibration motor will activate to vibrate the steering wheel body.
[0049] In some embodiments, the vehicle includes a basic control mode, a function blind selection mode, an eye-tracking mode, and a fixed function mode.
[0050] For example, when the vehicle is in basic control mode, both the eye-tracking device and the speaker are disabled. In this mode, if the driver wants to use a function on the vehicle's infotainment screen while driving, they can look at the screen and move the cursor on the driver's touchscreen or media touchscreen by swiping up, down, left, or right with their right thumb. Double-tapping the driver's touchscreen or media touchscreen confirms whether the desired function is enabled or disabled, preventing accidental touches.
[0051] When the vehicle is in blind selection mode, the eye-motion recognition device stops working while the speakers operate normally, eliminating the need for the driver to look at the infotainment screen. When the driver slides their finger across the driving or media touchscreen, the vehicle controls the speakers to announce the area of the screen the cursor is tracing. Furthermore, when the cursor passes over a function control on the screen, the driving or media vibration motor vibrates, providing real-time feedback to remind the driver of the cursor's movement. This allows the driver to identify the desired function based on both auditory and tactile feedback, and then double-click to confirm and use it.
[0052] When the vehicle is in eye-tracking mode, the eye movement recognition device works normally. The vehicle can determine the driver's gaze point on the in-vehicle screen through the eye movement recognition device, and determine the cursor position corresponding to the driver's gaze point. The cursor position is then fed back to the in-vehicle screen in real time, so that the driver can select and use functions by swiping, double-tapping, etc. on the touchpad with his right thumb.
[0053] When the vehicle is in a fixed function mode, it is necessary to pre-set the mapping relationship between the driver's driving touch operations and the driving control functions of the driving touch device, as well as the mapping relationship between the driver's media touch operations and the media control functions of the media touch device. Specifically, one driving touch operation corresponds to one driving control function, and one media touch operation corresponds to one media control function. This allows the driver to manipulate and select content on the vehicle's infotainment screen when performing touch operations on the driving or media touch device. For example, if the driver slides their thumb up or down on the media touch device, it triggers the volume adjustment function. Thus, when the driver slides up or down on the media touch device, they can adjust the media volume in real time without executing other media control functions.
[0054] In some embodiments, the driving touch control device and the media touch control device integrate a fingerprint recognition sensor, which is used to acquire the driver's fingerprint feature information. The vehicle compares the driver's fingerprint feature information with pre-stored fingerprint feature information. If the driver's fingerprint feature information matches the pre-stored fingerprint feature information, a preset vehicle control function is executed. The preset vehicle control function may be turning on the vehicle infotainment screen, turning off the vehicle infotainment screen, unlocking the doors, or locking the doors; this application does not limit this.
[0055] It should be noted that the system architecture and application scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.
[0056] This application uses a vehicle control method as an example to illustrate the vehicle control method provided in this application.
[0057] like Figure 3 The illustration shows a vehicle control method provided in this application, applied to a vehicle. The vehicle's steering wheel is equipped with a driving touch control device and a media touch control device. The driving touch control device is used to trigger driving control functions on the vehicle's infotainment screen, and the media touch control device is used to trigger media control functions on the vehicle's infotainment screen. The vehicle control method includes: S301, In response to receiving a touch operation for a driver touch device or a media touch device, determine whether the driver's gaze point is located within the display area of the vehicle screen.
[0058] Touch operation refers to the interactive behavior generated by the driver's physical contact or near-field sensing with the driving touch device or media touch device, which is used to trigger control commands. Specific criteria for determining whether a vehicle has received a touch operation may include the real-time change in the capacitance, resistance, or pressure value of the touch sensing node exceeding a preset noise suppression threshold, or the duration of the spatial coordinate data corresponding to the touch operation being greater than or equal to a preset duration. This application does not limit the specific criteria for determining whether a vehicle has received a touch operation.
[0059] The gaze point is used to indicate the location where the driver's gaze falls, specifically referring to the geometric intersection or projected coordinates of the driver's gaze direction vector and the target reference plane (such as the plane where the vehicle screen is located) in three-dimensional space. The gaze point can be a monocular gaze point or a binocular gaze point; this application does not limit the number of eyes corresponding to a gaze point. The vehicle screen can be a central control screen, and its specific structural form can be a single screen, a screen composed of multiple physical screens, a flat display screen, a curved display screen, or a flexible folding screen. This application does not limit the specific structural form of the vehicle screen.
[0060] One possible approach is to determine the driver's gaze point based on a deep learning model and eye-collected data. Another possible approach is to determine the driver's gaze point by performing geometric calculations on the eye-collected data using the Pupil Center Corneal Reflection (PCCR) algorithm.
[0061] In one possible implementation, it is determined whether the display area of the vehicle screen includes the driver's gaze point, so as to determine whether the driver's gaze point is located within the display area of the vehicle screen. If the display area of the vehicle screen includes the driver's gaze point, it is determined that the driver's gaze point is located within the display area of the vehicle screen. If the display area of the vehicle screen does not include the driver's gaze point, it is determined that the driver's gaze point is not located within the display area of the vehicle screen.
[0062] S302. When the gaze point is not located within the display area of the vehicle's infotainment screen, determine the corresponding driving control strategy or in-vehicle media control strategy based on the vehicle's current speed and touch operation.
[0063] The driving control strategy instructs the execution of driving control functions corresponding to the touch operation when the touch operation is directed to a driving touch device. The in-vehicle media control strategy instructs the execution of media control functions corresponding to the touch operation when the touch operation is directed to a media touch device. The driving control strategy is the control algorithm logic used to achieve the target driving control function, and the in-vehicle media control strategy is the control algorithm logic used to achieve the target media control function. When the gaze point is not within the display area, it indicates that the driver cannot visually confirm the function controls displayed on the vehicle's screen. In this case, the vehicle's current speed objectively reflects the risk level during vehicle operation, thereby determining the vehicle's current safety status and the timing requirements for function execution—that is, clarifying which functions can be executed immediately at the current speed or require delayed processing. Touch operations are direct physical commands issued by the driver, reflecting the functions the driver expects to trigger, thus clarifying the functional content required by the strategy. By combining vehicle speed information representing the safety status and execution timing requirements with touch information representing specific functional targets, the system can determine the driving control strategy or in-vehicle media control strategy that conforms to current driving safety regulations and the driver's operational intentions without visual confirmation.
[0064] S303, Execute driving control strategy or in-vehicle media control strategy.
[0065] In one possible implementation, when the touch operation is a driving touch operation for a driving touch device, a driving control strategy is executed; when the touch operation is a media touch operation for a media touch device, an in-vehicle media control strategy is executed.
[0066] For example, after determining the air conditioning temperature adjustment control, if the vehicle receives a continuous displacement signal along one direction (e.g., from bottom to top), and the duration of the continuous displacement signal is greater than or equal to a first preset time threshold or the displacement distance is greater than or equal to a first preset distance threshold (corresponding to the driver's swiping action from bottom to top on the touch area), the vehicle determines the driving control strategy to increase the air conditioning temperature and controls the air conditioning system to perform the temperature increase action. After determining the music playback control, if the vehicle receives a touch point connection and disconnection signal completed within a preset time period (corresponding to the user's finger lifting off the screen after tapping), the vehicle determines the function instruction to play or pause music and controls the audio system to perform the corresponding play or pause action.
[0067] As can be seen from S301-S303, the solution provided in this application embodiment, by setting a driving touch control device and a media touch control device on the steering wheel, achieves physical isolation between vehicle driving-related functions and vehicle entertainment-related functions at the physical control level. This allows the driver to distinguish whether the function to be operated is related to vehicle driving or entertainment simply by the touch of their fingers, avoiding confusion caused by functions being mixed in the same touch area. When a touch operation is received on the driving touch control device or the media touch control device, the system determines whether the driver's gaze is within the display area of the vehicle screen by responding to the driver's touch operation. This establishes a correlation monitoring mechanism between operation input and visual attention, thereby determining whether the driver is operating while looking at the screen or blindly operating without looking at the screen. Furthermore, if the gaze is not within the display area, it can be determined that the driver is not currently looking at the screen. At this time, the current safety risk status of the vehicle can be determined based on the current vehicle speed, and the function the driver expects the vehicle to perform can be determined based on the touch operation. Thus, the corresponding driving control strategy or in-vehicle media control strategy can be determined based on the current vehicle speed and the touch operation, and the driving control strategy or in-vehicle media control strategy can be executed. This ensures that the driver can safely control the vehicle or media entertainment without looking at the screen, reducing the risk of distracted driving caused by the driver looking down at the screen to confirm functions and improving driving safety.
[0068] In some embodiments, when the touch operation is a driving touch operation for a driving touch device, it is necessary to generate a corresponding driving control strategy based on the driving touch operation.
[0069] As a feasible implementation method, the driving control strategy is determined based on S3021-S3023: S3021. When the touch operation is a driving touch operation for the driving touch device, determine the multiple driving control function controls displayed on the vehicle screen according to the current vehicle speed.
[0070] As a feasible implementation method, when the current vehicle speed is less than a first vehicle speed threshold, the vehicle's infotainment screen displays the driving control function controls corresponding to all driving control functions supported by the vehicle, so that the driver can trigger any driving control function based on the driving touch device. This application does not limit the specific value of the first vehicle speed threshold; for example, the first vehicle speed threshold can be 60 km / h, 70 km / h, 80 km / h, 90 km / h, or 100 km / h.
[0071] When the touch operation is for the driver's touch control device, if the current vehicle speed is below a first speed threshold, it can be determined that the vehicle is in a low-speed driving state, requiring less driver attention. The driver can then focus more on selecting the desired driving functions. In this situation, a more comprehensive set of driving control controls can be displayed on the vehicle's screen, giving the driver more options.
[0072] As another feasible implementation, when the current vehicle speed is greater than or equal to a first vehicle speed threshold, the driving control function controls corresponding to the candidate driving control functions are displayed on the vehicle's infotainment screen, allowing the driver to trigger any candidate driving control function via the driving touch device. The candidate driving control function is the driving control function with a priority greater than or equal to a preset priority threshold among all driving control functions. This application does not limit the criteria for determining the priority of driving control functions. For example, the default priority of the system's preset driving control functions can be determined as the priority of the driving control functions. Alternatively, the frequency of use of driving control functions can be determined based on the driver's historical usage habits, and the priority of driving control functions can be determined based on this frequency of use, with a positive correlation between the frequency of use and the priority of driving control functions. Another example is that the priority of driving control functions can be determined based on driving control function preference settings, which indicate whether the driving control function is a driver-preset preferred driving control function. This application does not limit the specific value of the preset priority threshold. For example, the preset priority threshold can be 2, 3, 4, or 5. For example, if the preset priority threshold is 3, the priority of driving control function a is 1, the priority of driving control function b is 3, the priority of driving control function c is 4, and the priority of driving control function d is 2, then driving control function b and driving control function c are candidate driving control functions.
[0073] When the current vehicle speed is greater than or equal to a first speed threshold, it can be determined that the vehicle is in a high-speed driving state, requiring a high level of driver attention. The driver needs to focus on the road to respond to unexpected situations. At this time, driving functions that are unnecessary at high speeds or may pose a safety risk due to misoperation can be disabled. The core functions that are frequently used and suitable for high-speed driving scenarios can be displayed on the vehicle's screen, allowing the driver to quickly select the required function. Thus, by using the first speed threshold as a safety boundary, two different function presentation modes can be intelligently switched. At low speeds, more driving control functions can be displayed to meet the diverse needs of the driver. Simultaneously, at high speeds, the number of driving control functions can be simplified to meet the driver's need for quick selection of the required function.
[0074] S3022. Based on driving touch operation, determine the target driving control function control indicated by the driving touch operation among multiple driving control function controls.
[0075] As a feasible implementation method, S3022 includes: when the touch operation is a driving touch operation targeting a driving touch device, parsing the actual motion trajectory of the driving touch operation in the coordinate system of the driving touch device; correcting the actual motion trajectory based on the steering wheel angle to obtain the target motion trajectory; and determining the target driving control function control indicated by the driving touch operation among multiple driving control function controls based on the target motion trajectory. The actual motion trajectory is the original sequence of coordinate points during the interactive movement of the driver's finger and the touch device, and the target motion trajectory is the corrected sequence of coordinate points for the actual motion trajectory. The direction of motion of the target motion trajectory in the vehicle coordinate system is the same as the direction of motion of the actual motion trajectory in the coordinate system corresponding to the driving touch device. The vehicle coordinate system is a coordinate system fixed on the vehicle body or ground and does not rotate with the steering wheel. The coordinate system corresponding to the driving touch device is a coordinate system fixed on the steering wheel and rotates with the steering wheel.
[0076] For example, such as Figure 4 As shown, the steering wheel body 10 is equipped with a driving touch control device 20 and a media touch control device 30. When the vehicle is stationary and the steering wheel body 10 is not rotated, the driver performs a sliding operation in the first direction on the driving touch control device 20 to obtain a first actual motion trajectory. The first direction sliding operation is a downward sliding relative to the steering wheel body 10. At this time, the vehicle coordinate system coincides with the coordinate system corresponding to the driving touch control device 20. The direction of motion of the first actual motion trajectory in the vehicle coordinate system and the direction of motion in the coordinate system corresponding to the driving touch control device 20 are both the first direction, and no correction based on the steering wheel angle is needed for the first actual motion trajectory. Based on the first actual motion trajectory, the vehicle determines that the driving control corresponding to the sliding operation in the first direction is the air conditioning start control.
[0077] For example, such as Figure 5 As shown, the steering wheel body 10 is equipped with a driving touch control device 20 and a media touch control device 30. When the vehicle is stationary and the steering wheel body 10 is not rotated, the driver performs a second-direction sliding operation on the driving touch control device 20 to obtain a second actual motion trajectory. The second-direction sliding operation is a leftward sliding relative to the steering wheel body 10. At this time, the vehicle coordinate system coincides with the coordinate system corresponding to the driving touch control device 20. The direction of movement of the second actual motion trajectory in the vehicle coordinate system and the direction of movement in the coordinate system corresponding to the driving touch control device 20 are both the second direction, and no correction based on the steering wheel angle is required for the second actual motion trajectory. Based on the second actual motion trajectory, the vehicle determines that the driving control corresponding to the second-direction sliding operation is a door opening control.
[0078] For example, such as Figure 6 As shown, the steering wheel body 10 is equipped with a driving touch control 20 and a media touch control 30. When the vehicle is in motion, after the steering wheel body 10 rotates 90 degrees counterclockwise, the driver performs a sliding operation in the first direction on the driving touch control 20, obtaining a third actual motion trajectory. At this time, the coordinate system corresponding to the driving touch control 20 rotates 90 degrees counterclockwise with the steering wheel body 10. The direction of motion of the third actual motion trajectory in the vehicle coordinate system is the first direction, and the direction of motion of the third actual motion trajectory in the coordinate system corresponding to the driving touch control 20 is the second direction. Since the direction of motion of the third actual motion trajectory in the vehicle coordinate system differs from the direction of motion in the coordinate system corresponding to the driving touch control 20, the actual motion trajectory needs to be corrected based on the steering wheel angle to obtain the target motion trajectory. The direction of motion of the target motion trajectory in the coordinate system corresponding to the driving touch control 20 is the first direction. Based on the target motion trajectory, the vehicle determines that the driving control corresponding to the sliding operation in the first direction is the air conditioning start control.
[0079] One possible implementation involves correcting the actual motion trajectory based on the steering wheel angle to obtain the target motion trajectory. This includes: performing a coordinate transformation on the actual motion trajectory based on the steering wheel angle using a coordinate rotation transformation algorithm to obtain the target motion trajectory. The coordinate rotation transformation algorithm can be a two-dimensional planar rotation matrix algorithm or a planar vector rotation algorithm; this application does not impose any restrictions on the coordinate rotation transformation algorithm.
[0080] When the touch operation is for a driver's touch device, by analyzing the actual motion trajectory of the touch operation in the coordinate system of the driver's touch device, the original data such as the sliding direction and distance relative to the steering wheel can be determined. Because when the driver operates the touch device, if the steering wheel angle changes, the driver will still maintain the original sliding trend based on the relative position when the steering angle did not change, ignoring the rotation of the steering wheel itself, thus easily selecting the wrong function. This application corrects the actual motion trajectory based on the steering wheel angle to obtain the target motion trajectory. This ensures that the direction of the corrected target motion trajectory in the vehicle coordinate system is logically consistent with the direction of the actual motion trajectory in the coordinate system of the touch device that rotates with the steering wheel. This reduces the mapping deviation caused by the change in the relative angle between the touch device and the vehicle screen due to steering wheel rotation, ensuring that regardless of the steering wheel's rotation angle, the driver's limb movement direction can be accurately restored to the logical operation direction on the screen. Thus, by determining the target driving control function indicated by the driving touch operation among multiple driving control function controls based on the target motion trajectory, the driver does not need to consider how the corresponding touch operation should change after the steering wheel changes. This allows the driver to quickly and conveniently select the desired driving control function, reducing the occurrence of safety accidents caused by selecting the wrong driving control function and improving the safety of vehicle driving.
[0081] S3023. Determine the driving control strategy based on the target driving control function corresponding to the target driving control function control.
[0082] The driving control strategy is the control algorithm logic used to implement the target driving control function. For example, if the target driving control function control is an adaptive cruise control activation virtual button, and the target driving control function corresponding to this control is entering adaptive cruise control mode, then the driving control strategy is determined as follows: current vehicle speed 82 km / h, following distance determined to be 2.5 seconds, and acceleration limited to no more than 1.2 m / s². 2 It also monitors the distance to the vehicle in front in real time to dynamically adjust the throttle opening.
[0083] As can be seen from S3021-S3023, the solution provided in this application embodiment, when the touch operation is a driving touch operation for a driving touch device, determines the multiple driving control function controls displayed on the vehicle screen based on the vehicle's current speed. It intelligently filters and displays only the most relevant and frequently used function controls in the current scenario based on the vehicle speed, thereby simplifying the screen information density. Then, by establishing a precise mapping between physical touch input and the dynamic virtual interface, it can determine the target driving control function control indicated by the driving touch operation among multiple driving control function controls. Even when the driver's gaze is off the screen, it can accurately determine the target driving control function control the driver wants to select on the vehicle screen based on the driver's touch operation and the current interface layout, thus achieving precise positioning in blind operation mode. Subsequently, based on the target driving control function corresponding to the target driving control function control, a driving control strategy is determined, which can convert the identified driver's intention into specific vehicle execution commands, completing a complete logical closed loop from physical operation to vehicle dynamic response. In this way, drivers do not need to navigate through layers of menus while stationary or in motion, nor do they need to look away to confirm the position of their fingers. They can quickly and conveniently determine the specific function they want to use simply by using the driving touch control on the steering wheel and the current vehicle speed.
[0084] In some embodiments, when the touch operation is a media touch operation for a media touch device, it is necessary to generate a corresponding media control strategy based on the media touch operation.
[0085] As a feasible implementation method, the in-vehicle media control strategy is determined as follows: when the touch operation is a media touch operation on the media touch device, if the current vehicle speed is greater than or equal to the second vehicle speed threshold, a media control command to be processed is generated based on the driver's touch operation on the media touch device, and the media control command to be processed is stored in the command cache area.
[0086] The first vehicle speed threshold can be the same as or different from the second vehicle speed threshold. This application does not limit the specific value of the second vehicle speed threshold; for example, it can be 50 km / h, 60 km / h, 70 km / h, 80 km / h, or 90 km / h. The media control command to be processed includes: a target media control function; and a command buffer used to indicate the determination of the in-vehicle media control strategy based on the media control command to be processed when the current vehicle speed is less than the second vehicle speed threshold. The data storage structure of the command buffer can be a first-in-first-out linear queue or a last-in-first-out stack structure. This application does not limit the data storage structure of the command buffer.
[0087] For example, the second vehicle speed threshold is 50 km / h. At a vehicle speed of 20 km / h, a double-click on the media touchscreen determines the target media control function as playing music, and the in-vehicle media control strategy is to control the vehicle to immediately play music. At a vehicle speed of 60 km / h, a double-click on the media touchscreen generates a media control command to be processed. When the vehicle speed drops to 40 km / h, the in-vehicle media control strategy is determined to control the vehicle to play music.
[0088] When the touch operation is directed at a media touch device, determining whether the current vehicle speed is greater than or equal to a second speed threshold can ascertain whether the vehicle is currently operating at high or low speed, thus mitigating the risk of using media control functions while in the current driving state. If the current vehicle speed is greater than or equal to the second speed threshold, it can be determined that the vehicle is currently operating at high speed. Controlling the vehicle to execute the target media control function at this time could distract the driver. Therefore, by storing the generated pending media control commands in a command buffer, the driver's media touch operation can be recorded first, and the corresponding target media control function can be executed only after the vehicle speed decreases. This avoids the immediate switching of media states distracting the driver's attention from the road.
[0089] As another feasible approach, when the current vehicle speed is less than the second vehicle speed threshold, the target media control function is determined from multiple preset media control functions based on the driver's touch operation on the media touch device, and the vehicle is controlled to determine the in-vehicle media control strategy based on the target media control function.
[0090] If the current vehicle speed is less than the second speed threshold, it can be determined that the vehicle is currently operating at a low to medium speed, requiring less driver attention. In this state, the driver's media touch controls can be responded to quickly, satisfying the driver's entertainment needs and improving the driving experience. Thus, by dividing the media control strategy into two modes—buffered delay and immediate execution—using the second speed threshold, dynamic decoupling of media interaction behavior from vehicle driving risks can be achieved. This allows the driver to pre-set media playback plans via the touch device while driving at high speeds without incurring the risk of distraction during operation. The previous operation commands are automatically executed once the vehicle speed decreases to a safe range.
[0091] As one possible implementation, the target media control function is determined as follows: when the touch operation is a media touch operation targeting a media touch device, the actual media motion trajectory of the media touch operation in the media touch device coordinate system is analyzed; the actual media motion trajectory is corrected based on the steering wheel angle to obtain the target media motion trajectory; the direction of movement of the target media motion trajectory in the vehicle coordinate system is the same as the direction of movement of the actual media motion trajectory in the coordinate system corresponding to the media touch device; based on the target media motion trajectory, the target media control function control indicated by the media touch operation is determined among multiple media control function controls to determine the target media control function corresponding to the target media control function control. For a description of determining the target media control function control, please refer to the description of S3022; this application will not elaborate further.
[0092] In some embodiments, due to differences in drivers' dominant hands, the settings of the media touchscreen and driving touchscreen may be opposite to the drivers' usage habits. Furthermore, drivers may experience fatigue with one hand during long drives and need to switch operating hands. In such cases, if the roles of the media touchscreen and driving touchscreen are interchanged, allowing the media touchscreen to perform the functions of the driving touchscreen and vice versa, the driver's driving experience can be improved. Moreover, if either the media touchscreen or the driving touchscreen malfunctions, the other touchscreen can temporarily take over, allowing the driver to use the functions on the vehicle's infotainment screen.
[0093] As a feasible implementation method, before executing S301 or after executing S303, the vehicle control method may also include: S401, and / or, S402.
[0094] S401. In response to receiving a function proxy operation for the media touch device, control the media touch device to enter the driving control function proxy mode so that the media touch device can be used to trigger the driving control function in the vehicle screen.
[0095] The driving control function proxy mode is used to instruct the updating of the first mapping relationship configured in the media touch device to a second mapping relationship. The first mapping relationship instructs the mapping of the native touch signals generated by the media touch device to media control function controls, and the second mapping relationship instructs the mapping of the native touch signals generated by the media touch device to driving control function controls. In other words, the driver's physical touch operation on the media touch device no longer corresponds to the media control function controls on the vehicle's infotainment screen, but instead directly maps to and triggers the driving control function controls on the vehicle's infotainment screen. For example, if the driver slides the media touch device upwards relative to the steering wheel, the cruise control speed setting value on the vehicle's infotainment screen increases accordingly; if the driver double-clicks the media touch device, the driving assistance system on the vehicle's infotainment screen is activated.
[0096] The driver can switch the driving touchscreen from controlling driving-related functions to controlling media and entertainment functions by performing a function proxy operation. This allows the driver to control the corresponding functions of the media touchscreen in case the media touchscreen malfunctions or if the driver wants to change hands.
[0097] S402, In response to receiving a function proxy operation for the driver touch device, control the driver touch device to be in media function proxy mode so that the driver touch device can be used to trigger media control functions in the vehicle screen.
[0098] The media function proxy mode is used to instruct the updating of the third mapping relationship configured in the driver's touch device to a fourth mapping relationship. The third mapping relationship instructs the mapping of the native touch signals generated by the driver's touch device to the driver control function controls, and the fourth mapping relationship instructs the mapping of the native touch signals generated by the driver's touch device to the media control function controls. In other words, the physical touch operation of the driver's touch device no longer corresponds to the driver control function controls on the vehicle's infotainment screen, but directly maps to and triggers the media control function controls on the vehicle's infotainment screen. For example, if the driver swipes upwards on the driver's touch device relative to the steering wheel, the media volume bar on the vehicle's infotainment screen increases; if the driver swipes left on the driver's touch device relative to the steering wheel, the playlist on the vehicle's infotainment screen switches to the previous song.
[0099] Drivers can perform function proxy operations on the media touch devices, switching them from controlling media and entertainment functions to controlling driving-related functions. In this way, by recognizing specific proxy operation commands, the left and right touch devices can temporarily break through their original functional boundaries, achieving role interchange or function takeover. This allows drivers to reconfigure control resources as needed, catering to different driving habits and preferences, and improving the driving experience.
[0100] In some embodiments, if a driver directly touches the in-vehicle screen to select a desired function while looking at it, it can easily lead to safety hazards due to prolonged distraction from the road. In this case, associating the target function control corresponding to the driver's gaze point with a driving touchscreen or media touchscreen allows the driver to quickly determine the desired function by touching the driving touchscreen or media touchscreen, reducing the time the driver's eyes are off the road and making driving safer.
[0101] As a feasible implementation method, before executing S301 or after executing S303, the vehicle control method also includes: S501-S502.
[0102] S501. When the gaze point is located within the display area, determine the target screen area corresponding to the gaze point on the vehicle screen.
[0103] If the point of gaze is within the display area, it indicates that the driver is looking at the screen. In this case, by determining the target screen area corresponding to the point of gaze on the vehicle's infotainment screen, it is possible to determine exactly which area of the screen and which function icon the driver's gaze is on, thereby establishing a connection between visual attention and screen elements.
[0104] S502. Associate the target function corresponding to the target function control displayed in the target screen area with the driving touch device or media touch device, so that the driver can realize the target function through the driving touch device or media touch device.
[0105] Among them, the target function control is either a driving control function control or a media control function control, and the target function is either a driving control function or a media control function.
[0106] By associating the target function controls displayed in the target screen area with the corresponding target functions of the driver's viewpoint on the driver's or media touchscreen, the driver can control the target function controls simply by operating the touchscreen. This allows the driver to achieve the target function through the touchscreen. In this way, by establishing a rapid pathway from visual to physical control, the convenience of driver operation and driving safety can be improved.
[0107] In some embodiments, after a driver performs a touch operation on the driving touch control and / or media touch control, the driver needs to determine whether the vehicle has responded to the touch operation. Therefore, this can be determined by displaying the target function control selected by the driver on the vehicle's infotainment screen, by voice announcement of the selected target function control, or by controlling steering wheel vibration. This allows the driver to be aware that the vehicle has responded to the touch operation.
[0108] As a feasible implementation method, after executing S303, the vehicle control method also includes: S601, and / or S602, and / or S603.
[0109] S601, in response to receiving a touch operation for a driving touch device and / or a media touch device, display the target function control on the vehicle infotainment screen.
[0110] Among them, the target function control is used to indicate the position of the function control corresponding to the driving control function or media control function indicated by the touch operation on the vehicle screen.
[0111] In response to a touch operation received for the driver's touch control device and / or media touch control device, the system can display the target function control on the vehicle screen and establish a confirmation mechanism that links the touch operation with the visual feedback on the screen. When the driver performs blind operation on the steering wheel, the system provides the driver with an optional visual confirmation channel by highlighting, flashing or dynamically displaying the position of the currently selected function control on the screen, so that the driver can still know the current operation progress by glancing at it with his peripheral vision even when he is not focused on looking at the screen.
[0112] S602, Output prompt voice information; the prompt voice information is used to prompt the driving control function or media control function indicated by the touch operation.
[0113] Outputting prompt voice information can establish a voice feedback channel for touch operation. By broadcasting the name of the currently selected function or status change, the driver can know the operation result without any eye contact.
[0114] S603: Control the vibration of the steering wheel to indicate that driving control or media control functions have been selected.
[0115] Controlling the steering wheel vibration allows drivers to directly perceive operational feedback through touch, confirming the corresponding driving or media control functions for touch operations. This simultaneously triggers a multi-dimensional real-time feedback mechanism, enabling drivers to receive confirmation information through screen highlighting, voice prompts, and steering wheel vibration—either in parallel or in combination—when operating the vehicle's infotainment screen via driving and / or media touch controls. This adapts to different driver preferences and the needs of various driving scenarios.
[0116] The foregoing mainly describes the solutions provided by the embodiments of this application from a methodological perspective. To achieve the above functions, the vehicle control device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0117] This application embodiment can divide the vehicle control device into functional modules according to the above method. For example, the vehicle control device may include functional modules corresponding to each functional division, or two or more functions may be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. The module division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.
[0118] Reference Figure 7 The vehicle control device is applied to a vehicle. The vehicle's steering wheel is equipped with a driving touch control device and a media touch control device. The driving touch control device is used to trigger driving control functions on the vehicle's infotainment screen, and the media touch control device is used to trigger media control functions on the vehicle's infotainment screen. The vehicle control device includes a response module 701, a gaze point determination module 702, a strategy determination module 703, and a strategy execution module 704.
[0119] The response module 701 is used to respond to receiving a touch operation for a driving touch device or a media touch device.
[0120] The gaze point determination module 702 is used to determine whether the driver's gaze point is located within the display area of the vehicle's infotainment screen.
[0121] The strategy determination module 703 is used to determine the corresponding driving control strategy or in-vehicle media control strategy based on the vehicle's current speed and touch operation when the gaze point is not located within the display area.
[0122] The strategy execution module 704 is used to execute driving control strategies or in-vehicle media control strategies.
[0123] In some embodiments, the vehicle control device further includes a control determination module.
[0124] The control determination module is used to determine the multiple driving control function controls displayed on the vehicle screen based on the vehicle's current speed when the touch operation is a driving touch operation for the driving touch device.
[0125] The control determination module is also used to determine the target driving control function control indicated by the driving touch operation among multiple driving control function controls based on the driving touch operation.
[0126] The strategy determination module is used to determine the driving control strategy based on the target driving control function corresponding to the target driving control function control.
[0127] In some embodiments, the vehicle control device further includes a function display module.
[0128] The function display module is used to display the driving control function controls corresponding to all driving control functions supported by the vehicle on the vehicle screen when the current vehicle speed is less than the first vehicle speed threshold, so that the driver can trigger any driving control function based on the driving touch device.
[0129] The function display module is also used to display the driving control function controls corresponding to the candidate driving control functions on the vehicle screen when the current vehicle speed is greater than or equal to the first vehicle speed threshold, so that the driver can trigger any candidate driving control function based on the driving touch device; the candidate driving control function is the driving control function with a priority greater than or equal to the preset priority threshold among all driving control functions.
[0130] In some embodiments, the vehicle control device further includes: an instruction generation module and a function determination module; The instruction generation module is used to generate a media control instruction to be processed based on the driver's touch operation on the media touch device when the current vehicle speed is greater than or equal to a second vehicle speed threshold, and to store the media control instruction to be processed in the instruction cache queue; wherein, the media control instruction to be processed includes: the target media control function instruction cache queue is used to indicate the determination of the vehicle media control strategy based on the media control instruction to be processed when the current vehicle speed is less than the second vehicle speed threshold.
[0131] The function determination module is used to determine the target media control function from multiple preset media control functions based on the driver's touch operation on the media touch device when the current vehicle speed is less than the second vehicle speed threshold, and to control the vehicle to determine the in-vehicle media control strategy based on the target media control function.
[0132] In some embodiments, the vehicle control device further includes a trajectory parsing module and a trajectory determination module.
[0133] The trajectory analysis module is used to analyze the actual motion trajectory of the driving touch operation in the coordinate system of the driving touch device when the touch operation is a driving touch operation for the driving touch device.
[0134] The trajectory determination module corrects the actual motion trajectory based on the steering wheel angle to obtain the target motion trajectory. The direction of the target motion trajectory in the vehicle coordinate system is the same as the direction of the actual motion trajectory in the coordinate system corresponding to the driving touch control device. The control determination module determines the target driving control function control indicated by the driving touch operation among multiple driving control function controls based on the target motion trajectory.
[0135] In some embodiments, the vehicle control device further includes a function proxy control module.
[0136] The response module is used to respond to received function proxy operations for media touch devices.
[0137] The function proxy control module is used to control the media touch device to be in the driving control function proxy mode, so that the media touch device can be used to trigger the driving control function on the vehicle screen.
[0138] The response module is also used to respond to received function proxy operations for the driving touch device.
[0139] The function proxy control module is also used to control the driver's touch device to be in media function proxy mode so that the driver's touch device can be used to trigger media control functions on the vehicle screen.
[0140] In some embodiments, the vehicle control device further includes a screen area determination module and a function association module.
[0141] The screen area determination module is used to determine the target screen area corresponding to the gaze point in the vehicle screen when the gaze point is located within the display area.
[0142] The function association module is used to associate the target function control displayed in the target screen area with the target function of the driving touch device or media touch device, so that the driver can realize the target function through the driving touch device or media touch device; wherein, the target function control is the driving control function control or media control function control, and the target function is the driving control function or media control function.
[0143] In some embodiments, the vehicle control device further includes a voice output module and a vibration control module.
[0144] A response module for responding to a received touch operation on a driving touch device and / or a media touch device.
[0145] The function display module is used to display the target function control on the vehicle screen. The target function control is used to indicate the position of the function control corresponding to the driving control function or media control function indicated by the touch operation on the vehicle screen.
[0146] The voice output module is used to output prompt voice information; the prompt voice information is used to prompt the driving control function or media control function indicated by the touch operation.
[0147] The vibration control module is used to control the vibration of the steering wheel to indicate that a driving control function or media control function has been selected.
[0148] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0149] In an exemplary embodiment, this application also provides a computing device, which may include a processor and a memory. The processor may be a computing cluster composed of multiple computing nodes, and the memory may adopt a distributed memory architecture. The processor integrated in the computing device is configured to execute the vehicle control method of any of the above embodiments.
[0150] Figure 8 This is a schematic diagram of the architecture of a vehicle control device provided in an embodiment of this application. Figure 8 As shown, the vehicle control device includes: one or more memories 820, one or more processors 810, a communication bus 840, and a communication interface 830. The processors 810 and memories 820 are connected via the communication bus 840; the one or more memories 820 are used to store computer program code, which includes computer instructions; when the one or more processors 810 execute the computer instructions, the computing device performs the vehicle control method provided in this application embodiment.
[0151] Optionally, the memory 820 may be a non-transitory computer-readable storage medium, such as a read-only memory (ROM), random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc., and the embodiments of this application do not impose any restrictions on this.
[0152] The processor 810 may be a central processing unit (CPU), a general-purpose processor, a network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD), or any combination thereof, and the embodiments of this application do not impose any limitations on this.
[0153] The communication bus 840 can be an industry standard architecture (ISA) bus, a peripheral component interconnect (PCI) bus, or an extended industry standard architecture (EISA) bus, etc. This communication bus 840 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 It is represented by a single thick line, but this does not mean that there is only one bus or one type of communication bus.
[0154] The communication interface 830 uses any transceiver-like device for communicating with other devices or communication networks, such as control systems, radio access networks (RAN), wireless local area networks (WLAN), etc.
[0155] This application also provides a computer-readable storage medium. All or part of the processes in the above method embodiments can be executed by computer instructions instructing related hardware; for example, the related hardware can be a processor of a computing device. The program instructions can be stored in the above-mentioned computer-readable storage medium, and when executed, the processes of the above method embodiments can be implemented. The computer-readable storage medium can be memory. The above-mentioned computer-readable storage medium can also be an external storage device, such as a hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc. Further, the above-mentioned computer-readable storage medium can include both memory and external storage devices. The above-mentioned computer-readable storage medium is used to store the above-mentioned computer program instructions and other programs and data required by the above-mentioned vehicle control method.
[0156] This application also provides a vehicle that includes a vehicle control device, which can be used to perform the methods described in the above embodiments.
[0157] Although this application has been described herein in conjunction with various embodiments, those skilled in the art, by reviewing the accompanying drawings, disclosure, and appended claims, will understand and implement other variations of the disclosed embodiments in carrying out the claimed application. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple instances. A single processor or other unit can implement several functions listed in the claims. While different dependent claims may recite certain measures, this does not mean that these measures cannot be combined to produce good results.
[0158] Although this application has been described in conjunction with specific features and embodiments, it is obvious that various modifications and combinations can be made thereto without departing from the spirit and scope of this application. Accordingly, this specification and drawings are merely illustrative descriptions of the application as defined by the appended claims, and are considered to cover any and all modifications, variations, combinations, or equivalents within the scope of this application. Clearly, those skilled in the art can make various alterations and modifications to this application without departing from the spirit and scope of this application. Thus, if such modifications and modifications fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and modifications.
[0159] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A vehicle control method, characterized in that, Applied to vehicles, the vehicle's steering wheel is equipped with a driving touch control device and a media touch control device. The driving touch control device is used to trigger driving control functions on the vehicle's infotainment screen, and the media touch control device is used to trigger media control functions on the vehicle's infotainment screen. The vehicle control method includes: In response to receiving a touch operation for the driving touch device or the media touch device, determine whether the driver's gaze point is located within the display area of the vehicle screen; If the gaze point is not located within the display area, a corresponding driving control strategy or in-vehicle media control strategy is determined based on the vehicle's current speed and the touch operation. Execute the driving control strategy or the in-vehicle media control strategy.
2. The vehicle control method according to claim 1, characterized in that, When the touch operation is a driving touch operation targeting the driving touch control device, a corresponding driving control strategy is determined based on the vehicle's current speed and the touch operation, including: Based on the vehicle's current speed, determine the multiple driving control function controls displayed on the vehicle's infotainment screen; Based on the driving touch operation, determine the target driving control function control indicated by the driving touch operation among the plurality of driving control function controls; The driving control strategy is determined based on the target driving control function corresponding to the target driving control function control.
3. The vehicle control method according to claim 2, characterized in that, The step of determining multiple driving control function controls displayed on the vehicle's infotainment screen based on the vehicle's current speed includes: When the current vehicle speed is less than the first vehicle speed threshold, the vehicle screen displays driving control function controls corresponding to all driving control functions supported by the vehicle, so that the driver can trigger any driving control function based on the driving touch device. When the current vehicle speed is greater than or equal to the first vehicle speed threshold, the vehicle screen displays the driving control function controls corresponding to the candidate driving control functions, so that the driver can trigger any candidate driving control function based on the driving touch device; the candidate driving control function is the driving control function with a priority greater than or equal to a preset priority threshold among all the driving control functions.
4. The vehicle control method according to claim 1, characterized in that, When the touch operation is a media touch operation targeting the media touch device, a corresponding in-vehicle media control strategy is determined based on the vehicle's current speed and the touch operation, including: When the current vehicle speed is greater than or equal to the second vehicle speed threshold, a media control instruction to be processed is generated based on the driver's touch operation on the media touch device, and the media control instruction to be processed is stored in the instruction cache queue; wherein, the media control instruction to be processed includes: target media control function, and the instruction cache queue is used to indicate the determination of the in-vehicle media control strategy based on the media control instruction to be processed when the current vehicle speed is less than the second vehicle speed threshold; When the current vehicle speed is less than the second vehicle speed threshold, the target media control function is determined from multiple preset media control functions based on the driver's touch operation on the media touch device, and the vehicle is controlled to determine the in-vehicle media control strategy based on the target media control function.
5. The vehicle control method according to claim 2, characterized in that, The step of determining the target driving control function control indicated by the driving touch operation among the plurality of driving control function controls based on the driving touch operation includes: When the touch operation is a driving touch operation for the driving touch device, the actual motion trajectory of the driving touch operation in the coordinate system of the driving touch device is analyzed; The actual motion trajectory is corrected based on the steering wheel angle to obtain the target motion trajectory; the direction of motion of the target motion trajectory in the vehicle coordinate system is the same as the direction of motion of the actual motion trajectory in the coordinate system corresponding to the driving touch device. Based on the target motion trajectory, the target driving control function control indicated by the driving touch operation is determined among the plurality of driving control function controls.
6. The vehicle control method according to any one of claims 1-5, characterized in that, The vehicle control method further includes: In response to receiving a function proxy operation for the media touch device, the media touch device is controlled to enter a driving control function proxy mode, so that the media touch device is used to trigger driving control functions in the vehicle screen; and / or; In response to receiving a function proxy operation for the driving touch device, the driving touch device is controlled to enter a media function proxy mode so that the driving touch device can be used to trigger media control functions in the vehicle screen.
7. The vehicle control method according to any one of claims 1-5, characterized in that, The vehicle control method further includes: When the gaze point is located within the display area, the target screen area corresponding to the gaze point in the vehicle screen is determined; The target function corresponding to the target function control displayed in the target screen area is associated with the driving touch device or the media touch device, so that the driver can realize the target function through the driving touch device or the media touch device; wherein, the target function control is the driving control function control or the media control function control, and the target function is the driving control function or the media control function.
8. The vehicle control method according to any one of claims 1-5, characterized in that, The vehicle control method further includes: In response to receiving a touch operation for the driving touch device and / or the media touch device, The target function control is displayed on the vehicle screen, and the target function control is used to indicate the position of the function control corresponding to the driving control function or media control function indicated by the touch operation on the vehicle screen; and / or; Output prompt voice information; the prompt voice information is used to prompt the driving control function or media control function indicated by the touch operation; and / or; The steering wheel is vibrated to indicate that the driving control function or the media control function has been activated.
9. A vehicle control device, characterized in that, Applied to vehicles, the vehicle's steering wheel is equipped with a driving touch control device and a media touch control device. The driving touch control device is used to trigger driving control functions on the vehicle's infotainment screen, and the media touch control device is used to trigger media control functions on the vehicle's infotainment screen. The vehicle control device includes: a response module, a gaze point determination module, a strategy determination module, and a strategy execution module. The response module is configured to respond to receiving a touch operation on the driving touch device or the media touch device; The gaze point determination module is used to determine whether the driver's gaze point is located within the display area of the vehicle screen; The strategy determination module is used to determine a corresponding driving control strategy or in-vehicle media control strategy based on the vehicle's current speed and the touch operation when the gaze point is not located within the display area. The strategy execution module is used to execute the driving control strategy or the in-vehicle media control strategy.
10. The vehicle control device according to claim 9, characterized in that, The vehicle control device further includes: a control determination module; The control determination module is used to determine, based on the current vehicle speed, multiple driving control function controls displayed on the vehicle screen when the touch operation is a driving touch operation for the driving touch device. The control determination module is further configured to determine, based on the driving touch operation, the target driving control function control indicated by the driving touch operation among the plurality of driving control function controls; The strategy determination module is used to determine the driving control strategy based on the target driving control function corresponding to the target driving control function control.
11. The vehicle control device according to claim 10, characterized in that, The vehicle control device also includes: a function display module; The function display module is used to display driving control function controls corresponding to all driving control functions supported by the vehicle on the vehicle screen when the current vehicle speed is less than the first vehicle speed threshold, so that the driver can trigger any driving control function based on the driving touch device. The function display module is also used to display driving control function controls corresponding to candidate driving control functions on the vehicle screen when the current vehicle speed is greater than or equal to the first vehicle speed threshold, so that the driver can trigger any candidate driving control function based on the driving touch device; the candidate driving control function is the driving control function with a priority greater than or equal to a preset priority threshold among all driving control functions.
12. A vehicle, characterized in that, The vehicle includes a steering wheel equipped with a driving touch control device and a media touch control device, and a vehicle control device as described in any one of claims 9-11.