Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

98 results about "Driver Distractions" patented technology

Distracted driving is the act of driving while engaged in other activities that take the driver's attention away from the road. All distractions compromise the safety of the driver, passengers, bystanders and those in other vehicles.

Inside cabin sensor system

An inside cabin sensor system, having an integrated, single hardware part comprising a camera sub-system and an integrated radar sub-system is proposed. A proposed system provides related information for covering the following applications inside a vehicle: Child Presence Detection (CPD), Driver Drowsiness & Fatigue (F), Driver Distraction (DD) as a safety-relevant function, complemented by Intrusion & Proximity Alert (IPA), Seat Occupancy Detection (SOD), Face Recognition (FR), and optional applications such as Driver Emotion (ES), Passenger Classification (PC), Airbag Suppression (AS), Airbag Activation (AA), Mobile Phone Detection (MP), Gesture Detection (GD) and Vital Signs Detection (VS). A proposed system utilizes Artificial Intelligence (AI)-related data processing for data processing, using radar point cloud data, calculated by said radar sensors. The proposed system utilizes Artificial Intelligence (AI)-related data processing for data processing, using video-captured data. The proposed system utilizes Artificial Intelligence (AI) -related data processing for sensor data fusion, using radar sensor and video sensor data.
Owner:NOVELIC DOO BEOGRAD-ZVEZDARA

Attention reminding algorithm based on multi-mode intelligent driving

PendingCN121341186AActive safetySensor array
The invention discloses an attention reminding algorithm for intelligent driving based on multiple modes, and relates to the technical field of intelligent driving and active safety, and the algorithm comprises the steps: firstly, collecting data in real time through a multi-mode sensor group, carrying out the alignment, and then calculating the quantization features, such as the fixation deviation degree, the steering wheel disturbance entropy and the heart rate variability; then, mapping scores by adopting an S-type function, analyzing a historical sequence by utilizing a long short-term memory network to generate a dynamic weight, and performing adjustment and weighted calculation on a single-mode score in combination with an environment complexity weight to obtain a comprehensive attention score; and finally, according to the continuous driving duration, calculating a linear decreasing dynamic reminding threshold value, executing dual logic judgment in combination with the environmental risk level, and triggering graded feedback through sound and light or vibration. According to the method, the problems of poor adaptability and high false alarm rate of traditional single-mode monitoring in a dynamic environment are effectively solved, the robustness of the system is improved, and adaptive evaluation and accurate early warning of driver distraction behaviors in a complex scene are realized.
Owner:CHINA FAW CO LTD +1

Vehicle-mounted intelligent service pushing method and device, vehicle and storage medium

The invention relates to a vehicle-mounted intelligent service pushing method and device, a vehicle and a storage medium. Comprising the steps of obtaining a current state, a current position and current sensing data of a vehicle; calculating a current security score according to the current state data, the current position data and the current perception data, and determining a current security level according to at least one of the current state data, the current perception data and the current security score; under the condition that the current security level reaches a service pushing level, determining a pushable service type and a pushable content form according to the current security level, calculating the value of each service in the pushable service type, and determining target pushing content according to the value of each service and the pushable content form based on the current security level, and pushing the target push content to the user. Therefore, the problem that the service pushing opportunity is not matched with the driving safety requirement and the actual scene of the user in the related technology is solved, the risk that the driver is distracted to drive is reduced, and the experience feeling of the user is improved.
Owner:BEIJING CAVAN NEW ENERGY AUTOMOTIVE CO LTD

Suspension touch method, device and equipment for vehicle-mounted screen

The invention provides a floating touch method, device and equipment for a vehicle-mounted screen, and is applied to the technical field of man-machine interaction. The method comprises the steps that when the vehicle-mounted screen is in a floating touch mode, the positioning position of a pointer on the vehicle-mounted screen is determined according to tracking information for the hand of a user. And judging whether the control is an effective control or not according to the positioning position and the suspension time of the pointer on the control at the positioning position. And under the condition that the control is determined to be the effective control, generating a to-be-executed operation instruction according to the operation action executed by the hand of the user. According to the current state information of the vehicle, whether the to-be-executed operation instruction is in the safe execution environment or not is judged so as to determine whether the to-be-executed operation instruction is executed or not, and the problems of low operation precision, high driver distraction risk and insufficient safety in the driving environment in a traditional interaction scheme can be solved.
Owner:CHERY AUTOMOBILE CO LTD

A lightweight driver distraction detection method based on CNN and ViL

This invention discloses a lightweight driver distraction behavior detection method based on CNN and ViL, belonging to the field of driver distraction detection. It constructs a hybrid model combining a Convolutional Neural Network (CNN) and a Visual Long Short-Term Memory (ViL) network for driver distraction behavior detection. The hybrid model performs five stages of processing. In the first two stages, local feature extraction is mainly performed. The DEC module is used to extract and downsample local features, while the PDC module further enriches the extracted local features. In the last three stages, the MlgViL module is used to process and fuse local and global information. This invention efficiently fuses local and global information, preserving fine-grained local information while capturing global contextual information, thus improving the overall performance of the model and achieving high accuracy and real-time performance with limited computing resources.
Owner:SHANDONG UNIV OF SCI & TECH

A driver distraction intervention system based on driver state and vehicle operation monitoring

The application discloses a driving distraction intervention system based on a driver state and vehicle operation monitoring, which comprises a driver state information acquisition module, a vehicle operation state information acquisition module, an information processing module, a distraction state judgment module and an intervention information output module; the driver state information acquisition module acquires the state information of the driver; the vehicle operation state information acquisition module acquires the vehicle operation state information; the information processing module obtains a visual buffer time and a driving stability value according to the driver state information and the vehicle operation state information; the distraction state judgment module calculates the state parameters of the distraction state of the driver according to the result of the information processing module to judge the distraction state grade corresponding to the real-time state of the driver; and the intervention information output module provides the corresponding preset distraction intervention information to the driver according to the distraction state grade of the driver obtained by the distraction state judgment module. The application can help the driver to restore the normal driving state and improve the driving safety.
Owner:HEFEI UNIV OF TECH

Compute system with driver distraction detection mechanism and method of operation thereof

A method of operation for a compute system comprising: monitoring a phone sensor array to detect a trigger; calculating a position of a cell phone based on the trigger and sensor data from the phone sensor array; predicting a driver distraction event by analyzing the sensor data and the position of the cell phone; compiling a driver distraction evaluation based on the driver distraction event and a sensor data packet from an in-vehicle sensor array; generating a distraction rating for display on a device based on the driver distraction evaluation.
Owner:TELENAV INC

Method and system for situation-dependently handling an interaction of a driver with an infotainment system

The invention relates to a method and a system for situation-dependently handling an interaction of a driver (10) with an infotainment system of a moving vehicle, in which method and system content which is distracting for the driver (10) is identified and, as a result, is intended to be transferred to a passenger (12). For this purpose, it is checked whether the passenger (12) themselves is already interacting with the infotainment system and the transfer to them is implemented on the basis thereof.
Owner:VOLKSWAGEN AG

Automobile information interaction display method, vehicle and storage medium

The invention relates to the technical field of man-machine interaction, and provides an automobile information interaction display method and a storage medium, when a target display mode is considered, comprehensive analysis is carried out by fusing one or more types of target data, the scene adaptation degree of each preset display mode to a current driving scene is dynamically evaluated, and the display effect of the current driving scene is improved. Based on comprehensive analysis of multi-source information, intelligent collaboration and dynamic self-adaption of information display are carried out by effectively combining driving scenes, information priorities and user requirements, so that the driving safety and the situation awareness ability are comprehensively improved, highly-personalized intelligent man-machine interaction is realized, distraction and cognitive loads of drivers are reduced, and the driving experience is improved. And the driving safety is improved.
Owner:FORYOU GENERAL ELECTRONICS

Method for distraction driver detection and alert

A method (400) for distraction driver detection and alert includes receiving vehicle speed data (20) from one or more wheel speed sensors (122) disposed on a vehicle (105), and receiving proximity data from one or more proximity sensors disposed on the vehicle, the proximity data indicating a distance (32) of the vehicle relative to any object in front of the vehicle. The method also includes executing a distracted driver detection algorithm (300) that uses the vehicle speed data and the proximity data to determine that the vehicle is interrupting the stop-time traffic flow and that a driver of the vehicle is distracted from operating the vehicle. The method includes instructing a system (270) of the vehicle to output an alert to reengage a driver based on determining that the vehicle is interrupting the stop-time traffic flow and the driver of the vehicle is distracted.
Owner:KARMA AUTOMOTIVE LLC

Storage unit that attaches to bicycle handlebars

The present invention aims to provide a storage unit that can be attached to a bicycle handlebar, allowing for the storage of a smartphone while simultaneously preventing distracted driving. [Structure] To achieve the above objectives, the present invention: Firstly, a storage unit for bicycle handlebars is attached to the handlebars at the center of the handlebars by fastening means such as screws at the mounting point, with a storage compartment protruding from the mounting point toward the rider, the storage compartment being opened and closed with a lid, and the horizontally elongated storage compartment being a storage space for storing a smartphone horizontally. The above is my proposal.
Owner:桥爪英弥

Driver distraction area boundary acquisition method and vehicle

The embodiment of the invention provides a driver distraction area boundary acquisition method, so as to accurately acquire a driver distraction area boundary, the method comprises the following steps: acquiring multi-view scanning data acquired by a depth camera for a cockpit, a plurality of diffuse reflection mark points being preset in a distraction attention area in the cockpit; based on the scanning data, performing three-dimensional reconstruction to obtain a cockpit three-dimensional model, and obtaining a first three-dimensional coordinate of each mark point in a depth camera coordinate system; based on a calibration plate in a common visual field of the two cameras, joint calibration is performed on the depth camera and the driver monitoring system camera, and a conversion relation from a depth camera coordinate system to a driver monitoring system camera coordinate system is established; according to the conversion relation, converting the first three-dimensional coordinates of the mark points into a camera coordinate system of a driver monitoring system to obtain second three-dimensional coordinates; and based on the second three-dimensional coordinates, determining distraction boundary information of the distraction region of interest in a camera coordinate system of the driver monitoring system.
Owner:GREAT WALL MOTOR CO LTD

Driver distraction early warning device suitable for industrial vehicle and industrial vehicle

The invention relates to the field of industrial vehicle hardware design, in particular to equipment structure optimization for monitoring the safety state of a driver of a vehicle. According to the technical scheme, the driver distraction early warning device suitable for the industrial vehicle comprises a vehicle connecting opening used for being connected with the industrial vehicle, a connecting rod connected with the vehicle connecting opening and a feature collecting module connected with the connecting rod, a mounting disc is rotationally connected to the connecting rod, and the feature collecting module is connected with the mounting disc. The mounting disc comprises a base disc and a moving disc in sliding connection with the base disc, the special acquisition module comprises a plurality of acquisition monomers mounted on the surface of the moving disc, and each acquisition monomer comprises a sensor. The invention aims to provide a driver distraction early warning device suitable for an industrial vehicle and the industrial vehicle. Flexible adjustment can be carried out according to heights and sitting postures of different drivers, and the recognition accuracy and universality are improved; the visual angle is wide and accurate, and targets are not easy to lose.
Owner:NOBLEELEVATOR INTELLIGENT EQUIP CO LTD +1

Driving force feedback distribution control system and method based on six-sense tactile sense

The invention discloses a driving force feedback distribution control system and method based on six-sense tactile sense, and relates to the field. Comprising an environment sensing module which is used for collecting obstacle information and road information around a vehicle and outputting an environment threat coefficient; the driver state monitoring module is used for detecting the hand position, the grip strength and the sight line direction of a driver and calculating the distraction degree of the driver; the central processing module is used for fusing environment and driver data and generating intensity and mode instructions of each tactile feedback point through a weight distribution algorithm; and the force feedback execution module comprises tactile generators distributed at a plurality of positions of the cockpit, and outputs vibration, pressure or temperature feedback according to instructions. The method has the advantages that the intuitionism and timeliness of danger perception and positioning are improved, the individuation and adaptive optimization of human-computer interaction are realized, and the dimension and robustness of information transmission are enhanced.
Owner:YOUNG FRIENDS (BEIJING) TECHNOLOGY HOLDINGS CO LTD

In-transit collaborative navigation method and system based on visual real-time search

The invention discloses an in-transit collaborative navigation method and system based on visual real-time search, and relates to the technical field of intelligent cabins and man-machine interaction. According to the method, visual gazing data are collected in real time through a passenger end wearable device, space coordinate transformation is carried out in combination with vehicle positioning, and the visual gazing data are acquired in real time; and accurately locking the target interest point watched by the passenger in the three-dimensional map by using a ray projection technology. And the system background immediately calculates the travel time increment after the target interest point is set as the approach point, and generates a navigation modification suggestion in combination with the identity of the initiator. Navigation modification suggestions are presented on a vehicle-mounted interface in a floating window mode, after voice or touch confirmation, the system automatically executes node insertion and sequence recombination of navigation tasks, and an engine is called to dynamically re-plan a path. According to the method, WYSIWYG visual interaction is realized, the potential safety hazards that passengers are difficult to accurately describe places and drivers are distracted to operate are solved, and the cabin cooperation efficiency is improved.
Owner:CHINA FAW CO LTD +1

Wearable interactive hardware equipment

The invention discloses wearable interaction hardware equipment, and relates to the technical field of man-machine interaction. S1, equipment wearing and setting; s2, reporting contact information; s3, automatically replying the voice message; s4, performing voice reply by the user; and S5, traffic light pause state notification. According to the wearable interaction hardware equipment, a user does not need to hold a mobile phone to check or edit messages, distracted driving is avoided through voice interaction of a Bluetooth headset, the traffic accident risk is reduced, meanwhile, road congestion caused by distraction of a driver is reduced, and timely transmission of emergency messages and delayed processing of non-emergency messages are ensured through emergency feature word recognition; not only are important cooperation or help information not missed, but also normal driving is not interfered, the non-emergency message is automatically replied and the optimal contact time is informed, the communication cost of a user is reduced, and the non-emergency message is broadcasted and replied on the premise of ensuring sufficient time in combination with a traffic light pause state, so that the message processing efficiency is improved, and message accumulation is avoided.
Owner:SHENZHEN YIDAO DIGITAL TECHNOLOGY R&D CO LTD

Inferring Operator Characteristics from Device Motion Data

PendingUS20260175849A1Driver/operatorEngineering
Raw sensor data from a device of a user is collected. The raw data does not include location data for the device. The data is preprocessed to identify driving trips in which the user had the device. The trip data is provided to machine-learning models (MLMs) as input and the MLMs provide as output predictions for each trip's estimated speeds, estimated number of hard brakes and a degree of each hard brake, and estimated degrees of distracted driving. A duration, time of day, and calendar date of each trip is identified. The predictions, duration, time of day, and calendar date are modified into four factor values. The four modified factor values are combined into an overall driver characteristic value and provided to a network service associated with the user for purposes of providing or modifying services provided to the user through the network service based on the overall characteristic value.
Owner:CARET HOLDINGS INC

Low-light driver distraction detection method based on target and keypoint detection

This invention discloses a low-light driver distraction detection method based on target and keypoint detection. The method extracts driver video sequences into images and performs illumination enhancement on these images to increase their brightness. After obtaining the high-brightness driver images, a YOLOv7-based joint target and keypoint detection network is used to identify the driver's face and its keypoints, the telephone and its keypoints, and the water cup and its keypoints. After obtaining the keypoint and target information, the driver's facial pose is calculated based on the face and its keypoint information to determine whether the driver is experiencing cognitive, visual, or mixed distraction. This invention achieves low-light driver distraction detection with a simple and flexible implementation method, effectively solving the problem of insufficient driver images in low-light conditions and improving the accuracy of distraction detection.
Owner:ZHEJIANG UNIV

A method, device, equipment, and vehicle for child safety protection in vehicles.

This application provides a method, device, equipment, and vehicle for child safety protection in vehicles, belonging to the field of vehicle technology. The embodiments of this application can control the child safety lock and child seat buckle to be in a locked state while the vehicle is in motion, preventing children from unfastening their seat belts. Furthermore, when a child attempts to unfasten their seat belt or cries and pulls on the inner door handle, the application can automatically trigger a corresponding safety alarm strategy based on the number of buckle actions and / or the number of inner door handle actions, providing appropriate comfort or alarm measures to the child, preventing driver distraction, and effectively ensuring the driving safety of both the driver and the child.
Owner:GREAT WALL MOTOR CO LTD

Haptic feedback method and vehicle

This application provides a haptic feedback method and vehicle, applied in the field of vehicle human-machine interaction technology. The method includes: responding to a user's touch operation on a display screen; acquiring functional attribute information of a target button corresponding to the touch operation, the functional attribute information including the button's danger level and / or importance level; determining a target haptic feedback mode and an initial haptic feedback intensity corresponding to the target haptic feedback mode based on the target button's functional attribute information; acquiring vehicle context information, the vehicle context information including at least one of vehicle operating status information, environmental information, and occupant information; correcting the initial haptic feedback intensity based on the vehicle context information to obtain a target haptic feedback intensity; and executing haptic feedback based on the target haptic feedback intensity. This application can effectively reduce the time the driver's gaze remains on the display screen, reduce the risk of driver distraction, and thus significantly improve driving safety and human-machine interaction experience.
Owner:GREAT WALL MOTOR CO LTD

A road profile warning induction lamp and system with breathing flashing mode

This utility model relates to the field of road traffic safety technology, specifically to a road contour warning and guidance light and system with a breathing flashing mode. The system consists of multiple guidance devices installed at intervals, each device including a light-transmitting cover, a light-emitting diode (LED), a control component, a power supply module, and mounting components. Addressing the problems of driver distraction caused by the instantaneous flashing of a single light in existing technologies, and the high energy consumption and short equipment lifespan caused by square wave control signals, this system uses pulse width modulation (PWM) technology to control the brightness of the LED, simulating a breathing rhythm to achieve a gradual brightening and dimming effect. Specifically, a microcontroller generates a PWM signal and adjusts the duty cycle to slowly increase and decrease the brightness within the cycle, forming a soft, gradual sinusoidal PWM signal. This system can enhance the visibility of road contours at night and in inclement weather, reduce visual stimulation, improve driving comfort and safety, and simultaneously reduce energy consumption and extend the lifespan of the light source through dynamic brightness adjustment.
Owner:SICHUAN COMM SURVEYING & DESIGN INST CO LTD

Driver status detection device, driver status detection method, and program

To more accurately detect the driver's condition. [Solution] The driver state detection device of the embodiment includes a recognition unit that recognizes at least one of the gaze or face direction of the driver of a moving object, and a determination unit that determines whether the driver is driving while distracted based on the recognition result of the recognition unit and a distraction determination condition. The determination unit makes a determination of distracted driving using a first distraction determination condition when the turning of the moving object is not predicted or the moving object is not turning, and makes a determination of distracted driving using a second distraction determination condition when the turning of the moving object is predicted or the moving object is turning. When the determination unit determines whether the moving object is turning, it changes the turning determination condition for determining whether the moving object is turning depending on whether the turning direction of the moving object is left or right.
Owner:HONDA MOTOR CO LTD

Method of controlling vehicle operation, system for implementing the same, and vehicle

To enable an occupant other than a driver to access a vehicle system while reducing the risk of distraction of the driver or the risk of the occupant other than the driver being exposed to an inappropriate content.SOLUTION: A vehicle includes a non-transitory computer readable medium configured to store instructions thereon. The vehicle further includes a processor connected to the non-transitory computer readable medium. The processor is configured to execute the instructions for detecting an input from an occupant other than a driver of the vehicle. The processor is configured to execute the instructions for determining whether the input is a request for an improper action. The processor is configured to execute the instructions for notifying the driver of the request in response to a determination that the input is the request for the improper action. The processor is configured to execute the instructions for executing the improper action in response to receiving approval from the driver following the notifying of the driver.SELECTED DRAWING: Figure 1
Owner:TOYOTA JIDOSHA KK

Apparatuses, systems and methods for determining distracted drivers associated with vehicle driving routes

Apparatuses, systems and methods are provided for determining vehicle driver distractions. More particularly, apparatuses, systems and methods are provided for receiving, via a vehicle interior data receiving module, vehicle interior data from at least one vehicle interior sensor, wherein the vehicle interior data is representative of an initial position of a body of at least one vehicle occupant; tracking, via a body tracking module, changes in the body of the at least one vehicle occupant from the initial position of the body; and predicting, via a driver action prediction module, one or more driver actions based at least on the changes in the body of the at least one vehicle occupant.
Owner:STATE FARM MUTAL AUTOMOBILE INSURANCE COMPANY

Vehicle social contact assisting method and device

The invention discloses a vehicle social contact assisting method and device, and the method comprises the steps: determining a target vehicle which is in near-field connection with a vehicle in a target range when the vehicle is in a weak network connection state, and receiving the social contact information sent by the target vehicle; obtaining driving information of the vehicle; and according to the driving information, push display processing of the social information by the vehicle is determined. Thus, even if the vehicle is in the weak network connection state, the vehicle can still stably obtain the social information, and service continuity is guaranteed. Through a driving safety strategy, social information display opportunity and an interaction mode are reasonably controlled, distraction of a driver is avoided, and driving safety and social demands are balanced.
Owner:VOYAH AUTOMOBILE TECH CO LTD

Anti-rollover mechanism of three-wheel all-terrain vehicle and control method

The invention discloses an anti-rollover mechanism of a three-wheel all-terrain vehicle and a control method. The mechanism comprises a mounting assembly, a balancing weight and a driving assembly. The mounting assembly comprises an inclination sensor and a sliding rail, and the inclination sensor and the sliding rail are both fixedly arranged on the frame; the balancing weight is movably arranged on the sliding rail; the driving assembly comprises screws and a motor, the screws are arranged in the axial direction of the sliding rail, the motor is a two-way motor and fixedly arranged on the frame, the two ends of the motor are connected with the screws and can drive the screws to rotate, and the screws are in threaded connection with balancing weights. By means of the rollover prevention mechanism of the three-wheel all-terrain vehicle, when the vehicle rolls laterally, an instruction can be rapidly sent out through the inclination sensor, and the gravity center of the vehicle is changed through movement of the balancing weight, so that the vehicle is helped to be stable and balanced, the stability of the three-wheel vehicle passing through a rugged road surface is greatly improved, a driver does not need to distract to operate, and the driving safety is improved. And driving can be focused, so that the driving safety is further improved.
Owner:CHONGQING HAOCHEN MASCH CO LTD

Mobile terminal remote control method and device based on interface visual understanding, equipment and medium

The invention relates to the technical field of intelligent cabin interaction, and discloses a mobile terminal remote control method and device based on interface visual understanding, equipment and a medium. The method comprises the following steps: firstly, acquiring multi-mode context information in a vehicle driving process, acquiring a screen interface image of the mobile terminal through a mirror image link, visually identifying UI elements by a vehicle terminal GUI large model, fusing the context information, generating an operation task and an instruction sequence, and controlling the mobile terminal to execute corresponding functions. A screen interface image is obtained by establishing a mirror image link between a vehicle-mounted terminal and a mobile terminal, interface UI element types and position information are analyzed in combination with a vehicle-mounted terminal GUI large model, the method is not limited to simple interface mapping any more, the interface of the mobile terminal is'understood 'and precise operation is executed like people, automatic completion of complex transactions is achieved, and the user experience is improved. And the interaction efficiency and intelligence are obviously improved. As the user does not need to manually contact the mobile terminal, the conditions that the driver is distracted and the sight deviates from the road are reduced, and the driving potential safety hazard is effectively reduced.
Owner:HUAQIN TECH CO LTD

A voice assistant control method, a vehicle, and a storage medium

This invention discloses a voice assistant control method, a vehicle, and a storage medium. By monitoring the user's cross-screen transfer intention after waking the voice assistant in real time, and dynamically switching the voice assistant's service focus from the current audio zone screen to the target audio zone screen upon confirmation of the intention, the method simultaneously associates the user's voice input channel with the application list of the target screen. Therefore, this embodiment allows users to operate any visible and speakable function on any screen in the vehicle directly through voice commands without leaving their current seat or repeatedly waking the voice assistant. This embodiment significantly simplifies the cross-screen control operation process, compressing the original multi-step operation of "moving position, re-waking, and issuing commands" into a smooth closed loop of "waking up, expressing intention, and direct control," improving interaction efficiency while effectively reducing the safety risks caused by driver distraction due to frequent operations.
Owner:VOYAH AUTOMOBILE TECH CO LTD

A driving risk early warning method and system based on a large language model

The application discloses a driving risk early warning method and system based on a large language model, wherein real-time obtained road environment information and driver distraction behavior state information are input into the large language model, early warning judgment and early warning information are performed through the large language model, so that the specific driving task and the distraction state of the driver can be fully considered, so as to provide personalized risk early warning at a suitable time by using a suitable persuasion strategy, compared with a single warning system, the driver's attention can be more efficiently guided, so that the reaction speed and the driving safety are improved. The two interactive modes of voice and vision are combined, more rich and intuitive early warning information is provided, and the perception ability of the driver to potential risks is enhanced.
Owner:ZHEJIANG UNIV

A natural language-based in-vehicle broadcast interaction method and system

This invention belongs to the field of vehicle-mounted human-machine interaction technology, specifically relating to a vehicle-mounted broadcast interaction method and system based on natural language. It involves acquiring broadcast audio streams, understanding the broadcast content to obtain structured content data, and associating and storing the structured content data with corresponding timestamps to construct a broadcast content time index library. When a user's verbal command is detected, speech recognition and natural language understanding are performed to parse the user's intent and time indication information, thereby determining a backtracking time window and quickly retrieving the corresponding structured content data using the backtracking time window as an index. Finally, based on the user's intent, corresponding target operations are executed and / or response content is generated, and multimodal feedback is performed. This enables interactive operations such as replay, query, or information retrieval, transforming the broadcast from a one-way receiving device into a conversational intelligent terminal. The elimination of manual operation significantly reduces the risk of driver distraction and improves driving safety and information acquisition efficiency.
Owner:FORYOU GENERAL ELECTRONICS