Vehicle-mounted electronic device and passenger information prompting method

By using on-board electronic devices to detect the words and actions of fellow passengers and obtain the driver's status, the problem of driving interference caused by drivers ignoring passengers' words and actions in online ride-hailing vehicles can be solved, thereby improving safety.

CN113807134BActive Publication Date: 2025-09-16ALPS ALPINE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202010537859.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-06-12
Publication Date
2025-09-16
Estimated Expiration
2040-06-12

AI Technical Summary

Technical Problem

During the online ride-hailing process, driving interference caused by drivers ignoring passengers' words and actions may lead to safety risks, and existing technologies lack effective detection and warning methods.

Method used

A vehicle-mounted electronic device is designed to detect passengers in the vehicle and observe their words and actions to determine whether they are interfering with the driver. The device then uses physiological information and attention status to understand the driver's status and issue prompts in a timely manner to eliminate interference.

Benefits of technology

Real-time detection of fellow passengers' words and actions and prompts can be provided to avoid driver distraction, improve driving safety, and ensure the personal safety of passengers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113807134B_ABST
    Figure CN113807134B_ABST
Patent Text Reader

Abstract

The present invention relates to a vehicle-mounted electronic device and a passenger information prompting method, comprising a passenger detection unit for detecting passengers in the vehicle and determining whether there are passengers other than the driver, a passenger speech and behavior observation unit for observing the speech and behavior of the passenger and determining whether the passenger has committed specific speech and behavior when the passenger detection unit detects the presence of a passenger in the vehicle, a driver status acquisition unit for further acquiring the state of the driver while driving when the passenger has committed specific speech and behavior, a driving obstruction judgment unit for determining whether the speech and behavior of the passenger have interfered with the driver based on the acquired state of the driver while driving, and a prompting unit for issuing a prompting message to eliminate the interference of the speech and behavior of the passenger with the driver's driving when the driving obstruction judgment unit determines that the speech and behavior of the passenger has interfered with the driver based on the judgment result of the driving obstruction judgment unit.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a vehicle-mounted electronic device and a method for prompting information to a fellow passenger, and in particular to a vehicle-mounted electronic device and a method for prompting information to a fellow passenger for detecting and prompting the words and deeds of the fellow passenger that may affect the user's driving during the user's driving process. Background Art

[0002] In recent years, with the advancement of technology and the internet, online ride-hailing services (hereinafter referred to as online ride-hailing) have gradually become part of people's lives. Using online ride-hailing services, people can simply open a website or app to reserve a vehicle of various types based on their destination, departure time, and number of passengers. Online ride-hailing has revolutionized the traditional roadside taxi-hailing model, making travel more convenient. A significant advantage of online ride-hailing is its rating system. After passengers exit the vehicle, the website or app will conduct a follow-up survey on their experience, including feedback on the driver's driving skills and service attitude. This means that the services provided during a ride are increasingly attracting the attention of businesses and individuals. However, this also presents drawbacks. For example, drivers, obsessed with high ratings, may neglect or even relax their supervision and control of passengers' behavior. This can lead to passengers' behavior interfering with the driver's driving, which can easily lead to dangers or even accidents if not promptly addressed. Summary of the Invention

[0003] The present invention is proposed to solve the above-mentioned problems existing in the prior art. Its purpose is to provide a vehicle-mounted electronic device and a passenger information prompting method that detects the words and deeds of fellow passengers while the user is driving and prompts the user's words and deeds that may affect the user's driving.

[0004] The present invention provides a vehicle-mounted electronic device, comprising: a passenger detection unit for detecting passengers in the vehicle and determining whether there are passengers other than the driver; a passenger speech and behavior observation unit for observing the speech and behavior of the passenger and determining whether the passenger has committed specific speech and behavior when the passenger detection unit detects the presence of a passenger in the vehicle; a driver status acquisition unit for further acquiring the state of the driver while driving based on the observation result of the passenger speech and behavior observation unit when the passenger has committed specific speech and behavior; a driving obstruction determination unit for determining whether the speech and behavior of the passenger have interfered with the driver based on the acquired state of the driver while driving; and a prompting unit for issuing a prompting message to eliminate the driving interference of the passenger's speech and behavior on the driver when the driving obstruction determination unit determines that the speech and behavior of the passenger has interfered with the driver based on the judgment result of the driving obstruction determination unit.

[0005] In addition, the above-mentioned vehicle-mounted electronic device also has: a physiological information abnormality judgment unit that enables the above-mentioned driver status acquisition unit to obtain the driver's current physiological information and judge whether the above-mentioned physiological information is abnormal; when the above-mentioned physiological information abnormality judgment unit judges that the above-mentioned physiological information is abnormal, the above-mentioned obstruction of driving judgment unit believes that the above-mentioned words and deeds of the above-mentioned fellow passenger have interfered with the driving of the above-mentioned driver.

[0006] Furthermore, in the above-mentioned vehicle-mounted electronic device, the above-mentioned physiological information includes at least one of heart rate information, heartbeat information and respiratory frequency.

[0007] In addition, the above-mentioned vehicle-mounted electronic device also has: the above-mentioned driver state acquisition unit obtains the current attention state of the above-mentioned driver, and determines whether the above-mentioned attention state is in a scattered state. An attention concentration judgment unit; based on the judgment result of the above-mentioned attention concentration judgment unit, when the above-mentioned driver's attention is in a scattered state, the above-mentioned obstruction of driving judgment unit believes that the above-mentioned words and deeds of the above-mentioned fellow passenger have interfered with the driving of the above-mentioned driver.

[0008] The present invention also provides a passenger information prompting method, comprising: a passenger detection step for detecting passengers in the vehicle and determining whether there are passengers other than the driver; a passenger speech and behavior observation step for observing the speech and behavior of the passenger and determining whether the passenger has committed specific speech and behavior when the passenger has committed specific speech and behavior in the passenger detection step; a driver status acquisition step for further acquiring the driver's status based on the observation result in the passenger speech and behavior observation step; a driving interference judgment step for determining whether the speech and behavior of the passenger have interfered with the driver's driving based on the acquired driver's status; and a prompting step for issuing a prompting message to eliminate the interference of the passenger's speech and behavior with the driver's driving when the passenger has committed specific speech and behavior in the passenger speech and behavior observation step based on the judgment result in the driving interference judgment step.

[0009] Effects of the invention:

[0010] According to the vehicle-mounted electronic device and the passenger information prompt method provided by the present invention, the passenger's speech and behavior information and the driver's status information can be obtained in real time while the user is driving the vehicle. When the passenger's status information is affected by the passenger's speech and behavior, the passenger is reminded in time, thereby avoiding the disadvantage of the user being distracted from driving due to the passenger's speech and behavior, improving driving safety, and ensuring the personal safety of passengers and drivers. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1This is a block diagram showing the configuration of an in-vehicle electronic device according to a first embodiment of the present invention.

[0012] Figure 2 This is a flowchart of a method for presenting information to a fellow passenger according to the first embodiment of the present invention.

[0013] Figure 3 This is a block diagram showing the configuration of an in-vehicle electronic device according to a second embodiment of the present invention.

[0014] Figure 4 This is a flowchart of a method for presenting information to a fellow passenger according to a second embodiment of the present invention.

[0015] Figure 5 This is a flowchart of a method for presenting information to a fellow passenger according to a modification of the second embodiment of the present invention.

[0016] Figure 6 This is a block diagram showing the configuration of an in-vehicle electronic device according to a third embodiment of the present invention.

[0017] Figure 7 This is a flowchart of a method for presenting information to a fellow passenger according to a third embodiment of the present invention.

[0018] Figure 8 This is a flowchart of a method for presenting information to a fellow passenger according to a modification of the third embodiment of the present invention.

[0019] Figure 9A 、 Figure 9B This is a diagram showing an example of display of a database of predetermined speech and behavior of fellow passengers and corresponding presentation contents according to an embodiment of the present invention.

[0020] Explanation of the reference numerals: 100, 100A, 100B; vehicle-mounted electronic device; 101: passenger detection unit; 102: passenger speech and behavior observation unit; 103: driver status acquisition unit; 104: obstruction driving judgment unit; 105: prompt unit; 106: physiological information abnormality judgment unit; 107: attention concentration judgment unit. DETAILED DESCRIPTION

[0021] Implementation Method 1

[0022] The following describes a first embodiment of the in-vehicle electronic device and electronic information output control method according to the present invention with reference to the accompanying drawings. In the specific embodiments, components of the device may be modified, deleted, or added, and the steps of the method may be modified, deleted, added, or reordered, depending on the actual situation.

[0023] like Figure 1As shown, the in-vehicle electronic device 100 is composed of a passenger detection unit 101, a passenger speech and behavior observation unit 102, a driver status acquisition unit 103, an obstructed driving judgment unit 104, a prompting unit 105 and other components. Figure 1 The in-vehicle electronic device 100 shown has the minimum configuration required to implement the present invention. The components 101-105 described above can be hardware components, such as any one or more of RAM / ROM memory, a DSP (Digital Signal Processor), and a CPU. The following describes in detail the necessary configuration required to implement the in-vehicle electronic device 100 of the present invention.

[0024] The passenger detection unit 101, comprised of a personnel detection component, a central processing unit, and a storage unit, detects the presence of passengers in the vehicle and determines whether there are any other passengers besides the driver. The personnel detection component includes, but is not limited to, a component capable of capturing images of the vehicle interior, such as a camera. If the personnel detection component is a camera, the camera captures the interior of the vehicle and transmits the captured images to the central processing unit, which analyzes and processes the images to detect the presence of any passengers in the passenger seat or rear seats. If so, the passenger is identified as a passenger. Alternatively, the personnel detection unit may utilize gravity sensors, etc., located on the corresponding seats, to detect the presence of passengers in specific parking spaces within the vehicle. This allows the determination of the presence of passengers in the passenger seat or rear seats. If so, the passenger is identified as a passenger. When the passenger detection unit 101 determines the presence of any passengers in the vehicle, it sends a signal to the passenger behavior observation unit 102.

[0025] The passenger speech and behavior observation unit 102 is composed of hardware such as a memory and a central processing unit. When receiving the information from the passenger detection unit 101 that there are other passengers in the car besides the driver, it observes the passenger's speech and behavior and further determines whether the passenger has performed the specified speech and behavior. Here, the speech and behavior in this case include but are not limited to the passenger's speech content, actions, behavior and other information. The specific speech content of the passenger is as follows: Figure 9A As shown in the figure, the specific actions and behaviors of the passengers are as follows: Figure 9B In addition, the specified speech and behavior information can be obtained by the user from the above Figure 9A , Figure 9B The setting can be selected from the passenger's speech and behavior database shown in , or it can be set by default by the manufacturer or developer of the device. In this embodiment, the specified speech and behavior information is as follows Figure 9A , Figure 9B When the above passenger speech and behavior observation unit 102 observes the speech and behavior of the passenger, it determines whether the passenger has done the following Figure 9A , Figure 9B The specific words and deeds shown in the database of passenger's words and deeds are judged. The specific judgment method here can be that the passenger's words and deeds observation unit 102 obtains and analyzes the two parts of information of the passenger's language and behavior respectively. Specifically, the language part can use the existing voice recognition technology to identify the passenger's speech content, which will not be elaborated here; the detection of the passenger's behavior part can first use a camera device to shoot the passenger's action information, and then use the central processing unit to analyze and judge the captured pictures or images to identify the passenger's action content. The above-mentioned specific analysis and identification of the passenger's words and deeds are not limited to the above-mentioned solutions. Other technologies that can analyze and identify the passenger's words and deeds can be included in this case. Then, after analyzing and identifying the passenger's words and deeds, the passenger's words and deeds observation unit 102 further compares the passenger's words and deeds information identified by the above analysis with the data in the above-mentioned specified words and deeds information database, that is, Figure 9A , Figure 9B Compare the data in the Figure 9A , Figure 9B According to the judgment result, when a fellow passenger sends Figure 9A , Figure 9B When the speech and behavior information specified in the above is obtained, the information is sent to the driver status acquisition unit 103. In addition, the passenger speech and behavior observation unit 102 can separately include a speech recognition unit for recognizing the speech of the passenger and a camera unit for recognizing the behavior of the passenger. The camera unit for recognizing the behavior of the passenger can also be the same unit as the camera in the passenger detection unit 101 that has the function of capturing images inside the vehicle.

[0026] Driver status acquisition unit 103, comprised of hardware such as a memory and a central processing unit, acquires driver status information upon receiving information from passenger behavior observation unit 102. Driver status information includes, but is not limited to, the driver's facial state, facial expression, emotional state, psychological state, and physiological indicators.

[0027] The obstruction determination unit 104, comprised of hardware such as a memory and a central processing unit, determines whether the passenger's words and actions obstruct the driver's driving based on the driver's status information acquired by the driver status acquisition unit 103. The specific determination method will be described in the subsequent detailed embodiments and will not be elaborated upon here. If the obstruction determination unit 104 determines that the passenger's words and actions do indeed obstruct the driver's driving, it sends a message to the prompt 105.

[0028] The prompting unit 105 is composed of components such as a memory, a speaker or a display. After receiving the information sent by the above-mentioned driving obstruction judgment unit 104, it sends a prompting message to reduce the driving interference to the above-mentioned driver.

[0029] Below, refer to Figure 2 A flowchart of a method for presenting information to a fellow passenger using an in-vehicle electronic device according to the present invention will be described.

[0030] First, the passenger detection unit 101 of the vehicle-mounted electronic device detects the situation of passengers in the vehicle (step S201) to determine whether there are other passengers in the vehicle besides the driver (step S202);

[0031] Then, according to the result of step S202, if it is determined that there are no other passengers in the vehicle except the driver (step S202: No), the process ends. If it is determined in step S202 that there are other passengers in the vehicle except the driver (step S202: Yes), step S203 is continued, that is, the passenger speech and behavior observation unit 102 further observes the speech and behavior of the detected passenger (step S203).

[0032] Next, during the observation process, the observed speech and behavior of the passenger is identified, analyzed, stored, and compared with the specified speech and behavior data to determine whether the passenger's speech and behavior contains the specified speech and behavior information (step S204);

[0033] Then, based on the result of step S204, if it is determined that the passenger's speech and behavior do not contain the specified speech and behavior information (step S204: No), the process returns to step S203. If it is determined that the passenger's speech and behavior do contain the specified speech and behavior information (step S204: Yes), the process continues to step S205, where the driver status acquisition unit 103 acquires the driver's status (step S205).

[0034] Next, based on the driver's status obtained in the above-mentioned step S205, the driving obstruction judgment unit 104 judges whether the words and deeds issued by the above-mentioned passenger interfere with the driver's driving (step S206); based on the execution result of step S206, when it is judged that the words and deeds issued by the above-mentioned passenger do not interfere with the driver's driving (step S206: no), the processing is terminated; when it is judged in step S204 that the words and deeds issued by the above-mentioned passenger do interfere with the driver's driving (step S206: yes), step S207 is continued to be executed, that is, information is issued to prompt the passenger to eliminate the interference of the above-mentioned passenger's words and deeds on the driver's driving (step S207).

[0035] This embodiment allows for monitoring the behavior of fellow passengers, assessing the driver's state after certain actions are taken, and determining whether these actions have an impact on the driver. Furthermore, if an impact does occur, timely and appropriate reminders can be provided to fellow passengers, thereby preventing the driver's state from deteriorating and distracting their attention, thereby reducing the risk of accidents.

[0036] Implementation Method 2

[0037] Next, a second embodiment of the present invention will be described in detail. Figure 3 This is a block diagram showing the configuration of an in-vehicle electronic device 100A according to a second embodiment of the present invention.

[0038] Here, components that are different from those of the in-vehicle electronic device 100 will be described in detail, and descriptions of the same components will be omitted.

[0039] The in-vehicle electronic device 100A is based on the in-vehicle electronic device 100 and further includes a physiological information abnormality determination unit 106 .

[0040] The physiological information abnormality determination unit 106 is composed of storage components and central processing components. It enables the driver status acquisition unit to obtain the driver's physiological information and then determine whether the physiological information is abnormal. Physiological information herein includes, but is not limited to, heart rate information, heartbeat information, respiratory rate, and breathing depth. This physiological information can be obtained through communication with an external device. That is, the physiological information abnormality determination unit 106 can also include a communication unit, such as a wristband, watch, or physiological monitor worn by the driver that can detect the driver's heart rate, heartbeat, respiratory rate, and other data, thereby obtaining the physiological information. Of course, the physiological information abnormality determination unit 106 can also directly include components that can detect the driver's heart rate, heartbeat, respiratory rate, and other data. In addition, the method for determining whether the physiological information is abnormal can be that if the value of any of the driver's physiological data is outside the normal range (the normal range for certain physiological values ​​defined in medical terms or generally accepted knowledge), the driver's physiological data is considered abnormal.

[0041] When the physiological information abnormality judgment unit 106 judges that the physiological information is abnormal, it sends information to the driving obstruction judgment unit 104. After the driving obstruction judgment unit 104 receives the information sent by the physiological information abnormality judgment unit 106, it believes that the above-mentioned words and deeds of the above-mentioned passenger have affected the psychological state of the above-mentioned driver, thereby interfering with driving, and then the prompt unit 105 sends a prompt information. For example, when the above-mentioned passenger words and deeds observation unit 102 detects that the passenger opens the window in the external environment of driving on a highway, the physiological information data of the driver is obtained, such as the heart rate is 150 beats / minute, which is more than the heart rate of an ordinary person. Therefore, it is considered that the driver's psychological information data is abnormal at this time, and the prompt unit 105 can prompt as follows: Figure 9B The driver can be prompted with the message "Sorry, opening the window here is dangerous, please close the window!" This prompt can be displayed on a screen visible to the passenger in the form of text or images, or in the form of voice to remind the passenger to correct the passenger's specific words and actions, thereby reducing or even eliminating the negative impact of the passenger's specific words and actions on the driver's driving.

[0042] Below, combined with the specific flow chart, that is, refer to Figure 4 The passenger information prompting method of the vehicle-mounted electronic device of this embodiment is described in detail. Steps S401 to S404 are Figure 2 Steps S201 to S204 are the same and are not described again here. Only the different contents, namely, steps S405 to S408, are described.

[0043] When the passenger speech and behavior observation unit 102 observes a specific speech or action of the passenger in step S404, the driver state acquisition unit 103 acquires the physiological information data of the driver (step S405);

[0044] Then, the physiological information abnormality determination unit 106 determines whether the physiological information of the driver is abnormal based on the physiological information data of the driver obtained in step S405 (step S406);

[0045] According to the judgment result of step S406, when the physiological information of the driver is within the normal range (step S406: No), the processing ends; when the physiological information of the driver is abnormal (step S406: Yes), step S407 is continued;

[0046] Furthermore, if it is determined in step S406 that the physiological information of the driver is abnormal, the driving obstruction determination unit 104 determines that the words and actions of the passenger have affected the driver, and such influence will interfere with the driver's driving (step S407);

[0047] Finally, a specific prompt message is sent to the fellow passengers to reduce or even eliminate the influence of the fellow passengers' specific words and deeds on the user (step S408).

[0048] This embodiment detects the driver's psychological state after observing specific actions from a fellow passenger. If the psychological state is abnormal, it is assumed that the specific actions have affected the driver, and the onboard electronic device can then provide a timely reminder to the fellow passenger. This allows for timely detection of changes in the driver's psychological state, preventing the impact of the passenger's actions on the driver's psychology, preventing accidents caused by deteriorating psychological information, and improving passenger safety.

[0049] Modification of the Second Embodiment

[0050] Next refer to Figure 5 The flowchart of the modified example of the second embodiment of the present invention is described in detail. Steps S601 to S604 are Figure 4 Steps S401 to S404 are the same and are not described again here. Only the different contents, namely, steps S605 to S609, are described.

[0051] When a specific speech or action of a fellow passenger is detected in step S604, the driver state acquisition unit 103 acquires the physiological information data of the driver's current state (step S605) and the history information of the driver's previous physiological information data (step S606);

[0052] Then, the physiological information abnormality determination unit 106 compares the current physiological information data of the driver and the historical information of the driver's physiological information data obtained in steps S605 and S606, respectively, to determine whether the current physiological information data of the driver is abnormal (step S607).

[0053] When the driver's current physiological information data is not significantly higher or lower than most of the driver's previous physiological information data (for example, significantly lower or higher than 50% of the physiological data), or is not significantly higher or lower than the average value of the driver's previous physiological information data, it can be determined that the driver's current physiological information data is normal (step S607: No), and the process ends;

[0054] On the contrary, that is, when the driver's current physiological information data is significantly lower or higher than most of the driver's previous physiological information data (for example, significantly lower or higher than 50% of the physiological data), or significantly higher or lower than the average value of the driver's previous physiological information data, it can be determined that the driver's current physiological information data is in an abnormal state (step S607: yes);

[0055] Next, if it is determined in step S607 that the driver's current physiological information is abnormal, the driving obstruction determination unit 104 determines that the passenger's speech or actions have affected the driver, and such influence will interfere with the driver's driving (step S608);

[0056] Finally, a specific prompt message is sent to the passenger to reduce or even eliminate the influence of the passenger's specific words and deeds on the driver (step S609).

[0057] Based on the second embodiment, this embodiment not only obtains the driver's current physiological information data, but also further integrates the driver's previous physiological information data, making the judgment of whether the driver's mental state is abnormal or not more accurate, further confirming the impact of the actions of fellow passengers on the driver, improving the accuracy and timeliness of this case, and ensuring the safety of passengers.

[0058] Implementation Method 3

[0059] Next, the third embodiment of the present invention will be described in detail. Figure 6 This is a block diagram showing the configuration of an in-vehicle electronic device according to a third embodiment of the present invention.

[0060] Here, as compared with the in-vehicle electronic device 100 , which is a configuration that minimally implements the present invention, components that differ from the in-vehicle electronic device 100 will be described in detail, and descriptions of the same components will be omitted.

[0061] The in-vehicle electronic device 100B is similar to the in-vehicle electronic device 100 and further includes an attention determination unit 107 .

[0062] The attention determination unit 107 is composed of a processor and a storage component, such as RAM / ROM. After the driver's attention state is obtained by the driver state acquisition unit 103, it is determined whether the driver's attention is not in a state of concentration. Specific determination methods include, but are not limited to, for example, the processor within the attention determination unit 107 can analyze an image and compare the image with driver big data or an attention distraction model to calculate; or it can also determine whether the driver's attention in the image is focused by analyzing whether the driver in the image performs a specified action, such as looking away from the driving direction or operating certain equipment in the vehicle.

[0063] The obstruction driving determination unit 104 determines, based on the determination result of the attention concentration determination unit 107 , that the words and actions of the fellow passenger interfere with the driver's driving when the driver's attention is not in a state of concentration.

[0064] Below, combined with the specific flow chart, that is, refer to Figure 7 This embodiment is described in detail. Steps S701 to S704 are Figure 2 Steps S201 to S204 are the same and are not described again here. Only steps S705 to S708 are described.

[0065] When a specific speech or action of a fellow passenger is observed in step S704, the driver state acquisition unit 103 acquires the driver's attention state information (step S705);

[0066] Then, the attention concentration determination unit 107 determines whether the driver is paying attention based on the physiological information data of the driver obtained in step S705 (step S706);

[0067] According to the judgment result of step S706, when the driver's attention is in a focused state (step S706: No), the processing ends; when the driver's attention is distracted (step S706: Yes), step S707 is continued;

[0068] Further, after it is determined in step S706 that the driver's attention has been diverted from driving, that is, when his attention is distracted from driving, the obstruction of driving judgment unit 104 believes that the passenger's language or actions have affected the driver's driving, and this influence will interfere with the driver's driving (step S707); for example, when the passenger turns up the audio volume very loudly, the driver will intentionally or unintentionally divert part of his attention to the plot of the video, and his eyes will deviate from the driving road, etc.

[0069] Finally, a specific reminder message is sent to the co-passenger to reduce or even eliminate the influence of the specific language or action issued by the co-passenger on the user (step S408). Figure 9B The prompt message "Sorry, your voice has disturbed the driver's driving, please turn down the volume!" is displayed.

[0070] By detecting the driver's driving concentration in this embodiment, it is determined whether the actions of fellow passengers have a negative impact on the driver's concentration. If a negative impact has occurred, the passenger can be promptly reminded of their words and actions to ensure the driver's concentration, avoid traffic accidents, and improve passenger safety.

[0071] Modification of the third embodiment

[0072] Next refer to Figure 8 The flowchart of the modified example of the third embodiment of the present invention is described in detail. Steps S801 to S804 are Figure 7 Steps S701 to S704 are the same and are not described again here. Only the different contents, namely, steps S805 to S809, are described.

[0073] When a passenger makes a specific speech or gesture in step S804, the driver state acquisition unit 103 acquires the driver's current attention state (step S805) and the driver's past attention state information (step S806);

[0074] Then, the attention determination unit 107 compares the driver's current attention state data and the driver's previous driving attention state data obtained in steps S805 and S806, respectively, to determine whether the driver's current driving attention state is abnormal (step S807).

[0075] When the driver's current driving concentration is not worse than the driver's previous driving concentration, it can be determined that the driver's current physiological data information is normal (step S807: No), and the process ends;

[0076] On the contrary, that is, when the driver's current driving concentration is worse than the driver's previous driving concentration, it can be determined that the driver's current driving concentration state is abnormal (step S807: yes);

[0077] Next, if it is determined in step S807 that the driver's current state of attention while driving is abnormal, the obstructed driving determination unit 104 determines that the passenger's speech or actions have affected the driver and that such influence will interfere with the driver's driving (step S808);

[0078] Finally, a specific prompt message is sent to the fellow passenger to reduce or even eliminate the influence of the fellow passenger's specific words and deeds on the driver (step S809).

[0079] By detecting the driver's current driving concentration and comparing the detection results with previous driver concentration, this embodiment can determine whether the driver's current attention is not focused, and thus further determine whether the words and actions of fellow passengers are affecting the driver's driving. Here, based on the third embodiment, the determination of attention can be made based on the user's own characteristics. This avoids the judgment errors caused by comparing the driver's driving concentration data with other people's driving concentration data or the average data of other people's driving concentration data, thereby improving the accuracy of the judgment of attention. It can timely remind passengers of their words and actions to ensure the driver's driving concentration, avoid traffic accidents, and improve passenger safety.

[0080] In addition, a driving assistance system composed of the vehicle-mounted electronic device, communication network, and user terminal of each of the above embodiments is also within the scope of the present invention. The driving assistance system provided by the present invention can achieve the technical effects achieved by the above-mentioned vehicle-mounted electronic device and its modified embodiments.

[0081] The specific embodiments and specific examples of the present invention are described above with reference to the accompanying drawings. The specific embodiments and specific examples described above are merely specific examples of the present invention, which are used to understand the present invention and are not intended to limit the scope of the present invention. Those skilled in the art can make various modifications, combinations, and reasonable omissions of elements to the specific embodiments and specific examples based on the technical ideas of the present invention, and the resulting methods are also included in the scope of the present invention. For example, the above-mentioned embodiments and specific examples can be combined with each other, and the embodiments formed by the combination are also included in the scope of the present invention.

[0082] The steps included in the priority application determination method of the above-mentioned embodiments of the present invention may also be implemented as steps included in a priority application determination program, or as a recording medium recording the above-mentioned priority application determination program, and achieve the same technical effect.

Claims

1. A vehicle-mounted electronic device, characterized in that: have: Passenger detection unit, which detects passengers in the car and determines whether there are any passengers other than the driver; a passenger speech and behavior observation unit, which, when the passenger detection unit detects the presence of a passenger in the vehicle, observes the speech and behavior of the passenger and determines whether the passenger has engaged in specific speech and behavior; a driver state acquisition unit, which further acquires the driver's state while driving based on the observation result of the passenger's speech and behavior observation unit when the passenger has made specific speech and behavior; a driving obstruction determination unit, configured to determine whether the words and actions of the fellow passenger have interfered with the driver based on the acquired state of the driver; and The prompt unit, based on the judgment result of the above-mentioned obstruction driving judgment unit, issues a prompt message when the above-mentioned obstruction driving judgment unit determines that the above-mentioned words and deeds of the above-mentioned fellow passenger have caused interference to the above-mentioned driver, so as to eliminate the interference of the above-mentioned words and deeds of the above-mentioned fellow passenger on the driving of the above-mentioned driver.

2. The vehicle-mounted electronic device according to claim 1, wherein: Also features: The physiological information abnormality determination unit causes the driver status acquisition unit to acquire the driver's current physiological information and determine whether the physiological information is abnormal. When the physiological information abnormality determination unit determines that the physiological information is abnormal, the driving obstruction determination unit determines that the words and actions of the fellow passenger have interfered with the driver's driving.

3. The vehicle-mounted electronic device according to claim 2, wherein: The above physiological information includes at least one of heart rate information, heartbeat information and respiratory rate.

4. The vehicle-mounted electronic device according to claim 1, wherein: Also features: The attention concentration determination unit is configured to obtain the current attention state of the driver and determine whether the attention state is in a distracted state. According to the determination result of the attention concentration determination unit, when the driver's attention is in a distracted state, the obstructed driving determination unit determines that the words and actions of the fellow passenger have interfered with the driver's driving.

5. A method for providing passenger information, characterized in that: have: A passenger detection step is to detect the passengers in the vehicle and determine whether there are any passengers other than the driver; A passenger behavior observation step, when a passenger is detected in the passenger detection step, observing the passenger's behavior and determining whether the passenger has engaged in specific behavior; A driver status acquisition step, based on the observation results in the passenger's speech and behavior observation step, further acquiring the driver's status when the passenger has made specific speech and behavior; a driving interference determination step of determining whether the passenger's words and actions interfere with the driver's driving based on the acquired driver's status; and A prompting step, based on the judgment result in the above-mentioned driving obstruction judgment step, when it is judged in the above-mentioned driving obstruction judgment step that the above-mentioned words and deeds of the above-mentioned fellow passenger have caused interference with the driving of the above-mentioned driver, issues a prompting message to eliminate the interference of the above-mentioned words and deeds of the above-mentioned fellow passenger with the driving of the above-mentioned driver.

Citation Information

Patent Citations

  • Driver condition recognition device and method based on travel state determination information

    JP2019197522A

  • Driving assistance device and driving assistance method

    WO2019130993A1