Apparatus and method for providing information and entertainment in a motor vehicle
By assessing vehicle and occupant conditions, the method provides personalized information and entertainment in vehicles, reducing driver distraction and enhancing safety and comfort.
Patent Information
- Application Number
- JP2023118884
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-07-22
- Filing Date
- 2023-07-21
- Publication Date
- 2025-04-07
- Estimated Expiration
- 2043-07-21
AI Technical Summary
Existing methods for providing information and entertainment in vehicles, such as broadcast radio and multimedia devices, offer limited personalization and require driver distraction to change stations or playlists, increasing the risk of accidents.
A method that assesses the vehicle's interior and ambient conditions, as well as the driver's and passengers' states, to provide personalized information and entertainment without distracting the driver, using data from cameras, microphones, and sensors to tailor content to the situation.
The method effectively provides personalized information and entertainment that adapts to the vehicle's situation and occupants' needs, reducing driver distraction and improving safety and comfort.
Smart Images

Figure 0007657863000001
Abstract
Description
[Technical field]
[0001] The present invention relates to an apparatus and method for providing information and entertainment in a motor vehicle, so-called "car content". [Background technology]
[0002] The method according to the invention can be used both for self-driving cars and for conventional cars, therefore the following description refers to a first occupant, which in a conventional car corresponds to the driver of the car.
[0003] The prior art discloses broadcast radio receivers and reception of broadcast radio, other multimedia devices and their uses, online streaming and services where simple personalization is performed, such as Spotify. A drawback of broadcast radio equipment is that the possible personalization is limited to a very limited extent by selecting radio stations that are available at the time and have a limited range, which means that for longer journeys, it may be necessary to search for and select another radio station. Other multimedia devices, such as mp3 players, may already better match the personal preferences of the first passenger, especially the motorist and / or his passengers, which are necessary for conventional automobiles, but are firmly pre-determined and cannot be changed without effort. The same applies to online streaming services, which are offered to suit different musical tastes, but cannot be perfectly adapted to the user. Finally, a specific song can be found on the streaming service. A drawback of all known methods is that the first passenger is distracted when changing radio stations or playlists while driving. This increases the risk of accidents in the case of non-self-driving automobiles. It would be largely irresponsible for a first occupant of a non-self-driving vehicle to seek out music while driving and become distracted to such an extent that the risk of a traffic accident is significantly increased. Summary of the Invention [Problem to be solved by the invention]
[0004] It is therefore an object of the present invention to specify a method whereby personalized information and entertainment is provided to a first passenger without distracting from driving. This object is achieved by a method having the features of claim 1. Advantageous configurations can be inferred from the dependent claims. [Means for solving the problem]
[0005] Since the first step involves ascertaining the state of the interior of the motor vehicle, the ambient conditions of the motor vehicle and the operating parameters of the motor vehicle, the second step involves ascertaining information on the state of the first occupant and the third step involves evaluating the information ascertained in the first and second steps and selecting information and / or entertainment therefrom and providing said information and / or entertainment for the first occupant, when the method according to the invention is used in a conventional motor vehicle, it is possible to provide information and / or entertainment that is acceptable to the first occupant, since this information and / or entertainment is adapted to the overall situation of the motor vehicle and the first occupant, i.e. the motor vehicle driver. The output information can be, for example, educational programs, weather forecasts, political events or quotes. The entertainment provided can be music or radio dramas adapted to the situation. For example, if a camera is used to detect that the motor vehicle driver is tired, he or she can be provided with or played more exciting music. If the motorist is detected to be agitated, softer music is provided or played to calm the motorist and therefore promote a safer driving style for that person, without the motorist being aware of it.
[0006] If the second step also includes evaluating information about the passenger's state and / or behavior, the selection of information and / or entertainment to be provided can be improved, since the effect on the first passenger in the first place also factors into the decision as to what information and / or entertainment is provided. For example, if a car driver becomes tense as a result of the passenger's behavior, it may be beneficial to provide a calming piece of music to lighten the atmosphere in the car and prevent further agitation.
[0007] If the third step also involves evaluating information about the passenger's status and providing information and / or entertainment for the first passenger and the passengers from the result, the satisfaction of all passengers can lead to a positive perception of the situation in the vehicle for all passengers, thus improving driving safety and comfort. For example, if one or more children are on board as passengers, it seems beneficial to provide information and / or entertainment for children, such as children's songs or children's radio dramas. It is also possible to provide the passengers with videos and games as entertainment, while providing this information to the first passenger only when the vehicle does not need to perform any active driving tasks due to foreseeable future situations, i.e. when the vehicle is in autonomous mode.
[0008] If the reaction of the first occupant and passengers to the information and / or entertainment provided is ascertained, stored in a storage medium and taken into account in subsequent selections of information and / or entertainment to be provided, the selection of information and / or entertainment to be provided can be continually improved, since in this manner it is detected how each piece of information and / or entertainment affects the occupant or passenger.
[0009] If the first occupant is identified, for example using a biometric characteristic, and associated with stored information about that person, then when the method is used at a later time and the first occupant and / or passenger is recognized, this information can be taken into account for subsequent selection of information and / or entertainment to be provided, thus improving the selection.
[0010] The ability to input the information and / or entertainment preferences of the first occupant and / or fellow passengers increases the likelihood of ensuring an appropriate selection of the appropriate information and / or entertainment provided right from the start of use of the method according to the invention, for example, manually using a keypad or vocally using a voice recognition system.
[0011] If the first step also involves reviewing the map data, the selection of information and / or entertainment to be output can be further refined.
[0012] The method according to the invention can be further improved if the first step further comprises ascertaining the current position of the vehicle and the destination of the current trip.
[0013] If these travel distances are stored and taken into account in a second step in the subsequent method according to the invention, the results found can be further improved.
[0014] If the first step includes registering at least one of the traffic flow conditions in which the vehicle is traveling, the driving task, the navigation direction, the travel time already taken, the estimated travel time to the destination, and / or the current location of the vehicle, the information and / or entertainment selection can be improved even further.
[0015] If the first step involves registering at least one of the operating parameters, i.e. vehicle speed, engine RPM, energy reserve, engine oil temperature, yaw rate, tire pressure or acceleration, this information can also be used to detect the driving style of the vehicle driver and, for example, if the driving is rough, soothing information and / or entertainment can be provided.
[0016] The provision of information and / or entertainment can be further improved if the information of the second step comprises information on at least the first person's level of fatigue, emotions, mood, excitement, stress, alertness, drunkenness, age and / or gender. Information on the level of fatigue, emotions, mood, excitement, stress and / or alertness can be provided based on, for example, an evaluation of images from a camera mounted on the vehicle.
[0017] Furthermore, the method can be improved if the information on the passengers' state in the second step includes at least information on the passengers' behavior and / or on the atmosphere between the occupants. This information can also be provided by means of one or more evaluations of images produced by one or more cameras in the vehicle. If a microphone is present, it is also or additionally possible to use voice recognition to evaluate the content of the conversation between the occupants and thus deduce the atmosphere.
[0018] If the first step involves performing at least one of the following actions: recording the interior of the vehicle by means of a 2D or 3D camera or radar or lidar, recording sounds and / or checking for gases in the vehicle interior, the situation in the vehicle interior can be analyzed much more accurately, so that for example a restless child can be identified and entertainment provision can be selected to calm the restless child.
[0019] In summary, it can be said that taking into account as many influences as possible that affect the comfort state of the first occupant and / or passengers helps to improve the selection of information and / or entertainment provided.
[0020] The above-mentioned method can be used in a multimedia system located in a car, but also in a mobile device, for example a smartphone, provided that the mobile device generates the required information itself (a camera and / or microphone or a GPS sensor is installed in the device) or receives it from the on-board sensors including one or more cameras, by being connected to the vehicle by a plug-in cable or wirelessly, for example using Bluetooth or WiFi, and the connections for the individual sensors are connected via individual lines in the car, which receive, evaluate and play back the received results, for example via the vehicle's bus system or the car's multimedia system.
[0021] An exemplary embodiment of the method according to the invention is explained in more detail below with reference to FIG. [Brief description of the drawings]
[0022] [Figure 1] 1 illustrates an exemplary embodiment of the method according to the invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] A first step 100, a second step 200 with a memory read step 210, and a third step 300 are shown.
[0024] A first step 100 includes collecting as much current data as previously described, for example by one or more cameras, one or more microphones, one or more temperature sensors, one or more pressure sensors, and / or gas monitoring sensors, all for monitoring the vehicle's interior, one or more cameras, one or more thermometers, a GPS system, and / or a navigation system, all for monitoring the vehicle's surroundings, and also collecting current operational data of the vehicle available in the vehicle. A second step 200 includes evaluating these ascertained data, for example ascertaining the number and behavior of occupants present in the vehicle interior, for example by evaluating images from available interior recordings, evaluating recorded audio, or evaluating pressure sensors in the vehicle seats. If available, data already available about the first occupant and / or passengers is also read in step 210 and taken into account in the evaluation of the currently ascertained data. The data read in step 210 can include data from information content of the first occupant and / or passengers' preferences for specific music genres, songs, and / or preferences. Personal relevant information of the occupant is possible, for example, by biometric sensing and identification. A personalized input system for the car also allows the retrieval of relevant information using these systems. The data read in step 210 can also include other previous matters, for example the distance traveled by each driver using the car. The data read in step 210 can then be taken into account when evaluating the current data, which means that the results are significantly improved. Step 300 then involves providing the occupant with the results identified in step 200, for example playing a song or providing audio information. Videos or computer games can also be provided to the occupant, who will not then have to perform any driving tasks with the car for a predictable period of time. [Explanation of symbols]
[0025] 100 First Step 200 Second Step 210 Memory Read Steps 300 Third Step
Claims
1. 1. A method for providing information and entertainment in a motor vehicle, comprising: A first step (100) includes ascertaining interior conditions of the vehicle, ambient conditions around the vehicle, and operating parameters of the vehicle; A second step (200) includes evaluating information about the state of the first occupant and selecting information and / or entertainment therefrom; A third step (300) includes providing the information and / or entertainment selected in the second step (200) for the first passenger. It is characterized by: said first step (100) further comprises registering at least one of said operating parameters: vehicle speed, engine RPM, energy reserve, engine oil temperature, yaw rate, tire pressure and acceleration; A method for providing information and entertainment in a motor vehicle, wherein a driving style is detected based on the registered operating parameters, and in a third step (300), the information and / or entertainment to be provided for the first occupant is selected based on the detected driving style.
2. 2. The method for providing information and entertainment in a motor vehicle according to claim 1, characterized in that said second step (200) also comprises evaluating information relating to the state and / or behavior of the passengers.
3. 3. The method for providing information and entertainment in a motor vehicle according to claim 2, characterized in that the third step (300) comprises providing information and / or entertainment for the first occupant and the passengers from the results.
4. A method for providing information and entertainment in a motor vehicle as claimed in claim 1 or 2, characterized in that the reaction of the first occupant and fellow passengers to the provided information and / or entertainment is ascertained and stored in a storage medium and taken into account by a memory reading step (210) when subsequently selecting information and / or entertainment to be provided.
5. 5. A method for providing information and entertainment in a motor vehicle as claimed in claim 4, characterized in that the first occupant is identified and associated with the information stored in accordance with claim 4 which is taken into account by the memory reading step (210) during subsequent selection of information and / or entertainment to be provided.
6. 3. A method for providing information and entertainment in a motor vehicle as claimed in claim 2, characterised in that information and / or entertainment preferences of the first occupant and / or of the fellow passengers can be input.
7. A method for providing information and entertainment in a motor vehicle according to claim 1 or 2, characterized in that the first step (100) also includes checking map data.
8. A method for providing information and entertainment in a motor vehicle according to claim 7, characterized in that said first step (100) also includes ascertaining the current location of said motor vehicle and the current travel destination.
9. 9. A method for providing information and entertainment in a motor vehicle according to claim 8, characterized in that the mileage of the motor vehicle is stored and taken into account during a subsequent method according to the invention by a memory reading step (210).
10. 3. The method for providing information and entertainment in a motor vehicle according to claim 1 or 2, characterized in that the first step (100) comprises registering at least one of the following: the state of the traffic flow in which the motor vehicle is traveling, the driving task, the navigation direction, the travel time already taken, the expected travel time to the destination, and / or the current position of the motor vehicle.
11. A method for providing information and entertainment in a motor vehicle as claimed in claim 1 or 2, characterized in that the evaluation in the second step (200) includes at least information regarding the first occupant's degree of fatigue, emotions, mood, excitement, stress, alertness, drunkenness, age and / or gender.
12. 3. The method for providing information and entertainment in a motor vehicle as claimed in claim 2, characterized in that the evaluation of information relating to the state of the passenger in the second step (200) includes at least information relating to the behavior of the passenger and / or information relating to the atmosphere among the passengers.
13. A method for providing information and entertainment in a vehicle as claimed in claim 1 or 2, characterized in that the first step (100) comprises performing at least one of the following actions: recording the interior of the vehicle by means of a 2D or 3D camera or a radar or lidar, recording sounds and / or checking gases in the interior of the vehicle.
Citation Information
Patent Citations
Contents reproduction equipment and its control method
JP2004168202A
Content reproduction device
JP2007161145A
Entertainment information providing system for automobile
JP2007212421A
Playback device, playback method and program
JP2013171546A
On-vehicle system, information processing device, and program
JP2015162087A