Method and apparatus for providing information in a vehicle

By providing a device that can identify and output surrounding vehicle data in the autonomous driving vehicle, the problem of lack of entertainment and entertainment for the occupants during driving is solved, and the effect of improving the comfort and time utilization efficiency of the occupants is achieved.

CN116057597BActive Publication Date: 2025-06-27BAYERISCHE MOTOREN WERKE AG
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202180055545.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-09-15
Filing Date
2021-08-30
Publication Date
2025-06-27
Estimated Expiration
2041-08-30

AI Technical Summary

Technical Problem

In autonomous vehicles, the occupants lack interesting and entertaining pastime during driving, resulting in less time utilization efficiency.

Method used

By providing a device in the vehicle, the device can identify occupants and vehicle data of the surrounding vehicles through environmental sensors and output these data to the occupants of the vehicle through vehicle-to-vehicle communication for entertainment and recreation.

Benefits of technology

The device enables occupants to perform interactive games and guessing games by receiving and viewing occupants and vehicle data from other vehicles, thereby improving occupants' comfort and time utilization efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116057597B_ABST
    Figure CN116057597B_ABST
Patent Text Reader

Abstract

The present invention relates to a device (101) for providing information in a vehicle (100). The device (101) is configured to determine personal-related data related to an occupant of another vehicle (112) in the environment of the vehicle (100) and / or vehicle-related data related to the other vehicle (112). Furthermore, the device (101) is configured to output the personal-related data and / or the vehicle-related data to an occupant of the vehicle (100).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a method for providing information related to the environment of a vehicle to an occupant or user of the vehicle and a corresponding device. Background Art

[0002] Occupants of a vehicle, especially an autonomously driving vehicle, can have a relatively large amount of time available during driving, which does not need to be used for driving the vehicle. Summary of the Invention

[0003] The technical task addressed herein is to enable the occupants of a vehicle to spend the available time as interestingly and / or entertainingly as possible while the vehicle is in motion.

[0004] According to one aspect, a device for providing information in a vehicle (the vehicle is also referred to herein as the host vehicle) is described. The device can be configured to determine personal-related data related to an occupant of another vehicle in the environment of the vehicle and / or vehicle-related data related to the other vehicle. The other vehicle can be identified, for example, based on environmental data from one or more environmental sensors (especially one or more cameras) of the vehicle (host vehicle). The device can be configured to receive personal-related data and / or vehicle-related data from the other vehicle via a vehicle-to-vehicle communication connection (especially in response to a request from the vehicle (host vehicle) for the data).

[0005] Personal-related data can include: information related to the characteristics (such as age, nationality, etc.), occupation, and / or qualifications (such as degrees) of the occupant of the other vehicle. Alternatively or in addition, vehicle-related data can include: information related to the characteristics and / or driving route of the other vehicle. The scope and / or depth of information of the personal-related data and / or vehicle-related data can be determined by the occupant of the other vehicle. The personal-related data can be provided herein by an electronic terminal device of the occupant of the other vehicle.

[0006] The device is further configured to output the personal-related data and / or vehicle-related data to the occupant of the vehicle. The personal-related data and / or vehicle-related data can especially be output visually (on the screen of the vehicle or on the terminal device of the vehicle occupant). Alternatively or in addition, the personal-related data and / or vehicle-related data can be output audibly and / or acoustically (for example, via the speakers of the vehicle and / or via the headphones of the vehicle occupant).

[0007] In particular, the device can be configured to display the personal-related data and / or vehicle-related data in an information area that is superimposed on an image representation of the other vehicle, especially on an image representation of the environmental situation in the environment of the vehicle (in which the other vehicle is also located).

[0008] For example, the device may be configured to output the information area on the glass of the vehicle (e.g., as augmented reality), through which the vehicle occupants can see the other vehicle. Alternatively or additionally, the device may be configured to output an image representation of the environment of the other vehicle on a screen of the vehicle (e.g., a TFT screen) based on image data from a camera of the vehicle. The information area may then be output within the image representation on the screen.

[0009] The device thus enables the determination of personal-related and / or vehicle-related data of one or more other traffic participants and provides it to the occupants of the vehicle (ego vehicle). Thereby, the comfort of the occupants of the vehicle (ego vehicle) can be increased (especially during autonomous driving).

[0010] The device may be configured to determine whether the vehicle occupants can only see the other vehicle or can also see the occupants of the other vehicle. If necessary, the personal-related data is only output to the vehicle occupants when it is determined that the vehicle occupants can also see the occupants of the other vehicle. Thereby, information can be output in a targeted manner. Thus, the comfort of the occupants of the vehicle (ego vehicle) can be further increased.

[0011] The device may be configured to provide an interactive game, especially a quiz game or a distribution game, for the vehicle occupants based on the personal-related data and / or vehicle-related data. Thereby, the comfort of the occupants of the vehicle (ego vehicle) can be further increased.

[0012] According to another aspect, a (road) motor vehicle (especially a sedan or a truck or a bus) is described, which includes the control unit and / or device described herein.

[0013] According to another aspect, a method for providing information in a vehicle is described. The method includes determining personal-related data related to the occupants of another vehicle in the environment of the vehicle and / or vehicle-related data related to the other vehicle. Additionally, the method includes outputting the personal-related data and / or vehicle-related data to the vehicle occupants.

[0014] According to another aspect, a software (SW) program is described. The SW program may be configured to be executed on a processor (e.g., on a controller of the vehicle) and thereby implement the method described herein.

[0015] According to another aspect, a storage medium is described. The storage medium may include an SW program, which is configured to be executed on a processor and thereby implement the method described herein.

[0016] It should be noted that the methods, devices, and systems described herein can be used not only individually but also in combination with other methods, devices, and systems described herein. Additionally, any aspects of the methods, devices, and systems described herein can be combined with each other in various ways. In particular, the features of the embodiments of the present invention can be combined with each other in various ways. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The present invention will be described in detail below with reference to embodiments. The accompanying drawings are as follows:

[0018] Figure 1 Showing exemplary components of a vehicle;

[0019] Figure 2a and Figure 2b Showing an exemplary driving situation;

[0020] Figure 3 Showing an exemplary image output on a screen; and

[0021] Figure 4 Showing a flowchart of an exemplary method for providing information to a vehicle user. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0022] As mentioned at the beginning, this document relates to providing information to the user of a vehicle, especially an autonomous vehicle. In this context, Figure 1 An exemplary system 150 is shown, which has at least one vehicle 100 (ego vehicle), at least one other traffic participant 112 (e.g., another vehicle), and optionally a central unit 111 (e.g., a server outside the vehicle).

[0023] The vehicle 100 has a communication unit 104, which is configured to communicate with the central unit 111 via a (wireless) communication connection 114 (e.g., WLAN, 3G, 4G, 5G, etc.) and / or directly with one or more other traffic participants, especially other vehicles 112 (in order to exchange data).

[0024] Vehicle 100 includes one or more environmental sensors 102 (such as image cameras, radar sensors, lidar sensors, ultrasonic sensors, etc.), and the environmental sensors are arranged to detect sensor data related to the environment of vehicle 100. Such sensor data is also referred to as environmental data herein. The control unit 101 of vehicle 100 is arranged to detect one or more objects in the environment of vehicle 100, especially one or more other traffic participants (vehicles) 112, based on the environmental data. In addition, the control unit 101 may be arranged to operate one or more longitudinal and / or lateral driving actuators 103 (such as steering devices, driving devices, and / or braking devices) of vehicle 100 based on the environmental data, especially based on an environmental model depending on the environmental data, so as to drive vehicle 100 at least partially or fully automatically.

[0025] Vehicle 100 further includes a user interface 105, which is configured to interact with the user of vehicle 100, especially with the occupants and / or the driver. The user interface 105 may be configured to receive user inputs, such as requests for outputting information. In addition, the user interface 105 may be configured to output information to the user (for example, through the screen of the user interface 105).

[0026] Figure 2a and 2b Show an exemplary driving situation in which vehicle 110 (ego vehicle) is traveling on a motorway lane 200 and one or more other traffic participants (especially vehicles) 112 are also located on this motorway lane. The control unit 101 may be arranged to determine distance information regarding the distance 201 between vehicle 100 and another traffic participant 112 based on the environmental data.

[0027] The control unit 101 may be arranged to request personal-related and / or vehicle-related data of another traffic participant 112 in the environment of vehicle 100 by means of the communication unit 104. Exemplary personal-related and / or vehicle-related data are:

[0028] - The driving destination of the other traffic participant 112;

[0029] - The departure location of the other traffic participant 112;

[0030] - The driving section that the other traffic participant 112 has passed;

[0031] - The number of occupants in the other traffic participant or vehicle 112; and / or

[0032] - Personal information related to the occupants of the other traffic participant or vehicle 112.

[0033] Data related to the other traffic participant 112 can be requested by a user of the vehicle 100 via the user interface 105 of the vehicle 100. In response thereto, a request can then be sent via the communication connection 114 to the central unit 111 or directly to the other traffic participant 112 (e.g., via vehicle-to-X communication), and the requested information can be provided to the vehicle 100 via the communication connection 114.

[0034] The control unit 101 can also be configured to output personal-related and / or vehicle-related data related to the other traffic participant 112 to the user of the vehicle 100 via the user interface 105. In particular, the data can be displayed on the screen of the user interface 105.

[0035] Figure 3 An exemplary graphical representation 300 that can be output on the screen of the user interface 105 is shown. In this graphical representation 300, the motor vehicle lane 301 on which the vehicle 100 is traveling can be graphically displayed. In addition, the one or more other traffic participants 312 can be displayed. In addition, the host vehicle 310 can be displayed if necessary. Here, the graphical representation 300 can include a video playback of the environment of the vehicle 100. As an alternative, the graphical representation 300 can include a graphical representation of the current environmental situation using graphical symbols 301, 310, 312.

[0036] The graphical representation 300 also includes one or more information areas 313 for the one or more other traffic participants 112, 312. The information area 313 for the other traffic participant 112, 312 can be displayed directly adjacent to or immediately adjacent to the traffic participant 112 or the symbol 312 of the traffic participant 112. The information area 313 for the traffic participant 112 can include personal-related and / or vehicle-related data of the other traffic participant 112, 312.

[0037] Therefore, the following situation can be considered, in which at least two vehicles 100, 112 pass by each other (e.g., during overtaking, when passing on a highway, etc.) and identify each other based on GPS coordinates that are close to each other. The GPS coordinates are exchanged, for example, via vehicle-to-vehicle communication, or the two vehicles identify each other with the aid of the sensing devices 102 of their driver assistance systems. Here, for example, the smartphones of one or more occupants can be used as mobile computers, which transmit personal-related data (such as resumes, interests, etc.) to the corresponding vehicles 100, 112 (e.g., via Bluetooth). The personal-related data can in turn be transmitted from one vehicle 112 to another vehicle 100 via vehicle-to-vehicle communication (such as WLAN). Here, the personal-related data can be anonymized in a hierarchical manner. The release can be made in extracts, for example, restricted according to specific categories such as hobbies, interests, occupations, etc. The personal-related data can be anonymized in a hierarchical manner (e.g., level 0: personal anonymization, level 1: partial personal anonymization, level 2: no anonymization and thus a complete profile including name, contact information, etc.).

[0038] The algorithm in the host vehicle 100 can be set to access the personal-related data of one or more of the surrounding traffic participants or the occupants of the vehicle 112. The determined data can be displayed (e.g., by projection) on the display and / or monitor of the vehicle 100 or on the glass of the vehicle 100, such that the passing vehicle 112 obtains an overlay box 313 with information (especially when the occupants of the host vehicle 100 see the other vehicle 112 through the glass).

[0039] The information provided can depend on the anonymization level, for example, a) "There is a pilot in the other vehicle", b) "There is a pilot of the Y model of airline X in the other vehicle", c) "Mr. Müller, a pilot of the Y model of airline X, is on his way to work in the other vehicle". In addition, supplementary information (e.g., from one or more databases from the Internet) can be output via a search function, such as an occupational overview of "pilot", information about airline X, about a specific airport, or about the Y model or more conceivable information related to this person.

[0040] Therefore, a system 150 is described that uses communication technologies to provide additional information for the occupants of the host vehicle 100, especially during autonomous driving, through data processing (databases from the Internet, personal-related data and / or vehicle-related data of the occupants of one or more traffic participants 112 in the environment of the vehicle 100). Here, instead of or in addition to the personal-related data, the vehicle-related data of the one or more traffic participants 112 can also be detected and / or transmitted.

[0041] Therefore, information related to another vehicle 112 (such as vehicle age, performance, total mileage and / or annual mileage, daily mileage, departure location, etc.) can be displayed on the screen of the host vehicle 100 (for example, in a display projected on the vehicle glass or on a TFT screen). For example, it can display "Vehicle A departs from the departure place Z1 at time T and the destination is Z2".

[0042] In order to provide entertainment, for example, during autonomous driving, games and / or quizzes can be distributed by the control unit 101 using vehicle-related or personal-related data of the one or more other traffic participants 112 as necessary. For example, in a distribution game, three vehicles in the surrounding lanes can be circled on the vehicle glass by augmented reality technology and a question can be asked: "Which car has been driving on the highway for the longest time (in the sense of driving time) or the longest distance (in the sense of daily kilometers) today? Please assign the vehicles in the order of the kilometers traveled" or "Please correctly assign a professional doctor, a farmer, and a judge to the three displayed vehicles". For example, for a quiz game, it can output: "What is the profession of the occupant in the vehicle on your right lane, a) butcher, b) baker, c) politician"; or "Which vehicle has just returned from vacation?".

[0043] Therefore, it can be achieved for the user of the host vehicle 100 that when looking out through the glass of the host vehicle 100, additional information is applied to the glass, thereby marking the one or more other vehicles 112 of the surrounding traffic (such as colored boxes, boundaries, etc.) and additional information can be displayed. It is also possible to receive the real outside world from one or more on-vehicle cameras 102 of the host vehicle 100 and present the outside world on the monitor or display of the vehicle 100.

[0044] Data can be displayed or visualized in different forms: in a head-up display, in a monitor such as a rear monitor, a panoramic monitor; in a projection onto the glass or onto the street; in a display in a mobile terminal device of the vehicle occupant such as a smartphone or a tablet.

[0045] The information output about another traffic participant 112 in the host vehicle 100 can be related to the distance 201 between the host vehicle 100 and the other traffic participant 112. If the occupant of the host vehicle 100, for example, has no line of sight contact with the occupant in the other vehicle 112, then vehicle-related data can be mainly used or output as necessary (because the occupant of the host vehicle 100 cannot see one or more occupants of the other vehicle 112). On the other hand, if the occupant of the host vehicle 100 has eye contact with the occupant in the other vehicle 112, then personal-related data and / or vehicle-related data can be used and / or output as necessary.

[0046] As described above, personal data related to an occupant of the vehicle 112 can be transmitted from the occupant's electronic terminal device to the vehicle 112 and / or the central unit 111 (e.g., via Bluetooth or WLAN). Additionally, vehicle-related data can be transmitted to the central unit 111. The personal-related and / or vehicle-related data can be transmitted from the other vehicle 112 and / or from the central unit 111 to the host vehicle 100 via vehicle-to-vehicle communication. Then, the occupants of the host vehicle 100 can view the personal-related data and / or vehicle-related data in an information overview with additional background information.

[0047] Figure 4 A flowchart of an exemplary (and optionally computer-implemented) method 400 for providing information in a vehicle 100 is shown.

[0048] The method 400 includes determining 401 personal-related data related to an occupant of another vehicle 112 in the environment of the vehicle 100 and / or vehicle-related data related to the other vehicle 112. The scope of the personal-related data and / or vehicle-related data provided by the other vehicle 112 can here be that which has been determined by the occupants of the other vehicle 112.

[0049] The method 400 further includes outputting 402 the personal-related data and / or vehicle-related data to the occupants of the vehicle 100 (e.g., within the scope of a guessing game and / or an assignment game). Thus, in particular, the comfort of the occupants of the vehicle 100 can be increased during autonomous driving.

[0050] The invention is not limited to the embodiments shown. In particular, it should be noted that the description and the drawings are only to illustrate the principles of the proposed methods, devices, and systems exemplarily.

Claims

1. A device (101) for providing information in a vehicle (100), wherein, The device (101) is configured to: Determine personal-related data related to an occupant of another vehicle (112) in the environment of the vehicle (100) and / or vehicle-related data related to the other vehicle (112); and Output the personal-related data and / or the vehicle-related data to an occupant of the vehicle (100), wherein the device (101) is configured to: Display a graphical representation of the other vehicle (112) and an information area that is superimposed on the graphical representation (300) of the other vehicle (112), and display the personal-related data and / or the vehicle-related data in the information area; Output the information area (313) on a glass of the vehicle (100) through which an occupant of the vehicle (100) can see the other vehicle (100); and Provide an interactive game for an occupant of the vehicle (100) based on the personal-related data and / or the vehicle-related data.

2. The apparatus (101) according to claim 1, wherein, The personal-related data includes information related to the characteristics, occupation, and / or qualifications of the occupant of the other vehicle (112).

3. The device (101) according to claim 1, wherein, The vehicle-related data includes information related to the characteristics and / or driving route of the other vehicle (112).

4. The apparatus (101) according to any one of claims 1 to 3, wherein, The device (101) is configured to receive the personal-related data and / or the vehicle-related data from the other vehicle (112) via a vehicle-to-vehicle communication connection.

5. The device (101) according to any one of claims 1 to 3, wherein, The information area is displayed adjacent to a symbol of the other vehicle.

6. The apparatus (101) according to any one of claims 1 to 3, wherein, The device (101) is configured to: Output, on a screen of the vehicle (100), a graphical representation (300) of the situation of the environment of the other vehicle (112) based on image data of a camera (102) of the vehicle (100); and Output the information area (313) within the graphical representation (300) on the screen.

7. The device (101) according to any one of claims 1 to 3, wherein, The device (101) is configured to: Determine whether an occupant of the vehicle (100) can only see the other vehicle (112) or can also see an occupant of the other vehicle (112); and Output the personal-related data to an occupant of the vehicle (100) only when it is determined that the occupant of the vehicle (100) can also see an occupant of the other vehicle (112).

8. The device (101) according to claim 1, wherein, The interactive game is a guessing game or an allocation game.

9. A method (400) for providing information in a vehicle (100), wherein, The method (400) includes: Determining (401) personal-related data related to an occupant of another vehicle (112) in the environment of the vehicle (100) and / or vehicle-related data related to the other vehicle (112); and Outputting (402) the personal-related data and / or the vehicle-related data to an occupant of the vehicle (100), wherein a graphical representation of the other vehicle (112) and an information area are displayed, the information area being superimposed on the graphical representation (300) of the other vehicle (112), and the personal-related data and / or the vehicle-related data being displayed in the information area; wherein the information area (313) is output on a glass of the vehicle (100) through which an occupant of the vehicle (100) can see the other vehicle (100); and Among them, an interactive game is provided for the occupants of the vehicle (100) based on personal-related data and / or vehicle-related data.

Citation Information

Patent Citations

  • Full-windshield head-up display interface for social networking

    CN102447731A

  • Vehicle generated social network updates

    CN105096199A