Method and apparatus for controlling displayed content on a vehicle output device
By detecting the various state parameters of the vehicle and passengers, adjusting the display content of the vehicle output device, the problem of failure to fully consider the degree of automation and other factors in the prior art is solved, and more effective display content management is achieved, which improves the driver's Focusing and driving safety in autonomous driving and harsh environments.
Patent Information
- Application Number
- CN201980066324.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-10-11
- Filing Date
- 2019-09-27
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2039-09-27
AI Technical Summary
The prior art fails to fully consider the degree of automation and other influencing factors when controlling the display content on the vehicle output device, resulting in the inability to effectively adjust the display content to improve the driver's attention, especially in autonomous driving or inclement weather conditions.
By detecting the status parameters of the vehicle or passenger, including geographic data, output device user, driving status and driver status, the display content on the output device is determined based on the degree of automation and these parameters, ensuring that the display content is adapted to the current driving environment and driver status, such as limiting the opening of distraction content during autonomous driving.
It realizes a more targeted coordination of display content, improves drivers' attention in different driving modes and environments, ensures that display content is adjusted in a timely manner when the degree of automation and geographical data changes, reduces secondary activities, and improves driving safety.
Smart Images

Figure CN112839835B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a method and a device for controlling display contents on an output device of a vehicle. Background Art
[0002] DE 10 2009 050 056 A1 discloses a method for outputting information on an output device of a vehicle, wherein different display contents are enabled depending on a parking mode or a driving mode of the vehicle.
[0003] A disadvantage is that other influencing factors relevant to the degree of automation are not taken into account when controlling the displayed content. Summary of the invention
[0004] It is therefore an object of the present invention to provide an improved method and an improved device for controlling display contents on a vehicle screen.
[0005] This object is achieved according to the invention by a method having the features of claim 1 and a device having the features of claim 7 .
[0006] Further advantageous embodiments of the invention are the subject matter of the dependent claims.
[0007] In the method according to the invention, at least one further state parameter of the vehicle or of the passengers is detected, wherein the state parameter comprises vehicle geographic data, and the display content on the output device is determined as a function of the degree of automation and the at least one further state parameter, wherein the vehicle comprises a plurality of output devices and the display content that is enabled is determined individually for each of the plurality of output devices, depending on whether the vehicle driver or the front passenger interacts with the output device by sight and / or gesture. By taking into account states that influence the attention of the vehicle passengers, in particular the driver, the method advantageously allows the display content to be coordinated more specifically. For example, in the case of partially automated or fully automated driving, the driver can in principle be more distracted by secondary activities than in manual driving. Furthermore, due to the driver's physical condition or bad weather conditions, according to the invention, secondary activities can be further reduced by limiting the access to the output content on the output device, thereby increasing attention according to the situation. In the present case, "limited access" means, more precisely, "disabling of content". For example, if only text display is enabled on the screen, then movies will be disabled as a result. Furthermore, it is taken into account individually: which person in the vehicle should see which content and which display content can be seen on which output device. The vehicle environment contained in the geographic data is determined, for example, by means of a map and the current geographic location of the vehicle. By taking the geographic data into account, it is allowed to output display content according to geographical conditions such as narrow lanes, curves, construction sites or intersections that require the driver to pay more attention. Therefore, attention is improved because the range of the displayed content is adapted to the geographic data, that is, the geographical conditions of the current vehicle location. The output device in the vehicle includes a screen, a mobile device, a head-up display, a projector or a hologram. The display content is opened according to the output device that can be selected for output. In the case where various different output devices are provided in the vehicle, a separate display content range can be opened for each output device according to the degree of automation of the driving operation. For example, the driver looks at multiple displays, namely the dashboard, the main unit display arranged next to the dashboard, the display of the head-up display, and perhaps other screens that can be viewed by the driver and the co-driver. The method allows, for example, in partially autonomous driving, not to open distracting content on the dashboard, but only to open driving information, to open text on the display of the main unit, to open information about the surrounding environment on the head-up display, and to open movies on other screens.
[0008] According to one embodiment of the invention, the current geographic data of the vehicle include in particular the identification of the country in which the vehicle is traveling. With the vehicle position depicted by GPS data and using a map, the vehicle geographic data defining the country / region in which the vehicle is currently traveling can be determined. The display content suitable for the respective country determined according to the degree of automation of the driving operation is stored in the control unit. Therefore, the display content for different degrees of automation can be automatically adjusted according to the country in which the vehicle is traveling, in particular according to the legal provisions of the country.
[0009] According to another design of the invention, the status parameter includes the driver, the co-pilot or another passenger as the user of the output device. The display content is activated depending on the person interacting with the output device. The user of the output device is determined by means of a mechanism known from the prior art for eye tracking and / or gesture tracking. Different display contents can be advantageously opened depending on the person interacting with the display by eye and / or gesture. For example, if the driver interacts with the main unit display, a first display content is opened, and if only the co-pilot interacts with the same display, a second display content is opened. Accordingly, by knowing who is interacting with the output unit, the display contents for multiple output units can be controlled independently of each other.
[0010] According to another embodiment of the invention, the vehicle state includes a driving situation, in particular a dangerous driving situation. For example, a dangerous driving situation can be determined by intervention of an assistance system or by means of sensors such as speed sensors, acceleration sensors or yaw rate sensors. If the speed, acceleration and / or yaw rate exceeds a preset threshold value or if an assistance system intervenes to stabilize the vehicle, the corresponding display content is opened separately on the different display devices according to the degree of automation. The opening of the display content on the output unit when driving with different degrees of automation can be advantageously adapted to the dangerous driving situation.
[0011] According to another embodiment of the present invention, the driver status includes the current state of the driver. The driving state of the driver is determined by means of pulse monitoring methods, eye monitoring methods, etc. known from the prior art. The opening of the display content can be advantageously adapted to the current driver state, for example in the case of partially automated driving or fully automated driving.
[0012] The device has a mechanism for determining the degree of automation of the driving state of the vehicle and a control unit for opening display contents that can be displayed on the output device according to the degree of automation. According to the invention, the control unit opens the display contents that can be displayed on the output device according to the degree of automation and at least one other state parameter measured by a sensor (including vehicle geographical data, output device user, driving situation and / or driver status), wherein the vehicle comprises a plurality of output devices, and the control unit opens corresponding display contents on the plurality of output devices respectively, which depends on whether the vehicle driver or the co-driver interacts with the output device by sight and / or gesture. With the help of the device, in addition to the degree of automation, other influencing factors are taken into account when determining the scope of the display contents to be opened and the driver is ensured to focus on the driving activity. The device allows to open the display contents separately on each output device according to the degree of automation and according to other state parameters of the vehicle, driver or passenger. For example, in manual driving, only driving data such as speed or navigation data are opened on the screen that can be viewed by the driver, while movies are opened on the screen of the co-driver or rear passenger. With the switch to fully automatic driving, movies can also be opened on the screen assigned to the driver.
[0013] According to another embodiment, the association between the degree of automation and other status parameters and the display content to be opened on the display device or devices is stored in a parameter set of the control unit. A parameter set is to be understood as a data set that can be modified in the control unit by suitable means for updating. For this purpose, the parameter set is stored in a flash memory and can be overwritten at any time by a new parameter set.
[0014] According to one embodiment, the parameters can be synchronized with a set of changeable parameters stored on a server. For example, in the case of frequently changing statutory requirements in different countries, it can be advantageous to keep the fleet up to date without delay by synchronizing data with the server. For this purpose, the set of parameters on the server is changed according to the current requirements and synchronized with the storage unit of the control unit of the target vehicle.
[0015] Further advantages, features and details emerge from the following description, which describes in detail at least one exemplary embodiment with reference to the drawings, as appropriate. The features described and / or shown in the drawings may form the subject matter of the invention individually or in any meaningful combination, which may also be independent of the claims and in particular may also be the subject matter of one or more separate applications. Identical, similar and / or functionally identical components are provided with the same reference numerals. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The accompanying drawings show:
[0017] Figure 1 A schematic side view of a vehicle having a device for carrying out the method according to the invention is shown;
[0018] Figure 2 Show Figure 1 A schematic diagram of the interior of a vehicle;
[0019] Figure 3 A flow chart showing the method process is shown. DETAILED DESCRIPTION
[0020] Figure 1 The vehicle 1 shown comprises a device 3 for determining the degree of automation of the driving operation. Depending on the degree of automation, the vehicle 1 is driven manually by the driver, semi-automatically controlled at different levels, or fully automatically controlled without driver intervention.
[0021] In the control unit 5 provided in the vehicle 1, parameters are stored in a parameter set 17, which contain the various automation levels that can be implemented by the vehicle 1. In addition, parameters are stored for defining further status parameters such as geographic data, output device user, driving situation or the current state of the driver. The automation level together with the further parameters form a parameter block that defines the corresponding display content that is available for the output device of the vehicle 1.
[0022] For example, the parameters block defines:
[0023] a. For the host used to show the display content,
[0024] b. During autonomous driving,
[0025] c. When driving in Italy
[0026] d. When the driver looks at the host display,
[0027] e. in so-called normal driving situations where no intervention of the assistance systems is required; and
[0028] f. If the current driver is in good condition,
[0029] Watching movies is permitted as a secondary activity for drivers.
[0030] The range of the parameter block can be arbitrarily limited, that is, in an alternative simplified embodiment, the parameter block can, for example, only include parameters a, b, c. The parameters in the parameter block can be arbitrarily adjusted and stored in the control unit 5, that is, for example, the legal requirements of different countries can be reflected by the parameters, and updated for new regulations as appropriate. The parameter group 17 stored in the control unit 5 includes a plurality of parameter blocks for individually defining the display content to be opened on different display devices according to different states of the vehicle or passengers.
[0031] The display content to be opened may for example relate to movies, animations, vehicle data, texts, images, operating menus, etc. Of course, any display content may not be opened, so that the screen is locked to a certain extent.
[0032] The parameter set 17 stored in the control unit 5 is synchronized continuously or on demand with the parameter set 19 stored on the server 15. A permanent or at least temporarily effective communication link is established between the vehicle 1 and the server 15 by means of a communication module not shown. By synchronizing with the vehicle 1, changes in the parameter set 19 on the server 15 are sent to the control unit 5. It is also sent to the entire fleet accordingly. In an alternative method, the parameter set 17 can be manually updated in the factory using a device provided for communication with the control unit.
[0033] If the state parameters of the vehicle 1 and / or of the passengers measured by the sensors match the state parameters defined in the parameter block, the display contents correspondingly assigned to the display device in the parameter block are opened accordingly.
[0034] In addition to the degree of automation, further state parameters of the vehicle or of the passengers are determined in vehicles using sensors as described in greater detail below.
[0035] In order to determine the vehicle geographic data, a large amount of data from a satellite 8 is received by means of a sensor with a GPS receiver 7, and the geographical location of the vehicle 1 is determined. In conjunction with a map (not shown), the vehicle's geographic data can be determined based on the geographical location. The geographic data include, for example, the name of the country in which the vehicle 1 is traveling, the name of the highway on which it is traveling, the name of the city street on which it is traveling. In addition, the geographic data can include winding roads, mountainous areas or areas with special traffic regulations on which the vehicle is traveling, etc.
[0036] The vehicle state also includes driving situation information, such as current weather conditions determined by sensors such as rain sensors and temperature sensors. Sensors for determining driving situations are also sensors 12 of assistance systems for identifying dangerous traffic situations, such as rotation speed sensors of ESP systems.
[0037] The driver's state is also determined by sensors, such as the sensor 11 for pulse measurement or a camera.
[0038] The user of the output device is determined by a sensor, such as a camera 13. The camera 13 determines, for example, whether the driver or the front passenger is interacting with a centrally arranged screen, the instrument panel or another screen.
[0039] Figure 2The interior of a vehicle 1 with various output devices is shown. The output devices include an instrument panel 19, a main unit display 21, a passenger display 23, and a smartphone display 25. The corresponding display content opened on each output device 19, 21, 23, 25 is determined individually by the control unit 5 using a parameter set 17 including various parameter blocks.
[0040] The parameter block contains, for example, the following parameters and specifies:
[0041] a. For a mobile device for showing display content,
[0042] b. When driving manually,
[0043] c. When driving in Germany,
[0044] d. When the co-pilot looks at the display of the mobile device,
[0045] e. in so-called normal driving situations where no intervention of the assistance system is required; and
[0046] f. When the driver is in good condition,
[0047] Allow, i.e. authorize, the co-pilot to watch movies on the mobile device.
[0048] If it is determined that the state parameters of the vehicle and / or the driver or other passengers determined by the sensors match the parameter values of the parameter block, the control unit 5 accordingly opens the movie to the co-pilot on the mobile device 25. As soon as the co-pilot requests a movie in this case, it is immediately displayed on the mobile device.
[0049] However, as soon as the driver directs his gaze towards the mobile device 25, the determined state parameters of the vehicle and / or the driver will no longer correspond to the previously described parameter block. If the driver directs his gaze towards the mobile device, the state parameters of the vehicle and / or the driver will correspond to another parameter block. Compared to the provisions of the previously mentioned parameter block item d, the corresponding parameter block then has the definition "when the driver is looking at the display of the mobile device 25" and, for example, the following definition: no display content is opened on the mobile device 25. The control unit 5 therefore prevents any display content from being output on the mobile device.
[0050] In another parameter block, for example:
[0051] a. a display of the host computer 21 for showing the displayed content,
[0052] b. In fully autonomous driving,
[0053] c. When driving in Germany,
[0054] d. When the driver looks at the display of the host 21,
[0055] e. in so-called normal driving situations where no intervention of the assistance system is required; and
[0056] f. When the current driver is in good condition,
[0057] Drivers are allowed to watch movies.
[0058] As soon as the vehicle crosses a national border, another parameter block that lists another country under parameter c applies. If the movie is not allowed in the other country, the movie is not allowed (i.e. prohibited) according to this parameter block. When entering another country from Germany, the vehicle identifies the new country with the help of a GPS receiver and a map, the corresponding parameter block containing the new country is adopted, the open range of the display content assigned to this parameter block is read and applied to the corresponding output device, i.e. the display of the host 21, via the control unit 5.
[0059] according to Figure 3 The flowchart of FIG. 1 reproduces the method of the present invention. In step S100, the degree of automation of the driving state of vehicle 1 is determined. In addition to the degree of automation, further state parameters of the vehicle and / or the passengers are determined in step S102. The state parameters determined in S102 include vehicle geographic data. Alternatively or additionally, the further state parameters include the user of one of the output devices, the driving situation or the passenger, preferably the driver.
[0060] In step S104 , the measured degree of automation and the measured further state parameters are compared with the parameter set 17 stored in the memory unit 5 .
[0061] In step S106, a parameter block is determined from the parameter set 17, which corresponds to the determined degree of automation and further state parameters. In step S108, the relevant release range of the display content is read from this parameter block for the output device 19, 21, 23, 25 that can be selected by the user. In S110, the release range is applied to the selected output device 19, 21, 23, 25. For example, the control unit 5 sends to the output device 19, 21, 23, 25 which display content is released and can be displayed.
[0062] Although the present invention has been shown and described in detail by preferred embodiments, the present invention is not limited to the disclosed examples and other changes may be derived therefrom by those skilled in the art without departing from the scope of protection of the present invention. It is therefore obvious that there are many possible variations. It is also obvious that the embodiments described by way of example are in fact only examples and should never be understood as limitations on the scope of protection, possible applications or configurations of the present invention, for example. On the contrary, the foregoing description and the accompanying drawings enable those skilled in the art to implement the embodiments, wherein the technician, with an understanding of the disclosed inventive concept, can, for example, make various changes to the functions or arrangements of the multiple components as mentioned in the embodiments, without departing from the scope of protection defined by the claims and their legal equivalents, as specifically described in the specification.
Claims
1. A method for controlling display content on a vehicle output device, the method comprising the following steps: - determining the degree of automation of the vehicle driving state (S100), - determining a display content on the output device which is assigned to the determined degree of automation, and - making available a predetermined display content on the output device, It is characterized in that - determining at least one further state parameter of the vehicle or of the passenger (S102), wherein the at least one further state parameter comprises geographical data of the vehicle, a current state of the driver determined by means of a pulse monitoring method or an eye monitoring method, wherein the geographical data of the vehicle comprises the flag of the country in which the vehicle is travelling, and - Determining display content on an output device based on the degree of automation and the at least one further state parameter (S108), wherein the vehicle comprises a plurality of output devices and the open display content is determined individually for the plurality of output devices, depending on whether the driver or the co-driver of the vehicle interacts with the output device through sight and / or gestures.
2. The method according to claim 1, characterized in that The state parameters include the driver, the co-driver or other passengers as users of the output device.
3. The method according to claim 1 or 2, characterized in that: The state parameters include the driving situation.
4. The method according to claim 1 or 2, characterized in that: The status parameters include the current status of the co-pilot and / or other passengers.
5. A device for controlling a display content on an output device (19, 21, 23, 25) of a vehicle (1), the device being designed to carry out the method according to any one of the preceding claims, the device comprising: - means (3) for determining the degree of automation of the driving state of the vehicle (1), a control unit (5) which, depending on the degree of automation, opens display contents that can be displayed on an output device (19, 21, 23, 25), It is characterized in that The control unit (5) opens display content that can be displayed on an output device (19, 21, 23, 25) based on the degree of automation and at least one other status parameter measured by the sensor (7, 11, 12, 13), wherein the at least one other status parameter includes vehicle geographical data, output device user, driving conditions and / or driver status or passenger status, wherein the vehicle includes multiple output devices (19, 21, 23, 25) and the control unit (5) opens separate display content on each of the multiple output devices, depending on whether the driver or co-driver of the vehicle interacts with the output device through sight and / or gestures.
6. The device according to claim 5, characterized in that A correspondence between the degree of automation and other status parameters and the display contents to be displayed on one or more output devices (19, 21, 23, 25) is stored in a parameter set (17) of the control unit (5).
7. The device according to claim 6, characterized in that The parameter set (17) can be synchronized with a variable parameter set stored on a server (15).
