Control of a motor vehicle

Abstract

The invention relates to a method (200) for controlling a motor vehicle (105), having the steps of scanning (215) a person (120) on board the motor vehicle (105); determining (220) an action of the person (120); determining (230) a safety event on the basis of the action; and providing (240) a warning on board the motor vehicle (105).

Description

[0001] Control of a motor vehicle

[0002] The present invention relates to the control of a motor vehicle. In particular, the invention relates to maintaining a safe state of the motor vehicle.

[0003] A motor vehicle is designed to transport one or more people. Responsibility for the vehicle and its passengers typically lies with the driver. The driver may be informed about which activities are acceptable and which are not. This may, for example, concern the use of a safety feature such as an airbag or seatbelt, the careful handling of the vehicle, or appropriate behavior on public roads.

[0004] It can be difficult for the driver to maintain an overview of the actions of all passengers in addition to controlling the vehicle. If a passenger is in a second or even further back row of seats, they may be difficult to see from the driver's position. Furthermore, there may be too many passengers on board for the driver to keep everyone in view at all times.

[0005] A second person on board may not be qualified to be a driver and may not be fully informed about appropriate behavior in a motor vehicle. Due to ignorance, overconfidence, or another reason, the person may endanger the safety of the motor vehicle, for example, by opening a window and extending an arm. This could pose a risk of another road user, such as a pedestrian or cyclist, colliding with the arm. To avoid an accident, the person should be informed in a timely manner about any danger that their behavior may pose.

[0006] An object underlying the present invention is to provide an improved technology for warning of a safety event induced by a person on board a motor vehicle. The invention solves this problem by means of the subject matter of the independent claims. Subclaims specify preferred embodiments.

[0007] According to a first aspect of the present invention, a method for controlling a motor vehicle comprises steps of sensing a person on board the motor vehicle; determining an action of the person; determining a safety event based on the action; and providing a warning on board the motor vehicle.

[0008] According to the procedure, it can be determined whether any person on board the motor vehicle is behaving in a manner that could endanger safety in the area of ​​the motor vehicle. This check can be performed continuously and for each person on board the motor vehicle. By automatically determining a safety event, a timely warning can be provided so that the safety event can be addressed quickly and the safety of the motor vehicle can be maintained.

[0009] The safety event may include an event that endangers the safety of the motor vehicle, the person, another person on board the motor vehicle, or another road user. The danger may be of a material or health-related nature, particularly if another event occurs, such as a collision of the motor vehicle with an object.

[0010] Preferably, the safety event is determined depending on the driving condition of the motor vehicle. Certain actions may be acceptable or unacceptable in different driving conditions. For example, opening a seat belt buckle may generally be unacceptable; however, if the motor vehicle is stopped at a red light, temporarily opening the seat belt buckle, for example so that a person can put on or take off a jacket, may be acceptable. Depending on the driving condition, an action that the person should perform can also be determined. If the action is not performed, this can be classified as a passive action that can lead to a safety event. For example, carrying a pet without appropriate restraint can be considered a passive action that leads to a safety event when the motor vehicle is set in motion.The safety event can also be determined depending on whether the person is a driver of the motor vehicle or not. The driver is usually located in a predetermined driver's seat of the motor vehicle. An action that is acceptable for a passenger, such as talking on the phone with another person, may not be acceptable for the driver, at least not while they are driving the motor vehicle. Different catalogs of behavior can therefore be predetermined for the driver and a passenger, which may include unacceptable actions. Other examples of actions that may be permitted for a passenger but not for a driver may include consuming alcohol or another substance that impairs driving ability.

[0011] The safety event can also be determined depending on whether the person is an adult or a child. For example, a safety event can be determined when a child is about to operate a control of the motor vehicle, such as a gear lever or steering wheel. In the case of an adult, such an operation can be assumed to be calculated and reasonable. If the warning is addressed to the person, it can be worded appropriately depending on the person's age. A warning issued to a child can be shorter and use simpler language than a warning addressed to an adult.

[0012] In a further embodiment, a driver of the motor vehicle is provided with an indication of a safety event that has been determined regarding another person. The indication may include the warning or be provided in addition to the warning. The indication is preferably not very detailed and essentially only indicates that a safety event has occurred and, optionally, the person responsible for the event. The warning may be more complex and include information about the type of safety event, its possible consequences, or an accompanying circumstance.

[0013] In one embodiment, the motor vehicle is controlled without a driver. This means that no person on board the motor vehicle can automatically be responsible for ensuring that no safety event occurs. According to the method, the automatic monitoring of persons on board the motor vehicle and the automatic provision of a warning before a safety event occurs can contribute to ensuring that the persons on board the motor vehicle behave appropriately. The safety of the motor vehicle, the persons on board the motor vehicle, or any other person outside the motor vehicle can be better ensured in this way.

[0014] The warning may be provided in response to a previously issued warning regarding a security event. For example, the warning may be more forceful or concise for consecutive security events. Such an escalation may be particularly useful if the same person repeatedly triggers a security event or the same security event is triggered repeatedly.

[0015] If the motor vehicle is controlled by a driverless vehicle, the warning may include a change in control. Initially, the motor vehicle may be controlled in a manner that potentially increases overall safety, for example, by reducing driving speed or controlling the vehicle with a more defensive strategy. If necessary, the motor vehicle may also be stopped to resolve a safety event that has already occurred or to terminate the transport of a person on board to reduce the risk of further safety events. If the motor vehicle is controlled by a human driver, a corresponding recommendation for controlling the motor vehicle may be provided to the driver.

[0016] The warning may be provided together with an explanation or further information. For example, the warning may include a reference to a hazard associated with the safety event. In a further embodiment, the warning includes a reference to an alternative action that does not trigger a safety event. This may take into account the possible purpose of the person's action. For example, if a passenger places their feet on a dashboard, a safety event may be triggered if the motor vehicle has an airbag that could be deployed in the area of ​​the passenger's feet. As an alternative action, the offer may be to adjust a passenger's seat so that they have more legroom or a different seat angle.According to a further aspect of the present invention, a device for controlling a motor vehicle comprises a sensing device for sensing a person on board the motor vehicle and a processing device. The processing device is configured to determine an action of the person; determine a security event based on the action; and provide a warning to the person.

[0017] The processing device is preferably configured to partially or completely execute a method described herein. For this purpose, the processing device can be implemented electronically and, for example, comprise an integrated circuit, a programmable logic module, or a programmable microcomputer. The method can be implemented in the form of a configuration or as a computer program product with program code means for the processing device. The configuration or the computer program product can be stored on a computer-readable data carrier. Features or advantages of the method can be transferred to the device, or vice versa.

[0018] Preferably, a plurality of scanning devices are provided, wherein the processing device is configured to fuse scans from the scanning devices. Based on the merged scans, an action of a person on board the motor vehicle can be determined with improved accuracy or reliability. Exemplary scanning devices include a camera, a radar sensor, a LiDAR sensor, or an ultrasonic sensor. A scanning device can also include another scannable element on board the motor vehicle, for example, a door contact, an operating element that can be actuated by a person, a seat contact that determines the occupancy of a seat for a person on board the motor vehicle, or a belt buckle for determining whether a seat belt is fastened or not.

[0019] The device further preferably comprises an output device for providing the warning. The warning can be provided generally on board the motor vehicle so that several or all persons can perceive the warning, or it can be provided individually. The individual provision can be directed in particular to the person whose action led to the determination of the safety event. The output device can be configured to issue an acoustic, a visual, a haptic, or a combined warning. Example output devices include a loudspeaker, a visual display, VR glasses (VR: virtual reality), or a vibration motor for providing a haptic warning. In a further embodiment, the warning can also be forwarded to a device on board the motor vehicle via a wireless interface.In particular, the device can be assigned to the person whose action caused the security event. The device can, for example, be a smartphone, laptop, or tablet computer.

[0020] According to yet another aspect of the present invention, a motor vehicle comprises a device described herein. The motor vehicle preferably comprises a passenger car, a truck, or a bus.

[0021] The invention will now be described in more detail with reference to the accompanying drawings, in which:

[0022] Figure 1 shows a motor vehicle with a control device;

[0023] Figure 2 is a flowchart of a method; and

[0024] Figure 3 illustrates exemplary actions of persons on board a motor vehicle.

[0025] Figure 1 shows a control device 100 on board a motor vehicle 105. Another road user 110 may be located outside the motor vehicle 105. The motor vehicle 105 is configured to transport multiple persons 115. For example, four persons 115 are on board the illustrated motor vehicle 105. A person 115 shown in a front left seat, holding a steering wheel in Figure 1, may be a driver of the motor vehicle 105. Other persons 115 on board the motor vehicle 105 may be considered co-drivers or passengers. The control device 100 comprises a processing device 120, at least one scanning device 125, and preferably an output device 130.

[0026] Figure 1 shows several scanning devices 125 by way of example. A scanning device 125 shown centrally comprises a camera or other optical scanning device 125 configured to perform an optical scan of the interior of the motor vehicle 105. The camera 125 preferably operates at wavelengths visible to the human eye. In a further embodiment, an infrared camera or another camera operating in the non-visible light spectrum can also be used.

[0027] On the right and left sides of the motor vehicle 105, further scanning devices 125 are indicated, which are configured to scan an exterior area or the surroundings of the motor vehicle 105. For example, these scanning devices 125 can comprise cameras that are part of a camera-monitor system that replaces the exterior mirrors of the motor vehicle 105. Cameras that can operate, for example, in the visible light spectrum and / or the infrared spectrum can also be used.

[0028] Further preferably, an interface 135 is provided, which can be connected to another scanning device or a system or subsystem on board the motor vehicle 105. The connection can be established, for example, via a data bus that interconnects a plurality of sensors or control units on board the motor vehicle 105. For example, a sensor such as a seat belt buckle or a seat occupancy sensor on board the motor vehicle 105 can be scanned via the interface 135.

[0029] In the embodiment of Figure 1, the output device 130 is illustrated as a loudspeaker by way of example. However, a variety of output options on board the motor vehicle 105 can be utilized by the control device 100. For example, a visual warning can be provided by means of a display 140 that is visible to one person 115 individually or to multiple people 115. An individually usable display 140 for one person 115 can be located, for example, in a headrest of a seat located in front of them. A generally visible display 140 can be located, for example, in a center console between the driver and a passenger sitting next to them.

[0030] In yet another embodiment, the control device 100 comprises a wireless interface 145. A personal device 150 of a person 115 can be communicatively connected via this interface 145. A warning can be provided to the person 115 via this connection. Similarly, the person 115 can wear a VR helmet or VR glasses that are connected to the control device 100 via the wireless interface 145. In this way, a warning can be displayed in a virtual space in which the person 115 is located.

[0031] A warning can generally be presented in any desired manner, for example visually, acoustically, or haptically. In the case of a visual presentation, a symbol or information text can be output, for example. Preferably, an avatar can be used to provide the warning. The avatar can represent the motor vehicle 105 or an intelligence controlling or monitoring the motor vehicle 105. The avatar can be humanoid or take any other form. In one embodiment, the avatar is integrated into a general information system on board the motor vehicle 105.

[0032] The control device 100 is configured to preferably scan all persons 115 on board the motor vehicle 105 and to determine actions performed by the persons 115. Depending on a driving state of the motor vehicle 105, an action can be evaluated or examined to determine whether or not it endangers safety in the area of ​​the motor vehicle 105. If a hazard is identified, a safety event may have occurred. A warning can then be provided to one or more persons 115 on board the motor vehicle 105. The warning can further specify a type of safety event and / or a person 115 whose action triggered the safety event.

[0033] The aim of the control device 100 is to control persons 115 on board the motor vehicle

[0034] 105 from behaving in a manner that could endanger the safety of themselves, the motor vehicle 105 or a road user 110 outside the motor vehicle 105.

[0035] Figure 2 shows a flowchart of an exemplary method 200 for controlling a motor vehicle 105. The method 200 can preferably be carried out by means of a control device 100.

[0036] In a step 205, an interior of the motor vehicle 105 can be scanned. In particular, an interior camera or a similar scanning device 125 can be used for this purpose. Optionally, in a step 210, an exterior of the motor vehicle 105 can be scanned. The scanning of the exterior can be used to determine a driving state of the motor vehicle 105. Furthermore, it can be determined, for example, whether a person 115 is about to leave the motor vehicle 105 or extend a body part out through a window of the motor vehicle 105.

[0037] Scans from the different scanning devices 125 can be merged with one another. More preferably, information obtained via the interface 135 can also be evaluated. This information can, in particular, relate to a sensor value from a sensor in the interior of the motor vehicle 105 or a state of a device on board the motor vehicle 105.

[0038] In a step 215, a person 115 can be detected based on the acquired information. An action of the person 115 can be determined in a step 220. For this purpose, a posture of the person 115 can be observed over a predetermined period of time. An activity or an action of the person 115 can be derived from the observations.

[0039] In a step 225, a context of the action can be determined. The context can include, for example, a previous action, the action of another person 115 on board the motor vehicle 105, or a driving state of the motor vehicle 105.

[0040] In a step 230, it can be determined whether a safety event has occurred based on a specific action of person 115 and, optionally, a function of person 115. For this purpose, a specific action of person 115 can be compared with a catalog of unacceptable actions that applies in the present context. Different catalogs of unacceptable actions can be predetermined for different persons 115. Whether an action is acceptable or not can depend on whether person 115 includes a child or an adult, whether person 115 concerns a driver of motor vehicle 105 or not, and which individual person 115 is being examined.

[0041] If it is determined in step 230 that a security event has occurred, a warning can be determined in step 235. The warning can be related to the security event that has occurred and, in particular, can contain information about which action led to the triggering of the event and / or which person 115 is associated with the triggering. Further information can be provided, for example, a suggestion for an alternative action or instructions about the possible consequences of the action.

[0042] In a step 240, the warning can be provided. In various embodiments, the warning can be provided to the person 115 involved in the occurrence of the security event, multiple persons 115 in the area of ​​this person 115, and / or all persons 115 on board the motor vehicle 105.

[0043] Figure 3 shows exemplary actions of persons 115 on board a motor vehicle 105. The actions shown can each lead to the triggering of a safety event.

[0044] A person 115 located in the front left of the motor vehicle 105 acts by handling a personal device 150, such as a smartphone. This is unacceptable if the person 115 is a driver of the motor vehicle 105. Otherwise, the action cannot result in a safety incident.

[0045] A person 115 located in the front right has placed their feet on a dashboard of motor vehicle 105. An airbag is embedded in the dashboard, which can be deployed if motor vehicle 105 collides with an external object. In this case, person 115 can suffer serious injuries to their legs from the deploying airbag.

[0046] A person 115 in the rear left seat is not wearing a seatbelt. In the event of an accident involving motor vehicle 105, this person 115 may be thrown uncontrollably within the motor vehicle 105. This could seriously injure the person 115 or another person 115.

[0047] A person 115 located in the rear right corner sticks their head out through a window of the motor vehicle 105. In doing so, the person 115 may be injured by an object or another road user 110 located outside the motor vehicle 105. Furthermore, the person 115 may suffer health damage from strong winds or from objects in the ambient air, such as insects or grains of sand.

[0048] In an area between or behind the persons 115 in the second row of seats, there is a pet 305 that is unsecured on board the motor vehicle 105. Although the pet 305 may not count as a person 115, a person 115 responsible for the pet 305 may be designated. For example, a person 115 who is close to the pet 305 may be considered responsible. If this person 115 fails to secure the pet 305 on board the motor vehicle 105, this may be considered a passive action that triggers a safety event.

[0049] The purpose of the present invention is to ensure safety on board a motor vehicle 105. To this end, persons 115 on board the motor vehicle 105 are to be guided in the event of a safety incident in a friendly and harmonious manner to improve their behavior so that safety in the area of ​​the motor vehicle 105 is uncompromised. A warning of a safety incident is therefore preferably designed to be friendly and can only become more persistent, insistent, or generally unpleasant for the person 115 addressed in the event of further safety incidents. It is preferably assumed that a person 115 who acts in such a way that a safety incident occurs does so out of ignorance. Reference numerals

[0050] 100 control device

[0051] 105 Motor vehicle

[0052] 110 road users

[0053] 115 people

[0054] 120 processing facility

[0055] 125 scanning device

[0056] 130 Output device

[0057] 135 Interface

[0058] 140 ad

[0059] 145 wireless interface

[0060] 150 personal devices

[0061] 200 procedures

[0062] 205 Scan the interior of the vehicle

[0063] 210 Scan the exterior of the vehicle

[0064] 215 people recorded

[0065] 220 Determine action

[0066] 225 Determine context

[0067] 230 Determine security event

[0068] 235 Determine warning

[0069] 240 Provide warning

[0070] 305 Pet

Claims

Claims 1. A method (200) for controlling a motor vehicle (105), the method (200) comprising the following steps: Scanning (215) a person (120) on board the motor vehicle (105); determining (220) an action of the person (120); Determining (230) a security event based on the action; and Providing (240) a warning on board the motor vehicle (105).

2. The method (200) according to claim 1, wherein the safety event comprises an event that endangers the safety of the motor vehicle (105), the person (120), another person (120) on board the motor vehicle (105) or another road user (110).

3. The method (200) according to claim 1 or 2, wherein the safety event is determined as a function of a driving state (225) of the motor vehicle (105).

4. The method (200) according to any one of the preceding claims, wherein the security event is determined depending on whether the person (120) is a driver of the motor vehicle (105) or not.

5. The method (200) according to any one of the preceding claims, wherein the security event is determined depending on whether the person (120) is an adult or a child.

6. The method (200) according to any one of the preceding claims, wherein a driver (120) of the motor vehicle (105) is provided with an indication of a security event determined with respect to another person (120).

7. Method (200) according to one of the preceding claims, wherein the motor vehicle (105) is controlled driverlessly.

8. The method (200) according to any one of the preceding claims, wherein the warning is provided in dependence on a previously given warning regarding a security event.

9. The method (200) of any preceding claim, wherein the warning includes an indication of an alternative action that does not trigger a security event.

10. A device (100) for controlling a motor vehicle (105), the device (100) comprising the following elements: a scanning device (125) for scanning a person (120) on board the motor vehicle (105); and a processing device (120) configured to determine an action of the person (120); to determine a security event based on the action; and to provide a warning to the person (120).

11. The device (100) according to claim 10, wherein a plurality of scanning devices (125) are provided and the processing device (120) is configured to fuse scans of the scanning devices (120) with one another.

12. The device (100) of claim 10 or 11, further comprising an output device (130, 140, 150) for providing the warning.

13. Motor vehicle (105) comprising a device (100) according to one of claims 10 to 12.

Images