METHOD FOR SECURING A PASSENGER COMPARTMENT OF A MOTOR VEHICLE, CONTROL DEVICE FOR A MOTOR VEHICLE, MOTOR VEHICLE WITH A PASSENGER COMPARTMENT

Description

[0001] The present invention relates to a method for securing the passenger compartment of a motor vehicle.

[0002] Especially in autonomous vehicles, there is a growing desire to occupy oneself with other things during the journey, such as a mobile smartphone, a laptop, a book, or similar items. However, this poses the risk that the object could be in the airbag's deployment path when it inflates. This could result in the object being propelled uncontrollably through the vehicle's passenger compartment.

[0003] A solution to overcome this problem is proposed in DE 10 2014 010 345 B3. This system uses a sensor to detect the position of a mobile device in the passenger compartment of a vehicle. Based on this data, the system determines whether the mobile device is located within a predetermined, unobstructed safety zone. This safety zone could, for example, be the area between an airbag and a vehicle occupant. If the mobile device is within the safety zone, the system would, for example, deactivate the device or issue a corresponding warning message.

[0004] Furthermore, it may be provided that the mobile device is restrained by means of a restraint device as soon as it assumes a position in the security area.

[0005] A similar system is disclosed in DE 10 2016 223544.

[0006] The object of the present invention is to provide an improved concept for securing the passenger compartment of a motor vehicle.

[0007] According to the invention, the problem is solved in a method of the type mentioned at the outset by comprising the following steps: a) Determining at least one object position information concerning a position and at least one object extent information concerning a spatial extent and at least one object property information concerning a property of at least one object located in the passenger compartment; b) Determining one hazard area position information concerning a position and one hazard area extent information concerning a spatial extent of a hazard area, each depending on the object property information, wherein the hazard area is that area of ​​the passenger compartment in which the deployment of a vehicle airbag causes a movement of the object that poses a risk of injury to a vehicle occupant, provided that the object is at least partially located in the hazard area; c) Verifying the fulfillment of a hazard condition that has been met.if the object position information, object extent information, hazard area position information, and hazard area extent information imply that the object is at least partially located within the hazard area, and d) generate a control signal that triggers a measure to remove the object from the hazard area, provided the hazard condition is met.

[0008] The invention is based in particular on the idea that not every object poses the same hazard potential when the airbag deploys. Thus, in the present invention, the hazard zone to be determined—that is, the hazard zone position information and the hazard zone extent information—depends on the object's property information, which in turn depends on the object's hazard potential. For example, the hazard potential of a soft and / or light object, such as a plush toy, is significantly lower than that of a hard and / or heavy object, such as a smartphone or laptop. To account for this, the hazard zone is determined based on the object's property. For an object with a lower hazard potential, the hazard zone is smaller than that of an object with a comparatively higher hazard potential.The position of the danger zone can also depend on the corresponding hazard potential. For example, with an object having a relatively low hazard potential, it might only cover the occupant's head, whereas with an object having a relatively high hazard potential, the chest area could also be included. The method according to the invention particularly ensures that, with objects having a comparatively low hazard potential, unnecessary measures to remove the object from its position can be avoided.

[0009] Regarding object position information, this can describe a point within the passenger compartment where the object is located, such as its center point. Object extent information relates to the spatial extent or size of the object, for example, how far the object extends from its center point. Data from a vehicle detection system, particularly a position and / or motion sensor or a camera, is preferably used to acquire object position and object extent information. Further details are explained below.

[0010] The danger zone can be the portion of the passenger compartment located between the airbag and the occupant. Regarding its geometric shape, the danger zone, viewed from the airbag's installation position, can be rectangular or circular, i.e., cuboid, cylindrical, or conical. In principle, any geometric shape for the danger zone is conceivable. The danger zone position information could, for example, be its center point. The danger zone extent information refers to the spatial extent or size of the danger zone.

[0011] To determine the hazard zone position information and / or the hazard zone extent information, data stored in a data storage device of a control unit set up to carry out the method according to the invention can be retrieved. A data record can be stored in a data storage device in which object property information is assigned values ​​relating to the hazard zone position information and the hazard zone extent information.

[0012] The hazard condition can be met if the relevant information implies that the object is entirely within the hazard area and / or if the object is partially within the hazard area, i.e., if the portion of the passenger compartment occupied by the object and the hazard area have a common intersection.

[0013] Regarding the measure for removing the object, it may be intended that the occupant removes the object from the danger zone. In other words, the measure informs or prompts the occupant to reposition the object. However, the measure may also cause the object to be removed from the danger zone without any action on the part of the occupant. Specific examples of this are explained below.

[0014] The object property information can be type information concerning a type of object. In In this context, it may be envisaged that sensor data from the detection device is evaluated by the control unit to determine whether it meets predefined classification criteria, for example, using image recognition software. In this context, it is conceivable that the object is assigned to one of the object classes "plush toy," "book," "smartphone," "laptop," or similar, each of which inherently carries a different risk potential. Depending on the determined species information or object class, the extent and location of the risk area are then determined.

[0015] Additionally or alternatively, the object property information can include weight information, hardness information, and / or surface texture information. The property—that is, the weight, hardness, and / or surface texture of the object—can be determined directly from sensor data. For example, data from another detection device in the vehicle, such as an infrared and / or radar sensor, can be used to infer the object's weight. Regarding surface texture, camera data can be used to determine whether the object has sharp corners or edges, in which case the danger zone should be expanded accordingly.Weight information and / or hardness information and / or surface texture information can also be determined using species information and / or vice versa.

[0016] In the method according to the invention, the control signal can trigger the output of a visual and / or audible warning signal to an occupant. The visual warning signal can be output via a vehicle output device, e.g., a display. It can be a simple inscription such as "Danger" and / or text explicitly requesting the user to remove the object and / or a warning symbol. Regarding the audible feedback, a warning tone such as a beep and / or a voice message, such as "Your mobile phone is in a critical area. Please remove it or place it on the center console," can be output via a further output device, such as a loudspeaker.

[0017] Additionally or alternatively, the control signal can cause a change in the operating state of the object designated as a mobile electronic device. This change in the operating state of the electronic device, such as a laptop or smartphone, could involve putting it into standby mode or switching it off. In this case as well, the user must be prepared to move the smartphone away from the danger zone, especially if they know that removing the smartphone from the danger zone will cause or enable it to be restarted.

[0018] Particularly preferred in the method according to the invention is the provision that, especially when a warning signal is issued, the danger zone position information and the danger zone extent information are communicated to the occupant, so that he is specifically informed about the current position and extent of the danger zone. Through this communication, the driver not only receives the mere information that the object is located in the danger zone, but also receives feedback indicating to which area he can move the object out of the danger zone. For example, when using a smartphone, the occupant can be informed that the current position of the smartphone, for instance directly in front of his face, is within the danger zone, whereas this is no longer the case if he were to hold the smartphone further down, for example in the area of ​​his lap.The user can then decide whether they want to do this or prefer to put the smartphone down completely.

[0019] Additionally or alternatively, it can be provided that, particularly when a warning signal is issued, the object's position and dimensions are communicated to the occupant, thus informing them of the object's location and size. This provides the occupant with an even broader information base regarding the aspects just explained. Specifically, it informs them whether the object is located at the edge of the danger zone, requiring only a minor repositioning to move it out of the danger zone, or whether the object is located in the center of the danger zone.

[0020] In the method according to the invention, it can additionally or alternatively be provided that, particularly when a warning signal is issued, safety area position information regarding the position and safety area extent information regarding the spatial extent of a safety area that differs from the danger zone is determined and issued to the occupant, so that the occupant is informed about the position and extent of the safety area. The occupant is thus additionally provided with information indicating where exactly they can move the object so that it is no longer in the danger zone. The safety area can be a section of the passenger compartment surrounding or adjacent to the danger zone, or an area on a center console of the motor vehicle, or the like.

[0021] In principle, it may also be provided that the output of this information just explained will also take place if step b) of the procedure has not been carried out, in particular if the same security area is always the basis for carrying out the procedure.

[0022] The method according to the invention can provide for a display, in particular a live camera image, of the passenger compartment in addition to a hazard area marking indicating the danger zone and / or a safety area marking indicating the safety zone and / or an object area marking indicating the position and / or extent of the object. The vehicle can, for example, have a display by means of which the camera image is displayed together with the markings superimposed on the camera image. The areas of the camera image superimposed by the markings can remain recognizable through the markings. The markings can be colored differently, for example in red, green, and blue, or be hatched or the like. The information output is thus simple and intuitive from the occupant's perspective.

[0023] Preferably, the system continuously determines and outputs the location and / or extent of the hazard zone and / or the object and / or the extent of the hazard zone and / or the safety zone. In this embodiment, the occupant is thus informed virtually in real time about the current location of the object and / or the hazard zone and / or the safety zone. This is particularly useful, for example, if the user changes the object's position and / or if the hazard zone and / or safety zone changes, such as when the occupant adopts a different seating position.

[0024] The method according to the invention can be provided that, after generating the control signal in step d) and after the elapse of a subsequent and predetermined time interval, steps a) to c) are repeated, whereby, if the hazard condition is met again, the control signal is generated again or an escalation control signal is generated, triggering a further measure to remove the object from the hazard area. This ensures that the occupant ultimately reacts to the request to remove the object from the safety area. Furthermore, the occupant receives feedback indicating whether any change in the object's position that has already been made was sufficient to remove it from the safety area. The time interval can be a predetermined interval, for example, between three seconds and one minute, and in particular ten seconds.

[0025] Regarding the escalation control signal, it may be intended that this triggers a more drastic measure to remove the object from the danger zone than the control signal already generated. For example, when the danger condition is first met and the control signal is generated, only the warning signal may be issued, whereas the escalation control signal causes the smartphone to be switched off and / or the vehicle to slow down.

[0026] The present invention further relates to a control device for a motor vehicle, wherein the control device is configured to carry out the method according to the above description. All aspects, features, and advantages explained in connection with the method according to the invention apply equally to the control device according to the invention, and vice versa.

[0027] The present invention further relates to a motor vehicle with a passenger compartment, comprising the aforementioned control device and a detection device for determining object position information, object extent information, and object property information. All aspects, features, and advantages described in connection with the method and control device according to the invention apply equally to the motor vehicle according to the invention, and vice versa.

[0028] The detection device may consist of, or include, a position and / or motion sensor, in particular a camera. The image data captured by the camera can then be transmitted to the control unit, which can analyze it, for example using appropriate image recognition software, and determine the relevant information. Particularly if the determination of the relevant information is to be based on three dimensions, several cameras, especially two or three, may be provided in the passenger compartment of the vehicle, with the control unit performing a joint evaluation of this image data.

[0029] The motor vehicle according to the invention may be provided with at least one output device, in particular a display and / or a loudspeaker, for outputting a warning signal. The display may be arranged in the area of ​​the vehicle's dashboard so that it can be easily viewed by the occupants.

[0030] Further aspects, features, and advantages of the invention are explained with reference to the exemplary embodiments and the figures. These schematically illustrate: Fig. 1 shows an embodiment of a motor vehicle according to the invention, Fig. 2 shows a flowchart of an embodiment of a method according to the invention, which is based on the motor vehicle of the Fig. 1 as explained, and Fig. 3 shows a display of the motor vehicle. Fig. 1 .

[0031] Fig. 1 Figure 1 shows a motor vehicle 1 according to the invention, comprising a passenger compartment 2 and seats 3 arranged therein, namely a driver's seat and a front passenger seat, each occupied by an occupant 4. The motor vehicle 1 further comprises two airbags 5, which are arranged in the area of ​​a dashboard 6 of the motor vehicle 1 and each serve to protect the occupant 4 sitting on one of the vehicle seats 3 in the event of an accident.

[0032] The following will be based on the Fig. 2 an embodiment of the method according to the invention, relating to the one described in Fig. 1 The motor vehicle 1 shown is explained. To carry out this procedure, a control unit 7 of the motor vehicle is installed, which is connected to the relevant components. For clarity, these connections are shown in Fig. 1 not shown. The procedure comprises steps 8 to 13.

[0033] In the first step 8, object position information 14 concerning a position, object extent information 15 concerning a spatial extent, and object property information 16 concerning a property of several objects 17 located in the occupant compartment 2 are determined. For example, the objects 17 are a laptop 18 and a plush toy 19 or a teddy bear, each located on the lap of one of the occupants 4.

[0034] To acquire the information 14, 15, 16, several acquisition devices 20 of the motor vehicle 1 are provided. For example, three cameras 21 distributed throughout the passenger compartment 2 are provided as acquisition devices 20. Each camera captures an image of the passenger compartment 2 from a different angle, which is then transmitted to the control unit 7. The control unit 7 is configured to determine the object position information 14 based on the image data and using suitable image processing software. This information relates to the center point of each object 17, described in three dimensions. The control unit 7 also determines the object extent information 15, which relates to the size of each object 17.

[0035] Several object property information 16 is determined with regard to the properties of the objects 17. One of the object property information 16 is type information concerning the type of object 17. The type information 22 is determined in particular using the camera data acquired by the cameras 21 within the framework of the image evaluation software. In this case, the type information 22 "Laptop" and "Plush Toy" is determined for each of the objects 17. This is done using a predefined classification catalog stored by the control unit 7.

[0036] Object property information 16 also includes weight information 23, hardness information 24, and surface texture information 25 for object 17. With regard to surface texture information 25, it is conceivable that this information is also determined as part of the aforementioned image analysis. Data from other detection devices 20, namely an infrared sensor 26 and a radar sensor 27 of the vehicle 1, can be used to determine weight information 23. The determination of weight information 23, hardness information 24, and surface texture information 25 can be based on the determined type information 22 and / or vice versa, particularly for verification purposes. For example, the hardness information 24, indicating that object 17 is soft, can be assigned to the type information 22 "plush toy".

[0037] In the second step 9 of the procedure, hazard area position information 28 concerning a position and hazard area extent information 29 concerning a spatial extent of a hazard area 30 are determined. Specifically, a separate determination of an associated hazard area 30 is carried out for each of the objects 17, which is stored in the Fig. 1 The danger zone 30 is the area of ​​the passenger compartment 2 in which the deployment of the airbag 5 would cause movement of the associated object 17 that poses a risk of injury to the occupants 4, provided that the respective object 17 is at least partially located within danger zone 30. In this case, danger zone 30 is the section of the interior 2 between the airbag 5 and the passenger 4.

[0038] The determination of the hazard area position information 28, i.e., the center point of the hazard area 30, and the hazard area extent information 29, i.e., the size of the hazard area 30, is based on the object property information 16. For the laptop 18, the hazard area 30 is the entire area in front of the head and upper body of the driver-side occupant 4. Thus, the object property information 16 with regard to the laptop 18 implies that this object 17 is such in terms of size, hardness, and weight that the hazard area 16 with regard to the laptop 18 must be selected to be correspondingly large.

[0039] Regarding the plush toy 19, the hazard zone 30 is only the area between the airbag 5 and the head of the passenger-side occupant 4. The hazard zone 30 assigned to the plush toy 19 is therefore smaller and positioned higher compared to the hazard zone 30 assigned to the laptop 18, since the plush toy 19, sitting on the lap of the passenger-side occupant 4, poses no or only a very low hazard potential when the airbag 5 deploys. The object property information 16 implies that the plush toy 19 has a low weight and a very soft feel, so the associated hazard zone 30 can be chosen to be correspondingly small.

[0040] In the next step 10 of the procedure, it is checked whether a hazard condition is met. This is the case if information 14 to 16 and 28 and 29 imply that object 17 is at least partially located in the respective hazard zone 30. If this is not the case, then no action is required in this regard, as the airbag 5 can deploy unhindered with respect to object 7. In this case, the procedure is restarted from the first step 8.

[0041] If the hazard condition is met, the procedure continues in the next step 11, in which a control signal 31 is generated and output, which triggers a measure to remove the object 17 from the hazard area 30. Specifically, the control signal 17 causes an optical warning signal 34 and an acoustic warning signal 36 to be output to the occupants 4 by means of output devices 32 of the motor vehicle 1. A display 33 is provided as the output device 32, by means of which the optical warning signal 34 is output, for example, in the form of the word "DANGER". The display output is in Fig. 3 This is shown and will be explained in more detail later. A loudspeaker 35 is provided as output device 32, by means of which the acoustic warning signal 36 is emitted. The acoustic warning signal 36 is a beep and / or a voice output that prompts the occupants 4 to remove the affected object 17 from the danger zone 30.

[0042] Subsequently or concurrently with step 11, step 12 is carried out, in which further information regarding the current positions of the objects 17 and the hazard zones 30 is provided to the occupants 4. Specifically, the occupants 4 are provided with the hazard zone position information 28 and the hazard zone extent information 29 via the display 33. This is done by displaying a current camera image 37 of the occupant compartment 2, captured by the camera 21 located centrally on the dashboard 6, on the display 33 (see Figur 3 ). In camera image 37, the two occupants 4 and the objects 17 are particularly recognizable.

[0043] The output of the hazard area position information 28 and the hazard area extent information 29 is achieved by overlaying a hazard area marker 38, which indicates the hazard areas 30, onto the camera image. In Fig. 3 The danger zone marking 38 is represented by a dashed box, which is specifically shown on the display 33 as a red colored area through which the camera image 37 shines.

[0044] Additionally, the object position information 14 and the object extent information 15 are output via the display 33, so that the occupants 4 are informed about the position and extent of the object 17. Analogous to the output of the hazard area marker 38, the object area marker 39 is output as a blue rectangle, which is displayed in the Figur 3 is represented as a dashed line.

[0045] Furthermore, the control unit 7 determines a safety area position information 40 concerning a position and a safety area extent information 41 concerning a spatial extent of a safety area 42 that differs from the hazard area 30, and displays this information on the display 33. The occupants 4 are thus informed about the position and extent of the safety area 42 and receive a concrete suggestion as to which area the respective object 17 could be moved to so that it is no longer within the hazard area 30. Analogous to the display of the hazard area marking 38 and the object area marking 39, a corresponding safety area marking 43 in green, indicating the safety area 42, is also displayed on the display 33. Figuren 1 and 3The safety zone 42 is indicated by dotted lines. The display of safety zone 42 ultimately provides the occupants 4 with a concrete suggestion as to where object 17 could be placed, in this case, for example, on a center console 45 of the vehicle. Regarding the issuance of zone markings 38, 39, and 43, it is conceivable that this could also occur in the case of a fixed hazard zone 30 and, in particular, safety zone 42.

[0046] In step 12 of the procedure, the information 14, 15, 16, 28, 29, 40, 41 is continuously determined over time, and the camera image 37 is captured, so that the marking areas 38, 39, 43 displayed by means of the display 33 are also continuously updated.

[0047] After step 12 has been executed for a certain period of time, for example ten seconds, steps 8, 9, and 10 of the procedure are repeated. If the check of the hazard condition in step 10 reveals that the hazard condition is met again, the procedure continues in step 13. In step 13, an escalation control signal 44 is generated, which triggers a further measure to remove object 17 from the hazard zone 30. Escalation control signal 44 triggers a more drastic measure to remove object 17 from the hazard zone 30 compared to control signal 31, because occupant 4 apparently did not react to the initial measure and object 17 is still within the hazard zone 30. The measures mentioned in connection with escalation control signal 44 can also be triggered by control signal 31, or vice versa.

[0048] If the object 17 is an electronic terminal device such as a smartphone or the laptop 18, the escalation control signal 44 causes a change in the operating state of this object 17. Specifically, it causes the electronic terminal device to be switched off.

[0049] The escalation control signal 44 can additionally or alternatively cause the motor vehicle 1 to brake, so that the occupant 4 is made aware of his "misbehavior".

Claims

1. Method for securing a passenger compartment (2) of a motor vehicle (1), comprising the following steps: a) determining at least one object position information (14) relating to a position and at least one object extension information (15) relating to a spatial extension and at least one object property information (16) relating to a property of at least one object (17) located in the passenger compartment (2), b) determining hazard area position information (28) relating to a position and hazard area extension information (29) relating to a spatial extension of a hazard area (30), in each case as a function of the object property information (16), wherein the hazard area (30) is that area of the passenger compartment (2) in which a deployment of an airbag (5) of the motor vehicle (1) causes a movement of the object (17) that entails a risk of injury to an occupant (4) of the motor vehicle (1), provided that the object (17) is at least partially located in the hazard area (30), c) checking whether a hazard condition has been met, which is met if the object position information (14) and the object extension information (15) and the hazard area position information (28) and the hazard area extension information (29) imply that the object (17) is located at least partially in the hazard area (30), and d) generating a control signal (31) that causes a measure to be taken to remove the object (17) from the hazard area (30), provided that the hazard condition is met.

2. Method according to claim 1, characterized in that the object property information (16) is type information (22) relating to a type, in particular according to a predetermined object classification, and / or weight information (23) concerning a weight and / or hardness information (24) concerning a hardness and / or surface quality information (25) concerning a surface quality of the object (17).

3. Method according to claim 1 or 2, characterized in that the control signal (31) triggers an output of a visual warning signal (34) and / or an audible warning signal (34) to the occupant (4) and / or a change in an operating state of the object (17) provided as a mobile electronic terminal device and / or an automatic movement of the object (17) out of the hazard area (30).

4. Method according to any one of the preceding claims, characterized in that, in particular when the warning signal or a warning signal is output, - the hazard area position information and the hazard area extension information are output to the occupant so that they are informed about the position and extension of the hazard area, and / or - the object position information and the object extension information are output to the occupant so that they are informed about the position and extension of the object, and / or - safety area position information concerning a position and safety area extension information concerning a spatial extension of a safety area deviating from the hazard area is determined and output to the occupant so that they are informed about the position and extension of the safety area.

5. Method according to claim 4, characterized in that a representation, in particular a current camera image, of the passenger compartment is provided, in addition to a hazard area marking indicating the hazard area and / or a safety area marking indicating the safety area and / or an object area marking indicating the position and / or extension of the object.

6. Method according to claim 4 or 5, characterized in that the hazard area position information and / or the hazard area extension information and / or the object position information and / or the object extension information and / or the safety area position information and / or the safety area extension information is determined and output continuously over time.

7. Method according to any one of the preceding claims, characterized in that after the control signal (31) has been generated in step d) and after a predetermined period of time has elapsed, steps a) to c) are repeated, wherein if the hazard condition is met again, the control signal (31) is generated again or an escalation control signal (44) is generated which causes a further measure to be taken to remove the object (17) from the hazard area (30).

8. Control apparatus for a motor vehicle, wherein the control apparatus (7) is arranged to perform the method according to any one of the preceding claims.

9. Motor vehicle with a passenger compartment (2), comprising the control apparatus (7) according to claim 8 and a detection apparatus (20) for determining the object position information (14) and the object extension information (15) and the object property information (16).

10. Motor vehicle according to claim 9, characterized in that the detection apparatus (20) is or comprises a position and / or motion sensor, in particular a camera (21).

11. Motor vehicle according to claim 9 or 10, characterized in that it comprises at least one output apparatus (32), in particular a display (33) and / or a loudspeaker (35), for outputting the or a warning signal (34; 36).