Method, warning device and motor vehicle for issuing information to a user regarding at least one specific item located in the motor vehicle
Patent Information
- Application Number
- DE102019204630
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2019-04-02
- Publication Date
- 2025-02-06
- Estimated Expiration
- 2039-04-02
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
The invention relates to a method for outputting information to a user of a motor vehicle with respect to at least one specific object located in the motor vehicle. The invention also includes a warning device and a motor vehicle.On the one hand, numerous possibilities for outputting information, for example in haptic, acoustic or optical form, are known from the prior art. For example, DE 10 2013 220 107 A1 describes a method for instructing and monitoring assembly and picking processes to be carried out at a work station. In this case, a visual or acoustic display with respect to an pending process step can be provided, which comprises a removal location of a component or of a tool, a mounting or depositing location of the component or a manual for mounting the component. In this case, an instruction for assembly can also be displayed directly in the assembly region by means of an image projection device. In addition, on the one hand, the removal location can be projected directly onto gripping containers and can also be projected directly onto the installation location with the projection device.There are also situations in which it is advantageous to output information about an object located in the motor vehicle to a user. For example, U.S. Pat. No. 10,093,230 B1 describes a method for informing a user of a motor vehicle about an object located in the motor vehicle in order to prevent the user from forgeting to carry this object when it arrives at a destination. In order to inform the user of the object, the latter can be illuminated, for example.Furthermore, DE 10 2012 219 923 A1 describes a vehicle assistance device which can issue vehicle occupant-specific recommendations for action via a display device, in particular in order to make action easier for the driver during the journey. For example, recommendations regarding the opening or closing of a cabriover deck, recommendations for the possible early activation of assistance systems, or even removal or stowage recommendations can be displayed. For example, the driver may be recommended to store a screen in the storage compartment provided for this purpose or heavy objects in the lower part of the vehicle. Numerous further recommendations can also be issued to a driver. Outputting numerous such recommendations on a display device in a motor vehicle can quickly overrequest a driver and thus be distracted rather than helpful in many situations.DE 10 2015 003 934 A1 relates to a motor vehicle having a receiving device for a sensor signal of a sensor device, wherein the sensor signal represents at least one object arranged in a rear of the motor vehicle and / or in a rear outer region of the vehicle adjoining the rear, and having an analysis device which is designed to identify a predetermined assistance situation on the basis of the sensor signal and to determine an indication signal relating to the identified assistance situation.It is therefore an object of the present invention to provide a method, a warning device and a motor vehicle which make it possible to output information relating to at least one specific object located in the motor vehicle to a user in a more adapted manner.This object is achieved by a method, a warning device and a motor vehicle having the features according to the respective independent patent claims. Advantageous embodiments of the invention are the subject matter of the dependent patent claims, the description and the figures.In a method according to the invention for outputting information to a user of a motor vehicle with respect to at least one specific object located in the motor vehicle, the at least one specific object is detected in the motor vehicle, a current location position of the detected specific object is determined, at least as a function of the determined current location position of the at least one specific object it is checked whether a risk arises from the specific object according to at least one predetermined criterion, and under the condition that it is determined during the checking that a risk arises from the at least one specific object according to the at least one predetermined criterion, an optical warning is output by means of a projection device by projecting the warning at least one projection position spatially correlated with the determined location position of the detected specific object.According to the invention, the at least one predetermined criterion includes that the at least one specific object is located in a predetermined position range of the motor vehicle interior, in particular of a plurality of predetermined position ranges of the motor vehicle interior, according to its specific current location position. For example, a plurality of position ranges within the motor vehicle interior may be defined in advance, which as such are initially defined as potentially hazardous position ranges. A prerequisite that it is determined according to the predetermined criterion that a danger arises from the particular object is then corresponding to this detected particular object being positioned at such a predetermined position range. If it is positioned at another location that does not belong to the potentially hazardous position ranges, then any further checking, as described in more detail below, can also be dispensed with and the object in question can be classified as an object from which no danger arises according to a current location position. If, for example, a specific object is positioned in a storage compartment or under a front seat or the like, wherein this position, namely the positions in the interior of storage compartments present and positions below the front seats, are then defined as non-dangerous, then any object positioned there is also classified as an object from which no danger arises. According to the invention, it is checked on the basis of further criteria whether a risk arises from the detected object.According to the invention, the further criteria include that the at least one specific object has a weight which is greater than a predetermined weight limit value, and / or a size which is greater than a predetermined size limit value, and / or has a predetermined geometry and / or structure.The invention is based on several findings: firstly, loose objects are often located in a vehicle interior at positions that are not optimal for vehicle safety. Unsecured objects can slip due to the driving dynamics in the vehicle or become hazardous in the event of a crash or in the event of an accident. However, this does not necessarily apply to all objects in the motor vehicle, nor to all positions of the motor vehicle. If a driver, for example, places his jacket on the rear seat bank, then this is indeed accommodated on the one hand at a position in the motor vehicle which actually does not represent a stowage location, and on the other hand, a jacket lying on the rear seat bank also results in no risk, even not in the event of an accident. If a driver, for example, places his mobile phone on the dashboard during the trip, a hazardous projectile can become therefrom in the event of a crash. If the driver instead places a packet of handkerchiefs on the dashboard, then in this case too, again no risk would arise for occupants of the motor vehicle even in the event of an accident. If, on the other hand, a warning message were always issued as soon as an object is not positioned in a storage compartment provided for this purpose, this would be unnecessary in many situations from the aspect of safety and merely leads to irritation and distraction of the driver or the users of the motor vehicle. The invention makes use of these findings by virtue of certain objects detected in the motor vehicle, such as detected loose objects, for example, being initially classified with respect to their risk potential as a function of their current location position, and a warning message being output to the user only if it is determined according to this classification that a risk arises from these objects. An information output to the user therefore only occurs if this is also relevant from a safety aspect. This allows the safety to be increased in a targeted manner without prompting a driver or user to transmit numerous and sometimes unnecessary information, disturb it and possibly even deflect it during the journey. A further reduction in the risk of distraction of the driver or generally of a user of the motor vehicle can, however, above all additionally be provided in that such a warning is output on the one hand as an optical warning and on the other hand at a projection position spatially correlated with the position where the detected object is located. As a result, a user can reliably and quickly identify which object in the motor vehicle this warning relates to. This rapid detection is made possible on the one hand by the fact that, due to the projection of such an optical warning, for example, due to the illumination of the object in question, no reading of recommendations output on a display device is necessary, but above all by the fact that the output warning is spatially correlated with the position of the object, so that searching for the object to which an output warning relates is also completely dispensed with. If, on the other hand, it were displayed on a display device that heavy objects are to be stowed under the seat, a driver would first have to search for such possibly heavy objects in the motor vehicle, which takes time accordingly and can again deviate from the traffic situation primarily during travel. Consequently, the invention makes it possible to provide a clearly more adapted information output about objects located in the motor vehicle, which also makes it possible to increase the safety in road traffic and to deviate or irritate a user of the motor vehicle significantly less.For detecting the at least one specific object, at least one camera, in particular an interior camera of the motor vehicle, is preferably used. The at least one camera can be designed as a 3D camera. A plurality of such cameras can also be present in the motor vehicle and used for detecting the at least one specific object. By using a plurality of cameras, in particular 3D cameras, the interior of the motor vehicle can be detected for the most part or even completely, or at least certain spatial regions of the motor vehicle, such as the front and rear seats, generally the rear passenger region, a parcel shelf, a dashboard, a central console, etc. The at least one certain object can therefore be detected by means of the at least one camera. This at least one specific object is preferably a loose object in the motor vehicle interior. This can be recognized as such by suitable software. The at least one camera can thus consequently recognize loose objects in the interior of the motor vehicle. These objects can be detected, measured and classified by image recognition software, as will be explained in more detail later. Likewise, the position of the at least one object can be determined on the basis of the camera recordings, that is to say its location position.If the object is classified as an object from which a certain risk potential arises, the object can advantageously be visually emphasized by means of the projection device. For this purpose, the projection device or the projection system can be located, for example, on the vehicle headliner, in particular centrally, so that very many different projection positions within the motor vehicle interior can be covered by means of the projection device. Alternatively, a plurality of such projection devices can also be arranged in the motor vehicle. However, the use of only a single projection device as a unit in a central region of the vehicle headliner, for example in the region between the headrests of the front seats, is preferred, since this makes it possible to save considerable costs and installation space and, at this position, all relevant positions in the motor vehicle interior space can be covered.Particularly heavy objects assume a higher risk potential if they are positioned at an unfavorable position in the motor vehicle. It is therefore particularly advantageous to carry out a classification of the specific object with respect to its risk potential on the basis of its weight. The weight can be estimated by the system, i.e. by the warning device according to the invention or one of its embodiments. For example, when the object is on a seat in the vehicle interior, pressure sensors in the seats may be used to estimate the weight of the particular object. The measurements of the pressure sensors can be transmitted to a control device, for example as part of a corresponding warning system, which evaluates the measurement results and estimates the weight of the object in question on the basis thereof. However, it is also conceivable that an object can be identified or classified as a specific object type on the basis of the camera images recorded by the at least one camera or the analysis thereof and a weight estimate of the object in question can also be carried out on the basis thereof. Furthermore, the geometric size of the object can also be taken into account in the weight estimation or the weight estimation can be based solely on a geometric measurement of the object.Furthermore, it is also advantageous to take into account the size of the detected object as such, optionally also independently of a weight estimate. For example, it can be assumed that an object carries a greater risk potential the larger this object is. Of very small articles such as a ring or a button or the like, even if such a small article is made of a hard material, there is usually no great risk even in a crash situation. A further factor which can advantageously be taken into account in the classification with respect to the risk potential of an object is its geometry. If the object is, for example, a very pointed object, then a greater risk potential is usually assumed from such an object than, for example, from a blunt or round object. The measurement of the geometry, which can be carried out by the camera system as described, can also be used to estimate what kind of object is with reference to the geometry. In this way, for example, mobile telephones can be easily recognized and categorized or classified as such.The structure of an object, i.e. whether it has, for example, a changeable and / or organic structure, as is typical, for example, for fabrics, jackets, other articles of clothing, or has a non-changeable, apparently hard structure with a smooth surface or the like, can also advantageously be used for classifying the object with regard to its risk potential. Soft, deformable objects, such as articles of clothing, which can be easily recognized on the basis of their typically organic structure on the basis of a camera image analysis, typically have no risk potential, regardless of where they are positioned. If, for example, no such organic structure of the object is detected, it can be classified as potentially dangerous.It is especially advantageous if all of these mentioned factors are taken into account in the classification of the object with respect to its danger potential, whereby the danger potential of an object can be estimated particularly accurately and reliably. According to the invention, the object is classified as dangerous if it has been classified as potentially dangerous according to at least one of the above-mentioned criteria. For example, only those of the mentioned factors which can also be detected at the given time or in the respective situation can also be taken into account. If, for example, no weight information about the pressure sensors is present in the seats because the object is located at another current location position, this cannot also be taken into account in the assessment of the risk potential. In this case, a weight estimation can then be omitted accordingly or the weight can be estimated in another way, as explained above.In a further advantageous embodiment of the invention, the optical warning is projected as at least one warning symbol and / or warning symbol onto the at least one specific object. Because the warning is projected directly onto the object, a projection position which is spatially correlated directly with the location position of the detected object is advantageously provided, which projection position allows the user to immediately recognize to which detected object the optical warning relates. The warning symbol and / or warning symbol can be provided, for example, as exclamation symbols or else as any other desired symbol and / or symbol. It is also possible to project a plurality of symbols and / or characters onto the detected object. It would also be conceivable to project an arrow as a symbol or character in order to inform the user of the removal of the detected object from the current location. The detected object can, however, also be illuminated or visually emphasized in any other manner. For example, only the contour of the object can also be illuminated. Such contour illumination is particularly advantageous and will be explained in more detail later. As a result, the object can advantageously be visually clearly and very precisely delimited from its environment, so that there is no risk of confusion with other objects and misinterpretations can be ruled out or the risk thereof can at least be reduced.In a further advantageous embodiment of the invention, the warning is output in the form of a temporal illumination sequence starting from the current location position to a predetermined position in the interior of the motor vehicle that differs from the current location position. For example, the visual warning may be provided in the form of a light spot or again as an illuminated contour of the object, which moves in the direction of the interior space, for example, temporally and spatially starting from the current position of where the object is located. This makes it possible to communicate to the user in a particularly simple manner that he is intended to move the object away from the current location. In this case, a concrete proposal for an optimum storage location can also be made, as is described in more detail below, which, however, does not necessarily have to be the case. Even if no optimum stowage position is determined or can be determined, a user can still advantageously be informed in this way that the object is currently located at a storage position which is unsuitable for this object and which entails a high risk potential. This advantageously alerts the user to this risk and, moreover, also notifies him to remove the object from this dangerous position. However, a further great advantage of such a temporal illumination sequence is not only that it is possible to provide a clearer way of moving the object away from the current location position, but above all also that such a temporal illumination sequence, which accordingly also implies a specific spatial variation, is perceived by a user much more easily on account of the light movement resulting therefrom than, for example, merely a static projection without a changing spatial and / or temporal component. Especially in the peripheral field of view range, the human eye is particularly sensitive to movements. Accordingly, such a temporal illumination sequence can be detected particularly well by a user even if the user is not looking directly at this incorrectly positioned object at all. This increases the probability that the potential risk detected by the warning system or by the warning device is also perceived by the user, so that the safety can be additionally increased as a result.In a further advantageous embodiment of the invention, if the predetermined and the further criteria are fulfilled, a stowage position, in particular of a plurality of defined stowage positions within the motor vehicle, is assigned to the at least one specific object as a function of its current location position and / or as a function of a captured geometric property of the object and / or as a function of its weight and / or as a function of the presence of at least one second specific object from which a risk likewise arises according to the predetermined and the further criteria, and the warning message is output in the form of a temporal illumination sequence starting from the current location position to the assigned stowage position.Based on the temporal illumination sequence, the user now advantageously sees a recommendation to which position the object that was classified as potentially dangerous should be moved. If, for example, in a taxi a passenger places his luggage next to him on the seat, although in this taxi a storage area for luggage is located opposite the rear seat, the warning system or the warning device can advantageously identify the heavy and unfavourably positioned luggage, for example illuminate the contour of the luggage and, by an animated light movement of this projected contour in the direction of the storage area, show the user that this luggage is to be stored optimally in this storage area. Thus, the user is intuitively alerted to a better storage position and the safety can be increased. For multiple or bulky items, the optimum deposition position can be determined for all such items and displayed in such a manner or similar. In determining the storage position to be recommended, the above-mentioned factors can advantageously be taken into account. For example, the current location position can be taken into account in such a way that, for example, the closest stowage position of a plurality of possible stowage positions is selected as the optimum stowage position by the warning device and recommended to the user by the visual projection of the warning. This advantageously allows the stowage path to be shortened, and stowage is particularly simple for the user. Alternatively or additionally, the stowage position can also be selected depending on the detected geometry of the object. In particular, the size of the object also often decides whether an object can be accommodated at any possible stowage position, or whether the object is too large for accommodation at this stowage position. Accordingly, only those positions at which the object can also be stowed due to size can be considered as stowage positions. A further advantageous factor also represents the weight of the object, which can be determined or estimated as already described above. For example, heavier objects should preferably be stored close to the ground. Also, some storage devices are not constructed so as to be stable enough for holding or storing particularly heavy objects, so that they are accordingly not possible as suitable storage positions. A further advantageous factor which can be taken into account in the selection of the stowage position additionally represents the presence of further items which are likewise to be stowed or which are already stowed in corresponding stowage positions, for example. If certain storage compartments are already occupied, they are no longer possible, for example, for storing the currently detected object. If a plurality of items have to be stowed, since all these items have been classified as hazardous, for example, according to their current storage positions, respective stowage positions can be assigned to a corresponding plurality of items, wherein, when assigning the respective stowage position, the requirement that all items can be stowed at suitable positions can be weighted more strongly than, for example, the correspondingly subordinate requirement for stowage items at stowage positions which are as close as possible if only some of these items could then be stowed. If, for example, a very large and a very small object are detected and both objects are to be stowed, and if, for example, a very large and nearby stowage compartment and a far-away smaller stowage compartment which would not be suitable for the large object are available for stowage of the small object, then the sufficiently large stowage compartment is also associated with the large object, and the smaller but nevertheless suitable stowage compartment is associated with the small object, although this is located further away from the small object.All these factors can be advantageously taken into account when assigning a suitable stowage position. Such an assignment can be provided, for example, in a particularly simple manner by a type of look-up table or the like which assigns suitable stowage positions accordingly for specific object classes, for example objects in a specific size range, in a specific weight range and / or in a specific location position range. In this case, a plurality of suitable stowage positions may possibly also be assigned to an object. Then, either one of these suitable storage positions may be selected randomly or the above-mentioned factors may be suitably weighted. For example, it is more relevant to arrange a very heavy object as close to the ground as possible than to arrange it as close as possible to its current location position. The geometric compatibility during the accommodation represents a basic prerequisite for the suitability of a specific stowage position. If a plurality of items are to be stowed, they can first be assigned to respective stowage positions primarily according to their geometric properties, and if there are then a plurality of possible selections for stowage of the respective items, the further factors can be weighted accordingly and subsequently taken into account in more detail. However, there are numerous further possibilities for determining a suitable stowage position. For example, not only look-up tables can be used for this purpose, but also more sophisticated algorithms, learning methods, and the like. However, these methods can also be based on the specification of specific weighting factors with respect to the previously described dependency factors, namely geometry, weight, proximity, number of items to be stowed, etc., and on a number of predefined storage positions and ranges which are possible in principle.This greatly facilitates stowage for a user, since on the one hand this does not have to thought himself about a suitable stowage possibility, and on the other hand all possible safety aspects are already taken into account in an optimized manner in the proposed stowage position, which additionally increases safety.Nevertheless, it may theoretically also occur that the warning device cannot ascertain for some reasons a suitable stowage position for an object which is however positioned as potentially dangerous. Therefore, it is a particularly advantageous embodiment of the invention that it is checked whether a stowage position can be assigned to the at least one specific object according to at least one second criterion, and if this is not the case, the warning message is projected as a static warning message onto the at least one specific object or is output in the form of a temporal illumination sequence originating from the at least one specific object and spatially leading away from the at least one specific object or is output in the form of a static directional message originating from the at least one object and pointing away, which likewise need not be spatially limited to the location of the object.This has the great advantage that, although an object cannot be assigned an optimum stowage position or even no stowage position at all, a possibility for alerting the user by the output of the warning message can nevertheless be provided. This can then be configured as described initially, for example as a warning symbol or sign, directly projected onto the object, or as an arrow pointing away from the object, or as a lighting sequence varying over time, for example as an illuminated contour of the object, which extends in the direction of the interior or vehicle center, but not to a defined stowage position or the like. All these possibilities make it possible to give the user that this object should be moved away from the current location position. The user is then advantageously provided with the option of searching for a more suitable stowage position. A user is thus made aware at least of the potential risk emanating from the object at the current location.In a further advantageous embodiment of the invention, a contour of the at least one specific object is detected and the temporal illumination sequence is output in the form of a spatially moving illuminated region which has a contour corresponding to the detected contour of the at least one specific object. By the visual warning message emphasizing the contour of the object, the user is unambiguously notified of which object the output warning message relates. Because this contour is also moved away from the object, which is provided by the temporal illumination sequence, in particular moved, for example, to the assigned stowage position, a user can be provided all the more clearly that he is intended to move this object to this stowage position or at least away from the current location position. It is especially when it is concerned with the projection, in particular moving projection, of a concrete geometric structure, in order to avoid distortion of such a structure, such as the present contour of the object, when moving this illuminated contour through the interior of the motor vehicle, for example over interior components, it is advantageous if a so-called projection mapping is used for implementing such a moving projection, as described, for example, under https: / / de.wikipedia.org / wiki / Projection mapping, and which is correspondingly known from the prior art and therefore not explained in more detail. Such a projection mapping generally also makes it possible, when projecting a specific light pattern or an illuminated region with a predefined geometric shape, to take into account the geometry of the surface onto which this shape is currently projected, so that this shape is not distorted. In other words, it is possible that a specific geometric light shape can be undistorted when passing through different regions, in particular the motor vehicle interior, by taking into account the geometry of these regions and projected while maintaining the geometric light shape. The geometry of these regions, especially those located in the motor vehicle interior, can be measured by the at least one camera and / or be specified and stored. This therefore advantageously allows the contour of an object to be detected in the interior of the motor vehicle, the projection device to appropriately geometrically correctly illuminate the contour of the object by calculating the region to be illuminated depending on the geometry of the projection surface which is currently to be illuminated by the illuminated region, and this contour can thus be geometrically correctly migrated through the motor vehicle interior, for example up to the assigned stowage position, taking into account the interior geometry of the motor vehicle.The visual warning may furthermore be configured such that any tilting of the object that may be necessary is also visually illustrated by a corresponding tilting of this contour, for example rotating by a predetermined angle, in order then to store the object in a suitable manner at the storage position, for example in a specific storage compartment. In other words, the warning device can also check whether a change in an orientation of the determined and detected object is required for stowage of this object in the assigned stowage position or is preferred according to any other criteria which can likewise be predefined, such as, for example, safety or efficiency of the use of installation space, and then this change in the orientation of the object can likewise be visualized accordingly by the output optical warning, in that the projected object contour is then likewise rotated accordingly in space, for example. Thus, a user can be proposed not only where he is to store the object, but also how he is to store the object in the proposed storage position. This allows the user to be assisted in stowage.Furthermore, the invention also relates to a warning device for outputting information to a user of a motor vehicle with respect to at least one specific object located in the motor vehicle, wherein the warning device has a processor and a memory with commands executable by the processor, wherein the processor is designed to execute the stored commands in order to execute a method according to the invention. The advantages mentioned with reference to the method according to the invention and its embodiments apply in the same way to the warning device according to the invention. In addition, the method steps described in connection with the method according to the invention and its embodiments enable the development of the warning device according to the invention by further corresponding physical features. In particular, in general the memory of the warning device may comprise instructions which, when these instructions are executed, cause the processor to execute a method according to the invention or one of its embodiments. For example, corresponding commands can also be stored in the memory, which define the temporal sequence of the temporal illumination sequence. The warning device can also have the above-described projection device and the at least one camera. Furthermore, the processor of the warning device can be designed for communication and / or control of the projection device and of the at least one camera.Furthermore, the invention also relates to a motor vehicle having a warning device according to the invention or one of its configurations. Here too, the advantages described in connection with the method according to the invention and its embodiments apply in the same way to the motor vehicle according to the invention.The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.The invention also includes the combinations of the features of the described embodiments.Exemplary embodiments of the invention are described below. The following are shown: FIG. 1 shows a schematic illustration of a motor vehicle having a warning device for outputting information to a user of the motor vehicle with respect to at least one object located in the motor vehicle according to an exemplary embodiment of the invention; FIG. 2 shows a schematic illustration of the motor vehicle from FIG. 1, in which the contour of the object detected in the motor vehicle is visually emphasized by means of a projection device, according to an exemplary embodiment of the invention; and FIG. 3 shows a schematic representation of the motor vehicle from FIG. 1, in which the user is alerted to a better stowage position for stowage of the object by a moving animation of the projection of the contour of the detected object, according to an exemplary embodiment of the invention.The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention that are to be considered independently of one another.In the figures, identical reference numerals designate functionally identical elements.FIG. 1 shows a schematic illustration of a motor vehicle 10 having a warning device 12 according to an exemplary embodiment of the invention. The warning device 12 comprises a control device 14, which in turn has a memory 16 and a processor 18. Furthermore, the warning device 12 comprises a projection device, in particular a projector 20, which in this example is arranged in a central region of the motor vehicle 10, in particular in a central region of the roof lining of the motor vehicle 10. In addition, the warning device 12 in this example also comprises a plurality of cameras 22, which can be arranged distributed in the motor vehicle interior in order to record the motor vehicle interior, in particular the passenger compartment in the front and / or rear seat region, and also objects located therein in order to measure the interior and / or the objects. The images recorded by the cameras 22, which are preferably configured as 3D cameras, in particular image sequences or videos, can then be evaluated accordingly by the control device 14. The control device 14 is also designed to actuate the projector 20 in a predetermined manner.The warning device 12 is now advantageously designed to inform a user 24 of the motor vehicle 10 about at least one specific object 26 located in the motor vehicle 10, in this example a briefcase 26, from which a potential risk arises, since this is not stored properly. For this purpose, the respective video image recorded by the cameras 22 can first be evaluated by an image recognition algorithm, which is executed by the control device 14, in particular by the processor 18, to determine whether any particular objects, in particular loose objects 26, such as the briefcase 26, are located in the interior of the motor vehicle 10. For the detection of objects 26 located in the motor vehicle 10, a comparison of the image data currently recorded by the cameras 22 with historical image data can also be made, so that changes within the motor vehicle can be easily identified, whereby newly added objects or objects 26 that are not permanently part of the interior of the interior can be recognized. In this way, for example, the briefcase 26 located in the motor vehicle 10 can also be detected as such a newly added object and can accordingly also be classified as a loose object 26.Furthermore, the control device 14 then checks whether a risk arises from the at least one detected object 26 according to at least one predetermined criterion. This can be evaluated on the basis of a plurality of different criteria. First, the current location P1 of the object 26 is determined. It can then be checked whether the detected object 26 is located at a potentially dangerous position within the motor vehicle 10. For this purpose, corresponding position ranges of the motor vehicle 10, which represent such potentially dangerous position ranges, can be defined in advance and stored, for example, in the memory 16 of the control device 14. Such potentially hazardous areas may represent, for example, the rear seat bench 28, a dashboard 30, the area of the front seats 32, a parcel shelf 34, or the like. If the detected object 26 is not located at such a potentially hazardous position, but for example in a luggage storage area 35, or on the floor 36, for example below the front seats 32 or the like, the object 26 can be classified as harmless. Otherwise, it can be checked on the basis of further criteria whether the object 26 is at a potential risk.A further suitable criterion is the weight of the object 26. This can be measured or estimated in a wide variety of ways. For example, the size of the object 26 can also be measured by the camera system 22, and a weight estimation can be carried out on the basis of the size. Optionally, an object classification can also be carried out by the control device 14 on the basis of the recorded images, and the detected object 26 can be classified therefrom as a briefcase, for example. On the basis of this classification, a weight estimation can then likewise take place, for example by virtue of typical average weights being assigned to different object classes according to a look-up table or the like. For example, pressure sensors 38 which are installed in seats 28, 32, and of which only some are shown schematically in FIG. 1, can also be used. On the basis of these measured variables detected by means of these pressure sensors 38 in the region of the current location position P 1 of the object 26, the control device 14 can then in turn determine or at least estimate the weight of this object 26 accordingly. If it is determined in this case that the weight exceeds a specific limit value, the object 26 can be classified as a potentially hazardous object.Other criteria are a specific size of this object 26, which can be dimensioned on the basis of the volume and / or a length and / or width and / or height or limit values respectively defined for this purpose. If this size likewise exceeds a predetermined limit value, the object 26 can likewise be classified as potentially hazardous. The geometry of the object 26 can also be detected and evaluated. If it is a pointed object, for example, then this can likewise be classified as dangerous. The structure, in particular the surface structure, of the object 26 can also be detected and evaluated. If the surface structure resembles an organic structure, it can be determined that the object 26 is presumably a piece of clothing, or at least a non-dimensionally stable, but deformable, flexible or textile object 26, and this can then be classified accordingly as non-dangerous. If, on the other hand, it is determined that the object 26 has a smooth surface, this can indicate, for example, a hard, non-deformable object and the object 26 is at least not classified directly as non-dangerous, but rather, for example, as potentially dangerous, or further criteria can be used to assess the risk potential of the object 26, for example those described above.If, as in this example, the object 26 is now classified as potentially dangerous on account of its size and / or weight and its position on the rear rear seat bank 28, an optical warning signal 40 is output by the warning device 12, as will now be explained in more detail with reference to FIGS. 2 and 3.As schematically shown in FIG. 2, the object 26 is illuminated by the projector 20, whereby the warning signal 40 is provided. In particular, this example is a contour illumination 42 of the contour of the object 26. For this purpose, the geometry of the object 26 can be measured by the cameras 22 and, correspondingly, based on these measurement data, the geometry of the contour, at least only one side of the object 26 and / or a plurality and / or all sides of the object 26 can be determined and a corresponding illumination 42 with a corresponding geometry can be projected onto the object 26 by the projector 20. However, this projection 42 may be provided not only as a static projection 42 but also as a moving projection 42 as illustrated in FIG. 3. For example, the projector 20 illuminates the contour of the object 26 and shows an animated motion 44 to be illustrated by the arrow 44 shown in FIG. 3, for example towards the interior or center of the interior or even to a recommended stowage position P 2 previously associated with the object 26, such as the stowage compartment or luggage storage area 35 in this example.The object 26 classified as potentially dangerous can be assigned to a suitable stowage location or to a suitable stowage position, such as the second position P 2 illustrated here, likewise as a function of a wide variety of criteria. For example, in this case too, in principle different possible stowage positions or stowage regions within the motor vehicle 10 can again be defined first and stored in the memory 16 of the control device 14. In addition to these stored possible stowage areas, further parameters describing these areas or parameters associated with these stowage areas can also be stored, such as, for example, the geometric dimensions of these possible stowage areas, the positions of these stowage areas, optionally weight areas, which indicate for which weight these stowage areas are suitable, so that, for example, items 26 that are heavier than such a predefined weight area cannot be stowed in the relevant stowage area.Such stowage areas can represent, for example, the luggage storage compartment 35 described, as well as, for example, also the parcel shelf 34, the floor 36, in particular under the front seats 32, various defined storage areas present in the motor vehicle 10, such as, for example, those in the area of the doors or in the area of the central console 46, or the like. The characteristics detected for the object 26, such as weight, geometry, size, and the like, can then be correspondingly compared with the parameters stored for the respective possible storage areas 34, 35, 36 in order to thus determine possible stowage positions for the specific object 26. The various criteria can also be weighted according to relevance if necessary. For example, the spatial proximity represents a rather subordinate criterion. If a plurality of suitable stowage positions have been determined for a detected object 26 from which a possible risk arises, then the closest one can be selected, for example, on the basis of a position comparison, in order to facilitate stowage by the user 24.If, for example, it happens that no suitable stowage position could be determined by the warning device 12, or if the optional determination of a suitable stowage position is not provided at all according to one embodiment variant, then it is preferred that the warning 40 is not provided as an animated projection to a defined assigned stowage position P 2, but, for example, as already mentioned above, merely as an animated projection 42, for example the contour, in the direction of a central region in the interior of the motor vehicle 10 or another predefined position within the interior of the motor vehicle, at least away from the current location position P 1 of the object 26, in order to inform the user 24 to move the object 26 away from its current location position P 1 as possible. However, the warning 40 can also be provided merely as a static projection on the object 26 itself, such as, for example, the projection of a exclamation mark onto the briefcase 26 or a similar warning mark or warning symbol. In all of these cases, the user 24 may be alerted to the potential risk resulting from the improperly stored item 26. As a result, the safety in the motor vehicle 10 can be significantly increased.Even in the case of a plurality of potentially hazardous objects 26 or bulky objects 26, an optimum storage position P 2 can be determined and displayed for all objects 26, as described for the briefcase 26. The user 24 is thus always intuitively informed of the better storage position P 2. If a driver or passenger, for example, places his cell phone or mobile phone on the dashboard 30 (cf. FIG. 1 ), the contour of the mobile phone can be illuminated in a very analogous manner to that described for the briefcase 26, and furthermore the projector 20 can show an animated movement of the projected contour 42 in the direction of the interior or center of the interior. This also intuitively notifies the driver of a better storage position.For multiple items, the algorithm executed by the processor 18 may determine the optimal stowage position of all items 26 and indicate these sequentially or simultaneously where which item 26 should be deposited. This can also take place in space, i.e. the objects 26 can be displayed in a manner stacked in space by the projection provided.Overall, the examples show how the invention can provide an output of safety instructions for loose objects, by means of which instructions a user can advantageously be alerted to hazards, the best position for the luggage in the interior can be determined when loading luggage by the system, and the optimum position in the vehicle can be represented in a optically projected manner. This makes it possible for the user to find the best position intuitively, more quickly and more easily.
Claims
Method for outputting information (40) to a user (24) of a motor vehicle (10) with respect to at least one specific object (26) located in the motor vehicle (10), wherein the method comprises the following steps: - detecting the at least one specific object (26) in the motor vehicle (10); - firstly determining as a predetermined criterion a current location position (P1) of the at least one specific object (26); - depending on the specific current location position (P1) of the at least one specific object (26): checking whether the at least one specific object (26) is located in one of a plurality of predetermined position ranges of a motor vehicle interior, which are defined in advance as potentially hazardous position ranges, according to its specific current location position (P1), checking further criteria whether the at least one specific object (26) - has a weight which is greater than a predetermined weight limit value; and / or - has a size which is greater than a predetermined size limit value; and / or - has a predetermined geometry and / or structure; wherein the at least one specific object (26) is classified with respect to its risk potential on the basis of the predetermined and the further criteria, and - under the condition that it is determined during the classification that a risk arises from the at least one specific object (26), outputting an optical warning notice (40) as the information (40) by means of a projection device (20) by projecting the warning notice (40) at at least one projection position spatially correlated with the specific location position (P1) of the at least one specific object (26).Method according to Claim 1, characterized in that the optical warning sign (40) is projected as at least one warning symbol and / or warning sign onto the at least one specific object (26).Method according to one of the preceding claims, characterized in that the warning message (40) is output in the form of a temporal illumination sequence (42, 44) starting from the current location position (P1) to a predetermined position in the interior of the motor vehicle (10) which differs from the current location position (P1).Method according to Claim 1, characterized in that, if the predetermined and the further criteria are fulfilled, the at least one specific object (26) is assigned - as a function of its current location position (P1), and / or - as a function of a detected geometric property of the object (26), and / or - as a function of its weight, and / or - as a function of the presence of at least one second specific object, from which a risk likewise arises according to the predetermined and the further criteria, a stowage position (P2), in particular of a plurality of defined stowage positions (P2) within the motor vehicle (10), and the warning notice (40) is output in the form of a temporal illumination sequence (42, 44) starting from the current location position (P1) to the assigned stowage position (P2).Method according to one of Claims 1 to 3, characterized in that it is checked whether a stowage position (P2) can be assigned to the at least one specific object (26) according to at least one second criterion, and if this is not the case, the warning notice (40) is projected as a static warning notice (40) onto the at least one specific object (26) or is output in the form of a temporal illumination sequence (42, 44) which originates from the at least one specific object (26) and spatially conducts away from the at least one specific object (26) or is output in the form of a static directional notice which originates from the at least one specific object (26) and conducts away.Method according to Claim 3, characterized in that a contour of the at least one specific object (26) is detected and the temporal illumination sequence (42, 44) is output in the form of a spatially moving illuminated region (42, 44) which has a contour corresponding to the detected contour of the at least one specific object (26).Warning device (12) for outputting information (40) to a user (24) of a motor vehicle (10) with respect to at least one specific object (26) located in the motor vehicle (10), wherein the warning device (12) has a processor (18) and a memory (16) with commands executable by the processor (18), wherein the processor (18) is designed to execute the stored commands in order to execute a method according to one of Patent Claims 1 to 6.Motor vehicle (10) having a warning device (12) according to Claim 7.
Citation Information
Patent Citations
Vehicle assistance device for assisting driver while driving vehicle, has control device for generating data, which specifies recommendations for action to vehicle occupant, where recommendations are displayed by display device
DE102012219923A1
Methods for guiding and / or controlling assembly and order picking processes to be carried out at a workplace
DE102013220107A1
Motor vehicle with display option in the trunk area
DE102015003934A1
Method and apparatus for notifying of objects
US10093230B1
US000010093230B1