Device, vehicle and method of visual design of interior space of vehicle

Abstract

The invention relates to a vehicle (10), to a device, and to a method for the visual design of an interior (1) of a vehicle (10). According to the invention, the method comprises the following steps: sensor-based detection of a change of the user (9) in relation to the parking location and / or the direction of sight of the vehicle (10), and in response thereto, automatic adaptation of the position of the virtual digital image (5, 12, 13) in the vehicle (10).

Description

TECHNICAL FIELD

[0001] The invention relates to a vehicle, a device and a method for the visual design of an interior space of a vehicle. In particular, the invention relates to the presentation of a suitable situation for an interior individualization by a user. BACKGROUND

[0002] Modern vehicles can be matched to the preferences and needs of different users according to a plurality of functions. Personal digital assistants are a possibility to set a brand-specific focus and have sometimes a significant importance for the purchase decision of a customer.

[0003] Furthermore, color schemes are provided in the prior art, by which a user of a vehicle can design an interior space in accordance with his preferences. For example, the ambient lighting and / or the color scheme used on a display device are coordinated with each other here.

[0004] Modern vehicles have a large number of cameras or interfaces for smart devices carried by a user, which have a camera themselves. Furthermore, modern vehicles have a large number of display devices on which selectable display contents can be presented.

[0005] Furthermore, the use of virtual reality (VR) / augmented reality (AR) glasses in vehicles has been discussed. SUMMARY

[0006] Starting from the prior art described above, it is the task of the invention to provide a presentation of a suitable situation with regard to an individualization element (sometimes referred to as element) of a vehicle.

[0007] According to the invention, the above-mentioned task is solved by a method with the features according to claim 1, a device with the features according to claim 16 and a vehicle with the features according to claim 17.

[0008] The dependent claims show preferred refinements of the invention.

[0009] The method according to the application serves for the visual design of an interior space of a vehicle. The vehicle can be designed as a car, a transport vehicle, a truck, a motorcycle, an airplane and / or a ship. The interior space can be understood as a passenger compartment or interior space of the vehicle. In a first step, a change of a user with respect to a stay place and / or a line of sight direction of the vehicle is acquired sensorically. In particular, electronic sensors are used here, which can be designed, for example, as a camera, a capacitive sensor, a vision sensor, a microphone, a seat occupancy sensor and the like. The stay place can be inside or outside the vehicle. The line of sight direction of the user can refer to elements inside the vehicle and / or elements outside the vehicle. In particular, the user can be located here inside or outside the vehicle. In response to the sensoric acquisition and depending on the new stay place of the user, a virtual digital figure (Avatar, sometimes also called avatar) is automatically matched in a position in the vehicle. As a virtual digital figure, an object defined by the user can be understood, which represents the user himself or an object specified by the user. The object can be taken, for example, by means of a camera. Furthermore, a Verfremdung (sometimes also called alienation) process and other steps can also be included to visually modify the taken object. In this way, the virtual digital figure can be changed in stay place together with the user or the line of sight direction of the user with respect to the change in the position of himself is matched in such a way that the user perceives the virtual digital figure in the corresponding area of his field of view with respect to his (changed) line of sight direction. In this way, a positioning of the virtual figure is derived which corresponds to the changed user situation.

[0010] The change in the stay place can include a change from a first seat row to a second seat row. In other words, the virtual digital figure can be arranged on the seat surface and / or the backrest of a seat of the first seat row and, after the change in the stay place and / or the line of sight direction of the user, can be arranged on a seat (again seat surface or backrest) of the second seat row. In particular, the automatic matching of the position can include animations which include walking, jumping, swimming, flying, emitting Beamen and the like. In this way, the change of the virtual digital figure is visualized for the user in the best and most intuitive way possible The change of the user's resting place can accordingly take place in a manner from the first seat row to the second seat row. Of course, the reverse procedure of the change of the user's resting place from the second seat row to the first seat row can comprise a corresponding matching of the position of the virtual digital figure from the second seat row to the first seat row. Alternatively or additionally, the change of the line of sight can take place in a manner from pointing in the direction of travel to pointing backwards. For example, the user can first situate himself with the line of sight pointing in the direction of travel and turn his head backwards in order to gaze at persons and / or objects located on the second seat row, the third seat row or behind the vehicle. Alternatively or additionally, the user can turn the driver's seat such that it changes from a forward position suitable for driving the vehicle to a backwards pointing rest room configuration of the interior space (or vice versa).

[0011] The sensor-technically acquisition of the user's resting place and / or line of sight can have been realized in the course of the approach of the user to the vehicle, in the course of the boarding process and / or when changing position within the vehicle. For example, an exterior camera can detect and analyze the approach and boarding process of the user, while an interior space camera detects the user upon boarding and within the vehicle. The interior space camera can also be used for line of sight analysis. For example, the interior space camera can be arranged in the combination instrument, the dashboard, the mirror base, etc.

[0012] The automatic matching of the figure can comprise displaying the figure on an outwardly pointing display of the vehicle, which is particularly advantageous when the user is also located outside the vehicle. If the user changes into the interior space of the vehicle, the figure can be presented, for example, by means of an inwardly pointing display. In particular in the vehicle, the user can also use AR glasses in order to display the virtual digital figure. The use of AR and / or VR and / or MX glasses can enable the greatest possible flexibility in the positioning of the virtual digital figure according to the invention. In this way, the user can be accompanied by the virtual digital figure in the best possible way and use his presence in order to obtain information collected and / or acquired by the vehicle.

[0013] Preferably, the method according to the application can be extended by detecting real objects in order to create virtual digital avatars. The image of the object selected / presented by the applicant can be realized by means of a camera. To this end, an instruction (Anleitung, sometimes referred to as tutorial) can be output to the user, which, for example, presets the position and / or rotation process for the complete taking of the image of the object. After detection, the method according to the application can be realized by automated (automatic) visual cropping of the image of the object with respect to the interior space of the vehicle, the hand of the user or other extraneous objects. For this purpose, for example, prior knowledge about the design of the interior space of the vehicle can be used. In particular, for example, a separate configuration can be stored (at the factory) in the vehicle or in a storage area associated with the vehicle, according to which the visual design of the interior space of the vehicle is primarily defined. According to these information, the object brought into the vehicle (at a later point in time) can be identified as best as possible in the picture material. Subsequently, the cropped image of the object is displayed on a display device in the vehicle. The user can then specify that the image of the object should be used as an avatar immediately after cropping. Alternatively, the user can select from a plurality of predefined objects representing images. To this end, the method according to the application can comprise an automatic object analysis of the image of the object. In a database (for example, in the vehicle or accessible via the Internet), a plurality of predefined data sets can be presented for the class of objects, which, for example, are prepared in a photographic and / or in a cartoon-like manner as a representation of the class. For example, an apple (which the user has taken as a real object) can be represented by an icon or a further similar apple character created in a cartoon-like manner. In this way, data sets provided with eyes and a mouth (and, if necessary, further body parts) can be used in order to design the output of information to the user by the vehicle to be intuitively comprehensible and interesting. In particular, the lip movement can be influenced by a speech output signal. In particular, in this way, a lip-synchronized speech output can also be appreciated by hearing-impaired passengers of the vehicle.

[0014] Preferably, the animation of the avatar can be achieved by acquiring sensor signals using the vehicle. For example, position signals and / or orientation signals (compass signals) and / or acceleration signals and / or light intensity signals and / or camera signals and / or ultrasonic signals and / or sound signals can be used as sensor signals. Based on this information, the user's orientation and / or the user's viewing direction can be determined, but in particular, virtual movement / animation of the virtual digital avatar can also be performed. For example, the acceleration signal can ensure that the avatar exhibits inertial phenomena corresponding to elastically oriented real objects, thereby also preventing motion sickness in the occupants. In particular, the virtual elastically suspended avatar can, for example, sway in the direction of travel during braking or tilt about the vehicle's Y axis. During steering maneuvers / cornering, the avatar can rotate about the X axis and / or deflect in the Y or -Y direction. Using the light intensity signal and / or the signal indicating the direction of light incidence, a virtual digital avatar that is as realistic as possible or corresponds to the current (actual, sometimes referred to as realistic) light conditions ( Sometimes referred to as light ratio) and a corresponding visual presentation. For example, the position of an image can be changed from a first display device of the vehicle to a second display device that is not part of the first display device. For example, the image can be changed from a central information display to an instrument cluster (or vice versa), from a head-up display to an instrument cluster (or vice versa), or from a head-up display to a central information display (or vice versa). A corresponding transformation process also occurs with respect to display devices (rear seat entertainment screens, etc.) located in the second seat row (or a seat row located further back). In particular, when using AR / VR / MX glasses, extremely flexible repositioning of the image within the vehicle is possible. In particular, the image can be kept within the user's predefined field of view. If the user changes the direction of their gaze, an animation of the image is played, in which the image changes from its previous position to a position corresponding to the previous position in the user's updated field of view. In particular, the position of the image can also be changed to a smartphone, or from a smartphone to the vehicle screen (or vice versa).

[0015] Optionally, the user can also define a desired position for the avatar via user input. For example, the user can perform a pointing gesture (pointing gesture) or a swipe gesture, thereby animating and / or presetting a new position for the avatar in a touch-like manner. In response, the avatar can be moved to the new position, directly pulled / pulled by the user's gesture, or simply appear at the new position (with all previous positions disappearing).

[0016] According to a second aspect of the application, a device for the visual design of an interior space of a vehicle is proposed, wherein the vehicle is designed as a car, a transport vehicle, a truck, an airplane and / or a ship. The device comprises a data input, an evaluation unit and a data output. The data input can be connected with a bus of the vehicle. The data input can be set up to receive camera signals and optionally further sensor signals. The evaluation unit can be a component of an electronic controller and have a programmable processor. The data output is set up at least to supply a picture material related to a virtual digital figure to one, preferably multiple, display devices in the interior space of the vehicle and / or facing the exterior of the vehicle. In this way, the device is set up to realize the features, combinations of features and advantages derived therefrom of the method according to the application in the respective way so obviously that, in order to avoid repetitions, reference is made to the above embodiments.

[0017] According to a third aspect of the application, a vehicle is proposed, which has an embodiment of the device according to the application as it has been introduced above in connection with the second mentioned aspect of the application. The features, combinations of features and advantages are also derived in the respective way with respect to the vehicle, which can be designed as a car, a transport vehicle, a truck, an airplane and / or a ship. BRIEF DESCRIPTION OF DRAWINGS

[0018] Further details, advantages and features of the application result from the following description of embodiments according to the drawings. Therein:

[0019] Figure 1 A schematic view of a user approaching an embodiment of the vehicle according to the application with an embodiment of the device according to the application is shown;

[0020] Figure 2 A perspective view of a vehicle interior space within which a user implements an embodiment of the method according to the application is shown;

[0021] Figure 3 A schematic view of components of an embodiment of the device according to the application is shown; and

[0022] Figure 4 A flow chart illustrating the steps of an embodiment of the method according to the application for the visual design of an interior space of a vehicle is shown. DETAILED DESCRIPTION

[0023] Figure 1 A user 9 is shown, which is located in the detection range of a front-facing camera 3 as a camera and approaches a car as an embodiment of the vehicle 10 according to the application. At an earlier point in time, the user 9 has predefined a figure 13, which is presented on an external display 17 as soon as the user 9 has been recognized by means of the front-facing camera 3.

[0024] Figure 2 An interior space 1 of an embodiment of a vehicle 10 according to the application is shown, within which a user 9 is seated on the driver's seat 18 at this time. The user 9 wears AR glasses 11 as display device. The user 9 holds an apple 2 as real object in his hand, which is located in the detection range of the interior space camera 4. After the (not represented) steps of the user 9 have been carried out, which are caused by the vehicle 10 for taking a picture of the apple 2, a cropped image 5 is presented on the central information display CID 6. The user 9 can confirm the use of the image 5 or select an alternative presentation. In particular, the user 9 can cause a 3D presentation of the apple 2 in the form of an avatar 12 on the center console with the aid of the AR glasses 11, on which also a smartphone 8 of the user as portable user terminal appliance is placed. The smartphone 8 is equipped with an acceleration sensor, which can communicate with the vehicle's on-board network. Depending on the signal of the acceleration sensor, the avatar 12 can move / rotate / vibrate / animate etc. The respective content applies to the image 5 on the central information display 6. Via lip-synchronized animations of the avatar 12 or the image 5, a speech output or navigation commands and other acoustic information to the user 9 can also be output in a way that is intelligible to hearing-impaired persons. A fully autonomous forward movement of the vehicle 10 allows a swivel of the driver's seat 18, as this is represented by the arrow P. The user 9 now looks in the rearward direction and fixates on the conference monitor 7, on which an image of the apple as avatar 13 is presented. The presentation of the avatar 13 can be caused, for example, by sensors in the driver's seat 18 (in response to a swivel thereof) and / or by evaluating the pictures of the interior space camera 4. In other words, it is automatically ensured that the avatars 12, 13 or the image 5 are always in the secondary or even primary field of view of the user 9. In this way, a suitable and comfortable design of the interior space 1 of the vehicle 10 can be carried out.

[0025] Figure 3 A schematic diagram of components of an embodiment of the apparatus according to the application is shown. The front camera 3 is connected in an information-technical manner with a data input 14 of an electronic controller as evaluation unit 15. The evaluation unit 15 is set up to acquire pictures of the front camera 3, to crop predefined objects in the picture stream and to check them, in particular with regard to a category class. The evaluation unit 15 is set up via a data output 16 to provide categories associated with images of real objects to the user for selection. This can be realized, for example, on the central information display 6, which is linked in an information-technical manner with the data output 16.

[0026] Figure 4Steps of an embodiment of a method for visual design of an interior space of a vehicle according to the present application are shown. In step 100, a change in the user's stay and / or line of sight direction with respect to the vehicle is technically acquired by sensors. This can be achieved by evaluating signals of a portable user terminal appliance carried by the user and / or by means of visual sensors, capacitive sensors, microphones or seat occupancy sensors. In response thereto and depending on the new stay of the user, in step 200, an automatic virtual figure is positioned in the matching vehicle. In other words, the virtual figure is moved in the vehicle such that it is in a known relationship with the user, in particular his field of view, after the change in the user's stay or line of sight direction. In step 300, the user is output an instruction to take an object from different sides. In other words, the user is given step-by-step instructions, in particular by the vehicle, by means of which the user is enabled to use the desired object as a virtual figure. In step 400, the real object is accordingly held in the hand by the user and detected by means of a camera for generating an image of the object. In order that the real object or its image can be used as isolated as possible for designing the virtual figure, the image of the object is subsequently visually cropped (step 500). Subsequently, in step 600, the figure is displayed on a display device in the vehicle. The figure designed in correspondence with the real object is thus continuously used for outputting the on-board network information of the vehicle. In step 700, sensor signals are subsequently acquired, for example by a front camera or an interior space camera of the vehicle. In step 700, an information-technical basis is thus created for matching the visual appearance of the figure on the display device in step 800. For example, movements, orientation changes, vibrations and accelerations can be used in order to make the figure behave as realistically as possible in the vehicle. In step 900, the class of the object is subsequently automatically identified. For this purpose, object recognition algorithms known in the prior art can be used, which make use of databases prepared in the vehicle or via the Internet. From the image of the object, the class is thus ascertained, for which a predefined representation is subsequently selected by the user. This can be, for example, a representation of the class of the object prepared in cartoon technology. Finally, in step 1000, the cropped image is replaced by a virtual figure logically associated with the class. In other words, the virtual figure is visually updated depending on the class of the object taken.

[0027] List of reference signs

[0028] 1 interior space

[0029] 2 apple

[0030] 3 front camera

[0031] 4 interior space camera

[0032] 5image

[0033] 6central information display (CID)

[0034] 7conference monitor

[0035] 8smartphone

[0036] 9user

[0037] 10vehicle

[0038] 11AR glasses

[0039] 12avatar

[0040] 13avatar

[0041] 14data input

[0042] 15evaluation unit

[0043] 16data output

[0044] 17external display

[0045] 100-1000method steps

[0046] Parrow

Claims

1. A method for visual design of an interior space (1) of a vehicle (10), comprising the steps of: - sensorically acquiring (100) a change of a user's (9) stay and / or line of sight direction with respect to the vehicle (10) and in response thereto - automatically matching (200) a position of a virtual digital figure (5, 12, 13) in the vehicle (10).

2. The method according to claim 1, wherein - the change of stay is effected in a manner from a first seat row to a second seat row, and / or - the change of line of sight direction is effected in a manner from pointing in a driving direction to pointing backwards.

3. The method according to any of the preceding claims, wherein, The sensoric acquisition is effected by means of an - interior space camera (4), and / or - exterior camera (3) of the vehicle (10).

4. The method according to any one of the preceding claims, wherein, The automatic matching of the position of the figure (5, 12, 13) comprises displaying the figure on an outwardly pointing display (17) of the vehicle (10) and subsequently transforming the figure (5, 12, 13) to an inwardly pointing display.

5. The method according to any one of the preceding claims, further comprising - cameraically detecting (400) a real object (2) for generating an image of the object (2), - automatically visually cropping (500) the image of the object (2) for generating the figure (5, 12, 13), and - displaying (600) the figure (5, 12, 13) on a display device in the vehicle (10).

6. The method according to claim 5, further comprising - outputting (300) instructions to the user (9) for photographing the object (2) from different sides.

7. The method according to any one of the preceding claims, further comprising - acquiring (700) sensor signals by means of the vehicle (10) and depending on the sensor signals - matching (800) a representation of the figure (5, 12, 13) on the display device.

8. The method of any of the preceding claims, wherein, The sensor signals comprise - position signals, and / or - orientation signals, and / or - acceleration signals, and / or - light intensity signals, and / or - camera signals, and / or - ultrasound signals, and / or - sound signals.

9. The method according to any of the preceding claims 5 to 8, wherein, During the detection, the object (2) is held in the hand of the user (9).

10. The method of any of the preceding claims, wherein, The position of the figure (5, 12, 13) is matched to - the vehicle (10), and / or - AR / VR / Mx glasses (11), and / or - a display device of a smartphone (8).

11. The method according to any one of the preceding claims, further comprising - acquiring a user input representing a position within the interior space (1) and in response thereto - bringing the figure (5, 12, 13) to the position.

12. The method according to any one of the preceding claims, further comprising - automatically identifying (900) a class of the object (2), and - replacing (1000) the cropped image by a figure (5, 12, 13) logically associated with the class.

13. The method according to any one of the preceding claims, further comprising - using the avatar (5, 12, 13) for - voice output, and / or - a personal digital assistant.

14. The method according to any one of the preceding claims, wherein, Matching the appearance includes - matching virtual light conditions, and / or - motion animation, and / or - orientation.

15. An apparatus for the visual design of an interior space (1) of a vehicle (10), comprising - a data input (14), - an evaluation unit (15), and - a data output (16), wherein the apparatus is set up to - sensorically acquire changes in the user's (9) stay and / or line of sight direction with respect to the vehicle (10) by means of the data input (14), and - to automatically match the position of a virtual digital avatar (5, 12, 13) in the vehicle (10) in response thereto by means of the data output (16).

16. A vehicle (10) comprising an apparatus according to claim 15.

Images