AR or VR glasses and methods for configuring a 3D model of a means of transport

Abstract

AR or VR glasses (20) and a method for configuring a 3D model (2, 3, 4) of a means of transportation by a user (1) are proposed. The method comprises the following steps: displaying a 3D model (2, 3, 4) of the means of transportation using a 3D display device (5), sensor-based detection of a voice input (6) from the user (1) that specifies a criterion using a microphone (7), and automatically adapting the display of the 3D model (2, 3, 4) according to the specified criterion based on the voice input.

Description

The present invention relates to AR or VR eyeglasses and a method for configuring a 3D model of a vehicle by a user. In particular, the present invention relates to a particularly intuitive and ergonomic possibility for configuring a means of transportation to be produced (to be ordered), in particular a new car.In the prior art, customers can configure new vehicles by determining the specification / equipment / special equipment of the means of transportation online. The files created in this case can then be sent to a car house or submitted for the distribution of a purchase offer. The configurators are usually directed to technically affine humans. With the terms relating to the special equipment, people who are less sophisticated in particular may occasionally start little and feel over. This may result in configuration processes being broken off prematurely or never being carried out completely. This results in a fruitless time expenditure for the user, while the vehicle manufacturer is charged with the provision of the configurator and an expired new car sale.Furthermore, AR / VR glasses are known in the prior art, by means of which immersive virtual or augmented reality experiences can be provided. Usually, game courses or 3D movie scenes are presented here.Proceeding from the aforementioned prior art, it is an object of the present invention to configure a configuration of a means of transportation in a particularly user-friendly and ergonomic manner.The aforementioned object is achieved according to the invention by a method for configuring a 3D model of a means of transportation by a user with the features according to claim 1 and by AR or VR spectacles with the features according to claim 14.The dependent claims show preferred developments of the invention.According to the invention, for example, a passenger car, a transporter, a truck, a motorcycle, an aircraft and / or watercraft is configured as means of transport by the user. The goal of the process can be seen to be the issuance of a production order to a vehicle manufacturer. For this purpose, in a first step, a 3D model of the means of transportation is displayed by means of a 3D display device (for example AR or VR spectacles). In particular, a plurality of 3D models of a plurality of means of transportation can be displayed next to one another or virtually around the user. The 3D display device may be, for example, a display device worn on the head of the user. In particular, this can result in an immersive virtual environment for the user, within which the 3D models of the means of transportation or of the means of transportation are displayed. The method according to the invention is speech input-based, so that in a second step a sensor-based detection of a speech input of the user takes place, by means of which the user concretizes or fixes a criterion. The criterion can comprise, for example, an interior color, an exterior color, a tire / rim size, a body variant, a number of seats or the like. The voice input is recorded by means of a microphone and analyzed by an evaluation unit. Depending on the voice input, the representation of the 3D model or the 3D models is then automatically adapted in order to realize the concreted criterion (ideally timely or immediately or in real time) on the 3D model. In other words, an adaptation of the illustrated 3D model or the illustrated 3D models is carried out automatically as a function of the voice input. This can comprise a respective adaptation of the 3D models shown. Alternatively or additionally, 3D models, which cannot be adapted in a concrete manner, can be hidden or no longer offered continuously. For example, a specification of a seat number which cannot be provided by a 3D model shown can result in this 3D model being omitted and no longer being available for the continuing configuration process until the criterion is deleted or widened in such a way that the 3D model can be specified in the same way. The speech input can be processed in particular by an artificial intelligence, a neural network, a machine-based learning algorithm, or the like. For example, a functionality corresponding to the application "Chat GPT" can be provided, so that the user can essentially freely call his criteria for the means of transportation. Depending on the criteria, the means of transportation are represented by a 3D model, which the provider is able to offer. For example, such an order / specification may be: "Show the vehicles available from the manufacturer X, which are suitable for a family with three children and one dog for journeys up to 450 km in length, also in environmental zones and on car goods." Later, a further criterion may be added, which is, for example: "The vehicle is to be allowed to tow a trailer load of 2.5 tons." The automatic adaptation of the representation of the 3D model may thus be implemented in real time, so that the user can immediately experience the effect of the more detailed specification by the show room / parking space around him being increasingly sparsely occupied. The user can then carry out the visual and further technical configuration of the remaining 3D models, ultimately decide on one of the means of transportation represented and make the specification the basis of an offer request.The 3D models can be moved slowly about their own axis, for example, as on a presentation pane, provided that the user does not stop them explicitly by a user input. Alternatively, the transport means can be rotated in different directions in response to a user input (for example a (swiping) gesture carried out freely in space, which in particular starts on the respective 3D model), in order to be able to investigate the effects on the nature of the model. In particular, the user can approach the 3D model of a respective means of transportation, slide a 3D model next to another 3D model shown, and activate assemblies of the 3D model in order to have detailed information and options displayed for adaptation. For example, after the selection of the wheels, a table may be displayed that represents the available tire / rim variants. By voice input or gesture operation, the user can now select another variant of the criterion "vehicle wheel", which is displayed in real time on the 3D model. Optionally, effects on a potential list price of the means of transportation can also be displayed in real time. For this purpose, the total sum for a respective means of transport corresponding to the 3D model can be represented in a predefined logical relationship, in particular a spatial relationship to the 3D model. Alternatively or additionally, for each 3D model, a plurality of components can be represented with a respective price or price offset, so that the composition of the list price becomes particularly transparent.The criterion can relate, for example, to interior scopes or special equipment such as, for example, infotainment system, connectivity and / or driver assistance systems.A specification of the interior scopes can also lead, for example, to automatically selecting a view of the 3D model, on the basis of which the user can particularly well assess the effect of the specification of the criterion. In other words, depending on the concrete / adapted criterion, a perspective / observer position of the user with respect to the means of transport can be automatically adapted immediately, by means of which a particularly good observation or assessment of the effect of the adaptation of the criterion is possible. In particular, this automatic change of the perspective can be reversed after a predefined time duration has elapsed or after a predefined user input has been received. In this way, it is possible, for example, to automatically return to a predefined external view / total in order to be able to quickly and comprehensively carry out an aesthetic classification of the adapted criterion into the overall impression of the means of transportation.As soon as the user is satisfied with the configuration of his 3D model or wishes to pause the configuration process (temporarily), he can express the wish to send a data record representing the 3D model to an address assigned to him (mobile telephone, email address, user profile in a database of the vehicle manufacturer) and to store it there. For example, the configuration can be resumed at a later time after login. In particular, the data record can be sent to a portable wireless communication terminal (smartphone, tablet, smart wearable, or the like), which is logically assigned to the user.The voice input can be improved by setting a presumed address thereof in advance. For example, the user can define a region of the transportation means, in particular a module, to which the voice input is to relate. For example, the user can carry out a gesture for this purpose, which "activates" the component to be concreted. For example, it can point to a module of a 3D model, which is optically emphasized for the output of an optical feedback to the selection. For example, a corona, color change, shade, border, or the like may be displayed to highlight the component to be adjusted. If a user's speech input is now carried out, which suggests an adaptation of the component, different weights can be carried out in the algorithm for speech analysis depending on the nature of the component. For example, inputs such as "inch", "light metal", "multi-spoke", "Niederquerschnittsbereifung"etc. can occur with a higher probability for the component wheel / tire combinations than for the definition of an interior circumference (seats, or the like). Therefore, the probability of hits in the speech analysis can be easily increased by pre-knowing the component to be adapted or the computing effort for successful analysis can be reduced.Similarly, a viewing direction of the user with respect to the 3D model or with respect to a component to be adapted can also be evaluated on the 3D model in order to promote the voice input. For example, a viewing direction of the user on a module of the 3D model can result in a synchronized voice input of the user being carried out with a hit weighting which is adapted to the nature of the component.Furthermore, the method according to the invention can be made more comfortable and more fault-tolerant by using the viewing direction of the user with respect to the 3D model or the component to be adapted in order to adapt an algorithm for evaluating a gesture of the user for interaction with the 3D model. For example, when looking at a door of the user, a gesture may more likely intend to open the door than the rotation of the entire vehicle. Similarly, a gaze under the hood of the model may be more likely desired if the user also looks at the hood during execution of the hood addressing gesture. In a corresponding manner, a sliding roof, a tailgate or a drive train can be manipulated with a higher probability by a gesture if the user views the respective component synchronously or has previously designated it by his viewing direction. For this purpose, the user can also acknowledge a gaze with a blink event, as a result of which the component remains activated until another component is intended to maintain the input focus in a corresponding manner. In this way, a particularly user-friendly, since fault-tolerant, method can be provided in order to configure a means of transport in an illustrative manner.The user can preferably execute the method according to the invention in a garage, in particular the home garage or the garage at the workplace. In this case, it can be particularly advantageous to be able to represent a life-sized 3D model and thus to be able to check to what extent a parking process will be possible comfortably and without damage / hindrances to the environment. In particular, for this purpose, the user can bring the means of transport into a configuration in which the doors / tailgate / engine hood / the hood, etc., are brought into a position / configuration that takes up a maximum amount of space. The user can now, for example, walk around the means of transportation in order to take into consideration the remaining distances to the walls or other spatial boundaries. If the distances should not be authorized, the user can also make a voice input for this purpose (for example: "Zig Mir rather a smaller car") in order to call up the display of a next smaller means of transportation, which nevertheless meets most or all of the criteria defined in advance.During the configuration process, which usually takes several minutes or even hours, it is possible to avoid the user having to remove the AR or VR glasses several times and put them on again by the screen view of his smartphone display being captured by sensors or being sent to the 3D display device in a form using data technology. For example, an incoming email, phone call, text message, or the like may be presented within the configuration view in this manner. In other words, the user can remove his smartphone from the pocket and, within the 3D representation comprising the 3D models, know the content of his smartphone on the basis of the optical representation of the smartphone display. In particular, the user can also make inputs on the smartphone display or within its representation within the 3D representation in order to answer the incoming messages / calls. The sensor system for this can be implemented by means of the actual digitizer of the smartphone, for which purpose the user should obtain a virtual representation of his thumb on the smartphone display within the virtual representation. Alternatively, the user may operate the smartphone "blindly" and be able to be surprised by the success of the input. The content of the smartphone display can be captured, for example, by a camera which is logically assigned to the 3D display device. Alternatively, the smartphone can also be logically coupled to the 3D display device using information technology or the like in order to send a (possibly simplified) screen view to the 3D display device in the manner of Apple Car Play or Android Car. Since the screen view is optionally interpreted / communicated in a segmented manner (in a rudimentary) manner, the 3D display device can optically emphasize the respectively currently addressed unit on the representation of the screen view when the user sweeps over the representation of the screen view of the smartphone display. In this way, the user does not have to interrupt the configuration by placing the 3D display device and operating his smartphone in the "real" world.The configuration according to the invention can even go so far that the user takes place virtually in the means of transport or its 3D model. For example, the user can virtually take place on the driver seat, the passenger seat or a rear seat for this purpose in order to review the means of transport with respect to his interior and / or to experience the effect of changes in a criterion of the interior in the best possible manner. In particular, the user can experience a representation of the user operating concept of the means of transportation for this purpose. In particular, gesture operation, as implemented in the actual means of transport, can be simulated provided that the actually present sensors of the 3D display device or of a sensor unit logically assigned to it enable sufficiently exact analysis of the user gestures. In particular, a screen view of the display of the 3D model or of the represented transportation means to be configured can therefore also be displayed and operated. The user can thus experience the operability of the user operating concept in the context of the current configuration of the means of transportation. For example, the sizes of a display arrangement which is located in the dashboard / in a central console of the means of transport can be examined and tried. The user can experience the operating logic of the means of transportation and exercise it as required. All operating steps have, so to speak, an immediate effect on the representation of the screen view of the display of the 3D model and on the possible effect to be perceived on the current configuration / appearance of the 3D model of the means of transportation to be configured.According to a second aspect of the present invention, an AR or VR eyeglasses is proposed, which can be understood as a 3D display device worn on the user's head. The AR or VR spectacles further comprise a data input, which can comprise wireless communication with further sensors and / or the Internet. In particular, the data input can be coupled to a microphone, which the user can use to input his voice commands. An evaluation unit is also provided for analyzing the voice commands, generating the representation and carrying out the communication with any other portable wireless communication terminals. In addition, a data output is provided, which can be coupled in particular to the 3D display device (display of the VR or AR spectacles). In this way, the AR or VR spectacles are configured to implement a method according to the above-mentioned first aspect of the invention in a corresponding manner such that reference is made to the above explanations in order to avoid repetitions with respect to the features, feature combinations and the advantages resulting therefrom.Brief Description of the FiguresFurther details, advantages and features of the present invention are evident from the following description of exemplary embodiments with reference to the drawing. The following are shown: FIG. 1 shows a perspective illustration of a user when carrying out a method according to the invention by means of an exemplary embodiment of AR or VR spectacles according to the invention; FIG. 2 shows a schematic side view of an exemplary embodiment of an AR or VR spectacles according to the invention; and FIG. 3 shows a flow chart illustrating steps of an exemplary embodiment of a method according to the invention for configuring a 3D model of a means of transportation by a user.FIG. 1 shows a user 1 holding a portable user terminal 8 in the form of a smartphone in his left hand. The smartphone has a (real) monitor 11. The user 1 wears on his head a first exemplary embodiment of an AR or VR pair 20 according to the invention, which has an immersive screen as 3D display device 5, a data input 13 coupled to a microphone 7, an evaluation unit 14 in the form of a programmable processor and a data output 15 coupled to the immersive screen. The user 1 influences the display of three 3D models 2, 3, 4 representing respective means of transport, which are parked virtually around him, by means of a voice command as voice input 6. The 3D models 2, 3, 4 have doors 10 and vehicle wheels as assemblies which can be understood or selected as addressed components 9. In addition, the 3D models 2, 3, 4 have central screens as displays 12, which can be provided with virtual representations of the graphical user interfaces. The user 1 views the 3D model 3 and points with his right hand to the front right wheel, whereby he addresses the wheel as component 9 by means of a gesture. Its speech input 6 can therefore be analyzed and processed with high probability as related to the addressed component 9. In other words, the voice input 6 relates with high probability to a criterion by which the component 9 can be individualized / changed / adjusted. Speech inputs which may not be unambiguously interpretable (for example on the basis of background noise, numerics or ambiguous pronunciation) can thus be corrected / interpreted with a concrete prior knowledge about the vocabulary to be assumed with respect to the vehicle wheels by knowing that this is a vehicle wheel.FIG. 2 shows a second exemplary embodiment of a 3D display device 20 according to the invention in the form of AR or VR spectacles 20, which have an immersive screen as a 3D display device 5, which is connected by information technology to a data output 15 of an evaluation unit 14. The evaluation unit 14 can record, process and, after successful evaluation, adapt the representation of the 3D models on the 3D display device 5 via a microphone 7 and a data input 13. Via an elastic band 16, the AR or VR eyeglasses 20 can be fixed to the head of a user.FIG. 3 shows steps of an exemplary embodiment of a method for configuring a 3D model of a means of transportation by a user. In step 100, a 3D model of a means of transportation is displayed by a 3D display device. For this purpose, the user can experience a virtually life-sized representation of the means of transport in front of him or at a distance of a few meters. In step 200, a voice input of the user, by means of which the user concretizes a criterion of the 3D model, is detected by means of a microphone using a sensor technology. The microphone can be arranged, for example, on VR or AR spectacles. Depending on the voice input for which artificial intelligence is used in step 300, the representation of the 3D model is finally automatically adapted in step 400 according to the concreted criterion. For example, a component / assembly of the means of transportation is adapted, exchanged, removed or added. In step 500, a gesture of the user with respect to the 3D model is subsequently determined by means of sensor technology, by means of which gesture a component on the 3D model is addressed and thereby activated. Depending on the addressed component to which the user has pointed, for example, an algorithm for speech input or speech analysis is then adapted in step 600. The preselection of the component in step 500 is used in step 600 so to speak for component-specific vocabulary weighting. In step 700, a viewing direction of the user with respect to the 3D model is then determined by sensor technology, by means of which a component on the 3D model is addressed. Depending on the addressed component, the algorithm for speech input is then adapted again in step 800. In other words, in addition to the gesture of the user, a viewing direction of the user is also evaluated in order to unambiguously determine the component and / or in order to increase the weighting of the component-specific vocabulary again. In step 900, the viewing direction of the user with respect to the 3D model is then determined using sensors. The viewing direction addresses a predefined component on the 3D model, for which reason an algorithm for evaluating a gesture of the user is subsequently adapted in step 1000. In particular, the same gesture can execute a different function on the 3D model depending on the previously activated / addressed component. For example, a door can be opened while an identical gesture with respect to a B-pillar or a fixed body part results in the display of the 3D model being rotated. Finally, in step 1100, after successful configuration of the 3D model, a data record representing the adapted 3D model is sent to a smartphone of the user. By means of a payment function on the smartphone, the user can carry out the payment process for the transportation means just configured and can thereby complete the ordering of his new car.List of reference characters1 User 2, 3, 4 3D model 5 3D display device 6 voice input 7 microphone 8 portable user terminal 9 addressed component 10 door 11 smartphone display 12 display 13 data input 14 evaluation unit 15 data output 16 elastic band 20 AR or VR eyeglasses 100 to 1100 method steps

Claims

Method for configuring a 3D model (2, 3, 4) of a means of transportation by a user (1), comprising the steps: - displaying (100) a 3D model (2, 3, 4) of the means of transportation by means of a 3D display device (5), - sensor-technology capturing (200) of a voice input (6) of the user (1) specifying a criterion by means of a microphone (7) and, depending on the voice input, - automatic adaptation (400) of the display of the 3D model (2, 3, 4) in accordance with the specified criterion.The method according to claim 1, further comprising - using (300) an artificial intelligence for automatic analysis of the speech input.Method according to claim 1 or 2, wherein the presenting of the 3D model (2, 3, 4) comprises: - presenting a plurality of 3D models (2, 3, 4) of different means of transportation, which correspond to the criterion of the user (1).Method according to any of the preceding claims, wherein - the 3D model and / or - the criterion comprises interior scopes.Method according to claim 4, wherein the interior scopes comprise - a paint and / or - a material and / or - a seat cover and / or - equipment with display units.Method according to one of the preceding claims, wherein the 3D display device (5) comprises AR or VR spectacles.Method according to any of the preceding claims, further comprising - sending (1100) a data set representing the adapted 3D model to a portable wireless communication terminal (8) of the user (1).Method according to one of the preceding claims, further comprising - sensor-technology determination (500) of a gesture of the user (1) with respect to the 3D model (2, 3, 4), by means of which a component (9) is addressed to the 3D model (2, 3, 4), and, depending on the addressed component (9), - adaptation (600) of an algorithm for speech input.Method according to one of the preceding claims, further comprising - sensor-technology determination (700) of a viewing direction of the user (1) with respect to the 3D model (2, 3, 4), by means of which a component (9) is addressed to the 3D model (2, 3, 4), and, depending on the addressed component (9), - adaptation (800) of an algorithm for speech input.Method according to one of the preceding claims, further comprising - sensor-technology determination (900) of a viewing direction of the user (1) with respect to the 3D model (2, 3, 4), by means of which a component is addressed to the 3D model (2, 3, 4), and, depending on the addressed component (9), - adaptation (1000) of an algorithm for evaluating a gesture of the user (1).Method according to one of the preceding claims, further comprising - determining a gesture of the user (1) with respect to the 3D model (2, 3, 4) by means of which a door (10) is addressed on the 3D model (2, 3, 4) by sensor technology, and as a function of the addressed door (10) and a trajectory of the gesture, - animating an actuation of the door (10).Method according to one of the preceding claims, further comprising - transmitting a current screen view of a smartphone display (11) to the 3D display device (5) and - presenting an image of the current screen view of the smartphone display (11) of the 3D model (2, 3, 4) on the 3D display device (5).Method according to claim 12, further comprising - determining an interaction of the user (1) with the image of the current screen view of the smartphone display (11) and / or the smartphone display (11) and / or with the image of the current screen view of the display (12) of the 3D model (2, 3, 4) on the 3D display device (5) and, depending on the interaction, - adapting the image of the current screen view of the smartphone display (11) or the smartphone display (11) or adapting the image of the current screen view of the display (12) of the 3D model (2, 3, 4) on the 3D display device (5).Spectacles for AR or VR (20) comprising - a data input (13) coupled to a microphone (7), - an evaluation unit (14) - a data output (15) coupled to a 3D display device (5), wherein the spectacles for AR or VR (20) are configured to carry out a method according to one of the preceding claims.

Images