Motor vehicle and method for providing images and / or videos in a motor vehicle following an outdoor experience

Abstract

The invention relates to a motor vehicle (10) and a method for providing images and / or videos in a motor vehicle (10) after an outdoor experience. The method comprises the following steps: determining, by means of a computing device (12) of the motor vehicle (10), that an outdoor experience has taken place for a user of the motor vehicle (10), wherein a mobile device (16) of the user is coupled to the computing device (12) and images and / or videos recorded during the outdoor experience are determined; issuing a query as to whether a recap of the outdoor experience should be provided; creating a recap of the outdoor experience by selecting images and / or videos if the query indicates that the recap should be provided; and playing back the created recap on a display device (14) of the motor vehicle (10).

Description

[0001] The invention relates to a method for providing images and / or videos in a motor vehicle after an outdoor experience. Furthermore, the invention relates to a motor vehicle configured to carry out the method.

[0002] Today's vehicles are being equipped or developed with the ability to offer interior experiences. Images, lighting, music, massage functions, climate control, scents, and other themes can be combined to create or offer different scenarios.

[0003] Furthermore, vehicles are used to transport people on excursions or hikes. During these outdoor experiences outside the vehicle, images and videos can be taken, particularly by the users' mobile devices. However, these images and / or videos can currently only be viewed again on the mobile device or at home.

[0004] From DE 10 2013 015 631 A1 a device for displaying image data in the interior of a vehicle is known, wherein the image data is provided by one or more mobile units, comprising an interface for establishing a data connection to the mobile unit(s) and for transmitting the image data from the mobile unit(s) to the device, a plurality of output units that can be arranged in the vehicle for optically displaying the image data, a selection means for selecting on which output unit(s) the image data of the respective mobile units should be displayed, and a control means for controlling the display of the image data on the output unit(s) depending on the selection.

[0005] From DE 10 2010 038 454 A1 a method for controlling at least one display unit of a vehicle is known, in which, when driving is decelerated, an application is shown on the at least one display unit of the vehicle, in which an end of the deceleration is determined and in which the end of the deceleration is signaled.

[0006] From DE 10 2018 215 056 A1 a vehicle and a method for capturing and providing images and / or image sequences of the surroundings and / or the interior of a vehicle are known.

[0007] From DE 10 2014 222 190 A1, a device and a method for connecting a mobile camera device to a vehicle-mounted display device are known, wherein the mobile camera device is controlled both by the driver's operation and by additional information about the state of the vehicle provided by vehicle sensors.

[0008] The object of the invention is to improve comfort for a vehicle user.

[0009] This object is achieved by the independent patent claims. Advantageous developments of the invention are disclosed in the dependent patent claims, the following description, and the figures.

[0010] One aspect of the invention relates to a method for providing images and / or videos in a motor vehicle after an outdoor experience. The method comprises the steps of determining by a computing device of the motor vehicle that an outdoor experience has taken place for a user of the motor vehicle, wherein a mobile terminal of the user is coupled to the computing device and images and / or videos recorded during the outdoor experience are determined, issuing a query as to whether a review of the outdoor experience should be provided, creating a review of the outdoor experience by selecting images and / or videos if the query results in the review being provided, and playing the created review on a display device of the motor vehicle.

[0011] In other words, a computing device of the motor vehicle can first determine whether an outdoor experience has taken place. An outdoor experience can be understood here as an activity of a user outside the vehicle. This includes, for example, excursions and / or hikes. To determine whether such an outdoor experience has taken place, the computing device can, for example, check whether the motor vehicle was parked for a certain period of time, in particular outside a home zone and / or a work zone of the user. Particularly preferably, to determine the outdoor experience, it can also be checked whether a mobile device of the user coupled to the computing device has new images and / or videos since the last trip, which would indicate the presence of a new outdoor experience.

[0012] The images and / or videos can be transmitted from the user's paired mobile device to the computing device, and a review of the outdoor experience can be created by the computing device if a query determines that a review should be created. The query can be issued visually and / or acoustically, for example, and confirmed by the user in an appropriate manner.

[0013] The review can include an automatic selection of images and / or videos, for example, based on predefined criteria. For example, a chronological sequence of images and / or videos can be created. The review can also be created using categories, for example, only landscape photos, only photos of people, or only photos that contain a specific feature. The review can also be selected based on presets or automatically based on the photos, for example, upon recognition of frequently photographed subjects.

[0014] The created review can then be played or displayed on a display device of the motor vehicle during a journey, particularly as part of an interior experience.

[0015] Furthermore, it can be provided that a user has the option to edit the created review and then save it in the vehicle and / or on the mobile device. It can also be provided that the created review can be shared on social media. This review(s) can be saved in the vehicle and / or in a cloud. It can also be provided that the created review can be played back on the mobile device.

[0016] The computing device of the motor vehicle can be, for example, a vehicle computer, in particular of an infotainment system of the motor vehicle. The mobile device can be, for example, a smartphone, tablet, PDA, a digital camera, and / or a laptop. The display device on which the created review can be played back can, for example, comprise at least one vehicle screen, a head-up display, a virtual reality system, and / or an augmented reality system.

[0017] The invention provides the advantage that an extension of the interior experience can be provided in conjunction with an exterior experience, which provides additional benefits for a user's well-being and an increase in comfort.

[0018] The invention also includes embodiments which provide additional advantages.

[0019] One embodiment provides that the computing device is coupled to a navigation system of the motor vehicle to detect that an outdoor experience has taken place, and it is determined that the motor vehicle was parked outside a home zone and / or work zone. This means that the navigation system can detect, based on position data, whether the vehicle has been parked outside the home zone and / or work zone for an extended period of time or is moving. Home zone refers to a position where the user is at home. Work zone refers to the position where the user's workplace is located. These can be specified, for example, by manual user input or automatically detected from a movement pattern. If it is determined that the motor vehicle was parked outside these zones, in particular for a minimum period of time, it can be inferred that the vehicle has been parked outside these zones.

[0020] Furthermore, it can be provided that, in order to recognize that an outdoor experience has taken place, a point of interest (POI) in the vicinity of the motor vehicle and / or a day of the week can also be taken into account. This means that a comparison can be made as to whether there are points of interest in the vicinity of the vehicle, in particular the parked vehicle, which would indicate the presence of an outdoor experience. Alternatively or additionally, it can be taken into account whether the journey by motor vehicle took place on a working day or on a weekend, with a journey on a weekend indicating an excursion and therefore an outdoor experience. Times during which the motor vehicle was parked can also be taken into account in order to distinguish whether it was merely a stopover, for example at a service station or gas station, or whether the time is sufficient to have participated in an outdoor experience.This has the advantage of allowing for an improved distinction as to whether a stop is an anticipated outdoor experience or not.

[0021] Another embodiment provides that when creating the review, the duration of the review is adjusted based on a predicted travel time. After the outdoor experience, for example, the navigation system can plan a return journey from the outdoor experience, for which a travel time can be predicted. When creating the review, this travel time can be taken into account, for example by ensuring that a sequence of images and / or videos does not exceed the predicted travel time. This means that if the travel time is very short, the review can be kept correspondingly short. If, on the other hand, the travel time is very long, the review can be longer. Alternatively, if the travel time is long, a user can also be given the option of editing the review and then saving it. This embodiment has the advantage of increasing satisfaction.

[0022] A further embodiment provides that an adjustment of the speed of the motor vehicle is recommended or carried out based on the duration of the generated review. This means that the duration of the generated review can be determined and thus the driving time of the motor vehicle required to play the review in full. In order to adhere to this driving time, the computing device can recommend an adjustment of the speed to a user, which the user should adhere to in order to play the review in full. Alternatively, particularly in autonomous or semi-autonomous motor vehicles, a speed can be automatically adjusted to the duration of the generated review. This offers another possibility of playing the review in full and thus increasing satisfaction.

[0023] A further embodiment provides for the rearview view to be supplemented by additional comfort functions of the vehicle, in particular climate control, massage, fragrance, lighting, and / or music. In particular, it can be provided that the comfort functions are provided depending on the images and / or videos. For example, if snow or ice is shown in an image and / or video, the temperature can be adjusted accordingly at short notice, and / or if flowers are shown, a corresponding fragrance can be generated. This can achieve an improved interior experience.

[0024] Another embodiment provides for the linking of the respective mobile devices for multiple users, and the creation of a joint review from the provided images and / or videos. This means that a combination of all available images and / or videos can be created, which can be shown together on the display device. In particular, this review can then be performed for the entire vehicle, whereby the images can originate from different mobile devices.

[0025] Another embodiment provides for the linking of the respective mobile devices for multiple users, and the creation of a seat-specific rearview view from the provided images and / or videos. This means, for example, that in a family, parents can receive a rearview view in the front area and the children can receive a separate rearview view. This can be achieved, for example, by assigning the mobile devices to the vehicle occupants.

[0026] A further embodiment provides for the option of replaying the review if the motor vehicle returns to the area of ​​the external experience at a later time. This means that the review can be saved in the motor vehicle, along with position information about the area of ​​the external experience. If it is determined that the motor vehicle returns to the area at a later time, replaying the review can be offered or carried out if this is confirmed. Alternatively, replaying of the review can be started manually, or it can be played automatically or randomly. Alternatively or additionally, playback of the review can also be offered based on a time factor, for example after one year.

[0027] Furthermore, it can be provided that monitoring is carried out by an interior camera during the playback of the review to obtain feedback on how well the created review is received. This can, for example, be coupled with a trained artificial intelligence that is trained based on user reactions. For example, the user's reactions can be used to determine approval or rejection, which can be used to further improve the generation of reviews.

[0028] A further aspect of the invention relates to a motor vehicle comprising at least one computing device and a display device, wherein the motor vehicle is configured to carry out a method according to the preceding aspect. This results in the same advantages and possible variations as in the method. The motor vehicle according to the invention is preferably configured as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus.

[0029] For use cases or application situations that may arise during the method and which are not explicitly described here, it may be provided that, in accordance with the method, an error message and / or a request to enter user feedback is issued and / or a default setting and / or a predetermined initial state is set.

[0030] The invention also includes the control device for the motor vehicle. The control device can have a data processing device or a processor device that is configured to carry out an embodiment of the method according to the invention. For this purpose, the processor device can have at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). In particular, a CPU (Central Processing Unit), a GPU (Graphical Processing Unit), or an NPU (Neural Processing Unit) can be used as the microprocessor. Furthermore, the processor device can have program code that is configured to carry out the embodiment of the method according to the invention when executed by the processor device. The program code can be stored in a data memory of the processor device.The processor device can be based, for example, on at least one circuit board and / or on at least one SoC (System on Chip).

[0031] The invention also includes further developments of the motor vehicle according to the invention that have features already described in connection with the further developments of the method according to the invention. For this reason, the corresponding further developments of the motor vehicle according to the invention are not described again here.

[0032] As a further solution, the invention also encompasses a computer-readable storage medium comprising program code which, when executed by a computer or computer network, causes the computer to carry out an embodiment of the method according to the invention. The storage medium can be provided at least partially as a non-volatile data memory (e.g. as a flash memory and / or as an SSD - solid state drive) and / or at least partially as a volatile data memory (e.g. as a RAM - random access memory). The storage medium can be arranged in the computer or computer network. However, the storage medium can also be operated on the Internet, for example, as a so-called app store server and / or cloud server. The computer or computer network can provide a processor circuit with, for example, at least one microprocessor.The program code may be provided as binary code and / or as assembly code and / or as source code of a programming language (e.g. C) and / or as a program script (e.g. Python).

[0033] The invention also encompasses combinations of the features of the described embodiments. The invention therefore also encompasses implementations that each comprise a combination of the features of several of the described embodiments, unless the embodiments are described as mutually exclusive.

[0034] Exemplary embodiments of the invention are described below. Shown are: Fig. 1 a motor vehicle according to an exemplary embodiment; Fig. 2 a schematic process diagram according to an exemplary embodiment.

[0035] The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention that can be considered independently of one another, each of which also develops the invention independently of one another. Therefore, the disclosure is intended to encompass combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.

[0036] In the figures, the same reference symbols designate elements with the same function.

[0037] In Fig. 1 shows a schematically illustrated motor vehicle 10 that can be configured to provide images and / or videos based on a user's outdoor experience. For this purpose, the motor vehicle 10 can include a computing device 12 and a display device 14.

[0038] Computing device 12 may be a vehicle computer, for example, of an infotainment system, wherein computing device 12 may also include a navigation system. Computing device 12 may further be configured to couple to a user's mobile device 16 and retrieve images and / or videos from mobile device 16, in particular images and / or videos recorded during an outdoor experience of a user of motor vehicle 10.

[0039] To first determine whether an outdoor experience has taken place, the computing device 12, in particular the navigation system, can determine that the motor vehicle 10 was parked outside a home zone and / or a work zone. Furthermore, it can be checked whether there is a point of interest near the parking position and / or whether it is a holiday or weekend to further increase the probability that the trip was made with the motor vehicle 10. If these factors are met, this may indicate an excursion, and images and / or videos recorded with the mobile device 16 can be associated with the excursion or outdoor experience.

[0040] For these images and / or videos, which can be transmitted from the mobile device 16 to the computing device 12, a query can then be issued as to whether a review of the outdoor experience should be provided. The query can be provided, for example, on the display device 14, which is preferably designed as a touch-sensitive screen.

[0041] If this query is confirmed, the computing device 12 can create a review in which images and / or videos are selected to be displayed. For example, a chronological sequence can be created or sorted by category. In particular, a predicted travel time, such as that required from the location of the outdoor experience back home, can be included when creating the review. This means that a number of images and / or videos or a frequency of images and / or videos is adjusted depending on the predicted travel time. Alternatively, it can also be provided that a speed recommendation for a return journey is issued in order to be able to provide the entire review.

[0042] Finally, the created review can be output via the display device 14. For example, other comfort functions of the motor vehicle 10 can also be included in the output of the review, such as an air conditioning function, massage function, fragrance function, lighting function, or music, to further enhance the review experience. It can also be provided that the review can be edited, saved, and / or shared on social media while driving.

[0043] If several mobile terminals 16 are present, a common rearview can be generated from the recorded images and / or videos, in which all images are taken into account, or different rearviews, in particular seat-selective rearviews, can be generated for the various occupants in the motor vehicle 10.

[0044] In Fig.2 shows a schematic process diagram for a method for providing images and / or videos in a motor vehicle 10.

[0045] In a step S10, a computing device 12 can determine that an outdoor experience has occurred for a user of the motor vehicle 10. A mobile terminal 16 of the user is coupled to the computing device 12, and images and / or videos recorded during the outdoor experience are determined. In particular, only images recorded during the outdoor experience can be considered.

[0046] In step S12, a query can be issued as to whether a review of the exterior experience should be provided. This query can be provided, for example, visually via a display device 14 or acoustically via vehicle speakers by a digital assistant.

[0047] If the query is confirmed, a review of the outdoor experience can be created in step S14 by selecting images and / or videos. For this purpose, a sequence of images and / or videos taken during the outdoor experience can be automatically selected. These can also be sorted by category, such as portraits or landscape shots.

[0048] Finally, in a step S16, the images and videos of the created rearview can be played back on the display device 14. For example, this can also be monitored by an interior camera (not shown) to obtain feedback on how well the automatically created rearview was received. This evaluation can be performed, for example, by an artificial intelligence system that determines how well the rearview was received based on the facial expressions of the users in the vehicle, such as smiling faces.

[0049] Furthermore, if the motor vehicle 10 returns to the area or region of the outdoor experience at a later time, the created review can be offered for playback to provide a reminder of past experiences in that area. Replaying the review can also be offered at predefined time intervals, for example, one year or one month.

[0050] Overall, the examples demonstrate a technical possibility of transferring images and videos into a motor vehicle after an external experience and automatically displaying these as an interior experience function.

Claims

[1] Method for providing images and / or videos in a motor vehicle (10) after an outdoor experience, comprising the steps: -Determining by a computing device (12) of the motor vehicle (10) that an outdoor experience has taken place for a user of the motor vehicle (10), wherein a mobile terminal (16) of the user is coupled to the computing device (12) and images and / or videos recorded during the outdoor experience are determined; -Question whether a review of the outdoor experience should be provided; -Creating a review of the outdoor experience by selecting images and / or videos, if the query indicates that the review should be provided; -Playing the created review on a display device (14) of the motor vehicle (10). [2] Method according to claim 1, wherein the computing device (12) for detecting that an outdoor experience has taken place is coupled to a navigation system of the motor vehicle (10) and it is determined that the motor vehicle (10) has been parked outside a home zone and / or work zone. [3] Method according to claim 2, wherein, in order to recognize that an outdoor experience has taken place, a point of interest in a vicinity of the motor vehicle (10) and / or a day of the week is additionally taken into account. [4] Method according to one of the preceding claims, wherein, when creating the review, a duration of the review is adjusted based on a predicted travel time. [5] Method according to one of claims 1 to 3, wherein an adjustment of the speed of the motor vehicle (10) is recommended or carried out on the basis of a duration of the generated retrospective view. [6] Method according to one of the preceding claims, wherein the rear view is supplemented by further comfort functions of the motor vehicle (10). [7] Method according to one of the preceding claims, wherein, in the case of several users, the respective mobile terminals (16) are coupled and a joint review is created from the provided images and / or videos. [8] Method according to one of claims 1 to 6, wherein, in the case of a plurality of users, the respective mobile terminals (16) are coupled and a respective seat-selective review is created from the provided images and / or videos. [9] Method according to one of the preceding claims, wherein a replay of the retrospective view is offered if the motor vehicle (10) is again in the area of ​​the external experience at a later time. [10] Motor vehicle (10) comprising at least one computing device (12) and one display device (14), wherein the motor vehicle (10) is designed to carry out a method according to one of the preceding claims.

Images