Device and method for communication between a vehicle occupant and a target object outside the vehicle

Abstract

The invention relates to a device and a method for communication between a vehicle occupant and a target object outside the vehicle, in which images are captured and a target object is recorded. An offer for communication assistance is then output to the vehicle occupant and a corresponding request is detected. An audio input provided by the vehicle occupant is then recorded and, on the basis of the audio input, a corresponding audio output is output outside the vehicle interior. Alternatively, if the target object is a device, an audio input provided by the vehicle occupant is recorded and corresponding audio data is obtained. The audio data is wirelessly transmitted to the device and audio output is obtained and output. An additional audio input is also recorded, and corresponding additional audio data is obtained and transmitted wirelessly to the vehicle. On the basis of the additional audio data, an additional audio output is then obtained and output.

Description

[0001] Device and method for communication between a vehicle occupant and a target object outside the vehicle

[0002] The invention relates to a device for communication between a vehicle occupant and a target object outside the vehicle. The device detects the direction of gaze and an audio input from the vehicle occupant, with the audio input being output as audio outside the vehicle interior. The invention further relates to a device for communication between a vehicle occupant and a target object, which is a device outside the vehicle. The device detects the direction of gaze and an audio input from the vehicle occupant, with corresponding audio data being transmitted to the device and the audio input being output as audio. Furthermore, a second audio input is detected, with corresponding audio data being transmitted to the vehicle and the second audio input being output as a second audio output.

[0003] In various traffic situations, it can be useful for vehicle occupants to communicate with people outside the vehicle. This applies particularly to drivers who need to communicate with pedestrians to avoid accidents. But even in other situations, such as placing an order with someone at a drive-through, a vehicle occupant needs to communicate with someone outside the vehicle. This presents vehicle occupants with a variety of challenges. Often, the content of the communication is difficult to understand due to ambient noise and distance, and depending on the occupant's seating position within the vehicle, communication can be further hampered by distance. This frequently leads to vocal strain, and finding a suitable position for communication, such as near the window, can often be uncomfortable or even painful. Furthermore, it is generally necessary to...One of the door windows has to be lowered, which impairs the climate control of the vehicle interior and creates a safety risk. Communication via hand signals is also often not a viable option due to the lighting conditions. Furthermore, to communicate with targets in a facility, a vehicle occupant sometimes has to leave the vehicle to enter the facility. Therefore, there is a need for a device that enables intuitive and rapid initiation of communication between a vehicle occupant and a target. Document EP 1 987 986 A2 discloses an external vehicle loudspeaker and a communication system. The communication device for a vehicle is designed to receive and reproduce sounds both inside and outside the vehicle.

[0004] Document JP 2014-035582 A discloses a vehicle communication device that enables a driver to establish communication with a desired communication partner without entering coordinates and ID.

[0005] Document US 8,401,477 B2 discloses a system, method and device for communicating with vehicle occupants, wherein the communication with the vehicle occupant is effected by reflecting a light beam off a window of the vehicle and processing the light beam as a light signal.

[0006] Document US 8,175,886 B2 discloses a method for telecommunication between a person in a vehicle and a target device.

[0007] The object of the invention is to provide a device and method for simple communication between a vehicle occupant and a target object outside the vehicle.

[0008] This problem is solved by a device having the features of claim 1 and by a method having the features of claim 8. Furthermore, this problem is solved by a device having the features of claim 5 and by a method having the features of claim 9. Advantageous embodiments are specified in the dependent claims.

[0009] The device with the features of claim 1 enables the easy identification of target objects, allowing the vehicle occupant to quickly and intuitively use a function for communication with the target object. Furthermore, the vehicle occupant does not need to open the vehicle window to communicate. The device with the features of claim 5 enables the easy identification of target objects that are devices, allowing the vehicle occupant to quickly and intuitively use a function for communication with the target object. In addition, the vehicle occupant does not need to open the vehicle window to communicate. Furthermore, it enables the vehicle occupant to communicate wirelessly with a person in the device without the person needing to be visible.The vehicle's interior camera is designed to capture at least the first image, depicting at least part of the vehicle interior and generating corresponding image data. The vehicle's exterior camera is designed to capture at least the second image, depicting at least part of the vehicle's exterior, and generating corresponding image data. The interior camera and / or the exterior camera may be located in the area of ​​the interior rearview mirror on the windshield. The interior camera and / or the exterior camera may be integrated into the vehicle's interior rearview mirror or into the housing of the interior rearview mirror. The interior camera may also be located above the driver and / or a passenger in an area of ​​the vehicle's headliner.Furthermore, the interior camera and / or the exterior camera can also be positioned on a B-pillar and / or an A-pillar on the driver's side and / or the passenger's side. The interior camera can also be positioned on a central display unit of the vehicle. This display unit could be, for example, a central information display, a head-up display, and / or a graphic instrument cluster. By arranging interior cameras in multiple positions within the vehicle, the detectable area inside the vehicle can be expanded compared to capturing the interior with only one interior camera. Similarly, by arranging exterior cameras in multiple positions within the vehicle, on the exterior surface of the body and / or integrated into the body, the detectable portion of the vehicle's exterior can be expanded compared to capturing parts of the exterior with only one exterior camera.

[0010] It is also advantageous if the interior camera and / or the exterior camera are, for example, an infrared camera and / or an RGB camera and / or a time-of-flight (TOF) camera. This allows for high-quality image data capture, making it easy to determine the direction of the vehicle occupant's gaze and identify target objects. Combining several camera types further enhances image data quality. Furthermore, it is advantageous if the field of view of the interior camera and / or the exterior camera has a detection angle of 100° to 150°, with the interior camera and / or the exterior camera preferably being a monocular camera and / or an RGB-IR camera. This allows for image processing by the processing unit based on the captured IR images.The use of IR images is advantageous because these images are independent of ambient light inside and / or outside the vehicle. Alternatively, the interior and / or exterior camera can also be a dedicated IR camera and / or a stereo camera (3D camera). The processing of the image data from the interior and / or exterior camera can be performed in a computer vision system provided by the processing unit. The use of an RGB IR camera combines the ability to be independent of ambient light inside and / or outside the vehicle while simultaneously providing RGB information when visible light is available.

[0011] The area of ​​the vehicle interior encompassing part of a vehicle seat can be an area that includes the head of a vehicle occupant seated in a vehicle seat. The area of ​​the vehicle exterior can be an area located outside the vehicle. Furthermore, the area of ​​the vehicle exterior can be an area to which the vehicle occupant's view is not obstructed by visual barriers and which may include an area in front of, behind, and / or beside the vehicle. The area of ​​the vehicle exterior can also, for example, be an area extending up to 10 m, preferably up to 5 m.

[0012] The target object is an object located within the vehicle occupant's line of sight. Furthermore, it is advantageous if the target object is positioned so that the occupant's view of it is not obstructed by any visual barriers. The target object could be, for example, a person, an animal, or an intercom system.

[0013] The interior speaker can be a speaker positioned within the vehicle interior or integrated into the interior trim. The vehicle may have multiple interior speakers located at different positions within the interior and / or integrated into the interior trim at different positions. The processing unit can then be configured, for example, to output audio only through the speaker closest to the vehicle occupant. This way, other vehicle occupants hear the audio output at a low volume and are not disturbed. The audio output is a sound produced by the interior and / or exterior speakers and corresponds to a reproduction of the audio input.

[0014] The interior microphone can be positioned within the vehicle interior or integrated into the interior trim. The vehicle may have multiple interior microphones located at different positions within the interior and / or integrated into the interior trim at different positions. The processing unit can then be configured, for example, to capture audio input only with the microphone closest to the vehicle occupant. This audio input can include spoken words and / or non-word sounds. By positioning the microphone close to the vehicle occupant, the audio input can be captured in high quality, and other vehicle occupants will hear it at a low volume, thus avoiding disturbance. The interior microphone can also serve as the vehicle's input unit.Alternatively or additionally, the input unit can be an Ergo-Commander and / or a touch display.

[0015] The external speaker can be a speaker located on the exterior surface of the vehicle body or integrated into the body, for example, under the hood or on the right or left side of the vehicle. The external speaker can be located in or on an A-, B-, C-, or D-pillar. The vehicle can have multiple external speakers located at different positions on the exterior surface of the vehicle body and / or integrated into the vehicle body at different positions. The processing unit can then be configured, for example, to output audio only through the external speaker closest to the target object. This way, other people outside the vehicle hear the audio output at a low volume and are not disturbed.

[0016] It is advantageous if the processing unit is designed to capture a second audio input from the target object using at least one external microphone of the vehicle. Furthermore, the processing unit is designed to output a corresponding second audio signal from the target object using the interior speaker. This provides the vehicle occupant with information from the target object, which can be used, for example, to adjust driving behavior. In this way, the vehicle occupant can participate in road traffic very safely.

[0017] The external microphone can be located on the exterior surface of the vehicle body or integrated into the bodywork, for example, on the right or left side of the vehicle. In particular, the external microphone can be located in or on the A-, B-, C-, or D-pillar. The vehicle can include multiple microphones integrated into the bodywork at various locations on the exterior surface and / or at various locations. The processing unit can then be configured, for example, to capture audio input only with the microphone closest to the target object. Due to the microphone's proximity to the target object, the audio input can be captured with high quality. Furthermore, other people outside the vehicle hear the audio input only at a low volume and are therefore not disturbed.Furthermore, it is advantageous if the external speaker is directional, so that audio output from the external speaker is particularly audible to a target object in a specific position. Other people outside the vehicle, outside this specific position, will only perceive the audio input at a low volume and will therefore not be disturbed.

[0018] The second processing unit and / or the setup speaker and / or the setup microphone can be located in or on the setup and / or in the device within the setup, e.g., the smartphone or smartwatch.

[0019] It is advantageous if wireless data transmission between the first and second communication units occurs via a wireless communication network, such as Bluetooth, Wi-Fi, or cellular network. This allows for very simple data transmission. The first communication unit can be located on the exterior surface of the vehicle body, integrated into the body, or located inside the vehicle or integrated into the interior trim. The second communication unit, and alternatively or additionally, the second processing unit and / or the system speaker and / or the system microphone, can be located in or on the system and / or in a device within the system, such as a smartphone or smartwatch.

[0020] The method with the features of dependent claim 8 has the same advantages as the device claimed in claim 1. In particular, the method can be further developed with the features of the dependent claims directed to the device and the aforementioned embodiments.

[0021] The method with the features of dependent claim 9 has the same advantages as the device claimed in claim 5. In particular, the method can be further developed with the features of the dependent claims directed to the device and the aforementioned embodiments.

[0022] Examples of implementation are explained in more detail below with reference to the figures. These show:

[0023] Figure 1 is a perspective schematic representation of a vehicle cockpit;

[0024] Figure 2: A schematic representation of a first communication situation; Figure 7: A schematic representation of a second communication situation;

[0025] Figure 4 shows a flowchart for communication between a vehicle occupant and a target object outside the vehicle; and

[0026] Figure Seinen: Flowchart for communication between a vehicle occupant and a target object that is an external facility.

[0027] Figure 1 shows a perspective schematic representation of the cockpit 100 of a vehicle 102. A driver 104 is seated in a driver's seat 106 of the vehicle 102. The cockpit 100 also includes a central information display (CID) 108, a head-up display 110, and a graphic instrument cluster 112, which are arranged in a dashboard 114 of the vehicle 102. The aforementioned display elements 108, 110, and 112 each form a functional unit of an output unit of the vehicle 102, which is designed to output information to the driver 104. At least one interior loudspeaker 116 and one interior microphone 117 of the vehicle 102 are also arranged in the cockpit 100. The loudspeaker 116 forms a functional unit of the output unit, and the microphone 117 forms a functional unit of the input unit. The functional units of the output unit and the input unit also serve as a playback unit for audio and / or video playback.The interior microphone 117 is designed to capture an initial audio input from the driver 104. The vehicle also includes at least one exterior microphone 146 and at least one exterior loudspeaker 148. The cockpit 100 further comprises a steering wheel 118 with controls 120, a gear selector 122, pedals 124, and an input unit 126 with a rotary dial and push-button function and / or a touch input panel. This input unit 126 is also referred to as the Ergo Commander.

[0028] In the upper area of ​​the windshield 128 of the vehicle 102, an interior rearview mirror 132 and an interior camera 134 and an exterior camera 136, each mounted on the windshield 128 in the area of ​​this interior rearview mirror 132, are arranged. The interior camera 134 is configured to capture at least one first image depicting an area of ​​the vehicle interior encompassing at least part of a vehicle seat 106 and to generate corresponding first image data. The exterior camera 136 is configured to capture at least one second image depicting at least part of the vehicle exterior and to generate corresponding second image data. The interior camera 134 and / or the exterior camera 136 can be a monocular camera or a stereo camera, preferably an RGB camera and / or an infrared camera.

[0029] A schematic representation of a first and second communication situation 200, 300, of which the external camera 136 captures an image from the perspective of the vehicle 102 and the driver 104 respectively, is shown in Figures 2 and 3. The internal camera 134 and / or the external camera 136 can be configured, in particular, to capture several successive images, especially in the form of a video stream, to generate image data corresponding to the images, and to transmit this data to a control unit 138 serving as a processing unit.

[0030] The control unit 138 has data outputs 140 and data inputs 142, which serve to connect to other units of the vehicle 102, for example, to additional cameras, sensors, input and output units, and control units of assistance systems. The control unit 138 also includes a communication module 144, which is configured to establish a connection to a telecommunications network, in particular a mobile communication network. Car-to-car communication and infrastructure-to-car communication are easily possible via this communication module 144. Data can be transmitted to and from the vehicle 102 via this communication module 144. Furthermore, based on the image data from the interior camera 134 and the exterior camera 136, the control unit 138 determines the direction of view of a vehicle occupant, such as the driver 104, and a target object 212, 302 outside the vehicle 102 in the determined direction of view of the vehicle occupant 104.The target object 212, 302 is shown by way of example in Figure 2 and Figure 3.

[0031] The control unit 138 is further configured to issue an offer of communication support for communication with the target object 212, 302 to the driver 104 using at least one internal loudspeaker 116 and / or a display unit 108, 110, 112 of the vehicle 102. The control unit 138 is also configured to detect a request for communication support from the vehicle occupant 104 using at least one internal microphone 117 and / or an input unit 126 of the vehicle 102. Based on the initial audio input, the control unit 138 is configured to output a corresponding initial audio signal using at least one external loudspeaker 148 of the vehicle 102 outside the vehicle interior.

[0032] Figure 2 shows a schematic representation of a first communication situation 200. A vehicle 102 is stopped with its windows 202, 204 at a road junction 206, also called a T-junction. Elements with the same function or structure have the same reference symbols.

[0033] The road section 208, on which vehicle 102 is located, leads into another road 210 via the road junction 206. To the right of vehicle 102, in the left half of the representation of the first communication situation 200, a cyclist 212 with a bicycle 214 is standing on a sidewalk 216. The driver 104 could offer the cyclist 212 the opportunity to cross road 208 in front of vehicle 102, with the driver 104's eyes 218 directed towards the cyclist 212.

[0034] The interior camera 134 of the vehicle 102 captures a first image depicting at least part of the vehicle interior, including a portion of a vehicle seat 106 and the eyes 218 of the driver 104 seated in the driver's seat 106. The interior camera 134 then generates initial image data corresponding to the first image. The exterior camera 136 of the vehicle 102 captures a second image depicting at least part of the vehicle's exterior, including the cyclist 212 standing on the sidewalk 216 to the right of the vehicle 102. The exterior camera 136 then generates a second image data corresponding to the second image. The control unit 138 processes the initial image data to determine the driver 104's direction of view.In addition, the second image data is processed by the control unit 138, so that the control unit 138, starting from the direction of view of the vehicle driver 104, determines the cyclist 212 as the target object in the vehicle's exterior area.

[0035] In alternative embodiments, the target object can also be a person in a service situation, e.g., a gas station attendant, or an animal, e.g., a deer, a dog, or a cow. Furthermore, the target object can also be, for example, an intercom system, e.g., at a barrier that prevents further travel.

[0036] The control unit 138 then sends an offer of communication support to the driver 104 via the internal loudspeaker 116 and additionally or alternatively via the display unit 108, 110, 112, enabling communication with the cyclist 212. The driver 104 then requests communication support via the internal microphone 117 and additionally or alternatively via the input unit 126. This request is registered by the control unit 138. The internal microphone 117 then registers an initial audio input from the driver 104, in which the driver 104 offers the cyclist 212 permission to cross the road 208 in front of the vehicle 102. The control unit 138 then outputs this initial audio input as the first audio signal to the exterior of the vehicle via an external loudspeaker 148. The external loudspeaker 148 can be located on the outer surface of the vehicle body or integrated into the body, e.g.under the hood 220 or on the right or left side of the vehicle 102, especially in or on the A, B, C or D pillar.

[0037] The 148 external speaker can be one of several external speakers directed in a specific direction. This allows the audio output to be directed to the 148 external speaker that is best suited for the target object to perceive the audio output.

[0038] Cyclist 212 hears the first audio output and the offer conveyed by the first audio output to cross road 208 in front of vehicle 102. Cyclist 212 then states that he does not accept the offer and does not wish to cross road 208.

[0039] The control unit 138 uses an external microphone 146 to capture the cyclist's statement 212 as a second audio input. The external microphone 146 can be located on the outer surface of the vehicle body or integrated into the body, e.g., on the right or left side of the vehicle, particularly in or on the A, B, C, or D pillar. The control unit 138 then outputs the second audio input to the driver 104 via the internal loudspeaker 116 as a second audio output. The driver 104 now knows that the cyclist 212 does not pose a safety risk and prepares to turn into the intersection 206.

[0040] Figure 3 shows a schematic representation of a second communication situation 300. A vehicle 102 is parked with its windows 202, 204 closed next to a drive-through facility 302. The driver 104 is seated in the driver's seat 106 of the vehicle 102. A portion of the interior 304 of the drive-through facility 302 is also shown. Inside the drive-through facility 302, a person 306 is seated in front of a table 308 equipped with a drive-through communication device 310. The communication device 310 comprises a facility microphone 312, a facility speaker 314, a second communication unit 316, and a second control unit 318. In one embodiment, the communication device 310 can be a smartphone or a smartwatch.

[0041] The interior camera 134 of the vehicle 102 captures a first image depicting at least part of the vehicle interior, including a portion of a vehicle seat 106 and encompassing the eyes 218 of the driver 104 seated in the driver's seat 106. The interior camera 134 generates initial image data corresponding to the first image. The exterior camera 136 of the vehicle 102 captures a second image depicting at least part of the vehicle exterior, including a portion of the drive-through device 302. The exterior camera 136 generates second image data corresponding to the second image. The control unit 138 processes the initial image data to determine the driver 104's direction of view.Additionally, the second set of image data is processed by the control unit 138, enabling the control unit 138 to identify the drive-through facility 302 as the target object on the outside of the vehicle, based on the driver's (104) line of sight. In another embodiment, the facility is a toll booth, a restaurant without a drive-through, or a gas station.

[0042] The control unit 138 then sends an offer of communication support to the driver 104 via the interior loudspeaker 116 and additionally or alternatively via the display unit 108, 110, 112 for communication with the drive-through device 302. The driver 104 then requests communication support via the interior microphone 117 and additionally or alternatively via the input unit 126. This request is recorded by the control unit 138.

[0043] The interior microphone 117 then detects an initial audio input from the driver 104, with which the driver 104 expresses his order request to the drive-through facility 302. Based on this initial audio input, the control unit 138 generates corresponding initial audio data. The control unit 138 transmits this initial audio data via wireless data communication to a first communication unit 144 of the vehicle 102 and a second communication unit 316 of the facility 302, then to a second control unit 318 within the facility 302. Based on this initial audio data, the second control unit 318 then outputs a corresponding initial audio signal via a facility speaker 314, so that a person 306 inside the drive-through facility 302 hears the driver 104's order request.The person 306 then repeats the order request of the driver 104 in the drive-through facility 310, asking for confirmation. This is captured by the second control unit 318 using a facility microphone 312 as a second audio input. Based on this second audio input, the second control unit 318 generates corresponding second audio data. This second audio data is then transmitted from the second control unit 318 to the first control unit 138 via the second communication unit 316 and the first communication unit 144. The first control unit 138 then outputs a corresponding second audio signal using the interior speaker 116, based on the second audio data. In one embodiment, wireless data transmission between the first communication unit 144 and the second communication unit 316 occurs via a wireless communication method such as Bluetooth, Wi-Fi, or cellular network.

[0044] Figure 4 shows a flow chart for communication between a vehicle occupant 104 and a target object 212, 302 outside the vehicle 102.

[0045] The process starts in step S100. Subsequently, in step S102, at least one initial image is captured using an interior camera 134, depicting at least part of a vehicle seat 106 within the vehicle interior, and corresponding initial image data is generated. In step S104, at least one second image is captured using an exterior camera 136, depicting at least part of the vehicle exterior, and corresponding second image data is generated. Then, in step S106, based on the initial image data, the viewing direction of a vehicle occupant 104 is determined, and based on the second image data, a target object 212 outside the vehicle 102 is determined in the occupant's viewing direction.Subsequently, in step S108, an offer of communication support for communication with the target object 212, 302 is issued to the vehicle occupant 104, and a request from the vehicle occupant 104 for communication support is recorded. Using an internal microphone 114, an initial audio input from the vehicle occupant 104 is recorded in step S110. In step S112, based on this initial audio input, a corresponding initial audio output is then delivered outside the vehicle interior using an external loudspeaker 148. The process then concludes in step S114. In other embodiments, steps S102 and S104 can be interchanged or executed simultaneously. In other embodiments, steps S110 and S112 can be executed simultaneously, so that an audio input is continuously recorded and output.Figure 5 shows a flow chart for communication between a vehicle occupant 104 and a target object 302, which is a facility 302 outside the vehicle 102.

[0046] The process begins in step S200. Subsequently, in step S202, an interior camera 134 captures at least one initial image depicting at least part of a vehicle seat 106 within the vehicle interior, and corresponding initial image data is generated. In step S204, an exterior camera 136 captures at least one second image depicting at least part of the vehicle exterior, and corresponding second image data is generated. Then, in step S206, based on the initial image data, the viewing direction of a vehicle occupant 104 is determined, and based on the second image data, a target object 302 outside the vehicle 102 is identified in the determined viewing direction of the vehicle occupant 104.In the next step, S208, vehicle occupant 104 is offered communication support for communication with target object 302, and a request from vehicle occupant 104 for communication support is recorded. Subsequently, in step S210, an initial audio input from vehicle occupant 104 is captured using an interior microphone. In step S212, corresponding initial audio data is determined based on the initial audio input and transmitted wirelessly to the device 302. Based on the initial audio data, corresponding initial audio output is determined in step S214 and played back using a device speaker 314. In step S216, a second audio input is captured using a device microphone 312. In step S218, corresponding second audio data is then determined based on the second audio input and transmitted wirelessly to vehicle 102.Based on the second audio data, a corresponding second audio output is determined and displayed in step S220. The process then ends in step S222. In other embodiments, steps S202 and S204 can be interchanged or executed simultaneously. In other embodiments, steps S110, S112, and S214 can be executed simultaneously, so that an audio input is continuously captured, transmitted, and output. In other embodiments, steps S116, S118, and S220 can also be executed simultaneously. Furthermore, steps S210 to S220 can be executed simultaneously in other embodiments, enabling two audio inputs to be captured, transmitted, and output simultaneously for bidirectional communication. Reference numerals:

[0047] 100 Cockpit

[0048] 102 vehicles

[0049] 104 drivers

[0050] 106 Driver's seat

[0051] 108 Central Information Display

[0052] 110 Head Up Display

[0053] 112 Graphic instrument cluster

[0054] 114 Dashboard

[0055] 116 speakers

[0056] 117 Microphone

[0057] 118 Steering wheel

[0058] 120 Control element

[0059] 122 Gear selector

[0060] 124 Pedals

[0061] 126 Input unit

[0062] 128 Windscreen

[0063] 132 Interior rearview mirror

[0064] 134 Interior camera

[0065] 136 Outdoor camera

[0066] 138 Control unit

[0067] 140 Data output

[0068] 142 Data input

[0069] 144 Communication module

[0070] 146 microphone

[0071] 148 speakers

[0072] 200 communication situations

[0073] 202, 204 windows

[0074] 206 Road junction

[0075] 208 road section

[0076] 210 Street

[0077] 212 cyclists 214 bicycles

[0078] 216 Footpath

[0079] 218 eyes

[0080] 220 Hood 300 Communication situation

[0081] 302 Drive-Through Facility

[0082] 304 Interior

[0083] 306 people

[0084] 308 Table 310 Drive-Through Communication Device

[0085] 312 Setup microphone

[0086] 314 Furniture speakers

[0087] 316 Communication unit

[0088] 318 Control unit

[0089] S100 to S114 Procedure steps

[0090] S200 to S222 procedure steps

Claims

Claims 1. Device for communication between a vehicle occupant (104) and a target object (212) outside the vehicle (102), comprising at least one interior camera (134) of the vehicle (102) configured to capture at least one first image depicting an area of ​​the vehicle interior encompassing at least a part of a vehicle seat (106) and to generate first image data corresponding to the first image, comprising at least one exterior camera (136) of the vehicle (102) configured to capture at least one second image depicting at least a part of the vehicle exterior and to generate second image data corresponding to the second image, comprising a processing unit (138) configuredto process the first and second image data and, based on the first image data, to determine the gaze direction of a vehicle occupant (104) and, based on the second image data, to determine a target object (212) outside the vehicle (102) in the determined gaze direction of the vehicle occupant (104), wherein the processing unit (138) is configured to issue an offer of communication support for communication with the target object (212) to the vehicle occupant (104) with at least one interior loudspeaker (116) and / or a display unit (108, 110, 112) of the vehicle (102), and to capture a request from the vehicle occupant (104) for communication support with at least one interior microphone (117) and / or an input unit (126) of the vehicle (102), wherein the interior microphone (117) is configured to capture an initial audio input from the vehicle occupant (104), wherein the processing unit (138) is trainedStarting from the first audio input, a corresponding first audio output with at least one, to output sound from the vehicle's external loudspeaker (148) (102) outside the vehicle interior.

2. Device according to claim 1, wherein the processing unit (138) is configured to detect a second audio input from the target object (212) using at least one external microphone (146) of the vehicle, and wherein the processing unit (138) is configured to output a corresponding second audio output from the second audio input of the target object (212) using the internal loudspeaker (116).

3. Device according to claim 1 or 2, wherein the target object (212) is located in an area around the vehicle (102) where the view of the vehicle occupant (104) is not blocked by visual obstructions and wherein the target object (212) is in particular a human being or an animal or an intercom system.

4. Device according to one of the preceding claims, wherein the external loudspeaker (148) is a loudspeaker directed in a specific direction.

5. Device for communication between a vehicle occupant (104) and a target object (310), which is a device outside the vehicle, comprising at least one interior camera (134) of the vehicle (102) configured to capture at least one first image depicting an area of ​​the vehicle interior encompassing at least part of a vehicle seat (106) and to generate first image data corresponding to the first image, comprising at least one exterior camera (136) of the vehicle (102) configured to capture at least one second image depicting at least part of the vehicle exterior and to generate second image data corresponding to the second image, comprising a processing unit (138) configured to process image data and, based on the first image data, to determine the viewing direction of a vehicle occupant (104) and, based on the second image data, to identify a target object (310). to determine outside the vehicle (102) in the determined line of sight of the vehicle occupant (104), wherein the processing unit (138) is configured with at least one internal loudspeaker (116) and / or a display unit (108, 110, 112) to issue an offer of communication support for communication with the target object (310) to the vehicle occupant (104), and with at least one internal microphone (117) and / or an input unit (126) to capture a request from the vehicle occupant (104) for communication support, wherein the internal microphone (117) is configured to capture a first audio input from the vehicle occupant (104), and wherein the processing unit (138) is configured to generate corresponding first audio data from the first audio input and to transmit this to a second processing unit (318) in the device (310),with a first communication unit (144) of the vehicle (102) and a second communication unit (316) of the device (310), which are configured for wireless data communication, and wherein the second processing unit (318) is configured to output a corresponding first audio output with a device loudspeaker (314) starting from the first audio data, wherein the second processing unit (318) is configured to capture a second audio input with a device microphone (312), wherein the second processing unit (318) is configured to generate corresponding second audio data starting from the second audio input, and to transmit this data to the first processing unit (138) with the second communication unit (316) and the first communication unit (144), and wherein the first processing unit (138) is configuredto output a corresponding second audio output using the internal speaker (116) based on the second audio data.

6. Device according to claim 5, wherein the wireless data transmission between the first and the second communication unit (144, 316) is carried out via Bluetooth, Wifi or mobile network.

7. Device according to claims 1 to 6, wherein the at least one indoor camera (134) comprises an RGB camera and / or an infrared camera, and / or wherein the at least one outdoor camera (136) is an RGB camera and / or an infrared camera.

8. Method for communication between a vehicle occupant (104) and a target object (212) outside the vehicle (102), wherein at least one first image depicting an area of ​​the vehicle interior encompassing at least part of a vehicle seat (106) is captured and first image data corresponding to the first image is generated, and wherein at least one second image depicting at least part of the vehicle exterior is captured using an interior camera (134) and second image data corresponding to the second image is generated, wherein, using an exterior camera (136), the direction of view of a vehicle occupant (104) is determined based on the first image data, and based on the second image data, a target object (212) outside the vehicle (102) is identified in the determined direction of view of the vehicle occupant (104).in which the vehicle occupant (104) is offered communication support for communication with the target object (212), and a request from the vehicle occupant (104) for communication support is recorded, in which an initial audio input from the vehicle occupant (104) is recorded using an internal microphone (117), and in which, based on the initial audio input, a corresponding initial audio output is produced using an external loudspeaker (148) outside the vehicle interior.

9. Method for communication between a vehicle occupant (104) and a target object (310), which is a device outside the vehicle (102), wherein at least one first image is captured using an interior camera (134) depicting an area of ​​the vehicle interior encompassing at least part of a vehicle seat (106), and corresponding first image data is generated, and wherein at least one second image is captured using an exterior camera (136) depicting at least part of the vehicle exterior, and corresponding second image data is generated, wherein, starting from the first image data, the direction of view of a vehicle occupant (104) is determined, and, starting from the second image data, a target object (310) outside the vehicle (102) is identified in the determined direction of view of the vehicle occupant (104).in which the vehicle occupant (104) is offered communication support for communication with the target object (310), and a request from the vehicle occupant (104) for communication support is recorded, in which an initial audio input from the vehicle occupant (104) is recorded using an interior microphone (117), in which corresponding initial audio data is determined from the initial audio input and transmitted wirelessly to the device (310), and in which a corresponding initial audio output is determined from the initial audio data and output using a device speaker (314), in which a second audio input is recorded using a device microphone (312), where, starting from the second audio input, corresponding second audio data is determined and transmitted wirelessly to the vehicle (102), and where, starting from the second audio data, a corresponding second audio output is determined and output using an interior loudspeaker (116).

Images