Device and method for transmitting data from a camera arranged in a seat of a vehicle

Abstract

A vehicle (10), a device and a method for transmitting data from a camera (1) arranged in a seat (2) of a vehicle (10) are proposed. The method comprises the steps of: determining a position of the seat (2), and using a data record representing the position of the seat (2) to adapt an acquisition of the data and / or a transmission of the data of the camera (1) to a control unit (3) of the vehicle (10).

Description

[0001] 1 24-2693

[0002] Device and method for transmitting data from a camera which is arranged in a seat of a means of transport

[0003] Description

[0004] The present invention relates to a means of locomotion, a device, and a method for transmitting data from a camera arranged in a seat of a means of locomotion. In particular, the present invention relates to increasing the efficiency of data transmission from such a camera to a control unit.

[0005] Modern vehicles typically feature a variety of optical cameras in the interior. For example, a camera located in the dashboard / instrument cluster can detect driver fatigue or that of other occupants. Additionally, occupant gestures are recognized and used to operate the vehicle's electronic systems.

[0006] Typically, such cameras are located in the first row of seats in vehicles. They are installed, for example, behind the steering wheel, in the A-pillar, or in an interior rearview mirror. Cameras can be RGB (red, yellow, blue) or IR (infrared) cameras. A challenge with cameras is the amount of data they generate and the transmission of that data. The larger the amount of data that needs to be transmitted from a camera to the processing unit, the more complex and expensive the required transmission technology becomes (e.g., Speed ​​Grade from GMSL). Another issue is the energy consumption of the infrared illumination required for imaging in the dark. Cameras in the second row of seats can be installed in various locations. Two cameras are often needed on the side of the vehicle (B-pillar) because the viewing angle of the person opposite is not ideal and can be obstructed by, for example, the front seat.The system could be reduced to a single camera in the center of the vehicle. However, vehicles increasingly have glass roofs, which make integration into the headliner more difficult or even impossible.

[0007] prevent.2 24-2693

[0008] Based on the aforementioned prior art, it is an object of the present invention to provide cost-effective monitoring of an interior space using camera technology. This object is achieved according to the invention by a method with the features of claim 1 and a device with the features of claim 9. The dependent claims describe preferred embodiments of the invention.

[0009] According to one aspect of the present invention, the seating position of a seat in a means of transport, in which the camera is integrated, is determined using sensors. For example, the camera can be integrated into a backrest or the back of a headrest. Furthermore, a 3D camera position within the vehicle can be determined. This includes determining the camera's orientation, height, position in the Y-direction, and, if applicable, its opening angle / capture area. The aforementioned information can then be transmitted to the camera, enabling it to reduce the recorded / transmitted data based on this information. In other words, irrelevant or less relevant data can be excluded from transmission to a control unit and / or a processing unit within or outside the means of transport.Finally, infrared illumination can also be adjusted to suit the reduced field of view. The data required to adapt the camera's data acquisition / transmission can be calculated, for example, in a control unit or integration platform and transmitted to the camera via SerDes sideband. If it is a smart camera (stand-alone camera), the calculation could also be performed within the camera itself, or the data could be transmitted to a control unit for processing via another method, such as LAN or WLAN.

[0010] In other words, a method for transmitting data from a camera located in the seat of a means of transport is proposed. The camera can be understood as an interior camera of the means of transport. The means of transport can be a car, van, truck, motorcycle, aircraft, and / or watercraft. First, the position of the seat is determined using sensors, in particular automatically. The position of the seat can be determined in such a way that it provides information about the position and orientation of the 3 24-2693

[0011] The invention involves a camera. In other words, it is an electrically adjustable seat of the means of transport, which carries the camera. The camera is thus arranged on the movable part of the seat, so that its position and / or orientation changes with the seat's adjustment. According to the invention, a data set representing the seat's position is used to adapt the acquisition of data and / or the transmission of data from the camera to a control unit of the means of transport. In other words, based on the determined position, a sensor-based decision is automatically made as to which data captured by the camera can be omitted in order to keep data processing and data transmission from the camera cost-effective and / or to minimize the required bandwidth. In particular, it can automatically take into account which areas are currently of interest for camera capture.For example, this can include a person, especially their gestures and / or face. This allows for cost-effective and low-bandwidth data transmission. Furthermore, the subsequent processing of the camera's image data (in the processor, such as ISP, CPU, NPU, GPU) can also be more resource-efficient and therefore more cost-effective.

[0012] The camera can be, for example, an optical camera, especially an infrared camera. It can be designed as a 2D and / or 3D camera. It can be a Time-of-Flight (ToF) camera, which can be used to determine three-dimensional images and / or distances to photographed objects. Such cameras are used, for example, for gesture recognition.

[0013] Using the data set may involve using a predefined reference. For example, the reference may describe a seating position and / or a relative position between the seat and an occupant or another predefined area within the means of transport. In other words, the predefined reference may establish a predefined relationship between a given seat setting and a data set describing the acquisition and / or transmission of the data. Here, a defined or parameterized area of ​​interest within the means of transport (for example, in the area of ​​the second or third row of seats) may be predefined, which in every case, or in every ordinary seat position, lies within the camera's field of view and, according to the invention, is not to be excluded from data acquisition and / or transmission. The [4 24-2693]

[0014] The remaining areas of the camera's detection range defined by the reference can therefore be automatically excluded using information technology in order to reduce the data to be processed and / or transmitted and to reduce the required bandwidth.

[0015] Using the dataset can reduce the maximum resolution of the camera. For example, the native resolution of a sensor in the camera can be reduced to decrease the amount of data. Alternatively or additionally, the image capture rate can be reduced to decrease the number of images taken per unit of time. Alternatively or additionally, the image format used by the camera to generate the data can also be reduced. In other words, areas can be excluded from the data stream captured by the camera, so that only sub-areas of the captured vehicle interior are included in the data stream. These can be, in particular, contiguous sub-areas (image sections).In this way, depending on the position of the seat, a focus can be placed on specific areas inside the vehicle in order to digitize the objects and / or movements suspected or located there in the best possible way, while keeping the amount of data low.

[0016] Using the data set can involve selecting a section of the image from the camera's field of view or using a contiguous pixel area from a native pixel area. In this case, a specific image area is extracted from the complete camera image and processed separately, while the remaining image areas are not processed or at least not transmitted. A data transmission rate can also be selected based on the data set. For this purpose, a separate, predefined reference can be used, specifically linking the seat position to the location of the image section to be processed and transmitted. A data transmission rate from the camera to the control unit can also be selected based on the data set. Furthermore, a refresh rate for a still image or video sequence can be defined using the data set.Alternatively or additionally, the operating mode of a light source assigned to the camera (e.g., an infrared light source) can be adjusted. For example, the light source can be switched on or off. In particular, the light sources can be aligned or subgroups of the light sources can be adjusted depending on 5 24-2693.

[0017] The data set can be selected. Alternatively or additionally, the camera (including or excluding the light source) can be motor-aligned relative to the seat based on the data set. The data set representing the seat's position can therefore offer a significant advantage for the demand-oriented processing and transmission of the camera data.

[0018] The seat may, for example, be located in a first row of seats in the means of transport, while the camera is oriented in a rearward direction (towards a rear, in particular a second, row of seats).

[0019] The camera can, for example, be set up to record an occupant of the vehicle. This could allow for classification of the occupant based on gender, height, weight, and location. Facial expressions and gestures can also be analyzed, and facial recognition can be prepared using data from this system.

[0020] Hall sensors or information from stepper motors inside the seat can be used to determine the position of the seat.

[0021] Alternatively or additionally, interior cameras, in particular cameras located, for example, in the dashboard, A-pillar, roof control unit, instrument cluster, or similar components of the vehicle, can be used. Finally, the target position of the seat, predefined via a radio key, can also be used or anticipated to adjust the data acquisition and / or transmission. In other words, all information known in the prior art for determining the position of the seat can also be used in accordance with the invention.

[0022] Data transmission between the camera and the control unit that receives the camera data can be achieved, for example, via a serial interface such as GMSL and / or ASA Motion Link (ML). The more selective the data to be transmitted, or the lower the data volume / data rate, the less expensive the cabling and data infrastructure can be. This reduces the costs of connecting the camera to the control unit.

[0023] According to a second aspect of the present invention, a device for transmitting data from a camera arranged in the seat of a means of transportation is proposed. The device comprises a data input, the camera, an evaluation unit, and a 6 24-2693

[0024] Data output. The data input and data output can be configured for connection to proprietary lines and / or a vehicle bus. The evaluation unit can comprise a programmable processor, in particular a microprocessor or a nanocontroller. According to the invention, the evaluation unit is linked to the data input and configured to automatically determine the position of the seat using sensors. In conjunction with the data output, the evaluation unit is configured to use a data set representing the position of the seat for acquiring and / or transmitting the camera data to a control unit of the means of transport. In this way, the device implements the features, combinations of features, and the resulting advantages of the method according to the invention in such a manner that reference is made to the above explanations to avoid repetition.

[0025] According to a third aspect of the present invention, a means of transport is proposed which can be configured as a car, van, truck, motorcycle, aircraft and / or watercraft. The means of transport has a device according to the second aspect of the invention, enabling it to realize the same features, combinations of features and advantages.

[0026] Further details, features and advantages of the invention will become apparent from the following description and the figures. These show:

[0027] Figure 1 shows a perspective schematic representation of a passenger cell of an embodiment of a means of transport according to the invention with an embodiment of a device according to the invention;

[0028] Figure 2 shows a schematic representation of an image section determined according to the invention from a native pixel area of ​​a camera usable according to the invention; and

[0029] Figure 3 is a flowchart illustrating the steps of an embodiment of a method according to the invention for transmitting data from a camera arranged in the seat of a means of transportation. 7 24-2693

[0030] Figure 1 shows a perspective view of the passenger compartment of a means of transport 10, in which a seat 2 with a seat surface 4 and a backrest 5 is arranged in a first row of seats. The seat surface 4 is slidably mounted in the passenger compartment in the direction of a double arrow P1. The backrest 5 is pivotally mounted opposite the slidable seat surface 4, as indicated by an arrow P2. A rear-facing camera 1 is itself motor-mounted and pivotable in the backrest 5, as indicated by a double arrow P3. The detection range of the camera 1 is larger than the current detection range adapted according to the invention (shown hatched), in which the face of the user 9 is located. The user 9 is seated in a second row of seats 11. A control unit 3 awaits data from the camera 1, which is to be transmitted via a data line 18.To select the most cost-effective data line 18, a seating position is determined using sensors 19 and 20 (Hall effect sensors) and reported to a data input 7 of an evaluation unit 6. Based on the reported position, the evaluation unit 6 can select data from camera 1 for transmission and then send it to the control unit 3 via data output 8 and data line 18. For example, by evaluating and transmitting only the hatched detection area of ​​camera 1 for user identification or facial recognition 9, the data required for imaging the remaining detection area of ​​camera 1 can be dispensed with.

[0031] Figure 2 schematically shows a native pixel area 12 of a camera, within which an image section 13, corresponding to the hatched receiving area shown in Figure 1, has been selected for processing and transmission. For this purpose, image areas located above an upper boundary line 14, below a lower boundary line 15, to the left of a left boundary line 16, and to the right of a right boundary line 17 are excluded from processing and transmission. The amount of data to be transmitted and processed per unit of time is therefore significantly less than if the entire (native) resolution of the camera were used.However, by using a camera with a wide-angle field of view, different inclinations of the backrest 5 can be compensated for by selecting a corresponding (hatched) field of view from the available image material, depending on the inclination.8 24-2693.

[0032] Figure 3 shows steps of an embodiment of a method according to the invention for transmitting data from a camera arranged in the seat of a means of transportation. In step 100, the position of the seat is automatically determined by sensors and, if necessary, reported to the camera together with other data. In step 200, the reported position of the seat is used to adjust the acquisition of data and / or the transmission of data from the camera to a control unit of the means of transportation. This step also occurs automatically and without user selection. Rather, an otherwise determined area of ​​interest within the interior is photographed by associating the position of the seat with camera settings based on a predefined reference, which enable continuous acquisition of the area of ​​interest.In step 300, a data set representing the position of the seat is transmitted to the camera, thereby applying the corresponding settings and specifications for data processing and transmission. By adapting the processing and transmission of the data to the position and situation, a comparatively cost-effective data infrastructure can be chosen without compromising functionality.24-2693

[0033] Reference symbol list:

[0034] 1 camera

[0035] 2 seats

[0036] 3 Control unit

[0037] 4 seats

[0038] 5 Backrest

[0039] 6 evaluation unit

[0040] 7 Data input

[0041] 8 Data output

[0042] 9 users

[0043] 10 means of transport

[0044] 11 second row of seats

[0045] 12 Full pixel area 13 Hatched detection area 14 Upper boundary line

[0046] 15 lower boundary line

[0047] 16 left boundary line

[0048] 17 right boundary line

[0049] 18 data lines

[0050] 19, 20 sensors

[0051] 100 to 300 process steps

[0052] P1 to P3 arrows

Claims

10 24-2693 Patent claims:

1. Method for transmitting data from a camera (1) which is arranged in a seat (2) of a means of transport (10), • Determining (100) a position of the seat (2) and • Using (200) a data set representing the position of the seat (2) to adapt a data acquisition and / or transmission of the data from the camera (1) to a control unit (3) of the means of transport (10).

2. The method of claim 1, wherein the use of the data set comprises the use of a predefined reference.

3. The method of claim 1 or 2, wherein the use of the data set results in a reduction - a maximum resolution and / or - an image capture rate and / or - an image format used to create the data the camera (1) includes.

4. Method according to one of the preceding claims, wherein the use of the data set - a selection of an image section from a detection area of ​​the camera (1) and / or - a selection of a data transfer rate and / or - a setting of a repetition rate for image capture and / or - an adjustment of an operating mode of a light source associated with the camera (1), in particular an infrared light source, and / or - a motorized alignment of the camera (1) relative to the seat (2).

5. Method according to one of the preceding claims, wherein the seat (2) is arranged in a first row of seats of the means of transport (10).

6. A method according to any of the preceding claims, wherein the camera (1) is directed towards a rear, in particular a second, row of seats (11). 11 24-2693 7. Method according to one of the preceding claims, wherein the camera (1) is configured to detect an occupant (9) of the means of transport (9).

8. Method according to one of the preceding claims further comprising - transmitting (300) a data set representing the position of the seat (2) to the camera (1).

9. Device for transmitting data from a camera (1) which is arranged in a seat (2) of a means of transport (10), wherein the device comprises - a data input (7), - the camera (1) - an evaluation unit (6) and - a data output (8), wherein - the evaluation unit (6) is set up in conjunction with the data input (7) to determine a position of the seat (2) and - the evaluation unit (6) is set up in conjunction with the data output (8) to use a data set representing the position of the seat (2) to adapt a data acquisition and / or transmission of the data from the camera (1) to a control unit (3) of the means of transport (10).

10. Means of transport comprising a device according to claim 9.

Images