Device and method for transmitting data from a camera which is arranged in a seat of a means of transport

Abstract

A means of locomotion (10), a device, and a method for transmitting data from a camera (1), which is arranged in a seat (2) of a means of locomotion (10), are proposed. The method comprises the steps of: determining the position of the seat (2), and using a data set representing the position of the seat (2) to adapt the acquisition of data and / or transmission of the data from the camera (1) to a control unit (3) of the means of locomotion (10).

Description

The present invention relates to a means of locomotion, a device, and a method for transmitting data from a camera arranged in a seat of a means of locomotion. In particular, the present invention relates to increasing the efficiency of data transmission from such a camera to a control unit. Modern vehicles typically feature numerous optical cameras in the interior. For example, a camera mounted in the dashboard / instrument cluster can detect driver fatigue or the fatigue of other occupants. It also recognizes occupant gestures and uses them to control the vehicle's electronics. These cameras are usually located in the front row of seats, such as behind the steering wheel, in the A-pillar, or in a rearview mirror. Cameras can be RGB (red, yellow, blue) or IR (infrared) cameras. US 2024 / 0067051 A1 discloses a method for adjusting an electric seat in a means of transportation, in which the adjustment of a seat can be prevented based on signals recorded by a camera mounted in the seat. In this way, a safety function (collision avoidance) based on camera images is provided. A problem with cameras is the amount of data they generate and the transmission of that data. The larger the amount of data that needs to be transferred from a camera to the processing unit, the more complex and expensive the required transmission technology becomes (e.g., Speed ​​Grade from GMSL). Another problem is the energy consumption of the infrared illumination required for imaging in darkness. Cameras in the second row of seats can be installed in different locations. Two cameras are often needed on the side of the vehicle (B-pillar) because the viewing angle of the person opposite is not ideal and can be obstructed by, for example, the front seat. In the center of the vehicle, the number of cameras could be reduced to one. However, vehicles increasingly have glass roofs, which make integration into the headliner difficult or even impossible. Based on the aforementioned prior art, it is an object of the present invention to provide cost-effective monitoring of an interior space using camera technology. This object is achieved according to the invention by a method with the features of claim 1 and a device with the features of claim 9. The dependent claims describe preferred embodiments of the invention. According to one aspect of the present invention, the seating position of a seat in a means of transport, in which the camera is integrated, is determined using sensors. For example, the camera can be integrated into a backrest or the back of a headrest. Furthermore, a 3D camera position within the vehicle can be determined. This includes determining the camera's orientation, height, position in the Y-direction, and, if applicable, its opening angle / capture area. The aforementioned information can then be transmitted to the camera, enabling it to reduce the recorded / transmitted data based on this information. In other words, irrelevant or less relevant data can be excluded from transmission to a control unit and / or a processing unit within or outside the means of transport.Finally, infrared illumination can also be adjusted to suit the reduced field of view. The data required to adapt the camera's data acquisition / transmission can be calculated, for example, in a control unit or integration platform and transmitted to the camera via SerDes sideband. If it is a smart camera (stand-alone camera), the calculation could also be performed within the camera itself, or the data could be transmitted to a control unit for processing via another method, such as LAN or WLAN. In other words, a method for transmitting data from a camera mounted in the seat of a vehicle is proposed. The camera can be understood as an interior camera of the vehicle. The vehicle can be a car, van, truck, motorcycle, aircraft, and / or watercraft. First, the position of the seat is determined using sensors, particularly automatically. The seat position can be determined in such a way as to provide information about the position and orientation of the camera. In other words, the vehicle has an electrically adjustable seat that supports the camera. The camera is thus mounted on the movable part of the seat, so that its position and / or orientation changes with the seat's adjustment.According to the invention, a data set representing the position of the seat is used to adapt the acquisition and / or transmission of data from the camera to a control unit of the means of transport. In other words, based on the determined position, a sensor-based decision is automatically made as to which data captured by the camera can be omitted in order to keep data processing and data transmission from the camera cost-effective and / or to minimize the required bandwidth. In particular, it can automatically take into account which areas are currently of interest for camera capture. For example, this could include a person, especially their gestures and / or their face. Thus, data transmission can be designed to be cost-effective and low-bandwidth. Furthermore, the subsequent processing of the camera's image data (in the processor, such as ISP, CPU, NPU, GPU) can also be more resource-efficient and therefore more cost-effective. The camera can be, for example, an optical camera, especially an infrared camera. It can be designed as a 2D and / or 3D camera. It can be a Time-of-Flight (ToF) camera, which can be used to determine three-dimensional images and / or distances to photographed objects. Such cameras are used, for example, for gesture recognition. Using the data set may involve using a predefined reference. For example, the reference may describe a seating position and / or a relative position between the seat and an occupant or another predefined area within the vehicle. In other words, the predefined reference may establish a predefined relationship between a given seat setting and a data set describing the acquisition and / or transmission of the data. This may include a defined or parameterized area of ​​interest within the vehicle (for example, in the area of ​​the second or third row of seats), which, in every ordinary seat position, must be within the camera's field of view and, according to the invention, should not be excluded from data acquisition and / or transmission.The remaining areas of the camera's detection range defined by the reference can therefore be automatically excluded using information technology in order to reduce the data to be processed and / or transmitted and to reduce the required bandwidth. Using the dataset can reduce the maximum resolution of the camera. For example, the native resolution of a sensor in the camera can be reduced to decrease the amount of data. Alternatively or additionally, the image capture rate can be reduced to decrease the number of images taken per unit of time. Alternatively or additionally, the image format used by the camera to generate the data can also be reduced. In other words, areas can be excluded from the data stream captured by the camera, so that only sub-areas of the captured vehicle interior are included in the data stream. These can be, in particular, contiguous sub-areas (image sections).In this way, depending on the position of the seat, a focus can be placed on specific areas inside the vehicle in order to digitize the objects and / or movements suspected to be there or located there in the best possible way, while keeping the amount of data low. Using the data set can involve selecting a section of the image from the camera's field of view or using a contiguous pixel area from a native pixel area. In this case, a specific image area is extracted from the complete camera image and processed separately, while the remaining image areas are not processed or at least not transmitted. A data transmission rate can also be selected based on the data set. For this purpose, a separate, predefined reference can be used, specifically linking the seat position to the location of the image section to be processed and transmitted. A data transmission rate from the camera to the control unit can also be selected based on the data set. Furthermore, a refresh rate for a still image or video sequence can be defined using the data set.Alternatively or additionally, the operating mode of a light source associated with the camera (e.g., an infrared light source) can be adjusted. For example, the light source can be switched on or off. In particular, the light sources can be aligned, or subgroups of light sources can be selected depending on the data set. Alternatively or additionally, the camera (including or excluding the light sources) can be motor-aligned relative to the seat based on the data set. The data set representing the position of the seat can therefore offer a significant advantage for the needs-based processing and transmission of the camera data. The seat may, for example, be located in a first row of seats in the means of transport, while the camera is oriented in a rearward direction (towards a rear, in particular a second, row of seats). The camera can, for example, be set up to record an occupant of the vehicle. This could allow for classification of the occupant based on gender, height, weight, and location. Facial expressions and gestures can also be analyzed, and facial recognition technology can be prepared for this purpose. To determine the seat's position, Hall sensors or information from stepper motors within the seat can be used. Alternatively or additionally, interior cameras can be used, in particular cameras located, for example, in the dashboard, an A-pillar, a roof control unit, an instrument cluster, or similar components of the vehicle. Finally, the target position of the seat, predefined via a key fob, can also be used or anticipated to adjust the data acquisition and / or transmission. In other words, all information known in the prior art for determining a seat's position can also be used in accordance with the invention. Data transmission between the camera and the control unit that receives the camera data can be achieved, for example, via a serial interface such as GMSL and / or ASA Motion Link (ML). The more selective the data to be transmitted, or the lower the data volume / data rate, the less expensive the cabling and data infrastructure can be. This reduces the costs of connecting the camera to the control unit. According to a second aspect of the present invention, a device for transmitting data from a camera arranged in the seat of a means of transportation is proposed. The device comprises a data input, the camera, an evaluation unit, and a data output. The data input and the data output can be configured for connection to proprietary lines and / or a vehicle bus. The evaluation unit can comprise a programmable processor, in particular a microprocessor or a nanocontroller. According to the invention, the evaluation unit is connected to the data input and configured to automatically determine the position of the seat using sensors. In conjunction with the data output, the evaluation unit is configured to use a data set representing the position of the seat for acquiring and / or transmitting the camera data to a control unit of the means of transportation.In this way, the device realizes the features, combinations of features and the advantages arising from them of the method according to the invention in such a way that reference is made to the above explanations to avoid repetition. According to a third aspect of the present invention, a means of transport is proposed which can be configured as a car, van, truck, motorcycle, aircraft and / or watercraft. The means of transport has a device according to the second aspect of the invention, enabling it to realize the same features, combinations of features and advantages. Further details, features, and advantages of the invention will become apparent from the following description and the figures. Figure 1 shows a perspective schematic representation of a passenger compartment of an embodiment of a means of transportation according to the invention, including an embodiment of a device according to the invention; Figure 2 shows a schematic representation of an image section determined according to the invention from a native pixel area of ​​a camera usable according to the invention; and Figure 3 shows a flowchart illustrating the steps of an embodiment of a method according to the invention for transmitting data from a camera arranged in a seat of a means of transportation. Fig. 1 shows a perspective view of the passenger compartment of a means of transport 10, in which a seat 2 with a seat surface 4 and a backrest 5 is arranged in a first row of seats. The seat surface 4 is slidably mounted in the passenger compartment in the direction of a double arrow P1. The backrest 5 is pivotally mounted opposite the slidable seat surface 4, as indicated by an arrow P2. A rear-facing camera 1 is itself motor-mounted and pivotable in the backrest 5, as indicated by a double arrow P3. The detection range of the camera 1 is larger than the current detection range adapted according to the invention (shown hatched), in which the face of the user 9 is located. The user 9 is seated in a second row of seats 11. A control unit 3 awaits data from the camera 1, which is to be transmitted via a data line 18.To select the most cost-effective data line 18, a seating position is determined using Hall-effect sensors 19 and 20 and reported to a data input 7 of an evaluation unit 6. Based on the reported position, the evaluation unit 6 can select data from camera 1 for transmission and then send it to the control unit 3 via data output 8 and data line 18. For example, by evaluating and transmitting only the hatched detection area of ​​camera 1 for user identification or facial recognition 9, the data required for imaging the remaining detection area of ​​camera 1 can be dispensed with. Fig. 2 schematically shows a native pixel area 12 of a camera, within which an image section 13, corresponding to the hatched receiving area shown in Fig. 1, has been selected for processing and transmission. For this purpose, image areas located above an upper boundary line 14, below a lower boundary line 15, to the left of a left boundary line 16, and to the right of a right boundary line 17 are excluded from processing and transmission. The amount of data to be transmitted and processed per unit of time is therefore significantly less than if the entire (native) resolution of the camera were used.However, by using a camera which has a wide-angle detection range, different inclinations of the backrest 5 can be compensated for by selecting a respective (hatched) detection area from the available image material depending on the inclination. Fig. 3 shows steps of an embodiment of a method according to the invention for transmitting data from a camera arranged in the seat of a means of transportation. In step 100, the position of the seat is automatically determined by sensors and, if necessary, reported to the camera together with other data. In step 200, the reported position of the seat is used to adjust the acquisition of data and / or the transmission of data from the camera to a control unit of the means of transportation. This step also occurs automatically and without user selection. Rather, an otherwise determined area of ​​interest within the interior is photographed by associating the position of the seat with camera settings based on a predefined reference, which enable continuous acquisition of the area of ​​interest.In step 300, a data set representing the seat's position is transmitted to the camera, thereby applying the corresponding settings and specifications for data processing and transmission. By adapting the data processing and transmission to the position and situation, a comparatively cost-effective data infrastructure can be chosen without compromising functionality. Reference symbol list: 1 Camera 2 Seat 3 Control unit 4 Seat surface 5 Backrest 6 Evaluation unit 7 Data input 8 Data output 9 User 10 Means of transport 11 Second row of seats 12 Complete pixel area 13 Hatched detection area 14 Upper boundary line 15 Lower boundary line 16 Left boundary line 17 Right boundary line 18 Data line 19, 20 Sensors 100 to 300 Process steps P1 to P3 Arrows

Claims

Method for transmitting data from a camera (1) arranged in a seat (2) of a means of transport (10), • Determining (100) a position of the seat (2) and • Using (200) a data set representing the position of the seat (2) to adapt a data acquisition and / or to adapt a transmission of the data from the camera (1) to a control unit (3) of the means of transport (10). The method of claim 1, wherein the use of the data set comprises the use of a predefined reference. Method according to claim 1 or 2, wherein the use of the data set comprises a reduction of a maximum resolution and / or an image acquisition rate and / or an image format of the camera (1) used to create the data. Method according to one of the preceding claims, wherein the use of the data set comprises: - a selection of an image section from a detection area of ​​the camera (1) and / or - a selection of a data transmission rate and / or - a setting of a repetition rate for an image capture and / or - an adjustment of an operating mode of a light source associated with the camera (1), in particular an infrared light source, and / or - a motorized alignment of the camera (1) relative to the seat (2). Method according to one of the preceding claims, wherein the seat (2) is arranged in a first row of seats of the means of transport (10). Method according to one of the preceding claims, wherein the camera (1) is directed towards a rear, in particular a second, row of seats (11). Method according to one of the preceding claims, wherein the camera (1) is configured to detect an occupant (9) of the means of transport (9). Method according to one of the preceding claims further comprising transmitting (300) a data set representing the position of the seat (2) to the camera (1). Device for transmitting data from a camera (1) arranged in a seat (2) of a means of transport (10), the device comprising: - a data input (7), - the camera (1), - an evaluation unit (6) and - a data output (8), wherein - the evaluation unit (6) is configured in conjunction with the data input (7) to determine a position of the seat (2) and - the evaluation unit (6) is configured in conjunction with the data output (8) to use a data set representing the position of the seat (2) to adapt a data acquisition and / or to adapt a transmission of the data from the camera (1) to a control unit (3) of the means of transport (10). Means of transport comprising a device according to claim 9.

Images