Method, assistance device and system for automatically adjusting a function of a motor vehicle to suit individual occupant positions

The method automatically adjusts vehicle functions based on occupant position and preferences using vehicle and mobile device cameras, addressing the inefficiency of manual settings and enhancing comfort and reducing costs.

DE102024204632B4Active Publication Date: 2026-03-26VOLKSWAGEN AG
View PDF 7 Cites 0 Cited by

Patent Information

Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-05-17
Publication Date
2026-03-26

AI Technical Summary

Technical Problem

Existing vehicle systems require manual adjustment of occupant-specific settings for comfort features, which is cumbersome and inefficient, and often necessitates user knowledge of vehicle functionality.

Method used

A method using vehicle and mobile device cameras to automatically determine the occupant's position and preferences, allowing for position-dependent control of vehicle functions such as air conditioning, ventilation, and seat adjustments, without the need for additional hardware.

Benefits of technology

Enables convenient, efficient, and cost-effective adjustment of vehicle functions to individual occupant preferences, reducing user effort and manufacturing costs while enhancing passenger comfort.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method (1) for controlling a vehicle function of a motor vehicle (2) which enables individual settings for different occupant seats of the motor vehicle (2), wherein automatically - Image data from a vehicle camera of the motor vehicle (2) and image data from a device camera of a mobile electronic device (3) carried by an occupant of the motor vehicle (2) are captured, - the image data of the vehicle camera and the device camera are compared with each other and thus, taking into account a predetermined fixed installation position and orientation of the vehicle camera in the motor vehicle (2), a position of the occupant is determined, - the motor vehicle (2) records an individual setting for the vehicle function specified in a personal user profile of the occupant and the vehicle function is set according to the setting for the specific position of the occupant in the motor vehicle (2).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a method for controlling a vehicle function of a motor vehicle. The invention also relates to a vehicle assistance device and a system for the method.

[0002] Modern motor vehicles often offer a multitude of options and functions to manually and / or automatically improve occupant comfort, user comfort, or the driving experience. For example, US Patent 2020 / 0239005A1 describes a computer-implemented method for vehicle manipulation. In this method, a camera in a vehicle collects data on the cognitive state of numerous occupants in numerous vehicles. Based on this data, a first computing device learns profiles of the cognitive states of the vehicle occupants. A second computing device collects further data on the cognitive state of an individual occupant in a specific vehicle. A third computing device compares this additional data with the learned profiles. Finally, the individual vehicle is manipulated based on this comparison.

[0003] Machine learning methods can also be used to evaluate such data. For example, US 2018 / 0189581A1 describes a computer-implemented method for vehicle manipulation in which a large number of images of a vehicle occupant are captured using an imaging device. This data is then used to train a multi-layered analysis system. Based on the evaluation of further facial images of a person in another vehicle by the trained analysis system, manipulation data is then provided to that vehicle.

[0004] There are various ways to acquire relevant camera or image data. For example, US 2017 / 0217383A1 describes a camera setup for use in a vehicle vision system.

[0005] Furthermore, DE 10 2011 112 370 A1 discloses a motor vehicle comprising: - a position detection device for recording position information describing the position of at least one occupant of the motor vehicle and / or a mobile device, in particular a mobile phone, within the motor vehicle, taking into account the position of the mobile device and / or registration information supplied by the mobile device; and - a control device designed to set at least one operating parameter of a vehicle system, taking into account control information supplied by the mobile device and the position information, and / or to transmit at least one operating information influencing at least one function of the mobile device to the mobile device depending on the position information.

[0006] DE 10 2012 014 074 A1 discloses a method for operating a vehicle in which the position of a portable device, designed to visualize content, is determined in the passenger compartment of the vehicle. Depending on the position of the device in the passenger compartment, the visualization of the content is prevented. Furthermore, the invention relates to a system comprising a vehicle and a portable device arranged in the passenger compartment of the vehicle. The invention also relates to a vehicle.

[0007] German patent DE 10 2023 104 806 A1 relates to a method for determining and outputting a user's seating position in a vehicle. The method comprises the following steps: determining the position of at least one user device assigned to the user outside the vehicle using an electromagnetic transceiver; determining the entry position of the user device into the vehicle using the same electromagnetic transceiver; determining the user's seating position based on the determined entry position; and outputting the determined seating position of the user.

[0008] FR 3 004 570 A1 discloses a method for estimating the angular deviation of a moving element relative to a reference direction, the method comprising the following steps: capturing a reference image representing a reference direction of the moving element; capturing an actual image representing the actual direction of the moving element; identifying points of interest in the reference image and in the actual image; determining at least two pairs of points of interest, each pair consisting of a point of interest in the actual image and a corresponding point of interest in the reference image; determining the angular deviation between the actual direction and the reference direction of the moving element using the at least two pairs of points identified in the previous step.

[0009] The object of the present invention is to enable improved passenger comfort in a motor vehicle.

[0010] This problem is solved by the subject matter of the independent claims. Further possible embodiments of the invention are disclosed in the dependent claims, the description, and the figures. Features, advantages, and possible embodiments set forth in the description for one of the subject matter of the independent claims are to be regarded, at least analogously, as features, advantages, and possible embodiments of the respective subject matter of the other independent claims, as well as of any possible combination of the subject matter of the independent claims, optionally in conjunction with one or more of the dependent claims.

[0011] The method according to the invention serves for the automatic control of at least one vehicle function of a motor vehicle, which, in particular, independently of one another, offers or enables individual, and especially different, settings, effects, or functions for various occupant seats of the motor vehicle. In other words, it can be used to control a corresponding feature of the motor vehicle, such as an air conditioning or ventilation system, an entertainment system (e.g., for music playback), a seat adjustment system, a seat heating system, a seat ventilation setting, a lighting system, and / or the like. This can be done position-dependent, position-specific, or position-individual, i.e., specifically or individually for a single occupant seat.Depending on the vehicle or application, a passenger space can be, for example, a seat, standing space, reclining space, or one of several predefined zones within the vehicle. Each such zone can encompass one or more passenger spaces; for instance, a conventional passenger car might have a first zone for the driver's seat, a second zone for the front passenger seat, and a third zone for the rear seats.

[0012] In one step of the method according to the invention, image data from at least one vehicle camera of the motor vehicle and image data from a device camera of a mobile electronic device carried by an occupant of the motor vehicle are automatically acquired.

[0013] This image data can be captured simultaneously by different cameras or be image data captured simultaneously. For example, this image data can be queried or retrieved from the vehicle camera and the device by means of an assistance system of the motor vehicle configured for the method according to the invention. Likewise, the image data can be sent, for example, to an external server for processing, such as a cloud server, a backend, a central data center, or the like, for example, by the motor vehicle or its assistance system and by the mobile electronic device. This can be done, for example, at the instigation of the assistance system or the motor vehicle and / or at the instigation of the mobile electronic device.If necessary, as part of the procedure, the mobile electronic device may be or become paired with the motor vehicle or its assistance system via a suitable data connection, for example a WLAN or Bluetooth connection or the like.

[0014] If available, image data from multiple vehicle cameras can be used here. This can provide a broader and better basis for the subsequent procedural steps.

[0015] The captured image data can overlap, at least partially, thus depicting a specific common area. To enable or support this, image data from multiple vehicle cameras and / or multiple device cameras of the mobile electronic device and / or image data from device cameras of several different mobile electronic devices carried by the same occupant can be captured. From this data, those image data or image datasets that overlap, at least partially, can then be selected. Similarly, the cameras to be used can be automatically selected in advance to achieve or increase the likelihood of an overlap in the recording or capture areas, i.e., the image data. This can be done, for example, by considering the type of mobile electronic device and / or the installation position and / or orientation of different vehicle cameras, such as a front or rear camera.The front-facing, rear-facing, or rear-facing surround-view camera and / or an interior camera must be taken into account. Different types of mobile electronic devices may, for example, have different typical usage or carrying positions and / or camera orientations. This can be compared, if necessary, with the installation positions and / or detection ranges of multiple vehicle cameras according to a corresponding specification or allocation table. Mobile electronic devices in this context may include, for example, mobile phones or smartphones, wearables, smartwatches, headsets such as AR, VR, or XR glasses, and / or similar devices.

[0016] In a further step of the inventive method, the image data from the at least one vehicle camera and the at least one device camera are automatically compared. Based on this comparison, or on a corresponding correlation of the various image data, and taking into account a predetermined fixed installation position and orientation of the at least one vehicle camera in the motor vehicle, the position of the mobile electronic device, and thus also of the occupant carrying this device, is automatically determined. The position of the device can therefore be used as, or equated with, the position of the occupant.Similarly, to determine the position, a predefined model of the vehicle, which may specify, for example, the dimensions and / or geometry and / or possible occupant positions of the vehicle, or similar information, can be considered, i.e., used or evaluated. For example, parts of the vehicle depicted in the image data can be identified and / or located based on the predefined model, and / or possible or plausible positions of the device or the occupant can be identified or restricted based on the model, or similar.

[0017] In a further step of the inventive process, the motor vehicle, i.e., for example, its assistance system, receives an individual setting for the adjustment or control of at least one vehicle function, such as a corresponding data set or control instruction, which is specified or managed in a personal user profile of the occupant. The at least one vehicle function, or its state, effect, impact, intensity, or the like, is then controlled, adjusted, or operated according to the user profile or the setting specified therein for the previously determined position of the occupant in the motor vehicle, i.e., for the corresponding occupant seat. The individual setting can, for example, be or specify a setting, behavior, intensity, or the like desired or preferred by the respective occupant for the at least one vehicle function.The individual setting may, for example, have been manually set by the respective occupant or learned automatically.

[0018] The present invention can enable the occupant to automatically and therefore particularly conveniently always receive their preferred setting or behavior for at least one vehicle function, for example, even when changing occupant seats within the vehicle or when changing vehicles or entering a new vehicle equipped for the method according to the invention. Modern vehicles often offer the possibility of individually adjusting or controlling various vehicle functions depending on the selected seat. Traditionally, however, these settings would have to be made manually by the user when changing seats or vehicles, i.e., adapted to their individual needs. This requires considerable effort on the part of the respective user.In addition to the necessary manual effort, occupants also require a corresponding knowledge of the functionality and operation of the relevant function or feature of the respective vehicle. On the vehicle side, this necessitates a user interface, i.e., a control element accessible or operable from the respective seat, and appropriate electronics or control software, or at least the provision of a corresponding operating or adjustment option via a mobile device or similar.

[0019] The present invention allows these costs to be saved completely or partially. This can, on the one hand, lead to increased passenger comfort and, on the other hand, potentially to reduced manufacturing and operating costs and / or maintenance costs for the motor vehicle.

[0020] In one possible embodiment of the present invention, image data of the vehicle's external environment is captured using the vehicle's camera. In other words, the vehicle's camera can be, in particular, a surround-view camera of the vehicle. Such a surround-view camera may already be present in many modern vehicles for other driver assistance systems, automated driving functions, or the like. The comparison of the image data from the vehicle's camera and the device's camera is performed here based on environmental features depicted in the image data. Such environmental features can be, for example, landmarks, prominent points, buildings, infrastructure elements, and / or the like in the respective environment. In particular, so-called SIFT features (SIFT: Scale Invariant Feature Transform) can be used.The embodiment of the present invention proposed here can enable a particularly cost-effective yet efficient implementation and application of the method according to the invention, since, for example, no additional dedicated camera needs to be installed in the vehicle for the method. Furthermore, the environmental features used here as a basis or reference for determining the position can enable robust and reliable position determination. Such environmental features outside the vehicle can often be visible from a multitude of different viewpoints or from a multitude of different positions inside the vehicle. Moreover, such environmental features can often be identified particularly easily and reliably across image data from different devices. This can be supported by the fact that, due to the automatically determined distance between the vehicle camera and the vehicle camera, the vehicle camera can be used to determine the position from a wide range of angles and positions.The device camera on the one hand and the environmental features outside the vehicle on the other hand can depict a multitude of features or details, which can then be used for comparison.

[0021] In a further possible embodiment of the present invention, at least a predetermined minimum number of features contained or depicted in both the image data of the vehicle camera and the image data of the device camera are identified and used to determine the position or pose of the occupant. Such features may be, for example, details, structures, patterns, objects, or the like, in particular the SIFT and / or environmental features mentioned elsewhere. Likewise, one or more further criteria may be used to determine the position or pose, such as a sufficient or predetermined minimum difference in the perspectives and / or apparent sizes of the features or of objects used as features, or the like, in the image data of the vehicle camera and the image data of the device camera.Based on differences in the relative spatial arrangement of features and / or the perspective on these features in the image data from the vehicle camera and the image data from the device camera, a relative transformation between the vehicle camera and device camera image data is automatically determined. This transformation corresponds to a change in position from the predetermined installation position of the vehicle camera to the position of the mobile electronic device. In other words, it can be calculated, or computer-aided, how the position of the vehicle camera would need to be changed so that the relative spatial arrangement of the features or the perspective of the mobile electronic device's image data is reflected in its image data. Using this method, the position of the mobile electronic device, and thus the position of the occupant, can be determined simply and reliably. Likewise, the orientation or...The rotational position of the occupant may be determinable or estimable, for example, if the position cannot be determined with sufficient accuracy, such as to narrow it down to a specific individual seat. Likewise, it may be possible to determine or estimate the pose, i.e., the position and orientation or rotational position of the occupant. Based on the orientation, rotational position, or pose, it is possible, for example, in a motor vehicle such as a bus, van, or rail vehicle, with opposing or facing possible occupant positions or seats, to deduce which seating arrangement (possibly a multi-seat arrangement) the occupant is located in.

[0022] If the specified minimum number of common features cannot be identified in both the image data from the vehicle camera and the image data from the mobile electronic device, and / or if any further specified criteria are not met, the procedure can be aborted, or further or new image data from the vehicle camera and the device camera can be requested or acquired. If or as long as the occupant's position cannot be determined as described, or has not been determined, at least one vehicle function can be controlled or operated, for example, in a standard operating mode or according to a current or previous setting or specification.

[0023] In a further possible embodiment of the present invention, sensor data from at least one additional sensor of the vehicle, which characterizes at least a part of an area captured by the vehicle camera and / or the device camera, i.e., depicted in their image data, are automatically acquired. This sensor data is then also used to determine the position of the occupant. For example, when using only two cameras, i.e., only one vehicle camera and only one device camera, whose spatial relationship is initially unknown, the scaling of the transformation mentioned elsewhere may initially be unknown. However, this can be determined, for example, by considering further sensor data or its fusion with the image data. In particular, a predetermined fixed spatial relationship between the at least one additional sensor and the vehicle camera or device camera can also be used.The detection ranges between the sensors must be taken into account. For example, a radar sensor, a lidar sensor, an infrared sensor, or the like can be used as an additional sensor. The embodiment of the present invention proposed here can enable a particularly accurate, reliable, and robust determination of the position.

[0024] In a further possible embodiment of the present invention, descriptors are automatically generated for features contained or depicted in the image data of the vehicle camera and the device camera. Such descriptors can be formalized descriptions of the features that have a predefined structure, i.e., follow a predefined scheme. For example, appropriate predefined detectors can be used to generate or determine the descriptors. These can be, for example, blob detectors such as SIFT or MSER (maximally stable extremal regions), or corner detectors such as Shi-Tomasi, SUSAN (smallest univalue segment assimilating nucleus), or FAST (features from accelerated segment test), or the like. The image data of the vehicle camera and the device camera are then compared with each other based on the respective descriptors.Thus, features present in both sets of image data can be identified or matched based on the descriptors. Using the method proposed here, such a matching or identification of common features is possible even when the image data originates from different devices or sources and was captured from at least slightly different angles or perspectives. Furthermore, comparing based on descriptors keeps the computational or data processing effort for the matching process relatively low. For example, this eliminates the need to compare parts or areas of the image data for which suitable or complete descriptors cannot be generated.A descriptor-based matching can also be robust, for example against different recording characteristics of the various cameras, which can lead to slightly shifted color or intensity values ​​of the different image data at the pixel level.

[0025] In a further possible embodiment of the present invention, the settings specified or managed in the user profile are automatically sent directly from the mobile electronic device to the motor vehicle, or, at the mobile electronic device's automatic instigation, from an external server unit mentioned elsewhere to the motor vehicle. In the former case, the settings can be sent, for example, via a local data connection between the device and the motor vehicle or its assistance system, i.e., the connection mentioned elsewhere. This can be particularly fast and reliable. In the latter case, the settings can be sent, for example, via a mobile network connection. Depending on the embodiment, the user profile can therefore be managed, for example, locally in the mobile electronic device and / or in the external server unit.Since such mobile electronic devices are typically used by only one user today, or, in the case of multiple users, only one user or user profile is active at any given time, separate identification of the occupant, for example by a corresponding occupant monitoring system in the vehicle, can be avoided. The method according to the invention can therefore be implemented in a particularly privacy- and data protection-friendly manner. Furthermore, the occupant or user can thus enjoy the described increase in convenience not only when changing seats within a vehicle in which their user profile is stored or managed, but also when switching between different vehicles or when using a new or unfamiliar vehicle.

[0026] In another possible embodiment of the present invention, the occupant in the motor vehicle is automatically identified. For this purpose, the occupant can be detected, for example, by means of interior or occupant monitoring sensors in the motor vehicle and identified based on biometric features, such as facial recognition. For example, corresponding sensor data or recognized biometric features can be compared with a corresponding user database, which is managed in a vehicle-external server facility mentioned elsewhere, in order to automatically determine the identity of the respective occupant. Based on the identification or the determined identity of the occupant, the vehicle or its assistance system then automatically retrieves the settings specified or managed in the user profile.For example, the user profile can be retrieved from the vehicle's external server or loaded from a local data storage device in the vehicle or driver assistance system. In the embodiment of the present invention proposed here, the mobile electronic device itself does not need to be configured to manage a corresponding user profile or to send the settings, control instructions, or control signals to the vehicle. However, outputting captured image data can be a standard feature for virtually all mobile electronic devices equipped with a camera. Therefore, the method can be applied here with particular reliability and flexibility, as a wide variety of mobile electronic devices can be used.

[0027] In a further possible embodiment of the present invention, the position of the device or the occupant, determined by comparing the image data, is first validated against a predetermined model of the motor vehicle mentioned elsewhere, i.e., before any corresponding control or adjustment of the vehicle function. Only if, according to this validation, the determined position corresponds to an occupant position in the vehicle specified in the model, at least within a predetermined maximum deviation or tolerance, is the vehicle function then adjusted or controlled as specified. This ensures particularly reliable prevention of faulty or undesired adjustments or control of the vehicle function.For example, a particular position may be classified as implausible if, according to the vehicle's model, it lies within the area of ​​the hood or trunk, or entirely outside the vehicle. In such a case, the vehicle function may be operated according to a default setting, in a standard operating mode, or with a current or previous setting.

[0028] The present invention also relates to an assistance device for a motor vehicle. The assistance device according to the invention has an interface for acquiring at least image data, in particular at least one camera of the respective motor vehicle and at least one camera of a mobile electronic device, and for outputting corresponding control signals for at least one vehicle function or at least one vehicle device of the respective motor vehicle associated with vehicle guidance. Furthermore, the assistance device according to the invention has a data processing device for processing at least the acquired image data and for generating the corresponding control signals.According to the invention, the assistance device is configured for the execution or application, in particular automatically, of at least vehicle-side process steps of the method according to the invention, i.e., for participation in or use within this method. For this purpose, the data processing device can, for example, comprise a process unit, such as a microprocessor, microchip, microcontroller, or the like, and a computer-readable data storage device coupled thereto. A corresponding operating or computer program can then be stored in this data storage device, which encodes or implements the corresponding process steps, measures, or sequences mentioned in connection with the method according to the invention, and which can be executed by means of the process unit.The assistance device according to the invention can, in particular, be the assistance device mentioned in connection with the method according to the invention or correspond to it. Accordingly, depending on its configuration, the assistance device according to the invention can, for example, also be configured for communication with the aforementioned vehicle-external server device and / or other devices or systems of the motor vehicle, for example, sensors.

[0029] The invention also relates to a system for carrying out at least system-level process steps of the method according to the invention. The system is or comprises the motor vehicle, which has at least one vehicle camera and at least one vehicle function that can be individually adjusted or controlled for different occupant seats according to the method according to the invention, or the motor vehicle, which has at least one vehicle camera and at least one vehicle function that can be individually adjusted or controlled for different occupant seats according to the method according to the invention, and the aforementioned vehicle-external server device in which the user profile, in particular a plurality of corresponding user profiles for a plurality of users, is managed. In particular, the corresponding motor vehicle can be equipped with the assistance device according to the invention.Likewise, the system according to the invention can comprise the mobile electronic device or a plurality of such devices, which is designed to participate in the method according to the invention and / or the assistance device according to the invention.

[0030] Further features of the invention may become apparent from the following description of the figures and from the drawings. The features and combinations of features mentioned above in the description, as well as the features and combinations of features shown below in the description of the figures and / or in the figures themselves, can be used not only in the combinations specified, but also in other combinations or individually, without departing from the scope of the invention.

[0031] The drawing shows in the single figure a schematic representation to illustrate a method for the automatic, location-specific adjustment of a vehicle function.

[0032] The implementation of modern driver assistance systems and autonomous or automated vehicles or driving functions often requires precise knowledge of the surrounding environment. In addition to sensor technologies such as radar and lidar, cameras can also be used to capture the vehicle's surroundings as comprehensively as possible. This image data can also be used for other purposes or functions. For example, image features, such as prominent points in the depiction of the environment, can be identified and extracted from the camera images. These features from different image data sets can be compared and matched using descriptors. This allows for the establishment of image correspondences between different images or between image data from different cameras.If a sufficient number of corresponding image features can be identified in image data from different cameras, a relative transformation of these cameras, i.e., the recording positions of the image data relative to each other, can be determined, thereby establishing or creating a spatial relationship between the cameras.

[0033] This principle can be applied to extract and compare image features from both camera images from cameras installed in a vehicle and camera images from a mobile device belonging to a vehicle occupant. With a sufficient number of matches, such as those expected when a wearer or user of smart glasses (such as AR glasses) looks out of a vehicle window, the relative position of the mobile device or its camera relative to the vehicle's camera can be determined. Knowing the installation position of the vehicle's camera allows, for example, the determination of the position of the mobile camera—that is, the device and thus the user or occupant—within the vehicle using predefined CAD data or a vehicle model.The position thus determined and the settings desired or specified by the occupant using or carrying the mobile device for a seat or zone corresponding to that position in the vehicle can then be transmitted to the vehicle, for example via an external server or directly from the device, and implemented accordingly.

[0034] To further illustrate such a procedure, the following is shown Fig.1. An exemplary schematic flowchart 1. This represents various process steps S1 to S10, at least some of which can be assigned to a motor vehicle 2 or a mobile electronic device, referred to here as mobile devices 3. In process step S1a, images or image data can be captured or recorded in the motor vehicle 2 using a vehicle camera. These can then be processed in process step S2a, also in the motor vehicle 2, to detect image features. In process step S3a, feature descriptors can be automatically calculated or generated in the motor vehicle 2 for the detected image features.

[0035] In parallel and analogous to this, in a process step S1b, images or image data can also be captured or recorded using a camera on the mobile device 3, which is referred to here as the device camera. These can, for example, also be processed in the mobile device 3 in a process step S2b to detect image features contained or depicted therein. In a process step S3b, feature descriptors can, for example, also be calculated or generated in the mobile device 3 for these detected image features.

[0036] In process step S4, the feature descriptors for the image data from the vehicle camera can be compared or aligned with the feature descriptors for the image data from the device camera. This allows features contained or depicted in both sets of image data to be identified and / or matched.

[0037] In process step S5, it can then be checked whether a sufficient number of such matching features—that is, features contained or depicted in both the image data of the vehicle camera and the image data of the device camera—are present or have been identified. If this is not the case, process steps S1a to S3a and S1b to S3b, as well as process step S4 for the corresponding newly acquired image data or the feature descriptors calculated for them, can be repeated.

[0038] If, in a single pass of process step S5, a sufficient number of matching features are found, a transformation that converts the position of the vehicle camera to the position of the device camera can be determined in process step S6. For this purpose, a corresponding predefined algorithm, a predefined perspective-spatial image processing model, a distortion model, or the like can be used. As a result of process step S6, the position of the mobile device 3 can be determined, for example, relative to the predefined fixed position of the vehicle camera or within a predefined coordinate system of the vehicle 2. This position can be considered or used as the position of the occupant who is carrying, transporting, or using the mobile device 3.

[0039] In process step S7, it can be checked whether the position thus determined lies within the vehicle 2 or, considering the intended occupant positions of the vehicle 2, whether it is a plausible position for the occupant. If this is not the case, the previous process steps can be repeated.

[0040] If, during a iteration of process step S7, it is determined that the specified position lies within the vehicle 2 or is plausible, then in process step S8 a corresponding occupant position, in particular a corresponding seat for the occupant in the vehicle 2, can be determined. For this purpose, for example, a predefined geometric model of the vehicle 2 can be used.

[0041] In process step S9, the automatic determination and transmission of the occupant's user preferences regarding one or more position-specific vehicle functions of the motor vehicle 2 can be carried out. Such user preferences can relate, for example, to volume, seat setting, ventilation, temperature, and / or the like. To determine these user preferences, i.e., the corresponding settings of the user or occupant for these parameters, a corresponding user profile of the user or occupant can be loaded. For example, such a user profile can be stored in an administrative unit 5 of the mobile device 3. Likewise, the user profile can be managed or stored, for example, on the vehicle-external and mobile device-external server 4.In this case, the management unit 5 of the mobile device 3 can, for example, contact the server 4 and instruct it to transmit the user profile or the user preferences specified therein, for example, directly to the vehicle 2. The respective user or occupant can then be identified or authenticated by the mobile device 3.

[0042] Depending on the design or implementation of the procedure, the process steps S4 to S9 can each be carried out, for example, in the motor vehicle 2 and / or the mobile device 3 and / or the server 4.

[0043] User preferences or corresponding control instructions can be transmitted to vehicle 2. In process step S10, the user preferences, i.e., a corresponding specification, can be implemented in vehicle 2. This means that the corresponding vehicle function or a device for the corresponding vehicle function can be automatically set or controlled accordingly in order to create or provide the conditions for the occupant at the determined position of the occupant or the corresponding occupant seat in vehicle 2 that correspond to the user preferences or the specification.

[0044] Overall, the examples described show how a comparison of vehicle cameras and cameras of a mobile device can be carried out and applied for seat-related control of vehicle functions in order to achieve improved passenger comfort. Reference symbol list 1. Schedule 2 motor vehicles 3 Mobile device 4 servers 5 Administrative Unit S1 - S10 Procedure steps

Claims

[1] Method (1) for controlling a vehicle function of a motor vehicle (2) which enables individual settings for different occupant seats of the motor vehicle (2), wherein automatically - Image data from a vehicle camera of the motor vehicle (2) and image data from a device camera of a mobile electronic device (3) carried by an occupant of the motor vehicle (2) are captured, - the image data of the vehicle camera and the device camera are compared with each other and thus, taking into account a predetermined fixed installation position and orientation of the vehicle camera in the motor vehicle (2), a position of the occupant is determined, - the motor vehicle (2) records an individual setting for the vehicle function specified in a personal user profile of the occupant and the vehicle function is set according to the setting for the specific position of the occupant in the motor vehicle (2). [2] Method (1) according to claim 1, characterized by , that image data of the environment of the motor vehicle (2) are recorded by means of the vehicle camera and the comparison of the image data of the vehicle camera and the device camera is carried out on the basis of environmental features depicted in the image data. [3] Method (1) according to any one of the preceding claims, characterized by, that to determine the position of the occupant, at least a predetermined minimum number of features depicted in both the image data of the vehicle camera and in the image data of the device camera are identified and used, and based on differences in their relative spatial arrangement and / or a perspective on these features in the image data of the vehicle camera and the device camera, a transformation is determined between the image data of the vehicle camera and the image data of the device camera, which corresponds to a change in position from the predetermined installation position of the vehicle camera to the position of the mobile electronic device (3). [4] Method (1) according to any one of the preceding claims, characterized by, that additionally sensor data from at least one further sensor of the motor vehicle (2), which characterize at least part of an area captured by the vehicle camera and / or the device camera, are captured and used to determine the position of the occupant. [5] Method (1) according to any one of the preceding claims, characterized by , that descriptors are automatically generated for features depicted in the image data and that the image data of the vehicle camera and the device camera are compared with each other based on the respective descriptors. [6] Method (1) according to any one of the preceding claims, characterized by , that the setting specified in the user profile is automatically sent directly from the mobile electronic device (3) to the motor vehicle (2) or is sent from an external server facility (4) to the motor vehicle (2) at the instigation of the mobile electronic device (3). [7] Method (1) according to any one of claims 1 to 5, characterized by , that the occupant in the motor vehicle (2) is automatically identified and, based on the identification of the occupant, the specification specified in the user profile is automatically retrieved by the motor vehicle (2). [8] Method (1) according to any one of the preceding claims, characterized by , that the position determined by comparing the image data is first validated using a predefined model of the motor vehicle (2) and only if the determined position corresponds to an occupant seat of the motor vehicle (2) according to the model, is the vehicle function set according to the specification. [9] Assistance device for a motor vehicle (2), comprising an interface for capturing image data and outputting corresponding control signals for at least one vehicle function of the respective motor vehicle (2) and a data processing device for processing the image data and generating the control signals, wherein the assistance device is configured to perform vehicle-side process steps of the method (1) according to one of the preceding claims. [10] System for performing at least system-side process steps of the method (1) according to any one of claims 1 to 8, wherein the system - a motor vehicle (2) which has at least one vehicle camera and at least one vehicle function which can be individually adjusted for different occupant seats of the motor vehicle (2) in accordance with the method (1), or - a motor vehicle (2) which has at least one vehicle camera and at least one vehicle function which can be individually adjusted for different occupant seats of the motor vehicle (2) in accordance with the method (1) and includes an external server facility (4) in which the user profile is managed.

Citation Information

Patent Citations

  • Camera assembly for vehicle

    US20170217383A1

  • Vehicle manipulation using convolutional image processing

    US20180189581A1

  • Vehicle manipulation with crowdsourcing

    US20200239005A1

  • motor vehicle

    DE102011112370A1

  • Method for operating vehicle, involves determining position of portable terminal device in passenger compartment of vehicle, where visualization of content is prevented depending on position of terminal device in passenger compartment

    DE102012014074A1