METHOD FOR DETECTING A MOBILE DEVICE IN A VEHICLE

Abstract

A method for detecting a mobile device (2) in a vehicle. In this method, monitoring data for at least a part of the vehicle's interior (1) is acquired by means of at least one monitoring device (3), and it is determined whether a mobile device (2) is located in the part of the vehicle's interior (1) for which the monitoring data is acquired and is currently being used by a user (10). If a device is detected in use, a lighting device (11) in the vehicle's interior (1) is activated. This improves the recognition of content displayed on the mobile device (2) by an image capture device (4), in particular for controlling a vehicle function.

Description

[0001] The present invention relates to a method for detecting a mobile terminal in a vehicle. In particular, content displayed on a mobile terminal is to be captured using an image capture device in order to control a function of the vehicle.

[0002] Modern vehicles have a multitude of functions that can be controlled by a user, i.e., accessed, started, stopped, configured, etc. This can include, in particular, infotainment system functions such as entering a navigation destination, playing a piece of music, calling a contact, or the like. These infotainment system functions are typically controlled by the user interacting directly with the vehicle, for example, by pressing buttons or touching a touchscreen, or by voice control or gesture control.

[0003] However, operating the system in the vehicle itself can sometimes be cumbersome, for example when data such as a navigation destination or the title of a song has to be entered using a keyboard on a touchscreen. Such input is often easier on a user's device, such as a smartphone. In some cases, the data is even already available on the smartphone, for example if a user has already listened to a particular song on their smartphone and now wants to hear it in the vehicle. Therefore, methods are known in which data is transferred from the user's device to the vehicle, for example via Bluetooth or a cloud service.

[0004] It is also known to capture content displayed on a mobile device using a camera in the vehicle. Since modern vehicles are often equipped with corresponding cameras, for example, for interior monitoring, this infrastructure can be used to read displayed content. The content can be displayed text that is recognized via OCR. This allows, for example, navigation destinations to be easily transferred from a smartphone to the vehicle. Machine-readable codes, such as QR codes, can also be used, which are captured by a camera in the vehicle.

[0005] To reliably recognize displayed content, especially text or codes, low-noise capture of the displayed content is necessary. However, this can be particularly difficult in low-light or dark environments, such as at night or in a tunnel. Furthermore, most mobile devices are configured to automatically adjust the display brightness to the ambient lighting. While a dimmed display is beneficial to the human eye in the dark or in low-light environments, it complicates the automatic recognition of displayed content by an image capture device.

[0006] The present invention is based on the object of providing an improved method for recognizing a mobile device in a vehicle. In particular, the recognition of content displayed on a mobile device is to be improved.

[0007] This object is achieved according to the teaching of the independent claims. Various embodiments and further developments of the invention are the subject of the dependent claims.

[0008] A first aspect of the invention relates to a method, in particular a computer-implemented method, for detecting a mobile terminal in a vehicle. In the method, monitoring data for at least a portion of the vehicle's interior is acquired by means of at least one monitoring device, and it is determined whether a mobile terminal is currently being used by a user in the portion of the vehicle's interior for which the monitoring data is acquired. If this is the case, a lighting device in the vehicle's interior is activated.

[0009] The aforementioned method according to the first aspect is therefore based, in particular, on a lighting device in the interior of the vehicle being activated, i.e., switched on, when the use of a mobile device is detected. This can be the case, for example, when a user picks up a device (e.g., a smartphone). It can also be provided that use is only detected upon a specific action, e.g., when the device is held in a specific position or at a specific location (see also the explanations below).

[0010] In this way, automatic recognition of the end device, in particular of content displayed on a screen, is facilitated and improved by an image capture device. This results, on the one hand, from the fact that the intensity of the ambient lighting in the interior of the vehicle increases as such, making the end device more easily detectable by an image capture device. On the other hand, particularly if the end device is set to automatically adjust the display brightness, the brightness of the end device's display automatically increases as a result of the activated lighting device in the vehicle. Due to the brighter (and thus generally higher-contrast) display on the display, texts or machine-readable codes in particular can be detected by an image capture device with less noise, thus increasing recognition accuracy. The lighting device can be activated for a predetermined period of time (e.g.30 seconds), which should usually be sufficient to capture the content. The lighting device can then be switched off automatically.

[0011] The term “vehicle” as used herein refers in particular to a passenger car, including all types of motor vehicles, hybrid and battery-powered electric vehicles, as well as vehicles such as vans, buses, trucks, delivery vans and the like.

[0012] The term "monitoring device" used here refers in particular to a device suitable for monitoring the interior of a vehicle, in particular the vehicle occupants, and in particular their positions and movements within the space. This can be an image capture device. An infrared (IR) camera (e.g., a near-infrared (NIR) camera) or a camera for IR and RGB can be used. An IR image is well suited for monitoring because it is robust against changing light conditions, for example, even in strong sunlight. Recordings are also possible in the dark. It goes without saying that a suitable IR light source can be present. It is also conceivable to create a three-dimensional model of the driver or the vehicle interior, for example, using a time-of-flight (TOF) camera.Using the three-dimensional model, distances to the camera and thus distances between objects and their movements can be calculated.

[0013] The term "image capture device" used here refers in particular to a camera, especially a digital camera. The camera can capture still images (photos) or moving images (videos), particularly in the visible light range. An image capture device can capture or record such an image and output corresponding image data. The image capture device can also serve as a monitoring device, i.e., the image capture device and the monitoring device can be one and the same device.

[0014] The term "lighting device" used here refers in particular to the interior lighting of a vehicle. This can be a reading light, for example, in a roof area of ​​the interior, particularly in or near the interior mirror, in or on the sun visors, or in another suitable location. Other lighting devices, such as a search light, ambient lighting, and the like, are also conceivable.

[0015] The term "mobile device" as used here refers in particular to electronic devices that are portable and capable of communicating wirelessly with other devices or networks. These are handy devices that can often be carried in a pocket or held in the hand. Mobile devices include smartphones, tablets, laptops, smartwatches, and other similar devices. These devices generally use cellular networks, Wi-Fi, Bluetooth, or UWB to establish a wireless connection and enable data transmission. The mobile device is particularly configured to display content, in particular on a screen. The user of a device can in particular be the driver of the vehicle. However, it is understood that a passenger and, in principle, any vehicle occupant can also be a user of the device within the meaning of the invention.

[0016] The term "function of a vehicle" (synonymous with the term "vehicle function") as used herein refers in particular to a function of an infotainment system of a vehicle. This can include proprietary applications of the vehicle manufacturer and / or applications implemented by third-party providers. The control of a vehicle function, which is also described here, can in particular include calling up or starting a vehicle function associated with a recognized piece of content depending on the recognized content. However, controlling a vehicle function can also merely comprise displaying data relating to a recognized piece of content or the associated vehicle function (optionally together with the recognized content), for example on a screen of the vehicle, in particular a display of the infotainment system.

[0017] The term "content" of a terminal device, as used herein, refers in particular to information presented on a display device, such as a display, of a terminal device. The content does not necessarily have to be displayed on the terminal device in an app that corresponds to the type of vehicle function. The content can simply consist of, for example, unformatted text or machine-readable code. Nevertheless, the content can also be examined with regard to its presentation, such as font format, colors, shapes, logos, or the like, which can be used to identify the vehicle function. A code can also contain more than just text, such as additionally specifying the type of content or even a corresponding control code for the vehicle function.

[0018] The terms "comprises," "includes," "includes," "has," "has," "with," or any other variation thereof, as used herein, are intended to cover non-exclusive inclusion. For example, a method or apparatus that includes or has a list of elements is not necessarily limited to those elements, but may include other elements not expressly listed or that are inherent in such a method or apparatus.

[0019] Furthermore, unless explicitly stated to the contrary, "or" refers to an inclusive "or" and not an exclusive "or." For example, a condition A or B is satisfied by one of the following conditions: A is true (or present) and B is false (or absent), A is false (or absent) and B is true (or present), and both A and B are true (or present).

[0020] The terms "a" or "an" as used herein are defined as "one or more." The terms "another" and "another," and any other variations thereof, are defined as "at least one other."

[0021] The term “plurality” as used here shall mean “two or more”.

[0022] The term “configured” or “set up” to fulfil a specific function (and respective modifications thereof) is to be understood within the meaning of the invention that the corresponding device is already in a design or setting in which it can carry out the function or is at least adjustable - i.e. configurable - so that it can carry out the function after being set accordingly. The configuration can be carried out, for example, by appropriately setting parameters of a process sequence or of switches or the like for activating or deactivating functionalities or settings. In particular, the device can have a plurality of predetermined configurations or operating modes, so that the configuration can be carried out by selecting one of these configurations or operating modes.

[0023] Preferred embodiments of the method are described below, which, unless expressly excluded or technically impossible, can be combined with each other as well as with the other aspects of the invention described.

[0024] In some embodiments, the method according to claim further comprises determining whether the mobile device, when in use, is at least partially located in a predetermined area of ​​the part of the interior that lies within a detection range of an image capture device. It can therefore be provided not to detect every use of a mobile device, for example when a user uses their smartphone solely for themselves, e.g., to type a message or make a call. The area of ​​the part of the interior that is within a detection range of an image capture device can be an area in front of an interior camera, which can be located in the interior mirror. A user must therefore then actively hold their device in front of the camera in order to detect use. This can be useful, in particular, while driving, to avoid disruptions caused by switching on the lights.

[0025] It can then be provided that the lighting device is only activated if it is determined that the mobile device is in use and is at least partially located within the specified area of ​​the part of the interior. In other words, a user must then actively hold their device in front of the camera in order to detect use and thus activate the lighting device. This can be particularly advantageous if this type of detection is used while driving. This can reduce the likelihood of the lighting device being switched on unintentionally while driving. When the vehicle is stationary, usage detection can then be extended to cover a larger part of the vehicle interior.

[0026] In some embodiments, the method further comprises determining a seating position of the user who is currently using the mobile device, wherein, if the driver's position is determined as the seating position, the lighting device is only activated when the vehicle is stationary. In particular, the monitoring data can be used for the determination, which can include, for example, three-dimensional data of the vehicle interior with the vehicle occupants. In this way, the device itself, in particular its position in space, can be recognized. However, the user who is currently using the mobile device, in particular their seating position, e.g., driver's seat or front passenger seat, can also be identified, for example based on skeletal models of the vehicle occupants.To ensure driving safety, the lighting system can only be activated when the vehicle is stationary (i.e., not while moving) if the driver's device usage is detected. However, if the passenger is using a mobile device, this restriction may not necessarily apply. However, this may be required, as activating the lighting while driving can be disruptive.

[0027] In some embodiments, the lighting device is located in an upper region of the vehicle interior, or in other words, a lighting device is activated that is located in an upper region of the vehicle interior. Illumination from above increases the probability that the mobile device currently being used by a user will be illuminated on its front by the lighting device, i.e., on the side of the display. Sensors for detecting the ambient light intensity are also typically arranged on this side in order to automatically regulate the display brightness. Switching on lighting in the upper region of the vehicle interior therefore highly likely results in the display brightness being automatically increased. As described above, this improves the automatic recognition of displayed content.

[0028] In some embodiments, the lighting device is located in an area of ​​the vehicle's interior that surrounds the image capture device, or in other words, a lighting device is activated that is located in an area of ​​the vehicle's interior that surrounds the image capture device. This makes it possible to illuminate the end device particularly brightly when it is held in front of a camera, for example, to recognize displayed content. For example, a reading light in the roof of the vehicle, such as in a corresponding module in the area of ​​the interior mirror, can be switched on when an end device is held in front of a camera that is installed in the interior mirror (or in the base of the interior mirror).The terminal device, in particular the display, is thus illuminated directly (from the front and top) from a relatively short distance, so that due to the automatic brightness adjustment of the display, as already explained several times, and also due to the lighting itself, the recognition of content shown on the display by an image capture device can be improved.

[0029] In some embodiments, the method further comprises determining an illuminance in the interior of the vehicle, in particular before the lighting device is activated, where appropriate. The lighting device is only activated if the determined illuminance is below a predetermined threshold. In other words, the lighting device is only activated if the illuminance is likely to be insufficient to reliably detect the terminal device without switching on the lighting device, i.e., if it is "too dark."Or conversely, it can be provided that the lighting device is not activated if the specific illuminance is above the specified threshold, i.e. it is “bright enough” to reliably recognize the terminal device (and, for example, brightening the display would not bring any benefit, or it may already be at the highest brightness level anyway).

[0030] In some embodiments, the method comprises capturing image data by means of at least one image capturing device in the interior of a vehicle, wherein the image data contain at least one view of a terminal device of the user, detecting content on the terminal device of the user by evaluating the image data, assigning the detected content to a function of the vehicle and controlling the function of the vehicle depending on the detected content.

[0031] Image data captured by an image capture device, such as a camera, is thus evaluated. The image capture device captures a view of the user's device, allowing content on the device, in particular content displayed on a display of the device, to be recognized. By activating the illumination device, this can be achieved with improved recognition accuracy (compared to image data captured without additional illumination).

[0032] The recognized content is assigned to a function of the vehicle. In other words, the type of content is recognized so that the content can be assigned to a vehicle function. This function can then be controlled, in particular called up or configured, depending on the recognized content, for example using the recognized content. This procedure significantly simplifies the control of a vehicle function because no pairing, connection or other electronic connection of the end device to the vehicle is necessary. Therefore, a vehicle function can also be controlled, for example, by users who do not have to connect their end device to the vehicle beforehand. The control can be achieved, for example, simply by holding a smartphone up to a camera in the vehicle interior. The image recorded by the smartphone orMore precisely, the display with the content shown on it allows a corresponding vehicle function with the appropriate content to be called up quickly and easily.

[0033] In some embodiments, the image data is only captured by the image capture device when it is determined that the user's terminal device is at least partially located within the predefined area. This measure, which can precede the actual detection of content on the terminal device, allows the method to be designed with increased reliability. Image analysis is not performed continuously, which would require additional computing power and could also lead to undesirable results, for example, if a user does not intend to control a vehicle function at all. The image data is only captured for the possible detection of content on the terminal device when a user actually holds a terminal device within a detection area (the predefined area). Use is then detected accordingly, and the lighting device is activated.

[0034] In some embodiments, the image data is captured by the image capture device in the visible light range. This can be done using an RGB camera. This method is most suitable for recognizing content appropriated on a terminal device's display.

[0035] In some embodiments, the monitoring data is acquired by means of the monitoring device, which is configured to acquire monitoring data for at least part of the interior of the vehicle, wherein the monitoring data preferably comprises image data in the infrared light range (IR) and / or three-dimensional model data. Driver monitoring systems typically operate with such IR cameras. This method is suitable for monitoring a vehicle interior because image data acquired in the IR range is robust to different lighting conditions. In other words, this method delivers reliable results both in strong sunlight and in the dark (especially compared to image data in the visible light range). Data on a three-dimensional model, recorded, for example, with a time-of-flight camera, allows a detailed three-dimensional view of the vehicle interior.

[0036] In some embodiments, recognizing content includes recognizing text and / or recognizing a machine-readable code. Such recognition can utilize known methods, such as text recognition from image data using OCR. Classification or parsing can then be performed to assign the recognized text (or code) to a vehicle function. For example, a recognized text can be used to determine whether it is a song title or an address. Depending on this, an app from a streaming provider can then be called up to play the recognized song, or the navigation system can be started with appropriate route guidance to the recognized address.

[0037] A second aspect of the invention relates to a data processing system comprising at least one processor configured to execute the method according to the first aspect of the invention. The system, in particular, comprises at least one lighting device in the interior of a vehicle.

[0038] In some embodiments, the system further comprises at least one image capture device configured to capture image data in the visible range (RGB) of light. As explained above, content of a terminal device, in particular content displayed on a display of a terminal device, can be recognized in this way.

[0039] In some embodiments, the system further comprises at least one monitoring device configured to acquire image data in the infrared (IR) range and / or three-dimensional model data. As explained above, it is advantageous to monitor the interior of a vehicle using an infrared camera or a time-of-flight camera.

[0040] A third aspect of the invention relates to a computer program comprising instructions which, when executed on a system according to the second aspect, cause the system to carry out the method according to the first aspect.

[0041] The computer program can, in particular, be stored on a non-volatile data carrier. This is preferably a data carrier in the form of an optical data carrier or a flash memory module. This can be advantageous if the computer program as such is to be handled independently of a processor platform on which the one or more programs are to be executed. In another implementation, the computer program can be present as a file on a data processing unit, in particular on a server, and can be downloadable via a data connection, for example the Internet or a dedicated data connection, such as a proprietary or local network. Furthermore, the computer program can have a plurality of interacting individual program modules.

[0042] The system according to the second aspect can accordingly comprise a program memory in which the computer program is stored. Alternatively, the system can also be configured to access an external computer program, for example, available on one or more servers or other data processing units, via a communication connection, in particular to exchange data with it that is used during the execution of the method or computer program or that represents outputs of the computer program.

[0043] The features and advantages explained with reference to the first aspect of the invention also apply accordingly to the further aspects of the invention. This also applies to the features and advantages explained with reference to the second aspect of the invention.

[0044] Further advantages, features and possible applications of the present invention will become apparent from the following detailed description in conjunction with the drawings.

[0045] It shows: Fig. 1 a flowchart of a method according to an embodiment; Fig. 2 a view of a vehicle interior with a terminal device held by a user in a detection area; and Fig. 3 a view of a device with displayed content.

[0046] Throughout the figures, the same reference numerals are used for the same or corresponding elements of the invention.

[0047] In Fig. 1 shows a method 100 for detecting a mobile terminal 2 in a vehicle, which in the example shown leads to the control of a vehicle function. The method 100 can be executed in particular in a data processing system of the vehicle (not shown). The method 100 is also described below with reference to Fig. 2 and Fig. 3 explained. Fig. 2 shows a section of a vehicle interior 1 with a driver as user 10 of a smartphone as an exemplary mobile device 2. In Fig. 3 shows a smartphone 2 in the hand of a user with a content 22 displayed on the display 21 (schematically indicated as a box).

[0048] In a step S1, monitoring data for at least part of the vehicle interior 1 are recorded. The vehicle can be equipped with a driver monitoring system (DMS), which monitors the driver and possibly also other parts of the vehicle interior 1. This monitoring can be active permanently while driving (i.e., in particular, beginning and ending with the ignition being switched on or off). For this purpose, a monitoring device 3 can be arranged in the vehicle interior 2, for example, in the base 5 of the interior mirror 6. From this position, the driver 10 and large parts of the vehicle interior 1 can be clearly seen.

[0049] An infrared (IR) camera (e.g., a near-infrared (NIR) camera) can be used. An IR image is well-suited for surveillance because it is robust against changing light conditions, for example, even in strong sunlight. Recordings in the dark are also possible. It goes without saying that a suitable IR light source can be present. An IR / RGB camera can also be used, which also records image data in the visible light range (RGB) for surveillance purposes. It is also conceivable to create a three-dimensional model of the driver 10 or the vehicle interior 1, for example, using a time-of-flight (TOF) camera. Using the three-dimensional model, distances to the camera, and thus distances between objects and their movements, can be calculated.

[0050] From the recorded monitoring data, it can be determined in a step S2 whether a mobile terminal 2 is detected which is currently in use. In principle, this can include any use of the terminal 2 that a user 10 can make in the vehicle, without the terminal 2 having to be held in a special area (cf. explanations below), for example. It can be sufficient if the user 10 picks up his terminal 2 or the like. For safety reasons or for reasons of convenience (in order to reduce unintentional activation of the lighting to a minimum), for the detection of use it can also be determined, for example, who is using the terminal 2, in particular to distinguish between driver and passenger, and / or whether the vehicle is stationary or moving. For example, it can be provided that use by the driver is only recognized as such (within the meaning of the invention, i.e.followed by activation of the lighting) when the vehicle is stationary, or that use is only detected while driving if the terminal 2 is held in the area 7 described below, which is shown in . Fig. 2 by dashed lines in Fig. 2 is indicated.

[0051] This area 7 is an excerpt from the surveillance data; in the case of (IR) image data, this can simply be a two-dimensional area that has been determined to be suitable for recognizing content displayed on a terminal device. In the vehicle interior, this can correspond to an area near camera 3 (monitoring device) (or camera 4 (image capture device), see below). The arrangement in the base 5 of the interior mirror 6 at the top center of the vehicle interior 1 is also easily accessible for a user to position a terminal device 2 for recognition in area 7 in a suitable manner. It is understood that the Fig. The area 7 indicated in Figure 2 is merely exemplary. The position, size, and shape of area 7 can be adjusted according to desired requirements.

[0052] If the use of a terminal device 2 has been detected accordingly, a lighting device 11 in the interior 1 of the vehicle is activated (switched on) in a step S3. This can, for example, be a reading light in the roof lining, which is arranged near the interior mirror 6. If the mobile terminal device 2 is used as in Fig. 2 is held in the area 7 in front of the interior mirror 6 (and thus in front of the cameras 3 and 4), the terminal device 2 is thus illuminated from a short distance essentially from the front above, i.e. in particular on the front side with the display 21, on which a brightness sensor 23 is usually also arranged in order to detect the intensity of the ambient lighting for an automatic adjustment of the display brightness.

[0053] Switching on the lighting device 11 thus automatically increases the display brightness of the majority of commercially available mobile devices, such as smartphones, since this brightness is generally automatically adjusted to the ambient lighting. For this reason (and because the surroundings are illuminated overall), content 22 displayed on the display 21 of the device 2 can be better recognized. In particular, the image capture device 4 can capture image data with less noise than would be possible in poor lighting conditions and with a dimmed display. It is understood that the lighting device 11 can be activated for a specific period of time, e.g., 30 seconds, and then automatically switch off.The lighting device 11 can also be switched off when the user 10 stops using the terminal 2, i.e., when no more interaction between the user 10 and the terminal 2 is detected, or when the terminal 2 leaves the area 7. It can also be provided that the lighting device 11 is not activated when the ambient lighting is sufficiently strong (e.g., during the day in sunshine).

[0054] The following steps of method 100 are advantageously only executed when terminal device 2 enters area 7. On the one hand, this allows the method to be executed more reliably, since not all surveillance data is evaluated, even if, for example, terminal device 2 is not in the field of view of camera 3 (or camera 4, see below). Before image data is captured for evaluation in step S4, it can be checked beforehand whether terminal device 2 is suitably positioned in front of camera 4.

[0055] For example, for reliable recognition of displayed content, the terminal device 2 must be held in an orientation that is neither too tilted nor too twisted. Furthermore, the terminal device 2 must not be obscured, for example, by the hand of the user 10, which may be an indication that the display 21 of the terminal device 2 is not in the field of vision or at least that large parts of the display 21 are obscured by fingers or parts of the hand of the user 10. Furthermore, excessively rapid movement of the terminal device 2 may result in the content 22 not being recognized. On the one hand, recognition of content 22 works more reliably if the terminal device 2 is not moved too much. On the other hand, rapid movement of the terminal device 2 in area 7 may be an indication that it has inadvertently entered area 7.

[0056] The image capture device 4 can, in particular, be a camera 4 that captures image data in the visible light range and can therefore be referred to as an RGB camera. While an IR camera or TOF camera as a monitoring device 3 delivers a suitable image under very different lighting conditions, the monitoring data 3 then does not contain any (RGB) colors. However, these are necessary for recognizing content 22 displayed (in the visible light range) on a terminal device 2, such as on a display 21 of a smartphone (see FIG. Fig. 3) is necessary. In an IR image, a terminal device 2, such as a smartphone, can only be recognized as a (usually) essentially rectangular object, on which, at best, the display 21 is distinguishable as a rectangular monochrome surface.

[0057] While in Fig.2 the monitoring device 3 and the image capture device 4 are shown as separate units, they can also be combined in one unit, which in particular can be an RGB-IR camera, ie a camera which delivers image data in both the RGB and IR ranges.

[0058] The image capture device 4 can, in particular, also be arranged in the base 5 of the interior mirror 6. Therefore, the viewing areas of the monitoring device 3 and the image capture device 4 can be assumed to be largely congruent, at least in area 7 (or even substantially congruent if the monitoring device 3 and the image capture device 4 are formed as a single unit). Therefore, image data located in area 7 are captured, in particular.

[0059] The image data is now evaluated using image analysis. First, content 22 displayed on the terminal device 2 is recognized (step S5). In particular, known methods for optical character recognition (OCR) can be used for this purpose if the content is text, or for reading machine-readable codes, for example if the content is a code such as a QR code. The recognized content can then be assigned to a vehicle function in a step S6, for example using known parsing or classification methods. For example, a recognized address can be assigned to the vehicle function "navigation system," a recognized piece of music can be assigned to the vehicle function "music player," etc. For this purpose, other optical features such as formatting, color, etc., for example to call up a specific streaming provider, or even data from a code can be used for the assignment.

[0060] In a step S7, the correspondingly assigned vehicle function is then controlled depending on the recognized content. Controlling a vehicle function can in particular comprise calling or starting a vehicle function assigned to a recognized content, in particular depending on the recognized content, i.e. the vehicle function is configured with the recognized content. For example, if the content 22 is an address, the vehicle function 9 "navigation system" can be called directly with the address as the set destination address, thus eliminating the need to manually enter the address in the navigation system in the vehicle. If the recognized piece of music is a song, a streaming provider with the recognized piece of music can be called directly, etc.

[0061] However, controlling a vehicle function can also simply comprise displaying data associated with recognized content, for example on a screen 8 of the vehicle, in particular a display of the infotainment system. Then, if necessary, provision can be made to offer a query for confirmation by the user, for example, whether the recognized content is correct and / or whether a function associated with the recognized content should be executed. For example: "The following address was recognized. Should route guidance be started?", "The following piece of music was recognized. Should it be played?", etc.

[0062] While at least one exemplary embodiment has been described above, it should be appreciated that a wide variety of variations exist. It should also be understood that the described exemplary embodiments are merely non-limiting examples and are not intended to limit the scope, applicability, or configuration of the devices and methods described herein. Rather, the foregoing description will provide a guide to implementing at least one exemplary embodiment, with the understanding that various changes in the operation and arrangement of the elements described in an exemplary embodiment may be made without departing from the subject matter as defined in the appended claims, as well as their legal equivalents. LIST OF REFERENCE SYMBOLS 100 Methods for detecting a mobile device in a vehicle 1 vehicle interior 2 end device (smartphone) 3 Monitoring device (IR camera) 4 Image capture device (RGB camera) 5 Interior mirror base 6 interior mirrors 7 Area 8-display infotainment system 9 Vehicle function 10 users (drivers) 11 Lighting equipment 21 Display device (smartphone) 22 displayed content 23 Brightness sensor

Claims

[1] Method (100) for detecting a mobile terminal (2) in a vehicle, the method comprising: - Acquiring monitoring data for at least part of the interior (1) of the vehicle by means of at least one monitoring device (3); - determining whether a mobile terminal (2) is currently being used by a user (10) in the part of the interior (1) of the vehicle for which the monitoring data is recorded; and - if the determination is positive, activating a lighting device (11) in the interior (1) of the vehicle. [2] Method according to claim 1, further comprising determining whether the mobile terminal (2) in use is at least partially located in a predetermined area (7) of the part of the interior (1) which lies in a detection range of an image capture device (4). [3] Method according to claim 2, wherein the lighting device (11) is only activated when it is determined that the mobile terminal (2) in use is at least partially located in the predetermined area (7) of the part of the interior (1). [4] Method according to claim 2 or 3, wherein the lighting device (11) is activated during travel only when it is determined that the mobile terminal (2) in use is at least partially located in the predetermined area (7) of the part of the interior (1). [5] Method according to one of the preceding claims, further comprising determining a seating position of the user (10) who is currently using the mobile terminal (2), wherein, if the seating position is determined to be the driver's position, the lighting device (11) is only activated when the vehicle is stationary. [6] Method according to one of the preceding claims, wherein the lighting device (11) is located in an upper region of the interior (1) of the vehicle and / or wherein the lighting device (11) is located in a region of the interior (1) of the vehicle which surrounds an image capture device (4). [7] Method according to one of the preceding claims, further comprising determining an illuminance in the interior (1) of the vehicle, wherein the lighting device (11) is activated only when the determined illuminance (11) is below a predetermined threshold value. [8] A method according to any one of the preceding claims, further comprising: - capturing image data by means of the image capturing device (4), wherein the image data contain at least one view of a mobile terminal (2); - Recognizing content on the mobile device (2) by evaluating the image data; - Assigning the detected content to a function (9) of the vehicle; and - Controlling the function (9) of the vehicle depending on the detected content (22). [9] A data processing system comprising at least one processor configured to carry out the method according to any one of the preceding claims. [10] A computer program comprising instructions which, when executed on a system according to claim 9, cause the system to carry out the method according to any one of claims 1 to 8.

Images