Method for operating a vehicle, computer-readable medium, system, and vehicle

Abstract

The invention relates to a method for operating a vehicle, the method comprising: detecting the use of a mobile device on the wrist of a driver by the vehicle; and adapting a vehicle function depending on the detected use of the mobile device on the wrist of the driver of the vehicle by the vehicle.

Description

[0001] The invention relates to a method for operating a vehicle. The invention further relates to a computer-readable medium for operating a vehicle, a system for operating a vehicle, and a vehicle comprising the system for operating the vehicle.

[0002] Various methods for detecting driver distraction caused by smartphone use in a vehicle are known in the prior art. It is also known to detect smartphone use inside a vehicle. For example, smartphone use can be detected using a 3D body pose model. However, methods for detecting smartwatch use inside a vehicle are not known in the prior art.

[0003] It is therefore an object of the invention to operate a vehicle more efficiently. In particular, an object of the invention is to detect driver distraction more efficiently.

[0004] This problem is solved by the features of the independent claims. Advantageous embodiments and further developments of the invention result from the dependent claims.

[0005] According to a first aspect, the invention is characterized by a method for operating a vehicle. The method can be a computer-implemented method and / or a control unit-implemented method. The vehicle can be a motor vehicle. The method comprises detecting the use of a mobile device on the driver's wrist by the vehicle, wherein the detection of the use of the mobile device on the driver's wrist by the vehicle includes recognizing the use of the detected mobile device on the driver's wrist based on an image of an activated display of the detected mobile device on the driver's wrist. Furthermore, the method comprises adapting a vehicle function based on the detected use of the mobile device on the driver's wrist by the vehicle.

[0006] Advantageously, the procedure can be operated more securely if the use of a mobile device on a wrist of the vehicle is detected.

[0007] According to an advantageous embodiment, the mobile device on the driver's wrist can be a smartwatch. Alternatively, the mobile device can be integrated into a piece of clothing and / or jewelry, which the driver wears on their wrist. This allows the vehicle to be operated more efficiently when a smartwatch is used.

[0008] According to a further advantageous embodiment, the vehicle's detection of the use of a mobile device on the driver's wrist can include capturing the driver's gaze direction and / or duration towards the mobile device on the driver's wrist using an interior camera system, and the vehicle's detection of the use of the mobile device on the driver's wrist depending on the driver's gaze direction and / or duration. This allows for efficient detection of the use of a mobile device on the driver's wrist.

[0009] According to a further advantageous embodiment, the vehicle's detection of the driver's use of a mobile device on their wrist can include capturing the driver's interior camera system and / or microphone with a voice and / or touch gesture-based interaction, and detecting the use of the mobile device on the driver's wrist based on the driver's voice and / or gesture-based interaction. This allows for efficient detection of the driver's use of a mobile device on their wrist.

[0010] According to a further advantageous embodiment, the vehicle's detection of the driver's use of a mobile device on their wrist can include displaying a message on a screen inside the vehicle, capturing the driver's gaze on the mobile device on their wrist by the vehicle's interior camera system while the message is being displayed, and detecting the use of the mobile device on the driver's wrist based on the driver's gaze on the mobile device on their wrist while the message is being displayed. This allows for efficient detection of the driver's use of a mobile device on their wrist.

[0011] According to a further advantageous embodiment, the vehicle's detection of the driver's use of a mobile device on their wrist can comprise the vehicle's detection of a communication activity for sending a message to the mobile device on the driver's wrist via a wireless communication interface between the vehicle and the mobile device on the driver's wrist, and the vehicle's detection of the use of the mobile device on the driver's wrist in relation to this communication activity for sending a message to the mobile device on the driver's wrist via the wireless communication interface between the vehicle and the mobile device on the driver's wrist. This allows for efficient detection of the driver's use of a mobile device on their wrist.

[0012] According to a further advantageous embodiment, the vehicle's detection of mobile device use on the driver's wrist can comprise the detection of a vibration and / or vibration pattern of the mobile device on the driver's wrist by a microphone in the vehicle's interior, and the detection of mobile device use on the driver's wrist based on the detected vibration and / or vibration pattern. This allows for efficient detection of mobile device use on the driver's wrist.

[0013] According to a further advantageous embodiment, the vehicle's detection of the use of the mobile device on the driver's wrist can include capturing the mobile device on the driver's wrist with an infrared camera of the interior camera system, wherein the infrared camera captures the mobile device on the wrist using technical data of the mobile device, in particular computer-aided design data of the mobile device. Furthermore, the vehicle's detection of the use of the mobile device on the driver's wrist can include detecting the use of the captured mobile device on the driver's wrist based on an image of an activated display of the captured mobile device on the driver's wrist, wherein the image of the activated display of the captured mobile device on the driver's wrist is captured with an RGB camera of the interior camera system.This allows the use of a mobile device on the driver's wrist to be efficiently detected.

[0014] According to a further advantageous embodiment, adapting the vehicle function based on the detected use of the mobile device on the driver's wrist can include adjusting a warning threshold and / or an intervention threshold of the vehicle function depending on the detected use of the mobile device, wherein, in particular, a warning threshold for the use of a watch is adjusted if the use of a smartwatch is detected. This allows the vehicle function to be adapted efficiently, thus enabling safer vehicle operation.

[0015] According to a further advantageous embodiment, adapting the vehicle function based on the detected use of the mobile device on the driver's wrist can further include providing a message to the mobile device on the driver's wrist via a display within the driver's field of vision, wherein the display within the driver's field of vision is preferably determined by the vehicle's interior camera system. This allows the vehicle function to be adapted efficiently, thus enabling safer vehicle operation.

[0016] According to another aspect, the invention is characterized by a computer-readable medium for operating a vehicle, wherein the computer-readable medium comprises instructions which, when executed on a computer and / or a control unit of the vehicle, execute the method described above.

[0017] According to another aspect, the invention is characterized by a system for operating a vehicle, wherein the system is configured to perform the method described above.

[0018] According to another aspect, the invention is characterized by a vehicle comprising the system described above for operating the vehicle.

[0019] Further features of the invention will become apparent from the claims, the figures, and the description of the figures. All features and combinations of features mentioned above in the description, as well as those subsequently mentioned in the description of the figures and / or shown in the figures alone, are usable not only in the combinations specified, but also in other combinations or individually.

[0020] The following describes a preferred embodiment of the invention with reference to the accompanying drawings. Further details, preferred configurations, and further developments of the invention will be derived from these drawings. Specifically, the drawings schematically illustrate... Fig. 1 an exemplary procedure for operating a vehicle, and Fig. 2 an exemplary system for operating a vehicle.

[0021] In detail, it shows Fig. 1. An exemplary method 100 for operating a vehicle. Method 100 can detect the use of a mobile device on the wrist of a driver of a vehicle by the vehicle 102. The mobile device on the driver's wrist can be a smartwatch. The use of the smartwatch can include reading information on a display of the smartwatch, performing a touch gesture on a touch-sensitive display of the smartwatch, pressing and / or touching a control element of the smartwatch, and / or voice-based interaction with a microphone of the smartwatch.

[0022] The use of a mobile device on the driver's wrist, particularly a smartwatch, can be detected using one or more of the following methods. For example, the smartwatch can be detected using image recognition from an interior camera system. This involves comparing an image of the smartwatch with a smartwatch image database to identify the smartwatch on the driver's wrist. The smartwatch image database can be stored on the vehicle and / or on an external server.

[0023] Additionally or alternatively, smartwatch use can be detected by measuring the driver's gaze duration. The vehicle's interior camera system can determine this duration, focusing on the smartwatch and / or the driver's wrist. If the detected gaze duration exceeds a predefined threshold, the vehicle can recognize smartwatch use. This predefined threshold could, for example, be a typical duration of gaze at a conventional watch.

[0024] Additionally or alternatively, smartwatch usage can be detected based on one or more interactions with the smartwatch. An interaction with a smartwatch could be, for example, scrolling, swiping, or sliding on the smartwatch's touchscreen. Additionally or alternatively, smartwatch usage can be detected by the vehicle's interior camera system when an activation movement causes the smartwatch's display to brighten. Additionally or alternatively, smartwatch usage can be detected based on one or more voice interactions with the smartwatch's microphone. Additionally or alternatively, smartwatch usage can be detected based on the driver's reaction to a message displayed on the vehicle's screen. For example, the message could be displayed on a central screen for a predetermined period.In response to the displayed message, the system can detect if the driver glances at the smartwatch during the same predefined time period using the vehicle's interior camera system. If the interior camera system detects the driver glancing at the smartwatch during this same predefined time period, the system can recognize the smartwatch's use.

[0025] Additionally or alternatively, the vehicle can determine smartwatch usage by analyzing Bluetooth communication messages between the smartwatch and the vehicle. If the message analysis shows a predefined minimum frequency of messages exchanged between the smartwatch and the vehicle, this can be considered representative of smartwatch usage. Additionally or alternatively, smartwatch usage can be detected by the vehicle's microphone via a vibration signal from the smartwatch upon receiving a message.

[0026] Method 100 can adapt a vehicle function based on the vehicle's detected use of the mobile device on the driver's wrist. Using a smartwatch can lead to a higher cognitive load compared to wearing a conventional watch. This increased cognitive load can result in reduced attention and / or distraction for the driver. Therefore, Method 100 can adapt the vehicle function to account for the driver's reduced attention and / or distraction when using a smartwatch. Furthermore, the vehicle function can display a message from the smartwatch on a vehicle display, making the message easier for the driver to read with less distraction.

[0027] In detail, it shows Fig. 2 an exemplary system 200 for operating a vehicle 202. The system 200 can do the above in Fig. The described procedure 100 is executed. The system 200 can include an interior camera system 204. The interior camera system 204 can detect a mobile device 206 on the wrist of a driver 208 of the vehicle. Furthermore, the interior camera system 204 can, for example, detect the use of the mobile device 206 based on an interaction of the driver 208 with the mobile device 206. If the interior camera system 204 detects the use of the mobile device 206, the interior camera system 204 can adjust a vehicle function 210.

[0028] Advantageously, the method and the system can operate the vehicle more efficiently. Driver distraction can be efficiently detected when a mobile device is worn on the driver's wrist, and the vehicle's functions can be adjusted accordingly. The vehicle can be operated more safely with reduced driver distraction. Reference symbol list 100 procedures 102 Detecting the use of a mobile device on a driver's wrist 104 Adjusting a vehicle function 200 System 202 vehicles 204 Interior camera system 206 Smartwatch 208 drivers

Claims

[1] Method of operating a vehicle, comprising: Detecting the use of a mobile device on a driver's wrist by the vehicle, wherein the detection of the use of the mobile device on the driver's wrist by the vehicle includes: Detecting the use of the detected mobile device on the driver's wrist based on an image of an activated display of the detected mobile device on the driver's wrist; and Adapting a vehicle function based on the vehicle's detected use of the mobile device on the driver's wrist. [2] Method according to claim 1, wherein the mobile device on the wrist of the driver of the vehicle is a smartwatch. [3] Method according to any of the preceding claims, wherein the vehicle comprises detecting the use of the mobile device on the driver's wrist: Capturing the direction and / or duration of the driver's gaze towards the mobile device on the driver's wrist by an interior camera system of the vehicle; and Detecting the use of the mobile device on the driver's wrist by the vehicle, depending on the direction and / or duration of the driver's gaze towards the mobile device on the driver's wrist. [4] Method according to any of the preceding claims, wherein the vehicle comprises detecting the use of the mobile device on the driver's wrist: Capturing speech- and / or gesture-based interaction between the vehicle's driver and the mobile device on the driver's wrist using the vehicle's interior camera system and / or a vehicle microphone; and Detecting the use of the mobile device on the driver's wrist based on the driver's voice and / or gesture-based interaction with the mobile device on the driver's wrist by the vehicle. [5] Method according to any of the preceding claims, wherein the vehicle comprises detecting the use of the mobile device on the driver's wrist: Providing a message on a display inside the vehicle; Capturing the driver's gaze at the mobile device on the driver's wrist while the message is being displayed on the vehicle's interior screen by the vehicle's interior camera system; and Detecting the use of the mobile device on the driver's wrist depending on the driver's gaze at the mobile device on the vehicle's wrist while the vehicle is providing the message on the display in the vehicle's interior. [6] Method according to any of the preceding claims, wherein the vehicle comprises detecting the use of the mobile device on the driver's wrist: Capturing a communication activity to deliver a message to the mobile device on the driver's wrist via a wireless communication interface between the vehicle and the mobile device on the driver's wrist; and Detecting the use of the mobile device on the driver's wrist based on communication activity in order to provide a message to the mobile device on the driver's wrist via the wireless communication interface between the vehicle and the mobile device on the driver's wrist. [7] Method according to any of the preceding claims, wherein the vehicle comprises detecting the use of the mobile device on the driver's wrist: Detecting a vibration and / or vibration pattern of the mobile device on the driver's wrist by a microphone inside the vehicle; and Detecting the use of the mobile device on the driver's wrist based on the detected vibration and / or vibration pattern of the mobile device on the driver's wrist. [8] Method according to any of the preceding claims, wherein the vehicle comprises detecting the use of the mobile device on the driver's wrist: Capturing the mobile device on the driver's wrist with an infrared camera of the interior camera system, wherein the infrared camera detects the mobile device on the wrist using technical data of the mobile device, in particular computer-aided design data of the mobile device; and the image of the activated display of the detected mobile device on the driver's wrist is captured with an RGB camera of the interior camera system. [9] Method according to any of the preceding claims, wherein the vehicle function is adapted depending on the detected use of the mobile device on the driver's wrist by the vehicle: Adjusting a warning threshold and / or an intervention threshold of the vehicle function depending on the detected use of the mobile device, In particular, a warning threshold for the use of a watch is adjusted to the vehicle function if the use of a smartwatch is detected. [10] Method according to any of the preceding claims, wherein the vehicle further comprises adapting the vehicle function depending on the detected use of the mobile device on the driver's wrist by the vehicle: Providing a message to the mobile device on the driver's wrist on a display within the driver's field of vision, wherein the display in the driver's field of vision is preferably determined by the vehicle's interior camera system. [11] Computer-readable medium for operating a vehicle, wherein the computer-readable medium comprises instructions which, when executed on a computer and / or a control unit of the vehicle, execute the method according to any one of claims 1 to 10. [12] System for operating a vehicle, wherein the system is configured to perform the method according to any one of claims 1 to 10. [13] Vehicle comprising the system for operating the vehicle according to claim 12.

Images