Method for operating an occupant monitoring system of a vehicle during a trip with the vehicle, computer-readable medium, system, and vehicle

Abstract

The invention relates to a method for operating an occupant monitoring system of a vehicle while driving the vehicle, the method comprising: providing information on a display of the vehicle; detecting a mobile terminal in a hand of one or more occupants of the vehicle while driving the vehicle by the occupant monitoring system of the vehicle; and adapting the information provided on the display of the vehicle while driving the vehicle depending on the one or more occupants in whose hand the mobile terminal is detected while driving.

Description

[0001] The invention relates to a system for operating an occupant monitoring system of a vehicle while driving the vehicle. The invention further relates to a computer-readable medium for operating an occupant monitoring system of a vehicle while driving the vehicle, a system for operating an occupant monitoring system of a vehicle while driving the vehicle, and a vehicle comprising the system for operating an occupant monitoring system of a vehicle while driving the vehicle.

[0002] Vehicles are known from the state of the art that display a quick response code on a vehicle display. For safety reasons, a quick response code is displayed when the vehicle is parked and not while the vehicle is moving. This means that other passengers in the vehicle also do not see a quick response code while the vehicle is moving.

[0003] DE 10 2019 133 559 A1 describes a method comprising the steps of determining a driver of a motor vehicle, determining a mobile device on board the motor vehicle, and determining whether the driver is using the mobile device.

[0004] DE 10 2018 106 380 A1 describes a method for establishing a data connection using an agricultural machine, in particular a harvesting machine. It is proposed that the agricultural machine provide an optical pattern with information, that a mobile, internet-enabled data transmission device detects the optical pattern, and, based on the information in the optical pattern, establishes a data connection for transmitting data.

[0005] It is therefore an object of the invention to operate an occupant monitoring system more efficiently. In particular, an object of the invention is to more efficiently control the provision of information on a vehicle display by an occupant monitoring system of the vehicle.

[0006] This object is achieved by the features of the independent claims. Advantageous embodiments and further developments of the invention emerge from the dependent claims.

[0007] According to a first aspect, the invention is characterized by a method for operating an occupant monitoring system of a vehicle while driving the vehicle. The method can be a computer-implemented method and / or a control unit-implemented method. The method comprises providing information on a display of the vehicle. The display of the vehicle can be a touch-sensitive display or a projection-based display of the vehicle. The vehicle can be a motor vehicle.

[0008] The method comprises detecting a mobile terminal in a hand of one or more occupants of the vehicle while driving the vehicle by the occupant monitoring system of the vehicle, and adapting the information provided on the display of the vehicle while driving the vehicle depending on the one or more occupants in whose hand the mobile terminal is detected while driving.

[0009] Advantageously, the vehicle's occupant monitoring system can more efficiently control the information on the vehicle's display while driving. Depending on the occupant's hand, in which a mobile device is detected by the occupant monitoring system, the method can adapt the information on the vehicle's display. The information can thus be provided to a large number of vehicle occupants while driving and does not have to be blocked for all vehicle occupants. The availability of the information can be efficiently increased while driving, while simultaneously ensuring road safety.

[0010] According to an advantageous embodiment, the information on the vehicle display can be a quick response code for coupling a passenger's mobile device with the vehicle. This allows a quick response code to be efficiently adapted depending on the mobile devices in the hands of one or more passengers of the vehicle.

[0011] According to a further advantageous embodiment, an occupant of the vehicle can be a driver, a front passenger, or a rear passenger. This allows for flexible adaptation to different occupants and / or combinations of occupants of the vehicle.

[0012] According to a further advantageous embodiment, the information can be provided on the display when a front passenger or a rear passenger of the vehicle enters the vehicle. This allows the information to be efficiently provided to a vehicle occupant.

[0013] According to a further advantageous embodiment, the information can be passenger-specific information and / or rear-seat passenger-specific information, and / or the passenger-specific information can include a quick response code for coupling a mobile device of the vehicle's front passenger while driving the vehicle, and / or the rear-seat passenger-specific information can include a quick response code for coupling a mobile device of the vehicle's rear passenger while driving the vehicle. This allows a quick response code to be efficiently provided for various vehicle occupants.

[0014] According to a further advantageous embodiment, the passenger-specific information can include an indication regarding the release of the quick response code for pairing the mobile device of the front passenger of the vehicle while driving with the vehicle, and / or the rear passenger-specific information can include an indication regarding the release of the quick response code for pairing the mobile device of the rear passenger of the vehicle. This allows a quick response code to be efficiently provided for various vehicle occupants.

[0015] According to a further advantageous embodiment, the method may further comprise determining a seat location for each occupant in whose hand a mobile device was detected, and adapting the information provided on the vehicle display during the vehicle journey depending on the determined seat location of the one or more occupants in whose hand the mobile device was detected during the journey. This allows the information to be provided based on the seat location.

[0016] According to a further advantageous embodiment, adapting the information provided on the vehicle display while driving the vehicle depending on the one or more passengers in whose hand the mobile device is detected during the journey can comprise: adapting the quick response code for pairing the mobile device of the vehicle's front passenger while driving the vehicle, as long as the mobile device is detected in the hand of the vehicle driver while driving, if the information provided is passenger-specific information with the quick response code for pairing the mobile device of the vehicle's front passenger while driving the vehicle and a mobile device is detected in the hand of the vehicle driver while driving. Adapting the quick response code can preferably comprise obscuring and / or hiding the quick response code.Furthermore, adapting the information provided on the vehicle display while driving the vehicle depending on the one or more occupants in whose hand the mobile device is detected while driving can include: adapting the quick response code for pairing the mobile device of the front passenger of the vehicle while driving the vehicle, as long as the mobile device is detected in the hand of the driver of the vehicle while driving, if the information provided is rear-seat passenger-specific information with the quick response code for pairing the mobile device of the rear passenger of the vehicle while driving the vehicle and a mobile device was detected in the hand of the driver of the vehicle while driving. Adapting the quick response code can preferably include obscuring and / or hiding the quick response code.This allows the quick response code to be provided efficiently while driving.

[0017] According to a further advantageous embodiment, adapting the information provided on the display of the vehicle while driving the vehicle depending on the one or more occupants in whose hand the mobile terminal is detected while driving can comprise: removing the reference to the release of the quick response code for pairing the mobile terminal of the front passenger of the vehicle while driving the vehicle, and providing a quick response code for pairing the mobile terminal of the front passenger of the vehicle on the display of the vehicle while driving the vehicle, if the information provided is passenger-specific information with the reference to the release of the quick response code for pairing the mobile terminal of the front passenger of the vehicle while driving the vehicle and no mobile terminal is detected in the hand of the driver of the vehicle while driving.Furthermore, adapting the information provided on the vehicle display while driving the vehicle depending on the one or more occupants in whose hand the mobile device is detected while driving can include: removing the reference to the release of the quick response code for pairing the mobile device of the rear occupant of the vehicle while driving the vehicle, and providing a quick response code for pairing the mobile device of the rear occupant of the vehicle on the vehicle display while driving the vehicle, if the information provided is rear occupant-specific information with the reference to the release of the quick response code for pairing the mobile device of the rear occupant of the vehicle and no mobile device is detected in the hand of the driver of the vehicle while driving.This allows the quick response code to be provided with reduced distraction and / or improved safety while driving.

[0018] According to a further aspect, the invention is characterized by a computer-readable medium for operating an occupant monitoring system of a vehicle while driving the vehicle, wherein the computer-readable medium comprises instructions which, when executed on a computer and / or a control unit, carry out the method described above.

[0019] According to a further aspect, the invention is characterized by a system for operating an occupant monitoring system of a vehicle while driving the vehicle, wherein the system is designed to carry out the method described above.

[0020] According to a further aspect, the invention is characterized by a vehicle comprising the above-described system for operating an occupant monitoring system of the vehicle during a journey with the vehicle.

[0021] Further features of the invention emerge from the claims, the figures, and the description of the figures. All features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the description of the figures and / or shown alone in the figures, can be used not only in the respective specified combination, but also in other combinations or even on their own.

[0022] A preferred embodiment of the invention is described below with reference to the accompanying drawings. Further details, preferred embodiments, and developments of the invention will emerge from these. In detail, schematically Fig. 1 shows an exemplary method for operating an occupant monitoring system of a vehicle while driving the vehicle, Fig. 2 shows a first exemplary scenario for operating an occupant monitoring system of a vehicle while driving the vehicle, and Fig. 3 a second exemplary scenario for operating an occupant monitoring system of a vehicle while driving the vehicle.

[0023] In detail, Fig. 1 shows an exemplary method 100 for operating an occupant monitoring system of a vehicle while driving the vehicle. The occupant monitoring system may be a camera-based occupant monitoring system of the vehicle. A camera of the occupant monitoring system may be integrated into a rearview mirror of the vehicle. The camera may include an RGB and / or an IR sensor.

[0024] The method 100 can provide information on a display of the vehicle 102. The information can be provided automatically on the vehicle display when a passenger enters the vehicle. The information can be a quick response code. By optically capturing the quick response code with a camera of a mobile device, the mobile device can be coupled to the vehicle.

[0025] The method can further detect 104 a mobile device in a hand of one or more occupants of the vehicle while the vehicle is traveling by the occupant monitoring system of the vehicle. The mobile device can be a smartphone, a tablet computer, or another mobile device that can be paired with the vehicle. The occupant monitoring system can determine which occupant the hand in which the mobile device is detected belongs to. Furthermore, the occupant monitoring system of the vehicle can detect multiple mobile devices in the hands of the occupants of the vehicle and assign each of the detected mobile devices in the hands of the occupants of the vehicle to an occupant of the vehicle.

[0026] The method 100 can further adapt 106 the information provided on the vehicle display while the vehicle is traveling depending on the one or more occupants in whose hand the mobile device is detected during the trip. If the information provided is a quick response code, the quick response code can be adapted depending on the occupant or occupants with a mobile device in their hand. For example, the quick response code can be provided on the display in an unrecognizable, for example blurred, manner if the occupant with the detected mobile device in their hand is a driver of the vehicle or if one of the occupants with the detected mobile devices is a driver of the vehicle.If no mobile device is detected in the driver's hand, the quick response code is visible on the display for all other occupants with a detected mobile device in their hand and can be visually read using the respective mobile device of the other occupants of the vehicle.

[0027] In addition, the method can determine a status of a driver assistance system of the vehicle and adapt the information provided on the vehicle display while the vehicle is driving depending on the one or more occupants in whose hand the mobile device is detected during the drive and the determined status of the driver assistance system 106. If the status of the driver assistance system is representative of an activated Level 3, Level 4, or Level 5 driver assistance system, the quick response code can, for example, be provided on the display when the mobile device is detected in the driver's hand. If the status of the driver assistance system is representative of an activated Level 1 or Level 2 driver assistance system, the quick response code can, for example, be provided on the display in an unrecognizable manner when the mobile device is detected in the driver's hand.

[0028] In detail, Fig. 2 shows a first exemplary scenario 200 for operating an occupant monitoring system 202 of a vehicle 204 during a journey with the vehicle 204. A driver 206 of the vehicle 204 may be carrying a passenger 208. The passenger 208 gets into the vehicle 204. The vehicle 204 may provide the passenger 208 with information on a display 210, for example, a quick response code 212, or QR code for short. The QR code 212 may be scanned by a mobile device 216 to couple the mobile device 216 to the vehicle 204. The occupant monitoring system 202 detects the mobile device 216 in a hand 214 of the passenger 208. The occupant monitoring system 202 detects no object in a hand 218 of the driver 216. The passenger 208 can use the mobile device 216 to capture the QR code 212 and pair the mobile device 216 with the vehicle 204.

[0029] While driving the vehicle 204, the occupant monitoring system 202 detects a mobile device 220 in the hand 218 of the driver 206. A customized QR code 222 is displayed on the display 210. The QR code 222 cannot be captured by any of the detected mobile devices 216, 222 in order to pair the mobile devices 216, 222 with the vehicle 204. In the scenario, the QR code 212 is displayed as a customized QR code 222 until the occupant monitoring system 202 no longer detects the mobile device 220 in the hand 218 of the driver 206.

[0030] In detail, Fig. 3 shows a second exemplary scenario 300 for operating an occupant monitoring system of a vehicle during a journey with the vehicle. The driver 206 of the vehicle 204 can take the passenger 208 with him. The passenger 208 gets into the vehicle 204. The vehicle 204 can provide the passenger 208 with information on the display 210, for example, the customized quick response code 222. The customized QR code 222 cannot be read by the mobile device 216. No object, in particular no mobile device, is detected by the occupant monitoring system 202 in the hand 218 of the driver 206 or in the hand 214 of the passenger 208.

[0031] The occupant monitoring system 202 detects the mobile device 216 in the hand 214 of the passenger 208. The occupant monitoring system 202 detects no object in the hand 218 of the driver 216. The adapted QR code 222 is adapted on the display 210 to provide the QR code 212 on the display. The QR code 212 can be captured by the mobile device 216 of the passenger 208 to pair the mobile device 216 with the vehicle. If the occupant monitoring system 202 detects the mobile device 222 in the hand 218 of the driver 206, the QR code is scanned as described above. Fig. 2 described.

[0032] Advantageously, the method can adapt information, for example a QR code, if a mobile device is detected in one of the vehicle driver's hands while the vehicle is moving. This can efficiently reduce driver distraction by visually capturing the information, for example the QR code. As soon as the vehicle driver is not holding a mobile device in their hand, the other vehicle occupants have the option of visually capturing the information, for example the QR code, using their respective mobile devices while the vehicle is moving. The convenience of using information while driving, for example when using QR codes while driving, can thus be efficiently increased. List of reference symbols 100 procedures 102 Providing information 104 Detecting a mobile device 106 Customizing the information provided 200 first scenario 202 Occupant Monitoring System 204 vehicles 206 drivers 208 passengers 210 ad 212 QR code 214 Hand 216 mobile devices 218 Hand 220 mobile devices 222 customized QR code 300 second scenario

Claims

[1] A method (100) for operating an occupant monitoring system (202) of a vehicle (204) while driving the vehicle (204), the method (100) comprising: Providing (102) information on a display (210) of the vehicle (204); Detecting (104) a mobile terminal (216, 220) in a hand of one or more occupants of the vehicle (204) while driving the vehicle by the occupant monitoring system (202) of the vehicle (204); and Adapting (106) the information provided on the display (210) of the vehicle (204) while driving the vehicle (204) depending on the one or more occupants in whose hand the mobile terminal (216, 220) is detected during the journey. [2] The method (100) of claim 1, wherein the information on the display (210) of the vehicle (204) is a quick response code (212) for coupling a mobile terminal (216, 220) of an occupant to the vehicle (204). [3] Method (100) according to one of the preceding claims, wherein an occupant of the vehicle is a driver (206), a passenger (208), or a rear passenger of the vehicle (204). [4] The method (100) of any preceding claim, wherein the information is provided on the display (210) when a front passenger (208) or a rear passenger of the vehicle (204) enters the vehicle (204). [5] Method (100) according to one of the preceding claims, wherein the information is passenger-specific information and / or rear passenger-specific information; and / or wherein the passenger-specific information comprises a quick response code (212) for coupling a mobile terminal (216) of the passenger (208) of the vehicle (204) while driving the vehicle (204); and / or wherein the rear passenger-specific information comprises a quick response code (212) for coupling a mobile terminal of the rear passenger of the vehicle (204) while driving the vehicle (204). [6] The method (100) according to claim 5, wherein the passenger-specific information comprises an indication of an enablement of the quick response code (212) for coupling the mobile terminal (216) of the front passenger (208) of the vehicle (204) while driving with the vehicle (204); and / or wherein the rear passenger-specific information comprises an indication of an enablement of the quick response code (212) for coupling the mobile terminal of the rear passenger of the vehicle (204) while driving with the vehicle (204). [7] Method (100) according to one of the preceding claims, the method (100) further comprising: Determining a seat location for each occupant in whose hand a mobile terminal (216, 220) was detected; and Adapting the information provided on the display (210) of the vehicle (204) while driving the vehicle (204) depending on the determined seat position of the one or more occupants in whose hand the mobile terminal (216, 220) is detected during the journey. [8] Method (100) according to one of the preceding claims, wherein the adaptation (106) of the information provided on the display (210) of the vehicle (204) while driving the vehicle (204) depending on the one or more occupants in whose hand the mobile terminal (216, 220) is detected during the journey comprises: If the information provided is passenger-specific information with a quick response code (212) for coupling the mobile terminal (216) of the passenger (208) of the vehicle (204) while driving with the vehicle (204) and a mobile terminal (220) is detected in the hand of the driver (206) of the vehicle while driving: Adapting the quick response code (212) for coupling the mobile terminal (216) of the passenger (208) of the vehicle (204) while driving with the vehicle (204), as long as the mobile terminal (220) is detected in the hand of the driver (206) of the vehicle (204) while driving, wherein adapting the quick response code (212) preferably comprises obscuring and / or hiding the quick response code; or If the information provided is rear passenger-specific information with a quick response code (212) for coupling the mobile terminal of a rear passenger of the vehicle (204) while driving with the vehicle (204) and a mobile terminal (220) was detected in the hand of the driver (206) of the vehicle (204) while driving: Adapting the quick response code (212) for coupling the mobile terminal of the rear passenger of the vehicle (204) while driving with the vehicle (204), as long as the mobile terminal (220) is detected in the hand of the driver (206) of the vehicle (204) while driving, wherein adapting the quick response code (212) preferably comprises obscuring and / or hiding the quick response code. [9] Method (100) according to one of the preceding claims, wherein the adaptation (106) of the information provided on the display (210) of the vehicle (204) while driving the vehicle (204) depending on the one or more occupants in whose hand the mobile terminal (216, 220) is detected during the journey comprises: If the information provided is passenger-specific information with the reference to the release of a quick response code (212) for coupling the mobile terminal (216) of the passenger (208) of the vehicle (204) while driving with the vehicle (204) and no mobile terminal (220) is detected in the hand of the driver (206) of the vehicle (204) while driving: Removing the reference to the release of the quick response code (212) for coupling the mobile terminal (216) of the passenger (208) of the vehicle (204) while driving the vehicle (204); and Providing a quick response code (212) for coupling the mobile terminal (216) of the passenger (208) of the vehicle (204) to the display (210) of the vehicle (204) while driving the vehicle (204); or If the information provided is rear passenger-specific information with the reference to the release of a quick response code (212) for coupling the mobile terminal of a rear passenger of the vehicle (204) while driving with the vehicle (204) and no mobile terminal (220) is detected in the hand of the driver (206) of the vehicle (204) while driving: Removing the reference to the release of the quick response code (212) for coupling the mobile terminal of the rear passenger of the vehicle (204) while driving the vehicle (204); and Providing a quick response code (212) for coupling the mobile terminal of the rear passenger of the vehicle (204) to the display (210) of the vehicle (204) while driving the vehicle (204). [10] A computer-readable medium for operating an occupant monitoring system of a vehicle during a journey with the vehicle, the computer-readable medium comprising instructions which, when executed on a computer and / or a control device, carry out the method according to any one of claims 1 to 9. [11] System for operating an occupant monitoring system (202) of a vehicle (204) during a journey with the vehicle, wherein the system is designed to carry out the method according to one of claims 1 to 9. [12] A vehicle (204) comprising the system for operating an occupant monitoring system (202) of the vehicle (204) during travel of the vehicle (204) according to claim 11.

Images