A method for operating an occupant state response system for a motor vehicle, a computer program product, a non-transitory computer-readable storage medium, a

Abstract

The invention relates to a method for operating an occupant state response system 12 for a motor vehicle 10, comprising the steps of: determining at least one current and / or future occupant state 16 o

Description

[0001] The invention relates to the field of automobiles. More specifically, the present invention relates to a method for operating an occupant state response system for a motor vehicle. Furthermore, the present invention relates to a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, and a corresponding response system. BACKGROUND INFORMATION

[0002] According to the state of the art, it is known that a state, such as of sleepiness or vexation, of a human may be determined by an electronic computing device combining sensor data, such as a camera recording of the human’s face, with environmental data, such as a current temperature of air external to a motor vehicle in which the human may, for example, be driving. According to the state of the art, it is furthermore known that suggestions intended to modify the state of the human may be generated, for example a suggestion to exercise or to change an eating habit. According to the state of the art, it is additionally known that at least one amenity of a motor vehicle may be customized, potentially according to at least one preset mode, by an occupant, for example to suit the aesthetic or comfort preferences of the at least one occupant. However, both the implementation of suggestions and the customization of motor vehicle amenities require a level of user initiative and engagement that is not conducive to road safety. Human states may fluctuate rapidly, and the conscious addressing of a human state, especially when the human is currently in an undesirable state such as of sleepiness or vexation, may SUMMARY OF THE INVENTION

[0003] It is an object of the present invention to provide a method, a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, and a corresponding response system, by which the reliance on human action by an occupant state response system of a motor vehicle is decreased.

[0004] The object is solved by a method, a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, and a corresponding response system, by which the reliance on human action by an occupant state response system of a motor vehicle is decreased.

[0005] One aspect of the invention relates to a method for operating an occupant state response system for a motor vehicle. At least one current and / or future occupant state of at least one current occupant of the motor vehicle is determined based on at least one occupant state determination datum by an electronic computing device of the response system. An occupant state regulation plan is created based on the at least one occupant state by the electronic computing device according to at least one regulation plan configuration of the response system. At least one control signal for at least one occupant amenity device of the motor vehicle is generated by the electronic computing device according to the regulation plan.

[0006] An occupant state may be, as examples, an emotion such as sadness or joy, or a neurological or psychiatric condition such as motion sickness or drowsiness.

[0007] Occupation state determination data may include at least one datum about at least one expression of the at least one occupant. For example, a camera may be used to analyze a facial expression of the at least one occupant, and a microphone may be used to analyze a volume or tone of voice of the at least one occupant.

[0008] Occupation state determination data may include at least one datum about the internal and / or external environment of the motor vehicle. For example, the at least one occupation state determination datum may be a temperature of air external to the motor vehicle. The response system may, for instance, associate the temperature with human discomfort. Therefore, in this example, the response system may determine from the occupant state determination datum that the at least one occupant is frustrated.

[0009] Occupation state determination data may include at least one datum concerning the current motion of the motor vehicle. For example, an exasperated user state may be determined when speeding or sudden acceleration is detected. Additionally, a motion-sick user state may be determined when rapid changes in heading occur in quick succession, evidencing a tortuous road.

[0010] Occupant state determination data may include at least one datum concerning a planned course of the motor vehicle, as when on-board GPS navigation is activated. In this way, an anticipatory state on the part of the at least one occupant, for example regarding an upcoming recreational area, may be determined. Furthermore, by accessing a traffic information server, the response system may determine that the at least one occupant may encounter traffic congestion at at least one point along the current journey. This information may be used by the response system to predict a future user state, in this example frustration due to traffic-related slowdowns.

[0011] An occupant amenity device is any device that may be used to influence at least one occupant state. Examples include climate control systems, massage chairs, video displays, speakers, and lights internal to the cabin.

[0012] An occupant state regulation plan is a prescription consisting of at least one setting for at least one occupant amenity device. Examples of such a setting include a specific video to be played on a display device, a specific song to be played on a speaker, a light intensity, a light color, and a rotation speed of an electric fan internal to the cabin of the motor vehicle. At least one occupant state regulation plan available to the occupant state response system may have been, for example, manually designed and / or curated, such as by at least one user experience professional. Alternatively or in addition, at least one occupant state regulation plan available to the occupant state response system may have been, for example, automatically designed and / or curated, such as by at least one artificial intelligence. For example, the at least one artificial intelligence may be an artificial neural network trained on at least one user experience datum, such as one produced by a professional psychologist, to design and / or curate occupant state regulation plans.

[0013] A regulation plan configuration is a preset, cohesive occupant state regulation plan coordinated toward a particular theme. For example, a drowsiness regulation plan configuration may consist of high-stimulation settings, such as an increased cabin light intensity, a playing of upbeat music, and an increased rotation speed of an electric fan internal to the cabin of the motor vehicle. A vexation regulation plan configuration may consist of calming settings, such as a decreased cabin light intensity, a playing of natural ambient sounds such as of rain or birdsong, and an activation of a massage chair.

[0014] As a consequence of the above mentioned method, a desirable occupant state may be maintained and / or an undesirable occupant state may be remedied without requiring input or action from the at least one occupant, solving the problem introduced earlier. However, a user control may still be included, for example in waiting for the at least one occupant to confirm at least one occupant state regulation plan proposed by the response system. In this example, the expected user input is minimal, which may allow control by the at least one occupant while avoiding significant diversion of the attention of the at least one occupant from the task of safe driving.

[0015] According to one embodiment, the occupant state regulation plan includes a playing of at least one media item by the at least one occupant amenity device.

[0016] According to one embodiment, potential media items for playing are evaluated by the electronic computing device. Then, at least one digital user history of the at least one occupant, comprising a history of played media items, is read by the electronic computing device. Next, at least one of the potential media items is selected for the occupant state regulation plan by the electronic computing device based on the at least one user digital history.

[0017] The at least one digital user history may include at least one user response indicator, such as a record of the interaction by the at least one occupant with a rating system, such as a like / dislike button. The response system may then prioritize the inclusion of positively rated media items and the exclusion of negatively rated media items in the occupant state regulation plan.

[0018] This embodiment may even be extended beyond media items, for example in recording additional user response indicators with ratings of settings such as specific massage cycles or light patterns.

[0019] According to one embodiment, the method runs on at least one automatic loop controlled by the electronic computing device, repeating in execution at at least one regular interval.

[0020] According to one embodiment, at least one follow-up occupant state determination datum concerning at least one impact of the regulation plan on the at least one current occupant is obtained by the electronic computing device. Then, at least one future iteration of the method is modified by the electronic computing device based on the at least one follow-up occupant state determination datum. In particular, at least one element of at least one future occupant state regulation plan is modified based on the follow-up occupant state determination datum.

[0021] According to one embodiment, at least one regulation plan configuration is retrieved from a regulation plan server outside of the motor vehicle by the electronic computing device. By updating the regulation plan configurations and the number thereof, this embodiment has the potential to increase the nuance with which at least one occupant state is addressed.

[0022] In particular, the method is a computer implemented method, Therefore, one aspect of the invention relates to a computer program product comprising program code means for performing a method according to the proceeding aspect.

[0023] One further aspect of the invention relates to a non-transitory computer-readable storage medium comprising at least a computer program product according to the preceding aspect.

[0024] One further aspect of the invention relates to an occupant state response system for a motor vehicle, comprising at least one electronic computing device and at least one occupant amenity device, wherein the occupant state response system is configured for performing a method according to the preceding aspect. In particular, the method is performed by the response system.

[0025] Furthermore, the invention relates to a motor vehicle comprising at least the occupant state response system according to the preceding aspect.

[0026] Advantageous embodiments of the method are to be regarded as advantageous embodiments of the computer program product, the non-transitory computer-readable storage medium, the occupant state response system, and the motor vehicle. Therefore, the response system as well as the motor vehicle comprise means for performing the method.

[0027] In the present disclosure, an electronic computing device may be understood as, for example, a data processing device with processing circuitry. An electronic computing device may therefore perform computing operations in order to process data. The computing operations may also include indexed accesses to a data structure, for example a look-up table, LUT.

[0028] In particular, an electronic computing device may include one or more computers, one or more microcontrollers, and / or one or more integrated circuits, for example, one or more application-specific integrated circuits, ASIC, one or more field-programmable gate arrays, FPGA, and / or one or more systems on a chip, SoC. The electronic computing device may also include one or more processors, for example one or more microprocessors, one or more central processing units, CPU, one or more graphics processing units, GPU, and / or one or more signal processors, in particular one or more digital signal processors, DSP. The electronic computing device may also include a physical or a virtual cluster of computers or of other said units.

[0029] An electronic computing device may also comprise one or more hardware and / or software interfaces and / or one or more memory units.

[0030] A memory unit may be implemented as a volatile data memory, for example a dynamic random access memory, DRAM, or a static random access memory, SRAM, or as a non-volatile data memory, for example a read-only memory, ROM, a programmable read-only memory, PROM, an erasable programmable read-only memory, EPROM, an electrically erasable programmable read-only memory, EEPROM, a flash memory or flash EEPROM, a ferroelectric random access memory, FRAM, a magnetoresistive random access memory, MRAM, or a phase-change random access memory, PCRAM.

[0031] Further advantages, features, and details of the invention derive from the following description of preferred embodiments as well as from the drawings. The features and feature combinations previously mentioned in the description as well as the features and feature combinations mentioned in the following description of the figures and / or shown in the figures alone can be employed not only in the respectively indicated combination but also in any other combination or taken alone without leaving the scope of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The novel features and characteristic of the disclosure are set forth in the appended claims. The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and together with the description, serve to explain the disclosed principles. The same numbers are used throughout the figures to reference like features and components. Some embodiments of system and / or methods in accordance with embodiments of the present subject matter are now described below, by way of example only, and with reference to the accompanying figures.

[0033] The drawings show in:

[0034] Fig. 1 a schematic side view according to an embodiment of a motor vehicle comprising an embodiment of a response system of the disclosure.

[0035] Fig. 2 a schematic flow chart according to an embodiment of the method.

[0036] In the figures the same elements or elements having the same function are indicated by the same reference signs. DETAILED DESCRIPTION

[0037] In the present document, the word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any embodiment or implementation of the present subject matter described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

[0038] While the disclosure is susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawing and will be described in detail below. It should be understood, however, that it is not intended to limit the disclosure to the particular forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure.

[0039] The terms “comprises,” “comprising,” or any other variations thereof, are intended to cover a non-exclusive inclusion so that a setup, device or method that comprises a list of components or steps does not include only those components or steps but may include other components or steps not expressly listed or inherent to such setup or device or method. In other words, one or more elements in a system or apparatus preceded by “comprises” or “comprise” does not or do not, without more constraints, preclude the existence of other elements or additional elements in the system or method.

[0040] In the following detailed descriptions of the embodiments of the disclosure, references are made to the accompanying drawings that form parts hereof, and in which are shown by way of illustration specific embodiments in which the disclosure may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the disclosure, and it is to be understood that other embodiments may be utilized and that changes may be made without departing from the scope of the present disclosure. The following descriptions are, therefore, not to be taken in a limiting sense.

[0041] Fig. 1 shows a schematic side view according to an embodiment of a motor vehicle 10 comprising at least one occupant state response system 12. A current occupant 14 of the motor vehicle 10 is currently experiencing an occupant state 16, here joy. A camera 18 captures at least one occupant state determination datum 20, here a photograph of a countenance of the occupant 14. The photograph is transmitted to an electronic computing device 22 of the response system 12. A regulation plan configuration 24 is received from a regulation plan server 26 by a telecommunication device 28 of the response system 12 and stored in a collection of regulation plan configurations in the response system 12. An occupant state regulation plan 30, here a program to maintain the state of joy, is created by the electronic computing device 22 based on the at least one occupant state determination datum 20 and according to the regulation plan configuration 24 received by the telecommunication device 28. According to the regulation plan 30, at least one control signal 32, here a playing of an upbeat song and therefore of a media item, for at least one occupant amenity device 34, here a speaker, is generated by the electronic computing device 22.

[0042] Fig. 2 shows a schematic flow chart according to several embodiments of the method. In particular, fig. 2 shows a method for operating an occupant state response system 12 (fig. 1) for a motor vehicle 10.

[0043] In a first step S1, the at least one current and / or future occupant state 16 is determined based on the at least one occupant state determination datum 20 by the electronic computing device 22.

[0044] According to an embodiment, the method includes a three-part second step S2. In a first part S2A, potential media items for playing are evaluated by the electronic computing device 22. In a second part S2B, at least one digital user history of the at least one occupant 14, comprising a history of played media items, is read by the electronic computing device 22. In a third part S2C, at least one of the potential media items is selected for the occupant state regulation plan 30 by the electronic computing device 22 based on the at least one user digital history.

[0045] In a third step S3, the occupant state regulation plan 30 is selected based on the at least one occupant state 16 by the electronic computing device 22 according to the at least one regulation plan configuration 24 of the response system 12. Specifically, in this example, the occupant state regulation plan 30 is selected from a group of occupant state regulation plans that have been curated by a panel of experts in fields such as user interface development, psychology, and ergonomics.

[0046] In this example, the regulation plan configuration 24 is not downloaded from the regulation plan server 26 but already present in the response system 12. In this example, the regulation plan 30 includes a playing of at least one media item by the at least one occupant amenity device.

[0047] In a fourth step S4, the at least one control signal 32 for the at least one occupant amenity device 34 of the motor vehicle 10 is generated by the electronic computing device 22 according to the regulation plan 30.

[0048] According to an embodiment, the method includes a two-part fifth step S5. In a first part S5A, at least one follow-up occupant state determination datum concerning at least one impact of the regulation plan 30 on the at least one current occupant 14 is obtained by the electronic computing device 22. In a second part S5B, at least one future iteration of the method is modified by the electronic computing device 22 based on the at least one follow-up occupant state determination datum. In particular, at least one element of at least one future occupant state regulation plan 30 is modified based on the follow-up occupant state determination datum.

[0049] According to an embodiment, the method includes a sixth step S6, in which the method runs on at least one automatic loop controlled by the electronic computing device 22, in this example repeating immediately after the completion of step S5B. Signs motor vehicle response system occupant occupant state camera occupant state determination datum electronic computing device regulation plan configuration regulation plan server telecommunication device regulation plan control signal occupant amenity device steps of the method

Claims

1. A method for operating an occupant state response system (12) for a motor vehicle (10), comprising the steps of:- determining (S1) at least one current and / or future occupant state (16) of at least one current occupant (14) of the motor vehicle (10) based on at least one occupant state determination datum (20) by an electronic computing device (22) of the response system (12);- creating (S3) an occupant state regulation plan (30) based on the at least one occupant state (16) by the electronic computing device (22) according to at least one regulation plan configuration (24) of the response system (12); and- generating (S4) at least one control signal (32) for at least one occupant amenity device (34) of the motor vehicle (10) by the electronic computing device (22) according to the regulation plan (30).

2. The method according to claim 1, characterized in thatthe occupant state regulation plan (30) includes a playing of at least one media item by the at least one occupant amenity device (34).

3. The method according to claim 2, characterized in that the method comprises:- evaluating (S2A), by the electronic computing device (22), potential media items for playing;- reading (S2B) at least one digital user history of the at least one occupant (14),comprising a history of played media items, by the electronic computing device (22); and- selecting (S2C) at least one of the potential media items for the occupant state regulation plan (30) by the electronic computing device (22) based on the at least one user digital history.

4. The method according to any one of claims 1 to 3, characterized in thatthe method runs on at least one automatic loop controlled by the electronic computing device (22), repeating (S5) in execution at at least one regular interval.

5. The method according to any one of claims 1 to 4, characterized in thatthe method comprises:- obtaining (S5A) at least one follow-up occupant state determination datum concerning at least one impact of the regulation plan (30) on the at least one current occupant (14) by the electronic computing device (22);- modifying (S6A) at least one future iteration of the method by the electronic computing device (22) based on the at least one follow-up occupant state determination datum, in particular modifying at least one element of at least one occupant state regulation plan (30).

6. The method according to any one of claims 1 to 5, characterized in thatthe at least one regulation plan configuration (24) is retrieved from a regulation plan server (26) outside of the motor vehicle (10) by a telecommunication device (28) of the response system (12).

7. A computer program product comprising program code means for performing a method according to any one of claims 1 to 6.

8. A non-transitory computer-readable storage medium comprising the computer program product according to claim 7.

9. An occupant state response system (12) for a motor vehicle (10), comprising at least one electronic computing device (22), wherein the response system (12) is configured for performing a method according to any one of claims 1 to 6.15

Images