Control device, control method, and program

Abstract

The present disclosure relates to a control device, a control method, and a program capable of improving a user experience by odor. The control device includes a state recognition section for recognizing an activity state of a user, and a presentation control section for controlling emission of air containing an odor component to control presentation of the odor to the user, and the presentation control section sets an off period in which emission of the odor is off in accordance with the activity state of the user. For example, an off period in which emission of the odor is off is set for a certain period of time after an activity period in which the user is active starts. The present technology can be applied to, for example, an odor presentation control system that controls presentation of an odor in a vehicle.

Description

Technical Field

[0001] This disclosure relates to control devices, control methods, and procedures, and more specifically, to control devices, control methods, and procedures capable of improving user experience through odor. Background Technology

[0002] Conventionally, for example, technologies for presenting scents inside vehicles have been developed to relax the driver and promote driver alertness.

[0003] Patent document 1 discloses a vehicle fragrance device that, in order to suppress the olfactory adaptation of occupants, intermittently blows out the fragrance of a fragrance agent in a predetermined cycle, and after a predetermined number of cycles of repeating the blowing and pausing of the fragrance, sequentially repeats a predetermined period of time during which the fragrance of the fragrance agent is stopped being blown out.

[0004] Patent document 2 discloses an aroma system that, when driver drowsiness is detected, releases different aromas when the time elapsed since the release of the aroma is short, and releases the same aroma when the time elapsed since the release of the aroma is not short.

[0005] [List of Citations]

[0006] [Patent Literature]

[0007] Patent Document 1: WO 2011 / 001808 A

[0008] Patent Document 2: Japanese Patent Application Publication No. 2019-215669 Summary of the Invention

[0009] [The problem to be solved]

[0010] Furthermore, compared to conventional technologies, this control, which allows for the presentation of appropriate scents based on the user's activity level, is believed to further improve the user experience.

[0011] This disclosure was made in light of this situation and is intended to enable the improvement of user experience through scent.

[0012] [Solution to the problem]

[0013] The control device of one aspect of this disclosure includes: a status recognition unit that recognizes the activity status of a user; and a presentation control unit that controls the emission of air containing odor components to control the presentation of an odor to the user, and the presentation control unit sets a shutdown period for cutting off the emission of odor based on the user's activity status.

[0014] One aspect of the control method or procedure disclosed herein includes: identifying the user's activity status; controlling the emission of air containing odor components to control the presentation of odors to the user, and setting a shutdown period for cutting off the emission of odors based on the user's activity status.

[0015] In one aspect of this disclosure, the user's activity state is identified, and the emission of air containing odor components is controlled to control the presentation of odors to the user. Then, a shutdown period for cutting off odor emission is set based on the user's activity state. Attached Figure Description

[0016] Figure 1 This is a block diagram illustrating an example of an embodiment of an odor presentation control system that applies the present technology.

[0017] Figure 2 This is a flowchart illustrating the odor presentation control process.

[0018] Figure 3 This is a diagram illustrating an example of control processing that sets the emission period to coincide with the user's activity period.

[0019] Figure 4 This diagram illustrates an example of control processing that sets the active shutdown period to a certain duration after the start of a user's activity period.

[0020] Figure 5 This diagram illustrates an example of control processing that sets the active shutdown period to a certain duration before the end of the user's active period.

[0021] Figure 6 This diagram illustrates an example of control processing that sets a fade-in period to a certain duration after the start of a user's activity period.

[0022] Figure 7 This diagram illustrates an example of control processing that sets a fade-out period to a certain duration before the end of a user's active period.

[0023] Figure 8 This is a diagram showing an example of a UI screen with GUI buttons for indicating operation mode settings and GUI buttons for indicating user settings arranged on it.

[0024] Figure 9 This is a diagram showing an example of a UI screen with UI buttons arranged on it for selecting the operation mode with the desired settings.

[0025] Figure 10 This is a diagram showing an example of a UI screen with UI buttons arranged on it to indicate detailed settings for the operating mode.

[0026] Figure 11This is a diagram showing an example of a UI screen used to specify odor intensity.

[0027] Figure 12 This is a diagram showing an example of a UI screen for selecting the type of scent to be displayed in sleep mode.

[0028] Figure 13 This is a diagram showing an example of a UI screen used for evaluating emission conditions.

[0029] Figure 14 It is a diagram used to explain how customized settings are reflected on the UI screen based on the learning results.

[0030] Figure 15 This is a block diagram illustrating a configuration example of a computer to which the present technology is applied.

[0031] Figure 16 This is a block diagram illustrating an example of a schematic configuration of a vehicle control system.

[0032] Figure 17 This is an explanatory diagram showing an example of the mounting positions of the vehicle exterior information detection unit and the imaging unit. Detailed Implementation

[0033] Specific embodiments in which this technology is applied will be described in detail with reference to the accompanying drawings.

[0034] <Configuration example of an odor presentation control system>

[0035] Figure 1 This is a block diagram illustrating a configuration example of an embodiment of an odor presentation control system to which the present technology is applied.

[0036] like Figure 1 As shown, the odor presentation control system 11 includes an input unit 21, a storage unit 22, a setting adjustment unit 23, a status recognition unit 24, a determination unit 25, a receiving unit 26, a sending unit 27, a presentation control unit 28, an odor presentation unit 29, a linkage control unit 30, and a linkage unit 31. The odor presentation control system 11 can be used by being installed in a vehicle, for example, by emitting air containing odor components (fragrance components) generated by the volatilization of fragrances to control the presentation of odors to occupants (hereinafter also referred to as users) riding in the vehicle, including the driver.

[0037] The input unit 21 is, for example, an information processing terminal including a touch panel, and is used to display information such as those described later. Figures 8 to 13 The UI screen shown includes user interface (UI) screens and other similar interfaces for users to set operating modes and input emission conditions.

[0038] Users can use the input unit 21 to set the operating mode to be executed by the odor presentation control system 11 (e.g., automatic mode, meal mode, sleep mode, map mode, reading mode, child mode, external environment (map / weather) mode, emotion mode, etc.). Users can use the input unit 21 to input individual detailed settings for each user. Users can use the input unit 21 to input emission conditions set for each operating mode or each user (e.g., odor intensity (airflow volume), odor type (fragrance / aromatic), etc.). Users can use the input unit 21 to input an evaluation of the emission conditions.

[0039] The storage unit 22 stores the emission conditions (such as detailed settings including odor intensity and type, as well as user-adjusted settings) input by the input unit 21 for each operating mode or each user, and also stores the user's evaluation of the emission conditions.

[0040] The setting adjustment unit 23 acquires additional information such as ambient temperature and humidity when necessary to adjust the setting of emission conditions, and provides the additional information to the presentation control unit 28.

[0041] The situation recognition unit 24 acquires detection data from sources such as motion sensors that detect the movement of people inside the vehicle equipped with the odor presentation control system 11, and odor sensors that detect odors inside the vehicle. Furthermore, the situation recognition unit 24 acquires images captured by in-vehicle cameras, in-vehicle sensors, and out-of-vehicle cameras and sensors that detect the state inside and outside the vehicle. Then, the situation recognition unit 24 identifies the activity state of the user inside the vehicle based on the detection data acquired from each sensor and the images acquired from each camera. Additionally, the situation recognition unit 24 can use vehicle location information, weather information, and historically accumulated data stored in a server to identify the activity state of the user inside the vehicle. Then, the situation recognition unit 24 provides identification information indicating the identification result of the user's activity state inside the vehicle to the determination unit 25. Furthermore, if the situation recognition unit 24 changes the emission conditions based on changes in the user's activity state inside the vehicle, the situation recognition unit 24 can directly provide the identification information to the presentation control unit 28.

[0042] For example, the situation recognition unit 24 can identify the driver's activity status as such as driving, resting, waiting at a traffic light, eating or drinking, listening to music, talking, experiencing motion sickness, etc. Furthermore, the situation recognition unit 24 can identify the activity status of users other than the driver as such as viewing scenery, sleeping, using navigation, playing games, using smartphones, listening to music, a child crying, eating or drinking, talking, reading, working, exercising, dating, participating in activities, experiencing motion sickness, etc. Note that the situation recognition unit 24 can refer to the user's emotional information, vital signs, conversation content, location information, etc.

[0043] The determination unit 25 determines whether a change in the user's activity state inside the vehicle has been detected based on the identification information provided by the condition recognition unit 24. Then, if the determination unit 25 determines that a change in the user's activity state inside the vehicle has been detected, the determination unit 25 determines whether to change the emission conditions based on the change in activity state and instructs the presentation control unit 28 to change the emission conditions.

[0044] Furthermore, the determination unit 25 can determine the operating mode to be performed by the odor presentation control system 11 based on the information input by the input unit 21, and can determine the user of the odor presentation control system 11 (the person to whom the odor is to be presented).

[0045] The receiving unit 26 receives various types of information necessary for the presentation control unit 28 to control the presentation of odors from a control device (e.g., an electronic control unit (ECU) installed on the vehicle) outside the odor presentation control system 11, and provides this information to the presentation control unit 28. For example, if the vehicle equipped with the odor presentation control system 11 is a convertible with a movable roof, the receiving unit 26 can receive opening / closing information indicating the open / closed state of the vehicle's roof from the ECU and provide this information to the presentation control unit 28. Similarly, the receiving unit 26 may receive opening / closing information indicating the open / closed state of the vehicle's windows (including, for example, a sunroof) from the ECU, not limited to the case of a convertible, and may provide this information to the presentation control unit 28. In addition, the receiving unit 26 can receive from the ECU and provide to the presentation control unit 28 information indicating the degree to which the vehicle's windows are open (e.g., information indicating the degree to which the windows are open (open / closed level information) (such as the state of the windows being fully open, the state of the windows being half open, and the state of the windows being one-third open), information indicating how many windows are open at the same time (number of open windows information), and information indicating which windows are in the open / closed state (open window position information and closed window position information)).

[0046] The sending unit 27 obtains various types of information from the presentation control unit 28 that need to be notified to the control device outside the odor presentation control system 11 as a result of the presentation control unit 28 controlling the presentation of the odor, and sends the information to the control device outside the odor presentation control system 11.

[0047] The presentation control unit 28 controls the presentation of odors by the odor presentation unit 29 based on the user's activity status, operating mode, or emission conditions set for each user. For example, the presentation control unit 28 can set the odor type, odor presentation time, intermittent odor presentation operation, airflow rate, airflow direction, etc., for the odor presentation unit 29. The presentation control unit 28 can change the emission conditions if the determination unit 25 determines that the emission conditions should be changed. The presentation control unit 28 can control the presentation of odors to the driver based on the activity status of users other than the driver. Furthermore, the presentation control unit 28 can control the emission mode of air containing odor components emitted by the odor presentation unit 29. For example, the presentation control unit 28 can, as referred to later... Figures 3 to 7 As described above, the emission and shutdown periods are controlled based on the user's activity status, and the fade-in or fade-out during the emission period can be controlled.

[0048] Furthermore, the presentation control unit 28 can control the intensity of the odor presented by the odor presentation unit 29 based on the opening / closing information provided from the receiving unit 26. For example, when a user performs the operation of opening the roof of a convertible and opening / closing information indicating that the vehicle roof is open is provided via the receiving unit 26, the presentation control unit 28 controls the odor presentation unit 29 to increase the intensity of the odor. That is, when the vehicle roof is open, compared to when the vehicle roof is closed, wind can enter the vehicle interior more easily, and odor components are more likely to evaporate due to airflow disturbances. Therefore, by controlling the odor intensity based on this opening / closing information (i.e., information indicating whether the environment for presenting the odor is open), the presentation control unit 28 can present the odor appropriately. It should be noted that the presentation control unit 28 can also control the intensity of the odor presented by the odor presentation unit 29 based on opening / closing information indicating the open / closed state of the vehicle's ordinary windows or information indicating the degree to which the vehicle's windows are open, as described above.

[0049] The odor presentation unit 29 is composed of a single diffuser containing two or more types of fragrances, or is physically or electrically combined with multiple diffusers containing one or more types of fragrances. The odor presentation unit 29 opens and closes valves and throttle valves under the control of the presentation control unit 28, adjusts the airflow rate and direction using a blower or the like, and discharges air containing odor components (fragrance components) generated by the volatilization of the fragrances to present the odor to the user. The odor presentation unit 29 can adjust the intensity of the odor (the concentration of odor components contained in the discharged air) by setting the concentration of the fragrance storage box, the airflow speed, the opening area of ​​the throttle valve, the discharge time per discharge, the discharge frequency, etc., and can increase the intensity of the odor by, for example, increasing the airflow speed, the opening area, the discharge frequency, etc.

[0050] The linkage control unit 30 controls the linkage unit 31 of the vehicle that operates in conjunction with the odor presented by the odor presentation unit 29.

[0051] The linkage unit 31 includes, for example, vehicle windows and doors, interior and exterior lights, seat tilting and foot pedal drive mechanisms, speakers for outputting music, displays for displaying video, and air conditioning equipment for performing cooling, heating, and ventilation. Additionally, the linkage unit 31 can be configured to include operating mechanisms for operating tables, cup holders, seat belts, wipers, detergent dispensers, etc.

[0052] The odor presentation control system 11 is configured as described above and can control the presentation of odors according to each user's preferences and state, and can improve the user experience through odors.

[0053] For example, the odor presentation control system 11 can extend the time when the odor presentation is turned off based on the breathing and activity status of the user inside the vehicle (such as during driving, while operating a smartphone, and while sleeping). Furthermore, the odor presentation control system 11 can appropriately present odors based on activity status, such as turning off odor presentation when the user is sleeping and turning on odor presentation when the user is stressed at work.

[0054] It should be noted that, for example, the odor presentation control system 11 can be configured such that each component of the odor presentation control system 11 is provided in one device, or it can be configured such that each component is distributed across multiple devices. In this case, a communication unit is required to provide communication between the actuators. For example, some functions of the odor presentation control system 11 can be integrated into the diffuser used as the odor presentation unit 29 to configure the device, and control can be performed from the odor presentation unit 29 to the linkage unit 31 on the vehicle side. Furthermore, the odor presentation control system 11 can automatically perform odor presentation control processing in cooperation with the system controlling the vehicle, or the user can use the input unit 21 to instruct the execution of odor presentation control processing.

[0055] Reference Figure 2 The flowchart shown describes the odor presentation control process performed in the odor presentation control system 11. For example, the odor presentation control process begins when a user who has boarded the vehicle performs an operation on the input unit 21 to instruct the odor presentation control system 11 to be activated.

[0056] In step S11, when the user sets the operating mode or inputs emission conditions, the input unit 21 acquires the input operating mode or emission conditions and provides them to the presentation control unit 28. It should be noted that if the user does not set the operating mode or input emission conditions, the presentation control unit 28 acquires the default operating mode or emission conditions or the operating mode or emission conditions used in the previous odor presentation control process from the storage unit 22.

[0057] In step S12, the status recognition unit 24 begins to recognize the activity status of the user inside the vehicle and provides recognition information indicating the recognition result to the determination unit 25.

[0058] In step S13, the determination unit 25 determines whether a change in the activity status of a user inside the vehicle has been detected based on the identification information provided by the condition recognition unit 24.

[0059] In step S13, if the determining unit 25 determines that a change in the activity state of the user inside the vehicle has been detected, the process proceeds to step S14.

[0060] In step S14, the determining unit 25 determines whether to change the emission conditions based on changes in the activity status of the user inside the vehicle.

[0061] In step S14, if the determination unit 25 determines that the emission conditions need to be changed, the process proceeds to step S15. In step S15, the determination unit 25 instructs the presentation control unit 28 to change the emission conditions based on changes in the activity status of the user inside the vehicle, and the presentation control unit 28 changes the emission conditions based on the identification information provided by the status recognition unit 24.

[0062] On the other hand, if it is determined in step S13 that no change in the activity state of the user inside the vehicle is detected, if it is determined in step S14 that the emission conditions are not changed, or after the processing in step S15, the process proceeds to step S16.

[0063] In step S16, the presentation control unit 28 performs control on the odor presentation unit 29 (e.g., emits odor, stops emitting odor, continues these operations, etc.) so that the odor is presented according to the emission conditions.

[0064] In step S17, the input unit 21 determines whether to record emission conditions and an evaluation based on user input. For example, if the user is satisfied with the emission conditions used to control the odor presentation in step S16, the user can use the input unit 21 to input an evaluation to record the emission conditions. In this case, for example, a method described later can be used... Figure 13 UI screens such as the UI shown.

[0065] In step S17, if the input unit 21 determines the emission conditions and assessment, the process proceeds to step S18. In step S18, the input unit 21 records the emission conditions and assessment, and the storage unit 22 stores the emission conditions and assessment.

[0066] On the other hand, if it is determined in step S17 that emission conditions and assessments are not recorded, or after the processing in step S18, the processing proceeds to step S19.

[0067] In step S19, the presentation control unit 28 determines whether to operate the linkage unit 31 in accordance with the odor presented in step S16.

[0068] In step S19, if the presentation control unit 28 determines that the linkage unit 31 operates in accordance with the scent presented in step S16, the process proceeds to step S20. In step S20, the presentation control unit 28 instructs the linkage control unit 30 to operate the linkage unit 31, and the linkage control unit 30 controls the operation of the linkage unit 31 according to the instruction.

[0069] On the other hand, if it is determined in step S19 that the linkage unit 31 will not be operated, or after the processing in step S20, the processing proceeds to step S21.

[0070] In step S21, the input unit 21 determines whether to end the odor presentation control process based on the user's input. For example, when the user performs an operation to turn off the odor presentation control system 11 on the input unit 21, the input unit 21 determines to end the odor presentation control process.

[0071] In step S21, if the input unit 21 determines that the odor presentation control process should not be terminated, the process returns to step S12, and similar processes are repeated thereafter. On the other hand, if the input unit 21 determines in step S21 that the odor presentation control process should be terminated, the process ends.

[0072] By performing the odor presentation control process as described above, the odor presentation control system 11 can improve the user experience through odor. Furthermore, the odor presentation control system 11 allows the user to change emission conditions using the input unit 21, and allows the user's evaluation to be fed back in subsequent instances.

[0073] <Example of using an odor presentation control system>

[0074] This section will describe an example of how to use an odor presentation control system.

[0075] For example, the odor presentation control system 11 can be used for the driver's naps and rest.

[0076] First, the driver can operate the input unit 21 (or use voice input) to express their desire to nap or rest. Alternatively, the driver can agree to the suggestion to nap or rest when the odor presentation control system 11 prompts them based on factors such as the vehicle's driving time, the level of accumulated stress based on vital signs obtained from the device worn by the driver, or map information indicating the vicinity of a service area where a nap or rest is possible.

[0077] The driver confirms that the vehicle's engine has stopped and operates the input unit 21 to activate the rest mode. Note that when multiple odor presentation units 29 are installed on the vehicle, control can be performed so that at least the odor presentation unit 29 closest to the driver, who is the target user, presents the odor.

[0078] Then, the odor presentation control system 11 begins to present a relaxing odor to the driver. Note that if an stimulating odor has already been presented during driving, the presentation of the stimulating odor is stopped before the presentation of the relaxing odor begins. Alternatively, if a relaxing odor has already been presented, the interval between odor presentations can be shortened to increase the intensity of the odor.

[0079] Subsequently, the odor presentation control system 11 can deactivate the rest mode by having the driver operate the input unit 21 (or by using voice input) to indicate the end of the rest. Alternatively, the odor presentation control system 11 can determine the need to end the rest based on factors such as the time required to reach the destination or the elapsed preset rest time, and can deactivate the rest mode accordingly.

[0080] In this way, the quality of naps and rests during driving can be improved by using the odor presentation control system 11.

[0081] For example, the odor presentation control system 11 can be used for sleep and rest for users other than the driver.

[0082] The odor presentation control system 11 can predict or detect situations where the driver may be drowsy. For example, the odor presentation control system 11 can predict that the driver may be drowsy by recognizing from images from an in-vehicle camera that the user in the front passenger seat or the user in the back seat is sleeping, or that conversations with such users have decreased.

[0083] In this situation, the odor presentation control system 11 activates the wake-up mode. Note that when multiple odor presentation units 29 are installed on the vehicle, control can be performed so that the odor is presented only by the odor presentation unit 29 closest to the driver, who is the target user, and, for example, control can be performed so that the odor is not presented from the odor presentation unit 29 closest to the sleeping user.

[0084] Then, the odor presentation control system 11 begins to present an odor with an stimulating effect to the driver. Note that if an odor with a relaxing effect has already been presented, the presentation of the relaxing odor is stopped before the presentation of the stimulating odor begins. Alternatively, if an stimulating odor has already been presented, the interval between odor presentations can be shortened to increase the intensity of the odor.

[0085] Subsequently, the odor presentation control system 11 can deactivate the wake-up mode by the driver performing an operation on the input unit 21 (or by using voice input) to indicate the end of driving. Alternatively, the odor presentation control system 11 can recognize that the vehicle is approaching its destination and can deactivate the wake-up mode thereafter.

[0086] For example, the odor presentation control system 11 can be used when users other than the driver are eating or drinking.

[0087] If the odor presentation control system 11 detects from images of the in-vehicle camera or odor sensors that another user (e.g., a user in the front passenger seat or a user in the back seat) has started eating or drinking, the odor presentation control system 11 can predict or detect situations where the driver may be unable to concentrate on driving due to the smell of food that other users are eating.

[0088] In this case, the odor presentation control system 11 activates the comfort mode. Note that when multiple odor presentation units 29 are installed on the vehicle, control can be performed so that the odor is presented only by the odor presentation unit 29 closest to the driver, who is the target user, and, for example, control can be performed so that the odor is not presented from the odor presentation unit 29 closest to the user who is eating or drinking.

[0089] Then, the odor presentation control system 11 begins to present odors that make the driver feel comfortable (e.g., odors that the driver has registered as preferred, odors that do not cause discomfort even when mixed with food odors, etc.). Alternatively, if the odor has already been presented, the time interval for presenting the odor is shortened to increase the intensity of the odor.

[0090] Subsequently, when the driver performs an operation on the input unit 21 (or can use voice input) to indicate that another user has finished eating or drinking, the odor presentation control system 11 can deactivate the comfort mode. Alternatively, if the odor presentation control system 11 recognizes from images from the in-vehicle camera or odor sensors that another user has finished eating or drinking, the odor presentation control system 11 can deactivate the wake-up mode.

[0091] Next, the control process of the odor presentation control system when eating or drinking is being performed in the vehicle will be described.

[0092] For example, the odor presentation control system 11 can use a human presence sensor or an in-vehicle camera to detect a hand reaching towards a cup holder or using a table as a trigger. Furthermore, the odor presentation control system 11 can use sensors to detect previously learned food odors or changes in odors within the vehicle as triggers. Additionally, the odor presentation control system 11 can use an in-vehicle camera to detect eating or drinking activities within the vehicle based on previously learned food images or human movement as triggers.

[0093] Then, the odor presentation control system 11 can stop presenting odors only for a specific area in the vehicle where eating or drinking is taking place, or for the entire interior of the vehicle, reduce the intensity of the odor presentation (e.g., suddenly or gradually reduce the airflow volume), or change the direction of the airflow used to present the odor. In addition, if an odor incompatible with the food has already been presented, the odor presentation control system 11 can switch to presenting a different odor (e.g., switch from a floral odor to an orange odor).

[0094] Furthermore, when only a specific user is eating or drinking, the odor presentation control system 11 can control the airflow to create an air curtain (odorless airflow) so that the odor of the food does not mix with the odor presented to other users.

[0095] Alternatively, the odor presentation control system 11 can eliminate food odors by operating the deodorizer only in the eating or drinking area or throughout the entire vehicle, or by presenting an odor that counteracts the food smell. In this case, the linkage 31 can open the windows to promote ventilation.

[0096] Next, the control process of the odor presentation control system after eating or drinking has been performed in the vehicle will be described.

[0097] For example, the odor presentation control system 11 can use the detection of a user's movement around a cup holder or table stopping by a human presence sensor or an in-vehicle camera as a trigger. Furthermore, the odor presentation control system 11 can use the detection of a weakening of previously learned food odors or changes in the odor inside the vehicle as a trigger. Additionally, the odor presentation control system 11 can use the in-vehicle camera to detect when eating or drinking inside the vehicle has ended, based on previously learned food images or human movement, as a trigger.

[0098] Then, the odor presentation control system 11 can begin presenting an odor only to an area in the vehicle where eating or drinking has been performed, or to the entire interior of the vehicle; increase the intensity of the odor presentation (e.g., suddenly or gradually increase the airflow volume); or return to the airflow direction used to present the odor. Furthermore, the odor presentation control system 11 can switch to the most suitable odor for falling asleep or waking up, based on a user-specified operating mode.

[0099] Furthermore, if only a specific user is eating or drinking and an air curtain (odorless airflow) has been generated to prevent the smell of food from mixing with the smell presented to other users, the odor presentation control system 11 can control the air curtain to stop.

[0100] Alternatively, the odor presentation control system 11 can eliminate food odors by operating the deodorizer only in the eating or drinking area or throughout the entire vehicle, or by presenting an odor that counteracts the food smell. In this case, the linkage 31 can open the windows to promote ventilation.

[0101] Next, we will describe the child model used to present a scent that soothes a baby.

[0102] For example, the odor presentation unit 29 can be installed on the headrest, straps, or side surface of the main body of the child seat. Furthermore, when the child seat is installed in the rear seat, the headrest can be installed on the rear seat side of the headrest of the driver's seat or the front passenger seat.

[0103] Users can perform an operation on the input unit 21 to input the switch to child mode. Alternatively, the scent presentation control system 11 can automatically set the child mode when the vehicle's engine is started, driving is detected, and the presence of a baby is recognized from the image of the in-vehicle camera. In child mode, a soothing scent for the baby, such as the scent of a mother or breast milk, is presented.

[0104] The odor presentation control system 11 can determine whether to present an odor based on whether the vehicle is stopped (or may stop), for example, to determine whether to present an odor so that the baby does not cry before starting to cry, rather than based on the baby's crying.

[0105] For example, the odor presentation control system 11 can determine whether the vehicle has stopped by acquiring vehicle speed information, location information or acceleration information from a user-owned device such as a smartphone, detecting vehicle vibration, and identifying whether the vehicle's windows have moved. The odor presentation control system 11 can make this determination by continuous monitoring or by periodic monitoring at one-second intervals.

[0106] Furthermore, the odor presentation control system 11 can be arbitrarily set from one odor emission to the next predetermined time. Additionally, the odor presentation control system 11 can adjust the predetermined frequency and timing of odor presentation while the vehicle is stationary.

[0107] Then, when it is detected that the baby has stopped crying, or when the vehicle starts to move, the odor presentation control system 11 can stop the presentation of the odor.

[0108] Next, the odor presentation control system 11 will be described how odors are presented by obtaining information from the operation of the vehicle.

[0109] The odor presentation control system 11 can measure the number of times the brakes are applied per unit time and can identify traffic congestion if the number exceeds a threshold. Typically, because drivers experience high stress levels during traffic jams, the odor presentation control system 11 can increase the intensity of the odor by shortening the time interval for presenting a relaxing odor, or decrease the intensity of the odor by lengthening the time interval for presenting an arousing odor.

[0110] The odor presentation control system 11 can measure the angle of the steering wheel operated by the driver per unit time, and can identify that the vehicle is traveling on a straight road when the angle is equal to or less than a threshold. Typically, since drivers tend to become increasingly drowsy when traveling on a straight road, the odor presentation control system 11 can increase the intensity of the odor by shortening the time interval for presenting odors with an arousing effect, or decrease the intensity of the odor by lengthening the time interval for presenting odors with a relaxing effect.

[0111] The odor presentation control system 11 can compare the driving speed with the speed limit of the road the vehicle is traveling on, and can detect sudden starts or stops of the vehicle. It can also identify that the vehicle is traveling at the speed limit if the difference from the speed limit is equal to or less than a threshold. Typically, since drivers tend to feel less calm when traveling at speed limits, the odor presentation control system 11 can increase the intensity of the odor by shortening the time interval for presenting a relaxing odor, or decrease the intensity of the odor by lengthening the time interval for presenting an arousing odor.

[0112] In addition, the odor presentation control system 11 can obtain the information described below from the vehicle and present the odor.

[0113] For example, when driving in the rain, as the driver uses wipers to ensure visibility and slows down in response to slippery surfaces, the odor presentation control system 11 can obtain information indicating that the vehicle is being driven in the rain based on the use of wipers and the vehicle's deceleration.

[0114] For example, in dense fog, the odor presentation control system 11 can acquire information indicating that the vehicle is being driven in dense fog based on the use of fog lights and significant deceleration, as the driver turns on the fog lights to improve visibility and significantly reduces speed to ensure safety.

[0115] For example, on gravel roads or unpaved roads, as the driver responds to the instability of the road surface by driving slowly and carefully at a lower speed to maintain control of the vehicle, the odor presentation control system 11 can obtain information indicating that the vehicle is traveling on gravel roads or unpaved roads based on the reduced speed and careful steering operation.

[0116] For example, when driving and parking, the odor presentation control system 11 can acquire information indicating that the vehicle is driving and about to park based on gear shifting and precise accelerator and brake operation, as the driver shifts to the appropriate gear to drive the vehicle into the parking space and makes fine adjustments to the accelerator and brake.

[0117] For example, during nighttime driving, as the driver turns on the headlights to ensure visibility and adjusts the speed appropriately to cope with the low visibility characteristic of nighttime, the odor presentation control system 11 can acquire information indicating the vehicle's operation at night based on the use of the headlights and the appropriate adjustment of the speed.

[0118] For example, in situations where emergency braking is necessary, the odor presentation control system 11 can acquire information indicating that the vehicle is in a situation requiring emergency braking based on the strong application of the brake pedal when the driver applies the brakes quickly and forcefully in the event of a sudden obstacle or the need for an emergency stop.

[0119] For example, during long-distance driving, as drivers take regular breaks and change their posture to improve blood circulation in order to prevent fatigue, the odor presentation control system 11 can obtain information indicating that the vehicle is traveling a long distance based on regular breaks and posture changes.

[0120] For example, when driving according to road signs and traffic signals, since the driver adjusts the speed according to speed limit signs, stop signs and traffic signals, the odor presentation control system 11 can obtain information indicating that the vehicle is driving according to road signs and traffic signals based on speed adjustment and direction change.

[0121] Reference Figures 3 to 7 The description describes a control process that controls the presentation of odors by setting emission and shutdown periods based on the user's activity time.

[0122] Figure 3 An example of control processing is shown where the emission period is set to coincide with the user's activity period.

[0123] exist Figure 3In the control process shown, the first emission period is set to coincide with the first active period, the first shutdown period is set between the first and second active periods, the second emission period is set to coincide with the second active period, the second shutdown period is set between the second and third active periods, and the third emission period is set to coincide with the third active period.

[0124] Here, in the odor presentation control system 11, it is executed intermittently multiple times (in... Figure 3 The example shown is a five-times emission pattern that emits air containing odor components. Therefore, a cycle is defined as the time interval (unit time) in which the emission time of performing multiple emissions and the stop time of not performing emissions are repeated alternately, and the emission of air containing odor components is performed periodically during an emission period.

[0125] Figure 4 An example of control processing is illustrated, wherein the emission period is set such that an active shutdown period is provided as a shutdown period during the activity period for a certain period of time after the start of the user's activity period.

[0126] exist Figure 4 In the control process shown, a first emission period is set to coincide with a first active period, a first shutdown period is set between the first and second active periods, and a second emission period is set to coincide with the second active period. Then, a second shutdown period is provided, starting after the end of the second active period and continuing until a certain time has elapsed after the start of the third active period; the second shutdown period during the third active period acts as an active shutdown period. After the second shutdown period ends, the third emission period begins. Furthermore, as shown, in each of the first to third emission periods, multiple emissions are intermittently performed for each cycle (unit of time).

[0127] In this way, by providing a proactive shutdown period within a certain time frame after the start of a new activity period, the proactive shutdown period can be used as a period of emotional change for the activity.

[0128] For example, it is preferable to provide active shut-off periods in this way to extend the shut-off period, such as when switching from a focused activity like work or reading, when switching after a meal (to prevent odor mixing), when the same type of odor is presented for two activities (e.g., orange and lemon), when the user has become accustomed to the odors perceived up to that point, and in environments where the odor is not expected to reach the nose (e.g., when it is windy).

[0129] Figure 5An example is shown where the emission period is set such that an active shutdown period is provided as a shutdown period within the activity period, which occurs for a certain period before the end of the user's activity period.

[0130] exist Figure 5 In the control process shown, a first emission period is set to coincide with a first active period, a first shutdown period is set between the first and second active periods, and a second emission period begins at the start of the second active period. Then, before the end of the second active period, the second emission period ends and the second shutdown period begins, and the second shutdown period during the second active period acts as an active shutdown period. After the end of the second shutdown period, a third active period and a third emission period begin. Furthermore, as shown, in each of the first to third emission periods, multiple emissions are intermittently performed for each cycle (unit of time).

[0131] In this way, by providing a closing period within a certain timeframe before the end of the activity period, the closing period can be used as a period of emotional change during the activity. For example, in the odor presentation control system 11, the presentation control unit 28 can start the closing period before the end of the activity period by understanding the user's activity plan through links with other information (such as links with schedules). Then, the end of the activity period can be determined based on the recognition results obtained by the situation recognition unit 24.

[0132] For example, it is preferable to provide active shut-off periods in this way to extend the shut-off period, such as when switching from a focused activity like work or reading using a schedule, when switching after a meal using recognition results (to prevent odor mixing), when presenting the same type of odor for two activities using a schedule (e.g., oranges and lemons), when the user has become accustomed to the odors perceived up to that point, and in environments where the odor is not expected to reach the nose (e.g., when it is windy).

[0133] Figure 6 An example is shown where the emission period is set such that a control process is provided for a fade-in period in which the odor is perceived as gradually increasing in intensity over a certain period of time after the start of the user's activity period.

[0134] exist Figure 6In the control process shown, a first emission period is set to coincide with a first active period, and a first shutdown period is set between the first and second active periods. Then, in a second emission period that begins concurrently with the second active period, a fade-in period is provided in which the odor is perceived as gradually increasing in intensity. Subsequently, after the second active period and the second emission period end, a second shutdown period is set between the second and third active periods, and a third emission period is set to coincide with the third active period. Furthermore, as shown, in each of the first to third emission periods, multiple emissions are performed intermittently for each cycle (unit of time), and in the example shown, the fade-in period is provided in the first cycle of the second emission period. Note that the fade-in period can be provided across multiple cycles.

[0135] In this way, a natural way of entering an activity can be achieved by providing a fade-in period within a certain timeframe after the start of a new activity period. For example, the fade-in period can be achieved as a way of perceiving odors by gradually extending the emission time of intermittent emissions.

[0136] For example, it is preferable to provide fade-in times in this manner when the smell is presented to an infant during rest periods, when the smell is presented (e.g., fade-in according to the acceleration of the vehicle), when the concentration of the smell increases as the driving condition approaches a dangerous situation (e.g., speed and distance to the white line), when the way the smell is perceived in relation to the activity state is close to a threshold, when listening to music or watching a movie, such as at the beginning of the music or movie, when the movie scene changes rapidly, when there is active conversation (when the user does not want to be disturbed), during focused activities such as working or reading, and when the smell is presented in a way that assumes that the meal is being enjoyed in a specific environment (e.g., near the sea or forest, or near a flower bed) (fading in allows for a more natural entry into the environment).

[0137] Figure 7 An example is shown where the emission period is set such that a fade-out period is provided during a certain time before the end of the user's activity period, in which the odor is perceived as gradually weakening.

[0138] exist Figure 7In the control process shown, at the end of the first emission period, which begins concurrently with the first active period, a fade-out period is provided where the odor is perceived to gradually weaken. Subsequently, a first shut-off period is set between the first and second active periods, a second emission period is set to coincide with the second active period, a second shut-off period is set between the second and third active periods, and a third emission period is set to coincide with the third active period. Furthermore, as shown, in each of the first to third emission periods, multiple emissions are performed intermittently for each cycle (unit of time), and in the illustrated example, a fade-out period is provided in the final cycle of the first emission period. Note that the fade-out period can be set to span multiple cycles.

[0139] In this way, by providing a fade-out period before the end of the activity period, it is possible to end the activity naturally. For example, the fade-out period can be achieved by gradually extending the emission time of intermittent emissions as a way to perceive odors.

[0140] For example, fade-out periods are preferably provided in this way when listening to music or watching movies, such as when the music or movie fades out (especially when the movie ends with very few changes in the visuals), when there is active conversation, when focused on work or reading, and when the scent is finished being presented to the baby.

[0141] It's important to note that in addition to controlling the duration of each emission, fade-in and fade-out can also be controlled, for example, by gradually decreasing or increasing the concentration of odor components in the emitted air. That is, fade-in and fade-out can be achieved by using fragrance cartridges with different concentrations or by changing the airflow speed of the emitted air containing odor components. For instance, with all conditions except airflow speed constant, increasing the airflow speed can make the user perceive a stronger odor, and decreasing the airflow speed can make the user perceive a weaker odor.

[0142] Furthermore, odor switching can be controlled by extending the emission period or extending the shutdown period. Additionally, odor switching can be controlled by abruptly switching between emission and shutdown periods, or by performing a fade-in or fade-out operation.

[0143] For example, when the ratio of emission time to shutdown time is 1:1, the latter half of the emission time can be set to fade out, and the shutdown time can be gradually extended relative to the emission time, or the emission time and shutdown time can remain unchanged. For example, when falling asleep, it is preferable to gradually change to a relaxing scent. Furthermore, when a person with an unpleasant odor enters the vehicle, it is preferable to gradually change the scent to a level that will not cause the user to notice too much change. In addition, the scent can be suddenly changed according to the vehicle's acceleration, the scent can be gradually switched according to the overall journey, the scent can be quickly stopped when eating or drinking begins, and the scent can be controlled to approach a comfortable value based on feedback from past use (user's impressions or evaluations) and sensing status.

[0144] Furthermore, the odor presentation control system 11 can control the interval between emission and shutdown periods using valves, fans, fragrance boxes, etc., and can change the intensity of the odor. For example, the odor presentation control system 11 can abruptly change the odor by turning valves and fans on and off, and by opening and closing valves (or emission ports) and changing the speed of the fan. Additionally, the odor presentation control system 11 can abruptly change the odor by changing the speed of the fan behind the fragrance box and by changing the opening and closing times of the fragrance box valve. For example, even if the airflow is the same when the valve is gradually closed, the propagation of the odor will change when the airflow speed of the emitted air changes.

[0145] Furthermore, even in structures where multiple fragrance boxes and valves exist, and air is blown by a single fan, the odor presentation control system 11 can change the intensity (weak / medium / strong) of the odor by controlling the number of valves to be activated. Additionally, the odor presentation control system 11 can control whether the odor is presented at a fixed point or over a wide area by changing the propagation of the airflow used to blow air containing the odor components (the opening width of the exhaust port), and can allow the user to perceive differences in concentration.

[0146] Furthermore, the odor presentation control system 11 can set the odor fade-in or fade-out based on activity states monitored using thresholds set for sleep, vehicle acceleration, and infants, such that the odor becomes stronger when the absolute value decreases relative to the threshold, and becomes weaker when the absolute value increases. Similarly, the odor presentation control system 11 can set the odor fade-in or fade-out when music ends, when the amount of change in a video is significant, when there is active conversation, when the user is engrossed in other things (such as reading or working), after meals, and before meals (when the user wants to eat while creating a specific atmosphere).

[0147] Furthermore, the scent presentation control system 11 can abruptly turn on / off the presentation of scent during a meal (when the user wishes to eat without fragrance), when a threshold is suddenly exceeded, when a conversation is inactive, when experiencing motion sickness, and at the start or end of a focused work period.

[0148] Furthermore, the scent presentation control system 11 can set the off period to be longer based on internal factors (for example, when it is desired to suppress the user from getting accustomed to the scent), external factors (for example, when it is desired to prevent other scents from mixing), and in environments where the scent is not expected to reach the nose (for example, when the wind is strong).

[0149] <Display Example of UI Screen>

[0150] Reference will be made to Figures 8 to 13 describe a display example of the UI screen displayed on the touch panel of the input unit 21.

[0151] Figure 8 shows an example of a UI screen on which graphical user interface (GUI) buttons for instructing setting of an operation mode and GUI buttons for instructing user setting are arranged. For example, this UI screen is displayed when activation of the scent presentation control system 11 is instructed.

[0152] On the UI screen shown in Figure 8 , the name of the selected operation mode (the XX mode in the example shown in Figure 8 ) is displayed next to the GUI button for instructing setting of the operation mode. Furthermore, on the UI screen, the name of the selected user (User 1 in the example shown in Figure 8 ) is displayed next to the GUI button for instructing user setting.

[0153] Then, when the user performs an operation on the GUI button for instructing setting of the operation mode, a UI screen on which UI buttons for selecting the operation mode for which details are to be set is arranged is displayed as shown in Figure 9 .

[0154] On the UI screen shown in Figure 9 , there are arranged a GUI button for selecting detailed settings of the automatic mode, a GUI button for instructing selection of detailed settings of the dining mode, a GUI button for selecting detailed settings of the sleep mode, a GUI button for selecting detailed settings of the map mode, and a GUI button for selecting detailed settings of the reading mode.

[0155] Then, when the user performs an operation on any of the GUI buttons, a UI screen on which UI buttons for instructing detailed settings of the selected operation mode are arranged is displayed as shown in Figure 10 .

[0156] exist Figure 10 The UI screen shown has indicators for... Figure 9 The UI screen displays detailed settings for the selected operation mode via UI buttons, as well as GUI buttons for indicating how to switch between the selected operation modes. Additionally, the UI screen displays the name of the selected operation mode. Figure 10 The example shown uses the ○○ pattern and the name of the selected user. Figure 10 User 1 in the example shown.

[0157] Then, when the user operates the UI button that indicates detailed settings for the operating mode and, for example, selects a setting for the intensity of the scent to be presented in the operating mode, a UI screen is displayed for specifying, for example, the intensity of the scent to be presented in the operating mode, such as... Figure 11 As shown.

[0158] exist Figure 11 The UI shown has a GUI for specifying the intensity of the odor in the range of 0 to 100, and displays the state where 50 is set as the reference level.

[0159] In addition, for example, when the user is Figure 9 When the user interacts with the GUI buttons for selecting detailed settings in sleep mode and chooses the type of scent to be displayed in sleep mode, a UI screen for selecting the type of scent to be displayed in sleep mode appears, such as... Figure 12 As shown.

[0160] exist Figure 12 The UI screen shows GUI buttons for selecting lavender, lemon, and mint, representing the scents presented in sleep mode. For example, in sleep mode, the lavender scent is set to 100% as the standard setting (lemon and mint are set to 0%). Furthermore, users can interact with the lemon button to adjust the lemon scent concentration, or with the mint button to adjust the mint scent concentration.

[0161] For example, the scent of lavender can promote relaxation and sleep, the scent of lemon can improve mood and refresh the mind, and the scent of peppermint can promote refreshment and concentration.

[0162] Figure 13 An example of a UI screen for inputting emission conditions is shown.

[0163] exist Figure 13 The UI screen displayed shows the name of the operating mode for the emission conditions to be evaluated. Figure 13 The example shown (○○ pattern) and the name of the user performing the evaluation ( Figure 13 User 1 in the example shown. Then, on this UI screen, a five-level rating can be performed on the overall, strength, and spice items (selecting the number of stars worth evaluating), and the user can enter comments for each item.

[0164] By performing operations on the UI screen as described above, input to the input unit 21 can be performed in the odor presentation control system 11.

[0165] Meanwhile, the above Figure 11 The UI shown is based on standard settings that correspond to initial conditions, in which the odor intensity is set to 50, and the aforementioned... Figure 12 The UI shown is based on standard settings that correspond to initial conditions, in which the lavender scent is set to 100%. Users can adjust the desired scent intensity, desired scent ratio, etc., by performing operations on the UI displayed based on their own standard settings.

[0166] Then, the odor presentation control system 11 can store instances of routine operations performed by the user to make adjustments on the UI screen, can learn based on the user's operation history, and can reflect customized settings on the UI screen based on the learning results. With this arrangement, when the odor presentation control system 11 learns that the user is making similar adjustments on the UI screen based on standard settings in a certain operating mode, the odor presentation control system 11 can reflect the learning results and display a UI screen based on customized settings, in which the user's desired adjustments have been set.

[0167] For example, such as Figure 14 As shown at the top, in sleep mode, a UI screen based on standard settings is displayed, corresponding to the initial condition where the lavender scent is set to 100%. Then, when the user repeatedly adjusts the lavender scent to 90% and the mint scent to 10% on this UI screen, the system learns from the user's operation history and displays a UI screen with customized settings based on the learned results. That is, as... Figure 14 The lower part of the image shows a UI screen based on custom settings, in which the lavender scent has been set to 90% and the mint scent to 10%.

[0168] In this way, the scent presentation control system 11 learns based on the user's operation history and displays a UI screen that reflects customized settings optimized for the user, such as presenting scents customized according to the user's preferences without requiring the user to perform any operation on the UI screen.

[0169] In addition, the odor presentation control system 11 can also know the situation when the user performs operations on the UI screen (such as temperature, time, day of the week, driving information, music, lighting, number of passengers, departure point, destination and other information), and can therefore display a UI screen optimized for the user for each situation.

[0170] Note that the odor presentation control system 11 is provided with operating modes such as positive mode, relaxation mode, rainy day mode, sunny day mode, morning mode and night mode, and when entering the next morning mode (or other similar modes, such as positive mode), the customized settings based on the above learning results can be reflected on the UI screen.

[0171] It should be noted that the odor presentation control system 11 can be applied to other use cases besides the above-described use case of installation and use in a vehicle, such as use cases of presenting odors based on the user's activity status in places where people stay (e.g., living room, sitting room, or workplace).

[0172] <Computer Configuration Example>

[0173] Next, the aforementioned series of processes (control methods) can be executed using hardware or software. In the case where the processes are executed by software, the program implementing that software is installed on a general-purpose computer or similar device.

[0174] Figure 15 This is a block diagram illustrating an example of a computer hardware configuration that performs the above series of processes according to a program.

[0175] In the computer, the central processing unit (CPU) 101, read-only memory (ROM) 102, random access memory (RAM) 103, and electronically erasable programmable read-only memory (EEPROM) 104 are connected to each other via bus 105. Furthermore, input / output interface 106 is connected to bus 105 and is also connected to an external device.

[0176] In the computer configured as described above, for example, the CPU 101 performs the aforementioned series of processes by loading a program stored in ROM 102 and EEPROM 104 onto RAM 103 via bus 105 and executing the program. Furthermore, the program to be executed by the computer (CPU 101) can be pre-written into ROM 102, or can be installed or updated from the outside via input / output interface 106 into EEPROM 104.

[0177] Here, in the description herein, the processes executed by the computer according to the program do not necessarily execute sequentially in the order described in the flowchart. That is, the processes executed by the computer according to the program also include processes executed in parallel or individually (e.g., parallel processing or object-based processing).

[0178] Furthermore, a program can be processed by a single computer (processor) or by multiple computers in a distributed manner. Additionally, a program can be executed by transferring it to a remote computer.

[0179] Furthermore, in this description, a system is defined as a collection of multiple components (such as devices or modules (parts)) regardless of whether all components are housed in the same housing. Therefore, multiple devices housed in a single housing and connected via a network, as well as a single device housing multiple modules, are both systems.

[0180] Furthermore, for example, a configuration described as a single device (or processing unit) can be partitioned and configured into multiple devices (or processing units). Conversely, a configuration described as multiple devices (or processing units) can be integrated into a single device (or processing unit). Moreover, any configuration other than those described above can, of course, be added to the configuration of each device (or each processing unit). Furthermore, as long as the overall system configuration and operation are substantially the same, a portion of the configuration of one device (or processing unit) can be included in the configuration of another device (or another processing unit).

[0181] Furthermore, for example, this technology can have a cloud computing configuration in which a function is shared by multiple devices, enabling processing to be performed in a coordinated manner via a network.

[0182] Furthermore, for example, the above procedure can be executed by any device. In this case, it is only necessary that the device has the required functions (function blocks, etc.) and be able to obtain the necessary information.

[0183] Furthermore, for example, each step shown in the flowchart above can be executed by one device or by multiple devices in a distributed manner. Additionally, in cases where a step comprises multiple processes, the multiple processes included in a single step can be executed by one device or by multiple devices in a distributed manner. In other words, multiple processes included in a single step can also be executed as multiple steps. Conversely, a process described as multiple steps can also be executed as a single step.

[0184] It should be noted that a program to be executed by a computer can be configured such that the steps describing the program are processed sequentially in the order described herein, or processed in parallel or separately as needed (e.g., when invoked). That is, steps can be processed in any order other than that described above, provided there is no inconsistency in the processing. Furthermore, the processing of the steps describing the program can be performed in parallel with the processing of another program, or it can be performed in combination with the processing of another program.

[0185] It should be noted that each of the various techniques described herein can be implemented independently as a single entity without inconsistency. Of course, any of the various techniques can also be implemented in combination. For example, a portion or all of the techniques described in one embodiment can be implemented in combination with a portion or all of the techniques described in another embodiment. Furthermore, a portion or all of any of the techniques can be implemented together with another technique not described above.

[0186] <Application Example>

[0187] The technology disclosed herein can be applied to a variety of products. For example, the technology disclosed herein can also be implemented as a device installed on any type of mobile body such as automobiles, electric vehicles, hybrid electric vehicles, motorcycles, bicycles, personal mobile devices, airplanes, drones, ships, robots, construction machinery, or agricultural machinery (tractors).

[0188] Figure 16 This is a block diagram schematically illustrating a configuration example of a vehicle control system 7000, which is an example of a mobile body control system to which the technology according to this disclosure can be applied. The vehicle control system 7000 includes multiple electronic control units interconnected via a communication network 7010. Figure 16In the example shown, the vehicle control system 7000 includes a drive system control unit 7100, a body system control unit 7200, a battery control unit 7300, an external information detection unit 7400, an internal information detection unit 7500, and an integrated control unit 7600. The communication network 7010 connecting the multiple control units can be, for example, an in-vehicle communication network conforming to any standard such as Controller Area Network (CAN), Local Interconnect Network (LIN), Local Area Network (LAN), or FlexRay (registered trademark).

[0189] Each control unit includes: a microcomputer that performs arithmetic processing according to various programs; a storage unit that stores programs executed by the microcomputer, parameters for various operations, etc.; and a drive circuit that drives various control target devices. Each control unit also includes: a network interface (I / F) for communicating with other control units via the communication network 7010; and a communication I / F for communicating with devices, sensors, etc. inside and outside the vehicle via wired or wireless communication. Figure 16 The functional components of the integrated control unit 7600 shown include a microcomputer 7610, a general communication I / F 7620, a dedicated communication I / F 7630, a positioning unit 7640, a beacon receiver 7650, an in-vehicle equipment I / F 7660, a voice / image output unit 7670, an in-vehicle network I / F 7680, and a storage unit 7690. Other control units similarly include microcomputers, communication I / Fs, storage units, etc.

[0190] The drive system control unit 7100 controls the operation of devices related to the vehicle's drive system according to various programs. For example, the drive system control unit 7100 functions as a control device for drive force generating devices such as internal combustion engines and drive motors that generate vehicle driving force, drive force transmission mechanisms that transmit driving force to the wheels, steering mechanisms that adjust the vehicle's steering angle, and braking devices that generate vehicle braking force. The drive system control unit 7100 may also function as a control device for systems such as anti-lock braking systems (ABS) and electronic stability control (ESC).

[0191] The drive system control unit 7100 is connected to the vehicle condition detection unit 7110. The vehicle condition detection unit 7110 includes, for example, at least one of a gyroscope sensor, an acceleration sensor, and sensors that detect the amount of operation of the accelerator pedal, the amount of operation of the brake pedal, the steering angle of the steering wheel, engine speed, or wheel speed. The gyroscope sensor detects the angular velocity of the axial rotational motion of the vehicle body, and the acceleration sensor detects the vehicle's acceleration. The drive system control unit 7100 performs arithmetic processing using signals input from the vehicle condition detection unit 7110 and controls the internal combustion engine, drive motor, electric power steering, braking system, etc.

[0192] The vehicle body system control unit 7200 controls the operation of various devices installed on the vehicle body according to various programs. For example, the vehicle body system control unit 7200 is used as a control device for keyless entry systems, smart key systems, power windows, or various lights such as headlights, rearview lights, brake lights, turn signals, fog lights, etc. In this case, radio waves or signals from various switches, which can be transmitted from mobile devices as a substitute for keys, can be input to the vehicle body system control unit 7200. The vehicle body system control unit 7200 receives these input radio waves or signals and controls the vehicle's door locking devices, power windows, lights, etc.

[0193] The battery control unit 7300 controls the secondary battery 7310, which serves as a power source for the drive motor, according to various programs. For example, information from the battery device, including the secondary battery 7310, is provided to the battery control unit 7300 regarding battery temperature, battery output voltage, remaining charge in the battery, etc. The battery control unit 7300 uses these signals to perform arithmetic processing and executes controls to adjust the temperature of the secondary battery 7310 or to control cooling devices set in the battery device, etc.

[0194] The exterior information detection unit 7400 detects information about the exterior of the vehicle, including the vehicle control system 7000. For example, the exterior information detection unit 7400 is connected to at least one of the imaging unit 7410 and the exterior information detection unit 7420. The imaging unit 7410 includes at least one of a time-of-flight (ToF) camera, a stereo camera, a monocular camera, an infrared camera, and other cameras. The exterior information detection unit 7420 includes, for example, at least one of an environmental sensor and a surrounding information detection sensor, the environmental sensor for detecting current atmospheric or weather conditions, and the surrounding information detection sensor for detecting other vehicles, obstacles, pedestrians, etc., around the vehicle including the vehicle control system 7000.

[0195] The environmental sensor can be at least one of a raindrop sensor for detecting rain, a fog sensor for detecting fog, a sunlight sensor for detecting sunlight intensity, and a snow sensor for detecting snowfall. The surrounding information detection sensor can be at least one of an ultrasonic sensor, a radar device, and a LIDAR device (light detection and ranging device or laser imaging detection and ranging device). Each of the imaging unit 7410 and the exterior information detection unit 7420 can be provided as an independent sensor or device, or can be provided as a device that integrates multiple sensors or devices.

[0196] here, Figure 17Examples of the mounting positions of the imaging unit 7410 and the vehicle exterior information detection unit 7420 are shown. Imaging units 7910, 7912, 7914, 7916, and 7918 are, for example, located at at least one of the following positions: the front nose of the vehicle 7900, the side mirrors, the rear bumper, and the rear door, as well as at the upper part of the windshield inside the vehicle. The imaging unit 7910 located at the front nose and the imaging unit 7918 located at the upper part of the windshield inside the vehicle primarily acquire images of the front of the vehicle 7900. The imaging units 7912 and 7914 located at the side mirrors primarily acquire images of the sides of the vehicle 7900. The imaging unit 7916 located at the rear bumper or the rear door primarily acquires images of the rear of the vehicle 7900. The imaging unit 7918 located at the upper part of the windshield inside the vehicle is mainly used to detect vehicles ahead, pedestrians, obstacles, signals, traffic signs, lanes, etc.

[0197] Note that, Figure 17 Examples of the imaging range of each of imaging units 7910, 7912, 7914, and 7916 are shown. Imaging range a represents the imaging range of imaging unit 7910 located at the front nose. Imaging ranges b and c represent the imaging ranges of imaging units 7912 and 7914 located at the side mirrors, respectively. Imaging range d represents the imaging range of imaging unit 7916 located at the rear bumper or rear door. For example, a bird's-eye view of the vehicle 7900 viewed from above can be obtained by overlaying the image data captured by imaging units 7910, 7912, 7914, and 7916.

[0198] Exterior information detection units 7920, 7922, 7924, 7926, 7928, and 7930, located at the front, rear, sides, corners, and above the windshield inside the vehicle 7900, can be, for example, ultrasonic sensors or radar devices. Exterior information detection units 7920, 7926, and 7930, located at the front nose, rear bumper, rear door, and above the windshield inside the vehicle 7900, can be, for example, LIDAR devices. These exterior information detection units 7920 to 7930 are primarily used to detect vehicles ahead, pedestrians, obstacles, etc.

[0199] Return to reference Figure 16Continuing the description, the exterior information detection unit 7400 causes the imaging unit 7410 to image an image of the exterior of the vehicle and receives the image data. Furthermore, the exterior information detection unit 7400 receives detection information from an exterior information detection unit 7420 connected to it. If the exterior information detection unit 7420 is an ultrasonic sensor, radar device, or LIDAR device, the exterior information detection unit 7400 transmits ultrasonic waves, electromagnetic waves, etc., and receives information about the received reflected waves. Based on the received information, the exterior information detection unit 7400 can perform processing to detect objects such as humans, vehicles, obstacles, signs, characters on the road surface, etc., or to detect their distance. The exterior information detection unit 7400 can perform environmental recognition processing based on the received information, such as identifying rainfall, fog, road conditions, etc. The exterior information detection unit 7400 can calculate the distance to objects outside the vehicle based on the received information.

[0200] Furthermore, based on the received image data, the exterior information detection unit 7400 can perform image recognition processing to identify objects such as humans, vehicles, obstacles, signs, and characters on the road surface, or to detect their distance. The exterior information detection unit 7400 can subject the received image data to processing such as distortion correction and alignment, and combine image data captured by multiple different imaging units 7410 to generate a bird's-eye view or panoramic image. The exterior information detection unit 7400 can perform viewpoint conversion processing using image data captured by imaging units 7410 including different imaging components.

[0201] The in-vehicle information detection unit 7500 detects information about the interior of the vehicle. The in-vehicle information detection unit 7500 is connected, for example, to a driver state detection unit 7510 that detects the driver's state. The driver state detection unit 7510 may include a camera that images the driver, a biosensor that detects the driver's biological information, a microphone that collects sounds from inside the vehicle, etc. The biosensor is disposed, for example, on the seat surface, steering wheel, etc., and detects the biological information of occupants sitting in the seat or the driver holding the steering wheel. Based on the detection information input from the driver state detection unit 7510, the in-vehicle information detection unit 7500 can calculate the driver's fatigue level or concentration level, or determine whether the driver is drowsy. The in-vehicle information detection unit 7500 can process the audio signals obtained through sound collection, such as through noise cancellation processing.

[0202] The integrated control unit 7600 controls the routine operations within the vehicle control system 7000 according to various programs. The integrated control unit 7600 is connected to the input unit 7800. The input unit 7800 is implemented by a device capable of input operation by an occupant, such as a touch panel, button, microphone, switch, lever, etc. The integrated control unit 7600 can provide data obtained through voice recognition of voice input via a microphone. The input unit 7800 can be, for example, a remote control device using infrared or other radio waves, or an external connection device such as a mobile phone or personal digital assistant (PDA) that supports the operation of the vehicle control system 7000. The input unit 7800 can be, for example, a camera. In this case, the occupant can input information through gestures. Alternatively, data obtained by detecting the movement of a wearable device worn by the occupant can be input. Furthermore, the input unit 7800 may include, for example, an input control circuit that generates an input signal based on information input by an occupant using the aforementioned input unit 7800 and outputs the generated input signal to the integrated control unit 7600. Passengers can input various data or give instructions for processing operations to the vehicle control system 7000 through the operation input unit 7800.

[0203] The storage unit 7690 may include a read-only memory (ROM) for storing various programs executed by a microcomputer and a random access memory (RAM) for storing various parameters, operation results, sensor values, etc. Furthermore, the storage unit 7690 may be implemented using magnetic storage devices (such as hard disk drives (HDDs), semiconductor storage devices, optical storage devices, magneto-optical storage devices, etc.

[0204] The General Communication I / F 7620 is a widely used communication I / F that facilitates communication with various devices present in the external environment 7750. The General Communication I / F 7620 can implement cellular communication protocols such as GSM, WiMAX, LTE, LTE-A, etc., or other wireless communication protocols such as Wireless LAN (also known as Wi-Fi), Bluetooth, etc. The General Communication I / F 7620 can connect, for example, via a base station or access point to devices (e.g., application servers or control servers) present on external networks (e.g., the Internet, cloud networks, or corporate private networks). Furthermore, the General Communication I / F 7620 can connect, for example, using peer-to-peer (P2P) technology to terminals present near the vehicle (e.g., terminals belonging to drivers, pedestrians, or shopkeepers, or machine-type communication (MTC) terminals).

[0205] The Dedicated Communications I / F 7630 is a communications I / F that supports communication protocols developed for use in vehicles. The Dedicated Communications I / F 7630 can implement standard protocols such as Wireless Access to the In-Vehicle Environment (WAVE), a combination of IEEE 802.11p as the lower layer and IEEE 1609 as the higher layer, Dedicated Short Range Communications (DSRC), or cellular communication protocols. The Dedicated Communications I / F 7630 typically performs V2X communication as one or more of the following concepts: vehicle-to-vehicle communication, road-to-vehicle communication (vehicle-to-infrastructure), vehicle-to-home communication (vehicle-to-home), and pedestrian-to-vehicle communication (vehicle-to-pedestrian).

[0206] The positioning unit 7640 performs positioning, for example, by receiving Global Navigation Satellite System (GNSS) signals from GNSS satellites (e.g., GPS signals from Global Positioning System (GPS) satellites) and generates location information including the vehicle's latitude, longitude, and altitude. Incidentally, the positioning unit 7640 can identify its current location by exchanging signals with a wireless access point, or it can obtain location information from a terminal with positioning capabilities, such as a mobile phone, a Personal Handheld Phone System (PHS), or a smartphone.

[0207] The beacon receiver 7650 receives, for example, radio waves or electromagnetic waves transmitted from a radio station installed on the road, thereby obtaining information about current location, road congestion, road closures, and estimated time. Incidentally, the dedicated communication I / F 7630 described above may include the functions of the beacon receiver 7650.

[0208] The vehicle-mounted device I / F 7660 is a communication interface between the microcomputer 7610 and various vehicle-mounted devices 7760 present in the vehicle. The vehicle-mounted device I / F 7660 can establish a wireless connection using wireless communication protocols such as Wireless LAN, Bluetooth (registered trademark), Near Field Communication (NFC), or Wireless Universal Serial Bus (WUSB). Furthermore, the vehicle-mounted device I / F 7660 can establish a wired connection via Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI (registered trademark)), Mobile High Definition Link (MHL), etc., via connection terminals not shown in the accompanying drawings (or via cable if necessary). The vehicle-mounted device 7760 may include, for example, at least one of mobile devices and wearable devices owned by the occupants, and information devices brought into or attached to the vehicle. The vehicle-mounted device 7760 may also include a navigation device that searches for a path to any destination. The vehicle-mounted device I / F 7660 exchanges control signals or data signals with these vehicle-mounted devices 7760.

[0209] The vehicle network I / F 7680 is a communication interface between the microcomputer 7610 and the communication network 7010. The vehicle network I / F 7680 sends and receives signals according to a predetermined protocol supported by the communication network 7010.

[0210] The microcomputer 7610 of the integrated control unit 7600 controls the vehicle control system 7000 according to various programs based on information obtained via at least one of the following: general communication I / F 7620, dedicated communication I / F 7630, positioning unit 7640, beacon receiving unit 7650, vehicle-mounted equipment I / F 7660, and vehicle-mounted network I / F 7680. For example, the microcomputer 7610 can calculate control target values ​​for the drive force generating device, steering mechanism, or braking device based on obtained information about the vehicle's interior and exterior, and output control commands to the drive system control unit 7100. For example, the microcomputer 7610 can perform cooperative control aimed at realizing functions of advanced driver assistance systems (ADAS), including collision avoidance or impact mitigation, following distance-based driving, speed maintenance driving, collision warning, lane departure warning, etc. Furthermore, the microcomputer 7610 can perform cooperative control aimed at realizing automated driving by controlling the drive force generating device, steering mechanism, braking device, etc., based on obtained information about the vehicle's surrounding environment, which allows the vehicle to drive automatically without relying on driver operation.

[0211] The microcomputer 7610 can generate three-dimensional distance information between the vehicle and objects such as surrounding structures and people based on information obtained via at least one of the following: general communication I / F 7620, dedicated communication I / F 7630, positioning unit 7640, beacon receiving unit 7650, vehicle-mounted equipment I / F 7660, and vehicle-mounted network I / F 7680. It also generates local map information including information about the environment surrounding the vehicle's current location. Furthermore, the microcomputer 7610 can predict hazards such as vehicle collisions, pedestrian approach, and entry into closed roads based on the obtained information and generate warning signals. These warning signals can be, for example, signals used to generate warning sounds or illuminate warning lights.

[0212] The sound / image output unit 7670 sends an output signal of at least one of sound and image to an output device capable of visually or audibly providing notification information to the occupants of the vehicle or to external sources. Figure 16In the example, an audio speaker 7710, a display unit 7720, and a dashboard 7730 are shown as output devices. The display unit 7720 may include, for example, at least one of an in-vehicle display and a head-up display. The display unit 7720 may have augmented reality (AR) display functionality. The output device can be any device other than these, and may be other devices such as headphones, wearable devices like glasses-type displays worn by occupants, projectors, lamps, etc. When the output device is a display device, the display device visually displays the results obtained from various processes executed by the microcomputer 7610 or information received from another control unit in various forms such as text, images, tables, and graphics. Furthermore, when the output device is an audio output device, the audio output device converts an audio signal composed of reproduced audio data or sound data into an analog signal and audibly outputs the analog signal.

[0213] Note that in Figure 16 In the example shown, at least two control units connected to each other via communication network 7010 can be integrated into one control unit. Alternatively, each individual control unit may include multiple control units. Furthermore, the vehicle control system 7000 may include other control units not shown in the figures. Additionally, some or all of the functions performed by one control unit as described above can be assigned to another control unit. That is, any control unit can perform predetermined arithmetic processing, as long as information is sent and received via communication network 7010. Similarly, sensors or devices connected to one control unit can be connected to another control unit, and multiple control units can send and receive detection information to each other via communication network 7010.

[0214] <Examples of configuration combinations>

[0215] Note that this technology can also have the following configurations.

[0216] (1) A control device, comprising: A status recognition unit identifies the user's activity status; and The presentation control unit controls the emission of air containing odor components to control the presentation of odors to the user. The presentation control unit sets the shutdown period for odor emission based on the user's activity status.

[0217] (2) The control device described in (1) above, The presentation control unit sets a shutdown period for odor emission to be turned off within a certain time period after the start of the user's activity period.

[0218] (3) The control device according to (1) or (2) above, The presentation control unit sets a shutdown period for odor emission to be turned off within a certain time period before the end of the user's activity period.

[0219] (4) The control device according to any one of (1) to (3) above, The presentation control unit sets a gradual entry period for a certain period of time after the start of the user's activity period, during which the smell is perceived as gradually increasing.

[0220] (5) The control device according to any one of (1) to (4) above, The presentation control unit sets a fade-out period for a certain period of time before the end of the user's activity period, during which the odor is perceived as gradually weakening.

[0221] (6) The control device according to any one of (1) to (5) above, Specifically, during the emission period when odor emission is performed based on the user's activity status, air containing odor components is emitted in an intermittent, multiple emission pattern.

[0222] (7) The control device according to any one of (1) to (6) above, The presentation control unit controls the presentation of odors to the user based on the emission conditions set for each operating mode or each user.

[0223] (8) The control device according to any one of (1) to (7) above, further comprising: The determining unit determines whether a change in the user's activity state has been detected based on the identification result obtained by the status identification unit, and if a change in the user's activity state has been detected, determines whether to change the emission conditions based on the change in activity state. The presentation control unit changes the emission conditions based on the determination result obtained by the determination unit.

[0224] (9) The control device according to any one of (1) to (8) above, further comprising: The storage unit stores the assessment of emission conditions input by the user. The presentation control unit provides feedback on the evaluation in subsequent instances.

[0225] (10) The control device according to any one of (1) to (9) above, further comprising: The linkage control unit controls the linkage unit that operates in coordination with the odor presented under the control of the presentation control unit.

[0226] (11) The control device according to any one of (1) to (10) above, The status recognition unit identifies the activity status of users other than the user to whom the odor is to be presented, and The presentation control unit controls the presentation of odors to the user to whom the odor is to be presented, based on the activity status of the other users.

[0227] (12) The control device according to any one of (1) to (11) above, The presentation control unit controls the odor intensity based on information indicating whether the environment in which the odor is presented is open.

[0228] (13) The control device according to any one of (1) to (12) above, The learning process is based on the user's operational history with the user interface (UI) screen set according to the initial conditions, and the customized settings based on the learning results are reflected on the UI screen.

[0229] (14) A control method, comprising: The control device identifies the user's activity status; and The control device controls the emission of air containing odor components to control the odor presentation to the user. The system sets the shutdown period for odor emissions based on the user's activity status.

[0230] (15) A program for causing a computer controlling a device to perform the following processes: Identify the user's activity status; and Controlling the emission of air containing odor components to control the odor presentation to the user. The system sets the shutdown period for odor emissions based on the user's activity status.

[0231] Note that this embodiment is not limited to the above embodiment, and various modifications can be made without departing from the spirit of this disclosure. Furthermore, the effects described herein are merely examples and not limiting, and other effects can also be achieved.

[0232] List of reference numerals

[0233] 11 Odor Presentation Control System

[0234] 21 Input Section

[0235] 22 Storage Department

[0236] 23 Setting Adjustment Department

[0237] 24-Hour Situation Identification Department

[0238] 25 Determined Department

[0239] 26 Receiving Department

[0240] 27th Sending Department

Claims

1. A control device, comprising: The status recognition unit identifies the user's activity status; as well as The presentation control unit controls the emission of air containing odor components to control the presentation of odors to the user. The presentation control unit sets the shutdown period for odor emission based on the user's activity status.

2. The control device according to claim 1, in, The presentation control unit sets a shutdown period for odor emission to be turned off within a certain time period after the start of the user's activity period.

3. The control device according to claim 1, in, The presentation control unit sets a shutdown period for odor emission to be turned off within a certain time period before the end of the user's activity period.

4. The control device according to claim 1, in, The presentation control unit sets a gradual entry period for a certain period of time after the start of the user's activity period, during which the smell is perceived as gradually increasing in intensity.

5. The control device according to claim 1, in, The presentation control unit sets a fade-out period for a certain period of time before the end of the user's activity period, during which the odor is perceived as gradually weakening.

6. The control device according to claim 1, in, During the odor emission period based on the user's activity status, air containing odor components is emitted in an intermittent, multiple emission pattern.

7. The control device according to claim 1, in, The presentation control unit controls the presentation of odors to the user based on the emission conditions set for each operating mode or each user.

8. The control device according to claim 7, further comprising: The determining unit determines whether a change in the user's activity state has been detected based on the identification result obtained by the status identification unit, and if a change in the user's activity state has been detected, determines whether to change the emission conditions based on the change in activity state. The presentation control unit changes the emission conditions based on the determination result obtained by the determination unit.

9. The control device according to claim 8, further comprising: The storage unit stores the assessment of emission conditions input by the user. The presentation control unit provides feedback on the evaluation in subsequent instances.

10. The control device according to claim 1, further comprising: The linkage control unit controls the linkage unit that operates in coordination with the odor presented under the control of the presentation control unit.

11. The control device according to claim 1, in, The status recognition unit identifies the activity status of users other than the user to whom the odor is to be presented, and The presentation control unit controls the presentation of odors to the user to whom the odor is to be presented, based on the activity status of the other users.

12. The control device according to claim 1, in, The presentation control unit controls the odor intensity based on information indicating whether the environment in which the odor is presented is open.

13. The control device according to claim 1, in, The learning process is based on the user's operational history with the UI screen set according to the initial conditions, and the customized settings based on the learning results are reflected on the UI screen.

14. A control method, comprising: The user's activity status is identified through the control device; as well as The control device controls the emission of air containing odor components to control the odor presentation to the user. The system sets the shutdown period for odor emissions based on the user's activity status.

15. A program for causing a computer of a control device to perform processing, said processing comprising: Identify the user's activity status; as well as Controlling the emission of air containing odor components to control the odor presentation to the user. The system sets the shutdown period for odor emissions based on the user's activity status.

Images