Control device, control method, and program

Abstract

The present disclosure relates to a control device, a control method, and a program that make it possible to improve user experience through scent. The present invention comprises a situation recognition unit that recognizes an activity state of a user, and a presentation control unit that controls the discharge of air containing a scent component to control the presentation of the scent to the user. On the basis of the activity state of the user, the presentation control unit sets an OFF period in which the discharge of the scent is set to OFF. For example, the OFF period in which the discharge of the scent is set to OFF is set in a fixed period after the start of an active period in which the user is active. The present technology can be applied to, for example, a scent presentation control system that controls the presentation of a scent in a vehicle.

Description

Control device, control method, and program

[0001] The present disclosure relates to a control device, a control method, and a program, and more particularly to a control device, a control method, and a program that are capable of improving the user experience through scent.

[0002] BACKGROUND ART Conventionally, development of technology for presenting odors inside a vehicle has been progressing, for example, for the purpose of relaxing the vehicle driver or encouraging the driver to be alert.

[0003] Patent document 1 discloses a vehicle fragrance device that intermittently sprays a fragrance of an air freshener in a specified cycle in order to suppress olfactory adaptation of the occupants, repeating the cycle of spraying the fragrance and pausing a specified number of times, and then providing a pause period in which spraying of the fragrance of the air freshener is stopped for a predetermined period of time, and then repeating this cycle in a sequential manner.

[0004] Patent Document 2 discloses a fragrance system that, when it detects that a driver is drowsy, emits a different fragrance if the time that has passed since the fragrance was first emitted is short, and emits the same fragrance if the time that has passed since the fragrance was first emitted is not short.

[0005] International Publication No. 2011 / 001808 Japanese Patent Application Laid-Open No. 2019-215669

[0006] Incidentally, it is believed that the user experience can be improved by realizing control that presents an appropriate scent according to the user's activity status, compared to conventional technologies.

[0007] The present disclosure has been made in light of such circumstances, and aims to improve the user experience through scent.

[0008] A control device according to one aspect of the present disclosure includes a situation recognition unit that recognizes the activity status of a user, and a presentation control unit that controls the emission of air containing an odor component to control the presentation of the odor to the user, and the presentation control unit sets an off period for turning off the emission of the odor based on the activity status of the user.

[0009] A control method or program according to one aspect of the present disclosure includes recognizing a user's activity status and controlling the emission of air containing an odor component to control the presentation of the odor to the user, and an off period for turning off the emission of the odor is set based on the user's activity status.

[0010] In one aspect of the present disclosure, the activity status of a user is recognized, and the emission of air containing an odor component is controlled to control the presentation of the odor to the user. Then, an off period during which the emission of the odor is turned off is set based on the activity status of the user.

[0011] 1 is a block diagram showing an example of the configuration of an embodiment of an odor presentation control system to which the present technology is applied; FIG. 2 is a flowchart illustrating odor presentation control processing; FIG. 3 is a diagram showing an example of control processing in which an ejection period is set to coincide with a user's activity period; FIG. 4 is a diagram showing an example of control processing in which an active off period is set for a certain period after the user's activity period has begun; FIG. 5 is a diagram showing an example of control processing in which an active off period is set for a certain period before the user's activity period has ended; FIG. 6 is a diagram showing an example of control processing in which a fade-in period is set for a certain period after the user's activity period has begun; FIG. 7 is a diagram showing an example of control processing in which a fade-out period is set for a certain period before the user's activity period has ended; FIG. 8 is a diagram showing an example of a UI screen display on which a GUI button for instructing setting of an operation mode and a GUI button for instructing user settings are arranged; FIG. 9 is a diagram showing an example of a UI screen display on which a UI button for selecting an operation mode for setting details is arranged; FIG. 10 is a diagram showing an example of a UI screen display on which a UI button for instructing detailed setting of an operation mode is arranged; FIG. 11 is a diagram showing an example of a UI screen display on which a UI button for instructing detailed setting of an operation mode is arranged; It is a diagram for explaining that customization settings according to learning results are reflected on a UI screen. It is a block diagram showing an example of the configuration of an embodiment of a computer to which the present technology is applied. It is a block diagram showing an example of a schematic configuration of a vehicle control system. It is an explanatory diagram showing an example of the installation positions of an outside-vehicle information detection unit and an imaging unit.

[0012] Hereinafter, specific embodiments to which the present technology is applied will be described in detail with reference to the drawings.

[0013] <Configuration Example of Odor Presentation Control System> FIG. 1 is a block diagram showing a configuration example of an embodiment of an odor presentation control system to which the present technology is applied.

[0014] 1 , the odor presentation control system 11 is configured to include an input unit 21, a memory unit 22, a setting adjustment unit 23, a situation recognition unit 24, a determination unit 25, a receiving unit 26, a transmitting unit 27, a presentation control unit 28, an odor presentation unit 29, an interlocking control unit 30, and an interlocking unit 31. The odor presentation control system 11 can be mounted on a vehicle, for example, and can control the presentation of odors to passengers (hereinafter also referred to as users) in the vehicle, including the driver of the vehicle, by emitting air containing odor components (aroma components) resulting from the volatilization of a fragrance.

[0015] The input unit 21 is, for example, an information processing terminal equipped with a touch panel or the like, and displays a UI (User Interface) screen such as those shown in FIGS. 8 to 13 described below, which is used by the user to set the operation mode and input the discharge conditions.

[0016] The user can use the input unit 21 to set the operation mode to be executed by the odor presentation control system 11 (e.g., automatic mode, meal mode, sleep mode, map mode, reading mode, child mode, external environment (map / weather) mode, emotion mode, etc.). The user can use the input unit 21 to input detailed settings that are individual to each user. The user can use the input unit 21 to input the operation mode or the ejection conditions that are set for each user (e.g., odor intensity (air volume), odor type (fragrance / aroma), etc.). The user can use the input unit 21 to input an evaluation of the ejection conditions.

[0017] The memory unit 22 stores the operating mode input using the input unit 21 or the ejection conditions set for each user (such as detailed settings such as the intensity and type of odor, or settings adjusted to suit the user), and also stores the user's evaluation of the ejection conditions.

[0018] For example, in order to adjust the settings of the ejection conditions, the setting adjustment unit 23 acquires additional information such as the temperature and humidity of the location as needed and supplies the information to the presentation control unit 28 .

[0019] The situation recognition unit 24 acquires detection data detected by, for example, a motion sensor that detects the movements of a person inside a vehicle equipped with the odor presentation control system 11 and an odor sensor that detects odors inside the vehicle. The situation recognition unit 24 also acquires images captured by an in-vehicle camera, an in-vehicle sensor, an exterior camera, and an exterior sensor that detect the interior and exterior of the vehicle. The situation recognition unit 24 then recognizes the user's activity status inside the vehicle based on the detection data acquired from each sensor and the images acquired from each camera. Additionally, the situation recognition unit 24 may use vehicle location information, weather information, past data stored on a server, and the like to recognize the user's activity status inside the vehicle. The situation recognition unit 24 then supplies recognition information indicating the recognition result of the user's activity status inside the vehicle to the determination unit 25. Furthermore, when changing the discharge conditions in response to changes in the user's activity status inside the vehicle, the situation recognition unit 24 can directly supply the recognition information to the presentation control unit 28.

[0020] For example, the situation recognition unit 24 can recognize the driver's activity status, such as driving, resting, waiting at a traffic light, eating or drinking, listening to music, having a conversation, or feeling car sick. Furthermore, the situation recognition unit 24 can recognize the activity status of users other than the driver, such as looking at the scenery, sleeping, helping with navigation, enjoying games, smartphones, music, or the like, a crying child, eating or drinking, having a conversation, reading, working, exercising, a date, an event, or feeling car sick. The situation recognition unit 24 may also refer to the user's emotional information, vital sign information, the content of the conversation, location information, and the like.

[0021] The determination unit 25 determines whether a change in the user's activity status in the vehicle has been detected, according to the recognition information supplied from the situation recognition unit 24. When the determination unit 25 determines that a change in the user's activity status in the vehicle has been detected, the determination unit 25 determines whether to change the ejection conditions in accordance with the change in the activity status, and instructs the presentation control unit 28 to change the ejection conditions.

[0022] In addition, the judgment unit 25 can, for example, determine the operating mode to be executed by the odor presentation control system 11 based on information input using the input unit 21, or determine the user (person to whom the odor is to be presented) using the odor presentation control system 11.

[0023] The receiving unit 26 receives various types of information required for the presentation control unit 28 to control the presentation of odors from a control device external to the odor presentation control system 11 (e.g., an ECU (Electronic Control Unit) mounted on the vehicle, etc.), and supplies the information to the presentation control unit 28. For example, if the vehicle on which the odor presentation control system 11 is mounted is a movable convertible, the receiving unit 26 can receive opening / closing information indicating the open / closed state of the vehicle's roof from the ECU and supply the information to the presentation control unit 28. Similarly, the receiving unit 26 can receive opening / closing information indicating the open / closed state of the vehicle's windows (including, for example, roof windows) from the ECU and supply the information to the presentation control unit 28, not limited to cases in which the vehicle is a convertible. Furthermore, the receiving unit 26 can receive information indicating the degree to which the vehicle windows are open (for example, information indicating the degree to which the windows are open (such as a state in which the windows are fully open, a state in which the windows are only half open, or a state in which the windows are only one-third open) (open / close level information), information indicating how many windows are open at the same time (open window number information), and information indicating which windows are in an open / closed state (open window position information or closed window position information)) from the ECU and supply the information to the presentation control unit 28.

[0024] The transmission unit 27 acquires various information from the presentation control unit 28 that needs to be notified to a control device external to the presentation control system 11 as a result of the presentation control unit 28 controlling the presentation of the odor, and transmits the information to the control device external to the odor presentation control system 11.

[0025] The presentation control unit 28 controls the presentation of odors by the odor presentation unit 29 according to the user's activity status, operation mode, or emission conditions set for each user. For example, the presentation control unit 28 can set the type of odor, the duration of odor presentation, intermittent odor presentation, air volume, and air direction for the odor presentation unit 29. The presentation control unit 28 can change the emission conditions when the determination unit 25 determines that the emission conditions should be changed. The presentation control unit 28 can control the presentation of odors to the driver based on the activity status of users other than the driver. The presentation control unit 28 can also control the emission pattern in which the odor presentation unit 29 emits air containing odor components. For example, the presentation control unit 28 can control the emission period and off period, or control the fade-in or fade-out during the emission period, based on the user's activity status, as will be described later with reference to FIGS. 3 to 7.

[0026] The presentation control unit 28 can also control the intensity of the odor presented by the odor presentation unit 29 according to the open / close information provided by the receiving unit 26. For example, when a user opens the roof of a convertible and open / close information indicating that the vehicle roof is open is provided via the receiving unit 26, the presentation control unit 28 controls the odor presentation unit 29 to increase the intensity of the odor. That is, when the vehicle roof is open, wind is more likely to enter the vehicle than when the vehicle roof is closed, and odor components are more likely to volatilize due to the influence of airflow disturbances. Therefore, the presentation control unit 28 can appropriately present an odor by controlling the intensity of the odor based on such open / close information, i.e., based on information indicating whether the environment in which the odor is presented is open. The presentation control unit 28 can also control the intensity of the odor presented by the odor presentation unit 29 based on normal open / close information indicating the open / closed state of the vehicle windows or information indicating the degree to which the vehicle windows are opened, as described above.

[0027] The odor presentation unit 29 is configured with a single diffuser containing two or more different fragrances, or is configured with a physical or electrical combination of multiple diffusers containing one or more fragrances. The odor presentation unit 29 opens and closes valves and orifices and adjusts the air volume and direction of a blower under the control of the presentation control unit 28, and emits air containing volatile odor components (aroma components) from the fragrance to present the odor to the user. The odor presentation unit 29 can adjust the odor intensity (the concentration of odor components contained in the emitted air) by setting the concentration of the cartridge containing the fragrance, the air velocity, the aperture area of ​​the orifice, the ejection time per ejection, the ejection frequency, etc. For example, the odor intensity can be increased by increasing the air velocity, the aperture area, the ejection frequency, etc.

[0028] The interlocking control unit 30 controls the interlocking unit 31 of the vehicle, which operates in conjunction with the smell presented by the smell presenting unit 29 .

[0029] The interlocking unit 31 may include, for example, the vehicle's windows and doors, interior and exterior lights, drive mechanisms for reclining the vehicle's seats and footrests, speakers for outputting music, a display unit for displaying images, air conditioning equipment for cooling, heating, and ventilation, etc. The interlocking unit 31 may also be configured to include operating mechanisms for operating tables, cup holders, seat belts, wipers, washer fluid, etc.

[0030] The odor presentation control system 11 is configured as described above, and can control the presentation of odors to suit the preferences and state of each individual user, thereby improving the user experience with odors.

[0031] For example, the odor presentation control system 11 can lengthen the time for which odor presentation is turned off depending on the breathing or activity status of the user in the car (while driving, while using a smartphone, while sleeping, etc.) Furthermore, the odor presentation control system 11 can appropriately present odors according to the activity status, such as turning off odor presentation when the user is sleeping and turning on odor presentation when the user is working and feeling tense.

[0032] The odor presentation control system 11 may be configured such that each block constituting the odor presentation control system 11 is provided on a single device, or may be configured such that each block is distributed across multiple devices. In this case, a communication unit for communicating between the devices is required. For example, some of the functions of the odor presentation control system 11 may be integrated into a diffuser, which is the odor presentation unit 29, and the odor presentation unit 29 may control the vehicle-side interlocking unit 31. The odor presentation control system 11 may automatically execute the odor presentation control process in conjunction with a system that controls the vehicle, or the user may use the input unit 21 to instruct the execution of the odor presentation control process.

[0033] 2, the odor presentation control process executed in the odor presentation control system 11 will be described. For example, when a user in a vehicle operates the input unit 21 to instruct the activation of the odor presentation control system 11, the odor presentation control process is started.

[0034] In step S11, when the user sets an operation mode or inputs ejection conditions, the input unit 21 acquires the input operation mode or ejection conditions and supplies them to the presentation control unit 28. If the user does not set an operation mode or input ejection conditions, the presentation control unit 28 acquires from the memory unit 22 the default operation mode or ejection conditions, or the operation mode or ejection conditions used in the previous odor presentation control process.

[0035] In step S12 , the situation recognition unit 24 starts recognizing the user's activity situation in the vehicle, and supplies the determination unit 25 with recognition information indicating the recognition result.

[0036] In step S13, the determination unit 25 determines, based on the recognition information supplied from the situation recognition unit 24, whether or not a change in the activity situation of the user inside the vehicle has been detected.

[0037] If the determination unit 25 determines in step S13 that a change in the user's activity status inside the vehicle has been detected, the process proceeds to step S14.

[0038] In step S14, the determination unit 25 determines whether or not to change the discharge conditions in response to a change in the user's activity status inside the vehicle.

[0039] If the determination unit 25 determines in step S14 that the ejection conditions should be changed, the process proceeds to step S15. In step S15, the determination unit 25 instructs the presentation control unit 28 to change the ejection conditions in accordance with a change in the user's activity status in the vehicle, and the presentation control unit 28 changes the ejection conditions based on the recognition information supplied from the situation recognition unit 24.

[0040] On the other hand, if it is determined in step S13 that no change in the user's activity status in the vehicle has been detected, if it is determined in step S14 that the ejection conditions will not be changed, or after processing in step S15, the processing proceeds to step S16.

[0041] In step S16, the presentation control unit 28 controls the odor presentation unit 29 (e.g., emitting an odor, stopping the emission of an odor, continuing these operations, etc.) so that the odor is presented in accordance with the emission conditions.

[0042] In step S17, the input unit 21 determines whether to record the ejection conditions and evaluation based on the user's input. For example, if the user likes the ejection conditions used to control the presentation of the scent in step S16, the user can use the input unit 21 to input an evaluation so that the ejection conditions are recorded. In this case, for example, a UI screen such as that shown in FIG. 13 (described later) can be used.

[0043] In step S17, if the input unit 21 determines that the ejection conditions and the evaluation are to be recorded, the process proceeds to step S 18. In step S18, the input unit 21 records the ejection conditions and the evaluation and stores them in the storage unit 22.

[0044] On the other hand, if it is determined in step S17 that the ejection conditions and evaluations are not to be recorded, or after the processing of step S18, the processing proceeds to step S19.

[0045] In step S19, the presentation control unit 28 determines whether or not to operate the linkage unit 31 in conjunction with the scent presented in step S16.

[0046] If the presentation control unit 28 determines in step S19 that the interlocking unit 31 should operate in conjunction with the scent presented in step S16, the process proceeds to step S20. In step S20, the presentation control unit 28 instructs the interlocking control unit 30 to operate the interlocking unit 31, and the interlocking control unit 30 controls the operation of the interlocking unit 31 in accordance with the instruction.

[0047] On the other hand, if it is determined in step S19 that the interlocking unit 31 is not to be operated, or after the processing of step S20, the processing proceeds to step S21.

[0048] In step S21, the input unit 21 determines whether to terminate the odor presentation control process in accordance with an input from the user. For example, when the user operates the input unit 21 to turn off the odor presentation control system 11, the input unit 21 determines to terminate the odor presentation control process.

[0049] If the input unit 21 determines in step S21 not to terminate the odor presentation control process, the process returns to step S12, and the same process is repeated thereafter. On the other hand, if the input unit 21 determines in step S21 to terminate the odor presentation control process, the process is terminated.

[0050] By executing the above-described odor presentation control process, the odor presentation control system 11 can improve the user experience with odors. Furthermore, the odor presentation control system 11 allows the user to change the ejection conditions using the input unit 21 and provides feedback of the user's evaluation for future use.

[0051] <Example of Use of Odor Presentation Control System> An example of use of the odor presentation control system 11 will be described.

[0052] For example, the odor presentation control system 11 can be used when a driver is taking a nap or resting.

[0053] First, the driver can input that he or she wants to take a nap or a rest by operating the input unit 21 (or by using voice input). Alternatively, the odor presentation control system 11 can prompt the driver to take a nap or a rest based on the driving time of the vehicle, the level of accumulated stress based on vital information acquired from a device worn by the driver, map information indicating that a service area where a nap or a rest is possible is nearby, and the driver can agree to this.

[0054] The driver checks whether the vehicle engine is stopped and turns on the rest mode by operating the input unit 21. If multiple odor presentation units 29 are installed in the vehicle, control can be performed so that at least the odor presentation unit 29 closest to the driver, who is the target user, presents an odor.

[0055] The odor presentation control system 11 then begins presenting an odor with a relaxing effect to the driver. If an odor with an awakening effect has been presented while the driver is driving, the presentation of the odor with an awakening effect is stopped and then the presentation of the odor with a relaxing effect is started. Alternatively, if an odor with a relaxing effect has already been presented, the interval between presentations of the odor is shortened and the intensity of the odor is increased.

[0056] Thereafter, when the driver operates the input unit 21 (or may use voice input) to input that the break is to be ended, the odor presentation control system 11 can turn off the rest mode. Alternatively, the odor presentation control system 11 can turn off the rest mode by determining that it is necessary to end the break based on, for example, recognizing the time required to reach the destination or the elapse of a pre-set rest time.

[0057] In this way, by using the odor presentation control system 11 for naps and resting, the quality of naps and resting during a drive can be improved.

[0058] For example, the odor presentation control system 11 can be used by users other than drivers when they are sleeping or resting.

[0059] The odor presentation control system 11 can predict or detect a situation in which the driver is likely to become drowsy. For example, the odor presentation control system 11 can recognize from an image captured by an in-vehicle camera that a user in the front passenger seat or a user in the back seat is asleep, or that conversation with these users has decreased, and predict that the driver is likely to become drowsy.

[0060] In this case, the odor presentation control system 11 turns on the awakening mode. Note that if multiple odor presentation units 29 are installed in the vehicle, control can be performed so that only the odor presentation unit 29 closest to the driver, who is the target user, presents an odor, and, for example, control can be performed so that the odor presentation unit 29 closest to the sleeping user does not present an odor.

[0061] The odor presentation control system 11 then begins presenting an odor with an awakening effect to the driver. If an odor with a relaxing effect has been presented, the system stops presenting the odor with a relaxing effect and then begins presenting an odor with an awakening effect. Alternatively, if an odor with an awakening effect has already been presented, the system shortens the interval between odor presentations and increases the intensity of the odor.

[0062] Thereafter, when the driver operates the input unit 21 (or may use voice input) to input that he or she will end driving, the odor presentation control system 11 can turn off the wakefulness mode. Alternatively, the odor presentation control system 11 can turn off the wakefulness mode when it recognizes that the driver is approaching the vicinity of the destination.

[0063] For example, the odor presentation control system 11 can be used by people other than drivers while they are eating.

[0064] When the odor presentation control system 11 recognizes through images from an in-vehicle camera or an odor sensor that another user in the passenger seat or back seat has started eating, it can predict or detect a situation in which the driver may be unable to concentrate on driving due to the smell of the other user eating.

[0065] In this case, the odor presentation control system 11 turns on the comfort mode. Note that if multiple odor presentation units 29 are installed in the vehicle, control can be performed so that only the odor presentation unit 29 closest to the driver, who is the target user, presents an odor, and, for example, control can be performed so that the odor presentation unit 29 closest to a user who is eating does not present an odor.

[0066] The odor presentation control system 11 then starts presenting an odor that the driver finds comfortable (for example, an odor that the driver has registered as a favorite, or an odor that does not cause discomfort even when mixed with the odor of food, etc.), or, if the odor has already been presented, shortens the interval at which the odor is presented and increases the intensity of the odor.

[0067] Thereafter, when the driver operates the input unit 21 (or may use voice input) to input that the other user has finished eating, the odor presentation control system 11 can turn off the comfort mode. Alternatively, when the odor presentation control system 11 recognizes that the other user has finished eating through an image from an in-vehicle camera or an odor sensor, it can turn off the wakefulness mode.

[0068] Next, the control flow of the odor presentation control system 11 when eating and drinking are being performed in the vehicle will be described.

[0069] For example, the odor presentation control system 11 can be triggered by a human sensor or an in-vehicle camera detecting a hand reaching into a cup holder or the use of a table. The odor presentation control system 11 can also be triggered by a sensor detecting the odor of a previously learned food or detecting some change in the odor inside the vehicle. The odor presentation control system 11 can also be triggered by an in-vehicle camera detecting eating and drinking situations inside the vehicle based on previously learned food images or human movements.

[0070] The odor presentation control system 11 can stop presenting the odor only in the area where eating and drinking is taking place in the vehicle, or throughout the entire vehicle, or can reduce the intensity of the odor presentation (e.g., suddenly or gradually reduce the airflow), or change the direction of the airflow presenting the odor. Furthermore, if the odor presentation control system 11 presents an odor that is incompatible with food, it can switch to presenting a different odor (e.g., switch from a floral scent to an orange scent).

[0071] In addition, when only a specific user is eating or drinking, the odor presentation control system 11 can control the airflow to create an air curtain (odorless airflow) so that the smell of the food or drink does not mix with the smell presented to other users.

[0072] Alternatively, the odor presentation control system 11 may operate a deodorizer only in the eating and drinking area or throughout the entire vehicle, or may enhance ventilation to eliminate food odors or present an odor that counteracts the food odor. In this case, the interlocking unit 31 can open the windows to promote ventilation.

[0073] Next, the control flow of the odor presentation control system 11 after eating or drinking has been performed in the vehicle will be described.

[0074] For example, the odor presentation control system 11 can be triggered by a motion sensor or an in-car camera detecting that the user has stopped moving around a cup holder or a table. The odor presentation control system 11 can also be triggered by a sensor detecting that the odor of a previously learned food has weakened or by detecting some kind of change in the odor inside the car. The odor presentation control system 11 can also be triggered by an in-car camera detecting that someone has finished eating or drinking inside the car based on a previously learned image of food or a person's movements.

[0075] The odor presentation control system 11 can start presenting an odor only in the area where eating and drinking is taking place or throughout the entire vehicle, increase the intensity of the odor presentation (for example, suddenly or gradually increase the airflow), or change the direction of the airflow presenting the odor. The odor presentation control system 11 can also switch to an odor optimal for falling asleep or waking up according to the operating mode specified by the user.

[0076] In addition, when only a specific user is eating or drinking, the odor presentation control system 11 can control the stopping of an air curtain (odorless airflow) that is being generated to prevent the smell of the food or drink from mixing with the smell presented to other users.

[0077] Alternatively, the odor presentation control system 11 may operate a deodorizer only in the eating and drinking area or throughout the entire vehicle, or may enhance ventilation to eliminate food odors or present an odor that counteracts the food odor. In this case, the interlocking unit 31 can open the windows to promote ventilation.

[0078] Next, we will explain the child mode, which presents scents that will soothe babies.

[0079] For example, the scent presenting unit 29 can be installed on the headrest of the child car seat, on the belt, on the side of the main body, etc. Furthermore, when the child car seat is installed in the rear seat, the headrest can be installed on the rear seat side of the headrest of the driver's seat or passenger seat.

[0080] The user can input a command to switch to the child mode by operating the input unit 21. Alternatively, the odor presentation control system 11 can automatically set the child mode when it detects that the vehicle's engine has started and the vehicle has begun to move, and recognizes the presence of a baby from images captured by the in-vehicle camera. In the child mode, an odor that is comforting to a baby, such as the smell of a mother or breast milk, is presented.

[0081] For example, the odor presentation control system 11 can determine whether to present an odor based on whether the vehicle is stopped (or about to stop), rather than determining whether to present an odor based on the sound of a baby crying, so as to determine whether to present an odor before the baby starts crying to stop it from crying.

[0082] For example, the odor presentation control system 11 can determine whether the vehicle is stopped by acquiring vehicle speed information, acquiring position information or acceleration information from a device such as a smartphone carried by the user, detecting vehicle vibrations, or recognizing whether the vehicle windows are moving. The odor presentation control system 11 can make this determination by continuous monitoring or periodic monitoring every second.

[0083] The odor presentation control system 11 can also arbitrarily set the time between the first odor emission and the next decision, and can adjust the frequency and timing of decisions to present an odor while the vehicle is stopped.

[0084] The odor presentation control system 11 can then recognize the baby's condition and stop presenting the odor when the baby stops crying or when the vehicle starts moving.

[0085] Next, the odor presentation control system 11 will be described for acquiring information from the vehicle's operation and presenting an odor.

[0086] The odor presentation control system 11 measures the number of times the brakes are applied per unit time, and can recognize that a traffic jam is occurring when the number of times exceeds a threshold. Generally, drivers are under high stress when they are in a traffic jam, so the odor presentation control system 11 can increase the intensity of the odor by shortening the interval at which an odor with a relaxing effect is presented, or can decrease the intensity of the odor by lengthening the interval at which an odor with an awakening effect is presented.

[0087] The odor presentation control system 11 measures the angle at which the driver turns the steering wheel per unit time, and if the angle is below a threshold, it can recognize that the vehicle is traveling on a straight road. Generally, drivers become more drowsy when traveling on a straight road, so the odor presentation control system 11 can increase the intensity of the odor by shortening the interval at which an odor with an awakening effect is presented, or can decrease the intensity of the odor by lengthening the interval at which an odor with a relaxing effect is presented.

[0088] The odor presentation control system 11 compares the driving speed with the speed limit of the road on which the vehicle is traveling, detects sudden starts or stops of the vehicle, and can recognize that the vehicle is traveling at the limit of the speed limit if the difference between the driving speed and the speed limit is equal to or less than a threshold. Generally, when driving at the limit of the speed limit, the driver feels stressed, so the odor presentation control system 11 can increase the intensity of the odor by shortening the interval at which the odor with a relaxing effect is presented, or can decrease the intensity of the odor by lengthening the interval at which the odor with an awakening effect is presented.

[0089] In addition, the odor presentation control system 11 can acquire information from the vehicle as described below and present the odor.

[0090] For example, when driving in the rain, the driver uses the wipers to ensure visibility and slows down to accommodate slippery road surfaces, so the odor presentation control system 11 can obtain information that the driver is driving in the rain based on the use of the wipers and the deceleration of the vehicle.

[0091] For example, in dense fog, the driver will turn on the fog lights to improve visibility and significantly reduce their speed to ensure safety, so the odor presentation control system 11 can obtain information that the driver is driving in dense fog based on the use of the fog lights and the significant reduction in speed.

[0092] For example, on gravel or unpaved roads, the driver will drive slowly and carefully to respond to the instability of the road surface and ensure control of the vehicle, so the odor presentation control system 11 can obtain information that the driver is driving on a gravel or unpaved road based on the driver's slowing down and careful steering.

[0093] For example, when driving to park, the driver puts the car in the appropriate gear and finely adjusts the accelerator and brake to fit into the parking space, so the odor presentation control system 11 can obtain information that the vehicle is being driven to park based on the gear change and precise accelerator and brake operation.

[0094] For example, when driving at night, the driver turns on the headlights to ensure visibility and adjusts the speed appropriately to deal with the poor visibility that is typical of nighttime driving, so the odor presentation control system 11 can obtain information that the driver is driving at night based on the use of headlights and the optimization of the speed.

[0095] For example, in a situation where sudden braking is required, the driver will quickly and hard press the brakes when there is a sudden obstacle or when an emergency stop is required, so the odor presentation control system 11 can obtain information that the situation requires sudden braking based on the driver pressing the brake pedal hard.

[0096] For example, when driving long distances, drivers take regular breaks to prevent fatigue and change their sitting posture to improve blood flow, so the odor presentation control system 11 can obtain information that the driver is driving a long distance based on the regular breaks and changes in posture.

[0097] For example, when driving in accordance with road signs and traffic lights, the driver adjusts their speed according to speed limit signs, stop signs, and traffic lights, so the odor presentation control system 11 can obtain information that the driver is driving in accordance with road signs and traffic lights based on the speed adjustment and direction changes.

[0098] A control process for controlling the presentation of an odor by setting an emission period and an off period in accordance with a period during which the user is active will be described with reference to FIGS.

[0099] FIG. 3 shows an example of a control process in which the discharge period is set to coincide with the user's activity period.

[0100] In the control process shown in FIG. 3, a first discharge period is set to coincide with a first active period, a first off period is set between the first active period and a second active period, a second discharge period is set to coincide with a second active period, a second off period is set between the second active period and a third active period, and a third discharge period is set to coincide with a third active period.

[0101] Here, in the odor presentation control system 11, air containing odor components is ejected in an ejection pattern in which ejection is performed intermittently multiple times (five times in the example shown in Fig. 3 ). Therefore, one cycle is defined as an interval (unit time) during which ejection periods in which multiple ejections are performed and pause periods in which no ejection is performed are alternately repeated, and air containing odor components is ejected periodically during one ejection period.

[0102] FIG. 4 shows an example of a control process in which the discharge period is set so that an active off period, which is an off period during the user's active period, is provided for a certain period after the user's active period has begun.

[0103] In the control process shown in Figure 4, a first ejection period is set to coincide with a first active period, a first off period is set between the first and second active periods, and a second ejection period is set to coincide with a second active period. The second off period, which begins after the second active period ends, is set until a certain period has elapsed after the start of a third active period, and the second off period during the third active period is an active off period. The third ejection period begins after the second off period ends. As shown in the figure, ejection is performed intermittently multiple times per cycle (unit time) during each of the first to third ejection periods.

[0104] In this way, by providing a period of time during which the player is off-activity after a new activity period has begun, the player can use the period as a period for a change of mood for the activity.

[0105] For example, when switching from an activity that requires concentration, such as work or reading, or when switching after a meal (to prevent odors from mixing), if the two activities use the same type of odor (such as orange and lemon), when you have become accustomed to the odor you have been sensing up until that point, or in an environment where it is expected that the odor will not reach your nose (such as when it is windy), it is preferable to set up an off period during the activity in this way and extend the off period.

[0106] FIG. 5 shows an example of a control process in which the discharge period is set so that an active off period, which is an off period during the user's active period, is provided for a certain period before the end of the active period.

[0107] In the control process shown in Figure 5, a first discharge period is set to coincide with a first active period, a first off period is set between the first active period and the second active period, and the second discharge period begins when the second active period begins.The second discharge period ends before the end of the second active period, and the second off period begins, and the second off period during the second active period becomes an active off period.After the second off period ends, a third active period and a third discharge period begin.As shown in the figure, multiple discharges are intermittently performed per cycle (unit time) during each of the first to third discharge periods.

[0108] In this way, by providing an off-period for a certain period before the end of an activity period, it can be used as a period for a change of mood for that activity. For example, in the odor presentation control system 11, the presentation control unit 28 can start the off-period before the end of the activity period by understanding the user's activity schedule through a link with other information (e.g., linking with a schedule, etc.). Then, the end of the activity period can be determined according to the recognition result by the situation recognition unit 24.

[0109] For example, when using a schedule to switch from an activity that requires concentration, such as work or reading, or when using the recognition results to switch after a meal (to prevent odors from mixing), when using a schedule to emit the same type of odor (e.g., orange and lemon) for two activities, when you have become accustomed to the odor you have been sensing up until that point, or in an environment where it is expected that the odor will not reach your nose (e.g., when it is windy), it is preferable to set up an off period during the activity in this way and extend the off period.

[0110] FIG. 6 shows an example of a control process in which the emission period is set so that a fade-in period is provided in which the scent gradually becomes stronger for a certain period after the user's activity period begins.

[0111] In the control process shown in FIG. 6 , a first discharge period is set to coincide with the first active period, and a first off period is set between the first and second active periods. Then, during the second discharge period, which begins with the second active period, a fade-in period is set, during which the odor gradually becomes stronger. After the second active period and the second discharge period end, a second off period is set between the second and third active periods, and the third discharge period is set to coincide with the third active period. As shown in the figure, multiple discharges are performed intermittently for each cycle (unit time) during each of the first to third discharge periods. In the illustrated example, a fade-in period is set during the first cycle of the second discharge period. The fade-in period may also be set across multiple cycles.

[0112] In this way, by providing a fade-in period for a certain period after the start of a new activity period, it is possible to aim for a natural way of joining in that activity. For example, during the fade-in period, by gradually lengthening the ejection time of the intermittent ejection, it is possible to realize a fade-in in the way the smell is perceived.

[0113] For example, it is preferable to provide a fade-in period in the following cases: when falling asleep while resting; when presenting scents to a baby (e.g., fading in as the vehicle accelerates); when making the scent stronger as the driving situation approaches a dangerous one (speed, distance to the white line, etc.); when the sensitivity to scents associated with the activity situation approaches a threshold; when listening to music or watching a movie, when the music or movie starts or when the movie screen changes rapidly; when a conversation is getting lively (you don't want to be interrupted); when working, reading, or other activities that require concentration; when presenting scents to accompany a meal in a specific environment (by the seaside / forest, near a flower bed, etc.) (fading in makes it easier to enter that environment in a more natural way).

[0114] FIG. 7 shows an example of a control process in which the emission period is set so that a fade-out period is provided in which the scent gradually weakens during a certain period before the user's activity period ends.

[0115] In the control process shown in Figure 7, when the first discharge period, which starts at the same time as the first active period, ends, a fade-out period is provided, which gradually weakens the odor. Thereafter, a first off period is provided between the first active period and the second active period, a second discharge period is provided to coincide with the second active period, a second off period is provided between the second active period and the third active period, and a third discharge period is provided to coincide with the third active period. As shown in the figure, multiple discharges are performed intermittently for each cycle (unit time) during each of the first to third discharge periods. In the example shown, a fade-out period is provided in the last cycle of the first discharge period. It is also possible to provide a fade-out period spanning multiple cycles.

[0116] In this way, by providing a fade-out period at a certain time before the end of an activity period, it is possible to aim for a natural ending to that activity. For example, during the fade-out period, the discharge time of the intermittent discharge can be gradually lengthened to achieve a fade-out in the way the smell is perceived.

[0117] For example, when listening to music or watching a movie, it is preferable to fade out in time with the end of the music or movie (especially if the end involves little change on the screen), when a conversation is getting lively, when someone is concentrating on work or reading, or when the scent presentation to a baby has finished.

[0118] In addition to controlling the duration of each discharge during the discharge time, the fade-in and fade-out may be controlled by, for example, gradually decreasing or increasing the concentration of the scent components contained in the discharged air. That is, fade-in and fade-out can be achieved by using cartridges containing fragrances of different concentrations or by changing the wind speed at which the air containing the scent components is discharged. For example, when conditions other than the wind speed are constant, increasing the wind speed can make the user perceive the scent as being stronger, and decreasing the wind speed can make the user perceive the scent as being weaker.

[0119] The switching of scents can be controlled by lengthening the discharge period or the off period. Alternatively, the switching of scents can be controlled by abruptly switching between the discharge period and the off period, or by fading in or out.

[0120] For example, when the discharge period and the off period are 1:1, the latter half of the discharge period can be faded out, the discharge period and the off period can be gradually lengthened, or the discharge period and the off period can be kept the same. For example, it is preferable to gradually change the scent to one that has a relaxing effect when it comes to falling asleep. Also, if a person with an unpleasant smell gets into the vehicle, it is preferable to gradually change the scent so that the smell is not noticeable. Furthermore, the scent may be suddenly changed in accordance with the acceleration of the vehicle, gradually switched to match the overall itinerary, or promptly stopped when eating or drinking begins, or the scent may be controlled to approach a comfort value based on feedback from previous use (user impressions or evaluations) or the sensed state.

[0121] The odor presentation control system 11 can also control the interval between the emission period and the off period, or change the intensity of the odor, using a valve, a fan, a fragrance cartridge, or the like. For example, the odor presentation control system 11 can rapidly change the odor by turning the valve and fan on and off, opening and closing the valve (or the outlet), or changing the fan speed. The odor presentation control system 11 can also rapidly change the odor by changing the speed of the fan behind the fragrance cartridge and changing the opening and closing time of the valve on the fragrance cartridge. For example, even if the air volume remains the same when the valve is closed gently, changing the air velocity of the emitted air will change the odor spread.

[0122] Furthermore, when there are multiple fragrance cartridges and valves, even if the system is designed to blow air using a single fan, the odor presentation control system 11 can change the odor intensity (weak / medium / strong) by controlling the number of valves that are turned on. Furthermore, by changing the spread of the air that blows out the air containing the odor components (the opening width of the outlet), the odor presentation control system 11 can control whether the odor is presented at a pinpoint or over a wide area, allowing the user to sense the difference in concentration.

[0123] Furthermore, the odor presentation control system 11 can set thresholds for sleep, car acceleration, and baby activity statuses to be monitored, and can set the odor to fade in or fade out so that the intensity increases as the absolute value decreases compared to the threshold. Similarly, the odor presentation control system 11 can set the odor to fade in or fade out when music ends, when the amount of video changes, when a conversation gets lively, when someone is immersed in something else such as reading or work, after a meal, before a meal (when someone wants to create a specific scene while eating), etc.

[0124] In addition, the odor presentation control system 11 can abruptly turn on / off the presentation of odors when eating (when one wants to eat without the aroma), when a threshold is suddenly exceeded, when the conversation is not going well, when one is getting drunk, or at the beginning or end of a task that requires concentration.

[0125] In addition, the odor presentation control system 11 can set a longer off period based on internal factors, such as when you want to prevent the user from becoming accustomed to the odor, and external factors, such as when you want to prevent other odors from mixing in, such as when the environment is such that the odor is not expected to reach the nose (strong wind, etc.).

[0126] <Display Examples of UI Screens> Display examples of UI screens displayed on the touch panel of the input unit 21 will be described with reference to FIGS. 8 to 13. FIG.

[0127] 8 shows an example of a UI screen on which a GUI (Graphical User Interface) button for instructing the setting of an operation mode and a GUI button for instructing user settings are arranged. For example, this UI screen is displayed when an instruction is given to start the odor presentation control system 11.

[0128] On the UI screen shown in Fig. 8, the name of the selected operation mode (XX mode in the example shown in Fig. 8) is displayed next to the GUI button that instructs setting of the operation mode. Also, on the UI screen, the name of the selected user (User1 in the example shown in Fig. 8) is displayed next to the GUI button that instructs setting of the user.

[0129] When the user operates a GUI button for instructing the setting of an operation mode, a UI screen is displayed on which UI buttons for selecting an operation mode for setting details are arranged, as shown in FIG.

[0130] The UI screen shown in Figure 9 is arranged with a GUI button for selecting detailed settings for the automatic mode, a GUI button for instructing selection of detailed settings for the meal mode, a GUI button for selecting detailed settings for the sleep mode, a GUI button for selecting detailed settings for the map mode, and a GUI button for selecting detailed settings for the reading mode.

[0131] When the user operates any of the GUI buttons, a UI screen is displayed on which UI buttons for instructing detailed settings for the selected operation mode are arranged, as shown in FIG.

[0132] The UI screen shown in Fig. 10 has a UI button for instructing detailed settings of the operation mode selected on the UI screen of Fig. 9 and a GUI button for instructing switching of the selected operation mode. The UI screen also displays the name of the selected operation mode (XX mode in the example shown in Fig. 10) and the name of the selected user (User1 in the example shown in Fig. 10).

[0133] Then, when the user operates a UI button that instructs detailed settings for the operation mode, for example, by selecting to set the intensity of the odor to be presented in that operation mode, a UI screen is displayed that specifies the intensity of the odor to be presented in that operation mode, as shown in Figure 11.

[0134] The UI screen shown in FIG. 11 has a GUI for specifying the odor intensity on a scale of 0 to 100, with 50 set as the reference level.

[0135] Also, for example, when a user operates the GUI button that selects detailed settings for the sleep mode on the UI screen shown in Figure 9 and selects to set the type of odor to be presented in the sleep mode, a UI screen for selecting the type of odor to be presented in the sleep mode is displayed, as shown in Figure 12.

[0136] 12 has a GUI button for selecting lavender, a GUI button for selecting lemon, and a GUI button for selecting mint as scent types to be presented in sleep mode. For example, in sleep mode, the lavender scent is set to 100% as the standard setting (lemon and mint are set to 0%). The user can also set the percentage of lemon scent by operating the GUI button for selecting lemon, or the percentage of mint scent by operating the GUI button for selecting mint.

[0137] For example, the smell of lavender has the effect of promoting relaxation and sleep, the smell of lemon has the effect of improving mood and refreshing, and the smell of mint has the effect of refreshing and increasing concentration.

[0138] FIG. 13 shows an example of a UI screen for inputting an evaluation of the ejection conditions.

[0139] The UI screen shown in Fig. 13 displays the name of the operating mode of the ejection conditions being evaluated (in the example shown in Fig. 13, "XX mode") and the name of the user making the evaluation (in the example shown in Fig. 13, "User1"). This UI screen allows the user to rate the overall, strength, and fragrance items on a five-level scale (select the number of stars to be rated), and allows the user to enter notes for each item.

[0140] By performing the above-described operations on the UI screen, input to the input unit 21 can be performed in the odor presentation control system 11.

[0141] The UI screen shown in Figure 11 is displayed based on standard settings in accordance with the initial conditions, where the scent intensity is set to 50, and the UI screen shown in Figure 12 is displayed based on standard settings in accordance with the initial conditions, where the lavender scent is set to 100%. By operating the UI screens displayed based on the respective standard settings, the user can adjust the desired scent intensity, scent ratio, etc.

[0142] The odor presentation control system 11 can store several times the user's usual operations for adjusting the UI screen, perform learning based on the user's operation history, and reflect customized settings based on the learning results on the UI screen. As a result, when the odor presentation control system 11 learns that the user makes similar adjustments to a UI screen based on standard settings in a certain operating mode, it can reflect the learning results and display a UI screen based on customized settings in which the user's desired adjustments have been set.

[0143] For example, as shown in the upper part of Fig. 14, in sleep mode, a UI screen is displayed based on standard settings in accordance with initial conditions in which the lavender scent is set to 100%. If the user performs an operation on this UI screen several times to adjust the lavender scent to 90% and the mint scent to 10%, learning is performed based on the user's operation history, and a UI screen is displayed based on customized settings in accordance with the learning results. That is, as shown in the lower part of Fig. 14, a UI screen is displayed based on customized settings in which the lavender scent is set to 90% and the mint scent to 10%.

[0144] In this way, the odor presentation control system 11 learns based on the user's operation history and displays a UI screen that reflects customized settings optimized for that user, thereby being able to present odors that match the user's preferences, for example, without the user having to perform any operations on the UI screen.

[0145] In addition, the odor presentation control system 11 also learns the situation when the user operates the UI screen (e.g., temperature, time, day of the week, driving information, music, lighting, number of passengers, departure point, destination, and other information), and can display a UI screen optimized for the user for each situation.

[0146] The odor presentation control system 11 has operating modes such as aggressive mode, relaxed mode, rainy mode, sunny mode, morning mode, and night mode, and when the next morning mode (or another mode similar to morning mode, such as aggressive mode) is selected, the customized settings based on the learning results described above can be reflected on the UI screen.

[0147] In addition to the use case of being mounted on a vehicle and used as described above, the odor presentation control system 11 can also be applied to use cases such as presenting odors according to the user's activity status in places where people stay, such as a room, living room, or workplace.

[0148] <Example of Computer Configuration> Next, the above-described series of processes (control method) can be performed by hardware or software. When the series of processes is performed by software, a program constituting the software is installed in a general-purpose computer or the like.

[0149] FIG. 15 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processes by a program.

[0150] In the computer, a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, and an EEPROM (Electronically Erasable and Programmable Read Only Memory) 104 are interconnected by a bus 105. An input / output interface 106 is further connected to the bus 105, and the input / output interface 106 is connected to the outside.

[0151] In a computer configured as described above, the CPU 101 performs the above-described series of processes by loading programs stored in, for example, the ROM 102 and EEPROM 104 into the RAM 103 via the bus 105 and executing the programs. In addition, the programs executed by the computer (CPU 101) can be written in advance in the ROM 102, or can be installed or updated in the EEPROM 104 from outside via the input / output interface 106.

[0152] In this specification, the processing performed by a computer according to a program does not necessarily have to be performed in chronological order according to the order described in the flowchart. In other words, the processing performed by a computer according to a program also includes processing that is executed in parallel or individually (for example, parallel processing or object-based processing).

[0153] The program may be processed by a single computer (processor), or may be distributed among multiple computers. Furthermore, the program may be transferred to and executed on a remote computer.

[0154] Furthermore, in this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all of the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.

[0155] Also, for example, a configuration described as one device (or processing unit) may be divided and configured as multiple devices (or processing units). Conversely, configurations described above as multiple devices (or processing units) may be combined and configured as one device (or processing unit). Of course, configurations other than those described above may be added to the configuration of each device (or each processing unit). Furthermore, as long as the configuration and operation of the entire system are substantially the same, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).

[0156] Furthermore, for example, the present technology can be configured as a cloud computing system in which a single function is shared and processed collaboratively by a plurality of devices via a network.

[0157] Furthermore, for example, the above-described program can be executed in any device, as long as the device has the necessary functions (functional blocks, etc.) and can obtain the necessary information.

[0158] Also, for example, each step described in the above flowchart can be executed by one device or can be shared and executed by multiple devices. Furthermore, if one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices. In other words, multiple processes included in one step can be executed as multiple step processes. Conversely, processes described as multiple steps can be executed collectively as a single step.

[0159] In addition, the processing of the steps of a program executed by a computer may be executed in chronological order according to the order described in this specification, or may be executed in parallel or individually at the required timing, such as when a call is made. In other words, as long as no contradiction occurs, the processing of each step may be executed in an order different from the order described above. Furthermore, the processing of the steps of this program may be executed in parallel with the processing of another program, or may be executed in combination with the processing of another program.

[0160] It should be noted that the present technologies described in this specification can be implemented independently and singly, unless a contradiction arises. Of course, any two or more of the present technologies can also be implemented in combination. For example, part or all of the present technologies described in any embodiment can be implemented in combination with part or all of the present technologies described in other embodiments. Furthermore, part or all of any of the present technologies described above can also be implemented in combination with other technologies not described above.

[0161] <Application Examples> The technology according to the present disclosure can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of moving body, such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, a robot, construction machinery, or agricultural machinery (tractor).

[0162] 16 is a block diagram showing a schematic configuration example of a vehicle control system 7000, which is an example of a mobile object control system to which the technology according to the present disclosure can be applied. The vehicle control system 7000 includes a plurality of electronic control units connected via a communication network 7010. In the example shown in FIG. 16, the vehicle control system 7000 includes a drive system control unit 7100, a body system control unit 7200, a battery control unit 7300, an outside-vehicle information detection unit 7400, an inside-vehicle information detection unit 7500, and an integrated control unit 7600. The communication network 7010 connecting these multiple control units may be an in-vehicle communication network conforming to any standard, such as a Controller Area Network (CAN), a Local Interconnect Network (LIN), a Local Area Network (LAN), or FlexRay (registered trademark).

[0163] Each control unit includes a microcomputer that performs arithmetic processing according to various programs, a memory unit that stores the programs executed by the microcomputer or parameters used in various calculations, and a drive circuit that drives various controlled devices. Each control unit includes a network I / F for communicating with other control units via a communication network 7010, and a communication I / F for communicating with devices or sensors inside and outside the vehicle via wired or wireless communication. Figure 16 illustrates the functional configuration of the integrated control unit 7600, including a microcomputer 7610, a general-purpose communication I / F 7620, a dedicated communication I / F 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle device I / F 7660, an audio / video output unit 7670, an in-vehicle network I / F 7680, and a memory unit 7690. The other control units also include a microcomputer, a communication I / F, a memory unit, and the like.

[0164] The drivetrain control unit 7100 controls the operation of devices related to the drivetrain of the vehicle in accordance with various programs. For example, the drivetrain control unit 7100 functions as a control device for a drive force generating device for generating drive force for the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating braking force for the vehicle. The drivetrain control unit 7100 may also function as a control device for an ABS (Antilock Brake System) or an ESC (Electronic Stability Control), etc.

[0165] A vehicle state detection unit 7110 is connected to the drivetrain control unit 7100. The vehicle state detection unit 7110 includes at least one of a gyro sensor that detects the angular velocity of the axial rotational motion of the vehicle body, an acceleration sensor that detects the acceleration of the vehicle, or a sensor that detects the amount of operation of the accelerator pedal, the amount of operation of the brake pedal, the steering angle of the steering wheel, the engine rotation speed, the rotation speed of the wheels, etc. The drivetrain control unit 7100 performs arithmetic processing using signals input from the vehicle state detection unit 7110, and controls the internal combustion engine, the drive motor, the electric power steering device, the brake device, etc.

[0166] The body system control unit 7200 controls the operation of various devices equipped in the vehicle body according to various programs. For example, the body system control unit 7200 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as headlamps, backup lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves transmitted from a portable device that serves as a key or signals from various switches can be input to the body system control unit 7200. The body system control unit 7200 receives these radio waves or signals and controls the vehicle's door lock device, power window device, lamps, etc.

[0167] The battery control unit 7300 controls the secondary battery 7310, which is the power supply source for the drive motor, in accordance with various programs. For example, information such as battery temperature, battery output voltage, or remaining battery capacity is input to the battery control unit 7300 from a battery device equipped with the secondary battery 7310. The battery control unit 7300 performs arithmetic processing using these signals, and controls the temperature regulation of the secondary battery 7310 or a cooling device or the like equipped in the battery device.

[0168] The outside vehicle information detection unit 7400 detects information outside the vehicle equipped with the vehicle control system 7000. For example, at least one of an imaging unit 7410 and an outside vehicle information detection unit 7420 is connected to the outside vehicle information detection unit 7400. The imaging unit 7410 includes at least one of a time-of-flight (ToF) camera, a stereo camera, a monocular camera, an infrared camera, and other cameras. The outside vehicle information detection unit 7420 includes at least one of an environmental sensor for detecting the current weather or climate, or a surrounding information detection sensor for detecting other vehicles, obstacles, pedestrians, etc. around the vehicle equipped with the vehicle control system 7000.

[0169] The environmental sensor may be, for example, at least one of a raindrop sensor that detects rain, a fog sensor that detects fog, a sunshine sensor that detects the degree of sunshine, and a snow sensor that detects snowfall. The surrounding information detection sensor may be at least one of an ultrasonic sensor, a radar device, and a LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) device. The imaging unit 7410 and the outside vehicle information detection unit 7420 may each be provided as an independent sensor or device, or may be provided as a device in which multiple sensors or devices are integrated.

[0170] 17 shows an example of the installation positions of the imaging unit 7410 and the vehicle exterior information detection unit 7420. The imaging units 7910, 7912, 7914, 7916, and 7918 are provided, for example, at least one of the front nose, side mirrors, rear bumper, back door, and upper part of the windshield inside the vehicle cabin of the vehicle 7900. The imaging unit 7910 provided on the front nose and the imaging unit 7918 provided on the upper part of the windshield inside the vehicle cabin mainly acquire images of the front of the vehicle 7900. The imaging units 7912 and 7914 provided on the side mirrors mainly acquire images of the sides of the vehicle 7900. The imaging unit 7916 provided on the rear bumper or back door mainly acquires images of the rear of the vehicle 7900. The imaging unit 7918 provided on the upper part of the windshield inside the vehicle cabin is mainly used to detect leading vehicles, pedestrians, obstacles, traffic lights, traffic signs, lanes, etc.

[0171] 17 shows an example of the imaging ranges of the imaging units 7910, 7912, 7914, and 7916. Imaging range a indicates the imaging range of the imaging unit 7910 provided on the front nose, imaging ranges b and c indicate the imaging ranges of the imaging units 7912 and 7914 provided on the side mirrors, respectively, and imaging range d indicates the imaging range of the imaging unit 7916 provided on the rear bumper or back door. For example, by overlaying the image data captured by the imaging units 7910, 7912, 7914, and 7916, a bird's-eye view image of the vehicle 7900 viewed from above can be obtained.

[0172] The outside vehicle information detection units 7920, 7922, 7924, 7926, 7928, and 7930 provided on the front, rear, sides, corners, and above the windshield inside the vehicle cabin of the vehicle 7900 may be, for example, ultrasonic sensors or radar devices. The outside vehicle information detection units 7920, 7926, and 7930 provided on the front nose, rear bumper, back door, and above the windshield inside the vehicle cabin of the vehicle 7900 may be, for example, LIDAR devices. These outside vehicle information detection units 7920 to 7930 are mainly used to detect preceding vehicles, pedestrians, obstacles, etc.

[0173] Returning to FIG. 16 , the explanation will be continued. The outside-vehicle information detection unit 7400 causes the imaging unit 7410 to capture an image outside the vehicle and receives the captured image data. The outside-vehicle information detection unit 7400 also receives detection information from the connected outside-vehicle information detection unit 7420. If the outside-vehicle information detection unit 7420 is an ultrasonic sensor, a radar device, or a LIDAR device, the outside-vehicle information detection unit 7400 emits ultrasonic waves or electromagnetic waves and receives information on the received reflected waves. Based on the received information, the outside-vehicle information detection unit 7400 may perform object detection processing or distance detection processing for people, vehicles, obstacles, signs, text on the road, etc. Based on the received information, the outside-vehicle information detection unit 7400 may also perform environmental recognition processing for recognizing rainfall, fog, road conditions, etc. Based on the received information, the outside-vehicle information detection unit 7400 may also calculate the distance to an object outside the vehicle.

[0174] The outside vehicle information detection unit 7400 may also perform image recognition processing or distance detection processing to recognize people, vehicles, obstacles, signs, or characters on the road surface based on the received image data. The outside vehicle information detection unit 7400 may perform processing such as distortion correction or alignment on the received image data, and may also generate an overhead image or a panoramic image by combining image data captured by different image capturing units 7410. The outside vehicle information detection unit 7400 may also perform viewpoint conversion processing using image data captured by different image capturing units 7410.

[0175] The interior information detection unit 7500 detects information inside the vehicle. A driver state detection unit 7510 that detects the driver's state is connected to the interior information detection unit 7500, for example. The driver state detection unit 7510 may include a camera that captures an image of the driver, a biosensor that detects the driver's biometric information, or a microphone that collects sound from within the vehicle cabin. The biosensor is provided, for example, on the seat or steering wheel, and detects the biometric information of a passenger sitting in the seat or the driver gripping the steering wheel. The interior information detection unit 7500 may calculate the driver's level of fatigue or concentration based on the detection information input from the driver state detection unit 7510, or may determine whether the driver is dozing off. The interior information detection unit 7500 may perform processing such as noise canceling on the collected audio signal.

[0176] The integrated control unit 7600 controls the overall operation of the vehicle control system 7000 according to various programs. An input unit 7800 is connected to the integrated control unit 7600. The input unit 7800 may be implemented by a device that can be operated by a passenger, such as a touch panel, a button, a microphone, a switch, or a lever. Data obtained by voice recognition of a voice input through a microphone may be input to the integrated control unit 7600. The input unit 7800 may be, for example, a remote control device using infrared or other radio waves, or an externally connected device such as a mobile phone or a personal digital assistant (PDA) that can operate the vehicle control system 7000. The input unit 7800 may be, for example, a camera, in which case the passenger can input information using gestures. Alternatively, data obtained by detecting the movement of a wearable device worn by the passenger may be input. Furthermore, the input unit 7800 may include, for example, an input control circuit that generates an input signal based on information input by the passenger using the input unit 7800 and outputs the input signal to the integrated control unit 7600. Passengers and the like operate this input unit 7800 to input various data to the vehicle control system 7000 and to instruct processing operations.

[0177] The storage unit 7690 may include a ROM (Read Only Memory) that stores various programs executed by the microcomputer, and a RAM (Random Access Memory) that stores various parameters, calculation results, sensor values, etc. The storage unit 7690 may also be realized by a magnetic storage device such as an HDD (Hard Disc Drive), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.

[0178] The general-purpose communication I / F 7620 is a general-purpose communication I / F that mediates communication with various devices present in the external environment 7750. The general-purpose communication I / F 7620 may implement a cellular communication protocol such as GSM (Global System of Mobile communications), WiMAX (registered trademark), LTE (Long Term Evolution), or LTE-Advanced (LTE-A), or other wireless communication protocols such as a wireless LAN (also referred to as Wi-Fi (registered trademark)) or Bluetooth (registered trademark). The general-purpose communication I / F 7620 may connect to a device (e.g., an application server or a control server) present on an external network (e.g., the Internet, a cloud network, or an operator-specific network) via, for example, a base station or an access point. In addition, the general-purpose communication I / F 7620 may connect to a terminal located near the vehicle (for example, a terminal of a driver, pedestrian, or store, or an MTC (Machine Type Communication) terminal) using, for example, P2P (Peer To Peer) technology.

[0179] The dedicated communication I / F 7630 is a communication I / F that supports a communication protocol designed for use in vehicles. The dedicated communication I / F 7630 may implement a standard protocol such as WAVE (Wireless Access in Vehicle Environment), which is a combination of a lower layer IEEE 802.11p and an upper layer IEEE 1609, DSRC (Dedicated Short Range Communications), or a cellular communication protocol. The dedicated communication I / F 7630 typically performs V2X communication, which is a concept including one or more of vehicle-to-vehicle communication, vehicle-to-infrastructure communication, vehicle-to-home communication, and vehicle-to-pedestrian communication.

[0180] The positioning unit 7640 performs positioning by receiving, for example, GNSS signals from GNSS (Global Navigation Satellite System) satellites (for example, GPS signals from GPS (Global Positioning System) satellites), and generates position information including the latitude, longitude, and altitude of the vehicle. Note that the positioning unit 7640 may identify the current position by exchanging signals with a wireless access point, or may obtain position information from a terminal such as a mobile phone, PHS, or smartphone that has a positioning function.

[0181] The beacon receiving unit 7650 receives, for example, radio waves or electromagnetic waves transmitted from radio stations or the like installed on the road, and acquires information such as the current location, congestion, road closures, required travel time, etc. The function of the beacon receiving unit 7650 may be included in the dedicated communication I / F 7630 described above.

[0182] The in-vehicle device I / F 7660 is a communication interface that mediates connections between the microcomputer 7610 and various in-vehicle devices 7760 present in the vehicle. The in-vehicle device I / F 7660 may establish wireless connections using wireless communication protocols such as wireless LAN, Bluetooth (registered trademark), NFC (Near Field Communication), or WUSB (Wireless USB). Furthermore, the in-vehicle device I / F 7660 may establish a wired connection such as USB (Universal Serial Bus), HDMI (High-Definition Multimedia Interface), or MHL (Mobile High-Definition Link) via a connection terminal (and a cable, if necessary) not shown. The in-vehicle device 7760 may include, for example, at least one of a mobile device or a wearable device owned by a passenger, or an information device carried into or attached to the vehicle. The in-vehicle device 7760 may also include a navigation device that searches for a route to an arbitrary destination. The in-vehicle device I / F 7660 exchanges control signals or data signals with these in-vehicle devices 7760.

[0183] The in-vehicle network I / F 7680 is an interface that mediates communication between the microcomputer 7610 and the communication network 7010. The in-vehicle network I / F 7680 transmits and receives signals in accordance with a predetermined protocol supported by the communication network 7010.

[0184] The microcomputer 7610 of the integrated control unit 7600 controls the vehicle control system 7000 in accordance with various programs based on information acquired via at least one of the general-purpose communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the in-vehicle network I / F 7680. For example, the microcomputer 7610 may calculate control target values ​​for the driving force generating device, the steering mechanism, or the braking device based on the acquired information inside and outside the vehicle, and output control commands to the drivetrain control unit 7100. For example, the microcomputer 7610 may perform cooperative control aimed at realizing functions of an Advanced Driver Assistance System (ADAS), including vehicle collision avoidance or impact mitigation, following driving based on the following distance, vehicle speed maintenance driving, vehicle collision warning, vehicle lane departure warning, etc. In addition, the microcomputer 7610 may perform cooperative control for the purpose of autonomous driving, in which the vehicle travels autonomously without relying on driver operation, by controlling a driving force generating device, steering mechanism, braking device, etc. based on information acquired about the vehicle's surroundings.

[0185] The microcomputer 7610 may generate three-dimensional distance information between the vehicle and objects such as surrounding structures and people, and create local map information including information about the vicinity of the vehicle's current location, based on information acquired via at least one of the general-purpose communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the in-vehicle network I / F 7680. Furthermore, the microcomputer 7610 may predict dangers, such as a vehicle collision, the approach of a pedestrian, or entry into a closed road, based on the acquired information, and generate a warning signal. The warning signal may be, for example, a signal for generating a warning sound or turning on a warning lamp.

[0186] The audio / image output unit 7670 transmits at least one audio and / or image output signal to an output device capable of visually or audibly notifying the vehicle occupants or the outside of the vehicle. In the example of FIG. 16 , an audio speaker 7710, a display unit 7720, and an instrument panel 7730 are illustrated as examples of the output devices. The display unit 7720 may include, for example, at least one of an on-board display and a head-up display. The display unit 7720 may have an AR (Augmented Reality) display function. The output device may also be other devices, such as headphones, a wearable device such as an eyeglass-type display worn by the occupant, a projector, or a lamp. When the output device is a display device, the display device visually displays results obtained by various processes performed by the microcomputer 7610 or information received from other control units in various formats, such as text, images, tables, and graphs. When the output device is an audio output device, the audio output device converts audio signals, such as reproduced audio data or acoustic data, into analog signals and audibly outputs the analog signals.

[0187] In the example shown in FIG. 16 , at least two control units connected via the communication network 7010 may be integrated into a single control unit. Alternatively, each control unit may be composed of multiple control units. Furthermore, the vehicle control system 7000 may include another control unit not shown. In the above description, some or all of the functions performed by one of the control units may be assigned to another control unit. In other words, as long as information is transmitted and received via the communication network 7010, predetermined arithmetic processing may be performed by one of the control units. Similarly, a sensor or device connected to one of the control units may be connected to another control unit, and multiple control units may transmit and receive detection information to and from each other via the communication network 7010.

[0188] <Examples of Combinations of Configurations> The present technology can also be configured as follows. (1) A control device including: a situation recognition unit that recognizes a user's activity status; and a presentation control unit that controls the emission of air containing an odor component to control the presentation of an odor to the user, wherein the presentation control unit sets an off period during which the emission of the odor is turned off based on the user's activity status. (2) The control device described in (1) above, wherein the presentation control unit sets an off period during which the emission of the odor is turned off for a certain period after the start of an activity period during which the user is active. (3) The control device described in (1) or (2) above, wherein the presentation control unit sets an off period during which the emission of the odor is turned off for a certain period before the end of an activity period during which the user is active. (4) The control device described in any of (1) to (3) above, wherein the presentation control unit sets a fade-in period during which the odor is perceived as gradually becoming stronger for a certain period after the start of an activity period during which the user is active. (5) The control device described in any of (1) to (4) above, wherein the presentation control unit sets a fade-out period during which the odor is perceived as gradually becoming weaker for a certain period before the end of an activity period during which the user is active. (6) The control device according to any of (1) to (5) above, wherein, during an emission period in which the odor is emitted based on the activity status of the user, air containing the odor component is emitted in an emission pattern in which emission is performed intermittently multiple times. (7) The control device according to any of (1) to (6) above, wherein the presentation control unit controls the presentation of the odor to the user in accordance with emission conditions set for each operation mode or user. (8) The control device according to any of (1) to (7) above, further comprising: a determination unit that determines whether a change in the activity status of the user has been detected in accordance with the recognition result by the situation recognition unit, and, if it is determined that a change in the activity status of the user has been detected, determines whether to change the emission conditions in accordance with the change in the activity status, wherein the presentation control unit changes the emission conditions in accordance with the determination result by the determination unit.(9) The control device according to any of (1) to (8) above, further comprising: a storage unit that stores an evaluation of the discharge conditions input by a user, and the presentation control unit feeds back the evaluation from the next time onwards. (10) The control device according to any of (1) to (9) above, further comprising: a linkage control unit that controls a linkage unit that operates in linkage with the presented odor in accordance with control by the presentation control unit. (11) The control device according to any of (1) to (10) above, wherein the situation recognition unit recognizes activity statuses of users other than the user to whom the odor is to be presented, and the presentation control unit controls the presentation of the odor to the user to whom the odor is to be presented based on the activity statuses of the other users. (12) The control device according to any of (1) to (11) above, wherein the presentation control unit controls the intensity of the odor based on information indicating whether the environment in which the odor is to be presented is open. (13) A control device according to any of (1) to (12) above, which performs learning based on a user's operation history on a UI (User Interface) screen with standard settings according to initial conditions, and reflects customized settings according to the learning results on the UI screen. (14) A control method, comprising: a control device recognizing a user's activity status; and controlling the emission of air containing an odor component to control the presentation of the odor to the user, wherein an off period for turning off the emission of the odor is set based on the user's activity status. (15) A program for causing a computer of the control device to execute processing, comprising: recognizing a user's activity status; and controlling the emission of air containing an odor component to control the presentation of the odor to the user, wherein an off period for turning off the emission of the odor is set based on the user's activity status.

[0189] It should be noted that the present embodiment is not limited to the above-described embodiment, and various modifications are possible within the scope of the gist of the present disclosure. Furthermore, the effects described in this specification are merely examples and are not intended to be limiting, and other effects may also be obtained.

[0190] 11 Odor presentation control system, 21 Input unit, 22 Memory unit, 23 Setting adjustment unit, 24 Situation recognition unit, 25 Determination unit, 26 Receiving unit, 27 Transmitting unit

Claims

1. A control device comprising: a situation recognition unit that recognizes the activity status of a user; and a presentation control unit that controls the emission of air containing an odor component to control the presentation of the odor to the user, wherein the presentation control unit sets an off period for turning off the emission of the odor based on the activity status of the user.

2. The control device according to claim 1, wherein the presentation control unit sets an off period in which the emission of the scent is turned off for a certain period after the start of an activity period in which the user is active.

3. The control device according to claim 1, wherein the presentation control unit sets an off period during which the emission of the scent is turned off for a certain period before the end of an activity period during which the user is active.

4. The control device according to claim 1, wherein the presentation control unit sets a fade-in period in which the odor gradually becomes stronger for a certain period after the start of an active period in which the user is active.

5. The control device according to claim 1, wherein the presentation control unit sets a fade-out period during which the odor gradually weakens for a certain period before the end of an active period during which the user is active.

6. The control device according to claim 1, wherein during the emission period in which the odor is emitted based on the user's activity status, air containing the odor component is emitted in an emission pattern in which multiple emissions are performed intermittently.

7. The control device according to claim 1, wherein the presentation control unit controls the presentation of the scent to the user in accordance with the operation mode or the discharge conditions set for each user.

8. The control device described in claim 7 further comprises a judgment unit that judges whether a change in the user's activity status has been detected according to the recognition result by the status recognition unit, and if it is judged that a change in the user's activity status has been detected, judges whether the ejection conditions should be changed in accordance with the change in the activity status, and the presentation control unit changes the ejection conditions according to the judgment result by the judgment unit.

9. The control device according to claim 8, further comprising: a storage unit that stores an evaluation of the ejection conditions input by a user; and the presentation control unit feeds back the evaluation from the next time onwards.

10. The control device according to claim 1, further comprising a linkage control unit that controls a linkage unit that operates in conjunction with the presented smell in accordance with the control of the presentation control unit.

11. The control device described in claim 1, wherein the situation recognition unit recognizes the activity status of other users other than the user to whom the odor is to be presented, and the presentation control unit controls the presentation of the odor to the user to whom the odor is to be presented based on the activity status of the other users.

12. The control device according to claim 1, wherein the presentation control unit controls the intensity of the odor based on information indicating whether the environment in which the odor is presented is open or not.

13. The control device according to claim 1, wherein learning is performed based on a user's operation history for a UI (User Interface) screen with standard settings according to initial conditions, and customized settings according to the learning results are reflected on the UI screen.

14. A control method comprising: a control device recognizing a user's activity status; and controlling the emission of air containing an odor component to control the presentation of the odor to the user; wherein an off period for turning off the emission of the odor is set based on the user's activity status.

15. A program for causing a control device computer to execute processing including: recognizing the user's activity status; controlling the emission of air containing odor components to control the presentation of the odor to the user; and setting an off period for turning off the emission of the odor based on the user's activity status.

Images