Control device, control method, and program

Abstract

The present disclosure relates to a control device, a control method, and a program, enabling safer operation. The control device includes an identification unit that identifies an operation state of an operator on an operation device and acquires operation state information indicating the operation state; an odor parameter setting unit that sets a parameter indicating presentation of an odor associated with content of the operation state; and an odor presentation unit that outputs air containing an odor component in accordance with the parameter and presents the odor to the operator. The present technology can be applied to, for example, a control system that controls how an operation is reflected in a vehicle.

Description

Technical Field

[0001] This disclosure relates to control devices, control methods, and procedures, and more specifically, to control devices, control methods, and procedures that enable safer operation. Background Technology

[0002] In general, there are concerns that various accidents may occur due to driver error when operating vehicles and operator error when operating machinery, and attempts have been made to prevent misoperation in advance by using odors.

[0003] For example, Patent Document 1 discloses a vehicle odor device that diffuses an odor into the vehicle cabin only when the vehicle door is unlocked and an opening operation is performed by an external door handle. Furthermore, Patent Document 2 discloses a vehicle notification system that can appropriately inform occupants of the danger level by releasing an odorant that emits a stronger odor as the danger level increases, based on the detection results of the vehicle's status.

[0004] Reference List

[0005] Patent documents

[0006] Patent Document 1: JP H2-117446 A

[0007] Patent Document 2: JP 2023-148338 A Summary of the Invention

[0008] The problem to be solved

[0009] There is a need for a technology that can more reliably prevent misoperation and perform safer operations compared to the technologies disclosed in Patent Documents 1 and 2.

[0010] In view of this situation, this disclosure was made to enable safer operations.

[0011] Solution to the problem

[0012] A control device according to one aspect of the present disclosure includes: an identification unit configured to identify an operator's operation state on an operating device and acquire operation state information indicating the operation state; an odor parameter setting unit configured to set parameters indicating the presentation of an odor associated with the content of the operation state; and an odor presentation unit configured to output air containing odor components according to the parameters and present the odor to the operator.

[0013] A control method or procedure according to one aspect of this disclosure includes: identifying the operating state of an operator operating an operating device and acquiring operating state information indicating the operating state; setting parameters indicating the presentation of an odor associated with the content of the operating state; and outputting air containing odor components according to the parameters and presenting the odor to the operator.

[0014] In one aspect of this disclosure, an operator's operating state of an operating device is identified, operating state information indicating the operating state is obtained, parameters indicating the presentation of an odor associated with the content of the operating state are set, and air containing odor components according to the parameters is output to present an odor to the operator. Attached Figure Description

[0015] Figure 1 This is a block diagram illustrating a configuration example of a first embodiment of a control system to which this technology is applied.

[0016] Figure 2 It is a diagram used to explain the changes in the driver's operating state.

[0017] Figure 3 This is a flowchart used to explain the first control process.

[0018] Figure 4 This is a block diagram illustrating a configuration example of a second embodiment of the control system.

[0019] Figure 5 It is a diagram used to explain the changes in the driver's operating state.

[0020] Figure 6 This is a flowchart used to explain the second control process.

[0021] Figure 7 This is a flowchart used to explain a modified example of the second control process.

[0022] Figure 8 This is a block diagram illustrating a configuration example of a third embodiment of the control system.

[0023] Figure 9 This is a block diagram illustrating a configuration example of a fourth embodiment of the control system.

[0024] Figure 10 This is a flowchart used to explain the third control process.

[0025] Figure 11 This is a block diagram illustrating a configuration example of a fifth embodiment of the control system.

[0026] Figure 12 This is a diagram used to explain an example of how odors are presented based on the external conditions of a vehicle.

[0027] Figure 13 This is a flowchart used to explain the fourth control process.

[0028] Figure 14 This is a block diagram illustrating a configuration example of a sixth embodiment of the control system.

[0029] Figure 15 This is a block diagram illustrating a configuration example of a seventh embodiment of the control system.

[0030] Figure 16 This is a block diagram illustrating a configuration example of the eighth embodiment of the control system.

[0031] Figure 17 This is a diagram used to explain an example of a driver alert screen display.

[0032] Figure 18 This is a flowchart used to explain the fifth control process.

[0033] Figure 19 This is a block diagram illustrating a configuration example of a computer to which the present technology is applied. Detailed Implementation

[0034] The following will describe in detail, with reference to the accompanying drawings, specific embodiments in which this technology is applied.

[0035] <First Configuration Example of a Control System>

[0036] Figure 1 This is a block diagram illustrating a configuration example of a first embodiment of a control system to which this technology is applied.

[0037] like Figure 1 As shown, the control system 11 includes an operating device 21, a vehicle interior identification device 22, a vehicle identification device 23, a vehicle exterior identification device 24, an operating status identification unit 25, a condition identification unit 26, a vehicle control unit 27, an odor parameter setting unit 28, and an odor presentation device 29. For example, Figure 1 The control system 11 can control how the operation is reflected in the vehicle when the driver is about to perform an operation, based on the change in the driver's operating state caused by the presentation of odors to the driver.

[0038] The operating device 21 includes a steering wheel 41, an accelerator pedal 42, a brake pedal 43, and a gear shift lever 44. The operating device 21 then provides the operation content acquisition unit 51 of the operation state recognition unit 25 with a steering wheel operation signal indicating the steering angle corresponding to the driver's rotation of the steering wheel 41, an accelerator pedal operation signal indicating the amount of pressure corresponding to the driver's pressing of the accelerator pedal 42, a brake pedal operation signal indicating the amount of pressure corresponding to the driver's pressing of the brake pedal 43, and a gear shift lever operation signal indicating the position (drive / reverse / park, etc.) corresponding to the driver's movement of the gear shift lever 44.

[0039] The vehicle interior recognition device 22 includes an interior camera 45 and an interior sensor 46. The interior camera 45 captures images for identifying the vehicle interior status, and the interior sensor 46 detects vehicle interior statuses that can be identified without using images. The vehicle interior recognition device 22 then provides the vehicle interior images captured by the interior camera 45 to the operation status recognition unit 25's operation filing estimation unit 52 and the condition recognition unit 26's vehicle interior condition recognition unit 53. Similarly, the vehicle interior recognition device 22 provides vehicle interior sensor information indicating the detection results of the interior sensor 46 to the operation status recognition unit 25's operation filing estimation unit 52 and the condition recognition unit 26's vehicle interior condition recognition unit 53.

[0040] The vehicle identification device 23 includes a vehicle sensor 47 and a location information acquisition unit 48. The vehicle sensor 47 detects the vehicle's speed, acceleration, etc., and the location information acquisition unit 48 acquires the vehicle's location information using a Global Navigation Satellite System (GNSS). Then, the vehicle identification device 23 provides vehicle information such as vehicle speed data and acceleration data output from the vehicle sensor 47 to the vehicle information acquisition unit 54 of the condition identification unit 26, and provides the vehicle's location information acquired by the location information acquisition unit 48 to the vehicle external condition identification unit 55 of the condition identification unit 26.

[0041] The vehicle exterior recognition device 24 includes a vehicle exterior camera 49 and a vehicle exterior sensor 50. The vehicle exterior camera 49 captures images for recognizing the vehicle's exterior condition, and the vehicle exterior sensor 50 detects vehicle exterior conditions that can be recognized without using images. Then, the vehicle exterior recognition device 24 provides the vehicle exterior image captured by the vehicle exterior camera 49 and vehicle exterior sensor information indicating the detection results of the vehicle exterior sensor 50 to the vehicle exterior condition recognition unit 55 of the condition recognition unit 26.

[0042] The operation status recognition unit 25 includes an operation content acquisition unit 51 and an operation record estimation unit 52. Based on various operation signals provided by the operation device 21 and vehicle interior images and vehicle interior sensor information provided by the vehicle interior recognition device 22, it identifies the driver's operation status on the vehicle and acquires operation status information indicating the operation status. The operation status information includes operation execution information and operation record information, which will be described later.

[0043] The operation content acquisition unit 51 acquires the operation content that the driver is performing on the steering wheel 41, accelerator pedal 42, and gear shift lever 44 based on the steering wheel operation signal, accelerator pedal operation signal, brake pedal operation signal, and gear shift lever operation signal provided from the operation device 21, and provides operation execution information indicating the operation content to the vehicle control unit 27. Furthermore, when the operation content acquisition unit 51 acquires the operation content, the operation state recognition unit 25 can recognize that the driver's operation state has changed to operation start.

[0044] The operation registration estimation unit 52 estimates the predicted operation (hereinafter referred to as operation registration) that the driver will perform on the vehicle based on the vehicle interior image captured by the vehicle interior camera 45 and the vehicle interior sensor information detected by the vehicle interior sensor 46, and provides operation registration information indicating the content of the operation registration to the odor parameter setting unit 28. Furthermore, when the operation registration estimation unit 52 estimates the operation registration, the operation state recognition unit 25 can recognize that the driver's operation state has changed to operation registration. Then, when the content of the operation registration estimated by the operation registration estimation unit 52 changes, the operation state recognition unit 25 can recognize that the driver's operation state has changed to operation registration change.

[0045] For example, if the operation registration estimation unit 52 detects that the driver's foot is placed on the accelerator pedal 42 in the vehicle interior image, the operation registration estimation unit 52 estimates that this state is predicted to be an acceleration operation registration for the driver to perform an acceleration operation. Furthermore, if the operation registration estimation unit 52 detects that the driver's foot is placed on the brake pedal 43 in the vehicle interior image, the operation registration estimation unit 52 estimates that this state is predicted to be a braking operation registration for the driver to perform a braking operation. Additionally, if the operation registration estimation unit 52 detects that the driver removes their foot from the accelerator pedal 42 or brake pedal 43, moves their foot from the accelerator pedal 42 to the brake pedal 43, or moves their foot from the brake pedal 43 to the accelerator pedal 42 in the vehicle interior image, the operation registration estimation unit 52 estimates that the content of the operation registration has changed.

[0046] In addition to estimating operation registration based on in-vehicle images in this manner, the operation registration estimation unit 52 can also estimate operation registration based on in-vehicle sensor information detected by the in-vehicle sensor 46. For example, the in-vehicle sensor 46 can detect pressure or contact on the accelerator pedal 42, brake pedal 43, etc., and the operation registration estimation unit 52 can estimate acceleration operation registration, braking operation registration, etc., based on the in-vehicle sensor information indicating these detection results.

[0047] The condition recognition unit 26 includes a vehicle interior condition recognition unit 53, a vehicle information acquisition unit 54, and a vehicle exterior condition recognition unit 55, and identifies the condition of the vehicle.

[0048] The vehicle interior condition recognition unit 53 recognizes the condition inside the vehicle based on images of the vehicle interior captured by the vehicle interior camera 45 and information from the vehicle interior sensors 46, and provides the vehicle control unit 27 with external vehicle condition information indicating the result of recognizing the condition inside the vehicle.

[0049] The vehicle information acquisition unit 54 acquires vehicle information such as speed data and acceleration data output from the vehicle sensor 47, and provides the vehicle information to the vehicle control unit 27.

[0050] The odor presentation device 29 includes an output unit control unit 61 and N output units 62-1 to 62-N.

[0051] The output unit control unit 61 controls the output units 62-1 to 62-N to present the driver with an odor (odor) according to the odor parameters set by the odor parameter setting unit 28.

[0052] The output units 62-1 to 62-N output air containing odor components (e.g., air in which odors have evaporated) according to the control of the output unit control unit 61, and present the odor to the driver.

[0053] The control system 11 is configured in such a way that the operation record estimation unit 52 estimates the operation record and provides the operation record information to the odor parameter setting unit 28, and the odor parameter setting unit 28 sets odor parameters based on the operation record information to indicate the presentation of an odor associated with the content of the operation record. Therefore, the control system 11 can present an odor associated with the content of the operation record to the driver through the odor presentation device 29.

[0054] As a result, when a driver is about to perform an operation, the driver can determine whether to start or change the operation based on the odor presented by the odor presentation device 29. For example, if an odor associated with an operation is presented when the driver is about to perform an operation, the driver can determine to start the operation because the odor matches the operation the driver is about to perform. On the other hand, if an odor unrelated to an operation is presented when the driver is about to perform an operation, the driver can determine to change the operation because the odor does not match the operation the driver is about to perform.

[0055] refer to Figure 2 The transition diagram shown illustrates the changes in the driver's operational status (operation registration, operation registration change, and operation start) caused by presenting odors.

[0056] Operation registration refers to the driver's operational state of placing their foot on the accelerator pedal 42 or brake pedal 43 (the state of simply placing the foot without pressing it). For example, when the operation registration estimation unit 52 estimates that the driver has placed their foot on the accelerator pedal 42, the operation state recognition unit 25 recognizes that the driver's operational state has changed to acceleration operation registration. Similarly, when the operation registration estimation unit 52 estimates that the driver has placed their foot on the brake pedal 43, the operation state recognition unit 25 recognizes that the driver's operational state has changed to braking operation registration.

[0057] A change in operation record means that the driver has changed the operation status of the operation record. For example, when the operation record estimation unit 52 estimates that the driver has removed his foot from the accelerator pedal 42 or the brake pedal 43, the driver has moved his foot from the accelerator pedal 42 to the brake pedal 43, or the driver has moved his foot from the brake pedal 43 to the accelerator pedal 42, the operation status recognition unit 25 recognizes that the driver's operation status has changed to a change in operation record.

[0058] Operation start is the state in which the driver presses the accelerator pedal 42 or brake pedal 43 and begins operating the vehicle. For example, when the operation content acquisition unit 51 acquires that the driver has pressed the accelerator pedal 42 or the operation content of the accelerator pedal 43, the operation state recognition unit 25 recognizes that the driver's operation state has changed to operation start.

[0059] Therefore, for example, when the driver places his foot on the accelerator pedal 42, the control system 11 can present the driver with an odor associated with acceleration operation, and when the driver places his foot on the brake pedal 43, the control system 11 can present the driver with an odor associated with braking operation.

[0060] As a result, when the driver attempts to accelerate by placing their foot on the accelerator pedal 42, if an odor associated with an acceleration operation is present, the driver can determine that acceleration is about to begin because the odor matches the operation the driver is about to perform, and the driver can depress the accelerator pedal 42. Similarly, when the driver attempts to brake by placing their foot on the brake pedal 43, if an odor associated with a braking operation is present, the driver can determine that braking is about to begin because the odor matches the operation the driver is about to perform, and the driver can depress the brake pedal 43.

[0061] On the other hand, when the driver attempts to accelerate and places their foot on the brake pedal 43, if an odor is present that is not associated with the acceleration operation (i.e., an odor associated with the braking operation), the driver can determine that they must change their operation because the odor does not match the operation they are about to perform, and they can remove their foot from the brake pedal 43. Therefore, in this situation, the driver's mistake of attempting to accelerate but pressing the brake pedal 43 can be prevented in advance.

[0062] Similarly, if a driver attempts to brake and places their foot on the accelerator pedal 42, and an odor is detected that is unrelated to the braking operation (i.e., related to the acceleration operation), the driver can determine that they must change their operation because the odor does not match the operation they are about to perform, and can remove their foot from the accelerator pedal 42. Therefore, in this situation, the error of the driver attempting to brake but pressing the accelerator pedal 42 can be prevented beforehand.

[0063] In this way, the control system 11 can prevent driver errors in advance by presenting odors related to the operation the driver is about to perform, and can control the vehicle's movement more safely. For example, the control system 11 can prevent accidental vehicle start-up caused by the driver mistakenly accelerating while the vehicle is stationary (or parked) in the mistaken belief that the driver is performing a braking operation.

[0064] refer to Figure 3 The flowchart shown describes the first control process performed in the control system 11.

[0065] In step S11, the operation status identification unit 25 identifies the driver's operation status on the vehicle based on the operation filing information indicating the content of the operation filing estimated by the operation filing estimation unit 52, and obtains operation status information indicating the operation status.

[0066] In step S12, the operation status identification unit 25 determines whether the driver's operation status has changed to operation registration based on the operation status information, which is the identification result of step S11.

[0067] In step S12, if the operation status identification unit 25 determines that the driver's operation status has not yet changed to operation registration, the process returns to step S11, and the same process is repeated thereafter.

[0068] On the other hand, in step S12, if the operation status identification unit 25 determines that the driver's operation status has changed to operation registration, the process proceeds to step S13.

[0069] In step S13, the operation record estimation unit 52 provides operation record information, which indicates the content of the operation record estimated in step S11, to the odor parameter setting unit 28. Then, based on the operation record information, the odor parameter setting unit 28 sets odor parameters for the odor presentation device 29 to indicate the presentation of an odor related to the content of the operation record.

[0070] In step S14, the output unit control unit 61 controls the output units 62-1 to 62-N to present an odor to the driver according to the odor parameters set by the odor parameter setting unit 28 in step S13. The output units 62-1 to 62-N output air containing odor components according to the control of the output unit control unit 61 and present an odor related to the operation record to the driver.

[0071] In step S15, the operation status identification unit 25 identifies the driver's operation status on the vehicle based on the operation filing information indicating the operation filing content estimated by the operation filing estimation unit 52 and the operation execution information indicating the operation content obtained by the operation content acquisition unit 51, and acquires the operation status information indicating the operation status.

[0072] In step S16, the operation status recognition unit 25 determines whether the driver's operation status has changed to operation registration change or operation start based on the operation status information, which is the recognition result of step S15.

[0073] In step S16, if the operation state recognition unit 25 determines that the driver's operation state has changed to an operation record change, the process returns to step S13, and the same process is repeated thereafter. In this case, in step S13, the odor parameter is set according to the content of the operation record after the operation record change estimated in step S15.

[0074] On the other hand, in step S16, if the operation state recognition unit 25 determines that the driver's operation state has changed to operation start, the process proceeds to step S17.

[0075] In step S17, the operation content acquisition unit 51 provides the vehicle control unit 27 with operation execution information indicating the operation being performed by the driver. Then, after the vehicle control unit 27 begins control to make the vehicle move according to the operation execution information provided from the operation content acquisition unit 51, the first control process ends.

[0076] By performing the first control process as described above, the control system 11 can prevent driver errors in advance and control the vehicle's movement more safely.

[0077] For example, the driver can detect the odor presented by the odor presentation device 29 and can know whether the driver is about to press the wrong pedal before pressing the accelerator pedal 42 or the brake pedal 43. Therefore, the driver can clearly know which pedal is about to be pressed and thus avoid pressing the wrong one.

[0078] <Second Configuration Example of Control System>

[0079] Figure 4 This is a block diagram illustrating a configuration example of a second embodiment of a control system applying this technology. It should be noted that... Figure 4 In the control system 11A shown, with Figure 1 The common blocks of the control system 11 are denoted by the same reference numerals, and detailed descriptions of these blocks are omitted. For example, Figure 4 The control system 11A can control how the driver's operation is reflected in the vehicle when the driver performs an operation based on the change in the driver's operating state caused by the presentation of odors to the driver.

[0080] like Figure 4 As shown, the control system 11A has the same Figure 1 The control system 11A has a common configuration, including an operating device 21, a vehicle interior identification device 22, a vehicle identification device 23, a vehicle exterior identification device 24, a condition identification unit 26, a vehicle control unit 27, and an odor presentation device 29.

[0081] Then, the control system 11A has a connection with Figure 1 The control system 11 has different configurations, wherein the control system 11A includes an operation status recognition unit 25A, an odor parameter setting unit 28A, a misoperation prevention setting unit 30, and a misoperation prevention control unit 31.

[0082] The operation status recognition unit 25A includes an operation content acquisition unit 51A, which identifies the driver's operation status (operation execution, operation change, or operation maintenance) of the vehicle based on the operation content acquired by the operation content acquisition unit 51A from the operation signal provided by the operation device 21, and acquires operation status information indicating the operation status.

[0083] Similar to Figure 1 The operation content acquisition unit 51A acquires the operation content that the driver is performing. Then, the operation content acquisition unit 51A provides operation execution information indicating the operation content to the odor parameter setting unit 28A and the misoperation prevention control unit 31.

[0084] The odor parameter setting unit 28A sets odor parameters for the odor presentation device 29 based on the operation execution information provided by the operation content acquisition unit 51A, instructing it to present odor parameters related to the operation being performed by the driver. In other words, the odor parameter setting unit 28A can instruct the odor presentation device 29 to present different odors for each operation.

[0085] The misoperation prevention setting unit 30 sets whether to enable / disable the misoperation prevention control unit 31 to perform misoperation prevention processing. Additionally, the misoperation prevention setting unit 30 sets the operation cancellation time used by the misoperation prevention control unit 31 when it performs misoperation prevention processing. For example, the misoperation prevention setting unit 30 can make these settings by using default setting information or by using setting information input by the driver via a user input unit (not shown).

[0086] The misoperation prevention control unit 31 is provided with operation execution information from the operation content acquisition unit 51A, vehicle external condition information from the vehicle internal condition recognition unit 53, vehicle information from the vehicle information acquisition unit 54, and vehicle external condition information from the vehicle external condition recognition unit 55.

[0087] Then, when the misoperation prevention setting unit 30 sets the misoperation prevention processing to "on", the misoperation prevention control unit 31 executes the misoperation prevention processing, which controls the provision of operation execution information, vehicle external condition information, vehicle information, and vehicle external condition information to the vehicle control unit 27 based on the driver's operation state identified by the operation state recognition unit 25A. On the other hand, when the misoperation prevention setting unit 30 sets the misoperation prevention processing to "off", the misoperation prevention control unit 31 provides the operation execution information, vehicle external condition information, vehicle information, and vehicle external condition information to the vehicle control unit 27 as is.

[0088] For example, when misoperation prevention processing is performed, the misoperation prevention control unit 31 temporarily stops providing operation execution information, vehicle interior status information, vehicle information, and vehicle exterior status information to the vehicle control unit 27 until an operation cancellation time has elapsed since the driver's operation state was identified as having changed to operation execution. Afterward, if the misoperation prevention control unit 31 identifies that the driver's operation state has changed to operation change before the operation cancellation time has elapsed, the misoperation prevention control unit 31 discards the operation execution information, vehicle interior status information, vehicle information, and vehicle exterior status information, and does not provide this information to the vehicle control unit 27. In this case, the operation performed by the driver during the operation cancellation time is cancelled. Conversely, if the misoperation prevention control unit 31 identifies that the driver's operation state is operation continuation after the operation cancellation time has elapsed, the misoperation prevention control unit 31 provides the operation execution information, vehicle interior status information, vehicle information, and vehicle exterior status information to the vehicle control unit 27.

[0089] The control system 11A is configured in such a way that the operation content acquisition unit 51A acquires the operation content and provides the operation execution information to the odor parameter setting unit 28, and the odor parameter setting unit 28 sets odor parameters that indicate the presentation of an odor associated with the operation content based on the operation execution information. Therefore, the control system 11A can present an odor associated with the operation content to the driver via the odor presentation device 29.

[0090] As a result, when the driver performs a specific operation, the driver can determine whether to maintain or change the operation based on the odor presented by the odor presentation device 29. For example, if an odor associated with the operation is presented when the driver performs a specific operation, the driver can determine to maintain the operation because the odor matches the operation performed by the driver. On the other hand, if an odor not associated with the operation is presented when the driver performs a specific operation, the driver can determine to change the operation because the odor does not match the operation performed by the driver.

[0091] refer to Figure 5 The state transition diagram shown below will describe the changes in the driver's operational state (operation execution, operation change, and operation maintenance) caused by the presence of odor.

[0092] Operation execution is the operating state in which the driver presses the accelerator pedal 42 or the brake pedal 43 and performs vehicle operations. For example, when the accelerator pedal operation signal or brake pedal operation signal provided by the operating device 21 indicates a predetermined amount of pressing of the accelerator pedal 42 or the brake pedal 43, the operation state recognition unit 25A recognizes that the driver's operation state has changed to operation execution.

[0093] An operation change occurs when the driver alters the operation state before the operation cancellation time has elapsed. For example, when the accelerator pedal operation signal or brake pedal operation signal provided by the operating device 21 changes to indicate that the accelerator pedal 42 or brake pedal 43 is depressed to 0, the operation state recognition unit 25A recognizes that the driver's operation state has changed to an operation change.

[0094] Operation maintenance is an operational state in which the driver continues to depress the accelerator pedal 42 or brake pedal 43 after the operation cancellation time has elapsed, thus maintaining the execution of vehicle operation. For example, when the accelerator pedal operation signal or brake pedal operation signal provided by the operation device 21 continues to indicate the amount of accelerator pedal 42 or brake pedal 43 being depressed, the operation state recognition unit 25A recognizes that the driver's operation state is operation maintenance.

[0095] Therefore, for example, when the driver presses the accelerator pedal 42, the control system 11A can present the driver with an odor associated with the acceleration operation, and when the driver presses the brake pedal 43, the control system 11A can present the driver with an odor associated with the braking operation.

[0096] As a result, if an odor associated with acceleration is present while the driver is performing an acceleration operation and pressing the accelerator pedal 42, the driver can determine to maintain the acceleration operation because the odor matches the operation performed by the driver, and can continue to press the accelerator pedal 42. Similarly, if an odor associated with braking is present while the driver is performing a braking operation and pressing the brake pedal 43, the driver can determine to maintain the braking operation because the odor matches the operation performed by the driver, and can continue to press the brake pedal 43.

[0097] On the other hand, if a driver believes they are performing an acceleration operation but simultaneously presses the brake pedal 43 and an odor unrelated to acceleration (i.e., an odor associated with braking) is present, the driver can determine to change their operation because the odor does not match the operation performed by the driver, and can remove their foot from the brake pedal 43. Similarly, if a driver believes they are performing a braking operation but simultaneously presses the accelerator pedal 42 and an odor unrelated to braking (i.e., an odor associated with acceleration) is present, the driver can determine to change their operation because the odor does not match the operation performed by the driver, and can remove their foot from the accelerator pedal 42.

[0098] Then, in the control system 11A, if it is recognized that the driver's operation state has changed to an operation change before the operation cancellation time has elapsed, the operation performed by the driver during the operation cancellation time is cancelled. Therefore, it is possible to prevent the vehicle from stopping erroneously due to the driver mistakenly believing they are performing an acceleration operation but pressing the brake pedal 43, and it is also possible to prevent the vehicle from starting erroneously due to the driver mistakenly believing they are performing a braking operation but pressing the accelerator pedal 42. For example, the control system 11A can prevent the vehicle from starting erroneously due to the driver mistakenly believing they are performing a braking operation while accelerating when the vehicle is stopped (or parked).

[0099] Additionally, for example, when the driver operates the shift lever 44 to the drive position or the reverse position, the control system 11A can present the driver with a smell associated with driving or reversing.

[0100] As a result, if a driving-related odor is present when the driver operates the shift lever 44 to the drive position to move the vehicle forward, the driver can determine to maintain operation of the shift lever 44 because the odor matches the operation performed by the driver. Similarly, if a reversing-related odor is present when the driver operates the shift lever 44 to the reverse position to move the vehicle backward, the driver can determine to maintain operation of the shift lever 44 because the odor matches the operation performed by the driver.

[0101] On the other hand, if a smell unrelated to driving (i.e., a smell associated with reversing) is detected when the driver operates the shift lever 44 to the reverse position to move the vehicle forward, the driver can determine to change the operation because the smell does not match the operation performed by the driver, and can perform the operation of changing the position of the shift lever 44 to driving. Similarly, if a smell unrelated to reversing (i.e., a smell associated with driving) is detected when the driver operates the shift lever 44 to the driving position to move the vehicle backward, the driver can determine to change the operation because the smell does not match the operation performed by the driver, and can perform the operation of changing the position of the shift lever 44 to reversing.

[0102] Then, in the control system 11A, if it is detected that the driver's operating state has changed to an operation change before the operation cancellation time has elapsed, the operation performed by the driver during the operation cancellation time (e.g., acceleration operation during that period) is cancelled. Therefore, it is possible to prevent the vehicle from mistakenly moving backward when the driver attempts to move the gear lever 44 to the reverse position, and it is also possible to prevent the vehicle from mistakenly moving forward when the driver attempts to move the vehicle backward by moving the gear lever 44 to the drive position. For example, when the vehicle is stopped (or parked), the control system 11A can prevent erroneous starting due to the driver's mistaken operation of the gear lever 44 (moving forward due to an operation intended to move the vehicle backward, or moving backward due to an operation intended to move the vehicle forward).

[0103] refer to Figure 6 The flowchart shown describes the second control process performed in the control system 11A. The second control process is performed when the misoperation prevention process is set to "on," and when the misoperation prevention process is set to "off," operation execution information, vehicle interior status information, vehicle information, and vehicle exterior status information are provided directly from the operation content acquisition unit 51A to the vehicle control unit 27 via the misoperation prevention control unit 31.

[0104] In step S21, the operation state recognition unit 25A recognizes the driver's operation state on the vehicle based on the operation content obtained by the operation content acquisition unit 51A from the operation signal provided by the operation device 21, and acquires operation state information indicating the operation state.

[0105] In step S22, the operation state recognition unit 25A determines whether the driver's operation state has changed to operation execution based on the operation state information, which is the recognition result of step S21.

[0106] In step S22, if the operation state recognition unit 25A determines that the driver's operation state has not yet changed to operation execution, the process returns to step S21, and the same process is repeated thereafter.

[0107] On the other hand, in step S22, if the operation state recognition unit 25A determines that the driver's operation state has changed to operation execution, the process proceeds to step S23.

[0108] In step S23, the operation content acquisition unit 51A provides operation execution information indicating the operation content acquired in step S21 to the odor parameter setting unit 28A. Then, based on the operation execution information, the odor parameter setting unit 28A sets odor parameters for the odor presentation device 29 to indicate the odor associated with the operation content being performed by the driver.

[0109] In step S24, the output unit control unit 61 controls the output units 62-1 to 62-N to present an odor according to the odor parameters set by the odor parameter setting unit 28A in step S23. The output units 62-1 to 62-N output air including odor components according to the control of the output unit control unit 61, and present an odor associated with the operation to the driver.

[0110] In step S25, the misoperation prevention control unit 31 waits for the operation cancellation time to elapse.

[0111] In step S26, the operation state recognition unit 25A identifies the driver's operation state on the vehicle based on the operation execution information indicating the operation content obtained by the operation content acquisition unit 51A from the operation signal provided by the operation device 21, and acquires the operation state information indicating the operation state.

[0112] In step S27, the operation state recognition unit 25A determines whether the driver's operation state is a change in operation or a maintenance of operation based on the operation state information, which is the recognition result of step S26.

[0113] In step S27, if the operation state recognition unit 25A determines that the driver's operation state has changed, the process returns to step S23, and the same process is repeated thereafter. In this case, the driver's operation performed during the operation cancellation time is canceled, and in step S23, the odor parameters are set according to the operation content after the operation change identified in step S26. Therefore, in this case, the odor presentation device 29 presents an odor associated with the operation content after the operation change.

[0114] On the other hand, in step S27, if the operation state recognition unit 25A determines that the driver's operation state is operation maintenance, the process proceeds to step S28.

[0115] In step S28, the misoperation prevention control unit 31 provides the vehicle control unit 27 with operation execution information, vehicle external condition information, vehicle information, and vehicle external condition information. Then, after the vehicle control unit 27 executes the control to make the vehicle move based on the operation execution information provided from the operation content acquisition unit 51, the process returns to step S23, and the same process is repeated thereafter.

[0116] By performing the second control process as described above, the control system 11A can cancel the operation if the operation performed by the driver before the operation cancellation time has elapsed, and can control the vehicle's movement more safely.

[0117] For example, the driver can detect the odor presented by the odor presentation device 29 and can know whether the driver has mistakenly pressed either the accelerator pedal 42 or the brake pedal 43 before the operation is reflected in the vehicle. Therefore, even if the driver mistakenly presses the accelerator pedal 42 in a parking lot or other place, the driver can notice the misoperation by the odor before the vehicle starts to move, and thus can eliminate the risk of vehicle movement caused by mistakenly pressing the accelerator pedal 42 and mitigate the risk of an accident.

[0118] It should be noted that, in the control system 11A, in addition to the timed start operation cancellation time when the driver's operating state is identified as having changed to operation execution, the odor parameter setting unit 28A can also, for example, notify the misoperation prevention control unit 31 that the odor parameter has been set for the odor presentation device 29, and can be notified at the timed start operation cancellation time when the notification is received.

[0119] Furthermore, the control system 11A can, for example, precisely sense the driver's operating conditions and, if the desired safe operation is achieved, execute feedback to cancel the presentation of odors.

[0120] Figure 7 For illustration and reference purposes Figure 6 A flowchart illustrating a modified example of the second control process.

[0121] like Figure 7 As shown, the reference is executed from step S21 to S28. Figure 6 The process described. Then, after the process in step S28, the process proceeds to step S29.

[0122] In step S29, the operation state identification unit 25A determines whether the operation duration (which is the duration of the operation state from the time when it is determined in step S22 that the driver's operation state has changed to operation execution) has become equal to or greater than the predetermined time.

[0123] In step S29, if the operation status identification unit 25A determines that the operation duration has not become equal to or greater than the predetermined time (i.e., less than the predetermined time), the process returns to step S23, and the same process is repeated thereafter.

[0124] On the other hand, in step S29, if the operation status identification unit 25A determines that the operation duration has become equal to or greater than the predetermined time, the process proceeds to step S30.

[0125] In step S30, the operation status recognition unit 25A provides a stop command to the odor parameter setting unit 28A, instructing it to stop presenting the odor. The odor parameter setting unit 28A, based on the stop command, instructs the odor presentation device 29 to stop presenting the odor, and within the odor presentation device 29, the output unit control unit 61 controls the output units 62-1 to 62-N to stop odor presentation. Therefore, the presentation of the odor associated with the operation content is stopped.

[0126] Afterwards, the process returns to step S26, and the same process is repeated thereafter. For example, if it is determined in subsequent step S27 that the driver's operation state is operation maintenance, the driver's operation is not canceled, and the misoperation prevention control unit 31 provides operation execution information, vehicle external condition information, vehicle information, and vehicle external condition information to the vehicle control unit 27, and the vehicle control unit 27 controls the vehicle's movement. On the other hand, if it is determined in subsequent step S27 that the driver's operation state is operation change, the scent presentation restarts according to the operation content after the operation change.

[0127] As described above, when a specific operating state continues for at least a predetermined time, the control system 11A can determine that the desired safe driving is in progress and can stop the presentation of odors based on the operation at that time. It should be noted that, in another embodiment of the control system 11, similar to the control system 11A, the presentation of odors can also be stopped when a specific operating state continues for at least a predetermined time.

[0128] <Third Configuration Example of Control System>

[0129] Figure 8 This is a block diagram illustrating a configuration example of a third embodiment of a control system applying the present technology. It should be noted that, in Figure 8 In the control system 11B shown, with Figure 1 The control system 11 and Figure 4 The blocks shared by the control system 11A are indicated by the same reference numerals, and detailed descriptions of these blocks are omitted. For example, Figure 7 The control system 11B can set the on / off state for handling malfunctions based on the vehicle's condition.

[0130] like Figure 8 As shown, the control system 11B has the same characteristics as... Figure 1 The common configuration of the control system 11B: The control system 11B includes an operating device 21, a vehicle interior identification device 22, a vehicle identification device 23, a vehicle exterior identification device 24, a vehicle control unit 27, and an odor presentation device 29, and has the same... Figure 4 Common configuration of control system 11A: Control system 11B includes misoperation prevention control unit 31.

[0131] Then, the control system 11B has a connection with Figure 1 The control system 11 and Figure 4 The control system 11A has different configurations: the control system 11B includes an operation status recognition unit 25B, a condition recognition unit 26B, an odor parameter setting unit 28B, and a misoperation prevention setting unit 30B.

[0132] The operation status recognition unit 25B includes an operation content acquisition unit 51B, and is similar to... Figure 4 The operation state recognition unit 25A recognizes the driver's operation state on the vehicle and acquires operation state information indicating the operation state. Similar to... Figure 1 The operation content acquisition unit 51B acquires the operation content that the driver is performing. Then, the operation content acquisition unit 51B provides operation execution information indicating the operation content to the odor parameter setting unit 28B and the misoperation prevention control unit 31.

[0133] The condition recognition unit 26B includes a vehicle interior condition recognition unit 53, a vehicle information acquisition unit 54B, and a vehicle exterior condition recognition unit 55B, and identifies the condition of the vehicle.

[0134] Similar to Figure 1 The vehicle information acquisition unit 54B acquires vehicle information. Then, the vehicle information acquisition unit 54B provides the vehicle information to the misoperation prevention setting unit 30B and the misoperation prevention control unit 31.

[0135] Similar to Figure 1 The vehicle external condition recognition unit 55B recognizes the external conditions of the vehicle. Then, the vehicle external condition recognition unit 55B provides vehicle external condition information indicating the result of recognizing the external conditions to the misoperation prevention setting unit 30B and the misoperation prevention control unit 31.

[0136] Similar to Figure 4 The odor parameter setting unit 28A and odor parameter setting unit 28B set odor parameters for the odor presentation device 29 based on the operation execution information provided by the operation content acquisition unit 51B. In other words, the odor parameter setting unit 28B can instruct the odor presentation device 29 to present different odors for each operation content.

[0137] The misoperation prevention setting unit 30B sets the misoperation prevention control unit 31 to be on or off for misoperation prevention processing based on the vehicle information provided by the vehicle information acquisition unit 54B and the vehicle external condition information provided by the vehicle external condition recognition unit 55B.

[0138] For example, the misoperation prevention setting unit 30B determines whether the vehicle is in a stopped or moving state based on the vehicle speed data indicated by the vehicle information provided by the vehicle information acquisition unit 54B. Furthermore, if the misoperation prevention setting unit 30B determines that the vehicle is in a moving state, it determines whether the object exists within a predetermined distance from the vehicle based on the presence or absence of an object outside the vehicle indicated by the vehicle external condition information provided by the vehicle external condition recognition unit 55B, and the distance information to the object outside the vehicle (relative position information relative to the vehicle).

[0139] Then, when the misoperation prevention setting unit 30B determines that the vehicle is in motion and that the object is within a predetermined distance from the vehicle, the misoperation prevention setting unit 30B sets the misoperation prevention processing related to steering wheel operation to off. Therefore, in the operation execution information provided by the operation content acquisition unit 51B, the misoperation prevention control unit 31 continuously provides the operation content of the steering wheel 41 to the vehicle control unit 27.

[0140] Furthermore, when the misoperation prevention setting unit 30B determines that the vehicle is in a stopped state, the misoperation prevention setting unit 30B sets the misoperation prevention processing related to acceleration operation to "on". Therefore, even if the operation of pressing the accelerator pedal 42 is performed while the vehicle is stopped, the misoperation prevention control unit 31 will cancel the acceleration operation until the operation cancellation time has elapsed, and temporarily stop providing the operation content of the accelerator pedal 42 from the operation execution information provided by the operation content acquisition unit 51B to the vehicle control unit 27.

[0141] Furthermore, when the misoperation prevention setting unit 30B determines that the vehicle is in motion and that no object exists within a predetermined distance from the vehicle, the misoperation prevention setting unit 30B sets the misoperation prevention processing related to steering wheel operation to "on". Therefore, even if an operation on the steering wheel 41 is performed while the vehicle is in motion, the misoperation prevention control unit 31 will cancel the steering wheel operation until the operation cancellation time has elapsed, and temporarily stop providing the operation content of the steering wheel 41 from the operation execution information provided by the operation content acquisition unit 51B to the vehicle control unit 27.

[0142] The control system 11B is configured in this way and can set the on / off state for misoperation prevention processing based on vehicle speed data, external conditions of the vehicle, etc., thereby enabling more appropriate execution of misoperation prevention processing.

[0143] Note that in control system 11B, when the misoperation prevention processing is set to "on", the above-mentioned... Figure 6The flowchart similarly executes the second control process.

[0144] <Fourth Configuration Example of Control Device>

[0145] Figure 9 This is a block diagram illustrating a configuration example of a fourth embodiment of a control device applying the present technology. Note that, in Figure 9 In the control system 11C shown, with Figure 1 The control system 11 and Figure 4 The blocks shared by the control system 11A are indicated by the same reference numerals, and detailed descriptions of these blocks are omitted. For example, Figure 9 The control system 11C can control how the operation is reflected in the vehicle when the driver is about to perform an operation and when the driver performs an operation, based on the change in the driver's operating state caused by the presentation of odors to the driver.

[0146] like Figure 9 As shown, the control system 11C has the same characteristics as... Figure 1 The common configuration of the control system 11: The control system 11C includes an operating device 21, a vehicle interior identification device 22, a vehicle identification device 23, a vehicle exterior identification device 24, an operating status identification unit 25, a condition identification unit 26, a vehicle control unit 27, and an odor presentation device 29, and has the same... Figure 4 The common configuration of the control system 11A: The control system 11C includes a misoperation prevention setting unit 30 and a misoperation prevention control unit 31.

[0147] Then, the control system 11C has with Figure 1 The control system 11 and Figure 4 The control system 11A has different configurations: the control system 11C includes an odor parameter setting unit 28C.

[0148] The odor parameter setting unit 28C receives operation execution information from the operation content acquisition unit 51 and operation record estimation information from the operation record estimation unit 52. The odor parameter setting unit 28C sets odor parameters for the odor presentation device 29 to indicate that the odor associated with the operation content of the operation execution information provided by the operation content acquisition unit 51 is presented. Furthermore, the odor parameter setting unit 28C sets odor parameters for the odor presentation device 29 to indicate that the odor associated with the content of the operation record estimation information provided by the operation record estimation unit 52 is presented. In other words, the odor parameter setting unit 28C can instruct the odor presentation device 29 to present different odors for each content of the operation record and for each operation content.

[0149] In other words, the odor parameter setting unit 28C is configured to perform... Figure 1 Operation of the odor parameter setting unit 28 and Figure 4 The operation of the odor parameter setting unit 28A involves both of these.

[0150] The control system 11C configured in this way can be similar to Figure 1 The control system 11 and Figure 4 The 11A control system is used to control the vehicle's movement more safely.

[0151] Note that, similar to having Figure 1 The control system 11 and Figure 4 The control system 11C can also be configured in combination with the control system 11A. Figure 1 The control system 11 and Figure 8 The configuration of the control system 11B combination.

[0152] Reference Figure 10 The flowchart shown in the figure describes the third control process performed in the control system 11C.

[0153] In steps S31 to S36, the following steps are performed: Figure 3 The processing in steps S11 to S16 is the same.

[0154] In step S37, the operation content acquisition unit 51C provides the odor parameter setting unit 28C with operation execution information indicating the operation content acquired in step S35 (i.e., the operation content performed by the driver). Then, the odor parameter setting unit 28C sets odor parameters for the odor presentation device 29 based on the operation execution information, indicating that the odor associated with the operation content will be presented.

[0155] In steps S38 to S42, the following steps are performed: Figure 6 The processing in steps S24 to S28 is the same.

[0156] By performing the third control process as described above, the control system 11C can be similar to Figure 1 The control system 11 and Figure 4 The 11A control system provides safer control of the vehicle's movement.

[0157] <Fifth Configuration Example of Control System>

[0158] Figure 11 This is a block diagram illustrating a configuration example of a fifth embodiment of a control system applying this technology. Note that in Figure 11 In the control system 11D shown, with Figure 1 The blocks shared by the control system 11 are indicated by the same reference numerals, and detailed descriptions of these blocks are omitted.

[0159] like Figure 11 As shown, the control system 11D has the same characteristics as... Figure 1 The common configuration of the control system 11D includes an operating device 21, a vehicle interior identification device 22, a vehicle identification device 23, a vehicle exterior identification device 24, a vehicle control unit 27, and an odor presentation device 29.

[0160] Then, the control system 11D has with Figure 1 The control system 11D has different configurations: the control system 11D includes an operation status recognition unit 25D, a condition recognition unit 26D and an odor parameter setting unit 28D.

[0161] The operation status recognition unit 25D includes an operation content acquisition unit 51D, and is connected with... Figure 4 Similar to the operation state recognition unit 25A, it recognizes the driver's operation state on the vehicle and obtains operation state information indicating the operation state. Figure 1 Similar to the operation content acquisition unit 51, the operation content acquisition unit 51D acquires the operation content that the driver is performing and provides the operation execution information indicating the operation content to the vehicle control unit 27.

[0162] The condition recognition unit 26D includes a vehicle interior condition recognition unit 53, a vehicle information acquisition unit 54, and a vehicle exterior condition recognition unit 55D, and identifies the condition of the vehicle.

[0163] In addition to providing vehicle location information from location information acquisition unit 48, vehicle exterior images from vehicle exterior camera 49, and vehicle exterior sensor information from vehicle exterior sensor 50, vehicle speed data is also provided to vehicle exterior condition recognition unit 55D from vehicle sensor 47. Then, vehicle exterior condition recognition unit 55D identifies the external conditions of the vehicle based on the vehicle location information, vehicle exterior images, vehicle exterior sensor information, and vehicle speed data, and provides vehicle exterior condition information indicating the identified external conditions to odor parameter setting unit 28D.

[0164] The odor parameter setting unit 28D sets odor parameters for the odor presentation device 29 based on vehicle external condition information provided by the vehicle external condition recognition unit 55D, instructing the odor presentation device 29 to present odors according to the vehicle external conditions. In other words, the odor parameter setting unit 28D can instruct the odor presentation device 29 to present different odors for each type of vehicle external condition.

[0165] The control system 11D is configured in such a way that the vehicle external condition recognition unit 55D recognizes the external conditions of the vehicle and provides the external condition information to the odor parameter setting unit 28D. The odor parameter setting unit 28D sets odor parameters based on the external condition information to indicate the odor to be presented according to the external conditions. Therefore, the control system 11D can present odors to the driver according to the external conditions via the odor presentation device 29. For example, in an unsafe external condition, the control system 11D can present an unpleasant odor to the driver and warn of danger; and in a safe external condition, the control system 11D can present a pleasant odor to the driver and notify them that the condition is safe or acceptable. As a result, the control system 11D can support the driver in understanding the external conditions of the vehicle.

[0166] Reference Figure 12 This will describe an example of how odors are presented based on the vehicle's external conditions.

[0167] The control system 11D can control the odor presented to the driver, such that the intensity of the unpleasant odor increases as the vehicle speed exceeds the speed limit. Conversely, when the vehicle speed is below the speed limit, the control system 11D can control the odor to present a pleasant odor to the driver. For example, the vehicle exterior condition recognition unit 55D can obtain speed limit information by recognizing traffic signs using image analysis of vehicle exterior images captured by the vehicle exterior camera 49, and can also obtain speed limit information from map information by referring to the vehicle's position information obtained by the position information acquisition unit 48. Then, the vehicle exterior condition recognition unit 55D can obtain the overspeed by obtaining the difference between the vehicle speed data output from the vehicle sensor 47 and the speed limit.

[0168] exist Figure 12 In the example shown in A, when the speed exceeds 0 km / h, the odor presented to the driver is controlled to be odor B (an unpleasant odor), and the intensity of odor B (an unpleasant odor) increases with each increase of +10 km / h in the speed limit. On the other hand, when the speed exceeds less than 0 km / h, control is executed to present odor A (a pleasant odor) to the driver.

[0169] Similarly, the control system 11D can control the odor presented to the driver such that, depending on the relative speed of the vehicle with respect to the speeds of other vehicles ahead, the intensity of an unpleasant odor increases with the relative speed. Conversely, when the relative speed is low, the control system 11D can control the presentation of a pleasant odor to the driver.

[0170] In this way, the control system 11D can warn / notify the driver of exceeding the speed limit, relative speed to other vehicles in front, etc. by presenting unpleasant smells, and enable the driver to perform safer operations.

[0171] The control system 11D can control the scent presented to the driver based on a vehicle distance parameter (speed [km / h] / (vehicle distance [m] × 1000)) which is expressed as the ratio of vehicle speed to the vehicle distance to other vehicles in front and behind. For example, the vehicle external condition recognition unit 55D can obtain vehicle distance information by performing image analysis on vehicle external images captured by the vehicle external camera 49, detect vehicle distance by the vehicle external sensor 50, and obtain the vehicle distance parameter based on the vehicle speed data output from the vehicle sensor 47.

[0172] exist Figure 12 In the example shown in B, the odor presented to the driver is controlled such that when the vehicle distance parameter is less than 1.0 (i.e., when sufficient distance to other vehicles in front and behind is ensured considering vehicle speed), odor A (a pleasant odor) is presented, and when the vehicle distance parameter is 0.5 or higher, the intensity of odor A (a pleasant odor) is higher than when the vehicle distance parameter is less than 0.5. On the other hand, the odor presented to the driver is controlled such that when the vehicle distance parameter is 1.0 or higher (i.e., when sufficient distance to other vehicles in front and behind is not ensured considering vehicle speed), odor B (an unpleasant odor) is presented, and when the vehicle distance parameter is 1.5 or higher, the intensity of odor B (an unpleasant odor) is higher than when the vehicle distance parameter is less than 1.5. Furthermore, the control is executed such that the greater the vehicle distance to other vehicles in front and behind, the higher the intensity of the odor presented to the driver, considering vehicle speed.

[0173] In this way, the control system 11D can warn / notify the driver that there is not enough distance between the vehicle and other vehicles in front and behind when considering the vehicle speed by presenting an unpleasant odor, and can enable the driver to perform safer operations.

[0174] The control system 11D can control the scent presented to the driver based on the distance [m] to surrounding objects located in the left-right direction orthogonal to the vehicle's driving direction. For example, the vehicle exterior condition recognition unit 55D can obtain distance information to surrounding objects by performing image analysis on vehicle exterior images captured by the vehicle exterior camera 49, and can detect the distance to surrounding objects by the vehicle exterior sensor 50.

[0175] exist Figure 12 In the example shown in C, the odor presented to the driver is controlled such that when the distance to a surrounding object in the left-right direction orthogonal to the vehicle's direction of travel is less than 1.0 (i.e., when the distance to the surrounding object is short), odor B (an unpleasant odor) is presented, and when the distance to the surrounding object is less than 0.5, the intensity of odor B (an unpleasant odor) is higher than when the distance to the surrounding object is 0.5 or greater. On the other hand, the odor presented to the driver is controlled such that when the distance to a surrounding object in the left-right direction orthogonal to the vehicle's direction of travel is 1.0 or greater (i.e., when the distance to the surrounding object is long), odor A (a pleasant odor) is presented, and when the distance to the surrounding object is less than 1.5, the intensity of odor A (a pleasant odor) is higher than when the distance to the surrounding object is 1.5 or greater. Furthermore, the control is performed such that the intensity of the odor presented to the driver increases as the distance to a surrounding object in the left-right direction orthogonal to the vehicle's direction of travel decreases.

[0176] In this way, the control system 11D can warn / notify the driver of a short distance to surrounding objects located in the left-right direction orthogonal to the vehicle's direction of travel by presenting an unpleasant odor, and may cause the driver to perform safer actions. Note that, similar to the distance to surrounding objects, the control system 11D can similarly control the odor presented to the driver based on the distance to lane markings on the road.

[0177] For example, the control system 11D can use scents such as citrus and floral scents as pleasant scents, and can use pungent scents such as strong mint, vinegar and sulfur scents as unpleasant scents.

[0178] Note that the control system 11D can present the driver with odors that are related to the vehicle's speed. For example, the control system 11D can control the odors presented to the driver by presenting a forest-like odor when the vehicle speed is 20 to 30 km / h, a rose-like odor when the vehicle speed is 40 to 60 km / h, a fruity odor when the vehicle speed is 60 to 80 km / h, and a citrus-like odor when the vehicle speed is 80 to 100 km / h.

[0179] Reference Figure 13 The flowchart shown below describes the fourth control process performed in the control system 11D.

[0180] In step S51, the vehicle external condition recognition unit 55D identifies the external condition of the vehicle based on the vehicle's position information, vehicle external image, vehicle external sensor information, and vehicle speed data.

[0181] In step S52, the vehicle exterior condition recognition unit 55D provides vehicle exterior condition information, indicating the recognition result of the vehicle exterior condition identified in step S51, to the odor parameter setting unit 28D. Then, the odor parameter setting unit 28D sets odor parameters for the odor presentation device 29 based on the vehicle exterior condition information, instructing it to present an odor according to the vehicle exterior condition.

[0182] In step S53, the output unit control unit 61 controls the output units 62-1 to 62-N to present the driver with an odor according to the odor parameters set by the odor parameter setting unit 28 in step S52. The output units 62-1 to 62-N output air containing odor components according to the control of the output unit control unit 61, and present the driver with an odor associated with the external conditions of the vehicle (e.g., a pleasant odor if the external conditions are safe, or an unpleasant odor if the external conditions are unsafe).

[0183] In step S54, after the vehicle control unit 27 performs control to make the vehicle drive according to the operation execution information provided by the operation content acquisition unit 51D, the process returns to step S51, and the same process is repeated thereafter.

[0184] By performing the fourth control process as described above, the control system 11D can base its decisions on factors such as vehicle speed, inter-vehicle distance, and distance to surrounding objects (as shown in the reference). Figure 12 The above-mentioned actions will provide warnings / notifications to the driver and may lead the driver to perform safer operations.

[0185] For example, the driver can detect the odor presented by the odor presentation device 29 and can adjust the operation of the vehicle so that the vehicle drives in a manner appropriate to the vehicle's conditions (speed, distance between vehicles, distance from surrounding objects, etc.), thereby leading to accident prevention and traffic violation prevention.

[0186] <Sixth Configuration Example of Control System>

[0187] Figure 14 This is a block diagram illustrating a configuration example of a sixth embodiment of a control system to which this technology is applied. Note that, in Figure 14 In the control system 11E shown, with Figure 1 The blocks shared by the control system 11 in the figure are indicated by the same reference numerals, and detailed descriptions of these blocks are omitted. For example, Figure 14 The control system 11E can control how an operation is reflected in the machine when the operator is about to perform an operation, based on the change in the operator's operating state caused by the presentation of odors to the operator, for various controlled machines such as factory machines, trains and ships.

[0188] like Figure 14 As shown, the control system 11E has the same characteristics as... Figure 1 The common configuration of the control system 11 in the system: The control system 11E includes an operation status recognition unit 25, an odor parameter setting unit 28, and an odor presentation device 29.

[0189] Then, the control system 11E has with Figure 1 Different configurations of the control system 11: The control system 11E includes an operation unit 71, a camera 72, and a machine control unit 73.

[0190] The operation unit 71 is used to operate the handwheels, pedals, levers, etc. of various machines controlled by the control system 11E. The operation unit 71 provides the operation signal corresponding to the operation performed by the operator to the operation content acquisition unit 51 of the operation status recognition unit 25.

[0191] Camera 72 captures the operator's actions when operating the operation unit 71 (hand movements on the crank wheel, lever, etc., or foot movements on the pedal), and provides the captured images to the operation status recognition unit 25 and the operation record estimation unit 52.

[0192] The machine control unit 73 controls various machines controlled by the control system 11E based on the operation execution information provided by the operation content acquisition unit 51.

[0193] and Figure 1 Similar to the control system 11 in the previous system, the control system 11E configured in this way can present the operator with odors associated with the contents of the operation record predicted that the operator will perform an operation on the machine through the operation unit 71 via the odor presentation device 29. That is, a different odor is presented for each contents of the operation record. Therefore, when the operator is about to perform an operation, the operator can determine whether to start the operation or change the operation to be performed based on the odor presented by the odor presentation device 29.

[0194] Therefore, with Figure 1 Similar to the control system 11 in the middle, the control system 11E can prevent operator errors in advance and can control the machine more safely.

[0195] <Seventh Configuration Example of Control System>

[0196] Figure 15 This is a block diagram illustrating a configuration example of a seventh embodiment of a control system to which this technology is applied. Note that, in Figure 15 In the control system 11F shown, with Figure 1 Control system 11 Figure 4 The control system 11A and Figure 14 The blocks shared by the control system 11E in the figure are indicated by the same reference numerals, and detailed descriptions of these blocks are omitted. For example, Figure 15 The control system 11F can control how an operation is reflected in the machine when an operator performs an operation, based on the change in the operator's operating state caused by the presentation of an odor to the operator, for various controlled machines such as factory machines (such as machine tools), trains and ships.

[0197] like Figure 15 As shown, the control system 11F has the same characteristics as... Figure 1 The control system 11F shares a common configuration: the control system 11F includes an odor parameter setting unit 28 and an odor presentation device 29; it has the same configuration as... Figure 4 The control system 11F shares a common configuration with the control system 11A: the control system 11F includes a misoperation prevention setting unit 30 and a misoperation prevention control unit 31; and has the same configuration as... Figure 14 The common configuration of the control system 11E: The control system 11F includes an operation unit 71 and a machine control unit 73. Additionally, the operation status recognition unit 25F and operation content acquisition unit 51F included in the control system 11F are consistent with those included in... Figure 4 The operation status recognition unit 25A and operation content acquisition unit 51A in the control system 11A are similarly configured.

[0198] Similar to Figure 4 The control system 11A, configured in this way, can present the operator with an odor associated with the operation performed by the operator on the operating unit 71 via the odor presentation device 29; that is, a different odor is presented for each operation. Therefore, when the operator performs an operation, the operator can determine whether to maintain or change the operation based on the odor presented by the odor presentation device 29. Then, if the misoperation prevention control unit 31 recognizes that the operator's operation status has changed to operation change before the operation cancellation time has elapsed, the misoperation prevention control unit 31 does not provide operation execution information to the machine control unit 73, and the operator's operation performed within the operation cancellation time is cancelled.

[0199] Therefore, similar to Figure 4The control system 11A and control system 11F can cancel an operation if the operation performed by the operator is changed before the operation cancellation time has elapsed, and can control the machine more safely.

[0200] Note that, similar to the above Figure 9 The control system 11C can be adopted Figure 14 The control system 11E and Figure 4 The configuration of the control system 11F combination. Additionally, it can include, for example... Figure 8 The configuration of the on / off settings for malfunction prevention processing, as in the control system 11B, is similar to that in the control system 11B. Figure 14 The control system 11E combination.

[0201] <Eighth Configuration Example of Control Device>

[0202] refer to Figures 16 to 18 The following describes a configuration example of an eighth embodiment of a control device to which this technology is applied.

[0203] Figure 16 This is a block diagram illustrating a configuration example of an eighth embodiment of a control device applying the present technology. Note that, in Figure 16 In the control system 11G shown, with Figure 1 The blocks shared by the control system 11 are indicated by the same reference numerals, and detailed descriptions of these blocks are omitted.

[0204] like Figure 16 As shown, the control system 11G has the same characteristics as... Figure 1 The common configuration of the control system 11G includes an operating device 21, a vehicle interior identification device 22, a vehicle identification device 23, a vehicle exterior identification device 24, a condition identification unit 26, and an odor presentation device 29.

[0205] Then, the control system 11G has the same Figure 1 The control system 11G has different configurations: the control system 11G includes an operation status recognition unit 25G, an odor parameter setting unit 28G, a communication unit 81, a cancel input unit 82, and a driver status determination unit 83. Note that the operation status recognition unit 25G and... Figure 4 The operation status recognition unit 25A is similarly configured, and a detailed description of the operation status recognition unit 25G is omitted.

[0206] Furthermore, when passengers other than the driver are riding in a vehicle equipped with the control system 11G, the control system 11G may include a user terminal 12 carried by the passenger as part of the system. The user terminal 12 is, for example, a smartphone, and includes a communication unit 91 and an application execution processing unit 92.

[0207] Communication unit 81 and communication unit 91 can perform wireless communication using existing communication standards (e.g., Bluetooth (registered trademark)) and can communicatively connect control system 11G and user terminal 12.

[0208] The application execution processing unit 92 executes a driver alarm application, through which the occupant uses odor to issue an alarm to the driver. For example, when the application execution processing unit 92 executes the driver alarm application and performs an operation by the occupant to issue an alarm to the driver using odor, the application execution processing unit 92 can provide an alarm command indicating the presentation of an odor for the alarm to the odor parameter setting unit 28G and the driver status determination unit 83 via the communication unit 81.

[0209] The cancellation input unit 82 is an input unit for the driver to instruct the driver to stop the presentation of the odor used for the alarm when the odor presentation device 29 presents the odor used for the alarm. For example, when the driver instructs the driver to stop the presentation of the odor used for the alarm, the cancellation input unit 82 provides a stop command to the driver status determination unit 83 to instruct the driver to stop the presentation of the odor used for the alarm.

[0210] The driver status determination unit 83 receives operation execution information from the operation content acquisition unit 51G, vehicle interior status information from the vehicle interior status recognition unit 53, vehicle information from the vehicle information acquisition unit 54, and vehicle exterior status information from the vehicle exterior status recognition unit 55. Then, when an alarm command is provided from the application execution processing unit 92 via the communication unit 81, the driver status determination unit 83 determines whether the driver's driving status is normal based on the operation execution information, vehicle interior status information, vehicle information, and vehicle exterior status information.

[0211] For example, the driver state determination unit 83 can determine whether the driver's driving state is normal based on whether the vehicle is maintaining an appropriate distance from other vehicles while traveling at an appropriate speed along the road, or the monitoring results of the driver captured by the in-vehicle camera 45. Additionally, the driver state determination unit 83 can determine whether the driver's driving state is normal based on whether a stop command has been provided from the cancellation input unit 82. Then, if the driver state determination unit 83 determines that the driver's driving state is abnormal, it notifies the odor parameter setting unit 28G that the driver's driving state is abnormal. On the other hand, if the driver state determination unit 83 determines that the driver's driving state is normal, it notifies the odor parameter setting unit 28G that the driver's driving state is normal. For example, when executing an input from the driver to the cancellation input unit 82, the driver state determination unit 83 determines that the driver's operating state is normal and notifies the odor parameter setting unit 28G that the driver's driving state is normal.

[0212] Similar to Figure 4 The odor parameter setting unit 28A and odor parameter setting unit 28G set odor parameters for the odor presentation device 29 based on the operation execution information provided by the operation state recognition unit 25G, instructing it to present odor parameters associated with the operation being performed by the driver. Furthermore, when an alarm command is provided from the application execution processing unit 92 via the communication unit 81, the odor parameter setting unit 28G sets odor parameters for the odor presentation device 29, instructing it to present an odor for the alarm. As a result, in the odor presentation device 29, the output unit control unit 61 controls the output units 62-1 to 62-N to present an odor for the alarm.

[0213] Subsequently, if the odor parameter setting unit 28G is notified by the driver status determination unit 83 that the driver's driving status is abnormal, the odor parameter setting unit 28G causes the odor presentation device 29 to continue presenting the odor for the alarm. On the other hand, if the odor parameter setting unit 28G is notified by the driver status determination unit 83 that the driver's driving status is normal, the odor parameter setting unit 28G instructs the odor presentation device 29 to stop presenting the odor for the alarm, and in the odor presentation device 29, the output unit control unit 61 controls the output units 62-1 to 62-N to stop presenting the odor.

[0214] The control system 11G configured as described above can alert the driver with an odor when passengers (other than the driver) notice that the driver's driving is abnormal. For example, by using the user terminal 12, the control system 11G can alert the driver with an odor without requiring a button or similar device to be installed in the vehicle to indicate the presence of the odor. Furthermore, by using the user terminal 12, the control system 11G can alert the driver with an odor, for example, when passengers are sitting in the back seat. For instance, if the control system 11G is installed in a bus, when a bus passenger notices that the bus driver's driving is abnormal, the passenger can use the user terminal 12 to alert the driver with an odor.

[0215] For example, when an occupant notices that the driver's driving behavior is abnormal, the occupant can operate the user terminal 12 to execute the driver alarm application. Figure 17 An example is shown of a driver alarm screen 93 displayed on the display of the user terminal 12 in response to the execution of a driver alarm application by the application execution processing unit 92.

[0216] If communication unit 91 can be connected to communication unit 81 via wireless communication, then application execution processing unit 92 displays as follows: Figure 17 The driver alert screen 93a displays the message "A connectable vehicle is nearby. Connect?". In response to this message, when the user performs the operation of connecting the user terminal 12 to the control system 11G, the communication unit 91 begins to communicate with the communication unit 81 according to the instructions from the application execution processing unit 92.

[0217] Subsequently, when communication is established between the user terminal 12 and the control system 11G, the application execution processing unit 92 displays as follows: Figure 17 The driver alert screen 93b displays the message "Vehicle xx bus _ xx route connected / Driver using odor alert," and also shows a graphical user interface (GUI) for specifying odor intensity. Figure 17 In the example shown, the GUI (Strong) for specifying a strong odor and the GUI (Weak) for specifying a weak odor are displayed on the driver alarm screen 93b.

[0218] Then, when the user performs an operation on the GUI used to specify the odor intensity, the application execution processing unit 92 displays as follows: Figure 17 The driver's alarm screen 93c displays the message "Vehicle connected to xx bus _ xx route / Confirm! Execute?", and also shows a GUI indicating whether to execute the alarm. Figure 17In the example shown, the GUI (Yes) for instructing the execution of presenting the scent for the alarm and the GUI (Stop) for instructing the cessation of presenting the scent for the alarm are displayed on the driver alarm screen 93c.

[0219] For example, when a user performs an operation on a GUI that instructs the presentation of an odor for an alarm, as described above, the application execution processing unit 92 provides an alarm command instructing the presentation of an odor for an alarm to the odor parameter setting unit 28G and the driver state determination unit 83. On the other hand, when a user performs an operation on a GUI that instructs the cessation of the presentation of an odor for an alarm, the application execution processing unit 92 does not provide an alarm command.

[0220] Then, in the case of presenting the odor for the alarm, the application execution processing unit 92 displays as follows: Figure 17 The driver alert screen 93d displays the message: "Vehicle xx bus _ xx route connected / Driver using odor alarm!"

[0221] Note that the control system 11G needs to be configured so that only vehicle occupants can trigger the alarm via scent. For example, the application execution processing unit 92 can be controlled to execute the processing of the driver alarm screen 93 described above only when the user terminal 12 is within the communication range of the communication standard used by the communication units 81 and 91 and the communication units 81 and 91 can perform wireless communication.

[0222] Furthermore, the application execution processing unit 92 can display a warning on the driver alarm screen 93 to ensure that the occupant will bear responsibility (e.g., potential legal penalties) when the driver alarm application is executed in situations other than emergencies, thus ensuring that the driver alarm application is only executed in emergencies such as abnormal driver operation. Additionally, the control system 11G needs to be configured to record and store identification information of the user terminal 12 used to identify the driver alarm application (e.g., the terminal identifier of the user terminal 12, Internet Protocol (IP) address, etc.), operation history of the driver alarm application, etc., so that the records can be traced.

[0223] refer to Figure 18 The flowchart shown below describes the fifth control process performed in the control system 11G.

[0224] For example, when an occupant performs an operation on the user terminal 12 and activates the driver alarm application, processing begins, and in step S61, the application execution processing unit 92 displays... Figure 17The driver alarm screen 93a shown is shown. Then, when the user performs the operation of connecting the user terminal 12 to the control system 11G, the application execution processing unit 92 establishes communication with the control system 11G via the communication unit 81 and the communication unit 91.

[0225] In step S62, the application execution processing unit 92 displays... Figure 17 The driver alarm screen 93b shown is displayed, and the application execution processing unit 92 displays when the user performs an operation on the GUI for specifying the odor intensity. Figure 17 The driver alarm screen 93c shown is then displayed. When the user performs an operation on the GUI that instructs the presentation of an odor for the alarm, the application execution processing unit 92 provides an alarm command instructing the odor parameter setting unit 28G and the driver status determination unit 83 to present an alarm odor for the alarm.

[0226] In step S63, the odor parameter setting unit 28G sets odor parameters for the odor presentation device 29 to indicate the presentation of an odor for alarm purposes. As a result, in the odor presentation device 29, the output unit control unit 61 controls the output units 62-1 to 62-N to present the odor for alarm purposes, and the presentation of the odor for alarm purposes begins. At this time, the application execution processing unit 92 displays... Figure 17 The driver alarm screen shown is 93d.

[0227] In step S64, the driver state determination unit 83 determines whether the driver's driving state is normal based on the operation execution information, vehicle external condition information, vehicle information, and vehicle external condition information.

[0228] In step S64, if the driver status determination unit 83 determines that the driver's driving status is abnormal, the process proceeds to step S65. In step S65, the driver status determination unit 83 notifies the odor parameter setting unit 28G that the driver's driving status is abnormal, and the odor parameter setting unit 28G determines to continue presenting the odor for the alarm, and the process returns to step S64.

[0229] On the other hand, in step S64, if the driver status determination unit 83 determines that the driver's driving status is normal, the process proceeds to step S66.

[0230] In step S66, the driver status determination unit 83 notifies the odor parameter setting unit 28G that the driver's driving status is normal. In response, the odor parameter setting unit 28G instructs the odor presentation device 29 to stop presenting the odor used for the alarm, and in the odor presentation device 29, the output unit control unit 61 controls the output units 62-1 to 62-N to stop presenting the odor, thereby stopping the presentation of the odor used for the alarm. The process then ends.

[0231] By performing the fifth control process as described above, the control system 11G can alert the driver by emitting an odor as a warning when occupants other than the driver notice that the driver's driving status is abnormal, and thus can control the vehicle's movement more safely.

[0232] The control system 11 of each embodiment described above can prevent maloperation in advance by using odor. Here, maloperation can be broadly categorized into single-occurrence maloperations such as incorrect pedaling of the brakes and accelerator, and recurring maloperations such as speeding, and the control system 11 is effective for both single-occurrence and recurring maloperations. That is, for either single-occurrence or recurring maloperation, the control system 11 can prevent the maloperation from occurring in advance, and can cancel the maloperation by presenting odor based on operation execution information or operation record information. In particular, the control system 11 can reliably prevent single-occurrence maloperations.

[0233] Furthermore, the control system 11 can present odors locally via the odor presentation device 29. For example, the control system 11 can present odors only to the driver, enabling the driver to identify misoperation and suppressing any adverse effects on the in-vehicle experience of occupants other than the driver.

[0234] Furthermore, the control system 11 can change the odor according to the driver's preference and can present multiple odors. As a result, the control system 11 can enable each driver to identify misoperations using appropriate odors, and can achieve more reliable misoperation identification. In addition, by selectively using multiple odors, the control system 11 can, for example, make differences in the degree of urgency be identified by odor.

[0235] <Computer Configuration Example>

[0236] Next, the aforementioned series of processes (control methods) can be executed by hardware or by software. In the case where the processes are executed by software, the program constituting that software is installed in a general-purpose computer or similar device.

[0237] Figure 19 This is a block diagram illustrating an embodiment of a computer equipped with a program that performs the series of processes described above.

[0238] In the computer, the central processing unit (CPU) 101, read-only memory (ROM) 102, random access memory (RAM) 103, and electronically erasable programmable read-only memory (EEPROM) 104 are connected to each other via bus 105. In addition, input / output interface 106 is connected to bus 105 and is connected to the outside.

[0239] In the computer configured as described above, for example, the CPU 101 loads the program stored in ROM 102 and EEPROM 104 into RAM 103 via bus 105 and executes the program to perform the series of processes described above. Additionally, the program executed by the computer (CPU 101) can be pre-written into ROM 102 and can also be externally installed into or updated to EEPROM 104 via input / output interface 106.

[0240] In this specification, the processes executed by a computer according to a program do not necessarily need to be executed sequentially in the order described in the flowchart. That is, the processes executed by a computer according to a program also include processes executed in parallel or individually (e.g., parallel processing or processing by objects).

[0241] Furthermore, a program can be processed by a single computer (processor), or it can be distributed and processed by multiple computers. Additionally, a program can be transmitted to a remote computer and executed there.

[0242] Furthermore, in this specification, "system" refers to a collection of multiple constituent elements (devices, modules (components), etc.), regardless of whether all constituent elements are housed in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a device in a housing containing multiple modules, are both systems.

[0243] Additionally, for example, a configuration described as a single device (or processing unit) can be partitioned and configured as multiple devices (or processing units). Conversely, a configuration described above as multiple devices (or processing units) can be collectively configured as a single device (or processing unit). Furthermore, of course, configurations other than those described above can be added to the configuration of each device (or each processing unit). Moreover, provided the overall system configuration and operation are substantially the same, a portion of the configuration of one device (or processing unit) can be included in the configuration of another device (or another processing unit).

[0244] Alternatively, for example, this technology can employ a cloud computing configuration in which one function is distributed across multiple devices via a network and processed collaboratively.

[0245] Alternatively, for example, the above program can be executed on any device. In this case, the device only needs to have the necessary functions (function blocks, etc.) and be able to obtain the necessary information.

[0246] Additionally, for example, each step described in the flowchart above can be executed by a single device, or it can be distributed and executed by multiple devices. Furthermore, in cases where a step includes multiple processes, the multiple processes included in a single step can be executed by a single device, or they can be distributed and executed by multiple devices. In other words, multiple processes included in a single step can also be executed as processes of multiple steps. Conversely, processes described as multiple steps can also be collectively executed as a single step.

[0247] Note that in a program executed by a computer, the processing of the steps describing the program can be performed sequentially according to the order described in this specification, or can be performed in parallel or individually when necessary (e.g., when called). That is, as long as no inconsistency is caused, the processing of each step can be performed in an order different from the above order. Furthermore, the processing of the steps describing this program can be performed in parallel with the processing of another program, or can be performed in combination with the processing of another program.

[0248] Note that the various aspects of the present technology described in this specification can be implemented independently, as long as no inconsistency arises. Of course, any multiple aspects of the present technology can also be implemented in combination. For example, part or all of the present technology described in any embodiment can be implemented in combination with part or all of the present technology described in another embodiment. Furthermore, any part or all of the present technology described above can also be implemented in combination with another technology not described above.

[0249] <Example of configuration combination>

[0250] Note that this technology can also be configured as follows.

[0251] (1) A control device, comprising: The identification unit is configured to identify the operator's operation status on the operating device and acquire operation status information indicating the operation status. The odor parameter setting unit is configured to set parameters that indicate the odor associated with the content presented in relation to the operating state; and An odor presentation unit is configured to output air containing odor components according to the parameters and present the odor to the operator.

[0252] (2) The control device according to (1), wherein, The identification unit includes an operation record estimation unit configured to estimate an operation predicted to be performed by an operator on an operating device and provide operation record information indicating the content of the estimated operation to an odor parameter setting unit. The odor parameter setting unit is configured to set parameters based on the operation record information that indicate the presentation of odors associated with the content of the operation predicted to be performed by the operator on the operating device.

[0253] (3) The control device according to (2), wherein, After the odor presentation unit presents an odor, if the content of the predicted operation estimated by the operation filing estimation unit changes, the odor presentation unit presents an odor associated with the content of the changed predicted operation.

[0254] (4) The control device according to any one of (1) to (3), wherein, The identification unit includes an operation content acquisition unit, which is configured to acquire the operation content being performed by the operator on the operating device and provide operation execution information indicating the operation content to the odor parameter setting unit. The odor parameter setting unit is configured to set parameters based on the operation execution information to indicate the odor associated with the operation being performed by the operator on the operating device.

[0255] (5) The control device according to (4) further includes: The misoperation prevention control unit is configured to cancel the execution of an operation based on the operation execution information provided by the operation content acquisition unit until a predetermined operation cancellation time has elapsed.

[0256] (6) The control device according to (5), wherein, After the operation cancellation time has elapsed, if the operation content obtained by the operation content acquisition unit changes, the odor presentation unit presents an odor associated with the changed operation content.

[0257] (7) The control device according to (5) further includes: The misoperation prevention setting unit is configured to set an on / off state for the misoperation prevention control unit to indicate whether to perform misoperation prevention processing.

[0258] (8) The control device according to any one of (1) to (7), wherein, When the identification unit determines that the duration of the predetermined operation state, i.e., the operation duration, becomes equal to or greater than the predetermined time, the identification unit instructs the odor parameter setting unit to stop presenting the odor.

[0259] (9) The control device according to any one of (5) to (8), wherein, The control device controls the vehicle's movement based on the driver's operation of the vehicle.

[0260] (10) The control device according to (9) further includes: The misoperation prevention setting unit is configured to set an indicator for whether to perform misoperation prevention processing on / off based on the vehicle's speed and external conditions.

[0261] (11) The control device according to (9) or (10) further includes: The vehicle exterior condition recognition unit is configured to recognize the conditions outside the vehicle based on the vehicle's location information, vehicle exterior images obtained by photographing the vehicle's exterior, vehicle exterior sensor information, and the vehicle's speed. The vehicle exterior sensor information indicates the detection results of the vehicle exterior conditions that can be recognized without using images.

[0262] (12) The control device according to (11), wherein, The odor parameter setting unit sets parameters based on the external conditions of the vehicle identified by the vehicle external condition recognition unit according to the vehicle's speed.

[0263] (13) The control device according to (11), wherein, The odor parameter setting unit sets parameters based on the magnitude of the vehicle's speed exceeding the speed limit identified by the vehicle external condition recognition unit.

[0264] (14) The control device according to (11), wherein, The odor parameter setting unit sets parameters based on the vehicle external condition identified by the vehicle external condition recognition unit according to the vehicle's distance from other vehicles in front and behind and the vehicle's speed.

[0265] (15) The control device according to (11), wherein, The odor parameter setting unit sets parameters based on the external conditions of the vehicle identified by the vehicle external condition recognition unit according to the distance to surrounding objects located in the left-right direction orthogonal to the vehicle's driving direction.

[0266] (16) The control device according to any one of (9) to (15) further comprises: The communication unit is configured to communicate with user terminals carried by occupants other than the driver traveling in the vehicle. When an alarm command is provided from the user terminal via the communication unit, instructing the presenter to present an odor for the alarm, the odor parameter setting unit instructs the odor presentation unit to present an odor for the alarm.

[0267] (17) The control device according to any one of (9) to (16) further comprises: The driver status determination unit is configured to determine whether the driver's operating status is normal; and The input cancellation unit allows the driver to stop the input of an alarm odor when the odor presentation unit presents the odor for the alarm. When the driver makes an input to the cancel input unit, the driver status determination unit determines that the driver's operating status is normal, notifies the odor parameter setting unit that the driver's driving status is normal, and stops presenting the odor used for alarm.

[0268] (18) The control device according to any one of (1) to (8), wherein

[0269] The control device controls the machine based on the operator's actions on the machine.

[0270] (19) A control method executed by a control device, the method comprising: Identify the operator's operational status on the operating device and acquire operational status information indicating the operational status; Set parameters to indicate the presentation of an odor associated with the content of the stated operating state; and The output contains air containing odor components according to the parameters, and presents the odor to the operator.

[0271] (20) A program for causing a computer of a control device to perform control processing, the control processing including: Identify the operator's operational status on the operating device and acquire operational status information indicating the operational status; Set parameters to indicate the presentation of an odor associated with the content of the stated operating state; and The output contains air containing odor components according to the parameters, and presents the odor to the operator.

[0272] (List of reference numerals in the attached image)

[0273] 11 Control System

[0274] 12 User Terminals

[0275] 21 Operating device

[0276] 22 Vehicle interior identification device

[0277] 23 Vehicle identification device

[0278] 24. Vehicle external identification devices

[0279] 25 Operation Status Recognition Unit

[0280] 26. Status Identification Unit

[0281] 27 Vehicle Control Unit

[0282] 28 Odor parameter setting unit

[0283] 29. Odor Presentation Device

[0284] 30 Misoperation Prevention Setting Unit

[0285] 31 Misoperation Prevention Control Unit

[0286] 41 Steering Wheel

[0287] 42 Accelerator Pedal

[0288] 43 Brake pedal

[0289] 44 Gearshift lever

[0290] 45. Vehicle interior cameras

[0291] 46 Vehicle interior sensors

[0292] 47 Vehicle Sensors

[0293] 48 Location Information Acquisition Unit

[0294] 49. Vehicle exterior cameras

[0295] 50 Vehicle External Sensors

[0296] 51 Operation Content Acquisition Unit

[0297] 52 Operation Filing Estimation Unit

[0298] 53 Vehicle Interior Condition Recognition Unit

[0299] 54 Vehicle Information Acquisition Unit

[0300] 55 Vehicle External Condition Recognition Unit

[0301] 61 Output Unit Control Unit

[0302] 62 Output Units

[0303] 71 Operation Unit

[0304] 72 cameras

[0305] 73 Machine Control Unit

[0306] 81 Communication Unit

[0307] 82 Cancel Input Unit

[0308] 83 Driver Status Determination Unit

[0309] 91 Communication Unit

[0310] 92 Application Execution Processing Unit

[0311] 93 Driver alarm screen

Claims

1. A control device, comprising: The identification unit is configured to identify the operator's operation status on the operating device and acquire operation status information indicating the operation status. The odor parameter setting unit is configured to set parameters that indicate the odor associated with the content of the operation status; as well as An odor presentation unit is configured to output air containing odor components according to the parameters and present the odor to the operator.

2. The control device according to claim 1, wherein, The identification unit includes an operation record estimation unit configured to estimate an operation predicted to be performed by an operator on an operating device and provide operation record information indicating the content of the estimated operation to an odor parameter setting unit. The odor parameter setting unit is configured to set parameters based on the operation record information that indicate the presentation of odors associated with the content of the operation predicted to be performed by the operator on the operating device.

3. The control device according to claim 2, wherein, After the odor presentation unit presents an odor, if the content of the predicted operation estimated by the operation filing estimation unit changes, the odor presentation unit presents an odor associated with the content of the changed predicted operation.

4. The control device according to claim 1, wherein, The identification unit includes an operation content acquisition unit, which is configured to acquire the operation content being performed by the operator on the operating device and provide operation execution information indicating the operation content to the odor parameter setting unit. The odor parameter setting unit is configured to set parameters based on the operation execution information to indicate the odor associated with the operation being performed by the operator on the operating device.

5. The control device according to claim 4, further comprising: The misoperation prevention control unit is configured to cancel the execution of an operation based on the operation execution information provided by the operation content acquisition unit until a predetermined operation cancellation time has elapsed.

6. The control device according to claim 5, wherein, After the operation cancellation time has elapsed, if the operation content obtained by the operation content acquisition unit changes, the odor presentation unit presents an odor associated with the changed operation content.

7. The control device according to claim 5, further comprising: The misoperation prevention setting unit is configured to set an on / off state for the misoperation prevention control unit to indicate whether to perform misoperation prevention processing.

8. The control device according to claim 1, wherein, When the identification unit determines that the duration of the predetermined operation state, i.e., the operation duration, becomes equal to or greater than the predetermined time, the identification unit instructs the odor parameter setting unit to stop presenting the odor.

9. The control device according to claim 5, wherein, The control device controls the vehicle's movement based on the driver's operation of the vehicle.

10. The control device according to claim 9, further comprising: The misoperation prevention setting unit is configured to set an indicator for whether to perform misoperation prevention processing on / off based on the vehicle's speed and external conditions.

11. The control device according to claim 9, further comprising: The vehicle exterior condition recognition unit is configured to recognize the conditions outside the vehicle based on the vehicle's location information, vehicle exterior images obtained by photographing the vehicle's exterior, vehicle exterior sensor information, and the vehicle's speed. The vehicle exterior sensor information indicates the detection results of the vehicle exterior conditions that can be recognized without using images.

12. The control device according to claim 11, wherein, The odor parameter setting unit sets parameters based on the external conditions of the vehicle identified by the vehicle external condition recognition unit according to the vehicle's speed.

13. The control device according to claim 11, wherein, The odor parameter setting unit sets parameters based on the magnitude of the vehicle's speed exceeding the speed limit identified by the vehicle external condition recognition unit.

14. The control device according to claim 11, wherein, The odor parameter setting unit sets parameters based on the vehicle external condition identified by the vehicle external condition recognition unit according to the vehicle's distance from other vehicles in front and behind and the vehicle's speed.

15. The control device according to claim 11, wherein, The odor parameter setting unit sets parameters based on the external conditions of the vehicle identified by the vehicle external condition recognition unit according to the distance to surrounding objects located in the left-right direction orthogonal to the vehicle's driving direction.

16. The control device according to claim 9, further comprising: The communication unit is configured to communicate with user terminals carried by occupants other than the driver traveling in the vehicle. When an alarm command is provided from the user terminal via the communication unit, instructing the presenter to present an odor for the alarm, the odor parameter setting unit instructs the odor presentation unit to present an odor for the alarm.

17. The control device according to claim 9, further comprising: The driver status determination unit is configured to determine whether the driver's operating status is normal. as well as The input cancellation unit allows the driver to stop the input of an alarm odor when the odor presentation unit presents the odor for the alarm. When the driver makes an input to the cancel input unit, the driver status determination unit determines that the driver's operating status is normal, notifies the odor parameter setting unit that the driver's driving status is normal, and stops presenting the odor used for alarm.

18. The control device according to claim 1, wherein The control device controls the machine based on the operator's actions on the machine.

19. A control method executed by a control device, the method comprising: Identify the operator's operational status on the operating device and acquire operational status information indicating the operational status; Set parameters to indicate the presentation of odors associated with the content of the stated operating state; as well as The output contains air containing odor components according to the parameters, and presents the odor to the operator.

20. A program for causing a computer of a control device to perform control processing, the control processing comprising: Identify the operator's operational status on the operating device and acquire operational status information indicating the operational status; Set parameters to indicate the presentation of odors associated with the content of the stated operating state; as well as The output contains air containing odor components according to the parameters, and presents the odor to the operator.

Images