Scent output control device, scent output control method, and program

Abstract

A device and method of outputting a scent corresponding to an advertisement are implemented. A scent output control unit that performs scent output control, and a scent output unit that performs scent output under the control of the scent output control unit are included, and the scent output control unit selects a scent to be output based on an advertisement, and outputs the selected scent via the scent output unit. The scent output control unit selects a scent to be output based on an advertisement detected from an image captured by an outside camera that captures the outside of a vehicle, or an advertisement output to an information output terminal, and outputs the selected scent via the scent output unit. Furthermore, an occupant profile is analyzed based on an image of an occupant, and a scent corresponding to the occupant is output.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to a scent output control device, a scent output control method, and a program. More specifically, the present disclosure relates to a scent output control device, a scent output control method, and a program that output various scents according to a situation in a vehicle such as an automobile. BACKGROUND

[0002] For example, users of automobiles such as passenger cars often install a perfume in their automobiles in order to emit a scent in the interior of the automobile.

[0003] There are various perfumes such as lavender, lemon, jasmine, and the like, and users can install a perfume in their vehicles in order to emit a favorite scent in their vehicles.

[0004] Furthermore, a configuration has been proposed in which a passenger such as a driver is informed of guidance information using a scent.

[0005] For example, Patent Literature 1 (Japanese Patent Application Publication No. 2001-349739) discloses a scent release configuration for guiding a passenger such as an automobile driver to a place, a facility, or the like.

[0006] In a case where the automobile approaches a specific place, a facility, or the like, a specific scent is automatically released, thereby guiding the driver or the like.

[0007] Furthermore, Patent Literature 2 (Japanese Patent Application Publication No. 2010-111315) discloses a configuration in which a scent is released in accordance with a change in display of a traffic signal light, to inform the display of the traffic signal light has changed using the scent.

[0008] LIST OF CITATIONS

[0009] PATENT LITERATURE

[0010] Patent Literature 1: Japanese Patent Application Publication No. 2001-349739

[0011] Patent Literature 2: Japanese Patent Application Publication No. 2010-111315 SUMMARY

[0012] PROBLEMS TO BE SOLVED BY THE INVENTION

[0013] As described above, there are various conventional technologies that disclose a notification process using a scent. However, there is no prior art that discloses a scent control configuration that improves an advertising effect using a scent.

[0014] An object of the present disclosure is to provide a scent output control device, a scent output control method, and a program that perform a scent output control for improving an advertising effect.

[0015] Solution to the problem

[0016] A first aspect of the present disclosure provides a scent output control device including:

[0017] a scent output control unit configured to perform scent output control; and

[0018] a scent output unit configured to perform scent output under control of the scent output control unit,

[0019] wherein the scent output control unit selects a scent to be output based on an advertisement, and outputs the selected scent via the scent output unit.

[0020] Further, a second aspect of the present disclosure provides a scent output control method performed in a scent output control device,

[0021] wherein the scent output control device includes:

[0022] a scent output control unit configured to perform scent output control; and

[0023] a scent output unit configured to perform scent output under control of the scent output control unit, and

[0024] the scent output control unit selects a scent to be output based on an advertisement, and outputs the selected scent via the scent output unit.

[0025] Further, a third aspect of the present disclosure provides a program that causes a scent output control device to perform scent output control,

[0026] wherein the scent output control device includes:

[0027] a scent output control unit configured to perform scent output control; and

[0028] a scent output unit configured to perform scent output under control of the scent output control unit, and

[0029] the program causes the scent output control unit to select a scent to be output based on an advertisement, and outputs the selected scent via the scent output unit.

[0030] Note that the program of the present disclosure is, for example, a program that can be provided to an information processing apparatus, an image processing apparatus, or a computer system capable of executing various program codes by a storage medium or a communication medium provided in a computer-readable format. By providing such a program in a computer-readable format, processing according to the program is implemented on the information processing apparatus or the computer system.

[0031] Other objects, features and advantages of the present disclosure will become more apparent from the following detailed description of embodiments of the present disclosure and the accompanying drawings. Note that in this specification, a system is a logical collection of a plurality of devices, and is not limited to a system in which various constituent devices are located in the same housing.

[0032] According to the configuration of the embodiment of the present disclosure, for example, a device and a method of outputting a scent corresponding to an advertisement that can be observed from inside a vehicle such as an automobile, or an advertisement output to an information output terminal such as a television are implemented.

[0033] Specifically, for example, a scent output control unit that performs scent output control, and a scent output unit that performs scent output under the control of the scent output control unit are included, and the scent output control unit selects a scent to be output based on an advertisement, and outputs the selected scent via the scent output unit. The scent output control unit selects a scent to be output based on an advertisement detected from an image captured by an outside camera that captures the outside of a vehicle, or an advertisement output to an information output terminal, and outputs the selected scent via the scent output unit. Furthermore, an occupant profile is analyzed based on an image of the occupant, and a scent corresponding to the occupant is output.

[0034] According to the configuration, for example, a device and a method of outputting a scent corresponding to an advertisement that can be observed from inside a vehicle such as an automobile, or an advertisement output to an information output terminal such as a television are implemented.

[0035] Note that the effects described in this specification are merely examples and are not limited. Other effects can be obtained. BRIEF DESCRIPTION OF DRAWINGS

[0036] Figure 1 is a diagram that explains a use case of a scent output control device of the present disclosure.

[0037] Figure 2 is a diagram that explains a use case of a scent output control device of the present disclosure.

[0038] Figure 3 is a diagram that explains a configuration example of a scent output control device of the present disclosure.

[0039] Figure 4 is a diagram that explains an example of an image captured by an outside camera.

[0040] Figure 5 is a diagram illustrating a specific example of "advertising corresponding scent management data" held by the scent management server.

[0041] Figure 6 is a diagram illustrating an example of selection control of the scent output unit based on an input image from the in-vehicle camera.

[0042] Figure 7 is a diagram illustrating an example of selection control of the scent output unit based on an input image from the in-vehicle camera.

[0043] Figure 8 is a diagram illustrating a detailed configuration example of the scent output control unit of the scent output control device.

[0044] Figure 9 is a flowchart illustrating a series of processes executed by the scent output control device of the present disclosure.

[0045] Figure 10 is a diagram illustrating a configuration example of the scent output control device of the second embodiment.

[0046] Figure 11 is a diagram illustrating a detailed configuration example of the scent output control unit of the scent output control device of the second embodiment.

[0047] Figure 12 is a diagram illustrating a specific example of "advertising corresponding scent management data" held by the scent management server.

[0048] Figure 13 is a flowchart illustrating a series of processes executed by the scent output control device of the second embodiment.

[0049] Figure 14 is a diagram illustrating a hardware configuration example of the scent output control device. DETAILED DESCRIPTION

[0050] The details of the scent output control device, the scent output control method, and the program of the present disclosure will be described below with reference to the accompanying drawings. Note that the description will be given in the following items.

[0051] 1. Configuration and processes of the scent output control device of the present disclosure

[0052] 2. Sequence of processes executed by the scent output control device of the present disclosure

[0053] 3. Scent output control device that outputs a scent in association with an output advertisement of an information output terminal

[0054] 4. Sequence of processes regarding output of a scent in association with output of an advertisement from an information output terminal

[0055] 5. Other embodiments of the scent output control apparatus of the present disclosure and effects of the scent output control apparatus of the present disclosure

[0056] 6. Example of hardware configuration of the scent output control apparatus

[0057] 7. Summary of the present disclosure

[0058] [1. Configuration and processes of the scent output control apparatus of the present disclosure]

[0059] The configuration and processes of the scent output control apparatus of the present disclosure will be described with reference to Figure 1 and subsequent drawings.

[0060] Figure 1 is a diagram illustrating a use case of the scent output control apparatus of the present disclosure. As Figure 1 illustrated in , the scent output control apparatus of the present disclosure is installed on a mobile device such as a passenger car. Note that the scent output control apparatus of the present disclosure is not limited to a vehicle such as a passenger car, but can be installed on various mobile devices such as a train, a motorcycle, and a bicycle.

[0061] Hereinafter, as a representative example, an embodiment in a case where the scent output control apparatus of the present disclosure is installed on a vehicle such as an automobile such as a passenger car will be described.

[0062] As Figure 1 illustrated in , a scent output unit that outputs (sprays) a scent component is installed on each seat of the vehicle.

[0063] The scent output unit 1 outputs a scent component to an occupant of a right front seat of the vehicle, for example, a driver.

[0064] The scent output unit 2 outputs a scent component to an occupant of a left front seat of the vehicle.

[0065] The scent output unit 3 outputs a scent component to an occupant of a right rear seat of the vehicle.

[0066] The scent output unit 4 outputs a scent component to an occupant of a left rear seat of the vehicle.

[0067] The scent output control apparatus of the present disclosure controls output of a scent from each of these scent output units 1 to 4.

[0068] Note that the number and arrangement of the scent output units can be set in various ways.

[0069] For example, as Figure 2As shown in the middle diagram, a scent detection unit 1 can be provided in the center of the vehicle roof to selectively output scents to each seat.

[0070] Note that, in the configuration of the present disclosure, the scent output unit is configured to selectively output various scents such as the scent of a forest, the scent of ramen, the scent of a hamburger, and the scent of a cosmetic in addition to scents such as lavender, lemon, and jasmine.

[0071] Details will be described later, but for example, a scent linked with an advertisement is selectively output.

[0072] Specifically, for example, in a case where an advertisement about ramen is detected in front of the vehicle, scent output control that selects and outputs the scent of ramen is performed.

[0073] The scent output unit stores various scent components in separate cartridges, and the control unit of the scent output control device performs control that selects a cartridge and outputs (sprays) the scent component in the cartridge to the outside.

[0074] The scent output unit is controlled by the scent output control unit. The scent output control unit performs processing that selects the type of scent to be output, and also performs start / stop processing of scent output. Furthermore, the remaining amount of the scent component in the cartridge can be detected, and in a case where the remaining amount is small, alarm output or the like is performed.

[0075] Note that an example of the configuration of a conventional scent output unit is AROMASTIC manufactured by Sony Corporation. AROMASTIC manufactured by Sony Corporation uses Scentents (registered trademark) technology unique to Sony to output scents. Specifically, this method is a method of imparting a scent to air itself by a gas diffusion method using a blower process that blows dry air into a cartridge.

[0076] The scent output unit of the scent output control device of the present disclosure is, for example, a scent output unit that uses this scheme, and the control unit performs switching of the scent type of each unit, control of the scent output intensity, and the like.

[0077] Figure 3 An example of the configuration of the scent output control device of the present disclosure is diagrammatically explained.

[0078] As Figure 3 As shown in the middle diagram, the scent output control device 100 includes an outside camera 101, an inside camera 102, a position information acquisition unit 103, a communication unit 104, a scent output control unit 105, and a scent output unit 110.

[0079] The scent output unit 110 includes a blower drive unit 121, a flow path control unit 122, and a scent selection output unit 123.

[0080] Note that one or a plurality of the fragrance output units 110 are provided.

[0081] The outside camera 101 captures an image of the surroundings of the vehicle, for example, an image of the traveling direction of the vehicle, and inputs the captured image to the fragrance output control unit 105.

[0082] The inside camera 102 captures an image of the inside of the vehicle. That is, a face image of an occupant in the inside of the vehicle is captured, and the captured image is input to the fragrance output control unit 105.

[0083] The position information acquisition unit 103 is, for example, a global navigation satellite system (GNSS / global positioning satellite system), and calculates a self position based on information from a satellite.

[0084] Note that the GNSS can detect not only a position but also a speed (speed and direction), and thus the position information acquisition unit 103 detects not only a position but also a speed (speed and direction).

[0085] Information (position, speed (speed and direction)) acquired by the position information acquisition unit 103 is also input to the fragrance output control unit 105.

[0086] The communication unit 104 performs communication with the fragrance management server 150, which is an external server, and other vehicles. The communication information is input to the fragrance output control unit 105.

[0087] The fragrance output control unit 105 controls the fragrance output units 110-1 to n to output various fragrances using at least one of the outside image captured by the outside camera 101, the inside image captured by the inside camera 102, the host vehicle position information and speed information acquired by the position information acquisition unit 103, or the communication information acquired by the communication unit 104.

[0088] The fragrance output control unit 105 controls each of the blower driving unit 121, the flow path control unit 122, and the fragrance selection output unit 123 in each of the fragrance output units 110 to perform selection processing of the kind of fragrance to be output, control of the output intensity and output time of the fragrance to be output, the output flow path of the fragrance, and the like.

[0089] For example, the fragrance selection output unit 123 performs control to select one cartridge from a large number of cartridges in which various different fragrances are stored, and output the fragrance of the cartridge to the outside.

[0090] Specifically, for example, in a case where it is detected that there is a person only in the driver's seat, only the fragrance output unit of the driver's seat is operated, and thus the selected fragrance is output only to the driver's seat.

[0091] A specific processing example will be described later.

[0092] Figure 4 An example of an image captured by the outside camera 101 is illustrated.

[0093] As Figure 4 illustrated in (a), the outside camera 101 captures an image of the surroundings of the vehicle, for example, an image of the traveling direction of the vehicle, and inputs the captured image to the scent output control unit 105.

[0094] In the image illustrated in (a), there is an advertisement of a restaurant in front of the vehicle. Figure 4

[0095] The scent output control unit 101 detects an advertisement image included in the captured image, and acquires detailed information about the detected advertisement image from the scent management server 150 illustrated in (b) via the communication unit 104. Figure 3

[0096] Note that the advertisement includes various advertisements such as a signboard, a display, and a digital signage.

[0097] The scent management server 150 holds "advertisement corresponding scent management data" that registers a kind of a scent to be output in association with each advertisement, a scent output condition, and the like.

[0098] A specific example of the "advertisement corresponding scent management data" held by the scent management server 150 will be described with reference to (c). Figure 5

[0099] As Figure 5 illustrated in (c), the following data associated with each advertisement is registered in the "advertisement corresponding scent management data".

[0100] (a) Valid period

[0101] (b) Advertisement setting pattern

[0102] (c) Scent output condition

[0103] (d) Scent output pattern

[0104] (a) In the valid period, period data in which the scent output control processing using the registered data is executed is registered.

[0105] For example, in the example illustrated in the drawing, in the period from November 1, 2018 to March 31, 2019, scent output control for "advertisement A" is executed.

[0106] This period is defined, for example, in accordance with a contract with an advertisement provider and is updateable. ​​​

[0107] (b) In the advertisement setting mode, record the position (latitude and longitude) information of the advertisement setting, the orientation of the advertisement (for example, the inclination angle from the north direction), and the like.

[0108] This information is used, for example, for collation with the information acquired by the position information acquisition unit 103 of the vehicle, and for specific processing of the advertisement within the image.

[0109] (c) The fragrance output condition is a field for recording a condition that defines whether or not to output a fragrance from the fragrance output unit 110 in a case where the advertisement is confirmed based on the captured image from the vehicle.

[0110] For example, the profile of the occupant such as the gender and the age of the occupant, and information such as the fragrance output allowable time are recorded.

[0111] In the example illustrated in Figure 5 , "advertisement A" is a setting in which a fragrance is output in a case where the conditions that the occupant is a woman, the age is 18 years or older, and the time period is 8:00 to 16:00 are satisfied.

[0112] "advertisement B" is a setting in which a fragrance is output in a case where the conditions that the occupant is a man or a woman, the age is 5 to 60 years, and the time period is 16:00 to 24:00 are satisfied.

[0113] Note that the gender and the age of the occupant are determined based on the captured image of the in-vehicle camera 192.

[0114] The time period is determined based on the system clock inside the device or the time information acquired from an external time information providing server.

[0115] (d) In the fragrance output mode, record the kind of the fragrance to be output and the output time in a case where the fragrance output condition is satisfied.

[0116] The kind of the fragrance is identified by a fragrance identifier. Specifically, for example, in a case where "advertisement A" is an advertisement of a restaurant as illustrated in Figure 4 , "hamburger fragrance" corresponding to the hamburger in the advertisement is selected and output.

[0117] The fragrance output time is the fragrance output processing time of the fragrance output unit 110. For example, in a case of "advertisement A" as illustrated in Figure 5 , 30 seconds of fragrance output is performed. In a case of "advertisement B", 20 seconds of fragrance output is performed.

[0118] Note that Figure 5The advertisement corresponding fragrance database illustrated in FIG may be stored not in the fragrance management server 150 but in the storage unit of the fragrance output control device 100 in the vehicle.

[0119] Although not in Figure 3 , however, the fragrance output control device 100 includes a storage unit used as a program for executing various processes or a storage area for capturing images, a work area for data processing, and the like.

[0120] Figure 5 The advertisement corresponding fragrance management data shown in the diagram can be recorded and maintained in the storage unit. In this case, processing can be performed without accessing the server.

[0121] Note that, in the embodiment described below, an embodiment using “advertisement-corresponding fragrance management data” held by the management server 150 will be described.

[0122] Figure 3 The fragrance output control unit 101 of the fragrance output control device 100 illustrated in FIG checks whether detailed information on the advertisement included in the captured image is data registered in the “advertisement-corresponding fragrance management data” held by the fragrance management server 150 .

[0123] In the case of registration, the fragrance output control unit 101 refers to the registration information to determine whether the registered fragrance output condition is satisfied.

[0124] When it is determined that the registered fragrance output condition is satisfied, the fragrance output control unit 101 performs control to output the registered kind of fragrance from the fragrance output unit.

[0125] Note that the specific processing sequence will be described later.

[0126] Note that the fragrance output control unit 105 determines which type of occupant is in which seat in the vehicle based on the in-vehicle image input from the in-vehicle camera 102. For example, if it is detected that only the driver's seat is occupied, control is executed so that only the fragrance output unit for the driver's seat is operated, thereby outputting the selected fragrance only to the driver's seat.

[0127] Figure 6 An example of selection control of the fragrance output unit based on the input image from the in-vehicle camera 102 is illustrated.

[0128] Figure 6 (1) Illustrated is an example of fragrance output control by the fragrance output unit in a case where an occupant is detected only at the right front seat of the vehicle based on an input image from the in-vehicle camera 102 .

[0129] In this case, the fragrance output control unit 105 performs fragrance output by operating only the fragrance output unit 1 that outputs fragrance to the right front seat of the vehicle.

[0130] Note that, as described above with reference to Figure 5 the fragrance output condition is registered in the "advertising corresponding fragrance management data" held by the fragrance management server 150, and the fragrance output control unit 105 performs fragrance output only in a case where the condition is satisfied.

[0131] For example, in a case where, based on the image captured by the in-vehicle camera 102, there is an occupant who is an adult female only in the right front seat of the vehicle, and in a case where the adult female is included as a fragrance output permission condition registered in the "advertising corresponding fragrance management data" held by the fragrance management server 150, fragrance output is performed. In a case where the adult female is not included as a fragrance output permission condition, fragrance output is not performed.

[0132] Figure 6 (2) An example of fragrance output control of the fragrance output units in a case where, based on the input image from the in-vehicle camera 102, an occupant is detected in the left and right seats in the front of the vehicle and the right seat in the rear of the vehicle.

[0133] In this case, the fragrance output control unit 105 performs fragrance output by operating the three fragrance output units 1 to 3 that output fragrance to the left and right seats in the front of the vehicle and the right seat in the rear of the vehicle.

[0134] However, in this case, control is also performed in accordance with the gender and age of the person detected in each seat.

[0135] Note that, as described above with reference to Figure 1 and 2 the number and the arrangement position of the fragrance output units can be set differently.

[0136] For example, as illustrated in Figure 7 , a configuration in which one fragrance output unit 1 is arranged in the center of the ceiling of the vehicle is also possible. In this case, the fragrance output control unit 105 of the fragrance output control device 100 performs control to selectively output fragrance in the direction of the occupant detected based on the input image from the in-vehicle camera 102.

[0137] Next, a detailed configuration example of the fragrance output control unit 105 of the fragrance output control device 100 will be described with reference to Figure 8

[0138] Figure 8 A detailed configuration example of the inside of the fragrance output control unit 105 of the fragrance output control device 100 is illustrated. ​

[0139] As Figure 8 As

[0140] The advertisement analysis unit 131 inputs an image (an outside vehicle image) captured by the outside camera 101, and detects whether or not an advertisement image is included in the image. The advertisement image detection processing is performed using, for example, learning data generated in advance.

[0141] In a case where an advertisement image is detected in the image (an outside vehicle image) captured by the outside camera 101, the advertisement analysis unit 131 accesses the fragrance management server 150 via the communication unit 104, and determines whether or not the detected advertisement matches an advertisement registered in the "advertisement corresponding fragrance management data" held by the fragrance management server 150.

[0142] That is, the position and direction of the advertisement detected from the image (an outside vehicle image) captured by the outside camera 101 are analyzed, and it is determined whether or not there is a registration entry in which the analyzed advertisement position and direction match the position and direction registered in the "advertisement corresponding fragrance management data" held by the fragrance management server 150.

[0143] In this processing, the own position information acquired by the position information acquisition unit 103 is used.

[0144] In a case where a registration entry matching the position and direction of the advertisement of the outside captured image is detected as a registration entry of the "advertisement corresponding fragrance management data" held by the fragrance management server 150, the advertisement analysis unit 131 acquires registration information of the entry, and outputs the acquired registration information to the fragrance output mode determination unit 133.

[0145] On the other hand, the occupant analysis unit 132 inputs an image (an inside vehicle image) captured by the inside camera 102, and performs presence or absence of an occupant of each seat, or gender, age estimation processing of the occupant, and the like. For example, the gender and age estimation processing is performed as processing using learning data generated in advance.

[0146] The presence or absence of the occupant of each seat, and the gender and age information of the occupant analyzed by the occupant analysis unit 132 are output to the fragrance output mode determination unit 133.

[0147] The fragrance output mode determination unit 133 inputs the following information:

[0148] (1) From the advertisement analysis unit 131, the registration information of the "advertisement corresponding scent management data" acquired from the scent management server 150 (registration information of the registration advertisement item having a position and a direction matching the captured image) is input,

[0149] (2) From the occupant analysis unit 132, the scent output mode determination unit 133 inputs each occupant information such as the presence or absence of the occupant of each seat, the gender and the age information of the occupant.

[0150] The scent output mode determination unit 133 determines whether the scent output condition is satisfied based on the input information.

[0151] Specifically, for example, it is determined whether ((c) scent output condition) included in the registration information of the "advertisement corresponding scent management data" input from the advertisement analysis unit 131 matches the occupant information (gender and age) input from the occupant analysis unit 132, and in addition, it is determined whether the current time matches the time information of ((c) scent output condition) included in the registration information of the "advertisement corresponding scent management data".

[0152] In a case where it is confirmed that the occupant information and the current time match the registration information of ((c) scent output condition) of the "advertisement corresponding scent management data", the scent output mode determination unit 133 then acquires the seat information of the matching occupant and the "(d) scent output mode information" included in the registration information of the "advertisement corresponding scent management data", and outputs the acquired information to the scent output unit control unit 134.

[0153] The scent output unit control unit 134 controls the scent output unit 110 to output a scent to the seat of the occupant matching the registration information of ((c) scent output condition) in the "advertisement corresponding scent management data", thereby performing scent output.

[0154] The scent output is performed by selecting a scent specified by the "output scent identifier" defined in the "(d) scent output mode" of the "advertisement corresponding scent management data". In addition, the scent is output for a specified time according to the "scent output time" specified in the "(d) scent output mode".

[0155] Note that, as described with reference to Figure 3 each scent output unit 110 includes a blower driving unit 121, a flow path control unit 122, and a scent selection output unit 123, and the scent output unit control unit 134 inputs a control signal to each of these components of the scent output unit 110 to perform the kind selection and the output control of the scent to be output.

[0156] Note that the fragrance output unit control unit 134 may be configured to control the output intensity, flow path, etc. of the fragrance, taking into account the distance between the advertisement display and the vehicle, the speed and driving direction of the vehicle, the display orientation of the advertisement display, etc. Specifically, the fragrance may be controlled as if it were wafting from the image of a hamburger drawn on the advertisement sign.

[0157] For example, control is performed such that the fragrance becomes stronger as the distance between the vehicle and the advertisement becomes closer.

[0158] Note that in the above description, an example is described in which the advertising analysis unit 131 of the fragrance output control unit 105 performs control to output various fragrances by controlling the fragrance output units 110-1 to n when an advertising image is detected in the image (exterior-vehicle image) captured by the exterior-vehicle camera 101, but as previously described, the fragrance output control unit 105 may perform control to output various fragrances by controlling the fragrance output units 110-1 to n using at least one of the exterior-vehicle image captured by the exterior-vehicle camera 101, the interior-vehicle image captured by the interior-vehicle camera 102, the vehicle position information acquired by the position information acquisition unit 103, the speed information, or the communication information acquired by the communication unit 104.

[0159] For example, the position and speed (speed and direction) of the host vehicle acquired by the GNSS constituting the position information acquisition unit 103 may be compared with the above reference Figure 5 The registration information of the advertisement setting mode (b) of the "advertisement corresponding fragrance management data" described above is selected, and the fragrance output control is performed according to the registration data of the entry.

[0160] [2. Sequence of Processes Executed by the Fragrance Output Control Device of the Present Disclosure]

[0161] Next, the sequence of processing performed by the fragrance output control device of the present disclosure will be described.

[0162] Figure 9 The flowchart illustrated in FIG. 1 is a flowchart explaining the sequence of processing performed by the fragrance output control device 100 of the present disclosure.

[0163] Note, according to Figure 9 The processing of the flow shown in the diagram is, for example, processing that can be executed under the control of a CPU or the like having a program execution function according to a program stored in a storage unit of the fragrance output control device 100, and can be executed under the control of a data processing unit of the fragrance output control device 100 of the present disclosure, that is, a data processing unit including a CPU having a program execution function.

[0164] It will be explained in turn Figure 9The processing of each step of the flow illustrated in the middle diagram.

[0165] (Step S101)

[0166] First, in step S101, the fragrance output control unit 105 of the fragrance output control device 100 performs advertisement analysis processing.

[0167] This processing is processing performed by the advertisement analysis unit 131 of the fragrance output control unit 105.

[0168] The advertisement analysis unit 131 inputs an image (an image outside the vehicle) captured by the outside camera 101, and performs processing of detecting an advertisement image from the image. The advertisement image detection processing is performed using, for example, learning data generated in advance.

[0169] (Step S102)

[0170] Next, in step S102, the advertisement analysis unit 131 determines whether an advertisement image is detected from the image (an image outside the vehicle) captured by the outside camera 101.

[0171] In the case where an advertisement image is detected from the image (an image outside the vehicle), the processing proceeds to step S103.

[0172] In the case where no advertisement image is detected, the processing returns to step S101, and the processing from step S101 is repeated.

[0173] (Step S103)

[0174] In the case where an advertisement image is detected from the image (an image outside the vehicle), the processing proceeds to step S103.

[0175] In step S103, the advertisement analysis unit 131 determines whether the advertisement detected from the image (an image outside the vehicle) captured by the outside camera 101 matches an advertisement registered in the "advertisement corresponding fragrance management data" held by the fragrance management server 150.

[0176] That is, the position and direction of the advertisement detected from the image (an image outside the vehicle) captured by the outside camera 101 are analyzed, and it is determined whether there is a registered entry in which the analyzed position and direction of the advertisement match the position and direction registered in the "advertisement corresponding fragrance management data" held by the fragrance management server 150.

[0177] In this processing, the own position information acquired by the position information acquisition unit 103 is used.

[0178] When it is determined that the advertisement detected from the captured image matches the registered entry of the "advertisement corresponding fragrance management data" held by the fragrance management server 150, the processing proceeds to step S104.

[0179] On the other hand, when the advertisement detected from the captured image is not registered in the "advertisement corresponding scent management data", the process returns to step S101, and the process of step S101 and the subsequent steps is repeated.

[0180] (Step S104)

[0181] When it is determined in step S103 that the advertisement detected from the captured image matches the registration entry of the "advertisement corresponding scent management data" held by the scent management server 150, the process of step S104 is executed.

[0182] In step S104, occupant analysis processing is executed based on the image (in-vehicle image) captured by the in-vehicle camera 102.

[0183] This process is a process executed by the occupant analysis unit 132 of the scent output control unit 105.

[0184] The occupant analysis unit 132 inputs the image (in-vehicle image) captured by the in-vehicle camera 102, and executes presence or absence of an occupant of each seat, or gender and age estimation processing of the occupant, and the like. For example, the gender and age estimation processing is executed as a process using learning data.

[0185] The presence or absence of the occupant of each seat, and the gender and age information of the occupant analyzed by the occupant analysis unit 132 are output to the scent output mode determination unit 133.

[0186] (Steps S105 and S106)

[0187] Next, in steps S105 to S106, the scent output control unit 105 collates the advertisement analysis result and the occupant analysis result with the server registration information, to determine whether the scent output condition is satisfied.

[0188] This process is a process executed by the scent output mode determination unit 133 of the scent output control unit 105.

[0189] As described above, the scent output mode determination unit 133 inputs the following each information.

[0190] (1) From the advertisement analysis unit 131, the registration information of the "advertisement corresponding scent management data" acquired from the scent management server 150 (registration information of the registration advertisement entry having a position and a direction matching the captured image) is input,

[0191] (2) From the occupant analysis unit 132, the scent output mode determination unit 133 inputs each occupant information such as presence or absence of an occupant of each seat, gender and age information of the occupant.

[0192] The scent output mode determination unit 133 determines whether or not the scent output condition is satisfied based on the input information.

[0193] Specifically, for example, it is determined whether or not the occupant information (gender and age) input from the occupant analysis unit 132 matches the ((c) scent output condition) included in the registration information of the "advertising corresponding scent management data" input from the advertisement analysis unit 131. Further, it is determined whether or not the current time matches the time information of the ((c) scent output condition) included in the registration information of the "advertising corresponding scent management data".

[0194] When it is determined in step S106 that the scent output condition is satisfied, the process proceeds to step S107.

[0195] On the other hand, in a case where the determination condition is not satisfied, the process returns to step S101, and the process of step S101 and subsequent steps is repeated.

[0196] (Step S107)

[0197] When it is determined in step S106 that the scent output condition is satisfied, the process of step S107 is executed.

[0198] In step S107, the scent output mode is determined in accordance with the server registration information and the occupant analysis result.

[0199] This process is also a process executed by the scent output mode determination unit 133 of the scent output control unit 105.

[0200] When it is determined in steps S105 to S106 that the occupant information and the current time match the registration information of the ((c) scent output condition) included in the registration information of the "advertising corresponding scent management data", the "(d) scent output mode information" recorded in the registration entry determined to match is acquired, and the scent output mode is determined in accordance with the acquired "(d) scent output mode information".

[0201] Specifically, the scent specified by the "output scent identifier" specified in the "(d) scent output mode" is determined to be the scent to be output, and the "scent output time" specified in the "(d) scent output mode" is determined to be the scent output time.

[0202] (Step S108)

[0203] Finally, in step S108, the scent output is executed in accordance with the scent output mode determined in step S107.

[0204] This process is executed by the scent output unit control unit 134 and the scent output unit 110 of the scent output control unit 105.

[0205] The fragrance output unit control unit 134 controls the fragrance output unit 110 toward the seat of the occupant matching the registration information of ((c) fragrance output condition) included in the registration information of the “advertisement corresponding fragrance management data” to perform fragrance output.

[0206] Scent output is performed by selecting the scent specified by the "Output Scent Identifier" defined in "(d) Scent Output Mode" of the "Advertising-Corresponding Scent Management Data." Furthermore, the scent is output for the specified time, according to the "Scent Output Time" specified in "(d) Scent Output Mode."

[0207] Note that, as referenced Figure 3 As described, each fragrance output unit 110 includes a blower driving unit 121, a flow path control unit 122 and a fragrance selection output unit 123, and the fragrance output unit control unit 134 inputs a control signal to each of these components of the fragrance output unit 110 to perform type selection and output control of the fragrance to be output.

[0208] The aroma output control device 100 of this embodiment is configured to output an aroma linked to an advertisement near the vehicle's driving path. For example, the device may output the smell of hamburgers when the user sees an advertisement for a hamburger restaurant in front of the car they are driving.

[0209] This processing can improve the advertising effectiveness of advertisements near roads.

[0210] [3. Regarding a scent output control device that outputs a scent linked to an advertisement output from an information output terminal]

[0211] Next, as a second embodiment of the fragrance output control device of the present disclosure, a configuration and processing example of a fragrance output control device that outputs fragrance linked to advertisements output to various information output terminals such as televisions, radios, PCs, and smartphones will be described.

[0212] Figure 10 : is a diagram illustrating a configuration example of the fragrance output control device 200 according to the present embodiment.

[0213] Figure 10 The aroma output control device 200 shown in the diagram corresponds to the one in the above reference Figure 3 The configuration of the aroma output control device 100 described above is supplemented with the configuration of the terminal output information analysis unit 201 .

[0214] Other components are the same as above Figure 3 The instructions are structured similarly.

[0215] Note that, in the second embodiment, the vehicle exterior camera 101 and the position information acquisition unit 103 are not essential components and thus may be omitted.

[0216] The terminal output information analysis unit 201 communicates with, for example, a TV set, a radio set provided in a vehicle, or terminals such as a TV set, a radio set, or a smartphone set as a portable terminal used by an occupant, and analyzes information output to these terminals.

[0217] The analysis information of the terminal output information analysis unit 201 is input to the fragrance output control unit 105 .

[0218] Figure 11 An example of a detailed configuration of the fragrance output control unit 105 of the fragrance output control device 200 of this embodiment is illustrated.

[0219] like Figure 11 As shown in the diagram, the fragrance output control unit 105 includes an advertisement analysis unit 131 , an occupant analysis unit 132 , a fragrance output mode determination unit 133 , and a fragrance output unit control unit 134 .

[0220] These components are similar to those mentioned above. Figure 8 The instructions are structured similarly.

[0221] However, in this embodiment, the advertising analysis unit 131 inputs the analysis information of the terminal output information analysis unit 201 and performs analysis processing of advertisements output to an information acquisition terminal such as a television or radio set in the vehicle, or a terminal such as a television, radio or smart phone that is a portable terminal used by the occupants.

[0222] The advertisement analyzing unit 131 analyzes output information of a terminal such as a television, a radio, and a smartphone, specifically, channel setting and visited site information.

[0223] In addition, when an advertisement is output to a terminal such as a television, a radio, or a smart phone, by accessing the fragrance management server 150 via the communication unit 104, the advertisement analysis unit 131 determines whether the advertisement matches the advertisement registered in the "advertisement corresponding fragrance management data" maintained by the fragrance management server 150.

[0224] That is, determine whether there is a registration entry in which the set channel, set station and time of a terminal such as a television, radio and smart phone, that is, the "advertising output condition" matches the "advertising output condition" registered in the "advertising corresponding fragrance management data" maintained by the fragrance management server 150.

[0225] Figure 12A specific example of "advertising corresponding scent management data" held by the scent management server 150 is illustrated.

[0226] As Figure 12 The following data associated with each advertisement to be output to an information terminal such as a television set, a radio, or a smart phone is registered in the "advertising corresponding scent management data", as illustrated in

[0227] (a) Validity period

[0228] (b) Advertising output condition

[0229] (c) Scent output condition

[0230] (d) Scent output mode

[0231] (a) In the validity period, period data in which scent output control processing using the registered data is executed is registered.

[0232] For example, in the example illustrated in the figure, scent output control for "advertising A" is executed in the period from November 1, 2018 to March 31, 2019.

[0233] This period is defined, for example, in accordance with a contract with an advertising provider and is updateable.

[0234] (b) In the advertising output condition, source (channel, broadcasting station, URL, etc.) information of an advertisement output to an information terminal such as a television set, a radio, or a smart phone, and output time information of the advertisement are recorded.

[0235] This information is data to be collated by the advertising analysis unit 131.

[0236] (c) The scent output condition is a field for recording a condition defining whether or not a scent is output from the scent output unit 110 in a case where it is confirmed that an item matching the advertising output condition (source and time) as a result of collation processing by the advertising analysis unit 131.

[0237] For example, the profile of an occupant such as gender and age of the occupant, and information such as scent output permission time are recorded.

[0238] In Figure 12 the example illustrated in the figure, "advertising A" is set so that the occupant gender = all, the occupant age = all, and the time = 8:00 to 16:00. This is a setting in which a scent is output regardless of whether the occupant is male or female, regardless of age, and in the time period from 8:00 to 16:00.

[0239] "Advertisement B" is a setting to output fragrance when the occupant is male, 20 years old or older, and the time period is between 16:00 and 24:00.

[0240] Note that the gender and age of the occupant are determined based on the captured image of the in-vehicle camera 192 .

[0241] The time period is determined based on a system clock inside the device or time information acquired from an external time information providing server.

[0242] (d) In the fragrance output mode, the type and output time of the fragrance to be output when the fragrance output conditions are satisfied are recorded.

[0243] The type of fragrance is identified by the fragrance identifier. Specifically, for example, if "Advertisement A" is a commercial outputted from 12:31:00 to 12:31:30 on TV station (XYZ-TV), and the commercial is a chocolate advertisement, "the fragrance of chocolate" is selected and outputted.

[0244] The fragrance output time is the fragrance output processing time of the fragrance output unit 110. For example, Figure 12 In the case of "Advertisement A" shown in the figure, the scent output is performed for 30 seconds. In the case of "Advertisement B", the scent output is performed for 20 seconds.

[0245] Notice, Figure 12 The “advertisement corresponding fragrance management data” illustrated in FIG may be stored not in the fragrance management server 150 but in the storage unit of the fragrance output control device 100 in the vehicle.

[0246] Although not in Figure 10 , however, the fragrance output control device 200 includes a storage unit used as a program for executing various processes or a storage area for capturing images, a work area for data processing, and the like.

[0247] Figure 12 The advertisement corresponding fragrance management data shown in the diagram can be recorded and maintained in the storage unit. In this case, processing can be performed without accessing the server.

[0248] return Figure 11 , continue to explain the structure and processing of the fragrance output control unit 105.

[0249] As described above, the advertising analysis unit 131 analyzes output information of terminals such as televisions, radios, and smart phones, specifically, channel settings and visited site information, and further, when an advertisement is output to terminals such as televisions, radios, and smart phones, determines whether the advertisement matches the advertisement registered in the "advertisement corresponding fragrance management data" maintained by the fragrance management server 150.

[0250] That is, it is determined whether the set channel or set station of a terminal such as a television, radio or smart phone, and the time, that is, the advertising entry that matches the conditions of the "advertising output condition" is registered in the "advertising corresponding fragrance management data" maintained by the fragrance management server 150.

[0251] When a matching entry is detected as a registered entry of “advertisement-corresponding fragrance management data” held by the fragrance management server 150 , the advertisement analyzing unit 131 acquires registration information of the entry and outputs the acquired registration information to the fragrance output mode determining unit 133 .

[0252] On the other hand, the occupant analysis unit 132 receives an image (in-vehicle image) captured by the in-vehicle camera 102 and performs processing for estimating the presence or absence of an occupant in each seat, or the occupant's gender and age. For example, the gender and age estimation processing is performed as processing using learning data.

[0253] The presence or absence of an occupant in each seat and the occupant's gender and age information analyzed by the occupant analyzing unit 132 are output to the fragrance output pattern determining unit 133 .

[0254] The fragrance output mode determination unit 133 inputs the following information:

[0255] (1) The advertisement analysis unit 131 inputs the registration information of the "advertisement corresponding fragrance management data" acquired from the fragrance management server 150 (registration information of registered advertisement entries having sources and times matching terminal output advertisements (CM, etc.),

[0256] (2) From the occupant analyzing unit 132, the fragrance output pattern determining unit 133 inputs individual occupant information such as the presence or absence of an occupant in each seat, and the occupant's gender and age information.

[0257] The fragrance output mode determination unit 133 determines whether the fragrance output condition is satisfied based on the input information, and determines the fragrance output mode when it is determined that the fragrance output condition is satisfied.

[0258] Specifically, for example, it is determined whether the (c) scent output condition included in the registration information of the "advertising corresponding scent management data" input from the advertising analysis unit 131 matches the occupant information (gender and age) input from the occupant analysis unit 132, and in addition, it is determined whether the current time matches the time information of the (c) scent output condition included in the registration information of the "advertising corresponding scent management data".

[0259] In a case where the occupant information and the current time match the registration information of the (c) scent output condition included in the registration information of the "advertising corresponding scent management data", the seat information of the matching occupant, and the (d) scent output mode information included in the registration information of the "advertising corresponding scent management data" are acquired, and output to the scent output unit control unit 134.

[0260] The scent output unit control unit 134 controls the scent output unit 110 toward the seat of the occupant matching the registration information of the (c) scent output condition included in the registration information of the "advertising corresponding scent management data" to perform scent output.

[0261] The scent output is performed by selecting a scent specified by the "output scent identifier" defined in the (d) scent output mode of the "advertising corresponding scent management data". In addition, the scent is output for a specified time according to the "scent output time" specified in the (d) scent output mode.

[0262] Note that, as described with reference to Figure 10 , each scent output unit 110 includes a blower driving unit 121, a flow path control unit 122, and a scent selection output unit 123, and the scent output unit control unit 134 inputs a control signal to each of these components of the scent output unit 110 to perform the kind selection and output control of the scent to be output.

[0263] [4. Sequence of processing regarding output of scent in association with output advertisement of information output terminal]

[0264] Next, the sequence of processing performed by the scent output control device 200 illustrated in Figures 10 to 12 will be described. Figure 10 The scent output control device 200 illustrated in

[0265] Figure 13 The flowchart illustrated in Figure 10 is a flowchart illustrating the sequence of processing performed by the scent output control device 200 illustrated in

[0266] Note that, according to theFigure 13 The processing of the flow illustrated in FIG. 6 is, for example, processing that is executed under the control of a CPU or the like having a program execution function in accordance with a program stored in the storage unit of the scent output control device 200, and can be executed under the control of the data processing unit of the scent output control device 100 of the present disclosure, that is, the data processing unit including the CPU having a program execution function.

[0267] The processing of each step of the flow illustrated in FIG. 6 will be described in order. Figure 13

[0268] (Step S201)

[0269] First, in step S201, the scent output control unit 105 of the scent output control device 200 executes processing of analyzing an advertisement to be output to a terminal such as a television set, a radio, or a smart phone.

[0270] This processing is processing executed by the advertisement analysis unit 131 of the scent output control unit 105.

[0271] The advertisement analysis unit 131 analyzes output information of a terminal such as a television set, a radio, and a smart phone, specifically, channel setting and access site information.

[0272] (Step S202)

[0273] Next, in step S202, the advertisement analysis unit 131 of the scent output control unit 105 determines whether an advertisement (CM) registered in the "advertisement corresponding scent management data" held by the scent management server 150 is to be output to a terminal such as a television set, a radio, or a smart phone.

[0274] That is, it is determined whether an advertisement entry in which a set channel or a set site of a terminal such as a television set, a radio, or a smart phone, and a time, that is, a condition matching the "advertisement output condition" are registered is registration data registered in the "advertisement corresponding scent management data" held by the scent management server 150.

[0275] In a case where it is determined that an advertisement entry matching the "advertisement output condition (channel or site, time)" of a terminal acquired through analysis of the terminal is registered in the "advertisement corresponding scent management data" held by the scent management server 150, the processing proceeds to step S203.

[0276] In a case where there is no matching registration entry, the processing returns to step S201, and the processing of step S201 and subsequent steps is repeated.

[0277] (Step S203)

[0278] ​In step S202, in a case where it is determined that an advertisement item matching the "advertisement output condition (channel or site, time)" of the terminal is registered in the "advertisement corresponding scent management data" held by the scent management server 150, the process proceeds to step S203.

[0279] In step S203, occupant analysis processing is performed based on an image (in-vehicle image) captured by the in-vehicle camera 102.

[0280] This process is a process performed by the occupant analysis unit 132 of the scent output control unit 105.

[0281] The occupant analysis unit 132 inputs an image (in-vehicle image) captured by the in-vehicle camera 102, and performs presence or absence of an occupant of each seat, or gender and age estimation processing of the occupant, and the like. For example, the gender and age estimation processing is performed as processing using learning data.

[0282] The presence or absence of an occupant of each seat, and gender and age information of the occupant analyzed by the occupant analysis unit 132 are output to the scent output mode determination unit 133.

[0283] (Steps S204 to S205)

[0284] Next, in steps S204 and S205, the scent output control unit 105 collates the advertisement analysis result and the occupant analysis result with the server registration information, to determine whether or not the scent output condition is satisfied.

[0285] This process is a process performed by the scent output mode determination unit 133 of the scent output control unit 105.

[0286] As described above, the scent output mode determination unit 133 inputs the following respective information.

[0287] (1) From the advertisement analysis unit 131, the registration information of the "advertisement corresponding scent management data" acquired from the scent management server 150 (registration information of a registered advertisement item matching the advertisement output condition (origin, time)) is input,

[0288] (2) From the occupant analysis unit 132, the scent output mode determination unit 133 inputs respective occupant information such as presence or absence of an occupant of each seat, gender and age information of the occupant.

[0289] The scent output mode determination unit 133 determines whether or not the scent output condition is satisfied based on the input information.

[0290] Specifically, for example, it is determined whether the (c) scent output condition included in the registration information of the "advertising corresponding scent management data" input from the advertisement analysis unit 131 matches the occupant information (gender and age) input from the occupant analysis unit 132, and in addition, it is determined whether the current time matches the time information of the (c) scent output condition included in the registration information of the "advertising corresponding scent management data".

[0291] When it is determined in step S205 that the scent output condition is satisfied, the process proceeds to step S206.

[0292] On the other hand, in a case where the determination condition is not satisfied, the process returns to step S201, and the process of step S201 and subsequent steps is repeated.

[0293] (Step S206)

[0294] When it is determined in step S205 that the scent output condition is satisfied, the process of step S206 is executed.

[0295] In step S206, the scent output mode is determined in accordance with the server registration information and the occupant analysis result.

[0296] This process is also a process executed by the scent output mode determination unit 133 of the scent output control unit 105.

[0297] When it is determined in steps S204 and S205 that the occupant information and the current time match the registration information of the (c) scent output condition included in the registration information of the "advertising corresponding scent management data", the (d) scent output mode information recorded in the registration entry determined to match is acquired, and the scent output mode is determined in accordance with the acquired (d) scent output mode information.

[0298] Specifically, the scent specified by the "output scent identifier" specified in the (d) scent output mode is determined to be the scent to be output, and the "scent output time" specified in the (d) scent output mode is determined to be the scent output time.

[0299] (Step S207)

[0300] Finally, in step S207, the scent output is executed in accordance with the scent output mode determined in step S206.

[0301] This process is executed by the scent output unit control unit 134 and the scent output unit 110 of the scent output control unit 105.

[0302] The fragrance output unit control unit 134 controls the fragrance output unit 110 toward the seat of the occupant matching the registration information of the (c) fragrance output condition included in the registration information of the "advertising corresponding fragrance management data" to perform fragrance output.

[0303] The fragrance output is performed by selecting a fragrance specified by the "output fragrance identifier" defined in the (d) fragrance output mode of the "advertising corresponding fragrance management data". In addition, the fragrance is output for a specified time according to the "fragrance output time" specified in the (d) fragrance output mode.

[0304] Note that, as Figure 10 As illustrated in FIG. 1, each fragrance output unit 110 includes a blower driving unit 121, a flow path control unit 122, and a fragrance selection output unit 123, and the fragrance output unit control unit 134 inputs a control signal to each of these components of the fragrance output unit 110 to perform selection of the kind of fragrance to be output and output control.

[0305] The fragrance output control device 200 of the above-described embodiment is configured to output a fragrance in association with an advertisement output to various information output terminals such as a television, a radio, a PC, and a smart phone. For example, a process of outputting a fragrance of chocolate when a user watches a CM of chocolate broadcast from a television can be performed.

[0306] By such a process, it is possible to improve the advertising effect of an advertisement output to various information output terminals such as a television, a radio, a PC, and a smart phone.

[0307] [5. Other Embodiments of the Fragrance Output Control Device of the Present Disclosure and Effects of the Fragrance Output Control Device of the Present Disclosure]

[0308] Next, other embodiments of the fragrance output control device of the present disclosure and effects of the fragrance output control device of the present disclosure will be described.

[0309] First, another embodiment of the fragrance output control device of the present disclosure will be described.

[0310] In the above-described embodiments, the first embodiment is an embodiment in which a fragrance in association with an advertisement viewed from a vehicle is output, and the second embodiment is an embodiment in which a fragrance in association with an advertisement output to an information output terminal such as a television, a radio, or a smart phone is output.

[0311] In addition to these embodiments, the fragrance output control device of the present disclosure can be configured to perform the following processes.

[0312] (a) when a vehicle is started, a unique fragrance associated with the vehicle such as a car is output,

[0313] (b) outputting a configuration of a scent unique to a vehicle of a communication partner, which is registered in advance at a service company (scent management server), in accordance with information received through inter-vehicle communication between vehicles such as automobiles,

[0314] (c) in a dispatch service such as a taxi or a car sharing service, when a user gets on a vehicle used by the user, outputting a configuration of a scent registered in advance at a service company (scent management server) by the user;

[0315] For example, it is also possible to perform a configuration of these processes.

[0316] In (a) in which a unique scent associated with a vehicle such as an automobile is output when the vehicle is started, a scent specific to a vehicle manufacturer or a model is output when the engine is started. The scent to be output can be set to be changed, for example, in accordance with an outside air temperature, a brightness, and a time. In this case, the outside temperature, the brightness, and the time are measured by a sensor or a clock provided in the scent output control device, and the setting of the scent output by the scent output control unit is changed based on the measured values.

[0317] In the above (b) in which a configuration of a unique scent of a vehicle of a communication partner, which is registered in advance at a service company (scent management server), is output in accordance with information received through inter-vehicle communication between vehicles such as automobiles, for example, the following processes are performed.

[0318] In a case where information such as a traffic jam or an accident is received in the vicinity of the inter-vehicle communication, a scent for arousing attention is output. Note that, in addition to this scent output, other alarms (sound, vibration, screen display) can be output in combination.

[0319] In the above (c) in which, in a dispatch service such as a taxi or a car sharing service, a user outputs a configuration of a scent registered in advance at a service company (scent management server) when the user gets on a vehicle used by the user, for example, the following processes are performed.

[0320] In a taxi dispatch service or a car sharing service, when a customer gets on a vehicle, a favorite scent registered in advance for the service is output. Various scent output timings can be used, such as when a sensor on a seat detects a seat, when a driver manipulates an operation switch, or when a human body sensor detects. Note that, one or more scents can be registered in advance. In the case of multiple, the scent to be output can be randomly selected and set in the order of the list each time the user gets on the vehicle.

[0321] Note that, for example, in the case of a taxi, when a customer makes a reservation for a car, customer information can be sent to the vehicle or driver along with the information of the departure location and the destination, and the customer's favorite scent information can be included in the customer information.

[0322] As a configuration common to (a) to (c) above, for example, a process of giving a scent gift to the owner or driver of the vehicle, or the user on the birthday, wedding anniversary, or the like can be performed. The anniversary date is recorded in the server or the storage unit in the device, and the management output control unit performs control to output the scent to the user on the anniversary date.

[0323] Alternatively, in the case of outputting the scent, a process such as giving points is performed, and a service such as a reward discount corresponding to the points can be developed.

[0324] Next, the effect of the scent output control device of the present disclosure will be described.

[0325] As the effect of the scent output control device of the present disclosure, first, there is a large effect of increasing the advertising effect.

[0326] Further, as a derivative effect, for example, the carrier such as a taxi can also receive an advertising fee from the advertiser. For the customer, smelling the scent increases their willingness to purchase, and increases the opportunity to receive products and services from the advertiser.

[0327] In addition, in the case of providing an advertisement via a television, a radio, or a network, not only the advertising effect can be improved, but also the satisfaction with the advertisement can be improved.

[0328] For the customer, by smelling the scent, the degree of understanding of the object of the advertisement can be improved.

[0329] [6. Example of hardware configuration of scent output control device]

[0330] Next, a specific example of the hardware configuration of the scent output control device that performs the above-described process will be described with reference to Figure 14

[0331] Figure 14 is a diagram illustrating an example of the hardware configuration of the scent output control device.

[0332] ​A central processing unit (CPU) 301 functions as a data processing unit that executes various processes in accordance with programs stored in a read only memory (ROM) 302 or a storage unit 308. For example, processes corresponding to the sequences explained in the above-described embodiments are executed. A random access memory (RAM) 303 stores programs, data, and the like executed by the CPU 301. The CPU 301, the ROM 302, and the RAM 303 are interconnected by a bus 304.

[0333] The CPU 301 is connected to an input / output interface 305 via the bus 304, and the input / output interface 305 is connected to an input unit 306 including various switches, a keyboard, a touch panel, a mouse, a microphone, a data acquisition unit such as a sensor, a camera, a GPS or a GNSS, and the like, and an output unit 307 including a display, a speaker, and the like.

[0334] Note that the scent output unit is also a component of the output unit 307.

[0335] The CPU 301 inputs commands, status data, and the like input from the input unit 306, executes various processes, and outputs the results of the processes to, for example, the output unit 307.

[0336] The storage unit 308 connected to the input / output interface 305 includes, for example, a hard disk or the like, and stores programs executed by the CPU 301 and various data. A communication unit 309 functions as a transmission / reception unit of data communication via a network such as the Internet or a local area network, and communicates with external devices.

[0337] A drive 310 connected to the input / output interface 305 drives a detachable medium 311 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory such as a memory card, and records or reads data.

[0338] [7. Summary of the configuration of the present disclosure]

[0339] The above, the embodiments of the present disclosure are explained in detail with reference to specific embodiments. However, it is obvious that modifications and substitutions of the embodiments can be made by those skilled in the art without departing from the gist of the present disclosure. That is, the present invention is disclosed in the form of examples, and should not be interpreted in a limiting manner. In order to determine the gist of the present disclosure, the claims should be referred to.

[0340] Note that the technology described in this specification can have the following configuration.

[0341] (1) A scent output control device including:

[0342] a scent output control unit configured to execute scent output control; and

[0343] a scent output unit configured to perform scent output under the control of the scent output control unit,

[0344] wherein the scent output control unit selects a scent to be output based on the advertisement, and outputs the selected scent via the scent output unit.

[0345] (2) The scent output control device described in (1), wherein the scent output unit is configured to output a scent into a car.

[0346] (3) The scent output control device described in (2), wherein the scent output control unit selects a scent to be output based on an advertisement detected from an image captured by an outside camera that captures an image of the outside of the car, and outputs the selected scent via the scent output unit.

[0347] (4) The scent output control device described in (3), wherein the scent output control unit

[0348] determines whether the advertisement detected from the image captured by the outside camera is an advertisement registered in advertisement-corresponding-scent management data, and

[0349] in the case where the advertisement is a registered advertisement, selects a scent to be output based on a scent identifier recorded in the advertisement-corresponding-scent management data in association with the registered advertisement.

[0350] (5) The scent output control device described in (4), wherein the scent output control unit performs processing that checks whether a position of the advertisement detected from the image captured by the outside camera matches position information recorded in association with a registered advertisement of the advertisement-corresponding-scent management data.

[0351] (6) The scent output control device described in (4) or (5), wherein

[0352] the advertisement-corresponding-scent management data is data held in a scent management server outside, and

[0353] the scent output control unit accesses the scent management server via a communication unit, and checks registration information of the advertisement-corresponding-scent management data.

[0354] (7) The scent output control device described in any one of (2) to (6), wherein the scent output control unit selects a scent to be output based on an advertisement of an information output terminal output into a car, and outputs the selected scent via the scent output unit.

[0355] (8) The scent output control device described in (7), wherein the scent output control unit

[0356] determining whether the advertisement output to the information output terminal is an advertisement registered in the advertisement corresponding scent management data, and

[0357] in the case of the registered advertisement, selecting a scent to be output based on a scent identifier recorded in the advertisement corresponding scent management data in association with the registered advertisement.

[0358] (9) The scent output control device described in (8), wherein the scent output control unit performs processing of checking whether a source and a time of the advertisement output to the information output terminal match a source and a time recorded in association with a registered advertisement of the advertisement corresponding scent management data.

[0359] (10) The scent output control device described in (8) or (9), wherein

[0360] the advertisement corresponding scent management data is data held in a scent management server outside, and

[0361] the scent output control unit accesses the scent management server via a communication unit and checks registration information of the advertisement corresponding scent management data.

[0362] (11) The scent output control device described in any one of (2) to (10), further comprising:

[0363] an in-vehicle camera configured to capture an image of the inside of the vehicle,

[0364] wherein the scent output control unit performs occupant analysis processing based on the image captured by the in-vehicle camera and controls scent output in accordance with the analysis result.

[0365] (12) The scent output control device described in (11), wherein the scent output control unit

[0366] determines whether the advertisement is an advertisement registered in the advertisement corresponding scent management data, and

[0367] in the case of the registered advertisement, acquires a scent output condition recorded in the advertisement corresponding scent management data in association with the registered advertisement, and outputs a scent in the case where the acquired scent output condition matches an occupant profile analyzed from the image captured by the in-vehicle camera.

[0368] (13) The scent output control device described in (12), wherein the scent output control unit outputs a scent to an occupant having a profile matching the scent output condition recorded in the advertisement corresponding scent management data.

[0369] (14) The scent output control device according to any one of (1) to (13), wherein the scent output control unit

[0370] determines whether the advertisement is an advertisement registered in the advertisement- corresponding scent management data, and

[0371] in a case where the advertisement is a registered advertisement, acquires a scent output permission time recorded in the advertisement- corresponding scent management data in association with the registered advertisement, and outputs a scent in a case where a current time matches the scent output permission time recorded in the scent output condition.

[0372] (15) A scent output control method executed in a scent output control device, wherein

[0373] the scent output control device includes:

[0374] a scent output control unit configured to perform scent output control; and

[0375] a scent output unit configured to perform scent output under control of the scent output control unit, and

[0376] the scent output control unit selects a scent to be output based on an advertisement, and outputs the selected scent via the scent output unit.

[0377] (16) A program that causes a scent output control device to perform scent output control, wherein

[0378] the scent output control device includes:

[0379] a scent output control unit configured to perform scent output control; and

[0380] a scent output unit configured to perform scent output under control of the scent output control unit, and

[0381] the program causes the scent output control unit to select a scent to be output based on an advertisement, and output the selected scent via the scent output unit.

[0382] The series of processes described in the specification can be executed by hardware, software, or a combination of both. In the case of executing the processes by software, a program that records the process sequence can be installed in a memory in a computer incorporated into a dedicated hardware and executed, or the program can be installed in a general-purpose computer capable of executing various processes and executed. For example, the program can be recorded in a recording medium in advance. In addition to being installed from the recording medium to the computer, the program can be received via a network such as a local area network (LAN) or the Internet and installed in a recording medium such as a built-in hard disk.

[0383] Note that the various processes described in the specification can be executed not only in the order described but also in accordance with the processing capacity of the device that executes the processes or in parallel or individually if necessary. In addition, in the present specification, a system is a logical collection of a plurality of devices, and is not limited to a system in which various constituent devices are located within the same housing.

[0384] Industrial applicability

[0385] As described above, according to the configuration of the embodiment of the present disclosure, for example, a device and a method that output a scent corresponding to an advertisement that can be observed from inside a vehicle such as a car, or an advertisement output to an information output terminal such as a television are realized.

[0386] Specifically, for example, a scent output control unit that executes scent output control, and a scent output unit that executes scent output under the control of the scent output control unit are included, and the scent output control unit selects a scent to be output based on an advertisement, and outputs the selected scent via the scent output unit. The scent output control unit selects a scent to be output based on an advertisement detected from an image captured by an outside camera that captures the outside of a vehicle, or an advertisement output to an information output terminal, and outputs the selected scent via the scent output unit. Furthermore, an occupant profile is analyzed based on an image of the occupant, and a scent corresponding to the occupant is output.

[0387] According to the present configuration, for example, a device and a method that output a scent corresponding to an advertisement that can be observed from inside a vehicle such as a car, or an advertisement output to an information output terminal such as a television are realized.

[0388] List of reference numerals

[0389] 100 scent output control device

[0390] 101 outside camera

[0391] 102 inside camera

[0392] 103 position information acquisition unit

[0393] 104 communication unit

[0394] 105 fragrance output control unit

[0395] 110 fragrance output unit

[0396] 121 blower drive unit

[0397] 122 flow path control unit

[0398] 123 fragrance selection output unit

[0399] 131 advertisement analysis unit

[0400] 132 passenger analysis unit

[0401] 133 fragrance output mode determination unit

[0402] 134 fragrance output unit control unit

[0403] 200 fragrance output control device

[0404] 201 terminal output information analysis unit

[0405] 301 CPU

[0406] 302 ROM

[0407] 303 RAM

[0408] 304 bus

[0409] 305 input / output interface

[0410] 306 input unit

[0411] 307 output unit

[0412] 308 storage unit

[0413] 309 communication unit

[0414] 310 drive

[0415] 311 detachable medium

Claims

1. A fragrance output control device, comprising: an acquisition unit configured to receive a first image of an exterior of the vehicle captured by the exterior camera and a second image of an interior of the vehicle captured by the interior camera; A fragrance output control unit, wherein the fragrance output control unit is configured to: detecting an advertisement from a first captured image of an exterior of the vehicle; determining, from the aroma management server, registration information corresponding to the detected advertisement; determining occupant information of the occupant from the second image, wherein the occupant information includes gender information of the occupant, age information of the occupant, and presence of the occupant; determining a match between the registration information and the occupant information; acquiring seat information of the occupant from the fragrance management server based on a match between the registration information and the occupant information, wherein the seat information corresponds to a position of a specific seat; The fragrance output control is performed so that the fragrance output unit outputs fragrance to the specific seat, wherein The fragrance output control unit is further configured to: selecting a scent to be output based on the advertisement detected from the captured first image; and The fragrance output unit is caused to output the selected fragrance.

2. The fragrance output control device according to claim 1, wherein The fragrance output control unit is further configured to determine whether the detected advertisement is an advertisement registered in the advertisement corresponding fragrance management data, and In a case where the detected advertisement matches a registered advertisement, the fragrance output control unit is further configured to select a fragrance to be output based on a fragrance identifier recorded in the advertisement-corresponding fragrance management data in association with the registered advertisement.

3. The fragrance output control device according to claim 2, wherein the fragrance output control unit is further configured to: It is checked whether the position of the detected advertisement matches the position information recorded in association with the registered advertisement of the advertisement-corresponding fragrance management data.

4. The fragrance output control device according to claim 2, further comprising a communication unit, wherein Advertisement corresponding fragrance management data is data stored in an external fragrance management server, and The fragrance output control unit is further configured to: accessing the aroma management server via the communication unit, and Check the registration information of the scent management data corresponding to the advertisement.

5. The fragrance output control device according to claim 1, wherein the fragrance output control unit is further configured to: Based on the advertisement output to the information output terminal, a scent to be output is selected, wherein The advertisement output is based on the first image, and The information output terminal is located in the car, and The fragrance output unit is caused to output the selected fragrance.

6. The aroma output control device according to claim 5, wherein The fragrance output control unit is further configured to determine whether the advertisement output to the information output terminal is an advertisement registered in the advertisement corresponding fragrance management data, and When the advertisement output to the information output terminal matches the advertisement registered in the advertisement-corresponding fragrance management data, the fragrance output control unit is further configured to select the fragrance to be output based on the fragrance identifier recorded in the advertisement-corresponding fragrance management data in association with the registered advertisement.

7. The fragrance output control device according to claim 6, wherein the fragrance output control unit is further configured to perform a process of checking whether the source and time of the advertisement output to the information output terminal match the source and time recorded in association with the registered advertisement of the advertisement-corresponding fragrance management data.

8. The aroma output control device according to claim 6, further comprising a communication unit, wherein Advertisement corresponding fragrance management data is data stored in an external fragrance management server, and The fragrance output control unit is further configured to: accessing a scent management server via the communication unit, and Check the registration information of the scent management data corresponding to the advertisement.

9. The fragrance output control device according to claim 1, wherein the fragrance output control unit is further configured to: Determine whether the advertisement is an advertisement registered in the advertisement corresponding fragrance management data, and In the case of a registered advertisement, the fragrance output control unit is further configured to obtain a fragrance output condition recorded in the advertisement corresponding fragrance management data in association with the registered advertisement, and In a case where the acquired fragrance output condition matches the occupant profile analyzed based on the second image captured by the in-vehicle camera, the fragrance output control unit is further configured to output the selected fragrance.

10. The fragrance output control device according to claim 9, wherein the fragrance output control unit is further configured to output the fragrance to an occupant having a profile matching the fragrance output condition recorded in the advertisement-corresponding fragrance management data.

11. The fragrance output control device according to claim 1, wherein the fragrance output control unit is further configured to determine whether the advertisement is an advertisement registered in the advertisement corresponding fragrance management data, and In the case of a registered advertisement, the fragrance output control unit is further configured to acquire a fragrance output permission time recorded in the advertisement corresponding fragrance management data in association with the registered advertisement, and The fragrance output control unit is further configured to output the selected fragrance in a case where the current time matches the fragrance output permission time recorded in the fragrance output condition.

12. A method for controlling fragrance output, comprising: Receiving, by an acquisition unit, a first image of the exterior of the vehicle captured by the exterior camera and a second image of the interior of the vehicle captured by the interior camera; detecting, by the fragrance output control unit, the advertisement from the captured first image of the exterior of the vehicle; determining, by the fragrance output control unit, registration information corresponding to the detected advertisement from the fragrance management server; determining, by the fragrance output control unit, occupant information of an occupant from the second image, wherein the occupant information includes occupant gender information, occupant age information, and occupant presence; determining, by the fragrance output control unit, a match between the registration information and the occupant information; acquiring, by the fragrance output control unit, seat information of the occupant from the fragrance management server based on a match between the registration information and the occupant information, wherein the seat information corresponds to a position of a specific seat; executing fragrance output control so that the fragrance output unit outputs fragrance toward the specific seat; selecting, by the fragrance output control unit, a fragrance to be output based on the advertisement detected from the captured first image; as well as The fragrance output unit is caused to output the selected fragrance.

13. A computer program product comprising a program for causing a fragrance output control device to perform fragrance output control, wherein when the program is executed by a computer, the computer performs the following operations: receiving a first image of an exterior of the vehicle captured by an exterior camera and a second image of an interior of the vehicle captured by an interior camera; detecting an advertisement from a first captured image of an exterior of the vehicle; determining, from the aroma management server, registration information corresponding to the detected advertisement; determining occupant information of the occupant from the second image, wherein the occupant information includes gender information of the occupant, age information of the occupant, and presence of the occupant; determining a match between the registration information and the occupant information; acquiring seat information of the occupant from the fragrance management server based on a match between the registration information and the occupant information, wherein the seat information corresponds to a position of a specific seat; executing fragrance output control so that the fragrance output unit outputs fragrance toward the specific seat; selecting a scent to output based on the advertisement detected from the captured first image; as well as Outputs the selected scent.

Images