Aroma determination system, aroma determination device, aroma determination method and program

Abstract

To provide a system, an apparatus and a method for determining fragrance, and a program allowing for providing suitable fragrance for an environment where a user is present.SOLUTION: A system 100 for determining fragrance according to one embodiment of the present disclosure comprises: a user imaging unit 101 that captures an image of a user; an environment information acquiring unit 102 that has at least either a surrounding environment imaging unit for capturing an image of a surrounding environment of the user or an environment sound acquiring unit for acquiring environment sound in the surrounding of the user; and a fragrance determining unit 103 that determines fragrance to be provided to the user based on at least any of a video image of the user captured by the user imaging unit 101 and a video image of the surrounding environment captured by the surrounding environment imaging unit or the environment sound acquired by the environment sound acquiring unit.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an aroma determination system, an aroma determination device, an aroma determination method, and a program.

Background Art

[0002] As part of an effort to improve the customer experience or UX (User Experience) of devices and services and give users a good impression to differentiate from others, users are made to experience some kind of aroma.

[0003] For example, Patent Document 1 describes an aroma presentation device that determines an aroma to be presented to a user based on identification information for identifying the user, the user's vital information, and the like.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When providing an aroma to a user, even if the provided aroma is appropriate for the user himself / herself, it may not necessarily be appropriate for the surrounding environment.

[0006] An object of the present disclosure is to provide an aroma determination system, an aroma determination device, an aroma determination method, and a program that can provide an aroma suitable for the environment where the user is present.

Means for Solving the Problems

[0007] A fragrance determination system according to one aspect of the present disclosure includes a first imaging unit for imaging the user, a second imaging unit for imaging the user's surrounding environment, or an ambient sound acquisition unit for acquiring ambient sounds around the user, and a fragrance determination unit that determines a fragrance to be provided to the user based on the image of the user captured by the first imaging unit and at least one of the image of the surrounding environment captured by the second imaging unit or the ambient sounds acquired by the ambient sound acquisition unit.

[0008] A fragrance determination device according to one aspect of this disclosure includes an acquisition unit that acquires captured video of the user and video of the user's surrounding environment or ambient sounds around the user, and a fragrance determination unit that determines a fragrance to be provided to the user based on at least one of the captured video of the user and video of the surrounding environment or ambient sounds.

[0009] A computer-based fragrance determination method according to one aspect of this disclosure acquires captured video footage of the user and video footage of the user's surrounding environment or ambient sounds around the user, and determines a fragrance to be provided to the user based on at least one of the captured video footage of the user and the video footage of the surrounding environment or ambient sounds.

[0010] A program according to one aspect of this disclosure acquires video footage of the user and video footage of the user's surrounding environment or ambient sounds around the user, and causes a computer to determine a scent to be provided to the user based on at least one of the video footage of the user and the video footage of the surrounding environment or ambient sounds. [Effects of the Invention]

[0011] According to this disclosure, it is possible to provide a fragrance determination system, a fragrance determination device, a fragrance determination method, and a program that can provide a fragrance suitable for the environment in which the user is located. [Brief explanation of the drawing]

[0012] [Figure 1] This is a block diagram showing an example of a fragrance determination system according to Embodiment 1. [Figure 2]It is a flowchart showing an example of the processing executed by the scent determination system according to Embodiment 1. [Figure 3A] It is a block diagram showing an example of the scent determination device according to Embodiment 1. [Figure 3B] It is a block diagram showing an example of the hardware configuration of the scent determination device according to Embodiment 1. [Figure 4] It is a block diagram showing an example of the scent determination system according to Embodiment 2. [Figure 5] It is a block diagram showing an example of the terminal according to Embodiment 2. [Figure 6] It is a diagram showing the situation where the camera for the surrounding environment according to Embodiment 2 is installed. [Figure 7A] It is a block diagram showing an example of the data storage server according to Embodiment 2. [Figure 7B] It is a block diagram showing an example of the functional aspect of the data storage server according to Embodiment 2. [Figure 8] It is a sequence diagram showing an example of the processing of the scent determination system according to Embodiment 2. [Figure 9A] It is a flowchart showing an example of the processing of the scent determination system according to Embodiment 2. [Figure 9B] It is a flowchart showing an example of the processing of the scent determination system according to Embodiment 2. [Figure 10] It is a block diagram showing an example of the terminal according to Embodiment 3. [Figure 11] It is a block diagram showing an example of the terminal according to Embodiment 4. [Figure 12] It is a block diagram showing an example of the terminal according to Embodiment 7. [Figure 13] It is a block diagram showing an example of the information processing unit according to Embodiment 7. [Figure 14] It is a block diagram showing an example of the terminal according to Embodiment 8. [Figure 15] It is a block diagram showing an example of the information processing unit according to Embodiment 8.

Best Mode for Carrying Out the Invention

[0013] Embodiment 1 (1A) Hereinafter, Embodiment 1 of the present disclosure will be described with reference to the drawings. In this (1A), an aroma determination system composed of a plurality of devices will be described.

[0014] FIG. 1 is a block diagram showing an example of an aroma determination system 100. The aroma determination system 100 determines the aroma to be provided to the user, and includes a user imaging unit 101 (first imaging unit), an environmental information acquisition unit 102 that acquires information on the user's surrounding environment, and an aroma determination unit 103. Hereinafter, each unit will be described.

[0015] The user imaging unit 101 images the user and includes, for example, a camera for imaging. The user imaging unit 101 captures an image of the user's appearance including at least one of elements such as the user's face, physique, and clothing as information for determining the aroma to be provided to the user.

[0016] [[ID=二十一]]The environmental information acquisition unit 102 has at least one of a surrounding environment imaging unit (second imaging unit) that images the user's surrounding environment and an environmental sound acquisition unit that acquires the environmental sound around the user as information on the user's surrounding environment. Here, the user's surrounding environment refers to the environment around the user (for example, within a few meters from the user), not the user's own information. Therefore, the surrounding environment imaging unit can image a location at a certain distance from the user, and the environmental sound acquisition unit can acquire the environmental sound at a location at a certain distance from the user. The surrounding environment imaging unit includes, for example, a camera for imaging, and the environmental sound acquisition unit includes, for example, a microphone for acquiring sound. The environmental information acquisition unit 102 is provided near the user imaging unit 101.

[0017] The fragrance determination unit 103 determines the fragrance to be provided to the user based on the user's image captured by the user imaging unit 101 and information about the user's surrounding environment acquired by the environmental information acquisition unit 102 (i.e., at least one of the image of the surrounding environment captured by the surrounding environment imaging unit or the environmental sound acquisition unit acquired by the environmental sound acquisition unit). The fragrance determination unit 103 may be located near the user imaging unit 101 and the environmental information acquisition unit 102, or it may be located at a distance from them.

[0018] For example, the fragrance determination unit 103 may determine the characteristics of the user in the video based on the video of the user captured by the user shooting unit 101. User characteristics refer to unique user traits that can be estimated from the user's appearance, such as face, build, and clothing, such as the user's age, gender, preferences (for example, the user's color preferences, whether they are outdoorsy or indoorsy, formal or casual, sporty or dressy). The user characteristics to be determined may be one or more.

[0019] As an example, the fragrance determination unit 103 may also determine the characteristics of the surrounding environment based on the information about the user's surrounding environment acquired by the environmental information acquisition unit 102. Characteristics of the surrounding environment include, for example, the number of people or their density (crowding), the time of day, and the location where the environmental information acquisition unit 102 is located. The location where the environmental information acquisition unit 102 is located may be specified as, for example, whether it is indoors or outdoors. If it is indoors, the type of building may be further specified as a convenience store, office building, shopping mall, or simple booth. If it is outdoors, the environment may be specified as a commercial district or residential area.

[0020] The fragrance determination unit 103 can determine a fragrance to be provided to the user based on at least one of the determined user characteristics or the characteristics of the surrounding environment. The fragrance determination unit 103 can determine a fragrance to be provided to the user by, for example, identifying fragrances that are previously associated with the characteristics. The fragrance determination unit 103 may determine one type of fragrance to be provided to the user based on the characteristics, or it may select a plurality of candidate fragrances based on the characteristics and determine one type of fragrance that satisfies predetermined conditions from among them. Details of this will be described later in Embodiment 2.

[0021] The fragrance determination unit 103 may also obtain information about the fragrance to be provided to the user by inputting acquired video or ambient sound of the user or surrounding environment into an AI (Artificial Intelligence) model. This AI model is a model that has been trained to determine the characteristics of the user or surrounding environment based on the video or ambient sound of the target user or surrounding environment (input data), and to determine the fragrance to be provided to the user based on the determination result. This AI model can be adjusted as appropriate, as described in Embodiment 2.

[0022] As another example, the fragrance determination unit 103 can also determine the fragrance to be provided to the user without determining the user's characteristics captured by the user shooting unit 101 or the characteristics of the user's surrounding environment acquired by the environmental information acquisition unit 102. For example, the AI ​​model described above may output information about the fragrance to be provided to the user based on the input video or ambient sound data of the user or surrounding environment, without determining the characteristics of the user or surrounding environment.

[0023] As yet another example, the determination of user characteristics or at least one of the characteristics of the surrounding environment may be achieved by the scent determination unit 103 performing an analysis of the video (or ambient sound). This analysis uses predetermined criteria, including thresholds set for determining each characteristic. Based on the results of the determination, the scent determination unit 103 can determine the scent to be provided to the user by referring to a table that corresponds to characteristics and scents. In this way, the scent determination unit 103 can perform processing even without an AI model.

[0024] Figure 2 is a flowchart illustrating a typical process of the fragrance determination system 100, and this flowchart explains the process of the fragrance determination system 100. Details of the process are as described above.

[0025] First, the user image capture unit 101 captures the user (step S11). Then, the environment information acquisition unit 102 acquires information about the user's surrounding environment (step S12). Specifically, at least one of the following is performed: the surrounding environment image capture unit captures the user's surrounding environment and acquires video of the surrounding environment, or the environment sound acquisition unit acquires the environment sounds around the user. The processes in steps S11 and S12 may be performed simultaneously or approximately simultaneously, for example.

[0026] The fragrance determination unit 103 determines the fragrance to be provided to the user based on the user's video captured by the user shooting unit 101 and the environmental information acquisition unit 102 (at least one of the video of the surrounding environment captured by the surrounding environment shooting unit or the environmental sound acquisition unit acquired by the environmental sound acquisition unit) (step S13).

[0027] Thus, the fragrance determination system 100 determines a fragrance by acquiring information about the user's surrounding environment, such as at least one of the user's video or ambient sound, as well as the user's video, and can provide a fragrance suitable for the environment in which the user is located.

[0028] (1B) Next, (1B) describes a fragrance determination device that can determine the fragrance to be provided to the user as a standalone device.

[0029] Figure 3A is a block diagram showing an example of a fragrance determination device according to Embodiment 1. The fragrance determination device 110 comprises an acquisition unit 111 and a fragrance determination unit 112.

[0030] The acquisition unit 111 acquires the captured video of the user, as well as video of the user's surrounding environment or ambient sound around the user. Details of how to capture the user's video and acquire video of the user's surrounding environment or ambient sound around the user are described in (1A).

[0031] The fragrance determination unit 112 determines the fragrance to be provided to the user based on the captured video of the user and at least one of the video of the user's surrounding environment or ambient sounds around the user, which are acquired by the acquisition unit 111. Further details are as described in (1A).

[0032] As described above, the fragrance determination device 110 can provide a fragrance suitable for the environment in which the user is present, similar to (1A). The fragrance determination device 110 can be configured, for example, as a device in which a fragrance determination unit 103 is provided within a fragrance determination system 100.

[0033] Furthermore, both the fragrance determination system 100 and the fragrance determination device 110 may also be further equipped with a fragrance provisioning unit that provides the user with the fragrance determined by the fragrance determination unit 103 or the fragrance determination unit 112. Details of this fragrance provisioning unit will be described in Embodiment 2.

[0034] In the above description, the fragrance determination device 110 was described as a hardware configuration. However, the configuration of the fragrance determination device 110 is not limited to this. The processing (steps) of the fragrance determination device 110 can also be realized by having a computer program executed by a processor in the computer that constitutes the fragrance determination device 110. Furthermore, a device having a fragrance determination unit 103 in the fragrance determination system 100 can also be realized by having a computer program executed by a processor in the computer that constitutes that device.

[0035] Figure 3B is a block diagram showing an example of the hardware configuration of an information processing device (computer) on which the above-described processes are performed. Referring to Figure 3B, this information processing device 120 includes a control unit 121, a storage unit 122, and a communication unit 123, and constitutes a device having a scent determination device 110 or a scent determination unit 103.

[0036] The control unit 121 includes one or more processors and performs control processing, arithmetic processing, etc., by reading and executing software (computer programs) from the storage unit 122, thereby performing the processing of the device described in the above embodiment. An example of a processor included in the control unit 121 is one of the following: CPU (Central Processing Unit), MPU (Micro Processing Unit), FPGA (Field-Programmable Gate Array), DSP (Demand-Side Platform), or ASIC (Application Specific Integrated Circuit), or multiple of these may be used in parallel.

[0037] The memory unit 122 has volatile memory, non-volatile memory, or a memory that combines the two. There is no limit to one such memory; multiple such memories may be provided. The volatile memory may be, for example, RAM (Random Access Memory) such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). The non-volatile memory may be, for example, ROM (Random Only Memory) such as PROM (Programmable Random Only Memory) or EPROM (Erasable Programmable Read Only Memory), flash memory, HHD (Hard Disk Drive), or SSD (Solid State Drive).

[0038] The memory in the storage unit 122 is used to store one or more instructions. Here, one or more instructions are stored in the memory as a group of software modules. The processor of the control unit 121 can perform the processing described in the above embodiment by reading and executing these software modules from the memory. In addition, the memory has a function for temporarily storing processing data, and may also store data such as algorithms, models, tables, and other databases used during processing.

[0039] Furthermore, the memory may include not only memory located outside the processor of the control unit 121, but also memory built into the processor. The memory may also include storage located separately from the processors that constitute the processor. In this case, the processor can access the memory via an I / O (Input / Output) interface.

[0040] The communication unit 123 transmits and receives signals with devices connected to the information processing device 120 via the network, and may include communication ports, routers, firewalls, etc. In terms of hardware configuration, the communication unit 123 includes a communication circuit.

[0041] The control unit 121 has one or more processors that execute one or more programs that include a set of instructions for causing the computer to perform the algorithm described with reference to Figure 2. This process enables the signal processing method to be realized.

[0042] The program, when loaded into a computer, includes a set of instructions (or software code) for causing the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disk (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically, or otherwise propagating signals.

[0043] Embodiment 2 Embodiment 2 of this disclosure will now be described with reference to the drawings. Embodiment 2 discloses a specific example of the fragrance determination system 100 described in Embodiment 1.

[0044] Figure 4 is a block diagram showing an example of a fragrance determination system according to Embodiment 2. The fragrance determination system 200 includes a terminal 210, a camera for the surrounding environment 230, and a data storage server 240. Each device is connected to enable communication via a network; for example, the terminal 210 and the data storage server 240, and the camera for the surrounding environment 230 and the data storage server 240 are connected via the Internet.

[0045] Terminal 210 is an information processing terminal installed indoors in places such as banks, convenience stores, office buildings, shopping malls, train stations, and booths. Here, an ATM (Automatic Teller Machine) is assumed, but other types of terminals may be used. Therefore, terminal 210 is intended to be operated by an unspecified number of users. Externally, terminal 210 has a camera 211, a microphone 212, a proximity sensor 213, and a fragrance emitter 214.

[0046] In this example, one ambient camera 230 is provided for each terminal 210, but multiple ambient cameras 230 may be provided for each terminal 210. Furthermore, multiple terminals 210 and ambient cameras 230 may be connected to the data storage server 240. The details of the configuration of each device are described below.

[0047] Figure 5 is a block diagram showing an example of terminal 210. Terminal 210 has the following hardware components: camera 211, microphone 212, proximity sensor 213, fragrance emitter 214, control unit 215, memory unit 216, and communication unit 217.

[0048] Camera 211 captures images of the user operating the terminal 210 (or a user who can smell the fragrance emitted by the fragrance emission unit 214) based on the detection results of the proximity sensor 213, and corresponds to the user capture unit 101 in Embodiment 1. This camera 211 is intended for acquiring terminal user data using a facial recognition function or the like. The images captured by camera 211 may be still images or videos.

[0049] Microphone 212 acquires ambient sounds around terminal 210 and corresponds to the ambient sound acquisition unit according to Embodiment 1. These ambient sounds include not only sounds originating from the user operating terminal 210, but also sounds originating from the environment, such as people in the vicinity. By analyzing this ambient sound data, it is possible to determine the noise around the terminal and its sources, thereby estimating the environment in which terminal 210 is installed.

[0050] The video data captured by camera 211 and the ambient sound data acquired by microphone 212 are transmitted to the data storage server 240 via communication unit 217 under the control of control unit 215.

[0051] The proximity sensor 213 is composed of an object detection sensor, such as a human presence sensor, and detects whether or not there is a user operating the terminal 210, and outputs the detection result to the control unit 215.

[0052] The fragrance emission unit 214 has multiple fragrances stored in it beforehand. These fragrances can be replaced and added or removed. When the control unit 215 issues an instruction to emit a predetermined fragrance based on the fragrance information determined by the data storage server 240 (described later), the fragrance emission unit 214 can select a fragrance that provides the fragrance indicated by the fragrance control signal based on that instruction and provide the fragrance of that fragrance to the user.

[0053] Furthermore, when providing fragrance, the fragrance release unit 214 may open a shutter that shields the fragrance from the outside air, thereby exposing the fragrance directly to the outside air. Alternatively, the fragrance release unit 214 may have a small fan or sprayer, and the fragrance release unit 214 may have a hardware configuration that controls this device to generate wind or mist, causing the fragrance to flow in the direction of the user captured by the camera 211. As described later, the intensity of the fragrance can be adjusted by adjusting this method of providing fragrance.

[0054] The control unit 215 controls the operation of the camera 211, microphone 212, proximity sensor 213, scent emitter 214, and communication unit 217. For example, when the proximity sensor 213 detects the presence of a user operating the terminal 210, the control unit 215 outputs a control signal to start the operation of the camera 211, microphone 212, and surrounding environment camera 230 based on the detection signal output from the proximity sensor 213. Upon receiving this control signal, the camera 211, microphone 212, and surrounding environment camera 230 start shooting or recording, respectively. The video data and ambient sound data obtained by the operation of the camera 211, microphone 212, and surrounding environment camera 230 are transmitted to the data storage server 240.

[0055] Furthermore, if the proximity sensor 213 changes from detecting the presence of a user operating the terminal 210 to not detecting it, the control unit 215 outputs a control signal to stop the operation of the camera 211, microphone 212, and surrounding environment camera 230 based on the detection signal output from the proximity sensor 213. As a result, the camera 211, microphone 212, and surrounding environment camera 230 stop operating.

[0056] Furthermore, when the control unit 215 receives a fragrance control signal related to a determined fragrance from the data storage server 240, it refers to a table of fragrances stored in the fragrance emission unit 214, which is stored in the storage unit 216, and determines whether a fragrance corresponding to the fragrance control signal is stored in the fragrance emission unit 214. If a fragrance corresponding to the fragrance control signal is stored in the fragrance emission unit 214, the control unit 215 outputs an instruction to the fragrance emission unit 214 to release that fragrance. At this time, the fragrance emission unit 214 selects one or more fragrances from the stored fragrances so that the fragrance indicated by the instruction is released, and releases the fragrance of the selected fragrances to the outside of the terminal 210. For example, if four types of fragrances, A, B, C, and D, are stored in the fragrance emission unit 214, and the fragrance indicated by the fragrance control signal is "A", the control unit 215 instructs the fragrance emission unit 214 to release "A". Furthermore, if the scent indicated by the scent control signal is "A+C", the control unit 215 instructs the scent emission unit 214 to emit "A" and "C".

[0057] Furthermore, if the fragrance control signal contains information indicating the intensity of the fragrance, the control unit 215 controls the intensity of the fragrance emitted by the fragrance emission unit 214 based on that information. For example, if the fragrance indicated by the fragrance control signal is "B: weak," the fragrance can be made weaker by reducing the area of ​​fragrance "B" exposed to the outside air and the amount of mist emitted. On the other hand, if the fragrance indicated by the fragrance control signal is "B: strong," the fragrance can be made stronger by increasing the area of ​​fragrance "B" exposed to the outside air and the amount of mist emitted.

[0058] Furthermore, if the control unit 215 determines, after referring to the table, that the scent indicated by the scent control signal is not stored in the scent emission unit 214, it may control the scent emission unit 214 to emit a predetermined scent if that predetermined scent stored in the scent emission unit 214 is defined as a scent similar to the scent indicated by the scent control signal. For example, suppose the storage unit 216 defines that scent "D" is similar to scent "E" (for example, scents of the same type such as citrus notes or marine notes), and assume that the scent indicated by the scent control signal is "E". In this case, after determining that the fragrance of "E" is not stored, the control unit 215 instructs the scent emission unit 214 to emit "D", which is similar to "E". As a result, the scent emission unit 214 can provide the user with a scent corresponding to the scent control signal from the data storage server 240.

[0059] Furthermore, the scent control signal may indicate not just one type of scent, but multiple types of scents. For example, if the scent control signal indicates multiple types of scents, the control unit 215 may select the scent stored in the scent release unit 214 from among the indicated scents and control it to release that scent. Also, if weights (priorities) are set for multiple types of scents, the control unit 215 may determine whether the scents with heavier weights are stored in the scent release unit 214, and if any of the scents stored in the scent release unit 214 are released, it may control it to release that scent.

[0060] Furthermore, if the proximity sensor 213 changes from detecting the presence of a user operating the terminal 210 to not detecting it, the control unit 215 may control the fragrance release unit 214 to stop providing fragrance based on the detection signal. For example, the control unit 215 may stop the operation of exposing the selected fragrance to the outside air, or it may stop the operation of blowing wind or mist on the user.

[0061] The memory unit 216 stores programs for the processor of the control unit 215 to read and execute. In addition, it may also store data to be temporarily stored in the control of the control unit 215, as well as data used during processing.

[0062] The communication unit 217 is a wireless communication interface for the terminal 210 to communicate with the surrounding environment camera 230 or the data storage server 240. For example, the communication unit 217 transmits a control signal output by the control unit 215 to the surrounding environment camera 230 to start or stop its operation. In addition, the communication unit 217 transmits video data and audio data acquired by the camera 211 and microphone 212 to the data storage server 240, and can also receive a scent control signal indicating a determined scent from the data storage server 240.

[0063] Note that the hardware configuration of the control unit 215, storage unit 216, and communication unit 217 is the same as that of the control unit 121, storage unit 122, and communication unit 123 in Embodiment 1, so a description will be omitted.

[0064] Returning to Figure 4, let's continue the explanation. The surrounding environment camera 230 is installed near the terminal 210 and captures images of the area around the terminal 210. The captured images of the surrounding area are used by the data storage server 240 to determine the ambient light level of the environment around the terminal 210, the level of human congestion (for example, whether there are other users waiting to use the terminal 210 in addition to the user operating the terminal 210), etc. The images captured by the surrounding environment camera 230 may be still images or videos.

[0065] Figure 6 shows the setup of the surrounding environment camera 230. Indoors L, the surrounding environment camera 230 is installed around terminal 210, and the surrounding environment camera 230 captures images of area P. Terminal 210 is operated by user U. If there is another user waiting to use terminal 210, that user will be in area P, and the surrounding environment camera 230 can also capture images of that user. Note that, for example, a surveillance camera intended for terminal 210 can be repurposed and used as the surrounding environment camera 230.

[0066] The data storage server 240 acquires and stores data obtained by the camera 211, microphone 212, and surrounding environment camera 230 when a user approaches and operates the terminal 210. The data storage server 240 can also determine the scent to be provided to the user operating the terminal 210 based on the data, and send a scent control signal to the terminal 210 to provide that scent to the user.

[0067] Figure 7A is a block diagram showing an example of a data storage server 240. The data storage server 240 has a hardware configuration consisting of a control unit 241, a storage unit 242, and a communication unit 243.

[0068] The control unit 241 can determine a scent suitable for the user and their surrounding environment by inputting user video and environmental information data (surrounding video and audio data) acquired from the terminal 210 and the surrounding environment camera 230 via the communication unit 243 into the AI ​​model 244, which will be described later. Details of the functions realized by this control unit 241 will be described later.

[0069] The memory unit 242 stores an AI model 244 for determining the scent to be provided to the user. The memory unit 242 may also store programs for the processor of the control unit 241 to read and execute, data for temporary storage, and data used during processing. For example, the memory unit 242 can store user video and environmental information data acquired from the terminal 210 and the surrounding environment camera 230.

[0070] However, the device on which the AI ​​model 244 is stored may be a separate device from the data storage server 240. Even in this case, by linking data between the storage unit 242 of the data storage server 240 and the AI ​​model 244, the AI ​​model 244 can perform data analysis using the user's video and environmental information data.

[0071] The communication unit 243 is a wireless communication interface for the data storage server 240 to communicate with the terminal 210 or the surrounding environment camera 230. The communication unit 243 can receive user video and environmental information data from the terminal 210 and the surrounding environment camera 230, and can also transmit a scent control signal to the terminal 210 indicating a scent that has been determined to be provided to the user.

[0072] AI model 244 is trained to analyze various data stored in data storage server 240 and determine a scent suitable for the user and their environment. AI model 244 identifies user information, as well as surrounding video and audio from data acquired by terminal 210 and surrounding environment camera 230, and uses the identified data to determine a suitable scent.

[0073] For example, AI model 244 identifies user information from the video data, including facial features, body type, and clothing. Based on the facial and body type information, it determines the user's age and gender, and based on the user's clothing, it determines the user's preferences. Furthermore, based on the user's facial information, AI model 244 determines at least one of the user's physical condition (whether healthy or not) or emotions (stressed, relaxed, irritated, etc.). In addition, based on the surrounding video and audio from terminal 210, AI model 244 determines aspects of the surrounding environment such as brightness, congestion level, and noise level.

[0074] Based on this information, AI model 244 determines a fragrance suitable for the user and the surrounding environment. For example, AI model 244 may determine whether the user belongs to a predefined age group (young, middle-aged, or elderly) or one or more characteristics such as gender or preferences, and select a fragrance appropriate to those characteristics. It may also determine to select a fragrance appropriate to the user's physical condition or emotions. For example, if it determines that the user is tense, AI model 244 may determine to select a fragrance that promotes relaxation.

[0075] Furthermore, AI model 244 can also select a fragrance that matches the characteristics of the surrounding environment. For example, it can determine that it is daytime if the surrounding environment is bright, and nighttime if the surrounding environment is dark, and then select a fragrance appropriate for each situation. It can also determine that if the surrounding environment is crowded (i.e., there are many people around), it will dilute the fragrance provided so that people around it do not perceive the scent too strongly, and if the surrounding environment is not crowded (i.e., there are few people around), it will concentrate the fragrance provided so that the user can fully perceive the scent.

[0076] Furthermore, AI Model 244 may determine a scent to be suitable based on a single scent or multiple scents. When multiple scents are deemed suitable, each scent may be weighted to indicate its degree of suitability.

[0077] Note that the hardware configuration of the control unit 241, storage unit 242, and communication unit 243 is the same as that of the control unit 121, storage unit 122, and communication unit 123 in Embodiment 1, so a description will be omitted.

[0078] Figure 7B is a block diagram showing an example of the functionality of the data storage server 240. The data storage server 240 includes an AI model 244 and an information processing unit 250.

[0079] The information processing unit 250 consists of a processor and other components included in the control unit 241. It reads and executes software (computer programs) from the memory of the storage unit 242, thereby realizing functions such as the data receiving unit 251, data management unit 252, processing execution unit 253, model adjustment unit 254, and data transmission unit 255. Each of these functions will be described below.

[0080] The data receiving unit 251 controls the communication unit 243 to receive data from other devices, and the data management unit 252 determines and manages how to manage the received data. For example, when it receives user video and environmental information data from the terminal 210 and the surrounding environment camera 230, the data management unit 252 determines that the data is for determining the scent to be provided to the user, and controls it to store it in the storage unit 242 and to input it into the AI ​​model 244.

[0081] The processing execution unit 253 determines the scent to be provided to the terminal 210 based on the judgment result of the AI ​​model 244. The processing execution unit 253 and the AI ​​model 244 correspond to the scent determination unit 103 or the scent determination unit 112 in Embodiment 1.

[0082] For example, if the AI ​​model 244 outputs that one type of scent is appropriate as a judgment result, the processing execution unit 253 decides that this scent will be provided to the terminal 210. If the AI ​​model 244 outputs that multiple types of scents are appropriate as a judgment result, the processing execution unit 253 may decide that all of these results will be provided to the terminal 210, or it may use predetermined judgment criteria to select one type of scent from the output results to provide. Furthermore, if multiple types of scents have been weighted, the processing execution unit 253 may decide that all of these results will be provided to the terminal 210, or it may use the weighting values ​​and predetermined judgment criteria to select one type of scent from the output results to provide. The judgment criteria used by the processing execution unit 253 are those for which pre-set thresholds and the like are stored.

[0083] As a hypothetical example, AI model 244 determines, based on the characteristics of the surrounding environment, that there are four types of scents suitable for the surrounding environment: A, B, C, and D. Then, based on the characteristics of the user during operation, it determines that there are four types of scents suitable for this user: A, C, E, and F. In this case, AI model 244 determines that the scents considered preferable for all of the characteristics are the common "A" and "C," and can output at least one of "A" or "C" as the result.

[0084] As another example, AI model 244 determines, based on the characteristics of the surrounding environment, that there are four types of scents suitable for the surrounding environment: A, B, C, and D. Then, based on the characteristics of the user performing the operation, it is assumed that it determines that there are two types of scents suitable for this user: E and F. However, it is stored in memory unit 242 that scent E is similar to scent A. In this case, AI model 244 refers to memory unit 242 and determines that although there are no common scents, scent "E," which is suitable for the user performing the operation, is similar to scent "A," which is suitable for the surrounding environment. Based on this determination, AI model 244 can output at least one of "E" or "A" as the result.

[0085] Furthermore, the AI ​​model 244 may determine an "unsuitable scent" rather than a suitable scent based on at least one of the characteristics of the surrounding environment or the characteristics of the user during operation, and output one or more scents based on that determination. For example, suppose the AI ​​model 244 determines that there are four types of scents suitable for the user during operation, A, C, E, and F, and that there are two types of scents unsuitable for the surrounding environment, E and F, based on the characteristics of the surrounding environment. In this case, the AI ​​model 244 determines that the scents that are suitable for the user during operation and are not expected to cause problems with the surrounding environment are "A" and "C", and can output at least one of "A" or "C" as the result.

[0086] The model adjustment unit 254 modifies the parameters of the AI ​​model 244 to improve its accuracy using data acquired from the terminal 210 and stored in the past. The data transmission unit 255 controls the communication unit 243 to transmit data to other devices. For example, the data transmission unit 255 causes the processing execution unit 253 to determine which terminal 210 should provide information about the scent and transmits this information to the terminal 210 as a scent control signal.

[0087] In the above example, the data storage server 240 was described as a single device, but the data storage server 240 may also be configured as a distributed system of multiple devices.

[0088] Figure 8 is a sequence diagram showing an example of the processing of the fragrance determination system 200. The overall processing flow of the system will be explained below using Figure 8. Details of each process are as described above and will therefore be omitted.

[0089] First, the proximity sensor 213 detects the approach of a user operating the terminal 210 (step S21). Based on this detection result, the control unit 215 outputs control signals to the camera 211 and microphone 212 to start shooting and recording, and also outputs a control signal to the surrounding environment camera 230 via the communication unit 217 to start shooting (step S22).

[0090] Camera 211 captures a video of the user operating the terminal 210 based on a control signal from the control unit 215 (step S23). The captured video is transmitted to the data storage server 240 via the communication unit 217 (step S24).

[0091] Furthermore, the microphone 212 records ambient sounds around the terminal 210 based on control signals from the control unit 215 (step S24). The recorded ambient sounds are transmitted to the data storage server 240 via the communication unit 217 (step S26).

[0092] Furthermore, the surrounding environment camera 230 captures video footage of the area around the terminal 210 based on control signals from the terminal 210 (step S27). The surrounding environment camera 230 transmits the captured video footage to the data storage server 240 (step S28). In this manner, the user's video footage and environmental information data are transmitted to the data storage server 240.

[0093] The data receiving unit 251 of the data storage server 240 receives this data, and the data management unit 252 controls the data to be stored in the storage unit 242 and to be input to the AI ​​model 244. As a result, the user and surrounding environment information stored in the data storage server 240 is updated. Based on the input user video and environment information data, the AI ​​model 244 determines one or more scents that are expected to be suitable for provision. The processing execution unit 253 determines the scent to be provided based on the determination result (step S29). Based on the determination result, the data transmission unit 255 transmits information about the scent to be provided to the terminal 210 as a scent control signal via the communication unit 243 to the terminal 210 (step S30).

[0094] When the control unit 215 of the terminal 210 receives a scent control signal via the communication unit 217, it controls the scent emission unit 214 to emit the scent indicated by the scent control signal (or a similar scent) (step S31).

[0095] Figures 9A and 9B are flowcharts illustrating an example of the processing performed by the fragrance determination system 200. The system's processing will be further explained below.

[0096] First, the terminal 210 initially does not release fragrance from the fragrance release unit 214 and waits for a user to operate the terminal 210 (step S41). In this state, the control unit 215 determines whether or not the proximity sensor 213 detects a user (step S42). If no user is detected (No. in step S42), the control unit 215 returns to step S41 and intermittently performs the determination in step S42.

[0097] If the proximity sensor 213 detects a user (Yes in step S42), the control unit 215 outputs control signals to the camera 211, microphone 212, and surrounding environment camera 230 to initiate operation. This process is as described in step S22. The control unit 215 may also control a display unit (e.g., touch panel) of the terminal 210 (not shown) based on the user detection by the proximity sensor 213 to display the initial ATM transaction screen.

[0098] Based on the control signal from the control unit 215, the camera 211 photographs the user operating the terminal 210 (step S43). The data storage server 240 receives the captured video, and the video is stored in the storage unit 242 by the data management unit 252 (step S44).

[0099] Furthermore, based on the control signal from the control unit 215, the microphone 212 records ambient sounds around the terminal 210 (step S45). The data storage server 240 receives the recorded ambient sound data, and this data is stored in the storage unit 242 by the data management unit 252 (step S46).

[0100] Furthermore, based on the control signal from the control unit 215, the surrounding environment camera 230 captures images of the area around the terminal 210 (step S47). The data storage server 240 receives the captured images, and the images are stored in the storage unit 242 by the data management unit 252 (step S48).

[0101] The AI ​​model 244 determines one or more scents that are deemed suitable for provision based on the acquired user video and environmental information data. Based on this determination, the processing execution unit 253 determines the scent to be provided (step S49). The data transmission unit 255 causes the terminal 210 to send a scent control signal based on the determination result, and the terminal 210 receives it (step S50). The control unit 215 controls the scent emission unit 214 based on the scent control signal and provides the scent to the user detected by the proximity sensor 213 (step S51).

[0102] Furthermore, if the proximity sensor 213 detects that the user has moved away from the terminal 210, the control unit 215 controls the fragrance release unit 214 to stop providing fragrance. However, the processing execution unit 253 of the data storage server 240 may determine that the acquisition of the user's image by the camera 211 has finished and instruct the data transmission unit 255 to send a fragrance control signal to the terminal 210 to stop providing fragrance. Based on this fragrance control signal, the control unit 215 of the terminal 210 stops providing fragrance by the fragrance release unit 214.

[0103] The processes described above are repeated each time the proximity sensor 213 detects that the same or different users have approached the terminal 210. The processes of capturing the user's image and transmitting the user's video, recording ambient sounds and transmitting the recording data, and capturing the surrounding environment and transmitting the video may be performed in any order or simultaneously.

[0104] In recent years, providing users with a scent has become a way to improve customer experience (UX). However, this approach has failed to consider that the users receiving the scent may differ, as well as their surrounding environment (location and usage). For example, when providing a scent to users operating a terminal, the users will vary depending on the time of day and the terminal's location. Therefore, it is expected that the appropriate scent will differ depending on the user's characteristics, such as gender and age. Furthermore, it is conceivable that a daytime scent might be provided when it is nighttime, or a strong scent might be provided when there are many people around the user, potentially causing an unpleasant impression to the user or those around them. Given the variety of users and their surrounding environments, it is considered undesirable to provide a uniform scent.

[0105] In contrast, in the fragrance determination system 200 according to Embodiment 2, the data storage server 240 can determine a fragrance appropriate to the user and surrounding environment based on user and surrounding environment information acquired from the terminal 210 and the surrounding environment camera 230. Therefore, if the user or surrounding environment changes, the fragrance provided by the terminal 210 can also be changed. For example, if the user of the terminal 210 changes from an outdoorsy middle-aged man to a dressy young woman, or if the time of day changes from daytime to nighttime, the terminal 210 can change the fragrance it provides.

[0106] Furthermore, the AI ​​model 244 can determine the user's characteristics based on the captured video of the user, and determine the characteristics of the surrounding environment based on at least one of the surrounding environment's video or ambient sound. Based on each of the determined characteristics, it can then decide which scent to provide to the user. By determining the characteristics of the user and the surrounding environment in this way, the accuracy of providing a scent appropriate to the situation can be improved.

[0107] Furthermore, AI model 244 can determine the scent to provide to the user by using both video and ambient sounds of the surrounding environment. Therefore, by using more information to provide a scent, the accuracy of providing a scent appropriate to the situation can be improved.

[0108] Further variations of this disclosure will be described below with reference to the drawings. These variations can be used in combination as appropriate.

[0109] Embodiment 3 In Embodiment 2, the data storage server 240 acquires not only information from the camera and microphone, but also other types of installation environment information and user information. By inputting this information along with the AI ​​model 244, it is possible to have the AI ​​model determine the optimal scent.

[0110] Figure 10 is a block diagram showing an example of a terminal according to Embodiment 3. In addition to the configuration shown in Figure 5, this terminal 210 also has a measuring sensor 218 and a timing unit 219.

[0111] The measurement sensor 218 is a sensor that acquires environmental information around the terminal 210. The measurement sensor 218 may include, for example, at least one of the following: a temperature sensor for acquiring temperature information, a humidity sensor for acquiring humidity information, a barometric pressure sensor for acquiring atmospheric pressure information, or a body temperature sensor for detecting the body temperature of the user operating the terminal 210. The environmental information measured by the measurement sensor 218 is transmitted to the data storage server 240, along with the video from the camera 211 and the recorded data from the microphone 212. Information about the time period measured by the timing unit 219 is also transmitted to the data storage server 240.

[0112] The data management unit 252 of the data storage server 240 stores this environmental information in the storage unit 242 and also inputs it into the AI ​​model 244. Based on this environmental information, the AI ​​model 244 can determine the characteristics of the surrounding environment. For example, it can determine whether the current environment is hot or cold from the temperature information, whether it is humid or dry from the humidity information, and whether the weather is sunny or rainy from the atmospheric pressure information. This determination can be made, for example, by determining whether the temperature, humidity, or atmospheric pressure is above a predetermined threshold. The AI ​​model 244 can also determine the weather conditions with greater accuracy by using a combination of two or more characteristics from this information.

[0113] Furthermore, AI model 244 can also determine user characteristics based on the user's body temperature. For example, if the user's body temperature is above a predetermined threshold, it can determine that the user has a fever.

[0114] Furthermore, the AI ​​model 244 can also determine whether the terminal 210 is currently in the morning, noon, evening, or night time zone by comparing the current time with information indicating the aforementioned time zones, based on the time information measured by the time timing unit 219.

[0115] The AI ​​model 244 can determine the scent to provide to the user using one or more of the characteristics determined above. For example, if the determined environment is "sunny daytime," it may decide to provide a refreshing scent suitable for this environment. Alternatively, if the user has a fever, it may decide to provide a scent with a relaxing effect. The processing execution unit 253 determines the scent to be provided by the terminal 210 based on the scent determined by the AI ​​model 244. This scent is released by the scent emission unit 214 of the terminal 210 in the same manner as in Embodiment 2. As a result, the terminal 210 can provide a scent that more appropriately reflects the state of the user and the surrounding environment.

[0116] Embodiment 4 Embodiment 4 describes a configuration that reliably switches the fragrance provided by the terminal 210 when the user operating the terminal 210 changes. In Embodiment 2, when the proximity sensor 213 detected that the user had moved away from the terminal 210, the control unit 215 controlled the fragrance release unit 214 to stop providing the fragrance. However, if the provided fragrance remained around the terminal 210 as a so-called lingering scent, the next user operating the terminal 210 might find that scent unpleasant. This embodiment can suppress the occurrence of such a situation.

[0117] Figure 11 is a block diagram showing an example of a terminal according to Embodiment 4. In addition to the configuration shown in Figure 5, this terminal 210 has a fragrance reduction unit 220. The fragrance reduction unit 220 reduces (for example, removes) the fragrance emitted by the fragrance emission unit 214. The fragrance reduction unit 220 may, for example, have a sprayer and spray out chemical components that react with the fragrance emitted by the fragrance emission unit 214 as a mist, thereby reducing the fragrance through a chemical reaction. Alternatively, the fragrance may be reduced by physical action, such as opening a shutter and exposing an air purification filter to the outside air to adsorb fragrance components. Furthermore, the fragrance reduction unit 220 may have a small fan and generate wind by rotating the fan to blow away the air accumulated around the terminal 210, thereby reducing the fragrance.

[0118] In Embodiment 4, when the proximity sensor 213 detects that the user has moved away from the terminal 210, the control unit 215 not only stops the fragrance release by the fragrance release unit 214 but also controls the fragrance reduction unit 220 to reduce the fragrance released by the fragrance release unit 214. In this way, it is possible to prevent the next user operating the terminal 210 from smelling the fragrance that was provided to the previous user. It is also possible to prevent the fragrance provided to the next user operating the terminal 210 from mixing with the fragrance provided previously. As a result, by switching the fragrance for each user, it is possible to reduce the possibility that the next user operating the terminal 210 may experience discomfort due to smelling a fragrance that is not suitable for them.

[0119] As described in Embodiment 2, instead of the proximity sensor 213, the data storage server 240 may detect that the user has moved away from the terminal 210 (ended use of the terminal 210) based on the video from the camera 211, etc. In this case, if the data storage server 240 sends a fragrance control signal to the terminal 210 that stops providing fragrance, the control unit 215 controls the fragrance reduction unit 220 as described above based on that signal.

[0120] Furthermore, if the proximity sensor 213 detects that the same or a different user approaches the terminal 210 after the user has moved away from it, the control unit 215 stops the operation of the fragrance reduction unit 220. The control unit 215 also controls the fragrance release unit 214 to release fragrance based on a fragrance control signal newly acquired from the data storage server 240.

[0121] Embodiment 5 In Embodiment 5, when providing a fragrance, the fragrance is determined by considering not only the user operating the terminal 210, but also the people around them. In particular, in this embodiment, the focus is on the person closest to the user currently operating the terminal (i.e., the user waiting to operate the terminal 210 next).

[0122] (5A) As described above, AI model 244 determines a scent suitable for the user and the surrounding environment based on the user's video and the surrounding video and audio of terminal 210. Here, AI model 244 analyzes the surrounding video of terminal 210 to determine whether there is a user waiting to operate terminal 210. Specifically, in this determination, the surrounding video is analyzed to first determine whether there is a person other than the user currently operating in the surrounding video. If there is a person, the presence or absence of a waiting user is determined by determining whether the distance between that person and the user is below a predetermined threshold, or whether the posture of the other person is moving or waiting. If the surrounding video is a video, AI model 244 may also determine whether the person is a waiting user by determining whether the time the other person does not move is above a predetermined threshold.

[0123] If AI model 244 detects that a user is waiting, it sets the fragrance offered to the user currently operating the device to a weaker level compared to when no such user is present. This is because it is anticipated that a fragrance tailored to the user will be offered to the waiting user later, and therefore, the model makes it less likely for that user to perceive the fragrance corresponding to the currently operating user. This reduces the possibility that the next user operating terminal 210 might experience discomfort due to a fragrance unsuitable for them.

[0124] Furthermore, as shown in Figure 11, the terminal 210 may also have a fragrance reduction unit 220. In this case, by setting the fragrance provided to the user during operation to a low level, it becomes easier to reduce the fragrance when the user moves away from the terminal 210.

[0125] (5B) Furthermore, if AI model 244 determines that there is a waiting user, it may also determine the characteristics of that user. Since this characteristic determination is done in the same way as the determination of the characteristics of an active user, the explanation will be omitted. After determining the characteristics of the waiting user, AI model 244 may make a comprehensive judgment on the most suitable scent based on the characteristics of the waiting user, the characteristics of the active user, and the characteristics of the surrounding environment. The details of this judgment will be explained below.

[0126] As a hypothetical example, AI model 244 determines that there are four types of scents, A, B, C, and D, that are suitable for the surrounding environment based on its characteristics. Then, based on the characteristics of the user currently operating the system, it determines that there are four types of scents, A, C, E, and F, that are suitable for this user. And based on the characteristics of the user in standby mode, it determines that there are three types of scents, A, F, and G, that are suitable for this user. In this case, AI model 244 determines that the scent that is considered preferable for all characteristics is "A," which is common to all three users, and can therefore determine that "A" is the overall most suitable scent.

[0127] As another example, let's assume that AI model 244 determines, based on the characteristics of the surrounding environment, that there are four types of scents, A, B, C, and D, that are suitable for the surrounding environment. Then, based on the characteristics of the user currently operating the system, it determines that there are four types of scents, A, C, E, and F, that are suitable for this user, and based on the characteristics of a user in standby mode, it determines that there are three types of scents, F, G, and H, that are suitable for this user. However, it is stored in memory unit 242 that scent H is similar to scent A. In this case, AI model 244 refers to memory unit 242 and determines that although there is no scent common to all three, scent "A," which is suitable for both the surrounding environment and the user currently operating the system, is similar to scent "H," which is suitable for the characteristics of the user in standby mode. Based on this determination, AI model 244 can determine that at least one of "A" or "H" is the most suitable scent overall.

[0128] Furthermore, the AI ​​model 244 may determine an "unsuitable scent" rather than a suitable scent based on at least one of the characteristics of the surrounding environment, the characteristics of the user during operation, or the characteristics of the user while waiting, and then make an overall determination of a suitable scent based on that determination.

[0129] For example, AI model 244 determines that there are four types of scents, A, B, C, and D, that are suitable for the surrounding environment based on the characteristics of the surrounding environment. Then, based on the characteristics of the user currently operating the system, it determines that there are four types of scents, A, C, E, and F, that are suitable for this user. And based on the characteristics of the user in standby mode, it determines that there are two types of scents, A and I, that are unsuitable for this user. In this case, AI model 244 determines that, among the scents suitable for the characteristics of the surrounding environment and the user currently operating the system, "A" is unsuitable for the standby user, while "C" is not unsuitable for the standby user, and therefore determines that "C" is the most suitable scent overall.

[0130] The process described above, which determines an "unsuitable scent" for at least one of the characteristics of the surrounding environment, the characteristics of the user in operation, or the characteristics of the user in standby, and determines a "suitable scent" for the others, and then determines an overall suitable scent based on these determinations, may be performed from the beginning when determining the scent. Alternatively, the AI ​​model 244 may determine suitable scents for the characteristics of the user in operation, the characteristics of the user in standby, and the characteristics of the surrounding environment, and if there is no common scent for the three, or if there is no common scent even when similar scents are included for each of the three, it may perform the above process.

[0131] For example, AI model 244 determines, based on the characteristics of the surrounding environment, that there are four types of scents suitable for the surrounding environment: A, B, C, and D, and that G and H are similar to any of these. Then, based on the characteristics of the user currently operating the system, it determines that there are four types of scents suitable for this user: A, C, E, and F, and that I and J are similar to any of these. Furthermore, based on the characteristics of the user in standby mode, it determines that there are two types of scents suitable for this user: K and L, and that M and N are similar to any of these. At this point, AI model 244 determines that, for all characteristics, there are no common scents, even when similar scents are included. At this point, AI model 244 determines that there are two types of scents unsuitable for the standby user: A and I, and therefore, as described above, determines that "C" is the overall suitable scent. In this case, in order to provide a fragrance that is expected to be favored by the user during operation, it is preferable to determine a "suitable fragrance" (or a similar fragrance) for the user during operation, determine an "unsuitable fragrance" for at least one of the characteristics of the surrounding environment or the characteristics of the user in standby mode, and then determine an overall suitable fragrance based on these results.

[0132] Furthermore, it may be determined that there is only one suitable or unsuitable scent for at least one of the characteristics of the user during operation, the user in standby mode, or the surrounding environment, rather than multiple suitable or unsuitable scents. In this case as well, the same processing as described above is possible.

[0133] Furthermore, AI model 244 may determine whether a scent is suitable or unsuitable based on either the characteristics of the surrounding environment or the characteristics of the user during operation, or it may determine whether a scent is suitable or unsuitable based on the characteristics of a user in standby mode, and then make an overall determination of a suitable scent based on the results of that determination.

[0134] By making the above determinations, the AI ​​model 244 can determine and output a fragrance that is suitable not only for the user operating the device, but also for the surrounding environment or the user operating the device, or a fragrance that will not cause discomfort. The processing execution unit 253 determines the fragrance to be emitted by the terminal 210 based on this determination result, so that the terminal 210 can emit a fragrance that takes into account not only the user operating the device, but also the surrounding environment or the user operating the device. Furthermore, even if the emitted fragrance remains when the user operates the terminal 210, it is assumed that the fragrance provided according to the user operating the device and the lingering fragrance will be similar, thus reducing the likelihood of discomfort even if the two are mixed.

[0135] (5C) As a variation of (5B), terminal 210 may have a fragrance reduction unit 220, as shown in Figure 11. In this case, if the fragrance that AI model 244 determines to be an overall suitable fragrance is suitable for the user currently operating the device (or a similar fragrance) and also suitable for the user in standby mode (or a similar fragrance), the processing execution unit 253 may decide to provide the fragrance that AI model 244 determined to be overall suitable to the user in standby mode as well. In this case, the processing execution unit 253, in the fragrance control signal output to terminal 210, instructs, along with the fragrance information, to continue providing the fragrance even after the user currently operating the device leaves terminal 210. Based on this signal, the control unit 215 of terminal 210 controls the fragrance emission unit 214 so that even if the user currently operating the device leaves terminal 210 via the proximity sensor 213, the fragrance reduction unit 220 is not activated, and the fragrance provided based on the fragrance control signal is provided as is. As a result, even when a user in standby mode starts operating terminal 210, that user can experience their preferred fragrance. Furthermore, since unnecessary operation of the fragrance reduction unit 220 can be suppressed, energy saving effects can be achieved.

[0136] Furthermore, in this state, if the proximity sensor 213 detects that a waiting user has approached terminal 210 and begun operation, the surrounding environment camera 230 may also capture images of another waiting user. In this case, the data storage server 240 acquires the video of the surrounding environment captured by the new user, and the AI ​​model 244 determines a fragrance that is comprehensively suitable for the next user and the surrounding environment based on that information and ambient sound information. If the determined fragrance (or a similar fragrance) is the same as the fragrance currently provided by terminal 210, the processing execution unit 253 may, in the fragrance control signal output to terminal 210 next, instruct the fragrance information to continue providing that fragrance even after the user who is operating the terminal 210 has left terminal 210. Otherwise, if the user who is operating the terminal 210 has left terminal 210, the control unit 215 operates the fragrance reduction unit 220 as described in Embodiment 4, based on the fact that the proximity sensor 213 no longer detects a user. Furthermore, the processing execution unit 253 can include information about a different scent from the previously provided scent in the scent control signal output to the terminal 210, so that the terminal 210 will provide a different scent. Subsequently, even if different users wait in sequence to operate the terminal 210, by repeating this process, the terminal 210 can provide a scent corresponding to each user, and unnecessary operation of the scent reduction unit 220 can be suppressed.

[0137] Embodiment 6 Since terminal 210 is installed in a public place, it may be subjected to intentional or unforeseen harm (for example, by a user vomiting or damaging it due to intoxication). In this embodiment, the possibility of terminal 210 being in such a state is suppressed.

[0138] For example, AI model 244 determines, based on the user's image captured by camera 211, whether the user is likely to harm terminal 210 (for example, whether they are attempting to cause damage through violence or vomiting). This determination is based on at least one of the following: a determination based on the user's face (for example, whether they are intoxicated) or a determination based on the user's actions (for example, whether they are staggering or making violent movements). If it is determined that the user is attempting to cause harm, AI model 244 determines that a smell that the user finds unpleasant is an appropriate scent for this situation. Processing execution unit 253 decides to provide this scent to the user and transmits a scent control signal indicating that scent to terminal 210 via data transmission unit 255.

[0139] The control unit 215 of the terminal 210 controls the fragrance emitter 214 based on the fragrance control signal, and emits an unpleasant odor. At this time, the fragrance emitter 214 is pre-stored with a fragrance that is perceived as an unpleasant odor, and the fragrance emitter 214 emits this fragrance in the same manner as when emitting other types of fragrances. As a result, it is expected that a user approaching the terminal 210 will feel uncomfortable with the odor and move away from the terminal 210. Therefore, the possibility of the terminal 210 being harmed can be suppressed. Furthermore, if the proximity sensor 213 detects that a user who has been determined to be attempting to cause harm has moved away from the terminal 210, the control unit 215 may stop the fragrance emitter 214 from providing the fragrance. In addition, the control unit 215 may also control the fragrance reduction unit 220 according to Embodiment 4 to reduce the unpleasant odor emitted by the fragrance emitter 214. The same control as in Embodiment 4 can be performed for this fragrance reduction unit 220.

[0140] Furthermore, when AI model 244 determines whether a user approaching terminal 210 is attempting to harm terminal 210, it may perform the determination not only based on the user's image captured by camera 211, but also by using at least one of the surrounding environment images captured by surrounding environment camera 230 or ambient sound information recorded by microphone 212. For example, AI model 244 may also acquire information about people in the vicinity of terminal 210 in addition to the user approaching terminal 210 from the surrounding environment images, and based on that information, determine whether the user approaching terminal 210 and the people in the vicinity are attempting to harm terminal 210. Alternatively, AI model 244 may determine, based on ambient sound information recorded by microphone 212, that a user approaching terminal 210 is attempting to vomit or perform other actions.

[0141] However, if the AI ​​model 244 determines that the user is about to vomit, it may select a scent that suppresses vomiting and release that scent from the scent release unit 214, as described in Embodiment 2.

[0142] Embodiment 7 Embodiment 7 describes a method by which the terminal 210 presents fragrance-related advertisements to the user when providing the fragrance to the user.

[0143] Figure 12 is a block diagram showing an example of a terminal according to Embodiment 7. Compared to the configuration shown in Figure 5, this terminal 210 further includes a display unit 221 and a speaker 222. The display unit 221 and speaker 222 are for presenting visual and audio information of advertisements to the user, respectively. The display unit 221 and speaker 222 may also perform other functions of the terminal 210 (for example, ATM-related functions). The display unit 221 is composed of, for example, a display or a touch panel.

[0144] Figure 13 is a block diagram showing an example of the information processing unit of a data storage server according to Embodiment 7. Compared to the configuration shown in Figure 7B, the information processing unit 250 further includes an advertisement presentation control unit 256. This advertisement presentation control unit 256 determines the advertisement to be presented from the terminal 210 as follows.

[0145] The memory unit 242 stores advertisements associated with the fragrances that the terminal 210 can provide. The advertisements may promote perfumes that provide that fragrance, or they may promote products, services, facilities, etc., that correspond to the type of fragrance. For example, if the fragrance is floral, advertisements may be for botanical gardens, orchards, vineyards, massage salons, or detergents; if it's marine, advertisements may be for leisure facilities such as the sea, swimming pools, or aquariums; if it's woody, advertisements may be for campsites; and if it's sweet, advertisements may be for sweet products that will be released soon. In this example, advertisements may be for things that can be associated with each fragrance. In this example, the advertisements are said to consist of visual and auditory information, but they may consist of at least one of either visual or auditory information. This advertisement information can also be updated automatically or manually.

[0146] When the processing execution unit 253 determines the scent to be presented to the terminal 210 based on the judgment result of the AI ​​model 244, the advertising presentation control unit 256 retrieves the content of the advertisement related to the determined scent by searching the storage unit 242. The advertising presentation control unit 256 controls the data transmission unit 255 to transmit the advertisement information along with the scent control signal to the terminal 210.

[0147] When the control unit 215 of the terminal 210 receives advertising information via the communication unit 217, it presents that advertising information to the user via the display unit 221 and speaker 222. This not only allows the user to experience the fragrance but also enables the presentation of advertisements, which can lead to the promotion of commercial transactions.

[0148] Furthermore, even if the scent is the same, the content of the advertisements stored in the memory unit 242 may differ based on at least one of the following characteristics: age, gender, or preferences. The advertisement display control unit 256 decides which of the multiple types of advertisements to display to the user based on the characteristics of the user during operation determined by the AI ​​model 244. For example, even when providing the same marine scent to the user, the advertisement display control unit 256 may decide to display advertisements for surfboards if the user is in their 20s, and advertisements for family-friendly facilities such as aquariums if the user is in their 40s. In addition, the advertisement display control unit 256 may decide to display advertisements for products other than alcohol if the user is a minor, and advertisements for alcohol if the user is 20 years of age or older. This makes it possible to provide advertisements that are more suitable to the user's characteristics.

[0149] Furthermore, the content of the advertisements stored in the memory unit 242 may differ depending on the time of day the advertisement is provided, even if the scent is the same. For example, even with the same citrus scent, the advertisement display control unit 256 may decide to advertise food products such as sweets if the advertisement is provided during a predetermined time period, and to advertise non-food products at other times. The predetermined time periods are, for example, daytime hours (e.g., 11am-1pm), snack time (e.g., 3pm-4pm), and evening hours (e.g., 5pm-8pm). By providing advertisements tailored to the time of day in this way, it is possible to further increase the user's purchasing intent for the advertised products and enhance the effectiveness of the advertisements.

[0150] Alternatively, instead of advertising information related to the scent, visual information of a scent-related scene may be stored in the storage unit 242. In this case as well, the advertising display control unit 256 can transmit the determined visual information of the scent-related scene to the terminal 210 as described above, allowing the terminal 210 to present the scene to the user along with the scent.

[0151] Embodiment 8 Embodiment 8 further describes how the model adjustment unit 254 adjusts the AI ​​model 244.

[0152] Figure 14 is a block diagram showing an example of a terminal according to Embodiment 8. Compared to the configuration shown in Figure 5, this terminal 210 further includes a display unit 221 and an input unit 223. The display unit 221 displays questionnaire information about scents transmitted from the data storage server 240, as described later. The input unit 223 is an interface in which the user inputs answers to the displayed questionnaire. The input unit 223 may be configured as, for example, a numeric keypad. Alternatively, the display unit 221 and the input unit 223 may be integrated as a touch panel. Furthermore, the terminal 210 may further include a speaker 222 as shown in Embodiment 7. The speaker 222 outputs, for example, voice prompts for inputting the questionnaire about scents.

[0153] Figure 15 is a block diagram showing an example of the information processing unit of a data storage server according to Embodiment 8. Compared to the configuration shown in Figure 7B, the information processing unit 250 further includes a questionnaire display control unit 257. This questionnaire display control unit 257 controls the terminal 210 to display the questionnaire as follows.

[0154] The questionnaire display control unit 257 acquires the questionnaire information stored in the memory unit 242 when the processing execution unit 253 determines the scent to be presented by the terminal 210 based on the judgment result of the AI ​​model 244. The questionnaire display control unit 257 controls the data transmission unit 255 to transmit the questionnaire information along with the scent control signal to the terminal 210.

[0155] When the control unit 215 of terminal 210 receives survey information via the communication unit 217, it presents the survey information to the user via the display unit 221. In other words, terminal 210 displays a survey about the scent provided by the scent emission unit 214 to the user. The user inputs their answers to the survey about the scent they experienced using the input unit 223. The input answers are transmitted to the data storage server 240 via the communication unit 217.

[0156] The data management unit 252 of the data storage server 240 stores the response information received by the communication unit 243 in the storage unit 242. The model adjustment unit 254 then adjusts the AI ​​model 244 based on this response information. In this way, the AI ​​model 244 is adjusted based on user feedback, thereby improving the accuracy of the model.

[0157] Furthermore, if multiple terminals 210 are connected to the data storage server 240, the model adjustment unit 254 can obtain questionnaire responses from each acquired terminal 210 and adjust the AI ​​model 244 based on them. Since the multiple terminals 210 are expected to be placed in different installation environments, the data obtained will be multifaceted. Therefore, the accuracy of the model can be further improved.

[0158] It should be noted that the present invention is not limited to the embodiments described above, and can be modified as appropriate without departing from the spirit of the invention. For example, the following variations are further conceivable.

[0159] Terminal 210 can be implemented not only as an ATM, but also as a digital signage terminal, a vending machine, a terminal capable of VR (Virtual Reality) experiences, etc. In such a terminal, when advertising the advertisement presented in Embodiment 7, terminal 210 may display a map of locations related to the advertisement that is provided to the user. This map information is stored in the storage unit 242 along with the advertisement information, and the processing execution unit 253 acquires this map information at the same time as acquiring the advertisement information from the storage unit 242, and outputs the advertisement information including this information, along with the fragrance control signal, to terminal 210.

[0160] In embodiments 2 to 8, the presence or absence of a user in close proximity to the terminal 210 may be determined by the control unit 215 based on whether or not an input unit mounted on the terminal 210 (for example, the input unit 223 in embodiment 8) has been operated, rather than by the proximity sensor 213. For example, if the input unit has been operated, the control unit 215 determines that a user is in close proximity to the terminal 210, and if a predetermined time has elapsed since the last operation of the input unit, it determines that there is no longer a user in close proximity to the terminal 210.

[0161] The AI ​​model 244 may determine the environment in which the terminal 210 is installed based on the location information of the terminal 210 on a map, rather than on the surrounding environment information acquired from the microphone 212 and the surrounding environment camera 230. This location information may be stored in the memory unit 242 in advance, or it may be acquired by GPS (Global Positioning System), etc. Based on this determination, the AI ​​model 244 can determine a scent suitable for the surrounding environment, as described above.

[0162] In the fragrance determination systems described in Embodiments 2 to 8, any function of the data storage server 240 may be installed within the terminal 210. For example, the terminal 210 alone can acquire user video and surrounding environment information using the installed camera 211, microphone 212, surrounding environment camera 230, etc., input this information into the AI ​​model 244 stored inside the terminal 210 to determine a fragrance to provide to the user, and then provide that fragrance to the user using the fragrance emission unit 214. Furthermore, by connecting to other terminals that perform similar operations, the terminal 210 can acquire AI model data from other terminals and adjust its own AI model 244 using the functions of the model adjustment unit 254.

[0163] As another example, in the scent determination system 200, at least one of the components of camera 211 to scent emission unit 214 and measurement sensor 218 to input unit 223 may not be provided as components of terminal 210, but as a separate device from terminal 210. Furthermore, in the scent determination system 200, terminal 210 may not be provided, and any component of camera 211 to scent emission unit 214 and measurement sensor 218 to input unit 223 may be provided as a standalone device. In this case, camera 211 captures a user near scent emission unit 214, and microphone 212 and surrounding environment camera 230 acquire information about the surrounding environment of scent emission unit 214 (ambient sound and video). The data storage server 240 then determines the scent as described above, and the scent emission unit 214 can emit the determined scent. This allows visitors to enjoy scents that suit their characteristics and environment, for example, in a facility where VR experiences are available.

[0164] Some or all of the above embodiments may also be described as follows, but are not limited to the following: (Note 1) The first shooting unit photographs the user, At least one of the following: a second imaging unit that captures the surrounding environment of the user, or an ambient sound acquisition unit that acquires ambient sounds around the user; A fragrance determination unit determines a fragrance to be provided to the user based on at least one of the following: the image of the user captured by the first imaging unit, the image of the surrounding environment captured by the second imaging unit, or the ambient sound acquired by the ambient sound acquisition unit. A fragrance determination system equipped with the following features. (Note 2) The fragrance determination unit determines the user's characteristics based on the user's image captured by the first imaging unit, and determines the characteristics of the surrounding environment based on at least one of the surrounding environment's image captured by the second imaging unit or the surrounding environment's sound acquired by the ambient sound acquisition unit. Based on the determined user characteristics and surrounding environment characteristics, the unit determines the fragrance to be provided to the user. The fragrance determination system described in Appendix 1. (Note 3) The fragrance determination system comprises at least the second imaging unit among the second imaging unit and the ambient sound acquisition unit, The second imaging unit photographs another user who is in the vicinity of the user, The fragrance determination unit determines the characteristics of the user based on the image of the user captured by the first imaging unit, and determines the presence of another user based on the image of another user captured by the second imaging unit, and determines the fragrance to be provided to the user based on the determination results of the user's characteristics and the presence of another user. The fragrance determination system described in Appendix 1. (Note 4) The aforementioned fragrance determination system is A fragrance providing unit provides the fragrance determined by the fragrance determination unit to the user, The system further comprises a fragrance reduction unit that reduces the fragrance provided by the fragrance providing unit, The first imaging unit images the user using a predetermined terminal, The second imaging unit photographs the other user who is waiting to use the predetermined terminal, The fragrance determination unit determines the characteristics of the other user based on the video of the other user captured by the second shooting unit, and if it determines that the fragrance to be provided to the other user based on the characteristics of the other user is suitable for the other user, it controls the fragrance reduction unit not to operate when the user finishes using the predetermined terminal. The fragrance determination system described in Appendix 3. (Note 5) The fragrance determination unit determines, when another user is present, to dilute the fragrance provided to that user compared to when the other user is not present. The fragrance determination system described in Appendix 3 or 4. (Note 6) The fragrance determination unit determines, based on the determined user characteristics, at least one of a first fragrance suitable for the user or a second fragrance similar to the first fragrance, and based on the determined characteristics of another user, at least one of a third fragrance suitable for the other user or a fourth fragrance similar to the third fragrance, and determines the fragrance common to the first or second fragrance and the third or fourth fragrance as the fragrance to be provided to the user. A fragrance determination system as described in any one of the items 3 to 5 of the appendix. (Note 7) The first imaging unit images the user using a predetermined terminal, The fragrance determination unit, based at least on the image of the user captured by the first imaging unit, determines that the user may pose a risk to the predetermined terminal, and then decides to provide the user with an unpleasant odor. A fragrance determination system as described in any one of the items 1 to 6 of the appendix. (Note 8) The system further includes an advertising display control unit that controls the display of advertisements related to the fragrance determined by the fragrance determination unit to be provided to the user to a predetermined terminal used by the user. A fragrance determination system as described in any one of the items 1 through 7 of the appendix. (Note 9) A fragrance providing unit provides the fragrance determined by the fragrance determination unit to the user, A questionnaire display control unit controls a predetermined terminal used by the user to display a questionnaire about the fragrance provided by the fragrance supply unit to the user. The system further includes an adjustment unit that adjusts a model for determining the scent that the scent determination unit provides to the user based on the answers to the questionnaire obtained from the predetermined terminal, A fragrance determination system as described in any one of the appendices 1 to 8. (Note 10) The fragrance determination system comprises both the second imaging unit and the ambient sound acquisition unit. The fragrance determination unit determines the fragrance to be provided to the user based on the image of the user captured by the first shooting unit, the image of the surrounding environment captured by the second shooting unit, and the ambient sound acquired by the ambient sound acquisition unit. A fragrance determination system as described in any one of the items 1 through 9 of the appendix. (Note 11) An acquisition unit that acquires video footage of the user, and video footage of the user's surrounding environment or ambient sounds around the user, A fragrance determination unit that determines a fragrance to be provided to the user based on the captured video of the user and at least one of the video of the surrounding environment or the ambient sound, A fragrance determination device equipped with the following features. (Note 12) The fragrance determination unit determines the user's characteristics based on the user's video, and determines the characteristics of the surrounding environment based on at least one of the surrounding environment's video or ambient sound, and determines a fragrance to be provided to the user based on the determined user characteristics and surrounding environment characteristics. The fragrance determination device described in Appendix 11. (Note 13) The system acquires video footage of the user, as well as video footage of the user's surrounding environment or ambient sounds from the user's surroundings. Based on the captured video of the user and at least one of the video of the surrounding environment or the ambient sound, the fragrance to be provided to the user is determined. A method for determining scents that a computer uses. (Note 14) The system acquires video footage of the user, as well as video footage of the user's surrounding environment or ambient sounds from the user's surroundings. Based on the captured video of the user and at least one of the video of the surrounding environment or the ambient sound, the fragrance to be provided to the user is determined. A program that causes a computer to perform a task.

[0165] While the present disclosure has been described above with reference to embodiments, the present disclosure is not limited thereto. Various modifications to the structure and details of the present disclosure may be made that can be understood by those skilled in the art within the scope of the disclosure. [Explanation of symbols]

[0166] 100 Scent Determination System 101 User Image Capture Unit 102 Environmental Information Acquisition Unit 103 Fragrance determination unit 110 Aroma Determination Device 111 Acquisition unit 112 Fragrance determination unit 120 Information Processing Devices 121 Control unit 122 Memory unit 123 Communications Department 200 Scent Determination System 210 terminals 211 Camera 212 Microphone 213 Proximity sensor 214 Fragrance emitter 215 Control unit 216 Memory unit 217 Communication Unit 218 Measurement Sensor 219 Timer 220 Fragrance reduction unit 221 Display unit 222 Speaker 223 Input section 230 Surrounding Environment Cameras 240 Data Storage Servers 241 Control unit 242 Memory unit 243 Communications Department 244 AI Model 250 Information Processing Unit 251 Data receiving unit 252 Data management unit 253 Processing execution unit 254 Model adjustment unit 255 Data transmission unit 256 Advertisement display control unit 257 Questionnaire Display Control Unit

Claims

1. A first imaging unit for photographing a user using a predetermined terminal, A second shooting unit that photographs another user waiting to use the aforementioned terminal, A fragrance determination unit that determines a fragrance to be provided to the user based on the image of the user captured by the first shooting unit and the image of another user captured by the second shooting unit, A fragrance providing unit provides the fragrance determined by the fragrance determination unit to the user, The system includes a fragrance reduction unit that reduces the fragrance provided by the fragrance providing unit, The aforementioned fragrance determination unit is Based on the image of the user captured by the first camera unit, the characteristics of the user are determined, and based on the image of another user captured by the second camera unit, the presence of the other user is determined, and based on the determination of the user's characteristics and the presence of the other user, the fragrance to be provided to the user is determined. Based on the video of the other user captured by the second shooting unit, the characteristics of the other user are determined, and if it is determined that the fragrance to be provided to the user based on the characteristics of the other user is suitable for the other user, the fragrance reduction unit is controlled not to operate when the user finishes using the predetermined terminal. Scent determination system.

2. A first imaging unit for photographing a user using a predetermined terminal, At least one of the following: a second imaging unit that captures the surrounding environment of the user, or an ambient sound acquisition unit that acquires ambient sounds around the user; The system includes a fragrance determination unit that determines a fragrance to be provided to the user based on at least one of the following: the image of the user captured by the first imaging unit, and the image of the surrounding environment captured by the second imaging unit or the ambient sound acquired by the ambient sound acquisition unit. The fragrance determination unit, based at least on the image of the user captured by the first imaging unit, determines that the user may pose a risk to the predetermined terminal, and then decides to provide the user with an unpleasant odor. Scent determination system.

3. The fragrance determination unit determines the user's characteristics based on the image of the user captured by the first imaging unit, and determines the characteristics of the surrounding environment based on at least one of the image of the surrounding environment captured by the second imaging unit or the ambient sound acquired by the ambient sound acquisition unit, and determines a fragrance to be provided to the user based on the determined user characteristics and the characteristics of the surrounding environment. The fragrance determination system according to claim 2.

4. The system further includes an advertising display control unit that controls the predetermined terminal to display advertisements related to the fragrance determined by the fragrance determination unit to be provided to the user. A fragrance determination system according to any one of claims 1 to 3.

5. A questionnaire display control unit controls the predetermined terminal to display a questionnaire regarding the fragrance provided based on the determination of the fragrance determination unit to the user, The system further includes an adjustment unit that adjusts a model for determining the scent that the scent determination unit provides to the user based on the answers to the questionnaire obtained from the predetermined terminal, A fragrance determination system according to any one of claims 1 to 4.

6. An acquisition unit that acquires video of a user using a predetermined terminal and video of another user waiting to use the predetermined terminal, The system includes a fragrance determination unit that determines a fragrance to be provided to the user based on the video of the user and the video of another user, The aforementioned fragrance determination unit is Based on the video of the aforementioned user, the characteristics of the aforementioned user are determined, and based on the video of the aforementioned other user, the presence of the aforementioned other user is determined, and based on the determination results of the characteristics of the aforementioned user and the presence of the aforementioned other user, the fragrance to be provided to the aforementioned user is determined. Based on the video of the other user, the characteristics of the other user are determined, and if it is determined that the fragrance to be provided to the user, determined based on the characteristics of the other user, is suitable for the other user, then it is decided not to reduce the fragrance provided to the user when the user finishes using the predetermined terminal. Scent determination device.

7. An acquisition unit that acquires video of a user using a predetermined terminal, and video of the user's surrounding environment or ambient sound around the user, The system includes a fragrance determination unit that determines a fragrance to be provided to the user based on the user's video and at least one of the video of the surrounding environment or the ambient sound, The fragrance determination unit, based at least on the user's video, determines that the user may harm the predetermined terminal, and then decides to provide the user with an unpleasant odor. Scent determination device.

8. Obtain video of a user using a predetermined terminal, and video of another user waiting to use the predetermined terminal, Based on the video of the aforementioned user, the characteristics of the aforementioned user are determined, and based on the video of the aforementioned other user, the presence of the aforementioned other user is determined, and based on the determination results of the characteristics of the aforementioned user and the presence of the aforementioned other user, the fragrance to be provided to the aforementioned user is determined. Based on the video of the other user, the characteristics of the other user are determined, and if it is determined that the fragrance to be provided to the user, determined based on the characteristics of the other user, is suitable for the other user, then it is decided not to reduce the fragrance provided to the user when the user finishes using the predetermined terminal. A method for determining scents that a computer uses.

9. Acquire video of a user using a predetermined terminal, and video of the user's surrounding environment or ambient sound around the user. Based on the video of the user and at least one of the video of the surrounding environment or the ambient sound, the fragrance to be provided to the user is determined. If it is determined, at least based on the user's video, that the user may harm the predetermined terminal, it is decided to provide the user with an unpleasant odor. A method for determining scents that a computer uses.

10. Obtain video of a user using a predetermined terminal, and video of another user waiting to use the predetermined terminal, Based on the video of the aforementioned user, the characteristics of the aforementioned user are determined, and based on the video of the aforementioned other user, the presence of the aforementioned other user is determined, and based on the determination results of the characteristics of the aforementioned user and the presence of the aforementioned other user, the fragrance to be provided to the aforementioned user is determined. Based on the video of the other user, the characteristics of the other user are determined, and if it is determined that the fragrance to be provided to the user, determined based on the characteristics of the other user, is suitable for the other user, then it is decided not to reduce the fragrance provided to the user when the user finishes using the predetermined terminal. A program that causes a computer to perform a task.

11. Acquire video of a user using a predetermined terminal, and video of the user's surrounding environment or ambient sound around the user. Based on the video of the user and at least one of the video of the surrounding environment or the ambient sound, the fragrance to be provided to the user is determined. If it is determined, at least based on the user's video, that the user may harm the predetermined terminal, it is decided to provide the user with an unpleasant odor. A program that causes a computer to perform a task.

Images