Aroma control device, aroma control method. and aroma control program

Abstract

To effectively guide a user's line of sight to a display object using aroma.SOLUTION: An aroma control device includes an estimation part and a determination part. The estimation part estimates a user's recognition degree of aroma of a second display object which is different from a first display object being viewed by the user, the second display object allowing the user's line of sight to be guided thereto. The determination part decides whether to present the aroma to the user according to the recognition degree estimated by the estimation part and matching degree between an image on a display screen of the first display object and the aroma.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an aroma control device, an aroma control method, and an aroma control program. [Background technology]

[0002] Olfactory stimulation by presenting scents along with the video is one of the most important sensory stimuli for stimulating the five senses of the user viewing the video and enhancing the sense of realism of the video.

[0003] Furthermore, in recent years, virtual technologies such as VR (Virtual Reality) and the Metaverse have been rapidly developing, and technologies such as digital twins, which recreate the real world in a virtual space, and full-dives, which immerse the user's entire consciousness in a virtual world, have been attracting attention. If olfactory stimulation were possible during a user's virtual experience, it is thought that the sense of immersion in the virtual space could be dramatically improved.

[0004] Conventionally, there is known a technology that presents scents in conjunction with video. There is also known a technology that uses the technology that presents scents in conjunction with video to encourage a user's exploration behavior. For example, there is known a technology that encourages a user's exploration behavior by presenting scents inconsistently in a video in which multiple display objects are displayed together (see Non-Patent Document 1 below). [Prior art documents] [Non-patent literature]

[0005] [Non-Patent Document 1] Keisuke Banno, Mana Tanaka, Yutaka Ishibashi, Akira Banno, "Gaze Characteristics of Digital Signage Displaying Scented Food Images," IEICE Transactions on Electronics, Information and Communication Engineers, Vol. J106-C, No. 7, pp. 277-288, July 2023 Summary of the Invention [Problem to be solved by the invention]

[0006] However, conventional techniques have not been able to effectively guide the user's gaze to the display target, which is the conflicting target of the conflicting scent presentation.

[0007] The present application has been made in view of the above, and aims to use scent to effectively guide the user's gaze to a displayed object. [Means for solving the problem]

[0008] The fragrance control device of the present application is characterized by having an estimation unit that estimates a user's awareness of the scent of a second display object, which is a display object that is different from a first display object that the user is visually viewing and is a display object to which the user's gaze should be directed, and a decision unit that decides to present the scent to the user based on the awareness estimated by the estimation unit and the degree of matching between the image on the display screen of the first display object and the scent. [Effects of the Invention]

[0009] According to one aspect of the embodiment, it is possible to effectively guide the user's gaze to a displayed object using a scent. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of the fragrance control device according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of a user information storage unit according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a display target information storage unit according to the embodiment. [Figure 5] FIG. 5 is a flowchart showing the procedure of information processing by the information processing system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Below, modes for implementing the fragrance control device, fragrance control method, and fragrance control program according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. Note that the fragrance control device, fragrance control method, and fragrance control program according to the present application are not limited to these embodiments. Furthermore, identical parts in the following embodiments will be given the same reference numerals, and duplicated explanations will be omitted.

[0012] The present disclosure will be described in the following order. 1. Information processing system configuration 2. Configuration of the aroma control device 3. Information processing flow 4. Variations 5. Embodiment 2 6.Effects 7.Other

[0013] <<Embodiment>> <1. Information processing system configuration> An information processing system 1 shown in Fig. 1 will be described. As shown in Fig. 1, the information processing system 1 includes a display device 10, an aroma control device 100, and a video providing server 200. The display device 10, the aroma control device 100, and the video providing server 200 are connected to each other via a predetermined communication network (network N) so as to be able to communicate with each other via wired or wireless communication. Fig. 1 is a diagram showing an example of the configuration of the information processing system 1 according to an embodiment.

[0014] The display device 10 is an information processing device that displays video. For example, the display device 10 is an information processing device that displays video provided from an external information processing device or the like. For example, the display device 10 is an information processing device that displays video provided from a video providing server 200 (described later). For example, the display device 10 is an information processing device that displays video on a screen so that a user can view the video. For example, the display device 10 is an information processing device used in entertainment facilities such as amusement facilities, experience-based facilities, and movie theaters. The display device 10 may also have a camera and detect the user's line of sight. For example, the display device 10 may detect a user who is located within a range where the video displayed using the display device 10 can be viewed, and detect the line of sight of the detected user.

[0015] The display device 10 may be an information processing device used by a user. For example, the display device 10 may be an information processing device used by a user who uses the display device 10 to view an image. For example, the display device 10 may be an information processing device used by a user who uses the display device 10 to immerse himself in a space in which an image is displayed (a so-called image world). For example, the display device 10 may be an information processing device used by a user who uses the display device 10 to experience a virtual space.

[0016] The display device 10 may be any device that can implement the processing in the embodiment. For example, the display device 10 may be a display medium that displays images, etc. in digital signage, etc. Furthermore, for example, the display device 10 may be a display medium that displays a virtual space (a display medium that enables the experience of a virtual space). For example, the display device 10 may be a device such as a head-mounted display. Furthermore, for example, the display device 10 may be a device such as a smartphone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a mobile phone, or a PDA (Personal Digital Assistant).

[0017] The display device 10 may be, for example, a smart device such as a smartphone or a tablet, or may be a mobile terminal device capable of communicating with any server device via a wireless communication network such as 4G to 6G (Generations), LTE (Long Term Evolution), etc. The display device 10 may have a screen such as a liquid crystal display with a touch panel function, and may accept various operations on displayed data such as content, such as tapping, sliding, and scrolling, performed by a user's finger or a stylus.

[0018] The fragrance control device 100 is an information processing device designed to effectively guide a user's gaze to a displayed object using a fragrance. For example, the fragrance control device 100 effectively guides the user's gaze to a displayed object by controlling the presentation of a fragrance based on the user's gaze information. The fragrance control device 100 may be any device that can implement the processing in the embodiments. For example, the fragrance control device 100 may be implemented by a server device, a cloud system, or the like.

[0019] The video providing server 200 is an information processing device intended to provide videos to users. Alternatively, the video providing server 200 may be an information processing device intended to provide videos so that users can experience a virtual space. The video providing server 200 may be any device capable of implementing the processes in the embodiments. For example, the video providing server 200 may be implemented by a server device, a cloud system, or the like.

[0020] 1 shows a case where the display device 10 and the fragrance control device 100 are separate devices, but the display device 10 and the fragrance control device 100 may be integrated. Also, a case where the display device 10 and the video providing server 200 are separate devices, but the display device 10 and the video providing server 200 may be integrated. Also, a case where the fragrance control device 100 and the video providing server 200 are separate devices, but the fragrance control device 100 and the video providing server 200 may be integrated. Also, a case where the display device 10, the fragrance control device 100, and the video providing server 200 are separate devices, but the display device 10, the fragrance control device 100, and the video providing server 200 may be integrated.

[0021] In the following embodiments, the image may be any image visible to the user. For example, the image may be an image displayed using a display medium (e.g., a flat panel display or a projector) that displays images, such as in digital signage. Furthermore, for example, the image may be an image of a virtual space. For example, the image may be an image of a virtual space displayed to a user experiencing the virtual space. That is, the image may be an image displayed using virtual technology that displays a virtual space. For example, the image may be an image displayed using technology that reproduces the real world in a virtual space. For example, the image may be an image displayed using technology that immerses the user's entire consciousness in the world of the virtual space. Furthermore, the image may include text information such as subtitles or dialogue. Furthermore, the image may be an image accompanied by sound, such as voice, music, or sound effects. Furthermore, the image may be an image accompanied by a tactile stimulus, such as wind. Furthermore, the image may be an image accompanied by an environmental stimulus that affects the perceived temperature (thermal sensation).

[0022] In the following embodiments, the display object may be any object that is included in at least a portion of the video provided to the user. For example, the display object may be a display object of an object that appears in a landscape video. For example, the display object may be a display object of a natural object such as a flower, grass, tree, soil, stone, river, or pond. Also, for example, the display object may be a display object of an object that appears in a food video (meal). For example, the display object may be a display object of a food-related object such as food or cooking. Also, for example, the display object is not limited to objects that exist in the real world, but may be a display object of an object that appears in fiction. For example, the display object may be a display object of a character. For example, the display object may be a display object of a character currently speaking. Also, for example, the display object may be a display object of a candidate character who will speak after the currently speaking character. In this case, the character who will speak after the currently speaking character may be selected from among characters previously determined as candidate characters who will speak after that character (or the utterance of that character). Furthermore, for example, the display object may be a display object of a character corresponding to text information included in a video. For example, the display object may be a display object of a speaker of an utterance corresponding to subtitles, lines, or the like. Note that the character may be, for example, a character that appears in an animation work (so-called anime) or a game work (so-called game). For example, the character may be a character that appears in an anime that is made up of multiple episodes, each episode having a predetermined length (for example, a predetermined length that can be broadcast in a 30-minute television broadcast slot), or a character that appears in an anime that is made up of multiple television seasons. For example, the character may be a character that appears in a simulation game (for example, a dating simulation game, a historical simulation game, or the like) in which the objective is to achieve a predetermined event.Furthermore, in the following embodiments, in order to distinguish between the display object itself on the display screen and an object linked to the display object on the display screen, the display object itself on the display screen will be referred to as the "display object" and the object linked to the display object on the display screen will be referred to as the "object of the display object" as appropriate. For example, if the display object is a display object related to a character (e.g., the character "KOTORI" appearing in the video work "XXXYY1"), the display object may change with changes in the image on the display screen (e.g., a change in the viewpoint depicting the image), but the object of the display object will remain the same as the character (e.g., in the above example, the character "KOTORI" appearing in the video work "XXXYY1"). Furthermore, when either the display object itself on the display screen or an object linked to the display object on the display screen is acceptable, the term "display object (or object of the display object)" will be used as appropriate below.

[0023] In the following embodiments, the scent may be any type of scent as long as it is the scent of the display object (or an object such as a character represented by the display object). The scent may also be a scent that evokes the display object (or the object of the display object). For example, the scent may be the scent of a fragrance that is commercially available as a fragrance that evokes the display object (or the object of the display object). The scent may be at any level that can be perceived by the user. The scent may be presented using any method that can present it to the user. For example, the scent may be presented directly by spraying, or may be presented by being transported together with gas using a blower, air cannon, or the like.

[0024] In the following embodiments, the display target that the user is looking at will be referred to as the "first display target" as appropriate. Furthermore, the display target to which the user's gaze is to be guided will be referred to as the "second display target" as appropriate. The second display target is the display target of the contradictory target in the contradictory presentation of scents. The second display target is a display target (or a display target of a target such as a character) to which the user's gaze is to be guided in response to the user's viewing of the first display target. For example, the second display target is a display target (or a display target of a target) to which the user's gaze is to be guided when the user is looking at the first display target. Furthermore, the first display target and the second display target will be collectively referred to as the "display target" as appropriate. Furthermore, the display target to which the gaze is to be guided to the second display target will be referred to as the "predetermined display target" as appropriate. When the user is looking at the predetermined display target, the first display target is the predetermined display target.

[0025] In the following embodiments, the second display target may be predetermined for each predetermined display target as a display target (or a display target of a target) to which the gaze is desired to be guided from the predetermined display target. For example, the second display target may be predetermined by an administrator of the display device 10, an administrator of the aroma control device 100, or an administrator of the video providing server 200. For example, if "Character 2" is predetermined as a target to which the gaze is desired to be guided from "Character 1" because "Character 2" will speak after "Character 1," the display target of "Character 1" is the predetermined display target, and the display target of "Character 2" is the display target to which the gaze is desired to be guided from the predetermined display target. Then, for example, when a user is looking at the display target of "Character 1," the display target of "Character 1" is the first display target. In this case, "Character 2" may be a character predetermined as a character that will speak after "Character 1," or may be a character selected from among candidates that will speak after "Character 1." Also, for example, if "Character 3" rather than "Character 2" is selected from the candidates to speak after "Character 1," then the display target of "Character 3" rather than the display target of "Character 2" will become the display target to which the gaze should be directed from the display target of "Character 1."

[0026] In the following embodiments, the second display object may be a display object included in the same video as the predetermined display object, or may be a display object included in a different video. For example, when a user is viewing the predetermined display object, the second display object may be a display object included in the same video as the predetermined display object, which is the first display object, or may be a display object included in a different video. Furthermore, the second display object may be a display object displayed on the same display screen as the predetermined display object, or may be a display object displayed on a different display screen. For example, when a user is viewing the predetermined display object, the second display object may be a display object displayed on the same display screen as the predetermined display object, which is the first display object, or may be a display object displayed on a different display screen. Furthermore, the second display object may be a display object of a different target than the predetermined display object, which is the first display object, or may be a display object of the same target. For example, when a user is viewing the predetermined display object, the second display object may be a display object of a different target than the predetermined display object, which is the first display object, or may be a display object of the same target.

[0027] <2. Configuration of the aroma control device> Next, the configuration of the fragrance control device 100 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the fragrance control device 100 according to the embodiment. As shown in Fig. 2, the fragrance control device 100 has a communication unit 110, a storage unit 120, and a control unit 130. The fragrance control device 100 may also have an input unit (e.g., a keyboard or a mouse) that accepts various operations from an administrator of the fragrance control device 100, and a display unit (e.g., a liquid crystal display) that displays various information.

[0028] (Communication unit 110) The communication unit 110 is realized by, for example, a network interface card (NIC), etc. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the display device 10, etc. via the network N.

[0029] (Storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in Fig. 2, the storage unit 120 has a user information storage unit 121 and a display target information storage unit 122.

[0030] The user information storage unit 121 stores information about users. For example, the user information storage unit 121 stores information about user attributes (e.g., gender, age, hobbies, hometown, race, nationality, etc.), information about the user's learning goals, information about the user's purchase history, information about the user's posting history, information about the user's browsing history, information about the user's search history, information about the user's operation history (e.g., a history of adding items to a cart, etc.), and information about the user's usage history (e.g., a history of wearing clothes or costumes, a history of using cosmetics, perfumes, fragrances, etc.). The information about the user's usage history may also include, for example, information about a history of trying on items. The information stored in the user information storage unit 121 is used, for example, to estimate the user's level of recognition (recognition) of the scent of the display target (or the target of the display target) and the user's level of preference (preference) for the display target (or the target of the display target). FIG. 3 illustrates an example of the user information storage unit 121 according to the embodiment. FIG. 3 illustrates an example of the user information storage unit 121 according to the embodiment. As shown in FIG. 3, the user information storage unit 121 has items such as "user ID" and "user information."

[0031] "User ID" indicates identification information for identifying a user. "User information" indicates information about a user. In the example shown in Figure 3, conceptual information such as "User information #1" and "User information #2" is stored in "User information," but in reality, information indicating the user's attributes, information indicating the user's learning goals, information indicating the user's purchasing history, information indicating the user's posting history, information indicating the user's browsing history, information indicating the user's search history, information indicating the user's operation history, information indicating the user's usage history, etc. is stored.

[0032] 3 shows an example in which the information about the user identified by the user ID "U1" is "user information #1." For example, this shows that user U1 is a user who has the information of "user information #1."

[0033] The display object information storage unit 122 stores information about the display object (or the object of the display object). For example, the display object information storage unit 122 stores information about the characteristics of the display object (or the object of the display object), information about display control of the display object, etc. The information about the characteristics of the display object (or the object of the display object) includes, for example, information for identifying the display object (or the object of the display object) (for example, information indicating the name, designation, or category), information about the scent of the display object (or the object of the display object), etc. Furthermore, if the display object (or the object of the display object) is a character, the information includes, for example, information about a video work in which the character appears, character information indicating the character's name, attributes, and costume worn (cosplay (costume play) costume), etc., and information about the character's scent, etc. Furthermore, the information about display control of the display object includes, for example, information about the display position and display time at which the display object is displayed, etc. Note that, like the user information storage unit 121, the information stored in the display target information storage unit 122 is used, for example, to estimate the user's recognition of the scent of the display target (or the target of the display target) and the user's preference for the display target (or the target of the display target). FIG. 4 shows an example of the display target information storage unit 122 according to the embodiment. FIG. 4 is a diagram showing an example of the display target information storage unit 122 according to the embodiment. As shown in FIG. 4, the display target information storage unit 122 has items such as "display target ID," "target feature information," and "display control information."

[0034] The "display target ID" indicates identification information for identifying the display target. The "target characteristic information" indicates information related to the characteristics of the display target (or the target of the display target). In the example shown in FIG. 4, conceptual information such as "target characteristic information #1" and "target characteristic information #2" is stored in the "target characteristic information", but in reality, information indicating the name or category of the display target (or the target of the display target), information indicating the scent of the display target (or the target of the display target), etc. is stored. Furthermore, if the display target (or the target of the display target) is the speaker, information related to the speech of the display target (or the target of the display target) may be stored. For example, text information corresponding to the speech of the display target (or the target of the display target), time information indicating the position on the timeline where the display target (or the target of the display target) speaks (e.g., information indicating a time code), etc. may be stored. The "display control information" indicates information related to the display control of the display target. 4, conceptual information such as "display control information #1" and "display control information #2" is stored in the "display control information," but in reality, information indicating the display position and display time of the display object is stored. For example, coordinate information indicating the position of the display object on the video, time information indicating the position of the display object on the timeline, etc. is stored.

[0035] 4 shows an example in which information relating to the characteristics of a display object (or object of a display object) identified by a display object ID "T1" is "object characteristic information #1," and information relating to display control of the display object is "display control information #1." For example, this shows that the display object T1 has the characteristics of "object characteristic information #1," and is a display object displayed with "display control information #1."

[0036] (control unit 130) The control unit 130 is a controller, and is realized by, for example, a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) using RAM as a work area to execute various programs stored in a storage device inside the aroma control device 100. The control unit 130 is also realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0037] 2, the control unit 130 has an acquisition unit 131, an identification unit 132, an estimation unit 133, a calculation unit 134, a determination unit 135, a generation unit 136, and a learning unit 137, and realizes or executes the information processing action described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 2, and may be any other configuration that performs the information processing described below.

[0038] (Acquisition part 131) The acquisition unit 131 acquires various pieces of information from an external information processing device. For example, the acquisition unit 131 acquires various pieces of information from another information processing device such as the display device 10. The acquisition unit 131 also acquires various pieces of information from the storage unit 120. The acquisition unit 131 also stores the acquired various pieces of information in the storage unit 120.

[0039] The acquisition unit 131 acquires gaze information of a user. For example, the acquisition unit 131 acquires gaze information of a user provided from the display device 10 or the like. For example, the acquisition unit 131 acquires gaze information of a user located within a range where the image displayed using the display device 10 can be viewed. Also, for example, the acquisition unit 131 acquires gaze information of a user estimated to be located within a range where the image displayed using the display device 10 can be viewed. Also, the acquisition unit 131 may acquire gaze information of multiple users. For example, when multiple users are located within a range where the image displayed using the display device 10 can be viewed, the acquisition unit 131 may acquire gaze information of the multiple users. Also, for example, when multiple users are estimated to be located within a range where the image displayed using the display device 10 can be viewed, the acquisition unit 131 may acquire gaze information of the multiple users. Also, when acquiring gaze information of multiple users, the acquisition unit 131 may acquire gaze information of each of the multiple users for each user. In addition, the gaze information acquired by the acquisition unit 131 is not limited to gaze information based on eye movement, but may also be gaze information estimated based on the user's state (e.g., facial direction, posture, sitting position, behavior, stillness or movement, level of tension, level of stress, emotions, etc.).

[0040] The acquisition unit 131 acquires information about a display object (first display object) that is being viewed by a user. Furthermore, the acquisition unit 131 acquires user information about the user who is viewing the display object. Furthermore, when there are multiple users, the acquisition unit 131 may acquire information about the display object that is being viewed by each of the multiple users. Furthermore, when there are multiple users, the acquisition unit 131 may acquire user information about each of the multiple users who are viewing the display object for each user.

[0041] The acquisition unit 131 acquires information about a display target (second display target) to which the user's gaze is to be guided. For example, the acquisition unit 131 acquires information about a display target that is predetermined for each predetermined display target as a display target (or a display target of a target) to which the user's gaze is to be guided. For example, the acquisition unit 131 acquires information about a second display target to which the user's gaze is to be guided in response to the user's visual inspection of the first display target. For example, the acquisition unit 131 acquires information about a second display target that is predetermined for the predetermined display target that is the first display target. Furthermore, when there are multiple users, the acquisition unit 131 may acquire information about a display target to which the user's gaze is to be guided for each of the multiple users.

[0042] (Specific Section 132) The identification unit 132 identifies a display target (first display target) that the user is looking at, based on the information acquired by the acquisition unit 131. For example, the identification unit 132 identifies a display target that the user is looking at, based on the user's line of sight information. The identification unit 132 also identifies a display target (second display target) to which the user's line of sight is desired to be guided from the display target that the user is looking at. That is, the identification unit 132 identifies a second display target that is predetermined for a predetermined display target that is the first display target.

[0043] The specification unit 132 may specify candidates for the display target (first display target) that the user is viewing. Then, the specification unit 132 may determine the first display target from among the candidates for the first display target. Furthermore, the specification unit 132 may specify candidates for the display target (second display target) to which the user's gaze is desired to be guided from the display target (first display target) that the user is viewing. That is, the specification unit 132 may specify candidates for the second display target that are predetermined for the predetermined display target that is the first display target. Then, the specification unit 132 may determine the second display target from among the candidates for the second display target. Furthermore, the specification unit 132 may specify candidates for the display target (second display target) to which the user's gaze is desired to be guided for each candidate for the display target (first display target) that the user is viewing. That is, the specification unit 132 may specify candidates for the second display target that are predetermined for each candidate for the predetermined display target that is the first display target. Then, the specifying unit 132 may determine a second display target from among the second display target candidates for each of the first display target candidates.

[0044] (Estimation part 133) The estimation unit 133 estimates the user's recognition of the scent of the display object (or the target of the display object) based on the information acquired by the acquisition unit 131. For example, the estimation unit 133 estimates the user's recognition of the scent of the display object (or the target of the display object) based on the user information of the user and information on the characteristics of the display object (or the target of the display object). For example, if the user has purchased a fragrance with a scent inspired by the display object (or the target of the display object (e.g., "Character 1")), the estimation unit 133 may estimate the user's recognition of the scent of the display object (or the target of the display object) to be high. Furthermore, for example, if the user has purchased a fragrance with a scent inspired by an object with similar characteristics (e.g., character information) to the display object (or the target of the display object), the estimation unit 133 may estimate the user's recognition of the scent of the display object (or the target of the display object) to be high. Furthermore, for example, if the user has purchased a fragrance with a scent that evokes an object with scent characteristics similar to those of the displayed object (or the displayed object), the estimation unit 133 may estimate the user's recognition of the scent of the displayed object (or the displayed object) to be high. Furthermore, for example, if the user regularly purchases a fragrance with a scent that evokes the displayed object (or the displayed object), and the more frequently the user purchases the fragrance, the higher the user's recognition of the scent of the displayed object (or the displayed object). Furthermore, for example, the estimation unit 133 may estimate the user's recognition of the scent of the displayed object (or the displayed object) to be high the higher the user's preference for the scent of the displayed object (or the displayed object). Furthermore, for example, the estimation unit 133 may estimate the user's recognition of the scent of the displayed object (or the displayed object) to be high the higher the user's recognition of the displayed object (or the displayed object). Furthermore, for example, the estimation unit 133 may estimate that the user's recognition of the scent of the display object (or the target of the display object) is higher the higher the user's preference for the display object (or the target of the display object). For example, the estimation unit 133 may estimate that the user's recognition of the scent of the display object (or the target of the display object) is higher the more frequently the user purchases products related to the display object (or the target of the display object) and the more frequently the user purchases products.

[0045] The estimation unit 133 estimates the user's preference for the display object (or the target of the display object) based on the information acquired by the acquisition unit 131. For example, the estimation unit 133 estimates the user's preference for the display object (or the target of the display object) based on the user information of the user and information on the characteristics of the display object (or the target of the display object). For example, if the user has purchased a product related to the display object (or the target of the display object (e.g., "Character 1")), the estimation unit 133 estimates the user's preference for the display object (or the target of the display object) to be high. Furthermore, for example, if the user has purchased a product related to an object whose characteristics (e.g., character information) are similar to those of the display object (or the target of the display object), the estimation unit 133 may estimate the user's preference for the display object (or the target of the display object) to be high. Furthermore, for example, if the user has purchased a product related to an object whose fragrance characteristics are similar to those of the display object (or the target of the display object), the estimation unit 133 may estimate the user's preference for the display object (or the target of the display object) to be high. Furthermore, for example, the estimation unit 133 may estimate that the user's preference for the display object (or the target of the display object) is higher when the user regularly purchases products related to the display object (or the target of the display object) and the number of purchases is higher. Furthermore, for example, the estimation unit 133 may estimate that the user's preference for the display object (or the target of the display object) is higher when the user's recognition of the display object (or the target of the display object) is higher. Furthermore, for example, the estimation unit 133 may estimate that the user's preference for the display object (or the target of the display object) is higher when the user's recognition of the scent of the display object (or the target of the display object) is higher. Furthermore, for example, the estimation unit 133 may estimate that the user's preference for the display object (or the target of the display object) is higher when the user's preference for the scent of the display object (or the target of the display object) is higher. For example, the estimation unit 133 may estimate that if a user regularly purchases a fragrance with a scent that evokes the displayed object (or the object of the displayed object), the more frequently the user purchases the fragrance, the higher the user's preference for the displayed object (or the object of the displayed object).

[0046] The estimation unit 133 may estimate the user's recognition of the scent of a candidate display target (or target of the display target). For example, the estimation unit 133 may estimate the user's recognition of the scent of a candidate display target (or target of the display target) based on the user information of the user and information related to the characteristics of the display target (or target of the display target). The estimation unit 133 may also estimate the user's preference for the candidate display target (or target of the display target). For example, the estimation unit 133 may estimate the user's preference for the candidate display target (or target of the display target) based on the user information of the user and information related to the characteristics of the display target (or target of the display target).

[0047] (Calculation unit 134) The calculation unit 134 calculates a gaze movement distance (or a score indicating the gaze movement distance) required for moving the user's gaze to a display target (second display target) to which the user's gaze is to be guided, based on the information acquired by the acquisition unit 131. For example, the calculation unit 134 calculates a gaze movement distance required for moving the user's gaze from a display target (first display target) that the user is looking at to the second display target. Generally, from the perspective of eye movement, it is considered that gaze movement in an up-down or left-right direction places less strain on the user than movement in a diagonal direction (see Non-Patent Document 1 above). The gaze movement distance calculated by the calculation unit 134 is a distance based on gaze movement that takes into account the strain of gaze movement from the perspective of eye movement. Specifically, the gaze movement distance calculated by the calculation unit 134 is a distance based on gaze movement that takes into account the strain due to the direction of gaze movement. The calculation unit 134 calculates the gaze movement distance based on the distance and direction between the display positions of the first display target and the second display target. For example, the calculation unit 134 calculates the gaze movement distance based on the distance and direction between the display positions of the first display target and the second display target, which are based on coordinate information indicating the display position (e.g., center, center of gravity, size, etc.) of the first display target and coordinate information indicating the display position of the second display target. For example, the calculation unit 134 calculates the gaze movement distance based on whether there is a high probability that the gaze movement from the first display target to the second display target may include a diagonal gaze movement. For example, when it is determined that there is a high probability that the gaze movement from the first display target to the second display target may include a diagonal gaze movement, the calculation unit 134 calculates the gaze movement distance so that the gaze movement distance is larger (or so that the score indicating the gaze movement distance is higher) than when it is determined that there is a low probability that the gaze movement from the first display target to the second display target may include a diagonal gaze movement. Furthermore, for example, when it is determined that there is a high probability that the gaze movement from the first display target to the second display target may include a gaze movement in a diagonal direction, the calculation unit 134 may calculate the distance between the display positions where there is a high probability of a gaze movement in a diagonal direction, and calculate the gaze movement distance according to the calculated distance. In this way, the calculation unit 134 may estimate the distance over which the gaze movement becomes diagonal in the gaze movement from the first display target to the second display target, and calculate the gaze movement distance.

[0048] In calculating the gaze movement distance, the calculation unit 134 may estimate a path of gaze movement from the first display target to the second display target. For example, the calculation unit 134 may identify the shortest path between the display positions of the first display target and the second display target, and estimate the identified shortest path as the path of gaze movement from the first display target to the second display target. Furthermore, the calculation unit 134 may determine whether there is a high probability that a diagonal gaze movement may be included when the gaze moves along this estimated path, and if it determines that there is a high probability that a diagonal gaze movement may be included, calculate the distance along which the gaze movement is diagonal on the estimated path, thereby calculating the gaze movement distance. On the other hand, if it determines that there is a low probability that a diagonal gaze movement may be included, the calculation unit 134 may calculate the gaze movement distance without taking into account the burden due to the direction of the gaze movement. Specifically, the calculation unit 134 may calculate the gaze movement distance without estimating the distance over which the gaze movement becomes diagonal when the gaze moves from the first display target to the second display target. More specifically, when the gaze moves along such an estimated path, the calculation unit 134 may calculate the gaze movement distance without calculating the distance over which the gaze movement becomes diagonal on the estimated path.

[0049] The calculation unit 134 may estimate a path along which the gaze moves only in the up-down or left-right direction when the gaze moves from the first display target to the second display target, and calculate the gaze movement distance. For example, when the calculation unit 134 determines that there is a high probability that the gaze movement from the first display target to the second display target may include a diagonal gaze movement, the calculation unit 134 may further estimate a path along which the gaze moves only in the up-down or left-right direction, and calculate the gaze movement distance. For example, when the calculation unit 134 identifies the shortest path between the display position of the first display target and the display position of the second display target, and determines that there is a high probability that the gaze movement along the identified shortest path may include a diagonal gaze movement, the calculation unit 134 may further identify a shortest path along which the gaze moves only in the up-down or left-right direction, and estimate the further identified shortest path as the path along which the gaze moves from the first display target to the second display target, thereby calculating the gaze movement distance. In this way, the calculation unit 134 may calculate the line of sight movement distance without estimating the distance over which the line of sight movement becomes oblique when moving from the first display target to the second display target.

[0050] In specifying the shortest path between the display position of the first display object and the display position of the second display object, the calculation unit 134 may specify a path connecting the display position of the first display object and the display position of the second display object with one or more straight lines (approximately straight lines), and set the specified path as the shortest path between the display position of the first display object and the display position of the second display object. For example, the calculation unit 134 may specify a path connecting the display position of the first display object and the display position of the second display object with one or more straight lines so that the line of sight movement is limited to up-down or left-right movements (i.e., no diagonal movement is included), and set the specified path as the shortest path between the display position of the first display object and the display position of the second display object. Furthermore, for example, the calculation unit 134 may specify a path connecting the display position of the first display object and the display position of the second display object with one or more straight lines so that the line of sight movement is at least up-down or left-right movements, and set the specified path as the shortest path between the display position of the first display object and the display position of the second display object. Furthermore, for example, the calculation unit 134 may identify the geometrically shortest route connecting the display position of the first display object and the display position of the second display object, and set the identified route as the shortest route between the display position of the first display object and the display position of the second display object.

[0051] The calculation unit 134 may calculate a line-of-sight movement distance required for the movement of the line of sight to a candidate display target (second display target) to which the user's line of sight is desired to be guided. For example, the calculation unit 134 may calculate a line-of-sight movement distance required for the movement of the line of sight from the display target (first display target) currently being viewed by the user to a candidate second display target. For example, the calculation unit 134 may calculate a line-of-sight movement distance required for the movement of the line of sight to a predetermined candidate second display target for a specific display target (first display target) currently being viewed by the user. Furthermore, for example, the calculation unit 134 may calculate a line-of-sight movement distance required for the movement of the line of sight from a candidate display target (first display target) currently being viewed by the user to a candidate second display target. For example, the calculation unit 134 may calculate a line-of-sight movement distance required for the movement of the line of sight to a predetermined candidate second display target for each candidate specific display target (first display target) currently being viewed by the user.

[0052] (Decision unit 135) The determination unit 135 determines to present a scent to the user (to present a scent toward the user) based on the user's recognition of the scent of the display target (target of the display target) estimated by the estimation unit 133 and the line-of-sight movement distance (or a score indicating the line-of-sight movement distance) required to move the user's line of sight to the display target (second display target) to which the user's line of sight is to be guided, calculated by the calculation unit 134. Specifically, the determination unit 135 determines whether to present a scent to the user based on the user's recognition of the scent of the display target (or target of the display target) and the line-of-sight movement distance required to move the user's line of sight to the second display target. If it is determined that a scent should be presented to the user, the determination unit 135 decides to present a scent to the user, and if it is determined that a scent should not be presented to the user, the determination unit 135 decides not to present a scent to the user. The determination unit 135 also determines to present a scent to the user to guide the user's line of sight to the second display target. For example, the determination unit 135 determines to present the scent of the second display object (or the object of the second display object) to the user. For example, the determination unit 135 determines to present the scent that evokes the second display object (or the object of the second display object) to the user. For example, the determination unit 135 determines to present the scent that evokes the second display object (or the object of the second display object) to the user using a fragrance that evokes the second display object (or the object of the second display object).

[0053] The determination unit 135 determines whether to present a scent to the user based on the user's recognition of the scent of the second display target (or the target of the second display target) and the line-of-sight movement distance required to move the user's gaze to the second display target. For example, the determination unit 135 determines to present a scent to the user when the user's recognition of the scent of the second display target (or the target of the second display target) is high and the line-of-sight movement distance required to move the user's gaze to the second display target is small. For example, the determination unit 135 determines to present a scent to the user when the user's recognition of the scent of the second display target (or the target of the second display target) is equal to or greater than a predetermined threshold and the line-of-sight movement distance required to move the user's gaze to the second display target is equal to or less than a predetermined threshold. Furthermore, the determination unit 135 may use a model that, when inputted with information about the second display target (or an object of the second display target), the user's recognition of the scent of the second display target (or an object of the second display target), and the gaze movement distance required to move the gaze to the second display target, outputs a score for determining whether or not to present the scent to the user. Then, the determination unit 135 may determine that the scent should be presented to the user if the score outputted using the model is equal to or greater than a predetermined threshold.

[0054] The determination unit 135 may determine whether to present a scent to the user based on the user's recognition of the scent of the first display target (or target of the first display target), the user's recognition of the scent of the second display target (or target of the second display target), and the line-of-sight movement distance required to move the user's gaze to the second display target. For example, the determination unit 135 may determine to present a scent to the user when the user's recognition of the scent of the first display target (or target of the first display target) is high, the user's recognition of the scent of the second display target (or target of the second display target) is high, and the line-of-sight movement distance required to move the user's gaze to the second display target is small. For example, the determination unit 135 may determine to present a scent to the user when the user's recognition of the scent of the first display target (or target of the first display target) is equal to or greater than a predetermined threshold (corresponding to the first threshold), and the user's recognition of the scent of the second display target (or target of the second display target) is equal to or greater than a predetermined threshold (corresponding to the second threshold), and the line-of-sight movement distance required to move the line of sight to the second display target is equal to or less than a predetermined threshold. Note that the first threshold and the second threshold may be different thresholds. Furthermore, the determination unit 135 may use a model that, when inputted with information about the first display target (or the target of the first display target), information about the second display target (or the target of the second display target), the user's recognition of the scent of the first display target (or the target of the first display target), the user's recognition of the scent of the second display target (or the target of the second display target), and the gaze movement distance required to move the gaze to the second display target, outputs a score for determining whether or not to present the scent to the user. Then, the determination unit 135 may determine that the scent should be presented to the user if the score outputted using the model is equal to or greater than a predetermined threshold.

[0055] The determination unit 135 may determine whether to present a scent to the user based on the user's preference for the second display target (or the target of the second display target), the user's recognition of the scent of the second display target (or the target of the second display target), and the line-of-sight movement distance required to move the user's gaze to the second display target. For example, the determination unit 135 may determine to present a scent to the user when the user's preference for the second display target (or the target of the second display target) is high, the user's recognition of the scent of the second display target (or the target of the second display target) is high, and the line-of-sight movement distance required to move the user's gaze to the second display target is small. For example, the determination unit 135 may determine to present a scent to the user if the user's preference for the second display target (or the target of the second display target) is equal to or greater than a predetermined threshold, the user's recognition of the scent of the second display target (or the target of the second display target) is equal to or greater than a predetermined threshold, and the gaze movement distance required to move the gaze to the second display target is equal to or less than a predetermined threshold. Furthermore, the determination unit 135 may use a model that, when inputted with information about the second display target (or the target of the second display target), the user's preference for the second display target (or the target of the second display target), the user's recognition of the scent of the second display target (or the target of the second display target), and the gaze movement distance required to move the gaze to the second display target, outputs a score for determining whether to present a scent to the user. The determination unit 135 may then determine to present a scent to the user if the score output using the model is equal to or greater than a predetermined threshold.

[0056] The determination unit 135 may determine whether to present a scent to the user based on the user's preference for the first display target (or the target of the first display target), the user's preference for the second display target (or the target of the second display target), the user's recognition of the scent of the first display target (or the target of the first display target), the user's recognition of the scent of the second display target (or the target of the second display target), and the eye movement distance required to move the gaze to the second display target. For example, the determination unit 135 may determine to present a scent to the user when the user's preference for the first display target (or the target of the first display target) is high, the user's preference for the second display target (or the target of the second display target) is high, the user's recognition of the scent of the first display target (or the target of the first display target) is high, the user's recognition of the scent of the second display target (or the target of the second display target) is high, and the eye movement distance required to move the gaze to the second display target is small. For example, the decision unit 135 may determine that a scent should be presented to the user if the user's preference for the first display target (or a target of the first display target) is equal to or greater than a predetermined threshold, the user's preference for the second display target (or a target of the second display target) is equal to or greater than a predetermined threshold, the user's awareness of the scent of the first display target (or a target of the first display target) is equal to or greater than a predetermined threshold, the user's awareness of the scent of the second display target (or a target of the second display target) is equal to or greater than a predetermined threshold, and the gaze movement distance required to move the gaze to the second display target is equal to or less than a predetermined threshold. Furthermore, for example, the decision unit 135 may determine that a scent should be presented to the user when the user's preference for the second display target (or an object of the second display target) is higher than the user's preference for the first display target (or an object of the first display target) in order to guide the user's gaze to the second display target while the user is looking at the first display target.Furthermore, the determination unit 135 may use a model that outputs a score for determining whether or not to present a scent to the user when it receives input of information about the first display target (or target of the first display target), information about the second display target (or target of the second display target), the user's preference for the first display target (or target of the first display target), the user's preference for the second display target (or target of the second display target), the user's recognition of the scent of the first display target (or target of the first display target), the user's recognition of the scent of the second display target (or target of the second display target), and the gaze movement distance required to move the gaze to the second display target.The determination unit 135 may then determine that a scent should be presented to the user if the score output using the model is equal to or greater than a predetermined threshold.

[0057] The determination unit 135 may determine the display target based on a score output using a model that outputs a score for determining whether or not to present a scent to a user for each candidate display target. For example, the determination unit 135 may determine the display target based on a score output by inputting into the model, for each candidate display target, the user's recognition of the scent of the display target (or the target of the display target), the user's preference for the display target (or the target of the display target), the gaze movement distance required to move the gaze to the display target, and the like. For example, the determination unit 135 may determine the display target by comparing the scores and identifying the combination with the highest score (the combination of input information input into the model). For example, the determination unit 135 may determine the display target by identifying the combination with the highest score among the combinations determined to present a scent to the user. For example, the determination unit 135 may determine the first display target candidate with the combination with the highest score as the first display target. Furthermore, for example, the determination unit 135 may determine the second display target candidate with the combination with the highest score as the second display target.

[0058] For example, when a model is used in which, upon inputting information about the first display target (or target of the first display target), information about a candidate for the second display target (or target of the second display target), a user's awareness of the scent of the first display target (or target of the first display target), a user's awareness of the scent of the candidate for the second display target (or target of the second display target), and the distance of gaze movement required to move the gaze to the candidate for the second display target, the determination unit 135 may determine the second display target by identifying the combination of information about the first display target (or target of the first display target), information about the candidate for the second display target (or target of the second display target) that has the highest score, the user's awareness of the scent of the first display target (or target of the first display target), the user's awareness of the scent of the candidate for the second display target (or target of the second display target), and the distance of gaze movement required to move the gaze to the candidate for the second display target. For example, the determination unit 135 may determine the second display object from among second display object candidates that are predetermined for a given display object that is the first display object. Furthermore, when a model is used in which, upon inputting information about a candidate for the first display target (or target of the first display target), information about a candidate for the second display target (or target of the second display target), a user's awareness of the scent of the candidate for the first display target (or target of the first display target), a user's awareness of the scent of the candidate for the second display target (or target of the second display target), and a distance of gaze movement required to move the gaze to the candidate for the second display target, the determination unit 135 may determine the first display target and the second display target by identifying the combination of information about the candidate for the first display target (or target of the first display target), information about the candidate for the second display target (or target of the second display target), a user's awareness of the scent of the candidate for the first display target (or target of the first display target), a user's awareness of the scent of the candidate for the second display target (or target of the second display target), and a distance of gaze movement required to move the gaze to the candidate for the second display target, which has the highest score.For example, the determination unit 135 may determine a first display target from among candidates for the first display target, and may determine a second display target from among candidates for the second display target that are predetermined for each candidate for a predetermined display target that is the first display target.

[0059] The determination unit 135 may determine whether or not the text information corresponding to the utterance of the second display target (or the target of the second display target) includes text information of predetermined information (e.g., an article, a magazine, or learning materials), and may determine to present a scent to the user if it is determined that the text information of the predetermined information is included, and may determine not to present a scent to the user if it is determined that the text information of the predetermined information is not included. Furthermore, the determination unit 135 may determine to present a scent to the user by using a display target (or a target of the display target) whose text information corresponding to the utterance includes text information of predetermined information as the second display target (or a target of the second display target). For example, the determination unit 135 may determine to present a scent to the user by using a display target (or a target of the display target) whose text information corresponding to the utterance is determined to include text information of predetermined information as the second display target (or a target of the second display target). For example, the determination unit 135 may determine whether or not text information corresponding to the utterance for each candidate for the second display target (or target of the second display target) includes text information of predetermined information, and may determine to present a scent to the user for a candidate for the second display target (or target of the second display target) that is determined to include text information of the predetermined information from among the candidates for the second display target (or target of the second display target). The predetermined information previously specified for the determination process of the determination unit 135 may be specified by the user, or by an administrator of the display device 10, an administrator of the aroma control device 100, an administrator of the video providing server 200, or the like. The predetermined information may be, for example, an anime article or an anime magazine. In this case, the text information of the predetermined information may be, for example, text information indicating information about a specific anime, a specific character, or a specific cosplay introduced in the anime article or anime magazine. The predetermined information may also be, for example, a game article or a game magazine. In this case, the text information of the predetermined information may be, for example, text information showing information about a specific game, a specific character, or a specific cosplay introduced in a game article, a game magazine, etc. The predetermined information may also be, for example, a fashion article, a fashion magazine, etc.In this case, the text information of the predetermined information may be, for example, text information indicating information about a particular fashion introduced in a fashion article or a fashion magazine. The predetermined information may also be, for example, a gourmet article or a gourmet magazine. The text information of the predetermined information may also be, for example, text information indicating information about a particular gourmet item introduced in a gourmet article or a gourmet magazine. The predetermined information may also be, for example, study materials (e.g., a vocabulary book or a dictionary) selected according to the user's level of proficiency (or proficiency) in a language being studied (not limited to a major language such as English, but may be any language). The text information of the predetermined information may also be, for example, text information indicating information about a particular word included in study materials selected according to the user's level of proficiency in the language being studied. In cases where the user's level of proficiency in the language being studied is unavailable (e.g., when there is insufficient information to adequately estimate the user's level of proficiency in the language being studied), the predetermined information may also be study materials selected according to the proficiency of another user whose level of proficiency in the language being studied is estimated to be similar to that of the user. In this case, the text information of the predetermined information may be, for example, text information indicating information about a specific word included in learning materials selected according to the level of proficiency of another user who is estimated to have a similar level of proficiency in the language being studied by the user. The predetermined information may also be, for example, learning materials created for the user using subtitle information (which may be dialogue information) of a video work or the like. In this case, the text information of the predetermined information may be, for example, text information indicating information about a specific word included in learning materials created for the user using subtitle information (which may be dialogue information) of a video work or the like. For example, the text information of the predetermined information may be text information indicating information about a specific word included in learning materials created for the user using subtitle information (which may be dialogue information) of subtitles extracted by the user performing a predetermined operation while watching a video work.For example, the text information of the predetermined information may be text information indicating information about a specific word included in learning materials, etc., created for a user using subtitle information (which may be line information of a line) of subtitles extracted when the user has a high preference for the speaker (or the clothing worn by the speaker) of subtitles (which may be lines) selected by the user performing a predetermined operation while watching a video work. For example, the text information of the predetermined information may be text information indicating information about a specific word included in learning materials, etc., created for a user for each video work using subtitle information (which may be line information of a line) and word information of a word extracted when the user has a high preference for the speaker (or the clothing worn by the speaker) of subtitles (which may be lines) containing a word selected by the user performing a predetermined operation on subtitles (which may be lines) displayed while watching a video work.

[0060] When the decision unit 135 determines to present a scent to the user, it transmits information for presenting the scent to the user. For example, the decision unit 135 transmits information for requesting that the scent be presented to the user. For example, the decision unit 135 transmits control information for performing control so that the scent is presented to the user. On the other hand, when the decision unit 135 determines not to present a scent to the user, it may transmit information for not presenting the scent to the user. For example, the decision unit 135 may transmit information for requesting that the scent not be presented to the user. For example, the decision unit 135 may transmit control information for performing control so that the scent is not presented to the user.

[0061] The decision unit 135 transmits various information to an external information processing device. For example, the decision unit 135 transmits various information to another information processing device such as the display device 10. Then, when the other information processing device such as the display device 10 receives the information transmitted from the decision unit 135, it presents a scent based on the received information. For example, the other information processing device such as the display device 10 performs inconsistent presentation of a scent based on the information transmitted from the decision unit 135. For example, when the other information processing device such as the display device 10 receives information to present a scent to a user, it performs control so that the scent is presented to the user (i.e., performs inconsistent presentation of a scent), and when it receives information not to present a scent to the user, it performs control so that the scent is not presented to the user.

[0062] (Generation unit 136) The generation unit 136 generates a model that outputs a score for determining whether or not to present a scent to a user. For example, the generation unit 136 may generate a model that outputs a score for determining whether or not to present a scent to a user when it receives information about the second display target (or an object of the second display target), the user's recognition of the scent of the second display target (or an object of the second display target), and a line-of-sight movement distance required to move the gaze to the second display target. Furthermore, for example, the generation unit 136 may generate a model that outputs a score for determining whether or not to present a scent to a user when it receives information about the first display target (or an object of the first display target), information about the second display target (or an object of the second display target), the user's recognition of the scent of the first display target (or an object of the first display target), the user's recognition of the scent of the second display target (or an object of the second display target), and a line-of-sight movement distance required to move the gaze to the second display target. Furthermore, for example, the generation unit 136 may generate a model that outputs a score for determining whether or not to present a scent to a user when it receives input of information about the second display target (or a target of the second display target), the user's preference for the second display target (or a target of the second display target), the user's awareness of the scent of the second display target (or a target of the second display target), and the gaze movement distance required to move the gaze to the second display target. Furthermore, for example, the generation unit 136 may generate a model that, when it receives input of information about the first display object (or the object of the first display object), information about the second display object (or the object of the second display object), the user's preference for the first display object (or the object of the first display object), the user's preference for the second display object (or the object of the second display object), the user's awareness of the scent of the first display object (or the object of the first display object), the user's awareness of the scent of the second display object (or the object of the second display object), and the gaze movement distance required to move the gaze to the second display object, outputs a score for determining whether or not to present the scent to the user.Furthermore, for example, the generation unit 136 may receive input of information about the first display target (or target of the first display target), information about a candidate for the second display target (or target of the second display target), the user's awareness of the scent of the first display target (or target of the first display target), the user's awareness of the scent of the candidate for the second display target (or target of the second display target), and the gaze movement distance required to move the gaze to the candidate for the second display target (or target of the second display target), and generate a model that outputs a score for determining whether or not to present the scent to the user. Furthermore, for example, the generation unit 136 may generate a model that, when inputting information about a candidate for the first display target (or a target of the first display target), information about a candidate for the second display target (or a target of the second display target), the user's awareness of the scent of the candidate for the first display target (or a target of the first display target), the user's awareness of the scent of the candidate for the second display target (or a target of the second display target), and the gaze movement distance required to move the gaze to the candidate for the second display target, outputs a score for determining whether or not to present the scent to the user.

[0063] (Learning Section 137) The learning unit 137 learns the model generated by the generation unit 136. For example, when it is estimated that the user's gaze is guided to a second display target by the inconsistent presentation of the scent of a display target (or a target of the display target) to which the user's gaze is desired to be guided while the user is looking at a predetermined display target that is a first display target, the learning unit 137 may learn a model that outputs a score for determining whether to present a scent to the user when it receives information about the second display target (or a target of the second display target), the user's recognition of the scent of the second display target (or a target of the second display target), and the gaze movement distance required to move the gaze to the second display target, using information about the second display target (or a target of the second display target) as correct answer data, and inputs the information about the second display target (or a target of the second display target), the user's recognition of the scent of the second display target (or a target of the second display target), and the gaze movement distance required to move the gaze to the second display target. In this case, the learning unit 137 may train the model so that, when it is estimated that the user's gaze has been guided to the second display target by the inconsistent presentation of the scent of the display target (or the target of the display target) to which the user's gaze is desired to be guided, the more similar the combination of information about the second display target (or the target of the second display target), the user's recognition of the scent of the second display target (or the target of the second display target), and the gaze movement distance required to move the gaze to the second display target is, the higher the score for determining whether or not to present a scent to the user. On the other hand, when it is estimated that the user's gaze has not been guided to the second display target by the inconsistent presentation of the scent of the display target (or the target of the display target) to which the user's gaze is desired to be guided, the learning unit 137 may train the model as incorrect data. In this case, the learning unit 137 may train the model so that the more similar the combination is to the combination at that time, the lower the score for determining whether or not to present a scent to the user.

[0064] <3. Information processing flow> Next, the procedure of information processing by the information processing system 1 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the procedure of information processing by the information processing system 1 according to the embodiment.

[0065] As shown in FIG. 5, the fragrance control device 100 acquires the user's line of sight information (step S101).

[0066] The fragrance control device 100 identifies the display object that the user is looking at based on the user's line of sight information (step S102).

[0067] The aroma control device 100 identifies a display object to which the user's gaze is to be guided from the first display object (step S103).

[0068] The aroma control device 100 estimates the user's recognition of the aroma of the second display target (or the target of the second display target) (step S104).

[0069] The fragrance control device 100 calculates the line of sight movement distance required for the user to move his / her line of sight from the first display target to the second display target (step S105).

[0070] The fragrance control device 100 decides to present the fragrance to the user based on the user's awareness of the fragrance of the second display object (or an object of the second display object) and the distance of gaze movement required for the user to move their gaze from the first display object to the second display object (step S106).

[0071] <4. Modifications> The information processing system 1 according to the embodiment described above may be implemented in various different forms other than the above embodiment, so other embodiments of the information processing system 1 will be described below.

[0072] (Variation 1: Determining the display position of the second display object) In the above embodiment, the determination unit 135 determines to present a fragrance to a user when a high score is output using a model that outputs a score for determining whether or not to present a fragrance to a user. In this manner, the fragrance control device 100 obtains input information to be input into the model and performs fragrance control to present a fragrance to a user. Note that fragrance control to present a fragrance to a user is not particularly limited to this example. For example, fragrance control may be performed by varying the gaze movement distance required to move the gaze to the second display target. Variation 1 describes a case in which the fragrance control device 100 performs fragrance control to present a fragrance to a user by determining the position at which the second display target is displayed.

[0073] In the first modification, the second display object may be a display object that can be displayed on the same display screen as the display screen on which the predetermined display object is displayed, or may be a display object that can be displayed on a different display screen. For example, when the user is visually observing the predetermined display object, the second display object may be a display object that can be displayed on the same display screen as the display screen on which the predetermined display object, the first display object, is displayed, or may be a display object that can be displayed on a different display screen.

[0074] The determination unit 135 may determine the gaze movement distance required to move the gaze to the second display target so that the score output using the model is at least equal to or greater than a predetermined threshold for determining that the fragrance is to be presented to the user. In other words, the determination unit 135 may determine the gaze movement distance required to move the gaze to the second display target by determining a gaze movement distance that can be input to the model as predetermined input information such that, when the input information is input to the model, the score output from the model is at least equal to or greater than a predetermined threshold. For example, the determination unit 135 may determine the maximum gaze movement distance that can be input to the model as predetermined input information, and then determine the gaze movement distance required to move the gaze to the second display target so that the second display target is displayed at a position within the range of the maximum gaze movement distance. Then, the determination unit 135 may determine the gaze movement distance required to move the gaze to the second display target in this manner, thereby determining the position at which the second display target is to be displayed.

[0075] The determination unit 135 may determine the position at which to display the second display object by, for example, using a model that, when inputted, outputs a score for determining whether or not to present the scent to the user when it receives information about the second display object (or an object of the second display object), the user's awareness of the scent of the second display object (or an object of the second display object), and the gaze movement distance required to move the gaze to the second display object, determining a gaze movement distance that can be inputted to the model as specified input information such that, when it receives inputted information about the second display object (or an object of the second display object), the user's awareness of the scent of the second display object (or an object of the second display object), and the gaze movement distance required to move the gaze to the second display object, the score outputted from the model is at least equal to or greater than a specified threshold.

[0076] The determination unit 135 may determine the position at which to display the second display target by using a model that, when inputting information about the first display target (or target of the first display target), information about the second display target (or target of the second display target), the user's awareness of the scent of the first display target (or target of the first display target), the user's awareness of the scent of the second display target (or target of the second display target), and the gaze movement distance required to move the gaze to the second display target, outputs a score for determining whether to present the scent to the user, and determines the gaze movement distance that can be input to the model as specified input information such that, when inputting information about the first display target (or target of the first display target), information about the second display target (or target of the second display target), the user's awareness of the scent of the first display target (or target of the first display target), the user's awareness of the scent of the second display target (or target of the second display target), and the gaze movement distance required to move the gaze to the second display target, the score output from the model is at least equal to or greater than a specified threshold.

[0077] The determination unit 135 may determine the position at which to display the second display object by using a model that, when inputted with information about the second display object (or an object of the second display object), the user's preference for the second display object (or an object of the second display object), the user's awareness of the scent of the second display object (or an object of the second display object), and the gaze movement distance required to move the gaze to the second display object, outputs a score for determining whether or not to present the scent to the user, and determines a gaze movement distance that can be inputted to the model as specified input information such that, when inputted with information about the second display object (or an object of the second display object), the user's preference for the second display object (or an object of the second display object), the user's awareness of the scent of the second display object (or an object of the second display object), and the gaze movement distance required to move the gaze to the second display object, the model outputs a score that is at least equal to or greater than a specified threshold.

[0078] The determination unit 135, for example, receives input of information about the first display target (or the target of the first display target), information about the second display target (or the target of the second display target), a user's preference for the first display target (or the target of the first display target), a user's preference for the second display target (or the target of the second display target), a user's recognition of the scent of the first display target (or the target of the first display target), a user's recognition of the scent of the second display target (or the target of the second display target), and a gaze movement distance required to move the gaze to the second display target, and determines whether or not to present a scent to the user by using a model that outputs a score. The position for displaying the second display object may be determined by determining a gaze movement distance that can be input to the model as predetermined input information such that when the model receives input of information relating to the first display object (or the object of the second display object), information relating to the second display object (or the object of the second display object), the user's preference for the first display object (or the object of the first display object), the user's preference for the second display object (or the object of the second display object), the user's recognition of the scent of the first display object (or the object of the first display object), the user's recognition of the scent of the second display object (or the object of the second display object), and the gaze movement distance required to move the gaze to the second display object, the position for displaying the second display object may be determined by determining a gaze movement distance that can be input to the model as predetermined input information such that the score output from the model is at least equal to or greater than a predetermined threshold.

[0079] The determination unit 135, for example, receives input of information about the first display target (or the target of the first display target), information about a candidate for the second display target (or the target of the second display target), a user's recognition of the scent of the first display target (or the target of the first display target), a user's recognition of the scent of the candidate for the second display target (or the target of the second display target), and a gaze movement distance required for moving the gaze to the candidate for the second display target, and determines a score for the first display target (or the target of the first display target) using a model that outputs a score for determining whether or not to present a scent to the user. The position at which the candidate second display target is to be displayed may be determined by determining a gaze movement distance that can be input to the model as predetermined input information such that, when the user inputs information about the first display target (or the target of the first display target), information about a candidate second display target (or the target of the second display target), the user's recognition of the scent of the candidate second display target (or the target of the second display target), the user's recognition of the scent of the candidate second display target (or the target of the second display target), and the gaze movement distance required to move the gaze to the candidate second display target, the score output from the model is at least equal to or greater than a predetermined threshold. Furthermore, the determination unit 135 may, for example, identify the second display target based on the position at which the candidate second display target is to be displayed and determine the position at which the second display target is to be displayed. For example, the determination unit 135 may determine the position at which the second display target is to be displayed by selecting, from the candidates for the second display target, the candidate second display target that requires the smallest gaze movement distance as the second display target.

[0080] The determination unit 135, for example, receives information about a candidate for the first display target (or a target of the first display target), information about a candidate for the second display target (or a target of the second display target), a user's recognition of the scent of the candidate for the first display target (or a target of the first display target), a user's recognition of the scent of the candidate for the second display target (or a target of the second display target), and a gaze movement distance required for moving the gaze to the candidate for the second display target, and uses a model that outputs a score for determining whether or not to present the scent to the user. The position at which the candidate for the first display target and the position at which the candidate for the second display target are to be displayed may be determined by determining a gaze movement distance that can be input to the model as predetermined input information such that, when information about the candidate for the display target (or the target of the first display target), the user's recognition of the scent of the candidate for the first display target (or the target of the first display target), the user's recognition of the scent of the candidate for the second display target (or the target of the second display target), and the gaze movement distance required to move the gaze to the candidate for the second display target are input, the score output from the model is at least equal to or greater than a predetermined threshold. Furthermore, the determination unit 135 may, for example, identify the first display target and the second display target based on the position at which the candidate for the first display target and the position at which the candidate for the second display target are to be displayed, and determine the position at which the candidate for the first display target and the position at which the candidate for the second display target are to be displayed. For example, the determination unit 135 may determine the position at which to display the first display target and the position at which to display the second display target by selecting the candidate first display target that is a combination of the first display target and the second display target that results in the shortest line-of-sight movement distance as the first display target and selecting the candidate second display target that is a combination of the second display target that results in the shortest line-of-sight movement distance as the second display target.

[0081] In this way, the information determined by the determination unit 135 is not limited to information regarding whether or not to present a scent to the user, but may also be information regarding the position at which to display the second display target. The determination unit 135 may determine the position at which to display the second display target or the position at which to display candidates for the second display target. For example, the determination unit 135 may determine the position at which to display a predetermined second display target relative to a predetermined display target that is the first display target, or may determine the position at which to display predetermined candidates for the second display target relative to the predetermined display target that is the first display target, or may determine the position at which to display predetermined candidates for the second display target relative to each candidate for the predetermined display target that is the first display target.

[0082] (Variation 2: Estimate the display object that the user is looking at and set it as the first display object) In the above embodiment, the case has been described in which the identification unit 132 identifies the display target (first display target) that the user is looking at based on the information acquired by the acquisition unit 131. That is, the case has been described in which the identification unit 132 acquires gaze information of the user and identifies the first display target based on the acquired gaze information. Note that the method for identifying the first display target is not particularly limited to this example. The identification unit 132 may also estimate the display target (first display target) that the user is looking at. That is, the identification unit 132 may estimate the display target (first display target) that the user is looking at and set the estimated display target as the first display target.

[0083] The acquisition unit 131 may acquire user location information to estimate a display target (first display target) that a user is viewing. For example, the acquisition unit 131 may acquire user location information provided from the display device 10 or the like. For example, the acquisition unit 131 may acquire location information of a user who is located within a range where an image displayed using the display device 10 can be viewed. Furthermore, for example, the acquisition unit 131 may acquire location information of a user who is estimated to be located within a range where an image displayed using the display device 10 can be viewed. Furthermore, the acquisition unit 131 may acquire location information of multiple users to estimate a display target (first display target) that each of multiple users is viewing. For example, when multiple users are located within a range where an image displayed using the display device 10 can be viewed, the acquisition unit 131 may acquire location information of the multiple users. Furthermore, for example, when multiple users are estimated to be located within a range where an image displayed using the display device 10 can be viewed, the acquisition unit 131 may acquire location information of the multiple users. Furthermore, when acquiring location information of a plurality of users, the acquiring unit 131 may acquire the location information of each of the plurality of users for each user.

[0084] The acquisition unit 131 may acquire information indicating a user's state (e.g., facial orientation, posture, sitting position, behavior, stillness or movement, level of tension, level of stress, emotion, etc.) (hereinafter referred to as "state information" as appropriate) in order to estimate a display object (first display object) that the user is viewing. For example, the acquisition unit 131 may acquire state information of a user provided from the display device 10 or the like. For example, the acquisition unit 131 may acquire state information of a user who is located within a range where an image displayed using the display device 10 can be seen. Furthermore, for example, the acquisition unit 131 may acquire state information of a user who is estimated to be located within a range where an image displayed using the display device 10 can be seen. Furthermore, the acquisition unit 131 may acquire state information of multiple users in order to estimate a display object (first display object) that each of multiple users is viewing. For example, when multiple users are located within a range where an image displayed using the display device 10 can be seen, the acquisition unit 131 may acquire state information of the multiple users. Furthermore, for example, the acquiring unit 131 may acquire status information of a plurality of users when it is estimated that the plurality of users are located within a range where the image displayed using the display device 10 can be seen. Furthermore, when acquiring status information of a plurality of users, the acquiring unit 131 may acquire the status information of each of the plurality of users for each user.

[0085] The identification unit 132 may estimate the display target (first display target) that the user is looking at, based on the information acquired by the acquisition unit 131. For example, the identification unit 132 may estimate the display target (first display target) that the user is looking at, based on the position information, state information, etc. acquired by the acquisition unit 131.

[0086] The acquiring unit 131 may acquire information regarding the speech of the display target (or a target of the display target) in order to estimate the display target (first display target) that the user is viewing. The identifying unit 132 may estimate the display target that is currently speaking as the first display target. For example, the identifying unit 132 may identify a user who is located within a range where an image displayed using the display device 10 can be seen, and estimate the display target that is currently speaking on the image as the first display target of the identified user. Then, the identifying unit 132 may estimate the display target as the first display target of the identified user while it is speaking. Furthermore, for example, the identifying unit 132 may identify a user who is estimated to be located within a range where an image displayed using the display device 10 can be seen, and estimate the display target that is currently speaking on the image as the first display target of the identified user. Then, the identifying unit 132 may estimate the display target as the first display target of the identified user while it is speaking. Furthermore, for example, the identification unit 132 may identify multiple users who are located within a range where the image displayed using the display device 10 can be seen, and estimate a display target who is speaking on the image as the first display target of the identified multiple users. Then, the identification unit 132 may estimate the display target as the first display target of the identified multiple users while the display target is speaking. Also, for example, the identification unit 132 may identify multiple users who are estimated to be located within a range where the image displayed using the display device 10 can be seen, and estimate a display target who is speaking on the image as the first display target of the identified multiple users. Then, the identification unit 132 may estimate the display target as the first display target of the identified multiple users while the display target is speaking.

[0087] The acquisition unit 131 may acquire information about the appearance of a display object (or an object of a display object) to estimate a display object (first display object) that a user is viewing. The identification unit 132 may estimate a display object with a distinctive appearance (for example, a display object that stimulates appetite, sexual desire, sleepiness, or the like) as the first display object. For example, the identification unit 132 may identify a user who is located within a range where a video displayed using the display device 10 can be viewed, and estimate a display object with a distinctive appearance in the video as the first display object of the identified user. Then, the identification unit 132 may estimate the display object as the first display object of the identified user during a period when the display object has a distinctive appearance (for example, a period during which a scene of eating is displayed). Furthermore, for example, the identification unit 132 may identify a user who is estimated to be located within a range where a video displayed using the display device 10 can be viewed, and estimate a display object with a distinctive appearance in the video as the first display object of the identified user. The identification unit 132 may then estimate the display target as the first display target of the identified user during a period in which the display target has a distinctive appearance. Furthermore, for example, the identification unit 132 may identify multiple users who are located within a range in which an image displayed using the display device 10 can be seen, and estimate the display target with a distinctive appearance in the image as the first display target of the identified multiple users. Furthermore, for example, the identification unit 132 may identify multiple users who are estimated to be located within a range in which an image displayed using the display device 10 can be seen, and estimate the display target with a distinctive appearance in the image as the first display target of the identified multiple users. Furthermore, for example, the identification unit 132 may identify multiple users who are estimated to be located within a range in which an image displayed using the display device 10 can be seen, and estimate the display target with a distinctive appearance in the image as the first display target of the identified multiple users. Furthermore, the identification unit 132 may then estimate the display target as the first display target of the identified multiple users during a period in which the display target has a distinctive appearance.

[0088] (Variation 3: Divide the image into multiple regions to determine gaze movement) In the above embodiment, the calculation unit 134 calculates the gaze movement distance based on whether there is a high probability that the gaze movement from the first display target to the second display target may include a diagonal gaze movement. In this case, the calculation unit 134 may determine whether there is a high probability that the gaze movement from the first display target to the second display target may include a diagonal gaze movement by dividing the image into multiple regions. Non-Patent Document 1 discloses a technology for evaluating the inconsistent presentation of scents by dividing a display screen into nine regions and counting the number of gaze movements between the regions in the vertical, horizontal, and diagonal directions. The calculation unit 134 may determine the probability that a diagonal gaze movement may be included by dividing the image into multiple regions so that the first display target is included in the central region. Alternatively, the calculation unit 134 may determine the probability that a diagonal gaze movement may be included by dividing the image into multiple regions so that the second display target is included in one of the regions. The number and shape of the multiple regions are not particularly limited. The number and shape of the multiple regions may be determined according to the display object. For example, the number and shape of the multiple regions may be determined according to the first display object, the second display object, or a combination of the first display object and the second display object. The shapes of the multiple regions may be different for each of the multiple regions. The shapes of the multiple regions may be determined according to the size of the display object. The shapes of the multiple regions may be determined according to the length of the utterance of the display object (or the object of the display object). The multiple regions may be divided so that the user can recognize the boundaries between the regions, or may be divided so that the user cannot recognize the boundaries between the regions.

[0089] (Variation 4: Taking into account the similarity of the scent to be displayed) In the above embodiment, the determination unit 135 determines whether to present a scent to the user based on the user's recognition of the scent of the second display target (or the target of the second display target) and the gaze movement distance required to move the gaze to the second display target. However, even if the user's recognition of the scent of the second display target (or the target of the second display target) is high, if the scent of the second display target (or the target of the second display target) is similar to the scent of the first display target (or the target of the first display target), it may not be possible to effectively guide the user's gaze from the first display target to the second display target when the scent of the second display target (or the target of the second display target) is used for inconsistent scent presentation. Therefore, the determination unit 135 may determine to present a scent to the user when the scent of the second display target (or the target of the second display target) is not similar to the scent of the first display target (or the target of the first display target). Specifically, the decision unit 135 may determine whether the scent of the second display object (or the object of the second display object) is similar to the scent of the first display object (or the object of the first display object), and if it determines that the scent of the second display object (or the object of the second display object) is not similar to the scent of the first display object (or the object of the first display object), it may decide to present the scent to the user, and if it determines that the scent of the second display object (or the object of the second display object) is similar to the scent of the first display object (or the object of the first display object), it may decide not to present the scent to the user. In this case, the determination of whether the scent of the second display target (or the target of the second display target) is similar to the scent of the first display target (or the target of the first display target) may be made, for example, by comparing evaluation results based on an affective evaluation of the scent of the first display target (or the target of the first display target) and the scent of the second display target (or the target of the second display target), or by comparing evaluation results based on an evaluation of the scent components of the scent of the first display target (or the target of the first display target) and the scent of the second display target (or the target of the second display target). The determination unit 135 may determine whether to present the scent to the user based on the user's recognition of the scent of the second display target (or the target of the second display target) whose scent is not similar to the scent of the first display target (or the target of the first display target) and the line-of-sight movement distance required to move the line of sight to the second display target.Specifically, the decision unit 135 may determine whether to present a scent to the user based on the user's awareness of the scent of the second display object (or the target of the second display object) whose scent is determined to be not similar to the scent of the first display object (or the target of the first display object) and the gaze movement distance required to move the gaze to the second display object.

[0090] (Variation 5: Adding a predetermined condition regarding the second display target) In the above embodiment, the determination unit 135 determines to present a scent to a user based on the user's recognition of the scent of the display target (or the target of the display target) and the distance of gaze movement required to move the user's gaze to the display target to which the user's gaze is to be guided. In this case, the determination unit 135 may determine to present a scent to a user based on whether the user is a user who satisfies a predetermined condition regarding the display target (or the target of the display target) to which the user's gaze is to be guided. Specifically, the decision unit 135 determines whether or not a predetermined condition for presenting a scent to a user is met based on the user's awareness of the scent of the display target (or the target of the display target) and the distance of gaze movement required to move the gaze to the second display target.If it determines that the predetermined condition for presenting a scent to a user is met, it further determines whether or not the user is a user who satisfies a predetermined condition regarding the second display target (or the target of the second display target).If it determines that the user is a user who satisfies a predetermined condition regarding the second display target (or the target of the second display target), it may decide to present a scent to the user, and if it determines that the user is not a user who satisfies the predetermined condition regarding the second display target (or the target of the second display target), it may decide not to present a scent to the user.

[0091] The determination unit 135 may determine, as a predetermined condition related to the second display target (or the target of the second display target), for example, whether the user has performed a predetermined action on the target of the second display target, and may decide to present a scent to the user if it is determined that the user has performed a predetermined action on the target of the second display target. For example, the determination unit 135 may decide to present a scent to the user if the user has purchased a product related to the target of the second display target. For example, the determination unit 135 may decide to present a scent to the user if the user has purchased a fragrance related to the target of the second display target. Furthermore, for example, the determination unit 135 may decide to present a scent to the user if the user has had a conversation with the target of the second display target on the interface. Furthermore, for example, the determination unit 135 may decide to present a scent to the user if the user has approached the target of the second display target within a predetermined distance on the interface.

[0092] The determination unit 135 may determine, as a predetermined condition related to the second display target (or the second display target), for example, that a scent be presented to the user when the user satisfies the predetermined condition as a result of a predetermined action taken by the user on the second display target. For example, the determination unit 135 may determine to present a scent to the user when the user acquires the second display target as a result of the user performing a predetermined action (e.g., operation on a user interface for acquisition using an item) to acquire (e.g., obtain, hold, get, etc.) the second display target. In this way, for example, the determination unit 135 may determine to present a scent to the user when the user performs a predetermined action to acquire the second display target and completes a predetermined task for acquiring the second display target. Furthermore, for example, the determination unit 135 may determine to present a scent to the user when the user has established a predetermined relationship with the second display target as a result of the user performing a predetermined action (e.g., conversation based on operation on a user interface) to acquire a predetermined relationship (e.g., friendship, romantic relationship, family relationship, etc.) with the second display target. In this way, for example, the decision unit 135 may decide to present a scent to the user if the user has performed a predetermined action to obtain a predetermined relationship with the second display target, and as a result, the user has accomplished a predetermined task to obtain a predetermined relationship with the second display target.

[0093] (Variation 6: Taking into account the level of understanding of the information corresponding to the utterance of the display target) In the above embodiment, the determination unit 135 may determine to present a scent to the user by taking into account the user's level of understanding (level of comprehension) of information corresponding to the speech of the display target (or the target of the display target). For example, the determination unit 135 may determine to present a scent to the user by taking into account the user's level of understanding of information corresponding to the speech of the display target (or the target of the display target), which is estimated based on the user's level of proficiency in the language being studied. For example, the determination unit 135 may determine to present a scent to the user by taking into account the user's level of understanding of information corresponding to the speech of the display target (or the target of the display target), which is estimated based on information about specific words included in learning materials (e.g., learning materials created for the user) selected according to the user's level of proficiency in the language being studied. Furthermore, for example, the determination unit 135 may determine to present a scent to a user by taking into consideration the user's level of understanding of the information corresponding to the utterance of the display target (or the target to be displayed), which is estimated based on the user's level of interest or concern in the information corresponding to the utterance of the display target (or the target to be displayed). Furthermore, for example, the determination unit 135 may determine to present a scent to a user by taking into consideration the user's level of understanding of the information corresponding to the utterance of the display target (or the target to be displayed), which is estimated based on the degree of familiarity indicating to what extent the information corresponding to the utterance of the display target (or the target to be displayed) is information whose content is familiar to the user (for example, to what extent the information is known before the utterance starts). Furthermore, for example, the determination unit 135 may determine to present a scent to the user by taking into consideration the user's level of understanding of information corresponding to the utterance of the display target (or the target to be displayed), which is estimated based on the degree of repetition (for example, the degree of repetition in a series of utterances) of information corresponding to the utterance of the display target (or the target to be displayed) repeated by the display target (or the target to be displayed). That is, the determination unit 135 may determine to present a scent to the user based on, for example, the user's recognition of the scent of the display target (or the target to be displayed), the gaze movement distance required to move the user's gaze to the display target to which the user's gaze is to be guided, and the user's level of understanding of information corresponding to the utterance of the display target (or the target to be displayed).In this case, the determination unit 135 may perform processing to determine to present a scent to the user such that, for example, the higher the user's level of understanding of information corresponding to the utterance of the display target (or the target of the display target), the higher the likelihood of determining to present a scent to the user. Furthermore, the determination unit 135 may perform processing to determine to present a scent to the user such that, for example, the higher the user's level of understanding of both information corresponding to the utterance of the first display target (or the target of the first display target) and information corresponding to the utterance of the second display target (or the target of the second display target), the higher the likelihood of determining to present a scent to the user. Furthermore, the determination unit 135 may perform processing to determine to present a scent to the user such that, for example, the higher the user's level of understanding of information corresponding to the utterance of the second display target (or the target of the second display target) is compared to the user's level of understanding of information corresponding to the utterance of the first display target (or the target of the first display target), the higher the likelihood of determining to present a scent to the user.

[0094] (Variation 7: Taking into account the preference for the video work to be displayed as a character) In the above embodiment, the determination unit 135 determines to present a scent to a user based on the user's recognition of the scent of the display object (or the target of the display object) and the gaze movement distance required to move the user's gaze toward the display object to which the user's gaze is to be guided. In this case, if the display object (or the target of the display object) is a character, the determination unit 135 may determine to present a scent to the user by taking into account the user's preference for a video work to which the display object (or the target of the display object) belongs (or a video work linked to the display object (or the target of the display object)). In other words, the determination unit 135 may determine to present a scent to a user by taking into account the user's preference for a video work in which a display object (or the target of the display object) that is a character appears. For example, the determination unit 135 may determine to present a scent to a user by taking into account the user's preference for a video work to which a first display object (or the target of the first display object) that is a character belongs (hereinafter referred to as a "first video work") Furthermore, for example, the determination unit 135 may determine to present a scent to a user by taking into consideration the user's preference for a video work (hereinafter referred to as "second video work") to which a second display object (or an object of the second display object) that is a character belongs (as appropriate). Furthermore, for example, in order to guide the user's gaze to the second display object while the user is looking at the first display object, the determination unit 135 may determine to present a scent to a user when the user's preference for the second video work to which the second display object (or an object of the second display object) that is a character belongs is higher than the user's preference for the first video work to which the first display object (or an object of the first display object) that is a character belongs. Note that the user's preference for a video work may be estimated based on, for example, the characteristics of the characters appearing in the video work, the characteristics of the clothing worn by the characters appearing in the video work, or the fashionability of the clothing.

[0095] (Variation 8: Consider the preference for the character wearing the costume) In the above embodiment, the determination unit 135 determines to present a scent to a user based on the user's recognition of the scent of the display target (or the target of the display target) and the gaze movement distance required to move the user's gaze to the display target to which the user's gaze is to be guided. In this case, if the display target (or the target of the display target) is a worn costume, the determination unit 135 may determine to present a scent to the user by taking into account the user's preference for a character to which the display target (or the target of the display target) belongs (or a character linked to the display target (or the target of the display target)). In other words, the determination unit 135 may determine to present a scent to a user by taking into account the user's preference for a character wearing the display target (or the target of the display target) that is a worn costume. For example, the determination unit 135 may determine to present a scent to a user by taking into account the user's preference for a character to which a first display target (or the target of the first display target) that is a worn costume belongs (hereinafter referred to as a "first character" as appropriate). Furthermore, for example, the determination unit 135 may determine to present a scent to the user taking into consideration the user's preference for a character (hereinafter referred to as "second character") to which the second display object (or object of the second display object) that is the worn costume belongs (as appropriate, hereinafter). Furthermore, for example, in order to guide the user's gaze to the second display object while the user is looking at the first display object, the determination unit 135 may determine to present a scent to the user when the user's preference for the second character to which the second display object (or object of the second display object) that is the worn costume belongs is higher than the user's preference for the first character to which the first display object (or object of the first display object) that is the worn costume belongs.

[0096] When the display subject (or the subject of the display subject) is a worn outfit, the determination unit 135 may determine to present a scent to the user by taking into consideration the user's preference for the fashion of the outfit (which may be a cosplay outfit) to which the display subject (or the subject of the display subject) belongs (or the fashion of the outfit estimated from the display subject (or the subject of the display subject)). That is, the determination unit 135 may determine to present a scent to the user by taking into consideration the fashion of the outfit (which may be a cosplay outfit) to which the display subject (or the subject of the display subject) belongs. For example, the determination unit 135 may determine to present a scent to the user by taking into consideration the user's preference for the fashion of the outfit (hereinafter referred to as "first fashion") to which a first display subject (or the subject of the first display subject) belongs, which is the worn outfit. Furthermore, for example, the determination unit 135 may determine to present a scent to the user by taking into consideration the user's preference for the fashion of the outfit (hereinafter referred to as "second fashion") to which a second display subject (or the subject of the second display subject) belongs, which is the worn outfit. Furthermore, for example, the determination unit 135 may determine to present a scent to the user when the user's preference for the second fashion to which the second display object (or the object of the second display object) that is the worn outfit belongs is higher than the user's preference for the first fashion to which the first display object (or the object of the first display object) that is the worn outfit belongs, in order to guide the user's gaze to the second display object when the user is looking at the first display object. Furthermore, for example, the determination unit 135 may determine to present a scent to the user when the characteristics of the second fashion to which the second display object (or the object of the second display object) that is the worn outfit belongs are more similar to the characteristics of a fashion that the user has a high purchasing tendency to (which may be fashion as a cosplay costume) than the characteristics of the first fashion to which the first display object (or the object of the first display object) that is the worn outfit belongs, in order to guide the user's gaze to the second display object when the user is looking at the first display object.In other words, in order to guide the user's gaze to the second display object while the user is looking at the first display object, the decision unit 135 may decide to present a scent to the user when the similarity between the characteristics of the second fashion to which the second display object (or the object of the second display object) which is the worn outfit belongs and the characteristics of the fashion which the user is likely to purchase is higher than the similarity between the characteristics of the first fashion to which the first display object (or the object of the first display object) which is the worn outfit belongs and the characteristics of the fashion which the user is likely to purchase.

[0097] (Variation 9: Taking into account the cosplayer's preference for the cosplay associated with the display target) In the above embodiment, the determination unit 135 determines to present a scent to a user based on the user's recognition of the scent of the display target (or the target of the display target) and the gaze movement distance required to move the user's gaze to the display target to which the user's gaze is to be directed. In this case, if the display target (or the target of the display target) is a worn costume, the determination unit 135 may determine to present a scent to the user by taking into account the user's preference for a wearer (i.e., a cosplayer) of clothing that is pre-defined as a cosplay costume associated with the display target (or the target of the display target) as the cosplay costume. In other words, the determination unit 135 may determine to present a scent to the user by taking into account the user's preference for a cosplayer wearing the cosplay costume of the display target (or the target of the display target), which is the worn costume. For example, the determination unit 135 may determine to present a scent to the user by taking into account the user's preference for a cosplayer (hereinafter referred to as "first cosplayer") wearing a cosplay costume of a first display target (or target of the first display target), which is a worn costume. Furthermore, for example, the determination unit 135 may determine to present a scent to the user by taking into account the user's preference for a cosplayer (hereinafter referred to as "second cosplayer") wearing a cosplay costume of a second display target (or target of the second display target), which is a worn costume. Furthermore, for example, in order to guide the user's gaze to the second display target while the user is looking at the first display target, the determination unit 135 may determine to present a scent to the user when the user's preference for the second cosplayer wearing a cosplay costume of the second display target (or target of the second display target), which is a worn costume, is higher than the user's preference for the first cosplayer wearing a cosplay costume of the first display target (or target of the first display target), which is a worn costume. It should be noted that the cosplayer wearing the cosplay costume of the display target (or the target of the display target) may be, for example, a person who actually exists in the real world, or may be an avatar in a virtual space.

[0098] When the display target (or the target of the display target) is a character, the determination unit 135 may determine to present a scent to the user, taking into consideration the user's preference for a wearer (i.e., a cosplayer) of clothing that is predetermined and linked to the display target (or the target of the display target) (or the costume worn by the display target (or the target of the display target)) as a cosplay costume worn by the display target (or the target of the display target) (or the costume worn by the target of the display target (or the target of the display target)). That is, the determination unit 135 may determine to present a scent to the user, taking into consideration the user's preference for a cosplayer wearing a cosplay costume that is a costume worn by the display target (or the target of the display target) who is a character. For example, the determination unit 135 may determine to present a scent to the user, taking into consideration the user's preference for a cosplayer (hereinafter referred to as "first cosplayer") wearing a cosplay costume that is a costume worn by a first display target (or the target of the first display target) who is a character. Furthermore, for example, the determination unit 135 may determine to present a scent to a user by taking into consideration the user's preference for a cosplayer (hereinafter referred to as "second cosplayer") wearing a cosplay costume that is the same as the costume worn by a second display object (or target of the second display object), which is a character. Furthermore, for example, in order to guide the user's gaze to the second display object when the user is looking at the first display object, the determination unit 135 may determine to present a scent to a user when the user's preference for a second cosplayer wearing a cosplay costume that is the same as the costume worn by a second display object (or target of the second display object), which is a character, is higher than the user's preference for a first cosplayer wearing a cosplay costume that is the same as the costume worn by a first display object (or target of the first display object), which is a character. Note that the cosplayer wearing a cosplay costume that is the same as the costume worn by the display object (or target of the display object) may be, for example, a real person in the real world or an avatar in a virtual space.

[0099] When the display subject (or the target of the display subject) is a worn outfit, the determination unit 135 may determine to present a scent to the user, taking into consideration the user's preference for clothes having similar characteristics (clothing characteristics) to predetermined clothes that are linked to the display subject (or the target of the display subject) as cosplay costumes for the display subject (or the target of the display subject). For example, the determination unit 135 may determine to present a scent to the user, taking into consideration the user's preference for clothes having similar characteristics regarding appearance, external appearance, and exterior (or fashionability for appearance, external appearance, and exterior) to predetermined clothes that are linked to the display subject (or the target of the display subject) as cosplay costumes for the display subject (or the target of the display subject). Furthermore, for example, the determination unit 135 may determine to present a scent to a user by taking into consideration the user's preference for features related to functionality (or fashion for functionality) of clothing similar in features to clothing previously determined and linked to the display subject (or the display subject) as a cosplay costume for the display subject (or the display subject). Furthermore, when the display subject (or the display subject) is a worn costume, the determination unit 135 may determine to present a scent to a user by taking into consideration the similarity of purchasing trends with purchasers of clothing previously determined and linked to the display subject (or the display subject) as a cosplay costume for the display subject (or the display subject).

[0100] When the display subject (or the target of the display subject) is a character, the determination unit 135 may determine to present a scent to the user, taking into consideration the user's preference for clothing having similar characteristics (clothing characteristics) to predetermined clothing linked to the display subject (or the target of the display subject) (or the costume worn by the display subject (or the target of the display subject)) as a cosplay costume of the costume worn by the display subject (or the target of the display subject). For example, the determination unit 135 may determine to present a scent to the user, taking into consideration the user's preference for clothing having similar characteristics (clothing characteristics) regarding appearance, external appearance, and exterior (or fashionability for appearance, external appearance, and exterior) to predetermined clothing linked to the display subject (or the target of the display subject) (or the costume worn by the display subject (or the target of the display subject)) as a cosplay costume of the costume worn by the display subject (or the target of the display subject). Furthermore, for example, the determination unit 135 may determine to present a scent to a user by taking into consideration the user's preference for features related to the functionality (or fashionability for functionality) of clothing similar in features to predetermined clothing linked to the display subject (or the display subject) (or the clothing worn by the display subject (or the display subject)) as a cosplay costume of the clothing worn by the display subject (or the display subject's target). Furthermore, when the display subject (or the display subject's target) is a character, the determination unit 135 may determine to present a scent to a user by taking into consideration the similarity of purchasing trends with purchasers of clothing similar in features (clothing characteristics) to predetermined clothing linked to the display subject (or the display subject) (or the clothing worn by the display subject (or the display subject's target)) as a cosplay costume of the clothing worn by the display subject (or the display subject's target).

[0101] (Variation 10: Taking into account the degree of matching of the scent to the image on the display screen) In the above embodiment, the determination unit 135 determines to present a scent to the user based on the user's recognition of the scent of the display target (or the target of the display target) and the gaze movement distance required to move the user's gaze to the display target to which the user's gaze is to be directed. In this case, the determination unit 135 may also determine to present a scent to the user by taking into consideration the degree of matching (matching degree) between the scent of the display target (or the target of the display target) and an image on the display screen on which the display target (or the target of the display target) is displayed (e.g., an image or another display target displayed on the same display screen as the display target (or the target of the display target)). For example, the determination unit 135 may also determine to present a scent to the user by taking into consideration the degree of matching between the image on the display screen of the first display target (or the target of the first display target) and the scent of the second display target (or the target of the second display target). Furthermore, for example, the determination unit 135 may determine to present a scent to the user by taking into consideration the degree of matching between an image related to the first display object (or an object of the first display object) among images on the display screen of the first display object (or an object of the first display object) and an aroma of the second display object (or an object of the second display object). Furthermore, for example, the determination unit 135 may determine to present a scent to the user by taking into consideration the degree of matching between a story (overall flow of the image) of the image on the display screen of the first display object (or an object of the first display object) and an aroma of the second display object (or an object of the second display object). Furthermore, for example, the determination unit 135 may determine to present a scent to the user by taking into consideration the degree of matching between a concept (image suggested by the image) of the image on the display screen of the first display object (or an object of the first display object) and an aroma of the second display object (or an object of the second display object). Furthermore, for example, the determination unit 135 may determine to present a scent to the user by taking into consideration the degree of matching between the scent characteristics of the second display target (or the target of the second display target) and the scent characteristics of the image estimated from the image on the display screen of the first display target (or the target of the first display target). Note that the degree of matching between the scent of the display target (or the target of the display target) may be an index based on the degree of improvement in the sense of realism (which may be a sense of immersion or unity, etc.) given to the user by presenting the scent together with the image.For example, the degree of matching of the display object (or the object to be displayed) with the scent may be an index based on the degree of improvement in the sense of realism given to the user by presenting only the video. Also, for example, the degree of matching of the display object (or the object to be displayed) with the scent may be an index based on the degree of improvement in the sense of realism given to the user by presenting only the scent. Also, for example, the degree of matching of the display object (or the object to be displayed) with the scent may be an index based on the degree of improvement in the sense of realism given to the user by presenting only the video and the degree of improvement in the sense of realism given to the user by presenting only the scent.

[0102] (Variation 11: Estimating awareness based on the Proust effect) In the above embodiment, the user's recognition of the scent of the display target (or the object of the display target) may be a degree corresponding to the ease with which memories, emotions, etc. associated with the scent are evoked when smelling the scent of the display target (or the object of the display target), based on the phenomenon that a specific scent evokes memories, emotions, etc. associated with that scent (the Proust effect). That is, the estimation unit 133 may estimate the ease with which memories, emotions, etc. associated with the scent are evoked when smelling the scent of the display target (or the object of the display target), and estimate the degree corresponding to the estimated ease as the user's recognition of the scent of the display target (or the object of the display target).

[0103] (Variation 12: Estimating the preference for the clothing worn by the display subject) In the above embodiment, the user's preference for the display subject (or the target of the display subject) may be, for example, the user's preference for the costume worn by the display subject (or the target of the display subject) when the display subject (or the target of the display subject) is a character. That is, the estimation unit 133 may estimate the user's preference for the costume worn by the display subject (or the target of the display subject) and estimate the estimated preference as the user's preference for the display subject (or the target of the display subject). For example, the estimation unit 133 may estimate the user's preference for the costume worn by the display subject (or the target of the display subject) based on costume information of a cosplay costume corresponding to the costume worn by the display subject (or the target of the display subject), and estimate the estimated preference as the user's preference for the display subject (or the target of the display subject). For example, the estimation unit 133 may estimate a user's preference for an outfit worn by the display subject (or the display subject) based on a user's behavior history (e.g., purchase history, posting history, browsing history, search history, operation history, usage history, etc.) for an outfit proposed based on costume information about a cosplay outfit corresponding to the outfit worn by the display subject (or the display subject), and estimate the estimated preference as the user's preference for the display subject (or the display subject). For example, the estimation unit 133 may estimate a user's preference for an outfit worn by the display subject (or the display subject) based on a user's behavior history for an outfit proposed based on costume information about an outfit similar to a cosplay outfit corresponding to the outfit worn by the display subject (or the display subject), and estimate the estimated preference as the user's preference for the display subject (or the display subject). Note that the outfit worn by the display subject (or the display subject) may be an outfit created by generative artificial intelligence (generative AI) such as a generative pre-trained transformer (GPT). For example, the clothes worn by the display subject (or the target of the display subject) may be clothes output using information about the display subject (or the target of the display subject) as input. Also, for example, the clothes worn by the display subject (or the target of the display subject) may be clothes output using information about the display subject (or the target of the display subject) and information about the scent of the display subject (or the target of the display subject) as input.Furthermore, for example, the clothes worn by the display target (or the subject of the display target) may be clothes output using information including the user information of the user as input.

[0104] Examples of clothing worn by the display subject (or the subject of the display subject) include tops, T-shirts, camisoles, wrap tops, cut-and-sew tops, blouses, shirts, knitwear, no-sew knitwear (registered trademark), sweaters, vests, cardigans, outerwear, jackets, collarless jackets, rider jackets, blousons, down jackets, coats, trench coats, ponchos, capes, pants, denim pants, chino pants, slacks, all-in-ones, overalls, skirts, denim skirts, wrap skirts, dresses, shirt dresses, jumper skirts, jumper dresses, dresses, bags, shoes, boots, booties, ballet shoes, pointe shoes, fashion accessories, hair accessories, bonnets, head dresses, headbands, clips, combs, barrettes, accessories, bags, wallets, pochettes, underwear, women's The costume may include at least any of the following: foundation, body foundation, brassiere, shorts, undershorts, stage shorts, girdle, control bottoms, corrective underwear, lingerie, underwear, knit innerwear, pajamas, loungewear, legwear, tights, socks, leg covers, garters, leggings, leg warmers, arm warmers, stockings, spats, panniers, bloomers, drawers, hats, swimsuits, kimonos, yukatas, ballet costumes, tutus, classic tutus, romantic tutus, opera tutus, georgette, tunics, tunic dresses, leotards, ballet clothing, ballet tights, ballet shorts, ballet underwear, ballet corrective underwear, all-in-one ballet clothing, wedding dresses, school uniforms, gymnastics uniforms, fancy dress clothing, special athletic clothing, special athletic shoes, stuffed animal costumes, and the like.

[0105] (Variation 13: Estimating the recognition level of the scent of the clothing worn by the display target) In the above embodiment, the user's recognition of the scent of the display target (or the target of the display target) may be, for example, the user's recognition of the scent of the costume worn by the display target (or the target of the display target) (e.g., a scent that evokes the costume worn by the display target (or the target of the display target)) if the display target (or the target of the display target) is a character. That is, the estimation unit 133 may estimate the user's recognition of the scent of the costume worn by the display target (or the target of the display target) and estimate the estimated recognition as the user's recognition of the scent of the costume worn by the display target (or the target of the display target). For example, the estimation unit 133 may estimate the user's recognition of the scent of the costume worn by the display target (or the target of the display target) based on costume information of a cosplay costume corresponding to the costume worn by the display target (or the target of the display target), and estimate the estimated recognition as the user's recognition of the scent of the display target (or the target of the display target). For example, the estimation unit 133 may estimate a user's recognition of the scent of the costume worn by the display target (or the target to be displayed) based on the user's behavior history with respect to a fragrance suggested based on costume information of a cosplay costume corresponding to the costume worn by the display target (or the target to be displayed), and estimate the estimated recognition as the user's recognition of the scent of the display target (or the target to be displayed). For example, the estimation unit 133 may estimate a user's recognition of the scent of the costume worn by the display target (or the target to be displayed) based on the user's behavior history with respect to a fragrance suggested based on costume information of a costume similar to the cosplay costume corresponding to the costume worn by the display target (or the target to be displayed), and estimate the estimated recognition as the user's recognition of the scent of the display target (or the target to be displayed).

[0106] (Variation 14: Estimating user recognition using user information of other users) In the above embodiment, if the amount of user information used to estimate the user's recognition level of the scent of the display target (or the target of the display target) is insufficient, it may be impossible to appropriately (or accurately) estimate the user's recognition level of the scent of the display target (or the target of the display target). Therefore, if the amount of user information used to estimate the user's recognition level of the scent of the display target (or the target of the display target) is insufficient, the estimation unit 133 may estimate the user's recognition level of the scent of the display target (or the target of the display target) using the user information of another user. For example, the estimation unit 133 may identify another user whose user information (e.g., user information stored in the user information storage unit 121) is similar to that of the user, in part or in whole, and estimate the other user's recognition level of the scent of the display target (or the target of the display target) estimated based on the user information of the identified other user as the user's recognition level of the scent of the display target (or the target of the display target). That is, the determination unit 135 may determine to present a scent to the user based on, for example, the recognition of other users (other users whose user information is similar to that of the user) for the scent of the display target (or the target of the display target) and the gaze movement distance required to move the user's gaze to the display target to which the user's gaze is to be guided. At this time, the estimation unit 133 may, for example, identify other users whose attributes, learning goals, etc. are similar to that of the user, identify other users whose purchase histories, posting histories, etc. are similar to that of the user, identify other users whose preferences for characters, clothing, cosplay costumes, scents, etc. are estimated to be similar to that of the user, identify other users whose recognition of the scent of the display target (or the target of the display target) is similar to that of the user, or identify other users whose preferences for the display target (or the target of the display target) are estimated to be similar to that of the user.

[0107] (Variation 15: Estimating user preferences using user information of other users) In the above embodiment, if the amount of user information used to estimate the user's preference for the display object (or the target of the display object) is insufficient, it may be impossible to appropriately (or accurately) estimate the user's preference for the display object (or the target of the display object). Therefore, if the amount of user information used to estimate the user's preference for the display object (or the target of the display object) is insufficient, the estimation unit 133 may estimate the user's preference for the display object (or the target of the display object) using the user information of another user. For example, the estimation unit 133 may identify another user whose user information (e.g., user information stored in the user information storage unit 121) is similar to that of the user, in part or in whole, and estimate the other user's preference for the display object (or the target of the display object), estimated based on the user information of the identified other user, as the user's preference for the display object (or the target of the display object). That is, the determination unit 135 may determine to present a scent to the user based on, for example, the user's (or other users whose user information is similar to that of the user) recognition of the scent of the display target (or the target of the display target), the other users' (other users whose user information is similar to that of the user) preference for the display target (or the target of the display target), and the gaze movement distance required to move the user's gaze toward the display target to which the user's gaze is to be directed. Note that at this time, the estimation unit 133 may, for example, identify other users whose attributes or learning goals are similar to that of the user, identify other users whose purchase histories or posting histories are similar to that of the user, identify other users whose preferences for characters, clothing, cosplay costumes, scents, etc. are estimated to be similar to that of the user, identify other users whose recognition of the scent of the display target (or the target of the display target) is similar to that of the user, or identify other users whose preferences for the display target (or the target of the display target) are estimated to be similar to that of the user.

[0108] (Variation 16: Applying the scent to be displayed based on predetermined conditions) In the above embodiment, the scent of the display object may be, for example, a scent that evokes the display object (or an object of the display object) and is applied based on predetermined conditions. For example, the scent of the display object may be a scent that is applied only during a period based on predetermined conditions. For example, the scent of the display object may be a scent that is applied only during a predetermined period depending on display information such as the display position and display time of the display object (which may not be the display object). For example, the scent of the display object may be a scent that is applied when the display object (which may not be the display object) enters a predetermined display area and is applied until the display object (which may not be the display object) leaves the predetermined display area.

[0109] The scent of the display object may be, for example, a scent applied depending on the relationship between the display object (which may not be the display object) and the user. For example, the scent of the display object may be a scent applied depending on the relationship based on the user's behavioral history with the display object (which may not be the display object). For example, the scent of the display object may be a scent applied when the user has purchased a product related to the display object (which may not be the display object). Note that if the user has not purchased a product related to the display object (which may not be the display object), for example, a scent that is predetermined to be associated with a case where the user has not purchased a product related to the display object (which may not be the display object) may be applied to the scent of the display object.

[0110] The scent of the display object may be, for example, a scent applied depending on the relationship between the display object (which may not be the display object) and the user. For example, the scent of the display object may be a scent applied depending on the positional relationship or operational relationship between the display object (which may not be the display object) and the user. For example, the scent of the display object may be a scent applied when the user operates the display object (which may not be the display object) (for example, by clicking or tapping). Furthermore, for example, the scent of the display object may be a scent applied depending on the relationship based on the user's behavioral history with respect to the display object (which may not be the display object). For example, the scent of the display object may be a scent applied when the user operates the display object (which may not be the display object). Note that when the user does not operate the display object (which may not be the display object), for example, a scent that is predetermined to be associated with the case where the user does not operate the display object (which may not be the display object) may be applied to the scent of the display object.

[0111] The scent of the display target may be, for example, a scent that evokes the image of the display target (or the target of the display target) and is applied based on predetermined conditions that vary for each display target (or the target of the display target). Note that the predetermined conditions may be, for example, conditions that are predetermined by the user, or conditions that are predetermined by the administrator of the display device 10, the administrator of the aroma control device 100, the administrator of the video providing server 200, etc. Furthermore, the scent applied based on the predetermined conditions may be, for example, a scent that is predetermined by the user, or conditions that are predetermined by the administrator of the display device 10, the administrator of the aroma control device 100, the administrator of the video providing server 200, etc.

[0112] (Variation 17: Processing the display object created using generation AI) In the above embodiment, the display object may be, for example, a display object created by a generating AI such as GPT. The display object may be, for example, a display object output using information of the display object (or the object of the display object) as input.

[0113] The first display object may be, for example, a display object that is output using information of the first display object (or a target of the first display object) as an input. The first display object may also be, for example, a display object that is output using information of the second display object (or a target of the second display object) as an input. The first display object may also be, for example, a display object that is output using information of the first display object (or a target of the first display object) and information of the second display object (or a target of the second display object) as input. The first display object may also be, for example, a display object that is output using information including user information of a user as an input.

[0114] The second display object may be, for example, a display object that is output using information of the second display object (or a target of the second display object) as an input. The second display object may also be, for example, a display object that is output using information of the first display object (or a target of the first display object) as an input. The second display object may also be, for example, a display object that is output using information of the first display object (or a target of the first display object) and information of the second display object (or a target of the second display object) as input. The second display object may also be, for example, a display object that is output using information including user information of a user as an input.

[0115] (Variation 18: Processing is performed using learning materials created using Animemo (registered trademark)) In the above embodiment, the learning materials may be created using a learning method called Animemo (registered trademark) (registered trademark No. 6768843). Animemo (registered trademark) is a learning method aimed at teaching knowledge related to English and English conversation. It creates a personalized vocabulary book (or dictionary) for each user, corresponding to each video work, using subtitle information (or dialogue information) extracted by the user performing a specific operation while watching the video work (mainly animation works, character works, etc.). Animemo (registered trademark) uses video works primarily targeted at viewers born and raised in the same culture as the user (i.e., video works produced in the user's culture). Because such video works are most easily understood by users, they can be considered to stimulate the user's five senses more effectively than video works primarily targeted at viewers born and raised in the culture of the language the user is learning. Furthermore, by using video works tailored to the user's preferences, the user can memorize the information naturally in their daily lives without feeling like they are learning. Such a learning method is called Animemo (registered trademark) and also called Animemo Method (registered trademark) (registered trademark No. 6756312). Also, the vocabulary book (or dictionary) created in this way is called Animemo Vocabulary (registered trademark) (registered trademark No. 6757904) or Animemo English Words (registered trademark) (registered trademark No. 6756311). Technology for creating such a vocabulary book (or dictionary) using Animemo (registered trademark) is disclosed, for example, in Japanese Patent Application Laid-Open No. 2023-182491, Japanese Patent Application Laid-Open No. 2024-016496, and Japanese Patent Application Laid-Open No. 2024-031185. The fragrance control device 100 may perform processing according to the above embodiment using the technology disclosed in Patent Publication No. 2023-182491, Patent Publication No. 2024-016496, Patent Publication No. 2024-031185, etc. (or in combination with the technology disclosed in Patent Publication No. 2023-182491, Patent Publication No. 2024-016496, Patent Publication No. 2024-031185, etc.).

[0116] <5. Embodiment 2> Conventionally, there are known techniques for evaluating the sense of realism caused by scent. For example, it is known that the sense of realism caused by a video can be enhanced when a scent is presented in conjunction with the video compared to when only a video is presented (see Non-Patent Document 2 below).

[0117] [Non-patent document 2] K.Tomono, A.Tomono “Cross-Modal Effect of Presenting Food Images on Taste Appetite”, Sensors 2020, 20(22), 6615, [online], [Retrieved March 15, 2020], Internet<https: / / doi.org / 10.3390 / s20226615>

[0118] However, this is the case when a scent that matches the video (a scent that is associated with the video when viewing the video) is presented, and it is thought that the effect of realism is difficult to obtain when a scent that does not match the video is presented. By presenting a scent that matches the video in conjunction with the video, the user's five senses are stimulated, making it easier to recall the user's past experiences, making it easier to obtain the effect of realism, whereas presenting a scent that does not match the video does not make it easier to recall the user's past experiences, making it difficult to obtain the effect of realism. In other words, even when a scent is presented in conjunction with the video, the effect of realism given to the user differs depending on whether the scent is presented as a scent that matches the video or a scent that does not match the video. This also applies when the user has low awareness of the scent and is unable to recognize that it is a scent that matches the video.

[0119] Furthermore, even when scents are presented in conjunction with the same video (for example, when the video and scent presented are the same for each user), the sense of realism (depth of realism) felt by different users may differ. For example, if a user's past experience related to a video is memorable to the user, presenting the scent of that video may be able to make the user feel a deeper sense of realism from that video. Also, for example, if a user has a strong emotional attachment to a video (for example, if the user has special feelings or emotions toward the video), presenting the scent of that video may be able to make the user feel a deeper sense of realism from that video.

[0120] In the second embodiment, a process is described in which it is determined to present a scent to a user based on the matching degree between a video related to a first display target and a scent related to a second display target (an index indicating the degree of improvement in the sense of realism (which may be a sense of immersion, a sense of unity, etc.) subjectively felt by each user). The degree of improvement in the sense of realism may be estimated based on information indicating changes in the user's biometric information (e.g., blood flow rate, etc.) (any information is acceptable as long as it is information that allows for analysis of changes in the user's biometric information). In other words, the matching degree according to the second embodiment may be an index indicating the degree of improvement in the sense of realism estimated based on information indicating changes in the user's biometric information. In the second embodiment, the same descriptions as those in the above embodiments will be omitted as appropriate. Furthermore, in the second embodiment, as in the above embodiments, the term "display target" may be appropriately replaced with "subject of the display target" or "subject of the display target (or subject of the display target)." In other words, the term "display target" may be appropriately replaced with "subject of the display target" or "subject of the display target (or subject of the display target)." For example, "first display target" can be appropriately read as "target of first display target" or "first display target (or target of first display target)". Also, for example, "second display target" can be appropriately read as "target of second display target" or "second display target (or target of second display target)".

[0121] The determination unit 135 determines to present a scent (the scent of the second display target) to the user based on the degree of matching between the image on the display screen of the first display target and the scent of the second display target. For example, the determination unit 135 determines to present a scent (the scent of the second display target) to the user based on the degree of matching between the image on the display screen of the first display target and the scent of the second display target, taking into account the user's recognition of the scent of the second display target. The determination unit 135 may also determine to present a scent (the scent of the third display target) to the user based on the degree of matching between the image on the display screen of the first display target and the scent of a display target linked to the second display target (hereinafter referred to as the "third display target" as appropriate) (or may determine to present the scent of the second display target to the user). For example, the determination unit 135 may take into account the user's recognition of the scent of the third display target and determine to present the scent (the scent of the third display target) to the user based on the degree of matching between the image on the display screen of the first display target and the scent of the third display target (or may determine to present the scent of the second display target to the user). Note that the user's recognition of the scent of the second display target and the user's recognition of the scent of the third display target may be estimated by the estimation unit 133.

[0122] The determination unit 135 may determine to present a scent (the scent of the second display target) to the user based on the degree of matching between an image associated by the user with the first display target and the scent of the second display target. For example, the determination unit 135 may determine to present a scent (the scent of the second display target) to the user based on the degree of matching between an image associated by the user with the first display target and the scent of the second display target, taking into account the user's recognition of the scent of the second display target. Furthermore, the determination unit 135 may determine to present a scent (the scent of the third display target) to the user based on the degree of matching between an image associated by the user with the first display target and the scent of the third display target (or may determine to present the scent of the second display target to the user). For example, the determination unit 135 may take into consideration the user's recognition of the scent of the third display target and, based on the degree of matching between the image associated by the user from the first display target and the scent of the third display target, determine to present the scent (the scent of the third display target) to the user (or may determine to present the scent of the second display target to the user). Note that the image associated by the user from the first display target may be, for example, an image estimated based on data of other users, or an image estimated based on data personalized for each user.

[0123] The determination unit 135 may determine to present a scent (the scent of the second display target) to the user based on the degree of matching between an image associated by the user from the image on the display screen of the first display target and the scent of the second display target. For example, the determination unit 135 may determine to present a scent (the scent of the second display target) to the user based on the degree of matching between an image associated by the user from the image on the display screen of the first display target and the scent of the second display target, taking into account the user's recognition of the scent of the second display target. Furthermore, the determination unit 135 may determine to present a scent (the scent of the third display target) to the user (or may determine to present the scent of the second display target to the user) based on the degree of matching between an image associated by the user from the image on the display screen of the first display target and the scent of the third display target. For example, the determination unit 135 may take into consideration the user's recognition of the scent of the third display target and, based on the degree of matching between the image associated by the user from the image on the display screen of the first display target and the scent of the third display target, determine to present the scent (the scent of the third display target) to the user (or may determine to present the scent of the second display target to the user). Note that the image associated by the user from the image on the display screen of the first display target may be, for example, an image estimated based on data of other users, or an image estimated based on data personalized for each user.

[0124] The determination unit 135 determines to present a scent (scent associated with the second display object) to the user when the matching degree between the video associated with the first display object and the scent associated with the second display object satisfies a predetermined condition. For example, the determination unit 135 determines to present a scent (scent associated with the second display object) to the user when the matching degree between the video associated with the first display object and the scent associated with the second display object does not exceed a predetermined threshold. On the other hand, the determination unit 135 determines to present a scent different from the scent associated with the second display object (that scent) to the user when the matching degree between the video associated with the first display object and the scent associated with the second display object does not satisfy a predetermined condition. For example, the determination unit 135 determines to present a scent different from the scent associated with the second display object (that scent) to the user when the matching degree between the video associated with the first display object and the scent associated with the second display object exceeds a predetermined threshold. At this time, the determination unit 135 may determine to present to the user a scent related to the second display object that is different from the scent related to the second display object (that scent), for example, a scent related to the second display object that is more recognized by the user than the scent related to the second display object (that scent). At this time, the determination unit 135 may also determine to present to the user a scent related to the second display object that is different from the scent related to the second display object (that scent), for example, a scent related to the second display object whose matching degree with the video related to the first display object (that video) does not exceed a predetermined threshold. At this time, the determination unit 135 may also determine to present to the user a scent related to the second display object that is different from the scent related to the second display object (that scent), for example, a scent related to the second display object that is more recognized by the user than the scent related to the second display object (that scent) and whose matching degree with the video related to the first display object (that video) does not exceed a predetermined threshold.

[0125] When the degree of matching between the video related to the first display object and the scent related to the second display object exceeds a predetermined threshold, the determination unit 135 may change the display object to which the user's gaze is to be guided to a display object (hereinafter referred to as a "fourth display object" as appropriate) whose scent is more recognized by the user than the scent related to the second display object (that scent). At this time, the determination unit 135 may change the display object to which the user's gaze is to be guided to, for example, a fourth display object whose scent is more recognized by the user than the scent related to the second display object (that scent). At this time, the determination unit 135 may also change the display object to which the user's gaze is to be guided to, for example, a fourth display object whose matching degree with the video related to the first display object (that video) does not exceed a predetermined threshold. In addition, at this time, the determination unit 135 may change the display object to which the user's gaze is to be guided to, for example, a fourth display object whose scent is more recognizable to the user than the scent related to the second display object (that scent) and whose matching degree with the video related to the first display object (that video) does not exceed a predetermined threshold. Then, the determination unit 135 may decide to present the scent of the fourth display object to the user.

[0126] <6. Effects> At least the following matters will become clear from the description of the embodiments and the accompanying drawings.

[0127] Aspect 1 is characterized by having an estimation unit that estimates a user's awareness of the scent of a second display object, which is a display object that is different from a first display object that the user is visually viewing and is a display object to which the user's gaze is to be guided, and a decision unit that decides to present the scent to the user based on the awareness estimated by the estimation unit and the gaze movement distance required for the user to move their gaze from the first display object to the second display object.

[0128] According to the first aspect, for example, the scent of the second display object (or the object of the second display object) can be presented to a user who has a high level of recognition for the scent of the second display object (or the object of the second display object), so the scent can be used to effectively guide the user's gaze to the display object. Also, for example, if a user who is visually viewing the first display object has a high level of recognition for the scent of the second display object (or the object of the second display object), the scent of the second display object (or the object of the second display object) can be presented, so the scent can give the user an unpleasant feeling. Such inconsistent presentation of scents can encourage the user to explore the second display object (or the object of the second display object), so the scent can be used to effectively guide the user's gaze to the display object. Also, for example, the scent of the second display object (or the object of the second display object) can be presented to a user who experiences little strain in moving their gaze to the second display object, so the scent can be used to effectively guide the user's gaze to the display object. Furthermore, for example, when the burden on a user who is visually viewing a first display target to move their gaze to a second display target is small, the scent of the second display target (or an object of the second display target) can be presented, and the scent can be used to effectively guide the user's gaze to the display target. Furthermore, for example, compared to intentionally guiding the user's gaze to a display target using visual or auditory information, the use of olfactory stimulation can encourage the user to unconsciously guide their gaze, and therefore the scent can be used to effectively guide the user's gaze to the display target.

[0129] Aspect 2 is characterized in that, in aspect 1, it is decided to present the scent to the user based on the line-of-sight movement distance calculated based on the distance and direction between the display positions of the first display object and the second display object.

[0130] According to the second aspect, for example, the scent of the second display target (or an object of the second display target) can be presented to a user who experiences little strain in moving their line of sight based on the distance and direction between the display positions of the first display target and the second display target. Furthermore, for example, the scent of the second display target (or an object of the second display target) can be presented when the strain in moving the user's line of sight based on the distance and direction between the display positions of the first display target and the second display target is small. Generally, from the viewpoint of eye movement, it is considered that moving the line of sight in an up-down or left-right direction is less strainful than moving it in a diagonal direction (see Non-Patent Document 1 above). Therefore, by estimating the strain in moving the line of sight based on the distance and direction, as well as the distance, between the display positions of the first display target and the second display target, and determining whether to present the scent of the second display target (or an object of the second display target), the scent can be used to effectively guide the user's line of sight to the display target.

[0131] Aspect 3 is characterized in that, in aspect 1, it is decided to present the scent to the user when the user is looking at the first display object in order to guide the user's gaze to the second display object.

[0132] According to the third aspect, for example, the scent of the second display object (or the target of the second display object) can be presented to a user who is visually viewing the first display object in order to guide the user's gaze. Therefore, by identifying the user who is visually viewing the first display object, the scent of the second display object (or the target of the second display object) can be presented. Therefore, the presentation of the scent of the second display object (or the target of the second display object) can be controlled based on whether or not there is a user visually viewing the first display object. Furthermore, for example, when a user is visually viewing the first display object, the scent of the second display object (or the target of the second display object) can be presented in order to guide the user's gaze. Therefore, by identifying whether or not the user is visually viewing the first display object, the scent of the second display object (or the target of the second display object) can be presented. Therefore, the presentation of the scent of the second display object (or the target of the second display object) can be controlled based on whether or not the user is visually viewing the first display object.

[0133] Aspect 4 is characterized in that, in aspect 1, the user's awareness of the scent of the first display object is estimated, and it is decided to present the scent of the second display object to the user based on the awareness of the scent of the first display object, the awareness of the scent of the second display object, and the gaze movement distance.

[0134] According to aspect 4, for example, the scent of the second display object (or the target of the second display object) can be presented taking into account the user's recognition of the scent of the first display object (or the target of the first display object). Generally, if the user has a high recognition of the scent of the first display object (or the target of the first display object), it is likely that the user will expect the scent of the first display object (or the target of the first display object) when perceiving the scent, and therefore it is likely that the sense of incongruity caused by the inconsistent presentation of the scent will be intensified. Therefore, by intensifying the sense of incongruity caused by the inconsistent presentation of the scent, it is possible to more effectively guide the user's gaze to the display object.

[0135] Aspect 5 is characterized in that in aspect 4, when the recognition level for the scent of the first display object is equal to or greater than a first threshold and the recognition level for the scent of the second display object is equal to or greater than a second threshold, it is decided to present the scent of the second display object to the user.

[0136] According to aspect 5, for example, when a user has a high level of recognition of the scent of the first display object (or an object of the first display object) and also has a high level of recognition of the scent of the second display object (or an object of the second display object), the scent of the second display object (or an object of the second display object) can be presented. Generally, when a scent is perceived, the higher the recognition of both the scent expected by the user and the scent recognized by the user, the stronger the sense of incongruity caused by the inconsistent presentation of the scent. Therefore, by strengthening the sense of incongruity caused by the inconsistent presentation of the scent, the user's gaze can be more effectively guided to the display object.

[0137] Aspect 6 is characterized in that, in aspect 1, the user's preference for the second display object is estimated, and it is decided to present the scent to the user based on the preference estimated by the estimation unit, the recognition level, and the gaze movement distance.

[0138] According to the sixth aspect, for example, the scent of the second display object (or the object of the second display object) can be presented taking into consideration the user's preference for the second display object (or the object of the second display object). For example, the scent of the second display object (or the object of the second display object) can be presented to a user who has a high preference for the second display object (or the object of the second display object). Furthermore, for example, if a user who is visually viewing the first display object has a high preference for the second display object (or the object of the second display object), the scent of the second display object (or the object of the second display object) can be presented. In general, it can be considered that the higher the preference for the display object (or the object of the display object), the more likely the user's gaze will be guided by the scent of that display object (or the object of that display object). For example, when the scent of the displayed object (or the target of the displayed object) is associated with (or imagined by) the displayed object (or when a memory or recollection related to the displayed object (or the target of the displayed object) is recalled), it can be considered that the greater the preference for the displayed object (or the target of the displayed object), the more easily the user's gaze will be guided. Furthermore, it can be considered that the greater the preference for the displayed object (or the target of the displayed object), the greater the preference for the scent of the displayed object (or the target of the displayed object), and the greater the sensitivity to the scent of the displayed object (or the target of the displayed object). Therefore, the greater the preference for the displayed object (or the target of the displayed object), the more effectively the user's gaze can be guided to the displayed object by using the scent of the displayed object (or the target of the displayed object).

[0139] Aspect 7 is characterized in that, in aspect 6, the user's preference for the first display object is estimated, and if the preference for the second display object is higher than the preference for the first display object, it is decided to present the scent to the user.

[0140] According to the seventh aspect, for example, the scent of the second display object (or the target of the second display object) can be presented taking into consideration the user's preference for the first display object (or the target of the first display object). For example, the scent of the second display object (or the target of the second display object) can be presented to a user who has a higher preference for the second display object (or the target of the second display object) than for the first display object (or the target of the first display object). Furthermore, for example, if a user visually viewing the first display object has a higher preference for the second display object (or the target of the second display object) than for the first display object (or the target of the first display object), the scent of the second display object (or the target of the second display object) can be presented. In general, if a user can expect a display object (or the target of the display object) that is more preferred than the display object (or the target of the display object) that he or she is visually viewing, it can be considered that the user's exploration behavior can be encouraged. Therefore, by using the scent of a display object (or an object of a display object) that is more preferred by the user than the display object (or an object of a display object) that the user is looking at, the user's gaze can be more effectively guided to the display object.

[0141] Aspect 8 is characterized in that, in aspect 4, the first display object is a display object of a character currently speaking, and the scent of the first display object is a scent that evokes the character currently speaking.

[0142] According to the eighth aspect, for example, the scent of the second display object (or the object of the second display object) can be presented taking into consideration the user's recognition of the scent that evokes the character of the display object that the user is looking at. Specifically, the scent of the second display object (or the object of the second display object) can be presented taking into consideration whether the scent can be recognized as a scent that evokes the character of the display object that the user is looking at when the scent is perceived. In cases where such recognition is high, if the character of the display object that the user is looking at is also the character currently speaking, it is likely that the user will strongly expect a scent that evokes that character when they perceive the scent. Therefore, by presenting a scent that is not a scent that evokes the character currently speaking, the sense of incongruity caused by the inconsistent presentation of the scent is emphasized, thereby more effectively guiding the user's gaze to the display object.

[0143] Aspect 9 is characterized in that, in aspect 8, the second display object is a display object of a candidate character who will speak after the utterance, and the scent of the second display object is a scent that evokes the image of the candidate character.

[0144] According to the ninth aspect, for example, it is possible to effectively guide the user's gaze to a display target by using a scent that is reminiscent of a candidate character to which the user's gaze is to be guided. For example, when the user is looking at a display target of a character that is currently speaking, by presenting a scent that is reminiscent of the candidate character to which the user's gaze is to be guided, the user's gaze can be guided to the display target of that candidate character. Therefore, by presenting a scent that is reminiscent of a candidate character that will speak after the character that is currently speaking (for example, the character that the user is looking at), when the character that will speak changes, it is possible to guide the gaze to the display target of the new character without having to search for the next character (or the character's display target) that will speak next.

[0145] Aspect 10 is characterized in that in aspect 9, if the information corresponding to the speech of the candidate character includes text information of predetermined information designated in advance by the user, it is decided to present a fragrance inspired by the candidate character to the user.

[0146] According to aspect 10, for example, it is possible to effectively guide the user's gaze to a display target in accordance with the speech of a candidate character to which the user's gaze is to be directed. For example, by selecting a character to present a scent in accordance with information corresponding to the speech of such a candidate character (e.g., speech content, audio information, text information, subtitle information, dialogue information, etc.), it is possible to guide the user's gaze to the display target of the selected character. Therefore, by presenting a scent inspired by a character whose speech includes information of interest or concern to the user, among the candidate characters to which the user's gaze is to be directed, it is possible to more effectively guide the user's gaze to the display target.

[0147] Aspect 11 is characterized in that in Aspect 1, the second display object is a display object displayed on the same display screen as the display screen on which the first display object is displayed.

[0148] According to aspect 11, for example, the scent of a display object (or an object of a display object) displayed on the same display screen as the display object the user is looking at can be used to effectively guide the user's gaze to the display object. For example, by displaying the display object the user is looking at and the display object to which the user's gaze is to be guided on the same display screen, the user can easily search for the second display object even while looking at the first display object. Furthermore, by making the second display object easier to search, the sense of incongruity caused by the inconsistent presentation of the scent is emphasized, making it possible to more effectively guide the user's gaze to the display object.

[0149] <7.Other> Furthermore, among the processes described in the above embodiments and modifications, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0150] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0151] Furthermore, the above-described embodiments and modifications can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0152] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have undergone various modifications and improvements based on the knowledge of those skilled in the art.

[0153] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, an acquisition unit can be read as an acquisition means or an acquisition circuit.

[0154] The following configurations (corresponding to the embodiments) also fall within the technical scope of the present invention. (1) an estimation unit that estimates the user's recognition of the scent of a second display object, which is a display object different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be directed; a decision unit that decides to present the scent to the user based on the recognition degree estimated by the estimation unit and a line-of-sight movement distance required for the user to move their line of sight from the first display object to the second display object; and An aroma control device comprising: (2) The determination unit and determining to present the scent to the user based on the line-of-sight movement distance calculated based on the distance and direction between the display positions of the first display object and the second display object. The aroma control device according to (1) above. (3) The determination unit determining to present the scent to the user while the user is looking at the first display object in order to guide the user's gaze to the second display object; The aroma control device according to (1) or (2). (4) The estimation unit Estimating the user's recognition of the first display target scent; The determination unit Based on the recognition degree for the scent of the first display object, the recognition degree for the scent of the second display object, and the gaze movement distance, it is determined that the scent of the second display object should be presented to the user. The aroma control device according to any one of (1) to (3) above. (5) The determination unit When the recognition degree for the fragrance of the first display target is equal to or greater than a first threshold value and the recognition degree for the fragrance of the second display target is equal to or greater than a second threshold value, it is determined that the fragrance of the second display target is to be presented to the user. The aroma control device according to (4) above. (6) The estimation unit Estimating the user's preference for the second display target; The determination unit A decision is made to present the scent to the user based on the preference level estimated by the estimation unit, the recognition level, and the gaze movement distance. The aroma control device according to any one of (1) to (5) above. (7) The estimation unit Estimating the user's preference for the first display target; The determination unit If the preference level for the second display object is higher than the preference level for the first display object, it is determined that the scent is to be presented to the user. The aroma control device according to (6) above. (8) the first display object is a display object of a character currently speaking, The scent of the first display target is a scent that evokes the image of the character currently speaking. The aroma control device according to (4) above. (9) the second display target is a display target of a candidate character who will make an utterance after the utterance, The second display target scent is a scent that evokes the image of the candidate character. The aroma control device according to (8) above. (10) The determination unit When the information corresponding to the speech of the candidate character includes text information of predetermined information designated in advance by the user, it is determined that a scent that evokes the candidate character is to be presented to the user. The aroma control device according to (9) above. (11) The second display object is a display object displayed on the same display screen as the first display object. The aroma control device according to any one of (1) to (10) above. (12) 1. A computer-implemented fragrance control method, comprising: an estimation step of estimating the user's recognition of the scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from the first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the recognition degree estimated in the estimation step and a line-of-sight movement distance required for the user to move their line of sight from the first display object to the second display object; An aroma control method comprising: (13) an estimation step of estimating a user's recognition of a scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from a first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the recognition degree estimated by the estimation step and a gaze movement distance required for the user to move their gaze from the first display object to the second display object; An aroma control program characterized by causing a computer to execute the above. (14) an estimation step of estimating a user's recognition of a scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from a first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the recognition degree estimated by the estimation step and a gaze movement distance required for the user to move their gaze from the first display object to the second display object; A computer-readable recording medium having recorded thereon an aroma control program that causes a computer to execute the above.

[0155] Furthermore, the following configuration (corresponding to Modification 1) also falls within the technical scope of the present invention. (1) an estimation unit that estimates the user's recognition of the scent of a second display object, which is a display object different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be directed; a determination unit that determines a position at which the second display object is to be displayed based on the degree of recognition estimated by the estimation unit and a line-of-sight movement distance required for the user to move their line of sight from the first display object to the second display object; and An aroma control device comprising: (2) The determination unit A position for displaying the second display object is determined based on the line-of-sight movement distance calculated based on the distance and direction between the display positions of the first display object and the second display object. The aroma control device according to (1) above. (3) The determination unit By presenting the scent to the user while the user is looking at the first display object, a position for displaying the second display object is determined in order to guide the user's line of sight to the second display object. The aroma control device according to (1) or (2). (4) The estimation unit Estimating the user's recognition of the first display target scent; The determination unit A position for displaying the second display object is determined based on the recognition degree for the scent of the first display object, the recognition degree for the scent of the second display object, and the gaze movement distance. The aroma control device according to any one of (1) to (3) above. (5) The determination unit When the recognition degree for the scent of the first display object is equal to or greater than a first threshold value and the recognition degree for the scent of the second display object is equal to or greater than a second threshold value, a position for displaying the second display object is determined. The aroma control device according to (4) above. (6) The estimation unit Estimating the user's preference for the second display target; The determination unit A position for displaying the second display target is determined based on the preference degree estimated by the estimation unit, the recognition degree, and the line-of-sight movement distance. The aroma control device according to any one of (1) to (5) above. (7) The estimation unit Estimating the user's preference for the first display target; The determination unit When the preference level for the second display object is higher than the preference level for the first display object, a position for displaying the second display object is determined. The aroma control device according to (6) above. (8) the first display object is a display object of a character currently speaking, The scent of the first display target is a scent that evokes the image of the character currently speaking. The aroma control device according to (4) above. (9) the second display target is a display target of a candidate character who will make an utterance after the utterance, The second display target scent is a scent that evokes the image of the candidate character. The aroma control device according to (8) above. (10) The determination unit When the information corresponding to the speech of the character of the candidate includes text information of predetermined information designated in advance by the user, a position where the second display object is to be displayed is determined. The aroma control device according to (9) above. (11) The second display object is a display object that is displayed on the same display screen as the display screen on which the first display object is displayed. The aroma control device according to any one of (1) to (10) above. (12) 1. A computer-implemented fragrance control method, comprising: an estimation step of estimating the user's recognition of the scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from the first display object that the user is visually observing; a determination step of determining a position at which the second display object is to be displayed based on the degree of recognition estimated by the estimation step and a line-of-sight movement distance required for the user to move their line of sight from the first display object to the second display object; An aroma control method comprising: (13) an estimation step of estimating a user's recognition of a scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from a first display object that the user is visually observing; a determination step of determining a position at which the second display object is to be displayed based on the degree of recognition estimated by the estimation step and a line-of-sight movement distance required for the user to move their line of sight from the first display object to the second display object; An aroma control program characterized by causing a computer to execute the above. (14) an estimation step of estimating a user's recognition of a scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from a first display object that the user is visually observing; a determination step of determining a position at which the second display object is to be displayed based on the degree of recognition estimated by the estimation step and a line-of-sight movement distance required for the user to move their line of sight from the first display object to the second display object; A computer-readable recording medium having recorded thereon an aroma control program that causes a computer to execute the above.

[0156] The following configuration (corresponding to embodiment 2 (1)) also falls within the technical scope of the present invention. (1) an estimation unit that estimates the user's recognition of the scent of a second display object, which is a display object different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be directed; a decision unit that decides to present the scent to the user based on the degree of recognition estimated by the estimation unit and the degree of matching between the image on the display screen of the first display object and the scent; An aroma control device comprising: (2) an estimation unit that estimates the user's recognition of a scent of a third display object that is a display object linked to a second display object that is a display object different from a first display object that the user is visually observing and that is a display object to which the user's gaze is to be guided; and a decision unit that decides to present the scent to the user based on the degree of recognition estimated by the estimation unit and the degree of matching between the image on the display screen of the first display object and the scent; An aroma control device comprising: (3) The determination unit A decision is made to present the scent to each user based on the matching degree, which indicates the degree of realism that each user subjectively feels. The aroma control device according to (1) or (2). (4) The determination unit A decision is made to present the scent to the user based on the matching degree, which indicates the degree of the sense of realism estimated based on information indicating a change in the biometric information of the user. The aroma control device according to (3) above. (5) The determination unit If the degree of matching does not exceed a predetermined threshold, it is determined that the scent is to be presented to the user. The aroma control device according to any one of (1) to (4) above. (6) The determination unit When the matching degree exceeds the predetermined threshold, it is determined to present to the user a scent related to the second display object that is different from the scent and has a higher recognition by the user than the recognition of the scent. The aroma control device according to (5) above. (7) The determination unit Deciding to present to the user the scent related to the second display object, the recognition of which is higher than the recognition of the scent and the matching degree with the video does not exceed the predetermined threshold. The aroma control device according to (6) above. (8) The determination unit When the degree of matching exceeds the predetermined threshold, the display object to which the user's gaze is to be guided is changed to a fourth display object, which is a display object for which the user has a higher recognition of the scent than the recognition of the first scent, and the scent of the fourth display object is presented to the user. The aroma control device according to any one of (5) to (7) above. (9) The determination unit Decide to change to a fourth display object, which is a display object for which the user's recognition of the scent is higher than the recognition of the scent and for which the matching degree of the scent with the image does not exceed the predetermined threshold, and to present the scent of the fourth display object to the user. The aroma control device according to (8) above. (10) 1. A computer-implemented fragrance control method, comprising: an estimation step of estimating the user's recognition of the scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from the first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the degree of recognition estimated in the estimation step and the degree of matching between the image on the display screen of the first display object and the scent; An aroma control method comprising: (11) an estimation step of estimating a user's recognition of a scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from a first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the recognition degree estimated by the estimation step and a matching degree between the image on the display screen of the first display object and the scent; An aroma control program characterized by causing a computer to execute the above. (12) an estimation step of estimating a user's recognition of a scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from a first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the recognition degree estimated by the estimation step and a matching degree between the image on the display screen of the first display object and the scent; A computer-readable recording medium having recorded thereon an aroma control program that causes a computer to execute the above. (13) 1. A computer-implemented fragrance control method, comprising: an estimation step of estimating the user's recognition of the scent of a third display object, which is a display object linked to a second display object that is different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be guided; a determination step of determining to present the scent to the user based on the degree of recognition estimated in the estimation step and the degree of matching between the image on the display screen of the first display object and the scent; An aroma control method comprising: (14) an estimation step of estimating the user's recognition of the scent of a third display object, which is a display object linked to a second display object that is different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be directed; a determination step of determining to present the scent to the user based on the recognition degree estimated by the estimation step and a matching degree between the image on the display screen of the first display object and the scent; An aroma control program characterized by causing a computer to execute the above. (15) an estimation step of estimating the user's recognition of the scent of a third display object, which is a display object linked to a second display object that is different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be directed; a determination step of determining to present the scent to the user based on the recognition degree estimated by the estimation step and a matching degree between the image on the display screen of the first display object and the scent; A computer-readable recording medium having recorded thereon an aroma control program that causes a computer to execute the above.

[0157] The following configuration (corresponding to embodiment 2 (2)) also falls within the technical scope of the present invention. (1) an estimation unit that estimates the user's recognition of the scent of a second display object, which is a display object different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be directed; a decision unit that decides to present the scent to the user based on the degree of recognition estimated by the estimation unit and a matching degree between the scent and an image associated by the user with the first display object; An aroma control device comprising: (2) an estimation unit that estimates the user's recognition of a scent of a third display object that is a display object linked to a second display object that is a display object different from a first display object that the user is visually observing and that is a display object to which the user's gaze is to be guided; and a decision unit that decides to present the scent to the user based on the degree of recognition estimated by the estimation unit and a matching degree between the scent and an image associated by the user with the first display object; An aroma control device comprising: (3) The determination unit A decision is made to present the scent to each user based on the matching degree, which indicates the degree of realism that each user subjectively feels. The aroma control device according to (1) or (2). (4) The determination unit A decision is made to present the scent to the user based on the matching degree, which indicates the degree of the sense of realism estimated based on information indicating a change in the biometric information of the user. The aroma control device according to (3) above. (5) The determination unit If the degree of matching does not exceed a predetermined threshold, it is determined that the scent is to be presented to the user. The aroma control device according to any one of (1) to (4) above. (6) The determination unit When the matching degree exceeds the predetermined threshold, it is determined to present to the user a scent related to the second display object that is different from the scent and has a higher recognition by the user than the recognition of the scent. The aroma control device according to (5) above. (7) The determination unit Deciding to present to the user the scent related to the second display object, the recognition of which is higher than the recognition of the scent and the matching degree with the video does not exceed the predetermined threshold. The aroma control device according to (6) above. (8) The determination unit When the degree of matching exceeds the predetermined threshold, the display object to which the user's gaze is to be guided is changed to a fourth display object, which is a display object for which the user has a higher recognition of the scent than the recognition of the first scent, and the scent of the fourth display object is presented to the user. The aroma control device according to any one of (5) to (7) above. (9) The determination unit Decide to change to a fourth display object, which is a display object for which the user's recognition of the scent is higher than the recognition of the scent and for which the matching degree of the scent with the image does not exceed the predetermined threshold, and to present the scent of the fourth display object to the user. The aroma control device according to (8) above. (10) 1. A computer-implemented fragrance control method, comprising: an estimation step of estimating the user's recognition of the scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from the first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the degree of recognition estimated in the estimation step and a matching degree between the scent and an image associated by the user with the first display object; An aroma control method comprising: (11) an estimation step of estimating a user's recognition of a scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from a first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the degree of recognition estimated by the estimation step and a matching degree between the scent and an image associated by the user with the first display object; An aroma control program characterized by causing a computer to execute the above. (12) an estimation step of estimating a user's recognition of a scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from a first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the degree of recognition estimated by the estimation step and a matching degree between the scent and an image associated by the user with the first display object; A computer-readable recording medium having recorded thereon an aroma control program that causes a computer to execute the above. (13) 1. A computer-implemented fragrance control method, comprising: an estimation step of estimating the user's recognition of the scent of a third display object, which is a display object linked to a second display object that is different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be guided; a determination step of determining to present the scent to the user based on the degree of recognition estimated in the estimation step and a matching degree between the scent and an image associated by the user with the first display object; An aroma control method comprising: (14) an estimation step of estimating the user's recognition of the scent of a third display object, which is a display object linked to a second display object that is different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be directed; a determination step of determining to present the scent to the user based on the degree of recognition estimated by the estimation step and a matching degree between the scent and an image associated by the user with the first display object; An aroma control program characterized by causing a computer to execute the above. (15) an estimation step of estimating the user's recognition of the scent of a third display object, which is a display object linked to a second display object that is different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be directed; a determination step of determining to present the scent to the user based on the degree of recognition estimated by the estimation step and a matching degree between the scent and an image associated by the user with the first display object; A computer-readable recording medium having recorded thereon an aroma control program that causes a computer to execute the above. [Explanation of symbols]

[0158] 1. Information Processing Systems 10 Display device 100 Aroma control device 110 Communications Department 120 Storage section 121 User information storage unit 122 Display target information storage unit 130 Control Unit 131 Acquisition Department 132 Specific part 133 Estimation Department 134 Calculation Unit 135 Decision Section 136 Generation part 137 Learning Department 200 Video providing server N Network

Claims

1. an estimation unit that estimates a user's recognition level of a scent of a second display object, which is a display object different from a first display object that is visually viewed by the user and is a display object to which the user's gaze is to be guided; a decision unit that decides to present the scent to the user based on the recognition degree estimated by the estimation unit and the matching degree between the image on the display screen of the first display object and the scent; An aroma control device comprising:

2. an estimation unit that estimates the user's recognition of a scent of a third display object that is a display object linked to a second display object that is a display object different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be guided; and a decision unit that decides to present the scent to the user based on the recognition degree estimated by the estimation unit and the matching degree between the image on the display screen of the first display object and the scent; An aroma control device comprising:

3. The determination unit A decision is made to present the scent to each user based on the matching degree, which indicates the degree of realism that each user subjectively feels. The aroma control device according to claim 1 or 2.

4. The determination unit A decision is made to present the scent to the user based on the matching degree, which indicates the degree of the sense of realism estimated based on information indicating a change in the biometric information of the user. The aroma control device according to claim 3 .

5. The determination unit If the degree of matching does not exceed a predetermined threshold, it is determined that the scent is to be presented to the user. The aroma control device according to claim 1 or 2.

6. The determination unit When the matching degree exceeds the predetermined threshold, it is determined to present to the user a scent related to the second display object that is different from the scent and has a higher recognition by the user than the recognition of the scent. The aroma control device according to claim 5 .

7. The determination unit Deciding to present to the user the scent related to the second display object, the recognition of which is higher than the recognition of the scent and the matching degree with the image does not exceed the predetermined threshold. The aroma control device according to claim 6 .

8. The determination unit When the matching degree exceeds the predetermined threshold, it is determined to change the display object to which the user's gaze is to be guided to a fourth display object, which is a display object for which the user has a higher recognition of the scent than the recognition of the first scent, and to present the scent of the fourth display object to the user. The aroma control device according to claim 5 .

9. The determination unit and determining to change the display object to a fourth display object, which is a display object for which the user's recognition of the scent is higher than the user's recognition of the scent and for which the matching degree of the scent with the image does not exceed the predetermined threshold, and to present the scent of the fourth display object to the user. The aroma control device according to claim 8 .

10. 1. A computer-implemented fragrance control method, comprising: an estimation step of estimating the user's recognition of the scent of a second display object, which is a display object to which the user's gaze is to be directed and which is different from the first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the recognition level estimated in the estimation step and a matching level between the image on the display screen of the first display object and the scent; An aroma control method comprising:

11. an estimation step of estimating a user's recognition of a scent of a second display object, which is a display object to which the user's gaze is to be directed and is different from a first display object that the user is visually observing; a determination step of determining to present the scent to the user based on the recognition degree estimated by the estimation step and a matching degree between the image on the display screen of the first display object and the scent; An aroma control program characterized by causing a computer to execute the above.

12. 1. A computer-implemented fragrance control method, comprising: an estimation step of estimating the user's recognition of the scent of a third display object, which is a display object linked to a second display object that is different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be directed; a determination step of determining to present the scent to the user based on the recognition level estimated in the estimation step and a matching level between the image on the display screen of the first display object and the scent; An aroma control method comprising:

13. an estimation step of estimating the user's recognition of the scent of a third display object, which is a display object linked to a second display object that is different from a first display object that the user is visually observing and is a display object to which the user's gaze is to be guided; a determination step of determining to present the scent to the user based on the recognition degree estimated by the estimation step and a matching degree between the image on the display screen of the first display object and the scent; An aroma control program characterized by causing a computer to execute the above.

Images