Recommendation device

Abstract

A recommendation device 10 comprising: an acquisition unit 12 for acquiring a line-of-sight image depicting the trajectory of the line of sight of a user browsing content displayed on a user terminal 30; an extraction unit 13 for extracting a feature vector indicating a feature amount of the line-of-sight image; a generation unit 14 for generating, as a user context, a correspondence relationship between the content and the trajectory of the line of sight of the user, on the basis of the feature vector; a calculation unit 15 for using the user context to calculate a score for each of a plurality of content, which are recommendation candidates; and an output unit 16 for outputting a recommendation result for the content that has been selected on the basis of the scores.

Description

[Technical field]

[0001] One aspect of the present disclosure relates to a recommendation device that recommends content to a user. [Background technology]

[0002] In online shopping and the like, a recommendation system is known that recommends products and the like to a user according to the user. Such a recommendation system extracts information about the user's interests using, for example, a log of the user's clicks or page transitions related to product selection. The recommendation system then sorts products using the information about the user's interests and recommends the sorted products to the user.

[0003] Patent document 1 discloses a recommendation device that presents an image including a face to a user, calculates the bias of the user's gaze in the image based on gaze information regarding the user's eye movement, and presents recommendation information to the user that is determined based on the gaze bias. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-192072 A Summary of the Invention [Problem to be solved by the invention]

[0005] Logs of user clicks or page transitions related to product selection may be affected by erroneous operations. Therefore, it may not be possible to recommend content that fully reflects the user's preferences based on this information. In addition, in an algorithm that simply uses eye movements to make recommendations as described in Patent Document 1, it is difficult to determine what the user was looking at when different eye movements occur for each product, such as in online shopping, and as a result, it may not be possible to properly determine the user's preferences and to recommend content that fully reflects the user's preferences.

[0006] Therefore, an object of one aspect of the present disclosure is to provide a recommendation device capable of recommending content that matches the preferences of a user. [Means for solving the problem]

[0007] A recommendation device according to one aspect of the present disclosure includes an acquisition unit that acquires a gaze image that visualizes the gaze trajectory of a user viewing content displayed on a user terminal, an extraction unit that extracts a feature vector that indicates features of the gaze image, a generation unit that generates a correspondence between the content and the user's gaze trajectory as a user context based on the feature vector, a calculation unit that calculates a score for each of a plurality of recommended content items using the user context, and an output unit that outputs a recommendation result for the selected content based on the score.

[0008] In the recommendation device according to one aspect of the present disclosure, the gaze image is converted into a feature quantity, and a feature vector indicating the feature quantity of the gaze trajectory of the user browsing the content is extracted. Then, based on the feature vector, a correspondence between the content and the gaze trajectory of the user is generated as a user context. Furthermore, based on such a user context, a score for each content is calculated, and a recommendation result is output. Instead of determining what the user was gazing at (for example, what information such as the price or product details of the content was the user gazing at), the gaze trajectory is imaged and the score for each content is calculated, making it possible to abstractly grasp the user's preferences on a behavioral basis. According to this way of grasping preferences, it is not necessary to determine the user's preferences regarding content information (for example, price and product details) by determining what the user was gazing at. Then, a content according to the gaze trajectory of the user can be selected based on the score based on the gaze image. As a result, it is possible to recommend content that matches the user's preferences. Effect of the Invention

[0009] According to one aspect of the present disclosure, it is possible to provide a recommendation device that is capable of appropriately grasping the preferences of each user and recommending content that matches the user's preferences. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is a diagram illustrating a functional configuration of a recommendation server according to an embodiment. [Diagram 2] FIG. 13 is a diagram showing an example of a product details screen for viewing a product. [Diagram 3] FIG. 13 is a diagram illustrating an example of a line of sight path. [Figure 4] FIG. 11 is a diagram illustrating an example of a gaze image converted into feature quantities. [Diagram 5] FIG. 13 is a diagram illustrating extraction of a line-of-sight vector. [Figure 6] FIG. 11 is a diagram illustrating generation of a user context. [Figure 7] FIG. 13 is a diagram for explaining an outline of recommendations based on gaze vectors. [Figure 8] 13 is a flowchart showing a process executed by a recommendation server. [Figure 9] FIG. 2 is a diagram illustrating a hardware configuration of a recommendation server. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same or equivalent elements are designated by the same reference numerals, and duplicated explanations will be omitted.

[0012] FIG. 1 is a diagram showing a functional configuration of a recommendation device 10 according to this embodiment. The recommendation device 10 is a device that recommends content that matches the preferences of each user to the user (i.e., delivers the content to the user terminal 30 of the user). Content refers to any tangible or intangible object that is traded, for example, for a fee or free of charge, and is a concept that includes the provision of goods and services. The recommendation device 10 learns the preferences of the user based on a gaze image that visualizes the trajectory of the user's gaze while viewing the content displayed on the user terminal 30. The recommendation device 10 selects content to be recommended to the user so that content that matches the user's preferences is the target of delivery.

[0013] As shown in FIG. 1, the recommendation system 1 includes a recommendation device 10 and a user terminal 30. The user terminal 30 is a communication terminal having a communication function, such as a smartphone, a tablet terminal, or a personal computer. The user terminal 30 is communicably connected to the recommendation device 10 via a network. The user terminal 30 has at least a function of displaying various screens, a function of detecting the trajectory of the user's gaze, a function of transmitting various information to the recommendation device 10, a function of receiving the delivery of the content to be recommended from the recommendation device 10, and a function of displaying the content. Although only one user terminal 30 is illustrated in FIG. 1, a plurality of user terminals 30 are actually included in the recommendation system 1 for each user.

[0014] For example, the user terminal 30 displays a product details screen for viewing a product, which is a content. The user terminal 30 also detects the line of sight of a user viewing the content displayed on the user terminal 30. The method of detecting the line of sight is not limited. As an example, the user terminal 30 may detect the line of sight of a user using a corneal reflex method (PCCR). When the corneal reflex method is adopted, the user terminal 30 may include an infrared emitting device and an infrared camera as a hardware configuration.

[0015] The user terminal 30 transmits information indicating the detected trajectory of the user's gaze to the recommendation device 10. The user terminal 30 may also transmit information indicating the user's purchase history regarding the content displayed on the user terminal 30 to the recommendation device 10. Furthermore, the user terminal 30 may transmit demographic data of the user to the recommendation device 10. Examples of demographic data include, but are not limited to, age, sex, place of residence, family structure, and occupation. The demographic data may be expressed, for example, as a numerical value or an assigned code (gender code, place of residence code, family structure code, occupation code, etc.). Furthermore, the user terminal 30 may transmit content metadata of the user to the recommendation device 10. The content metadata is meta information of the content last (immediately before) viewed by the user. Examples of the content metadata include, but are not limited to, a price range, a genre, and the presence or absence of a campaign. The content metadata may be expressed, for example, as a numerical value or an assigned code (price range code, genre code, campaign code, etc.).

[0016] FIG. 2 is a diagram showing an example of a product details screen G for viewing a product. The product details screen G is, for example, a web page for online shopping. The product details screen G may be provided to the user terminal 30 by, for example, the recommendation device 10, or may be provided to the user terminal 30 by another external system. The product details screen G displays various information related to the content. In one example, the product details screen G displays a product image C1, a product price C2, a description C3, and additional information C4 related to a hamburger.

[0017] The user terminal 30 detects the trajectory of the user's gaze every time the product details screen G is accessed. The user terminal 30 may also measure the viewing time of the content. The viewing time of the content may be, for example, the display time of the product details screen G.

[0018] FIG. 3 is a diagram illustrating an example of a line of sight trajectory V. The line of sight trajectory V is the line of sight of a user with respect to content displayed on a product details screen G. In one example, the line of sight trajectory V is the line of sight of a user with respect to content detected upon first access to the product details screen G. In FIG. 3, the line of sight trajectory V is represented by a solid black line. For example, the line of sight trajectory V indicates that the gaze moved in the order of product image C1, product price C2, detailed text C3, supplementary information C4, and detailed text C3.

[0019] The user terminal 30 transmits information indicating the detected line of sight trajectory V to the recommendation device 10. The information indicating the line of sight trajectory V includes the viewing time of the content. The recommendation device 10 receives the information indicating the line of sight trajectory V.

[0020] Returning to FIG. 1, the recommendation device 10 includes a storage unit 2, a gaze image generation unit 11, an acquisition unit 12, an extraction unit 13, a generation unit 14, a calculation unit 15, and an output unit 16.

[0021] The storage unit 2 stores demographic data 21 and content metadata 22 of each user. For example, the recommendation device 10 stores the demographic data and content metadata of each user received from the user terminal 30 of each user in the storage unit 2. The recommendation device 10 may store, in the storage unit 2, information indicating a line of sight path received from the user terminal 30 and information indicating the user's purchase history regarding content displayed on the user terminal 30.

[0022] The gaze image generating unit 11 generates a gaze image by imaging the trajectory of the user's gaze. For example, the gaze image generating unit 11 generates a gaze image by imaging the trajectory V of the gaze based on information indicating the trajectory V of the gaze received from, for example, the user terminal 30. The gaze image generating unit 11 outputs the generated gaze image to the acquiring unit 12.

[0023] The acquisition unit 12 acquires a gaze image obtained by imaging the trajectory of the gaze of a user viewing content displayed on the user terminal 30. For example, the acquisition unit 12 acquires a gaze image obtained by imaging the trajectory V of the gaze by the gaze image generation unit 11.

[0024] The acquisition unit 12 acquires the viewing time during which the user viewed the content and the demographic data of the user. For example, the acquisition unit 12 acquires the viewing time during which the user viewed the content based on information indicating the line of sight trajectory V received from the user terminal 30. The acquisition unit 12 also acquires the demographic data of each user stored in the storage unit 2.

[0025] The extraction unit 13 extracts a feature vector (gaze vector) indicating a feature amount of the gaze image. For example, the extraction unit 13 generates numerical data that represents the feature amount of the gaze image. Then, the extraction unit 13 performs a principal component analysis on the numerical data to extract a first principal component as the gaze vector.

[0026] Fig. 4 is a diagram for explaining an example of a gaze image that has been converted into a feature quantity. The gaze image VP shown in Fig. 4 is a gaze image that visualizes the gaze trajectory V. For example, the extraction unit 13 extracts the feature quantity of the gaze image VP and generates two-dimensional or three-dimensional numerical data. As an example, the extraction unit 13 divides the gaze image VP into 6 x 6 regions and obtains the feature quantity of each divided region. Then, the extraction unit 13 generates numerical data VA that is a two-dimensional array having elements of 6 rows x 6 columns corresponding to the feature quantities of each region.

[0027] The numerical value of each element of the numerical data VA indicates how much of which part of the content the user has looked at. For example, the higher the numerical value of an element of the numerical data VA, the higher the density of the gaze trajectory V in the gaze image VP. Also, the lower the numerical value of an element of the numerical data VA, the lower the density of the gaze trajectory V in the gaze image VP. Here, the numerical value of each element of the numerical data VA does not take into account (determine) where information related to the content is located. More specifically, the numerical value of each element of the numerical data VA does not take into account (determine) the positions of the product image C1, product price C2, detailed description C3, and supplementary information C4, etc., on the product details screen G1.

[0028] 5 is a diagram for explaining extraction of a gaze vector. For example, the extraction unit 13 performs a principal component analysis on the numerical data VA to extract a first principal component as a gaze vector. In one example, the extraction unit 13 extracts the acquired first principal component as a gaze vector V t,a Here, t is the number of trials (visits) and a is the content. The gaze vector extracted in this way may differ for each trajectory of the user's gaze, each visit, or each content. That is, the gaze vector V t,a can be said to be the gaze vector of "a certain user at a certain visit to a certain piece of content."

[0029] 1, the generation unit 14 generates a correspondence relationship between the content and the trajectory of the user's gaze as a user context based on the gaze vector, which is a feature vector. For example, the generation unit 14 generates a correspondence relationship between the content and the trajectory of the user's gaze as a user context based on the feature vector, the viewing time, and demographic data.

[0030] FIG. 6 is a diagram for explaining generation of a user context. For example, the acquisition unit 12 acquires content metadata C t,a , Demographic Data U t,a , and viewing time T t,a Further, the generation unit 14 obtains the line of sight vector V t,a , Content Metadata Ct,a , Demographic Data U t,a , and viewing time T t,a Based on user context z t,a In one example, the line of sight vector V t,a has elements [v_1, v_2, . . . , v_n], which indicate the first principal components of the features. t,a has elements [1,4,1]. Content metadata C t,a Each element in indicates the price range code, genre code, and campaign code, respectively. t,a has elements [29,1,20]. Demographic data U t,a Each element in indicates the age, gender code, and place of residence code, respectively. t,a has an element

[20] that indicates the number of seconds of viewing time.

[0031] For example, the generation unit 14 generates a line-of-sight vector V t,a , Content Metadata C t,a , Demographic Data U t,a , and viewing time T t,a By combining t,a The generation unit 14 generates a line of sight vector V t,a Based only on user context z t,a The generation unit 14 may generate a line of sight vector V t,a , Content Metadata C t,a , Demographic Data U t,a , and viewing time T t,a Based on one or more of the user contexts z t,a may be generated.

[0032] Returning to FIG. 1, the calculation unit 15 calculates the score of each of the multiple pieces of content that are recommendation candidates by using the user context. For example, the calculation unit 15 calculates the score p of the content by the following formula (1) to which the Contextual Bandit algorithm is applied: t,a Calculate.

[0033]

number

[0034] Here, t is the number of trials (visits) and a is the content (corresponding to the arm in the Contextual Bandit algorithm). (θ a )^ is a term (utilization term) whose value is updated by learning how each piece of content should be scored for the user context based on feedback from past user behavior. t,a is (θ a )^ is updated and represents the uncertainty of the score for each content (degree of exploration). (θ a )^, and α√s t,a The number of exists corresponding to the number of contents. The Contextual Bandit algorithm calculates a score by performing a search in the absence of correct answer data, and learns the user context in the process of calculating the score. The calculation unit 15 learns the user context as, for example, "a user who has this kind of eye movement for this content." When content metadata is included in the user context, a model is created that learns the preferences of "a user who has just viewed content with these characteristics and has this kind of eye movement."

[0035] The contextual bandit algorithm may use correct answer data. For example, the acquisition unit 12 further acquires correct answer data indicating the user's purchase history of content displayed on the user terminal. The calculation unit 15 then uses the correct answer data in calculating the score to obtain the user context z t,a Learn.

[0036] The output unit 16 outputs a recommendation result of the content selected based on the score. For example, the output unit 16 outputs a recommendation result of the content selected based on the score p t,aThe content recommendation unit 101 selects one or more pieces of content in descending order of popularity, and transmits a recommendation result of the selected pieces of content to the user terminal 30.

[0037] FIG. 7 is a diagram for explaining an outline of a recommendation based on a gaze vector. For example, the generation unit 14 generates a recommendation based on a gaze vector V t,a , Content Metadata C t,a , Demographic Data U t,a , and viewing time T t,a By combining t,a The calculation unit 15 calculates the score of each of the multiple pieces of content that are recommendation candidates by using the user context. In addition, the calculation unit 15 uses the user context z t,a The output unit 16 selects one or more contents from among the plurality of contents in descending order of score, and transmits a recommendation result of the selected content to the user terminal 30. The user terminal 30 displays the received recommendation result.

[0038] Next, the process executed by the recommendation system 1 will be described with reference to the flowchart shown in FIG.

[0039] The user terminal 30 detects the trajectory of the user's gaze (step S1). The user terminal 30 detects the trajectory V of the user's gaze with respect to the content while the product details screen G shown in Fig. 3 is being displayed. The user terminal 30 transmits information indicating the detected trajectory V of the gaze to the recommendation device 10.

[0040] The acquisition unit 12 acquires a gaze image that visualizes the trajectory of the gaze of a user viewing the content displayed on the user terminal 30 (step S2). For example, the acquisition unit 12 acquires a gaze image VP in which the gaze trajectory V is visualized by the gaze image generation unit 11.

[0041] The acquisition unit 12 acquires the viewing time T during which the user viewed the content (step S3). For example, the acquisition unit 12 acquires the viewing time T during which the user viewed the content based on information indicating the line of sight path V received from the user terminal 30. t,a Get the.

[0042] The acquisition unit 12 acquires demographic data of the user (step S4). For example, the acquisition unit 12 acquires demographic data U t,a Get the.

[0043] The acquisition unit 12 acquires the user's content metadata (step S5). For example, the acquisition unit 12 acquires the user's content metadata C t,a Get the.

[0044] The extraction unit 13 extracts a feature vector (gaze vector) indicating the feature amount of the gaze image (step S6). For example, the extraction unit 13 generates numerical data that converts the gaze image into a feature amount. Then, the extraction unit 13 performs principal component analysis on the numerical data to extract a first principal component as the gaze vector. In one example, the extraction unit 13 generates numerical data VA that converts the gaze image VP into a feature amount (see FIG. 4). Furthermore, the extraction unit 13 performs principal component analysis on the numerical data VA to convert the first principal component into the gaze vector V t,a (See Figure 5.)

[0045] The generation unit 14 generates a correspondence relationship between the content and the trajectory of the user's gaze as a user context based on the gaze vector, which is a feature vector (step S7). For example, the generation unit 14 generates a correspondence relationship between the content and the trajectory of the user's gaze as a user context based on the gaze vector V t,a , Content Metadata C t,a , Demographic Data U t,a , and viewing time T t,a By combining t,a Generate.

[0046] The calculation unit 15 calculates the score of each of the multiple content items that are recommendation candidates by using the user context (step S8). In one example, the calculation unit 15 calculates the score p t,a In addition, the calculation unit 15 calculates the score p t,a In the process of calculating the user context z t,a Learn.

[0047] In the process of step S8, the acquisition unit 12 may further acquire correct answer data indicating a track record of a user purchasing content displayed on the user terminal 30. The calculation unit 15 may learn the user context by using the correct answer data in calculating the score.

[0048] The output unit 16 outputs a recommendation result of the selected content based on the score (step S9). For example, the output unit 16 outputs a recommendation result of the selected content based on the score p t,a The content recommendation unit 101 selects one or more pieces of content in descending order of popularity, and transmits a recommendation result of the selected pieces of content to the user terminal 30.

[0049] Next, the effects of the recommendation device 10 according to this embodiment will be described.

[0050] The recommendation device 10 of this embodiment includes an acquisition unit 12 that acquires a gaze image that visualizes the gaze trajectory of a user viewing content displayed on a user terminal 30, an extraction unit 13 that extracts a feature vector that indicates the features of the gaze image, a generation unit 14 that generates a correspondence between the content and the user's gaze trajectory as a user context based on the feature vector, a calculation unit 15 that calculates a score for each of multiple recommended content items using the user context, and an output unit 16 that outputs a recommendation result for the selected content based on the score.

[0051] In the recommendation device 10 according to the present embodiment, the gaze image is converted into a feature quantity, and a feature vector indicating the feature quantity of the gaze trajectory of the user browsing the content is extracted. Then, based on the feature vector, a correspondence between the content and the gaze trajectory of the user is generated as a user context. Furthermore, based on such a user context, a score for each content is calculated, and a recommendation result is output. Instead of determining what the user was gazing at (for example, what information such as the price or product details of the content was the user gazing at), the gaze trajectory is imaged and the score for each content is calculated, making it possible to grasp the user's preferences abstractly on a behavioral basis. According to this way of grasping preferences, it is not necessary to determine the user's preferences regarding content information (for example, price and product details) by determining what the user was gazing at. Then, a content according to the gaze trajectory of the user can be selected based on the score based on the gaze image. As a result, it is possible to recommend content that matches the user's preferences.

[0052] The processing of the recommendation device 10 can be said to be reinforcement learning based on gaze trajectories. Such reinforcement learning can learn on the premise that different gaze trajectories occur for each content, so it is easier to capture individuality than an algorithm that simply uses gaze. By using reinforcement learning, the recommendation device 10 can also deal with the problem of not knowing what kind of gaze trajectory leads to what kind of user preference.

[0053] In the recommendation device 10 described above, the acquisition unit 12 further acquires content metadata, which is meta information of the content last viewed by the user, the viewing time of the content, and the demographic data of the user. The generation unit 14 generates a correspondence between the content and the trajectory of the user's gaze as a user context based on the feature vector, the content metadata, the demographic data, and the viewing time. The user context reflects the content metadata, the demographic data, and the viewing time in addition to the feature vector. Then, a score for each content is calculated based on such user context, and a recommendation result is output. By reflecting the user's characteristics in the recommendation result, content that matches the user's preferences is more likely to appear in the recommendation result.

[0054] In the recommendation device 10 described above, the acquisition unit 12 further acquires correct answer data indicating the user's track record of purchasing the content displayed on the user terminal 30. The calculation unit 15 learns the user context using the correct answer data when calculating the score. The correct answer data is reflected in the user context in addition to the feature vector. Then, the score of each content is calculated based on such user context, and the recommendation result is output. By reflecting the correct answer data in the recommendation result, content that matches the user's preferences is more likely to appear in the recommendation result.

[0055] (Modification) In the above embodiment, the numerical values ​​of the elements of the numerical data VA shown in FIG. 4 are not considered to be the position of the information on the content. However, the extraction unit 13 may generate the numerical data by considering the position of the information on the content. For example, the extraction unit 13 may divide the gaze image into areas in which the information on the content (e.g., the product image C1, the product price C2, the detailed description C3, and the additional information C4) are associated, and acquire the feature amount in each divided area. Alternatively, the acquisition unit 12 may further acquire the position of the information on the content from the user terminal 30. Then, the generation unit 14 may generate the correspondence between the content and the trajectory of the user's gaze as a user context based on the feature vector, the content metadata, the demographic data, the viewing time, and the position of the information on the content. According to these processes, the position of the information on the content is reflected in the user context. The calculation unit 15 may further learn the user context in which the position of the information on the content is reflected in the calculation of the score.

[0056] In the above embodiment, the user terminal 30 transmits the detected gaze trajectory V to the recommendation device 10, but the user terminal 30 may transmit a gaze image obtained by imaging the detected gaze trajectory V to the recommendation device 10. In this case, the recommendation device 10 receives the gaze image obtained by imaging the gaze trajectory V.

[0057] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of at least one of hardware and software. The method of realizing each functional block is not particularly limited. That is, each functional block may be realized by using one device that is physically or logically combined, or may be realized by using two or more devices that are physically or logically separated and directly or indirectly connected (for example, by wire, wirelessly, etc.). The functional blocks may be realized by combining the one device or the multiple devices with software.

[0058] Functions include, but are not limited to, judgment, determination, judgment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocation, mapping, assignment, etc. For example, a functional block (component) that performs the function of transmission is called a transmitting unit or a transmitter. In either case, as described above, there is no particular limitation on the method of realization.

[0059] For example, the recommendation device 10 in an embodiment of the present disclosure may function as a computer that performs the information processing of the present disclosure. FIG. 9 is a diagram showing an example of a hardware configuration of the recommendation device 10 according to an embodiment of the present disclosure. The recommendation device 10 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like. The hardware configuration of the user terminal 30 may also be the one described here.

[0060] In the following description, the term "apparatus" may be replaced with a circuit, a device, a unit, etc. The hardware configuration of the recommendation apparatus 10 may be configured to include one or more of the apparatuses shown in the drawings, or may be configured to exclude some of the apparatuses.

[0061] Each function in the recommendation device 10 is realized by loading a specific software (program) onto hardware such as a processor 1001 and a memory 1002, so that the processor 1001 performs calculations, controls communications via a communication device 1004, and controls at least one of reading and writing of data in the memory 1002 and the storage 1003.

[0062] The processor 1001, for example, operates an operating system to control the entire computer. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, each function in the recommendation device 10 described above may be realized by the processor 1001.

[0063] Furthermore, the processor 1001 reads out a program (program code), a software module, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002, and executes various processes according to the read out programs. As the program, a program that causes a computer to execute at least a part of the operations described in the above-mentioned embodiment is used. For example, each function in the recommendation device 10 may be realized by a control program stored in the memory 1002 and operated in the processor 1001. Although the above-mentioned various processes have been described as being executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The program may be transmitted from a network via a telecommunication line.

[0064] The memory 1002 is a computer-readable recording medium, and may be composed of at least one of, for example, a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a random access memory (RAM), etc. The memory 1002 may be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store a program (program code), software modules, etc. that are executable to perform information processing according to an embodiment of the present disclosure.

[0065] The storage 1003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, and the like. The storage 1003 may be called an auxiliary storage device. The storage medium provided in the recommendation device 10 may be, for example, a database including at least one of the memory 1002 and the storage 1003, a server, or other appropriate medium.

[0066] The communication device 1004 is hardware (transmission / reception device) for performing communication between computers via at least one of a wired network and a wireless network, and is also called, for example, a network device, a network controller, a network card, or a communication module.

[0067] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that accepts input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that performs output to the outside. The input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).

[0068] In addition, each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.

[0069] The recommendation device 10 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA), and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented using at least one of these pieces of hardware.

[0070] The order of the steps, sequences, flow charts, etc. of each aspect / embodiment described in this disclosure may be changed unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0071] The input and output information may be stored in a specific location (e.g., memory) or may be managed using a management table. The input and output information may be overwritten, updated, or added to. The output information may be deleted. The input information may be transmitted to another device.

[0072] The determination may be based on a value represented by a single bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0073] Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched according to execution. In addition, notification of specific information (e.g., notification that "X is the case") is not limited to being done explicitly, but may be done implicitly (e.g., not notifying the specific information).

[0074] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0075] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0076] Additionally, software, instructions, information, etc. may be transmitted or received over a transmission medium. For example, if the software is transmitted from a website, server, or other remote source using wired and / or wireless technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave, etc.), then these wired and / or wireless technologies are included within the definition of transmission media.

[0077] As used in this disclosure, the terms "system" and "network" are used interchangeably.

[0078] Furthermore, the information, parameters, etc. described in this disclosure may be expressed using absolute values, may be expressed using relative values ​​from a predetermined value, or may be expressed using other corresponding information.

[0079] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, inquiry (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in a memory), and the like. In addition, "judgment" and "decision" can include considering resolving, selecting, choosing, establishing, comparing, etc., to be a "judgment" or "decision." In other words, "judgment" and "decision" can include considering some action to be a "judgment" or "decision." In addition, "judgment" can be interpreted as "assuming," "expecting," "considering," etc.

[0080] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0081] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0082] Any reference to an element using a designation such as "first," "second," etc., used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must precede the second element in some way.

[0083] When the terms "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Further, when used in this disclosure, the term "or" is not intended to be an exclusive or.

[0084] In this disclosure, where articles have been added due to translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0085] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different." [Explanation of symbols]

[0086] 10... recommendation device, 11... gaze image generation unit, 12... acquisition unit, 13... extraction unit, 14... generation unit, 15... calculation unit, 16... output unit, 21... demographic data, 30... user terminal.

Claims

1. an acquisition unit that acquires a gaze image that visualizes a trajectory of a user's gaze while viewing content displayed on a user terminal; An extracting unit that extracts a feature vector indicating a feature amount of the gaze image; a generation unit that generates a correspondence relationship between the content and a trajectory of the user's gaze as a user context based on the feature vector; A calculation unit that calculates a score for each of a plurality of pieces of content that are recommendation candidates by using the user context; an output unit that outputs a recommendation result of the content selected based on the score; A recommendation device comprising:

2. The acquisition unit further acquires content metadata, which is meta information of the content last viewed by the user, demographic data of the user, and a viewing time for which the content was viewed by the user; the generation unit generates, as the user context, a correspondence relationship between the content and a trajectory of the user's gaze based on the feature vector, the content metadata, the demographic data, and the viewing time. The recommendation device according to claim 1 .

3. The acquisition unit further acquires correct answer data indicating a record of the user purchasing the content displayed on the user terminal, The calculation unit learns the user context by using the correct answer data in calculating the score. The recommendation device according to claim 1 .

Images