Image generation device, image generation method, information processing method, information processing device, image output device, image output method, and program
The image generation device addresses the variability in sensory perceptions by creating seamless moving images based on cosmetic use data, providing a universal and engaging visual representation of the experience.
Patent Information
- Application Number
- JP2024075986
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-18
- Filing Date
- 2024-05-08
- Publication Date
- 2024-11-28
AI Technical Summary
Existing methods struggle to convey the feeling of using cosmetics in a way that is universally relatable, as sensory expressions like 'smooth' and 'moist' can vary among individuals.
An image generation device that acquires sensory data during cosmetic use, divides the period into segments, identifies dominant sensations, and generates seamless moving images to visually express the user's experience, optionally incorporating sound.
Enables a universal and dynamic visual representation of the cosmetic experience, aligning with individual perceptions and enhancing user engagement.
Smart Images

Figure 2024166110000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an image generating device, an image generating method, an information processing method, an information processing device, an image output device, an image output method, and a program. [Background technology]
[0002] The feeling of using cosmetics is often conveyed using sensory expressions such as "smooth" and "moisturizing." However, the impression that each person gets from these expressions varies. Therefore, there is a need for a method other than these sensory expressions to convey the feeling of using cosmetics.
[0003] Patent Document 1 describes a method for generating visual element data based on flavor data that represents the flavor felt by a person when eating food, and displaying the data on a display. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 6725123 Summary of the Invention [Problem to be solved by the invention]
[0005] By visually expressing the sensation of using a cosmetic product using moving images, it is possible to communicate to the user the sensation of using the cosmetic product while it is in use.
[0006] The present invention has been made to solve the above-mentioned problems, and has an object to provide an image generation device, an image generation method, an information processing method, an information processing device, an image output device, an image output method, and a program that make it possible to visually express the feel of using a cosmetic product. [Means for solving the problem]
[0007] The image generating device according to an embodiment of the present invention is characterized by having an acquisition unit that acquires sensory data representing a user's sensations during a specified period of time when the user is using a cosmetic product, a generation unit that generates an image based on the sensory data, and an output unit that outputs the image.
[0008] It is also preferable that the generation unit divides the predetermined period into a plurality of generation periods, generates a partial image for each generation period based on the user's sense in that generation period, and generates an image by connecting the plurality of partial images.
[0009] It is also preferable that the generating section connects the multiple partial images so that the multiple partial images are seamlessly connected.
[0010] It is also preferable that the generation unit identifies, for each generation period, the sensation that is felt to be dominant by the user from among a plurality of preset sensations, and generates a partial image corresponding to the generation period based on the sensation identified in each generation period.
[0011] In addition, it is preferable that the generation unit identifies, for each generation period, one sensation that is felt most predominantly by the user from among the multiple sensations.
[0012] Furthermore, the sensory data is preferably generated based on a Time Intensity (TI) method, a Temporal Dominance of Sensations (TDS) method, or a Temporal Check All That Apply (TCATA) method.
[0013] It is also preferable that the generation unit further generates a sound based on the sensory data, and the output unit further outputs the sound.
[0014] In addition, it is preferable that the sensory data represents a change in the user's sense when using a plurality of cosmetic products in a predetermined order, and the generation unit generates a single image based on the sensory data for the plurality of cosmetic products.
[0015] It is also preferable that the acquisition unit further acquires sensor data for a predetermined period during which the user is using the cosmetic product, and the generation unit generates the image further based on the sensor data.
[0016] It is also preferable that the generation unit generates a moving image as the image based on the sensory data.
[0017] An image generating method according to an embodiment of the present invention is characterized in that it includes acquiring sensory data representing a user's sensations during a specified period of time when the user is using a cosmetic product, generating an image based on the sensory data, and outputting the image.
[0018] The information processing method of an embodiment of the present invention is characterized by having an acquisition step of acquiring sensory term information indicating terms for expressing the sensations felt by a user of the cosmetic during a specified period during which the cosmetic is used, and a generation step of generating an image based on the sensory term information.
[0019] A program according to an embodiment of the present invention is characterized in that it causes a computer to execute the method according to claim 11 or 12.
[0020] An information processing device according to an embodiment of the present invention is characterized by having an acquisition unit that acquires sensory term information indicating terms used to express the sensations felt by a user of the cosmetic during a specified period in which the cosmetic is used, and a generation unit that generates an image based on the sensory term information.
[0021] It is also preferable that the generation unit refers to a storage device in which multiple terms and multiple videos are associated, extracts videos associated with terms indicated by the sensory term information acquired by the acquisition unit, and generates an image based on the extracted videos.
[0022] The image output device according to an embodiment of the present invention is characterized by having a memory unit that stores an image generated based on sensory data representing the user's sensations during a specified period of time while the user is using the cosmetic product, and an output unit that outputs the image at a specified timing.
[0023] The image output method according to an embodiment of the present invention is characterized in that an image generated based on sensory data representing the sensations of a user during a specified period of time when the user is using a cosmetic product is stored, and the image is output at a specified timing.
[0024] The information processing method according to an embodiment of the present invention is characterized by having a storage step of storing an image generated based on sensory term information indicating terms for expressing the sensations felt by a user of the cosmetic product during a specified period during which the cosmetic product is used, and an output step of outputting the image at a specified timing.
[0025] A program according to an embodiment of the present invention is characterized in that it causes a computer to execute the above-described method.
[0026] An information processing device according to an embodiment of the present invention is characterized by having a memory unit that stores an image generated based on sensory term information indicating terms used to express the sensations felt by a user of the cosmetic during a specified period in which the cosmetic is used, and an output unit that outputs the image at a specified timing. Effect of the Invention
[0027] An image generating device, an image generating method, an information processing method, an information processing device, an image output device, an image output method, and a program according to one embodiment of the present invention make it possible to visually express the feeling of using a cosmetic product. [Brief description of the drawings]
[0028] [Figure 1] FIG. 1 is a diagram illustrating an example of a schematic configuration of a moving image generating system 1. [Diagram 2]2 is an exemplary functional block diagram of a moving image generating device 3. FIG. [Diagram 3] FIG. 13 is a diagram showing an example of a video selection screen G1. [Figure 4] FIG. 2 is a diagram showing an example of the data structure of a cosmetics table T1. [Diagram 5] FIG. 13 is a diagram showing an example of the data structure of sensory data T2. [Figure 6] FIG. 13 is a diagram showing examples of moving images corresponding to each of a plurality of senses. [Figure 7] FIG. 11 is a flowchart showing an example of the flow of a moving image generating process. [Figure 8] FIG. 11 is a flowchart showing an example of the flow of a video transmission process. [Figure 9] 13A is a diagram showing an example of a video selection screen G2, and FIG. 13B is a diagram showing an example of a cosmetics presentation screen G3. [Figure 10] FIG. 11 is a flow diagram showing an example of the flow of a cosmetic product presentation process. [Figure 11] 13A is a diagram showing an example of a sensory data input screen G4, and FIG. 13B is a diagram showing an example of a moving image presentation screen G5. [Figure 12] FIG. 11 is a flowchart showing an example of the flow of a moving image presentation process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0029] Hereinafter, various embodiments of the present invention will be described with reference to the drawings. It should be noted that the technical scope of the present invention is not limited to these embodiments, but covers the inventions described in the claims and their equivalents.
[0030] (First embodiment) FIG. 1 is a diagram showing an example of a schematic configuration of a moving image generation system 1 according to a first embodiment of the present invention. The moving image generation system 1 displays moving images based on changes in a user's sensation according to the elapsed time since the user started applying cosmetics. The moving image generation system 1 has a display terminal 2 and a moving image generation device 3 that communicate via a network N such as the Internet. The moving image generation device 3 is an example of an image generation device and an image output device.
[0031] The moving image generating device 3 may be an example of an information processing device. The image generating method executed by the moving image generating device 3 may be an example of an information processing method. The image output method executed by the moving image generating device 3 may be an example of an information processing method. At least a part of one or more steps constituting the above information processing method is executed by, for example, a computer.
[0032] The user applying the cosmetics may be an example of a user of the cosmetics. In the first embodiment, the user may be a user of the cosmetics. In other embodiments, the user may be a user, administrator, operator or owner (sometimes referred to as a user, etc.) of the moving image generation system 1. In yet another embodiment, the user may be a user of the display terminal 2, etc. In yet another embodiment, the user may be a user of the moving image generation device 3, etc. The user may be a subject using the cosmetics, etc.
[0033] In the first embodiment, the user of the cosmetics, the user etc. of the video image generation system 1, the user etc. of the display terminal 2, and the user etc. of the video image generation device 3 may be different from one another. In other embodiments, at least two of the user of the cosmetics, the user etc. of the video image generation system 1, the user etc. of the display terminal 2, and the user etc. of the video image generation device 3 may be the same.
[0034] The display terminal 2 is a computer owned by a user, such as a PC (Personal Computer), a smartphone, a mobile phone, a tablet terminal, a portable game machine, etc. The display terminal 2 receives a moving image from the moving image generating device 3 and displays it.
[0035] As described above, the user of the display terminal 2 may be the same person as the user of the cosmetic product, or may be a different person from the user of the cosmetic product. Similarly, the user of the display terminal 2 may be the same person as the user of the moving image generating device 3, or may be a different person from the user of the moving image generating device 3.
[0036] 2 is an exemplary functional block diagram of the moving image generating device 3. The moving image generating device 3 is a computer such as a server, a PC, a smartphone, a mobile phone, or a portable game console. The moving image generating device 3 generates moving images based on changes in the user's sensation according to the elapsed time since the user started applying the cosmetic product. The moving image generating device 3 has a storage unit 31, a communication unit 32, and a processing unit 33.
[0037] The storage unit 31 is configured to store programs and data, and includes, for example, a semiconductor memory. The programs stored in the storage unit 31 include an operating system program, a driver program, and an application program used in processing by the processing unit 33. The programs are installed in the storage unit 31 from a computer-readable, non-transitory, portable storage medium such as a CD-ROM (Compact Disc Read Only Memory) or a DVD-ROM (Digital Versatile Disc Read Only Memory).
[0038] The communication unit 32 is a component that enables the moving image generating device 3 to communicate with other devices, and includes a communication interface circuit. The communication interface circuit included in the communication unit 32 is a communication interface circuit for a wireless LAN (Local Area Network) or a wired LAN. The communication unit 32 transmits data provided from the processing unit 33 to the other devices, and provides data received from the other devices to the processing unit 33.
[0039] The processing unit 33 is configured to comprehensively control the operation of the moving image generating device 3, and includes one or more processors and their peripheral circuits. For example, the processing unit 33 includes a CPU (Central Processing Unit). The processing unit 33 may include a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), or the like. The processing unit 33 executes various processes based on the programs stored in the storage unit 31 and the data supplied from the communication unit 32.
[0040] The processing unit 33 has an acquisition unit 331, a generation unit 332, an output unit 333, a reception unit 334, and a transmission unit 335. Each of these units is a functional module realized based on a program executed by the processing unit 33. Each of these units may be implemented in the moving image generating device 3 as a dedicated processing circuit.
[0041] 3 is a diagram showing an example of a video selection screen G1 displayed on the display terminal 2 based on display data transmitted from the video generation device 3. The video selection screen G1 is displayed, for example, in response to a request for display data for the video selection screen G1 from the video generation device 3 by the display terminal 2 executing a web browser application program. The video selection screen G1 includes information G11 on a plurality of cosmetics and a plurality of video objects G12 corresponding to each of the cosmetics.
[0042] The cosmetic information G11 is information that identifies one cosmetic product. In the example shown in Fig. 3, the cosmetic information G11 is an image of the cosmetic product. However, the cosmetic information G11 is not limited to this example, and may be a product name or the like.
[0043] The moving image objects G12 are objects for displaying moving images corresponding to each cosmetic product. When one of the multiple moving image objects G12 is selected, the moving image corresponding to the selected moving image object G12 is played back.
[0044] The processing unit 33 may be an example of an information processing device. The image generating method executed by the processing unit 33 may be an example of an information processing method. The image output method executed by the processing unit 33 may be an example of an information processing method.
[0045] 4 is a diagram showing an example of the data structure of the cosmetics table T1 stored in the storage unit 31. The cosmetics table T1 stores sensory data for each of a plurality of types of cosmetics. The sensory data is data that represents changes in the user's sensory sensation over a predetermined period of time after the user starts applying each cosmetic product.
[0046] The sensory data is generated based on, for example, the TDS (Temporal Dominance of Sensations) method. In this case, the subjects answer the change in the most dominant sensation among the multiple preset sensations during a predetermined period from the start of application of the cosmetic product. Then, a DR (Dominance Rate) is calculated, which is time-series data indicating how many subjects felt each sensation to be dominant at each time during the predetermined period. In the example shown in FIG. 4, the cosmetic table T1 stores the DR of each sensation at each elapsed time as sensory data. In the example shown in FIG. 4, the multiple sensations are six types of sensations, namely, "rich," "fresh," "smooth," "penetrating," "moist," and "soft." The sensations may include any of the senses of sight, hearing, touch, smell, and taste, and may include, for example, sensations related to the appearance of the cosmetic base and the appearance of the skin, sensations of warmth and coldness of the cosmetic base and unevenness of the skin surface, sensations related to movement and vibration during application, and sensations related to the scent of the cosmetic base. Furthermore, the expression to express the sensation is not particularly limited as long as it is a word that the user uses when feeling the sensation, and includes a variety of expressions.
[0047] The sensory data includes, for example, information indicating terms for expressing sensations felt by a user of the product or service (which may be simply referred to as a user) during a specified period during which the product or service is being used or utilized (which may be simply referred to as the product being used). Sensory data may be an example of sensory term information. Cosmetics may be an example of an product.
[0048] The term for expressing the sensation is not particularly limited, but examples of the term include sensory test terms. The term for expressing the sensation is determined by, for example, the TDS (Temporal Dominance of Sensations) method, the TI (Time Intensity) method, the TCATA (Temporal Check All That Apply) method, the sensory test method specified in JIS Z 8144:2004, and methods conforming to these.
[0049] Examples of the senses felt by the user include at least one of taste, smell, touch, sight, and hearing. The above sense may be at least one of smell, touch, and hearing. Touch may be any sensation caused by stimulating the skin or mucous membrane, and may be a concept including muscle sensation, warmth, coldness, and pain. Terms for expressing touch may include terms indicating the touch (sometimes called texture) related to the surface of an object that is generated by the material, surface structure, etc. of the object.
[0050] The sensory data may include information for identifying the type of sensory sensation and information indicating the degree of strength of the sensory sensation (sometimes referred to as intensity). The sensory data may be information in which information indicating a time or a period of time, information for identifying the type of each of one or more sensory sensations felt by the user at that time, and information indicating the intensity of each of the one or more sensory sensations at that time are associated with each other.
[0051] (Generation process of cosmetics table T1) The moving image generation system 1, the moving image generation device 3, or the processing unit 33 may be an example of an information processing device (sometimes referred to as a database management device) that manages a database that stores, in association with each other, identification information for identifying an item or service and information indicating terms for expressing sensations felt by a user of the item or a user of the service during a specified period during which the item or service identified by the identification information is used or utilized. The cosmetics table T1 may be an example of the above database.
[0052] The database management device includes, for example, a first information acquisition unit that acquires identification information for identifying an item or service. The database management device includes, for example, a second information acquisition unit that acquires information (the sensory term information described above) indicating terms for expressing sensations felt by a user of the item or service identified by the identification information during a predetermined period during which the item or service is used or utilized. The database management device includes, for example, a term information management unit that associates the identification information acquired by the first information acquisition unit with the sensory term information acquired by the second information acquisition unit and stores the associated information in an arbitrary storage device.
[0053] In the above database management device, the second information acquisition unit may acquire the sensory term information based on at least one of the TDS (Temporal Dominance of Sensations) method, the TI (Time Intensity) method, the TCATA (Temporal Check All That Apply) method, the sensory test method defined in JIS Z 8144:2004, and methods conforming thereto. In the above database management device, the second information acquisition unit, for example, first outputs information to a user of the product or service at each of a plurality of time points included in a predetermined period during which the product or service is used or utilized, for prompting the user of the product or service to answer the sensation felt by the user or service. The second information acquisition unit then accepts an answer from the user or service. Next, when the answer is accepted by the TDS method, for example, the second information acquisition unit calculates the ratio (the above-mentioned DR) of the number of people who answered for each sensation to the total number of people at each of a plurality of time points included in a predetermined period during which the product or service is used or utilized, based on the answers of the plurality of users. The second information acquisition unit may select the sensation with the largest number of respondents (highest DR) as the sensation term information based on the DR for each sensation. The second information acquisition unit may perform data interpolation on the calculated DR using a known method (polynomial interpolation, spline interpolation, etc.) and use the ratio after data interpolation as the DR.
[0054] FIG. 5 is a diagram showing an example of the data structure of the sense table T2 stored in the storage unit 31. The sense table T2 stores one or more videos and colors corresponding to each of a plurality of senses. In the example shown in FIG. 5, one video and a plurality of colors are stored for each of six types of senses. The videos and colors are set in advance so as to match the image of each sense. As will be described later, a video corresponding to a cosmetic product is generated based on the videos and colors stored in the sense table T2.
[0055] In the first embodiment, the moving image generating system 1 has been described in detail by taking as an example a case in which the sense table T2 stores one or more (sometimes referred to as one or more) moving images corresponding to each of a plurality of senses and colors. However, the moving image generating system 1 is not limited to the first embodiment.
[0056] In another embodiment, the sense table T2 stores, for each of one or more senses, (a) identification information for identifying the type of the sense, and (b) information indicating one or more videos corresponding to the sense, in association with each other. In yet another embodiment, the sense table T2 stores, for each of one or more senses, (a) identification information for identifying the type of the sense, (b) information indicating one or more videos corresponding to the sense, and (c) information regarding editing applied to at least one of the one or more videos (sometimes referred to as image editing information), in association with each other.
[0057] Examples of the information indicating the video include data of the video, various identification information for identifying the video, and the URI (Uniform Resource Identifier) of the video. Examples of the image editing information include information indicating at least one selected from the group consisting of (a) the type of effect or filter applied to the video, (b) the strength of the effect or filter, (c) at least one of the position, size, and range or shape of the area to which the effect is applied in the frames constituting the video, (d) the playback speed of the video, and (e) the type and / or size and / or pitch of the sound added to the video, and (f) the playback speed of the sound added to the video. Examples of the effect or filter include adjustment of hue and / or saturation and / or brightness, addition of characters or figures, change of transparency and / or contrast, superimposition of videos (same size, different size), fade-in / fade-out, etc.
[0058] As a result, once the type of sense is identified, a video appropriate for the type of sense can be generated based on the video indicated by the information stored in the sense table T2 and the image editing information. For example, the video generation system 1 generates a video corresponding to the product or service based on (a) information in which information for identifying a product or service is associated with one or more types of senses, and (b) information stored in the sense table T2. As described above, the cosmetics table T1 may be an example of information in which information for identifying a product or service is associated with one or more types of senses.
[0059] More specifically, the moving image generation system 1 first determines an article to be a target of the moving image generation process. For example, the moving image generation system 1 identifies the type of the above-mentioned article based on an instruction or operation from a user of the moving image generation system 1 or the like. The information indicating the type of the article may be an example of information for identifying the article. Next, the moving image generation system 1 refers to a storage device that stores information in which the information for identifying the article is associated with one or more types of senses, and extracts information indicating one or more types of senses associated with the above-mentioned identified article.
[0060] When a single type of sensation is extracted, the video production system 1 extracts information indicating one or more videos associated with the extracted sensation, for example, by referring to the sensation table T2. When multiple types of sensations are extracted, the video production system 1 extracts information indicating one or more videos associated with each of the multiple extracted sensations, for example, by referring to the sensation table T2.
[0061] When multiple types of sensations are extracted, the video generation system 1 may refer to the sensation table T2 for at least one of the extracted sensations and extract information indicating one or more videos associated with the sensation. In this case, the video generation system 1 determines, for example, based on the DR of the extracted sensations, at least one sensation to be a target of the process of extracting a video from among the extracted sensations.
[0062] The video generation system 1 may generate a video corresponding to the product or service based on the information stored in the sense table T2 and the information indicating the intensity of the specified sense. For example, the playback speed of the video may be determined based on the intensity of the specified sense, the size of the video may be determined based on the intensity, or the intensity for editing the video may be determined based on the intensity.
[0063] The sensory table T2 may be an example of information in which a plurality of terms are associated with a plurality of videos. The video generation system 1, the video generation device 3, or the storage unit 31 may be an example of a storage device.
[0064] The video generation system 1, the video generation device 3, or the processing unit 33 may be an example of an information processing device (sometimes referred to as a database management device) that manages a database that stores identification information for identifying each type of one or more senses in association with information indicating one or more videos corresponding to the type of sense identified by the identification information. The sensory table T2 may be an example of the above-mentioned database.
[0065] (Generation process of sensory table T2) The database management device includes, for example, an image determination unit that determines, for each of one or more senses, one or more videos suitable for that sense from among a plurality of videos. The image determination unit may store, in an arbitrary storage device, identification information for identifying each of the one or more senses and information indicating each of the one or more videos determined to be suitable for each sense in association with each other.
[0066] The database management device includes, for example, an editing content determination unit that determines, for each of one or more sensations, the content of editing to be applied to at least one of one or more videos suitable for that sensation. The editing content determination unit may store, in an arbitrary storage device, identification information for identifying each of one or more sensations, information indicating one or more videos corresponding to each sensation, and information regarding the content of editing to be applied to at least one of the one or more videos in association with each other. For example, a video suitable for the sensation of "rich" is determined in advance as the video with the highest average score (for example, a video showing a viscous liquid like honey dripping) obtained by weighting a plurality of videos according to the degree of responses regarding the sensation of having "rich" obtained from a plurality of evaluators.
[0067] Fig. 6 is a diagram showing examples of moving images corresponding to each of a plurality of senses. In Fig. 6, examples of moving images corresponding to each of the above-mentioned six types of senses are shown.
[0068] Fig. 6(A) is a diagram showing an example of a moving image corresponding to the feeling of "rich". As shown in Fig. 6(A), the moving image corresponding to the feeling of "rich" is a moving image showing a viscous liquid like honey dripping.
[0069] Fig. 6(B) is a diagram showing an example of a moving image corresponding to the sensation of "freshness." As shown in Fig. 6(B), the moving image corresponding to the sensation of "freshness" is a moving image showing a water drop falling on the surface of water and ripples spreading out.
[0070] Fig. 6(C) is a diagram showing an example of a moving image corresponding to the feeling of "smooth." As shown in Fig. 6(C), the moving image corresponding to the feeling of "smooth" is a moving image showing a state in which liquid is flowing in a lateral direction.
[0071] Fig. 6(D) is a diagram showing an example of a moving image corresponding to the feeling of "sinking in". As shown in Fig. 6(D), the moving image corresponding to the feeling of "sinking in" is a moving image showing bubbles moving in water.
[0072] Fig. 6(E) is a diagram showing an example of a moving image corresponding to the feeling of "moist". As shown in Fig. 6(E), the moving image corresponding to the feeling of "moist" is a moving image showing a state in which liquid is dripping from above.
[0073] Fig. 6(F) is a diagram showing an example of a moving image corresponding to the "soft and squishy" feeling. As shown in Fig. 6(F), the moving image corresponding to the "soft and squishy" feeling is a moving image showing elastic spheres colliding with each other.
[0074] 7 is a flow diagram showing an example of the flow of a moving image generation process executed by moving image generation device 3. The moving image generation process is executed in advance to generate a plurality of moving images corresponding to a plurality of cosmetic products. The moving image generation process is realized by processing unit 33 working in cooperation with other components of moving image generation device 3 based on a program stored in storage unit 31.
[0075] First, the acquisition unit 331 acquires sensory data of the cosmetic product for which a video is to be generated (step S11). For example, the acquisition unit 331 acquires the sensory data of the cosmetic product for which a video is to be generated from a sensory data table T1. The acquisition unit 331 may acquire the sensory data by receiving it from another device via the communication unit 32.
[0076] Next, the generation unit 332 divides the period indicated by the sensory data into a plurality of generation periods (step S12). As described below, a partial moving image is generated for each of the plurality of generation periods, and a moving image of the cosmetic product is generated by linking the partial moving images. For example, the generation unit 332 divides the period into a predetermined number of generation periods so that each generation period has the same length. The predetermined number is, for example, three. In this case, the generation unit 332 divides the period indicated by the sensory data into three generation periods: a period immediately after the start of application, a period during application, and a period after application.
[0077] Next, the generating unit 332 selects one generation period from which a partial video image is to be generated from among the multiple generation periods (step S13). The generating unit 332 selects one generation period according to a default order. For example, the generating unit 332 selects the earliest period from among the multiple generation periods. However, this is not limited to this, and the generating unit 332 may select, for example, the longest period or the shortest period.
[0078] Next, the generating unit 332 identifies the sensation most predominantly felt by the user in the selected generation period (step S14). For example, the generating unit 332 identifies the sensation with the maximum DR in the selected generation period as the sensation most predominantly felt by the user. When the DRs of a plurality of sensations become maximum in the generation period, the generating unit 332 may identify the sensation with the maximum DR for the longest period as the sensation most predominantly felt by the user, or may identify the sensation with the maximum value obtained by integrating the DR over time as the sensation most predominantly felt by the user.
[0079] Next, the generating unit 332 generates a partial video for the selected generation period based on the identified sensation (step S15). For example, the generating unit 332 acquires a video associated with the identified sensation in the sensation table T2. The generating unit 332 expands or contracts the playback time of the acquired video so that the playback time of the acquired video becomes the same as the generation period, thereby generating a partial video for the selected generation period.
[0080] The generating unit 332 may edit the partial video image based on the sensory data. For example, the generating unit 332 may change the color of the partial video image based on the sensory data. In this case, the generating unit 332 acquires a color associated with the most dominant sense felt by the user during the generation period in the sensory table T2. The generating unit 332 changes the hue of the color of the partial video image to the acquired hue. The generating unit 332 may acquire a color obtained by weighting the color corresponding to each sense based on the DR of each sense indicated by the sensory data. As the color, at least one of hue, saturation, and brightness is exemplified, and the hue is one of the elements constituting the color.
[0081] Next, the generation unit 332 determines whether or not partial video images have been generated for all generation periods (step S16).
[0082] If partial moving images have not been generated for all generation periods (step S16-No), the moving image generation process returns to step S12, and the generation unit 332 selects one generation period for generating a partial moving image from among the generation periods in which partial moving images have not yet been generated.
[0083] When partial videos have been generated for all generation periods (step S16-Yes), the generation unit 332 generates one video by concatenating the partial videos generated for each of the multiple generation periods (step S17). For example, the generation unit 332 concatenates the multiple partial videos in the same order as the order of the generation periods to which each partial video corresponds.
[0084] The generating unit 332 may connect a plurality of videos so that the plurality of videos are seamlessly connected. Seamlessly connecting the videos means adding a predetermined special effect at the switching point between the two videos. The predetermined special effect means, for example, an effect of gradually increasing the transparency of the previous video before and after the switching point and gradually decreasing the transparency of the next video.
[0085] Next, the output unit 333 outputs the generated moving image (step S18). For example, the output unit 333 outputs the generated moving image to the storage unit 31 and stores it in association with the cosmetic product. This ends the moving image generation process.
[0086] 8 is a flow diagram showing an example of the flow of a video transmission process. The video transmission process is executed, for example, in response to a request from the display terminal 2 to the video generation device 3 for display data of the video selection screen G1. The video transmission process is realized by the processing unit 33 cooperating with other components of the video generation device 3 based on a program stored in the storage unit 31.
[0087] First, the reception unit 334 receives a selection of a video by the user (step S21). The reception unit 334 transmits display data of the video selection screen G1 to the display terminal 2 via the communication unit 32. The display terminal 2 displays the video selection screen G1 and receives an operation to select one of a plurality of video objects G12. The reception unit 334 receives information specifying the selected video object G12 via the communication unit 32, thereby receiving the selection of a video.
[0088] Next, transmission unit 335 obtains the selected video from storage unit 31, and transmits it to display terminal 2 via communication unit 32 (step S22). Display terminal 2 receives and displays the video. This ends the video transmission process.
[0089] As described above, in the moving image generating device 3, the acquiring unit 331 acquires sensory data that indicates changes in the user's sensation according to the elapsed time since the user started applying the cosmetic product, and the generating unit 332 generates a moving image based on the sensory data. This enables the moving image generating device 3 to visually represent the time-series changes in the sensation when using the cosmetic product.
[0090] Furthermore, the generation unit 332 divides a predetermined period indicated by the sensory data into a plurality of generation periods, generates partial moving images for each generation period, and generates a moving image by linking the partial moving images corresponding to each generation period. This enables the moving image generation device 3 to visually express the feeling of using the cosmetic product for each generation period.
[0091] Furthermore, the generation unit 332 connects a plurality of partial moving images so that the plurality of partial moving images are seamlessly connected, thereby enabling the moving image generation device 3 to visually express the gradual change in the feel of using a cosmetic product.
[0092] Furthermore, the generator 332 identifies the sensation most prevalent to the user in each generation period and generates partial moving images based on the identified sensation, thereby enabling the moving image generator 3 to visually express the usage sensation most prevalent to the user.
[0093] (Modification 1 of the first embodiment) In the above-described first embodiment, the video generation device 3 displays a video selection screen G1 including cosmetics information G11 and a video object G12 on the display terminal 2. The present invention is not limited to this example, and the video generation device 3 may display a video selection screen that does not include cosmetics information on the display terminal 2. In this case, the video generation device 3 accepts a video selection by the user, and presents cosmetics corresponding to the selected video to the user.
[0094] 9(A) is a diagram showing an example of a video selection screen G2 that does not include information about cosmetics, which is displayed on the display terminal 2. The video selection screen G3 includes a plurality of video objects G21 and a plurality of selection objects G22 corresponding to each video object G21.
[0095] The video object G21 is an object for displaying one of a plurality of videos corresponding to each of a plurality of cosmetics. When one of the plurality of video objects G21 is selected, the video corresponding to the selected video object G21 is played.
[0096] The selection object G22 is an object for selecting one of a plurality of video images. The user selects a plurality of video image objects G21 and causes the display terminal 2 to play videos corresponding to each video image object G21. After that, the user selects a selection object G22 corresponding to one video image that matches the user's preference from among the played videos.
[0097] Fig. 9(B) is a diagram showing an example of a cosmetics presentation screen G3 displayed on the display terminal 2. The cosmetics presentation screen G3 is a screen for presenting information about the cosmetics to the user. In the example shown in Fig. 9(B), the information about the cosmetics is an image of the cosmetics. However, the information is not limited to this example, and the information about the cosmetics may be a product name, etc.
[0098] 10 is a diagram showing an example of the flow of a cosmetics presentation process executed by moving image generation device 3. The cosmetics presentation process is a process for presenting information about cosmetics corresponding to a moving image selected by a user. The cosmetics presentation process is executed in response to, for example, display terminal 2 requesting display data for video selection screen G2 from moving image generation device 3. The cosmetics presentation process is realized by processing unit 33 working in cooperation with other components of moving image generation device 3 based on a program stored in storage unit 31.
[0099] First, the reception unit 334 receives a selection of a video by the user (step S31). The reception unit 334 transmits display data of the video selection screen G2 to the display terminal 2 via the communication unit 32. The display terminal 2 displays the video selection screen G2 and receives an operation to select one of a plurality of selection objects G22. The reception unit 334 receives information specifying the selection object G22 selected by the user via the communication unit 32, thereby receiving the selection of a video.
[0100] Next, the transmission unit 335 presents information about the cosmetics corresponding to the selected video (step S32). The cosmetics corresponding to the selected video are the cosmetics corresponding to the sensory data used to generate the selected video. The transmission unit 335 generates display data for the cosmetics presentation screen G3 including information about the cosmetics corresponding to the selected video. The transmission unit 335 presents the information about the cosmetics by transmitting the display data to the display terminal 2 via the communication unit 32. This ends the cosmetics presentation process.
[0101] In this way, the video generating device 3 presents information on cosmetics corresponding to a video selected by a user from among a plurality of videos, thereby enabling the video generating device 3 to present cosmetics with a usability that matches the user's preferences.
[0102] (Modification 2 of the first embodiment) In the first embodiment described above, the sensory data includes a DR indicating how many subjects felt each sensation to be dominant at each elapsed time. The sensory data is not limited to this example, and may be data indicating the sensation felt most dominantly by a specific user at each elapsed time from when the user started applying the cosmetic product. In this case, the moving image generating device 3 accepts input of sensory data indicating the sensation felt most dominantly by the user of the display terminal 2. The moving image generating device 3 generates a moving image based on the input sensory data.
[0103] Fig. 11(A) is a diagram showing an example of a sensory data input screen G4 displayed on the display terminal 2. The sensory data input screen G4 is a screen for receiving input of sensory data indicating the sensation predominantly felt by the user of the display terminal 2. The sensory data input screen G4 includes input objects G41 corresponding to multiple generation periods. In the example shown in Fig. 11(A), the multiple generation periods are a period immediately after the start of application of the cosmetic product, a period during which the cosmetic product is being applied, and a period after the application of the cosmetic product.
[0104] The input object G41 is an object for receiving input of the predominant sensation felt by the user for each of a plurality of generation periods. After using the cosmetic product, the user inputs the most predominant sensation felt by the user for each of a plurality of generation periods among the plurality of sensations represented by the input object G41.
[0105] 11(B) is a diagram showing an example of a moving image presentation screen G5 displayed on the display terminal 2. The moving image presentation screen G5 is displayed when an input is made to the input object G41 for each of a plurality of generation periods on the sensory data input screen G4. The moving image presentation screen G5 displays a moving image based on the sensory data input on the sensory data input screen G4.
[0106] 12 is a diagram showing an example of the flow of a moving image presentation process executed by the moving image generation device 3. The moving image presentation process is a process for presenting a moving image based on sensory data input by a user. The moving image presentation process is realized by the processing unit 33 working in cooperation with other components of the moving image generation device 3 based on a program stored in the storage unit 31.
[0107] First, the accepting unit 334 accepts an input of sensory data by the user (step S41). The accepting unit 334 transmits display data of the sensory data input screen G4 to the display terminal 2 via the communication unit 32. The display terminal 2 displays the sensory data input screen G4 and accepts an input of the most dominant sensation felt by the user for each of a plurality of generation periods. The accepting unit 334 accepts the input of sensory data by receiving the sensory data input by the user via the communication unit 32.
[0108] Next, the generator 332 executes a moving image generating process for generating a moving image based on the input sensory data (step S42). The details of the moving image generating process are as described above.
[0109] Next, the transmission unit 335 presents the generated video (step S43). The transmission unit 335 generates display data for a video presentation screen G5 for presenting the generated video. The transmission unit 335 presents the video by transmitting the display data via the communication unit 32. This ends the video presentation process.
[0110] In this way, the moving image generating device 3 generates a moving image based on the sensory data input by the user and presents the generated moving image, thereby enabling the moving image generating device 3 to visually express the usage sensation felt by a specific user.
[0111] (Third Modification of the First Embodiment) In the first embodiment described above, the functions of the moving image generating device 3 may be realized by a plurality of devices. For example, the moving image transmission process may be executed by a web server different from the moving image generating device 3. In this case, in step S18 of the moving image generating process, the output unit 333 outputs the generated moving image by transmitting it to the web server. The web server receives the moving image and stores it in association with the cosmetic product. Conversely, the functions of the display terminal 2 and the moving image generating device 3 described above may be realized by a single device.
[0112] (Other Modifications of the First Embodiment) In the first embodiment described above, the generation unit 332 divides the period indicated by the sensory data into a plurality of generation periods, and generates a video by concatenating a plurality of partial video images generated for each of the plurality of periods. The present invention is not limited to this example, and the generation unit 332 may generate one video based on the sensory data without dividing the period indicated by the sensory data. In this case as well, the video generation device 3 makes it possible to visually express the time-series change in the sensation of using the cosmetic product. Furthermore, when the generation unit 332 divides the period indicated by the sensory data into a plurality of generation periods, the generation unit 332 may set the plurality of periods to be equally spaced, or may set the plurality of periods to be unequal spaced, based on the sensory data.
[0113] The generating unit 332 divides a period indicated by the sensory data obtained by, for example, a TDS (Temporal Dominance of Sensations) method into generation periods whose number is equal to the number of times the sensor showing the highest DR among one or more sensory changes plus 1. That is, the generating unit 332 divides the period indicated by the sensory data at each timing when the sensor showing the highest DR changes. In this case, the length of each generation period is the time during which the sensor showing the highest DR in each generation period continues to have the highest DR. The generating unit 332 may also divide the period indicated by the sensory data into a plurality of generation periods based on the intensity of the sensory data. The generating unit 332 divides the period indicated by the sensory data into generation periods whose number is equal to the number of times the sensor showing the highest intensity among one or more sensory changes plus 1. For example, the generating unit 332 may divide the period indicated by the sensory data into generation periods (n is an integer equal to or greater than 1) from the occurrence of the nth fluctuation related to the strongest type of sensory change to the occurrence of the n+1th fluctuation.
[0114] In this way, the generation unit 332 may divide the period indicated by the sensation data into a number of generation periods obtained by adding 1 to the number of times the sensation showing the highest intensity or DR switched among one or more sensations, averaging the number for a plurality of cosmetics, and rounding down to an integer. In this case, when the number of times the sensation showing the highest intensity or DR switched in the period for each product is equal to the number of generation periods minus 1, the generation unit 332 may calculate an average using the duration of the sensation showing the highest intensity or DR in each period, and use this average as the length of each generation period.
[0115] In the present modified example, the sensory table T2 differs from the sensory table T2 used in the first embodiment described above in that it stores a video image corresponding to each combination of multiple sensory types. In one embodiment, a combination of multiple sensory types is identified by the types of multiple sensory types constituting the combination, regardless of the composition ratio of the multiple sensory types constituting the combination. For example, when sensory A is 70% and sensory B is 30%, or when sensory A is 30% and sensory B is 70%, it is identified as combination X. In another embodiment, a combination of multiple sensory types is identified by the types of multiple sensory types constituting the combination and the composition ratio of the multiple sensory types. For example, when sensory A is 70% and sensory B is 30%, it is identified as combination X, and when sensory A is 30% and sensory B is 70%, it is identified as combination Y.
[0116] For example, the sense table T2 of this modification stores, for each of one or more combinations, (a) identification information for identifying the combination and (b) information indicating one or more videos corresponding to the combination in association with each other. The sense table T2 may further store, for each of one or more combinations, at least one of (c) information on editing applied to at least one of the one or more videos (sometimes referred to as image editing information), (d) information on audio added to at least one of the one or more videos (sometimes referred to as audio information), and (e) information indicating the content of editing applied to the audio (sometimes referred to as audio editing information).
[0117] In the first embodiment described above, the generation unit 332 connects a plurality of partial videos so that the partial videos are seamlessly connected. However, the present invention is not limited to this example, and the generation unit 332 may connect a plurality of partial videos so that the partial videos are instantly switched between each other.
[0118] In the first embodiment described above, the generation unit 332 identifies the most dominant sensation felt by the user for each generation period, and generates partial moving images based on the identified sensation. The present invention is not limited to such an example, and the generation unit 332 may generate partial moving images without identifying the most dominant sensation felt by the user. For example, the generation unit 332 may generate partial moving images by superimposing moving images corresponding to a plurality of sensations with an opacity according to the DR indicated by the sensation data, or by connecting the moving images with a length of playback time according to the DR.
[0119] In the first embodiment described above, the sensory data is generated based on the TDS method. The sensory data is not limited to this example, and may be generated based on the TI (Time Intensity) method or the TCATA (Temporal Check All That Apply) method. When the sensory data is generated based on the TI method, the TI method is executed for each of the multiple senses.
[0120] In the first embodiment described above, the generation unit 332 generates a moving image based on sensory data. However, the present invention is not limited to this example, and the generation unit 332 may further generate sound based on the sensory data. In this case, the generation unit 332 synthesizes sound with the generated moving image so that the sound is played together with the moving image. This allows the moving image generation device 3 to aurally express the sensation of using the cosmetic product.
[0121] The generation unit 332 may, for example, refer to the sensation table T2 to synthesize the sound with the generated video so that the sound is played together with the video. The generation unit 332 may determine the sound and / or the synthesis mode of the sound based on the information stored in the sensation table T2 and the intensity of the sensation.
[0122] For example, in the above embodiment, the sense table T2 stores, for each of one or more senses, (a) identification information for identifying the type of the sense, (b) information indicating one or more videos corresponding to the sense, and (d) information on the sound (sometimes referred to as sound information) to be added to at least one of the one or more videos in association with each other. Examples of the sound information include at least one of information indicating the type or tone of a sound source, information indicating the pitch or interval of a sound, information indicating the loudness of a sound, and information indicating the length of a sound or the sense in which the sound is output. In the sense table T2, the above information may be further associated with (e) information indicating the content of editing applied to the sound (sometimes referred to as sound editing information).
[0123] The sensory table T2 may store, for each of one or more sensory senses, (a) identification information for identifying the type of the sensory sense, (b) information showing one or more videos corresponding to the sensory sense, (c) image editing information, and (d) audio information in association with each other. The sensory table T2 may store, for each of one or more sensory senses, (a) identification information for identifying the type of the sensory sense, (b) information showing one or more videos corresponding to the sensory sense, (c) image editing information, (d) audio information, and (e) audio editing information in association with each other.
[0124] In yet another modified example, the generation unit 332 may generate a sound based on the sensory data. In this embodiment, the sensory table T2 may store, for each of one or more sensory senses, (a) identification information for identifying the type of the sensory sense, and (f) information on one or more sounds corresponding to the sensory sense, in association with each other. The sensory table T2 may store, for each of one or more sensory senses, (a) identification information for identifying the type of the sensory sense, (f) information on one or more sounds corresponding to the sensory sense, and (e) sound editing information on the sounds, in association with each other.
[0125] In the first embodiment described above, the sensory data represents a change in the user's sensation during a predetermined period of time after the user starts applying one cosmetic product. The sensory data is not limited to this example, and may represent a change in the user's sensation when using multiple cosmetics in a predetermined order. The combination of multiple cosmetics is a combination of cosmetics that are generally used consecutively, such as a combination of makeup remover, face wash, lotion, serum, and emulsion. In this case, the sensory data represents a change in the user's sensation during a period of time from the start of application of the makeup remover, which is the first cosmetic product, to the end of application of the emulsion, which is the last cosmetic product. Furthermore, the video generation device 3 generates one video corresponding to the combination of multiple cosmetics in the video generation process.
[0126] In the above-described first embodiment, when a video object G12 is selected on the video selection screen G1, the transmission unit 335 transmits a video corresponding to the cosmetic product and displays it on the display terminal 2. At this time, the transmission unit 335 may further transmit information related to the cosmetic product and display it on the display terminal 2. The information related to the cosmetic product is, for example, how to use the cosmetic product. In this case, the transmission unit 335 composites the video corresponding to the cosmetic product into the background of the video explaining how to use the cosmetic product. The transmission unit 335 transmits the video to the display terminal 2 via the communication unit 32.
[0127] In the first embodiment described above, the moving image generating system 1 includes the display terminal 2 and the moving image generating device 3. The moving image generating system 1 is not limited to this example, and may further include a sensor. The sensor is attached to, for example, a user's finger and detects the force applied to the finger and the tactile sensation felt by the finger when the cosmetic product is used. The sensor may also be mounted on a contactor simulating a finger, and the contactor may scan the skin when the cosmetic product is used to detect the contact force and acceleration applied to the contactor. The subject to which the cosmetic product is applied in this case is not limited to actual skin, and may be replaced by artificial skin or the like. The number and type of sensors are not limited to one, and may be multiple. The moving image generating device 3 generates a moving image based on the information on the force applied to the finger and the information on the sense of touch acquired from the sensor. The moving image generating device 3 acquires the strength of the force applied to the finger (i.e., the pressing pressure), the sense of touch (such as the frequency of the sound caused by friction), and / or the sensor or the type of sensor whose strength or sense of touch has changed as the detection value by the sensor. The moving image generating device 3 determines a moving image to be displayed, its saturation and / or contrast, a special effect to be added at the time when the two moving images are switched, and / or a sound to be added to the moving image, based on a detection value by the sensor. The moving image generating device 3 prestores a table showing the correspondence between the detection value by the sensor and the moving image, the saturation and / or contrast, the special effect, and / or the sound. The moving image generating device 3 refers to the table and determines a moving image, the saturation and / or contrast of the moving image, the special effect to be added at the time when the two moving images are switched, and / or a sound to be added to the moving image, based on the detection value by the sensor. In this way, the moving image generating device 3 can visually express the sensation felt by the user's fingers when using the cosmetic product. The moving image generating device 3 may simultaneously acquire sensory data and a detection result of the sensor. In this case, the moving image generating device 3 selects a moving image based on the sensory data, and determines the saturation and / or contrast of the moving image, the special effect to be added at the time when the two moving images are switched, and / or a sound to be added to the moving image, based on the detection result by the sensor. In the moving image generating device 3, the physical quantity detected by the sensor is not limited to a physical quantity related to the sense of touch (pressure, frequency, etc.).
[0128] In the first embodiment described above, as shown in Fig. 5, the senses and the moving images are in one-to-one correspondence. However, a combination of a plurality of senses may be made to correspond to one moving image. Moreover, the correspondence with the moving image may not only be limited to the color, but also to the speed at which the moving image is played.
[0129] For example, the sensory table T2 according to another modification stores, for each of one or more combinations, (a) identification information for identifying the combination and (b) information indicating one or more videos corresponding to the combination in association with each other. The sensory table T2 may further store, for each of one or more combinations, at least one of (c) information on editing applied to at least one of the one or more videos (sometimes referred to as image editing information), (d) information on audio added to at least one of the one or more videos (sometimes referred to as audio information), and (e) information indicating the content of editing applied to the audio (sometimes referred to as audio editing information).
[0130] For example, the video generating device 3 can select a video closest to the midpoint coordinates of sense A and sense B as a corresponding video based on a map created by principal component analysis, correspondence analysis, or multidimensional scaling based on the evaluation result of the sense corresponding to the video. The senses and the videos are associated in advance in the map. The video generating device 3 can also apply the mapping by the above-mentioned principal component analysis or correspondence analysis to the editing process, and can select an editing process closest to the midpoint coordinates of sense A and sense B as a corresponding editing process based on a map created by principal component analysis, correspondence analysis, or multidimensional scaling based on the evaluation result of the sense corresponding to the editing process. In this case, the editing content may be associated in advance in addition to the sense and the video to the map. The video generating device 3 can also specify the type of video by sense A, and then specify the editing process by sense B.
[0131] According to another modified example, for example, a single process is assigned as an editing process corresponding to a combination in which the type of the most predominantly felt sense is sense A and the type of the second most predominantly felt sense is sense B. The information indicating the above process may be information indicating the type of editing process, or may be information indicating the type of editing process and the degree to which editing is applied. The above information indicates, for example, that the type of editing process is determined by the type of one of the most predominantly felt sense and the second most predominantly felt sense, and the degree to which editing process is applied is determined by the other type.
[0132] A plurality of processes may be assigned as the editing process corresponding to the above combination. For example, the type of the first editing process is determined by the type of one of the most dominantly felt sense and the second most dominantly felt sense, and the type of the second editing process is determined by the type of the other sense. The type of the first editing process and the type of the second editing process may be different types of processes. In this case, the degree to which at least one of the first editing process and the second editing process is applied may be determined by the intensity of the corresponding sense.
[0133] As a specific example of a case in which multiple editing processes are assigned to the above combinations of senses, the playback speed of the video is determined according to the type of sense felt most dominantly, and the hue, tone or color of the video is adjusted according to the type of sense felt second most dominantly.
[0134] As described above, in the first embodiment, a combination of a plurality of types of sensations can be identified by the types of sensations that make up the combination, regardless of the composition ratio of the plurality of sensations that make up the combination. In other modified examples, a combination of a plurality of types of sensations can be identified by the types of sensations that make up the combination and the composition ratio of the plurality of sensations.
[0135] In yet another modified example, one or more videos may be determined based on a single type of sensation, and the content of the editing process to be applied to at least one of the one or more videos may be determined based on a combination of multiple types of sensation. The above determination process may be performed for each of the above-mentioned generation periods. An example of the above-mentioned single type of sensation is the sensation that is most predominantly felt by a user of an item or a user of a service in a specific generation period.
[0136] Examples of the content of the editing process corresponding to a combination in which the type of the most predominantly felt sense is sense A and the type of the second most predominantly felt sense is sense B include (a) the type of editing process is determined by the type of one of the most predominantly felt sense and the second most predominantly felt sense, and the degree to which the editing process is applied is determined by the type of the other sense, and (b) the type of the first editing process is determined by the type of one of the most predominantly felt sense and the second most predominantly felt sense, and the type of the second editing process is determined by the type of the other sense. The type of the first editing process and the type of the second editing process may be different types of processes. In this case, the degree to which at least one of the first editing process and the second editing process is applied may be determined by the intensity of the corresponding sense.
[0137] For example, the mapping using the aforementioned principal component analysis and correspondence analysis can also be applied to the editing process, and based on the sensory evaluation results for the editing process method, the editing process closest to the midpoint coordinates of sensation A and sensation B can be selected as the corresponding editing process based on the maps created by principal component analysis, correspondence analysis, and multidimensional scaling.
[0138] In the first embodiment described above, the sensory data represents a change in the user's senses over a predetermined period of time after the user starts applying the cosmetic product. The sensory data is not limited to this example, and may represent the user's senses at "a specific point in time, including before and after the user applies the cosmetic product." The reason why the point in time before the cosmetic product is applied is included is because the sensory data is influenced by the impression of the base, packaging, and fragrance before application. In other words, the sensory data may represent a change in the user's senses over a "predetermined period of time during which the user uses the cosmetic product."
[0139] In the first embodiment described above, in step S14 of the moving image generation process, the generation unit 332 identifies one of the multiple sensations that is felt to be the most dominant sensation by the user. However, the present invention is not limited to this example, and the generation unit 332 may identify multiple sensations that are felt to be the most dominant sensation by the user.
[0140] In the first embodiment described above, the generation unit 332 may generate a video image by a trained model (AI) stored in advance in the storage unit 31. Also, prompts corresponding to various sensations may be generated so that appropriate video images are generated. The trained model may be, for example, an existing generation model that generates a video image using various sensory words as prompts, or may be a model that has been fine-tuned using various sensory words and corresponding video images for the same generation model, or may be a model that has been trained in advance by supervised learning such as a neural network or a support vector machine using various sensory words and corresponding video images as teacher data. That is, the trained model is trained in advance so that when a sensory word is input, a video image corresponding to the input sensory word is output.
[0141] The generation unit 332 generates prompts corresponding to various sensations so that appropriate moving images can be generated from the sensory words, and inputs the generated prompts to the trained model. For example, the generation unit 332 can generate a prompt such as, "Please create an image video showing the sensation of a lotion that feels "rich" for the first 10 seconds after the start of application, "smooth" for the next 10 seconds, and "moisturizing" for the last 10 seconds.
[0142] The generating unit 332 may also identify intermediate words for specifying the contents of the video or the contents of editing from the sensory words, and generate a video from the identified intermediate words. Examples of intermediate words include "a state in which a honey-like liquid slowly falls and spreads," "a state in which a liquid flows smoothly sideways," and "a state in which a liquid containing bubbles spreads and shimmers across the entire screen." The video generating device 3 stores in advance a table in which each sensory word and an intermediate word corresponding to each sensory word are set. The generating unit 332 refers to the table stored in advance to identify an intermediate word corresponding to each sensory word, and generates a prompt including the identified intermediate word. For example, the generation unit 332 generates a prompt using the above-mentioned intermediate word as a prompt for instructing the generation of a moving image to a generation model that generates an image based on an input prompt, instructing the user to display "a state in which a honey-like liquid slowly falls and spreads" for 10 seconds from the start of application, display "a state in which the liquid flows smoothly sideways" for the next 10 seconds, and display "a state in which a liquid containing bubbles spreads and shimmers across the entire screen" for the next 10 seconds, and to display the color at that time in orange. Alternatively, the generation unit 332 may obtain a moving image corresponding to an intermediate word by inputting the intermediate word into a trained model that has been pre-trained to output a moving image corresponding to the input intermediate word when an intermediate word is input. The generation unit 332 may also generate a prompt for generating an intermediate word from a sensory word, and generate an intermediate word corresponding to the sensory word using a generation model. The generation unit 332 may also obtain an intermediate word corresponding to a sensory word by inputting the sensory word into a trained model that has been pre-trained to output an intermediate word corresponding to the input sensory word when a sensory word is input. In these cases, the video generating device 3 may store in advance a table in which each intermediate word and a video corresponding to each intermediate word are set, and the generating unit 332 may acquire a video corresponding to each intermediate word by referring to the pre-stored table. The generating unit 332 may also generate a prompt to specify a type of sound, such as "Please add a sound that evokes a feeling that matches the video."For example, the video generating device 3 may store a table in which sounds and video images are associated with each other, and the generation unit 332 may generate a prompt specifying the type of sound, such as, "Please add a sound that creates a honey-like thickness."
[0143] In the above-described first embodiment, when a selection of a video is accepted, as in step S21 of Fig. 8, the selected video is transmitted to the display terminal 2. This is not limited to when a start instruction is given by the user, but may be configured to automatically transmit the video to the display terminal 2, for example, when a predetermined web page is opened on the display terminal 2, or when the web page is switched, etc. In other words, the video may be output at a predetermined timing.
[0144] In the first embodiment and other various modified examples described above, the generating unit 332 generates a moving image based on sensory data. The present invention is not limited to such an example, and the generating unit 332 may generate still images based on sensory data. In this case, the generating unit 332 stores still images corresponding to each of a plurality of senses in advance. Furthermore, in step S15 of the moving image generation process, the generating unit 332 generates partial still images corresponding to each generation period by acquiring still images associated with the identified sense. Furthermore, in step S17, the generating unit 332 may connect a plurality of partial still images to generate one moving image, or may output a plurality of partial still images as they are without connecting them.
[0145] The above-described embodiment and various modified examples may be appropriately combined and implemented within the scope of the present invention. The above-described various processes may be appropriately executed in different orders within the scope of the present invention. [Explanation of symbols]
[0146] 3. Video Generation Device 331 Acquisition Department 332 Generation part 333 Output section
Claims
1. an acquisition unit that acquires sensory data representing a sensation of a user during a predetermined period when the user is using the cosmetic product; A generator that generates an image based on the sensory data; an output unit that outputs the image; An image generating device comprising:
2. The generation unit is Dividing the predetermined period into a plurality of generation periods; generating a plurality of partial images for each generation period based on the user's sense during that generation period; Concatenating the plurality of partial images to generate the image.
2. The image generating device of claim 1.
3. The generation unit connects the plurality of partial images so that the plurality of partial images are seamlessly connected.
3. The image generating device of claim 2.
4. The generation unit is For each generation period, a sensation that is felt to be dominant by the user is identified from among a plurality of sensations set in advance; generating a partial image corresponding to each generation period based on the sense identified in the generation period; 3. The image generating device of claim 2.
5. The generation unit identifies, for each generation period, one sensation that is most dominantly felt by the user among the plurality of sensations.
5. The image generating device of claim 4.
6. The sensory data is generated based on a Time Intensity (TI) method, a Temporal Dominance of Sensations (TDS) method, or a Temporal Check All That Apply (TCATA) method.
2. The image generating device of claim 1.
7. The generator further generates a sound based on the sensory data; The output unit further outputs the sound.
2. The image generating device of claim 1.
8. The sensory data represents a change in a user's sensory response when using a plurality of cosmetic products in a predetermined order; The generation unit generates one moving image based on the sensory data for the plurality of cosmetics.
2. The image generating device of claim 1.
9. The acquisition unit further acquires sensor data for a predetermined period of time during which the user is using the cosmetic product, The generation unit generates the image further based on the sensor data.
2. The image generating device of claim 1.
10. The generation unit generates a moving image as the image based on the sensory data.
2. The image generating device of claim 1.
11. acquiring sensory data representing the sensation of a user during a predetermined period in which the user uses the cosmetic product; generating an image based on said sensory data; outputting the image; 13. An image generating method comprising:
12. An acquisition step of acquiring sensory term information indicating terms for expressing sensations felt by a user of the cosmetic product during a predetermined period of use of the cosmetic product; A generation step of generating an image based on the sensory term information; 13. An information processing method comprising:
13. A program for causing a computer to execute the method according to claim 11 or 12.
14. an acquisition unit that acquires sensory terminology information indicating terms for expressing sensations felt by a user of the cosmetic product during a predetermined period in which the cosmetic product is used; A generation unit that generates an image based on the sensory term information; 13. An information processing device comprising:
15. The generation unit is extracting a video associated with a term indicated by the sensory term information acquired by the acquisition unit by referring to a storage device in which a plurality of terms and a plurality of video images are associated; generating the image based on the extracted video; The information processing device according to claim 14.
16. a storage unit that stores an image generated based on sensory data representing a sensation of a user during a predetermined period in which the user uses the cosmetic product; an output unit that outputs the image at a predetermined timing; 1. An image output device comprising:
17. storing an image generated based on sensory data representing the sensation of the user during a predetermined period of time when the user is using the cosmetic product; Outputting the image at a predetermined timing.
23. An image output method comprising:
18. a storage step of storing an image generated based on sensory term information indicating terms for expressing sensations felt by a user of the cosmetic product during a predetermined period of time during which the cosmetic product is used; an output step of outputting the image at a predetermined timing; 13. An information processing method comprising:
19. A program for causing a computer to execute the method according to claim 17 or 18.
20. a storage unit that stores an image generated based on sensory term information indicating terms for expressing sensations felt by a user of the cosmetic product during a predetermined period in which the cosmetic product is used; an output unit that outputs the image at a predetermined timing; 13. An information processing device comprising:
Citation Information
Patent Citations
Method, program and information processing device for displaying time-varying flavors as time-varying visual elements
JP6725123B1
