DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND DISPLAY CONTROL PROGRAM

The display control device addresses the challenge of assessing disposable wearing article suitability by superimposing article images on user photos, enabling effective pre-purchase evaluation and enhancing user experience and sales.

JP7581153B2Active Publication Date: 2024-11-12UNI CHARM CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2021131445
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-08-11
Publication Date
2024-11-12
Estimated Expiration
2040-01-31

AI Technical Summary

Technical Problem

Conventional technologies fail to effectively allow users to recognize whether disposable wearing articles, such as masks, are suitable for them before purchasing, as they are primarily focused on makeup support and do not display disposable items superimposed on images.

Method used

A display control device that acquires article information indicating the shape of a disposable wearing article and superimposes an image of the article on a user's photographed image, allowing virtual try-on and evaluation of suitability based on user input and detected body parts.

Benefits of technology

Enables users to effectively recognize the suitability of disposable wearing articles before purchase, enhancing the user experience and increasing sales by allowing virtual try-on and improving product appeal.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007581153000001
    Figure 0007581153000001
  • Figure 0007581153000002
    Figure 0007581153000002
  • Figure 0007581153000003
    Figure 0007581153000003
Patent Text Reader

Abstract

To allow for effectively recognizing whether or not a disposable wearable article is suitable for a user before purchasing.SOLUTION: A display control device according to the present application comprises: an acquisition unit for acquiring article information indicating a shape of a disposable wearable article that is identified according to information input by a user; and a display control unit for displaying an image of the disposable wearable article superimposed on an image in which the user, virtually wearing the disposable wearable article in the shape indicated by the article information, is captured.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a display control device, a display control method, and a display control program. [Background technology]

[0002] In the past, with the progress of information processing, techniques for providing information to users in various forms have been proposed. For example, a technique has been proposed for promoting sales of a product by displaying a virtual image of the product superimposed on an image taken by a user. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-181688 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned conventional techniques do not necessarily allow a user to effectively recognize whether a disposable wearing article is suitable for the user before purchasing it. For example, the above-mentioned conventional techniques recognize facial features in images sequentially acquired from an imaging unit, and display a virtual makeup image that tracks a face in the image based on the positions of the facial features included in the recognition result, superimposed on the image.

[0005] As described above, the conventional technologies are specialized for makeup assistance, and disposable wearable items such as masks are not displayed as objects to be superimposed on an image. Therefore, it is not necessarily possible to effectively allow a user to recognize whether a disposable wearable item is suitable for the user before purchasing it.

[0006] The present application has been made in view of the above, and has an object to allow a user to effectively recognize whether a disposable wearing article is suitable for him / her before purchasing it. [Means for solving the problem]

[0007] The display control device according to the present application Among the predetermined wearing articles related to the wearing articles identified by the input identification information, according to the contents selected by the user An acquisition unit that acquires article information indicating a shape of a worn article, and the shape indicated by the article information Arrival The user is virtually wearing the item, and the item corresponds to a photographed image of the user. The one that's on and a display control unit that displays the image of the item in a superimposed state. Effect of the Invention

[0008] According to one aspect of the embodiment, a user can effectively recognize whether a disposable wearing article is suitable for the user before purchasing the article. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is an explanatory diagram conceptually explaining a display corner. [Diagram 2] FIG. 2 is a diagram showing an example (1) of the display control process according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example (2) of the display control process according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example (3) of the display control process according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of image comparison according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 7] FIG. 7 is a flowchart showing the procedure of the first half of the display control process according to the embodiment. [Figure 8] FIG. 8 is a flowchart showing the latter half of the display control process according to the embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of a hardware configuration. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] At least the following points will become apparent from the description of this specification and the accompanying drawings.

[0011] A display control device comprising: an acquisition unit that acquires article information indicating a shape of a disposable wearable article specified in response to information input by a user; and a display control unit that displays an image of a disposable wearable article having a shape indicated by the article information, the image being superimposed on an image captured of the user in a state in which the user is virtually wearing the disposable wearable article.

[0012] According to such a display control device, article information indicating the shape of a disposable wearable article specified in response to information input by a user is acquired, and an image of the disposable wearable article having the shape indicated by the acquired article information is displayed in a state in which the user is virtually wearing the disposable wearable article, superimposed on an image captured by the user, thereby enabling the user to effectively recognize whether the disposable wearable article is suitable for the user before purchasing it.

[0013] The display control device also acquires the article information indicating a shape of a disposable mask made of nonwoven fabric as the disposable wearing article.

[0014] According to such a display control device, product information indicating the shape of a disposable mask made of nonwoven fabric as a disposable wearable item is obtained, thereby allowing the user to effectively recognize whether or not the disposable mask is a mask product suitable for the user before purchasing it.

[0015] The display control device also acquires, as the input information, the article information indicating a shape of the disposable wearing article identified according to identification information attached to a display shelf on which the disposable wearing article is displayed as a commodity.

[0016] According to such a display control device, the input information obtained is article information indicating the shape of the disposable wearable article specified according to the identification information attached to the display shelf on which the disposable wearable article is displayed as a commodity, thereby effectively increasing the opportunities to experience wearing the disposable wearable article.

[0017] The display control device also acquires the item information indicating a shape of a disposable wearable item identified by the identification information and currently displayed on the display shelf as a disposable wearable item specified in accordance with the identification information.

[0018] According to such a display control device, a disposable wearable article specified according to the identification information is obtained, which is a disposable wearable article identified by the identification information and indicates the shape of the disposable wearable article currently displayed on the display shelf, so that an image of the wearable article that is currently attracting the user's attention can be displayed.

[0019] The display control device also acquires the item information indicating the shape of a disposable wearable item corresponding to the category selected by the user from among the wearable item identified by the identification information and the disposable wearable items that are display candidates that are wearable items related to the wearable item identified by the identification information as the disposable wearable item specified in accordance with the identification information.

[0020] According to such a display control device, the disposable wearable article specified according to the identification information is obtained from among the wearable article identified by the identification information and the disposable wearable articles that are display candidates related to the wearable article identified by the identification information, and thus it is possible to effectively assist the user in more easily finding the disposable wearable article that the user wishes to try on.

[0021] The display control device also acquires the item information indicating the shape of a wearing item that belongs to a second category further selected by the user from among the disposable wearing items that are candidates for display and that belong to a first category selected by the user, the second category being a lower category than the first category.

[0022] According to such a display control device, from among the disposable wearable articles that are candidates for display and that belong to a first category selected by the user, article information is obtained that indicates the shapes of wearable articles that belong to a second category that is further selected by the user and is a lower category than the first category, thereby effectively supporting the user to more easily find the disposable wearable article that the user wishes to try on.

[0023] The display control device also acquires the article information indicating a shape of a disposable wearing article selected by the user from among the display candidates of disposable wearing articles.

[0024] According to such a display control device, article information indicating the shape of a disposable wearable article selected by a user from among the disposable wearable articles displayed as display candidates is obtained, so that the user can easily try on a disposable wearable article that meets his or her needs.

[0025] The display control device also acquires the item information indicating a shape of a disposable wearing item selected by the user from among the display candidate disposable wearing items identified according to attribute information or preferences of the user.

[0026] According to such a display control device, article information is obtained that indicates the shape of a disposable wearable article selected by the user from among the disposable wearable articles that are candidates for display and that are identified according to the user's attribute information or preferences, so that the user can easily experience wearing a disposable wearable article that matches his or her preference.

[0027] The display control device also acquires, as the input information, the article information indicating a shape of a disposable wearing article identified according to a photographed image of the user.

[0028] According to such a display control device, input information is obtained that indicates the shape of a disposable wearable item identified according to an image captured by the user, thereby increasing the user's interest and effectively guiding the user to a store where the disposable wearable item is sold.

[0029] Furthermore, the display control device displays an image of the disposable wearable article superimposed on the captured image so that the disposable wearable article having the shape indicated by the article information is positioned at an appropriate body position according to the intended use of the disposable wearable article, based on body parts of the user detected from the captured image of the user.

[0030] According to such a display control device, an image of the disposable wearable article is displayed superimposed on the captured image so that the disposable wearable article having the shape indicated by the article information is positioned at an appropriate body position according to the intended use of the disposable wearable article based on the body parts of the user detected from the captured image of the user, thereby allowing the user to experience wearing the disposable wearable article without feeling uncomfortable.

[0031] The display control device also controls the shape indicated by the item information according to the orientation of the user's face shown in the captured image relative to the imaging means that images the user, and displays an image of the disposable wearable item having the controlled shape superimposed on the captured image in a manner such that the user is virtually wearing the disposable wearable item.

[0032] According to such a display control device, the shape indicated by the item information is controlled according to the orientation of the user's face shown in the captured image relative to the imaging means that captures the user, and an image of the disposable wearable item having the controlled shape is displayed superimposed on the captured image in a state in which the user is virtually wearing the disposable wearable item, thereby allowing the user to accurately visualize how the appearance of the disposable wearable item changes according to the orientation of the face.

[0033] The display control device controls the size of the image of the disposable wearing article in accordance with the size of the face of the user, and superimposes the image of the controlled size on the captured image.

[0034] According to such a display control device, the size of the image of the disposable wearable article is controlled in accordance with the size of the user's face, and the image of the controlled size is superimposed on the captured image, thereby allowing the user to experience wearing the disposable wearable article without feeling uncomfortable.

[0035] In addition, when the color or pattern of the disposable wearable article is designated by the user, the display control device superimposes an image of the disposable wearable article having the designated color or pattern on the captured image as an image of the disposable wearable article.

[0036] According to such a display control device, when a color or pattern of a disposable wearable article is designated by a user, an image of the disposable wearable article of the designated color or pattern is superimposed on the captured image as an image of the disposable wearable article, so that the user can effectively recognize whether or not a disposable wearable article of a certain color or pattern is suitable for the user before purchasing the product.

[0037] Furthermore, when the size of the disposable wearing article is designated by the user, the display control device superimposes an image of the disposable wearing article of a size corresponding to the designated size on the captured image.

[0038] According to such a display control device, when a size of a disposable wearable article is specified by a user, an image of the disposable wearable article of a size corresponding to the specified size is superimposed on the captured image as an image of the disposable wearable article, so that the user can effectively recognize what size of disposable wearable article is suitable for the user before purchasing the product.

[0039] In addition, the display control device displays guidance information on a terminal device of a user identified based on user information about the user, the user not having installed an application that displays an image of a disposable wearable item superimposed on the captured image, guiding the user to install the application.

[0040] According to such a display control device, guidance information guiding a user to install an application that displays an image of a disposable wearable article superimposed on a captured image is displayed on a terminal device of the user who is identified based on the user information about the user and who does not have the application installed, thereby effectively lowering the barrier to entry for a user to try on a disposable wearable article in a store.

[0041] In addition, after the input information is input, the display control device displays guidance information to take a photograph that includes a part of the user's body that is virtually worn by the disposable wearable item, and if it is determined that the part is not included in the captured image of the user, the display control device displays guidance information to take a photograph that includes the part.

[0042] According to such a display control device, after input information is input, if it is determined that a part of the user's body that is to be virtually worn by the disposable wearable item is not included in the image captured of the user, guidance information is displayed to take an image that includes that part, so that the image of the disposable wearable item can be controlled to be displayed in the correct manner according to the intended use of the disposable wearable item.

[0043] The display control device also displays images of the user that have been taken so far, among images on which images of the disposable wearable article are superimposed, in a manner that allows comparison.

[0044] According to such a display control device, images taken of a user, on which images of disposable wearable articles are superimposed, are displayed so as to be comparable, so that the user can easily compare which disposable wearable article suits him / her.

[0045] The display control device also displays images of the user that have been taken in the past and have the image of the disposable wearable item superimposed thereon, together with a currently taken image that has the image of the disposable wearable item superimposed thereon.

[0046] According to such a display control device, among images of a user in which an image of a disposable wearable article is superimposed, a previously taken image is displayed together with a currently taken image in which an image of a disposable wearable article is superimposed, so that the user can easily compare which disposable wearable article suits him / her.

[0047] The display control device also displays specified information corresponding to the posting to a specified information sharing service on a captured image of the user on which an image of the disposable wearable article is superimposed.

[0048] According to such a display control device, a photographed image taken by a user, on which an image of a disposable wearable item is superimposed, is displayed with specified information corresponding to a post made to a specified information sharing service, thereby making it possible to effectively advertise the disposable wearable item and a business operator of the disposable wearable item.

[0049] The display control device also displays information about the disposable wearing article as the predetermined information.

[0050] According to such a display control device, since information related to the disposable wearing article is displayed as the predetermined information, it becomes possible to effectively advertise the disposable wearing article and the business of the disposable wearing article.

[0051] [Embodiment] An example of a form for implementing a display control device, a display control method, and a display control program (hereinafter, referred to as an "embodiment") will be described in detail below with reference to the drawings. Note that the display control device, the display control method, and the display control program are not limited to this embodiment. Also, the same components in the following embodiments are given the same reference numerals, and duplicated descriptions will be omitted.

[0052] 1. Overview of display control process according to embodiment First, an overview of the display control process according to the embodiment will be described along the premise. One example of a disposable wearable article is a mask, and the demand for masks has been increasing in recent years. In addition, since masks are often used throughout the year, many people are concerned about the appearance when wearing them, and wear them as fashionably as possible. For this reason, it would be convenient if masks could be tried on before purchasing them, but since masks are hygiene products and many of them are disposable products, it is difficult to try them on before purchasing them.

[0053] The display control process according to the embodiment is an idea for solving such problems, and allows a user to simulate the appearance of wearing a mask by having the user virtually wear an image of a mask via a terminal device owned by the user (e.g., a smartphone) or a terminal device placed in a store (e.g., a tablet terminal or digital signage).

[0054] Specifically, the display control process according to the embodiment acquires article information indicating the shape of a disposable wearable article specified in response to information input by a user, and displays an image of the disposable wearable article superimposed on an image captured by the user in a state in which the user is virtually wearing the disposable wearable article having the shape indicated by the acquired article information.

[0055] According to such a display control process, it becomes possible to effectively allow a user to recognize whether or not a disposable wearing article (for example, a mask) is a suitable product before purchasing it.

[0056] As described above, the display control process according to the embodiment allows a user to virtually wear an image of a mask via a terminal device, so that the user can easily try on a mask at a store or the like. By using this as a "selling point" and displaying masks of the company's product (for example, company T) ​​together with a store pop such as "Easily try on masks with your smartphone!", the appeal of the company's product can be increased. An image of a display corner where masks are displayed with a store pop attached will be shown later with reference to FIG. 1.

[0057] [2. Programs for display control processing] Next, a program corresponding to the display control process according to the embodiment will be described. The program is a program for causing a computer to execute an acquisition procedure for acquiring article information indicating a shape of a disposable wearing article specified in response to information input by a user, and a display control procedure for displaying an image of a disposable wearing article having a shape indicated by the article information acquired by the acquisition procedure, superimposed on an image captured by the user in a state in which the user virtually wears the disposable wearing article.

[0058] An application according to an embodiment, which is such a program, is introduced (installed) into so-called end-user terminal devices, such as a terminal device owned by a user (e.g., a smartphone, etc.) or a terminal device placed in a store (e.g., a tablet terminal or a digital signage, etc.), or into a server device that communicates with such terminal devices.

[0059] In the following embodiment, a terminal device 10 is illustrated as an example of such a terminal device, and a server device 100 is illustrated as an example of such a server device. Both the terminal device 10 and the server device 100 are devices that can be considered as examples of display control devices.

[0060] Furthermore, the application according to the embodiment may be a dedicated application (hereinafter referred to as "application AP11") installed in the terminal device 10 to link the terminal device 10 and the server device 100. On the other hand, the application according to the embodiment may be a general-purpose application ("application AP12") installed in the terminal device 10. For example, the application AP12 may be a web application (application for displaying web content) that runs on a browser of the terminal device 10.

[0061] Moreover, the applications AP11 and AP12 can be said to be applications for causing at least one of the terminal device 10 and the server device 100 to execute the display control process according to the embodiment. In the present embodiment, the terminal device 10 and the server device 100 cooperate to execute the display control process according to the embodiment in accordance with the control of the application AP11 or the application AP12. However, for example, the terminal device 10 may independently execute the display control process according to the embodiment in accordance with the control of the application AP11 or the application AP12.

[0062] Also, a display control process according to an embodiment performed between the terminal device 10 and the server device 100 when the app AP11 is installed, and a display control process according to an embodiment performed between the terminal device 10 and the server device 100 when the app AP12 is installed will be described separately. The former will be described mainly with reference to FIG. 3, and the latter will be described mainly with reference to FIG. 4. On the other hand, the display control process when the app AP11 is installed may be performed under the control of the app AP12. Also, the display control process when the app AP12 is installed may be performed under the control of the app AP11.

[0063] [3. Disposable clothing items] Next, a disposable wearing article will be described. In this embodiment, the disposable wearing article according to the embodiment is a mask. Specifically, the disposable wearing article according to the embodiment is a disposable mask made of nonwoven fabric. However, the disposable wearing article does not necessarily have to be a mask, and may be, for example, an absorbent article for adults (adult diapers).

[0064] [4. Memory and in-store display] Next, a storage unit included in the server device 100 and a display corner where masks are displayed with in-store POPs attached will be described with reference to Fig. 1. Fig. 1 is an explanatory diagram conceptually explaining the display corner.

[0065] 1 shows an example of a product information storage unit 121 that stores various information related to masks as a product, among the storage units included in the server device 100, which is an example of a display control device. The product information storage unit 121 shown in FIG 1 has items such as "series information," "first type," "second type," "product ID," "AR information," and "sales store."

[0066] "Series information" indicates series information on mask products by business operator T, which is a business operator (mask sales manufacturer) corresponding to server device 100. Products (products identified by "product IDs") associated with "series information" correspond to the product series indicated by "series information". In the example of FIG. 1, a mask product (mask PD11) identified by product ID "PD11" is associated with series information "New products released this spring". This example shows that mask PD11 is one of the new product series (lineup) released by business operator T this spring.

[0067] The "first type" and "second type" correspond to classification information for classifying masks by purpose (e.g., for women, for children, etc.), shape (pleated type, three-dimensional type, etc.), various specifications (comfort when worn, breath conditions emitted through the mask, etc.), i.e., mask categories, and the "first type" and "second type" each cover a different range (granularity). Specifically, the "second type" is a category with a narrower granularity than the "first type." In other words, the "second type" corresponds to a lower category than the "first type." Also, for this reason, the "first type" and the "second type" have a hierarchical relationship.

[0068] In the example of the product information storage unit 121 shown in FIG. 1, "TY11", "TY12", "TY13", and "TY14" are shown as the first type. In the example of the product information storage unit 121 shown in FIG. 1, the first type "TY11" is associated with "TY11-1" and "TY11-2" as the second type. In the example of the product information storage unit 121 shown in FIG. 1, the first type "TY12" is associated with "TY12-1" and "TY12-2" as the second type. In the example of the product information storage unit 121 shown in FIG. 1, the first type "TY13" is associated with "TY13-1" and "TY13-2" as the second type. In the example of the product information storage unit 121 shown in FIG. 1, the first type "TY14" is associated with "TY14-1" and "TY14-2" as the second type.

[0069] "Product ID" indicates identification information for identifying a mask product. "Product ID" may be any information that can identify a mask product, and examples of "product ID" include product numbers and product names (brand names). Furthermore, each mask product identified by a "product ID" can be considered a display candidate mask product.

[0070] The "AR information" is information that is the source for generating an AR image, which is a virtual image of a mask (for example, a virtual stereoscopic image showing a mask in three dimensions), and includes at least information indicating the shape of the mask. The "AR information" is also an example of product information that indicates the shape of the mask. The "AR information" may also include information indicating the default color or pattern of the mask. In the example of the product information storage unit 121 shown in FIG. 1, the AR information "3D11" is associated with the mask PD11, which is a mask product identified by the product ID "PD11". In this example, the AR information "3D11" includes information indicating the characteristic shape of the mask PD11 as product information. For example, if the mask PD11 is a pleated type mask product having a shape specific to the business operator T, the AR information "3D11" includes information indicating this characteristic shape.

[0071] "Store" is information indicating a store that sells the mask product identified by the product ID. For example, "store" is a store ID, store name, store location, etc. that identify a store that sells the mask product identified by the product ID.

[0072] Next, the in-store POP will be described. The right side of FIG. 1 shows an example of a display corner where masks are displayed with the in-store POP attached. In the example of FIG. 1, a state is shown in which a mask PD21, among the mask products managed in the product information storage unit 121, is placed in a display corner CN11 installed in the store SH1 and sold. In addition, in the example of FIG. 1, a in-store POP P21 with the words "Easily try wearing it with your smartphone!" is attached to the front of the display corner CN11. In addition, the in-store POP P21 shows code information QR21 as a QR code (registered trademark) that triggers the display control according to the embodiment. In addition, the code information QR21 includes, for example, a product ID that identifies the mask PD21. Therefore, when a user wants to simulate his / her appearance when wearing a mask through his / her own terminal device 10, first, the user inputs the code information QR21 into the terminal device 10 using the imaging means (imaging unit 13 shown in FIG. 6) of the terminal device 10, thereby causing the terminal device 10 to read the code information QR21.

[0073] For example, if the store SH1 sells masks PD22 in addition to masks PD21, the masks PD22 are displayed in a display corner CN12 (see attached drawings) next to the display corner CN11, and a storefront POP P22 (see attached drawings) corresponding to the masks PD22 is displayed in the display corner CN12. Here, the QR code displayed on the storefront POP P22 may be the same code information QR21 as the storefront POP P21, or may be another QR code including a product ID that identifies the mask PD22.

[0074] Also, when a user wants to perform a simulation of each different mask product, it may be troublesome to input the QR code for each mask product each time. Therefore, even if a single store displays multiple different mask products from business T, a QR code may be associated with only one of these mask products. Even if a single store displays multiple different mask products from business T but has only one QR code, it is possible to display a mask image corresponding to the mask product that the user wants to simulate by having the user select the mask product that he or she wants to display from among the mask products that are candidates for display. This point will be described in detail with reference to FIG. 2.

[0075] [5. Display control processing] From here, an example of the display control process according to the embodiment will be described with reference to Figs. 2 to 4. Fig. 2 describes the display control process according to the embodiment, including a process in which the server device 100 acquires AR information corresponding to a mask product according to input information in response to an input by a user. Fig. 3 describes an example of the display control process in the case where the terminal device 10 operates according to the application AP11. Fig. 4 describes an example of the display control process in the case where the terminal device 10 operates according to the application AP12.

[0076] 2 to 4, it is assumed that a user U1 is attempting to simulate how he or she would look when wearing a mask using his or her own terminal device 10. More specifically, it is assumed that the user U1 enters code information QR21 shown on an in-store POP P21 to simulate how he or she would look when wearing a mask PD21 placed in the display corner CN11 of the store SH1.

[0077] [5-1. Display control process (1)] First, a process in which the server device 100 acquires AR information corresponding to a mask product according to input information by a user will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example (1) of a display control process according to an embodiment.

[0078] First, assume that user U1 inputs code information QR21, which is a QR code, into terminal device 10 using the camera of the terminal device (imaging unit 13 shown in FIG. 6). In this example, code information QR21 can be considered as information input by user U1. Also, code information can be considered as identification information attached to a display shelf on which mask products are displayed.

[0079] Then, when the terminal device 10 accepts the input of the QR code, it reads the QR code to detect the product ID indicated by the QR code (step S11). Specifically, when the terminal device 10 accepts the input of the code information QR21, it reads the code information QR21 to detect the product ID indicated by the code information QR21. In the example of Fig. 1, it is assumed that the terminal device 10 detects the product ID "PD21" indicating the mask PD21 as the product ID.

[0080] Next, the terminal device 10 transmits the detected product ID to the server device 100. For example, the terminal device 10 transmits the detected product ID to the server device 100 via a predetermined application. For example, if the application AP11 is installed in the terminal device 10, the terminal device 10 transmits the detected product ID to the server device 100 under the control of the application AP11. Also, if the application AP11 is not installed in the terminal device 10 but the application AP12 is installed (i.e., if a browser, which is a web application corresponding to the application AP12, is installed), the terminal device 10 transmits the detected product ID to the server device 100 via the application AP12. Through such transmission, the server device 100 acquires the product ID from the terminal device 10 (step S12). Specifically, the server device 100 acquires the product ID "PD21" from the terminal device 10 as a result of the terminal device 10 transmitting the product ID "PD21".

[0081] If the code information QR21 includes a store ID for identifying the store SH1, the terminal device 10 may transmit the store ID together with the product ID to the server device 100. This enables the server device 100 to identify mask products of the business operator T among the mask products handled at the store SH1 by matching the "store" in the product information storage unit 121 with the "store ID" acquired from the terminal device 10.

[0082] Next, the server device 100 identifies mask products as display candidates based on the product ID, and generates selection content for allowing the user to select a mask product to be displayed from the identified mask products as display candidates (step S13). Specifically, the server device 100 identifies mask products as display candidates based on the product ID "PD21", and generates selection content for allowing the user to select a mask product to be displayed from the identified mask products as display candidates.

[0083] For example, the server device 100 identifies the mask PD21 identified by the product ID "PD21" and mask products related to the mask PD21 as display candidate mask products. According to the example of the product information storage unit 121 shown in FIG. 1, the masks PD11 and PD12 are products in the same series as the mask PD21, and are also related from the perspective of brand. Therefore, in the example of FIG. 2, the server device 100 extracts the masks PD11 and PD12, which are mask products related to the mask PD21, and as a result, the masks PD11, PD12, and PD21 are identified as display candidate mask products.

[0084] In this example, the mask PD11, the mask PD12, and the mask PD21 are examples of masks identified according to the identification information. The process of step S13 can be conceptually expressed as the server device 100 identifying the disposable wearable article identified by the identification information and the wearable article related to the wearable article identified by the identification information as the disposable wearable article to be displayed. The criteria for identifying related products are not limited to series and brand.

[0085] Here, an example of the generation of selection content will be described using the example of the product information storage unit 121 shown in Fig. 1. For example, the server device 100 generates selection content C111 that allows the user to select either a first type "TY12" corresponding to a first category that is a broader category (higher category) among categories to which the mask PD21 belongs, or a first type "TY11" corresponding to a first category that is a broader category (higher category) among categories to which the masks PD11 and PD12 belong.

[0086] The server device 100 also generates selection content C111-1 that allows the user to select one of the second types "TY12-1" and "TY12-2" that correspond to the first type of mask PD21 and are a second type corresponding to a second category that is narrower in granularity than the first category (i.e., lower than the first category). The server device 100 also generates selection content C111-2 that allows the user to select one of the second types "TY11-1" and "TY11-2" that correspond to the first types of mask PD11 and mask PD12 and are a second type corresponding to a second category that is narrower in granularity than the first category (i.e., lower than the first category).

[0087] Furthermore, the server device 100 generates the selected content C11 so that when the first type "TY11" is selected in the selected content C111, a transition is made to the selected content C111-2, and when the first type "TY12" is selected in the selected content C111, a transition is made to the selected content C111-1. Specifically, the server device 100 generates the selected content C11 by combining the selected content C111, the selected content C111-1, and the selected content C111-2 so as to realize the transition as described above. This allows the user U1 to narrow down the mask products that he or she wishes to display by selecting a first category and then further selecting a second category that corresponds to the selected first category.

[0088] In addition, instead of having the user select categories in a hierarchical structure in order to narrow down the mask products he or she wishes to display, as in the example shown in Figure 2, the server device 100 may simply generate list content that lists product information (e.g., product name) indicating each of the mask products that are candidates for display, and allow the user to select the mask products he or she wishes to display from the list.

[0089] Furthermore, the server device 100 identifies a display candidate mask product corresponding to the user U1 from among the display candidate mask products based on the user information on the user U1. The server device 100 may generate a list content in which product information (e.g., product name) indicating each of the identified display candidate mask products is displayed in a list, thereby allowing the user to select a mask product to be displayed from the list. For example, the server device 100 identifies a display candidate mask product corresponding to the user U1 from among the display candidate mask products based on attribute information (e.g., age, gender, etc.) of the user U1 or the preference (e.g., preferred shape, color, specifications) of the user U1. For example, the server device 100 can estimate the preference of the user U1 based on behavior information (e.g., purchase history, browsing history) indicating the behavior of the user U1.

[0090] Furthermore, the server device 100 may identify mask products as display candidates corresponding to the user U1 from among products handled at a store currently used by the user U1 (store SH1 in the example of FIG. 2). For example, the server device 100 may identify a store currently used by the user U1 from the location information of the user U1, and identify mask products as display candidates corresponding to the user U1 from among products handled at the identified store. Furthermore, for example, if the server device 100 has acquired a store ID together with the product ID in step S12, it may identify mask products as display candidates corresponding to the user U1 from among products handled at the store identified by the acquired store ID.

[0091] 2, the server device 100 transmits the selected content C11 generated in step S13 to the user U1 (step S14). Specifically, the server device 100 transmits the selected content C11 to the terminal device 10 of the user U1.

[0092] Then, the user U1 selects a first type that is thought to correspond to the mask product desired to be displayed from among the first types (first categories) displayed in the selected content C11, and also selects a second type that is thought to correspond to the mask product desired to be displayed from among the second types (second categories) displayed in the selected content C11 to which the transition is made in response to the selection. In response to such a selection, the terminal device 10 transmits category information indicating the selected category to the server device 100 (step S15). In the example of FIG. 2, if the user U1 selects the second type "TY12-1" in the selected content C111-2, the terminal device 10 transmits category information indicating the second type "TY12-1" to the server device 100.

[0093] When the server device 100 receives the category information, it acquires AR information (an example of product information) indicating the shape of a mask product belonging to the selected category based on the received category information (step S16). For example, assuming that the server device 100 receives category information indicating the second type "TY12-1", it identifies a mask product belonging to the second type "TY12-1" and acquires AR information indicating the shape of the identified mask product from the product information storage unit 121. In the example of the product information storage unit 121 shown in FIG. 1, the server device 100 identifies a mask PD21 as a mask product belonging to the second type "TY12-1" and acquires AR information 3D21 as AR information indicating the shape of the mask PD21 from the product information storage unit 121.

[0094] In addition, if there are multiple mask products belonging to the second type "TY12-1", the server device 100 may present product information indicating these mask products to the user U1, allowing the user U1 to select the mask product he or she wishes to display.

[0095] In the above examples, the server device 100 narrows down the mask products desired to be displayed from among the mask products that are candidates for display, or selects the mask product desired to be displayed from among the mask products that are candidates for display. However, if the QR code acquired from the terminal device 10 uniquely determines a mask product from among the mask products that are candidates for display, the server device 100 may acquire AR information of the mask product. For example, if the product ID indicated by the code information QR21 is the product ID "PD21", the mask product is determined to be one mask PD21 by the product ID "PD21". Furthermore, the mask PD21 is a mask product currently displayed in the display corner CN11 that caught the user U1's eye.

[0096] 2, where the server device 100 acquires the product ID "PD21" in step S12, the server device 100 may acquire the AR information 3D21 as the AR information for the mask PD21 without performing steps S13 to S16. Moreover, such a process can be conceptually expressed as the server device 100 acquiring product information indicating the shape of a disposable wearing article that is identified by the identification information and is currently displayed on a display shelf.

[0097] 2, the server device 100 transmits the AR information acquired in step S16 to the user U1 (step S17). Specifically, the server device 100 transmits the AR information 3D21 acquired in step S16 to the terminal device 10 of the user.

[0098] [5-2. Display control process (2)] Up to this point, the process in which the server device 100 acquires AR information corresponding to a mask product according to input information by a user has been described with reference to Fig. 2. From here, an example of a display control process in which the terminal device 10 operates according to the application AP11 will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example (2) of a display control process according to an embodiment. The process described below is a process following step S17 in Fig. 2.

[0099] When the terminal device 10 acquires AR information from the server device 100, the terminal device 10 generates a mask image from the acquired AR information (step S21). Specifically, when the terminal device 10 acquires AR information 3D21 from the server device 100, the terminal device 10 generates a stereoscopic image that virtually reproduces the shape indicated by the AR information 3D21 based on the shape of the mask PD21 as a mask image of the mask PD21. In the example of Fig. 3, it is assumed that the terminal device 10 generates a mask image GP21 as such a mask image.

[0100] In addition, the terminal device 10 dynamically activates the camera in response to acquiring the AR information, and displays guidance information on the display screen (the output unit 14 shown in FIG. 6) that guides the user to capture a picture of the face so that the whole face is included within the capture range of the activated camera (step S22). For example, if the application AP11 also has a function as a camera application, the terminal device 10 dynamically activates the camera (the image capture unit 13 shown in FIG. 6) in the application AP11, thereby displaying the current image captured by the camera on the display screen. On the other hand, if the application AP11 does not have a function as a camera application, the terminal device 10 may dynamically activate a predetermined camera application that has been installed in advance, thereby displaying the current image captured by the camera on the display screen. The terminal device 10 activates the in-camera so that the user U1 can capture his or her own face.

[0101] The terminal device 10 also displays on the display screen frame information corresponding to the range of photography by the camera and guidance information consisting of text information such as "Please take a picture so that your face is within this frame."

[0102] The camera continues to take pictures continuously as long as it is activated. Therefore, the terminal device 10 detects the facial features of the user U1 based on each captured image by sequentially acquiring images captured by the camera (step S23). For example, the terminal device 10 detects the facial features of the user U1 that are the parts on which a mask is virtually worn based on the captured images. For example, the terminal device 10 detects the eyes, nose, mouth, and ears of the user U1. The terminal device 10 also detects the shape of the jaw line of the user U1 and the direction of the face of the user U1 relative to the camera capturing the image of the user U1. The terminal device 10 may further detect (estimate) the size of the face of the user U1.

[0103] Furthermore, the terminal device 10 may determine whether or not the facial parts of the user U1, which are the parts to virtually wear a mask, are included in the current captured image based on the detection result detected as described above, and if it is determined that they are not included, display guidance information on the display screen to capture the image so that the facial parts are included. For example, if the terminal device 10 cannot detect all / part of the facial parts (e.g., the part of the face below the nose) according to the use of the mask based on the detection result, it determines that the facial parts of the user U1 are not included in the current captured image. Then, the terminal device 10 displays guidance information on the display screen, which is composed of frame information corresponding to the capture range and text information such as "Your face is not captured. Please capture the image so that your face is within this frame."

[0104] Next, the terminal device 10 displays a mask image of the mask in a state where the user U1 virtually wears a mask having a shape indicated by the AR information based on the detected facial features, in a state where the mask image of the mask is superimposed on the current captured image captured by the user U1 (step S24). Specifically, the terminal device 10 displays a mask image GP21 of the mask PD21 in a state where the user U1 virtually wears a mask PD21 having a shape indicated by the AR information 3D21 based on the detected facial features, in a state where the user U1 virtually wears the mask. For example, the terminal device 10 displays the mask image GP21 in a state where the mask PD21 having a shape indicated by the AR information 3D21 is superimposed on the current captured image, in such a state that the mask PD21 having a shape indicated by the AR information 3D21 is positioned at an appropriate face position according to the use of the mask, based on the detected facial features.

[0105] Furthermore, when the terminal device 10 detects the shape of the jaw line of the user U1, it controls the shape of the mask image GP21 to match the detected shape. Furthermore, when the terminal device 10 detects the size of the face of the user U1, it controls the shape of the mask image GP21 to match the detected size. Furthermore, when the terminal device 10 detects the orientation of the face of the user U1 relative to the camera photographing the user U1, it controls the shape of the mask image GP21 to match the detected orientation. For example, when the user faces right relative to the camera, it controls the shape of the mask image GP21 by rotating the AR information 3D21 to match the orientation.

[0106] Then, the terminal device 10 displays a mask image GP21 of the mask PD21 superimposed on a current captured image of the user U1, with the user U1 virtually wearing the mask PD21 in the controlled shape. Specifically, the terminal device 10 displays the mask image GP21 superimposed on the current captured image so that the mask PD21 in the controlled shape is positioned at an appropriate face position according to the intended use of the mask.

[0107] Furthermore, the terminal device 10 displays the mask image GP21 so as to follow changes in the facial movement of the user U1. Furthermore, the terminal device 10 controls the shape of the mask image GP21 in response to changes in the facial direction of the user U1.

[0108] [5-3. Display control process (2)] Next, an example of the display control process when the terminal device 10 operates according to the application AP12 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example (3) of the display control process according to the embodiment. The process described below is a process following step S16 in Fig. 2.

[0109] As described in step S16 of Fig. 1, when the server device 100 acquires AR information from the product information storage unit 121, it generates a mask image from the acquired AR information (step S31). Specifically, when the server device 100 acquires AR information 3D21 from the product information storage unit 121 as AR information indicating the shape of the mask PD21, it generates a stereoscopic image that virtually reproduces the shape indicated by the AR information 3D21 based on the mask PD21 as a mask image of the mask PD21. In the example of Fig. 4, it is assumed that the server device 100 generates a mask image GP21 as such a mask image in the same manner as in the example of Fig. 3.

[0110] In addition, the server device 100 transmits guidance information to the terminal device 10 of the user U1 to guide the user U1 to photograph the face so that the entire face is included within the shooting range of the camera (step S32). For example, the server device 100 transmits guidance information to the terminal device 10 to guide the user U1 to photograph the face so that the entire face is included within the shooting range of the camera.

[0111] When the terminal device 10 receives the guidance information, it dynamically starts the camera in response to the reception of the guidance information, and displays the received guidance information on the display screen (the output unit 14 shown in FIG. 6) (step S33). For example, if the application AP12 also has a function as a camera application, the terminal device 10 dynamically starts the camera (the image capture unit 13 shown in FIG. 6) in the application AP12, thereby displaying the current image captured by the camera on the display screen. On the other hand, if the application AP12 does not have a function as a camera application, the terminal device 10 may dynamically start a predetermined camera application installed in advance, thereby displaying the current image captured by the camera on the display screen. The terminal device 10 starts the front camera so that the user U1 can take a picture of his or her own face.

[0112] The terminal device 10 also displays on the display screen frame information corresponding to the range of photography by the camera and guidance information consisting of text information such as "Please take a picture so that your face is within this frame."

[0113] The camera continues to capture images continuously as long as it is activated. Therefore, the terminal device 10 sequentially transmits images captured by the camera to the server device via the application AP 12. As a result, while the camera of the terminal device 10 is capturing images, the server device 100 sequentially acquires captured images from the terminal device 10 via the application AP (step S34).

[0114] Next, the server device 100 detects facial features of the user U1 based on each captured image (step S35). For example, the server device 100 detects facial features of the user U1 that are parts on which a mask is virtually worn based on the captured images. For example, the server device 100 detects the eyes, nose, mouth, and ears of the user U1. The server device 100 also detects the shape of the jaw line of the user U1 and the direction of the face of the user U1 relative to the camera capturing the image of the user U1. The server device 100 may also detect (estimate) the size of the face of the user U1.

[0115] Further, based on the detection result detected as described above, the server device 100 determines whether the facial parts of the user U1, which are the parts to virtually wear the mask, are included in the current captured image. If the server device 100 determines that the facial parts are not included, the server device 100 may transmit guidance information to the terminal device 10 to take a photograph so as to include the facial parts, thereby displaying the guidance information on the display screen. For example, if the server device 100 cannot detect all / part of the facial parts (e.g., the part of the face below the nose) according to the use of the mask based on the detection result, the server device 100 determines that the facial parts of the user U1 are not included in the current captured image. Then, the server device 100 transmits guidance information consisting of frame information corresponding to the capture range and text information such as "Your face is not captured. Please capture your face so that it fits within this frame" to the terminal device 10, thereby displaying the guidance information.

[0116] Returning to the explanation of FIG. 4, the server device 100 causes the terminal device 10 to display the mask image generated in step S31 based on the detected face parts (step S36). Specifically, the server device 100 causes the display screen of the terminal device 10 to display the mask image GP21 based on the detected face parts. For example, the server device 100 continuously acquires captured images from the terminal device 10, and detects face parts in the acquired captured images every time a captured image is acquired. For this reason, the server device 100 transmits the detection result to the terminal device 10 every time a face part is detected, thereby controlling the terminal device 10 to display the mask image GP21 based on the detection result and the current captured image.

[0117] By such control in step S36, the terminal device 10 displays a mask image of the mask in a state where the user U1 virtually wears the mask in the shape indicated by the AR information, superimposed on the current captured image of the user U1. Specifically, the terminal device 10 displays a mask image GP21 of the mask PD21 in a state where the user U1 virtually wears the mask PD21 in the shape indicated by the AR information 3D21, superimposed on the current captured image of the user U1, based on the detection result and the current captured image. For example, the terminal device 10 displays the mask image GP21 in a state where the mask PD21 in the shape indicated by the AR information 3D21 is superimposed on the current captured image, based on the detection result and the current captured image, so that the mask PD21 in the shape indicated by the AR information 3D21 is positioned at an appropriate face position according to the use of the mask.

[0118] 4, the server device 100 transmits a mask image to the terminal device 10, whereby the terminal device 10 acquires the mask image from the server device 100. Here, since the mask image is generated from the AR information, the terminal device 10 acquiring the mask image from the server device 100 is essentially equivalent to the terminal device 10 acquiring the AR information from the server device 100.

[0119] As described above, the display control device according to the embodiment (e.g., the terminal device 10) acquires article information indicating the shape of a disposable wearable article specified in response to information input by a user, and displays an image of the disposable wearable article superimposed on an image captured by the user in a manner in which the user is virtually wearing the disposable wearable article having the shape indicated by the acquired article information.

[0120] Such display control processing by the display control device enables the user to simulate how he or she would look when wearing a disposable wearable item (e.g., a mask) via the terminal device 10, thereby enabling the user to effectively recognize whether the disposable wearable item is suitable for the user before purchasing it.

[0121] Furthermore, such a display control process by the display control device can enhance the appeal of the disposable wearing article as a commodity, thereby contributing to sales of a store that handles the disposable wearing article.

[0122] [6. About variations] The display control device according to the above embodiment may be implemented in various different forms other than the above embodiment, so other embodiments of the display control device will be described below.

[0123] [6-1. Terminal Devices] Up to this point, the terminal device 10 has been described as a terminal device owned by a user, but the terminal device 10 may be, for example, a terminal device (for example, a tablet terminal or a digital signage) placed in a store. Therefore, here, the display control process in the case where the terminal device 10 is a terminal device placed in a store will be described. When the terminal device 10 is a terminal device placed in a store, for example, when a user passing in front of the store enters within the shooting range of the camera of the terminal device 10, a situation is considered in which the result of the display control according to the embodiment is displayed on the display screen of the terminal device 10. Specifically, when a user passing in front of the store enters within the shooting range of the camera of the terminal device 10, the user is displayed on the display screen of the terminal device 10 in a state where he or she is virtually wearing a mask.

[0124] If the terminal device 10 is a terminal device placed in a store (particularly if it is a digital signage), it is difficult for a user to input a QR code into the terminal device 10. Therefore, in this example, the input information is not the identification information (QR code) attached to the display shelf on which the mask products are displayed, but an image captured dynamically by the user. Specifically, in this example, when the user passes in front of the terminal device 10, the user enters the camera's shooting range, and the captured image that is dynamically captured as a result becomes the input information by the user. For this reason, the terminal device 10 acquires AR information indicating the shape of the mask identified according to the captured image, using the captured image captured by the user as the input information by the user.

[0125] In this way, when the terminal device 10 is a terminal device placed in a store, the terminal device 10 performs the display control process according to the embodiment, thereby making it possible to heighten the interest of users and effectively guide them to the store.

[0126] [6-2. Controlling the state of the worn article in response to user operation (1)] In the above embodiment, when the terminal device 10 detects (estimates) the size of the user's face from the captured image, the terminal device 10 controls the shape of the mask image to match the detected size, and displays the mask image after the control in a state where it is superimposed on the currently captured image. However, the terminal device 10 may control the state of the mask in response to the user's operation.

[0127] For example, when a mask color or pattern is specified by the user, the terminal device 10 superimposes a mask image of the specified color or pattern on the captured image as a mask image. This will be described using the example of FIG. 3. For example, in the example of FIG. 3, the mask PD21 has color variations of white, black, and pink. In this case, the terminal device 10 initially displays a mask image GP showing the mask PD21 in a default color (for example, white), that is, a white mask image GP21.

[0128] In this state, the terminal device 10 displays color selection content on the display screen, which allows the user to select any color from white, black, and pink. For example, if the user U1 selects "pink" through the color selection content, the color of the currently displayed mask image GP21 is controlled (changed) from white to pink. Although the example of color selection has been described here, the terminal device 10 can also perform similar processing with patterns.

[0129] According to such a display control process, the user can simulate, via the terminal device 10, how the color and pattern of a disposable wearable article (e.g., a mask) will affect his / her image, and thus the user can effectively recognize whether or not a disposable wearable article of a certain color or pattern is suitable for the user before purchasing the product.

[0130] [6-3. Controlling the state of the worn article in response to user operation (2)] Furthermore, when a mask size is specified by the user, the terminal device 10 superimposes a mask image of a size corresponding to the specified size on the captured image as a mask image. This will be described using the example of Fig. 3. For example, the terminal device 10 displays size selection content on the display screen that allows a user to select any size from small, normal, and large. Then, for example, if the user U1 specifies "large size" via the size selection content, the size of the currently displayed mask image GP21 is controlled (changed) to a size corresponding to "large size".

[0131] According to such a display control process, the user can simulate, via the terminal device 10, how his / her image changes depending on the size of the disposable wearable article (e.g., a mask), so that the user can effectively recognize whether or not a certain size of the disposable wearable article is suitable for the user before purchasing the product.

[0132] [6-4. Installation Guidance Display] In addition, the terminal device 10 may display guidance information to guide a user identified based on user information about the user who has not installed the app AP11, which is an application that displays an image of a disposable wearable article superimposed on a captured image, to install the app AP11.

[0133] For example, the server device 100 identifies users who have registered with the business operator T but have not yet installed the application AP11 by matching information indicating users who have registered with the business operator T with information indicating users who have installed the application AP11. Then, the server device 100 transmits guidance information to guide the identified users to install the application AP11 to the terminal device 10. As a result, the terminal device 10 displays the guidance information to guide the users to install the application AP11 on the display screen.

[0134] In addition, the server device 100 may identify users who have accessed content related to provider T but have not installed app AP11 by matching cookie information indicating users who have accessed content related to provider T with information indicating users who have installed app AP11.

[0135] Furthermore, the server device 100 identifies users who are located in the vicinity of a store indicated by "Stores that carry the app" in the product information storage unit 121, based on the location information of the users. The server device 100 may then identify users who have not installed the app AP11 among the users who are located in the vicinity of a store indicated by "Stores that carry the app" by matching information about the identified users (e.g., the terminal ID of the identified users) with information indicating users who have installed the app AP11.

[0136] In this way, by displaying guidance information on a terminal device of a user who is identified based on user information about the user and who does not have an application installed that displays an image of a disposable wearable item superimposed on a captured image, guiding the user to install the application, it is possible to effectively lower the barrier to entry for a user to try on disposable wearable items in a store.

[0137] [6-5. Posting to information sharing services] Furthermore, the terminal device 10 may display predetermined information corresponding to posting to a predetermined information sharing service (SNS) on a captured image on which a mask image is superimposed, which is a captured image of a user. For example, when the shutter button is pressed in a state in which the mask image GP21 is superimposed and displayed on the captured image, the terminal device 10 acquires a still image from the captured image on which the mask image GP21 is superimposed, and displays predetermined information corresponding to posting to a predetermined information sharing service (SNS) on the acquired still image. For example, the terminal device 10 displays information on the mask PD21 (for example, the company logo of the business operator T, the product of the mask PD21, the brand name of the mask PD21, etc.) as the predetermined information. Furthermore, the terminal device 10 may display guidance information for guiding posting to a predetermined information sharing service as the predetermined information. The guidance information is, for example, guidance information consisting of text information such as "Take a photo and post it!"

[0138] In this way, by displaying specific information corresponding to a post to a specific information sharing service on an image taken by a user on which an image of a disposable wearable item is superimposed, it becomes possible to effectively advertise the disposable wearable item or a business operator of the disposable wearable item via the specific information sharing service.

[0139] [6-6. Comparison] Furthermore, the terminal device 10 may display images of the user on which a mask image is superimposed that have been taken so far, so that the images can be compared. For example, the terminal device 10 displays images of the user on which a mask image is superimposed that have been taken in the past, together with an image currently being taken on which a mask image is superimposed. This point will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of image comparison according to the embodiment.

[0140] For example, in response to the first selection made by user U1 in selected content C11, the terminal device 10 displays a mask image GP31 of the mask PD31 superimposed on the captured image, and when the shutter is pressed in this state, a still image SM3 in which user U1 is virtually wearing the mask PD31 is acquired.

[0141] In this state, it is assumed that the display control process has now progressed up to step S23 in Fig. 2 and Fig. 3. Then, as described in step S24 in Fig. 3, the terminal device 10 displays a mask image GP21 of the mask PD21 superimposed on the current captured image of the user U1, in a state in which the user U1 is virtually wearing a mask PD21 having a shape indicated by the AR information 3D21, based on the detected face parts. At this time, the terminal device 10 performs display in a form as shown in Fig. 5.

[0142] For example, the terminal device 10 divides a display area on the display screen where a captured image is displayed into two display areas, an area AR11 and an area AR12. The terminal device 10 then displays a still image SM3 acquired in advance in the area AR11 as a comparison image. In addition to this display, the terminal device 10 also displays in the area AR12 a mask image GP21 of the mask PD21 superimposed on the current captured image captured by the user U1, with the user U1 virtually wearing the mask PD21 having the shape indicated by the AR information 3D21.

[0143] In this way, the terminal device 10 displays a previously captured image together with a currently captured image on which an image of a disposable wearable article is superimposed, thereby allowing the user to easily compare which disposable wearable article suits the user, thereby preventing a situation in which the user finds out after purchasing a disposable wearable article that the purchased disposable wearable article does not suit the user.

[0144] 5, the terminal device 10 divides the display area in which the captured image is displayed into two parts, an upper part and a lower part, but may divide it into two parts, for example, a left part and a right part. Also, the terminal device 10 does not necessarily need to divide the display area in which the captured image is displayed into two parts, and can divide it into any number of parts depending on the number of comparison images.

[0145] 7. Configuration of the display control device Next, a display control device according to an embodiment will be described with reference to Fig. 6. Fig. 6 is a diagram showing a configuration example of an information processing device according to an embodiment. Specifically, Fig. 6 is a diagram showing a configuration example of a terminal device 10 and a server device 100, which are examples of an information processing device according to an embodiment. In the following, first, a configuration example of the terminal device 10 will be described, and then a configuration example of the server device 100 will be described.

[0146] [7-1. Terminal Device Configuration] (Regarding communication section 11) The communication unit 11 is realized by, for example, a network interface card (NIC) etc. The communication unit 11 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the server device 100, for example.

[0147] (Regarding the input unit 12, the imaging unit 13, and the output unit 14) The input unit 12 is an input device that accepts various operations from a user. For example, the input unit 12 is realized by a keyboard, a mouse, operation keys, etc. The output unit 14 is a display device for displaying various information. For example, the output unit 14 is realized by a liquid crystal display, etc. If a touch panel is adopted in the terminal device 10, the input unit 12 and the output unit 14 are integrated. Furthermore, the output unit 14 corresponds to, for example, a display screen of the terminal device 10. Furthermore, the imaging unit 13 corresponds to a camera function that captures an image of a target. The imaging unit 13 is controlled, for example, by an application that performs a display control process according to the embodiment.

[0148] (Regarding the control unit 15) The control unit 15 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), etc., executing various programs (e.g., application AP11 or application AP12) stored in a storage device inside the terminal device 10 using a RAM as a working area. The control unit 15 is also realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0149] (Regarding the control unit 15) As shown in Fig. 6, the control unit 15 has an acquisition unit 15a, a generation unit 15b, a detection unit 15c, and a display control unit 15d, and realizes or executes the functions and actions of information processing described below. Note that the internal configuration of the control unit 15 is not limited to the configuration shown in Fig. 6, and may be other configurations as long as they perform information processing described below. Also, the connection relationship between the processing units of the control unit 15 is not limited to the connection relationship shown in Fig. 6, and may be other connection relationships.

[0150] (Regarding the acquisition unit 15a) The acquiring unit 15a acquires article information indicating the shape of a disposable wearing article specified in response to information input by a user. For example, the acquiring unit 15a acquires the article information from the server device 100. Also, for example, the acquiring unit 15a acquires article information (AR information) indicating the shape of a disposable mask made of nonwoven fabric as the disposable wearing article.

[0151] The acquiring unit 15a also acquires, as input information, the article information indicating the shape of the disposable wearing article identified according to identification information (QR code) attached to a display shelf on which the disposable wearing article is displayed as a commodity.

[0152] For example, the acquiring unit 15a acquires article information indicating the shape of a disposable wearing article that is identified by the identification information and is currently displayed on a display shelf as a disposable wearing article specified according to the identification information.

[0153] For example, the acquiring unit 15a may acquire, as the disposable wearing article specified according to the identification information, the wearing article identified by the identification information, and the article information indicating the shape of the disposable wearing article corresponding to the category selected by the user from among the display candidate disposable wearing articles which are the wearing articles related to the wearing article identified by the identification information. For example, the acquiring unit 15a acquires, from among the display candidate disposable wearing articles which belong to the first category selected by the user, the article information indicating the shape of the wearing article which belongs to the second category which is further selected by the user and which is a lower category than the first category. On the other hand, the acquiring unit 15a may acquire, from among the display candidate disposable wearing articles, the article information indicating the shape of the disposable wearing article selected by the user, or may acquire, from among the display candidate disposable wearing articles specified according to the attribute information or preference of the user.

[0154] The acquiring unit 15a may also acquire, as the input information, article information indicating the shape of a disposable wearing article identified according to an image captured of the user.

[0155] (Regarding the generation unit 15b) When the generating unit 15b acquires the article information, the generating unit 15b generates an image of the disposable wearing article from the acquired article information. For example, when the generating unit 15b acquires the article information from the server device 100, the generating unit 15b generates a three-dimensional image that virtually reproduces the shape indicated by the acquired article information based on the shape of the disposable wearing article.

[0156] (Regarding the detection unit 15c) The detection unit 15c detects the user's body parts based on the captured images of the user. For example, the detection unit 15c detects the user's body parts based on each captured image by sequentially acquiring images captured by the camera (imaging unit 13). For example, the detection unit 15c detects the user's body parts that are virtually worn by the disposable wearing article based on the captured images.

[0157] For example, the detection unit 15c detects the facial features of the user based on a captured image of the user. For example, the detection unit 15c detects the user's eyes, nose, mouth, and ears. The detection unit 15c also detects the shape of the user's jaw line and the orientation of the user's face relative to a camera capturing the user's image. The detection unit 15c also detects the size of the user's face.

[0158] (Regarding the display control unit 15d) The display control unit 15d displays an image of a disposable wearable article having a shape indicated by the article information superimposed on a captured image of the user in a state in which the user virtually wears the disposable wearable article. For example, the display control unit 15d displays an image of the disposable wearable article superimposed on a captured image such that the disposable wearable article having a shape indicated by the article information is positioned at an appropriate body position according to the usage purpose of the disposable wearable article based on a body part of the user detected from the captured image of the user.

[0159] Also, for example, the display control unit 15d controls the shape indicated by the article information according to the orientation of the user's face shown in the captured image relative to the imaging means (imaging unit 13) that images the user, and displays the disposable wearable article with the controlled shape superimposed on the captured image in a state in which the disposable wearable article with the controlled shape is virtually worn by the user. Also, for example, the display control unit 15d controls the size of the image of the disposable wearable article according to the size of the user's face, and superimposes the image with the controlled size on the captured image.

[0160] Furthermore, when the color or pattern of the disposable wearing article is designated by the user, the display control unit 15d superimposes an image of the disposable wearing article having the designated color or pattern on the captured image as an image of the disposable wearing article. For example, the display control unit 15d displays color selection content that allows a user to select any color on the display screen. Then, the display control unit 15d controls (changes) the color of the image of the disposable wearing article that is currently being displayed to the color designated in the color selection content. The color selection content is generated by, for example, the generating unit 15b. For example, the generating unit 15b generates the color selection content based on the color variation of the disposable wearing article identified according to the identification information.

[0161] When the size of the disposable wearing article is specified by the user, the display control unit 15d superimposes an image of the disposable wearing article of a size corresponding to the specified size on the captured image. For example, the display control unit 15d displays size selection content on the display screen, which allows the user to select any size from small, normal, and large. The display control unit 15d then controls (changes) the size of the currently displayed image of the disposable wearing article to the size specified in the size selection content. The size selection content is generated by, for example, the generating unit 15b. For example, the generating unit 15b generates the size selection content based on the size variations of the disposable wearing article identified according to the identification information.

[0162] In addition, the display control unit 15d may display guidance information on a terminal device of a user identified based on user information about the user, the user not having installed an application that displays an image of a disposable wearable item superimposed on a captured image, guiding the user to install the application.

[0163] In addition, after the input information is input, the display control unit 15d may display guidance information to take a photograph that includes a part of the user's body that is to be virtually worn by the disposable wearable article, if it is determined that the part is not included in the captured image of the user.

[0164] The display control unit 15d may display images of the user taken in the past on which an image of a disposable wearing article is superimposed, so that the images can be compared. For example, the display control unit 15d displays images of the user taken in the past on which an image of a disposable wearing article is superimposed, together with an image currently taken on which an image of a disposable wearing article is superimposed. For this reason, the terminal device 10 may have a storage unit that stores the captured images. For example, the terminal device 10 may have a storage unit that stores a still image obtained from the captured image by pressing the shutter.

[0165] The display control unit 15d may display predetermined information corresponding to posting to a predetermined information sharing service on a photographed image taken by a user on which an image of a disposable wearing article is superimposed. For example, the display control unit 15d displays information related to the disposable wearing article as the predetermined information. For example, when the shutter button is pressed in a state in which an image of a disposable wearing article is superimposed and displayed, the display control unit 15d acquires a still image from the photographed image on which the image of the disposable wearing article is superimposed. Then, the display control unit 15d displays predetermined information corresponding to posting to a predetermined information sharing service (SNS) on the acquired still image. For example, the display control unit 15d displays information related to the disposable wearing article (for example, a company logo, a product name of the disposable wearing article, a brand name of the disposable wearing article, etc.) as the predetermined information. The display control unit 15d may display guidance information for guiding posting to a predetermined information sharing service as the predetermined information.

[0166] [7-2. Server device configuration] (Regarding communication unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the terminal device 10, for example.

[0167] (Regarding the storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk, an optical disk, etc. The storage unit 120 has the product information storage unit 121 described in FIG.

[0168] (Regarding the control unit 130) The control unit 130 is realized by a CPU, an MPU, or the like executing various programs (e.g., the application AP11 or the application AP12) stored in a storage device inside the server device 100 using the RAM as a working area. The control unit 130 is also realized by an integrated circuit such as an ASIC or an FPGA.

[0169] As shown in Fig. 6, the control unit 130 has an acquisition unit 131, an identification unit 132, a generation unit 133, and a transmission unit 134, and realizes or executes the functions and actions of information processing described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in Fig. 6, and may be other configurations as long as they perform the information processing described below. Also, the connection relationship between the processing units included in the control unit 130 is not limited to the connection relationship shown in Fig. 6, and may be other connection relationships.

[0170] (Regarding the acquisition unit 131) The acquiring unit 131 acquires article information indicating the shape of a disposable wearing article specified in response to information input by a user. For example, the acquiring unit 131 acquires the article information from the product information storage unit 121. Also, for example, the acquiring unit 131 acquires article information (AR information) indicating the shape of a disposable mask made of nonwoven fabric as the disposable wearing article.

[0171] The acquiring unit 131 also acquires, as input information, the article information indicating the shape of the disposable wearing article identified according to identification information (QR code) attached to a display shelf on which the disposable wearing article is displayed as a commodity.

[0172] For example, the acquiring unit 131 acquires article information indicating the shape of a disposable wearing article identified by the identification information as a disposable wearing article specified according to the identification information and currently displayed on a display shelf.

[0173] For example, the acquiring unit 131 may acquire, as the disposable wearing article specified according to the identification information, the wearing article identified by the identification information, and the article information indicating the shape of the disposable wearing article corresponding to the category selected by the user from among the display candidate disposable wearing articles which are the wearing articles related to the wearing article identified by the identification information. For example, the acquiring unit 131 acquires, among the display candidate disposable wearing articles which belong to the first category selected by the user, the article information indicating the shape of the wearing article which belongs to the second category which is further selected by the user and is a lower category than the first category. On the other hand, the acquiring unit 131 may acquire, among the display candidate disposable wearing articles, the article information indicating the shape of the disposable wearing article selected by the user, or may acquire, among the display candidate disposable wearing articles specified according to the attribute information or preference of the user.

[0174] Moreover, the acquisition unit 131 acquires the captured image from the terminal device 10.

[0175] (Regarding the identification unit 132) The identification unit 132 identifies the display candidate disposable wearing articles based on the input information (QR code) by the user. For example, the identification unit 132 identifies the display candidate disposable wearing articles based on the product ID included in the input information. For example, the identification unit 132 identifies the disposable wearing article uniquely identified by the product ID included in the input information and the disposable wearing article related to this wearing article as the display candidate disposable wearing articles.

[0176] The specifying unit 132 may specify a disposable wearing article as a display candidate based on attribute information of the user or a preference of the user.

[0177] (Regarding the generation unit 133) The generating unit 133 generates a selection content for allowing the user to select a desired wearing article from among the display candidate disposable wearing articles identified by the identifying unit 132. For example, the generating unit 133 generates a selection content for allowing the user to select any one of first categories that are higher than the categories to which the display candidate disposable wearing articles belong, based on the product information storage unit 121, and for allowing the user to further select any one of second categories that correspond to the selected first category and are lower than the first category. In the example of FIG. 2, the generating unit 133 generates a selection content C11.

[0178] The generating unit 133 may have the same function as the generating unit 15b. For example, the generating unit 133 may have a function of generating an image of a disposable wearing article from the article information.

[0179] (Regarding the transmitting unit 134) The transmission unit 134 transmits various information. For example, the transmission unit 134 transmits various information to the terminal device 10. For example, the transmission unit 134 transmits to the terminal device 10 the selected content, the item information, the guidance information, the information indicating the body parts detected from the user (corresponding to the detection result by the detection unit 15c) generated by the generation unit 133, and an image of the disposable wearing item generated from the item information.

[0180] (Other processing units) In addition, the server device 100 may further have a processing unit corresponding to the detection unit 15c and a processing unit corresponding to the display control unit 15d so as to perform the display control processing described in FIG. 4 as being performed by the server device 100.

[0181] 8. Processing Procedure Next, the procedure of the display control process according to the embodiment will be described with reference to Fig. 7 and Fig. 8. Fig. 7 describes a display control process procedure up to acquiring article information (AR information) corresponding to a disposable wearing article specified according to information input by a user, among the display control processes according to the embodiment. Fig. 8 describes a display control process procedure for superimposing an image of a disposable wearing article having a shape indicated by the acquired article information on a captured image, among the display control processes according to the embodiment. In Fig. 7 and Fig. 8, the disposable wearing article will be described as a disposable mask made of nonwoven fabric.

[0182] [8-1. Processing Procedure (1)] First, a display control process procedure up to acquiring article information (AR information) corresponding to a disposable wearing article specified in accordance with information input by a user will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the display control process procedure in the first half of the display control process according to the embodiment.

[0183] First, the acquisition unit 131 judges whether or not the product information (product ID) associated with the input of the code information has been acquired (step S101). For example, when the terminal device 10 transmits product information detected from the code information to the server device 100 in response to the user inputting the code information to the terminal device 10, the acquisition unit 131 judges that the product information associated with the input of the code information has been acquired.

[0184] Then, while the acquiring unit 131 has not been able to acquire product information (product ID) accompanying the input of code information (step S101; No), it waits until it can be acquired. On the other hand, when the acquiring unit 131 has acquired product information (step S101; Yes), the identifying unit 132 identifies display candidate masks based on the acquired product information (step S102). For example, the identifying unit 132 further narrows down the display candidate masks stored in the product information storage unit 121 based on the product information to display candidate masks corresponding to the product information.

[0185] Next, the generating unit 133 generates a selection content that allows the user to select a desired mask from the display candidate masks identified by the identifying unit (step S103). Then, the transmitting unit 134 transmits the selection content generated by the generating unit 133 to the terminal device 10 (step S104). The terminal device 10 is owned by the user who input the code information.

[0186] In this state, the acquisition unit 131 determines whether or not a selection of any one of the categories (first category, second category) indicated in the selected content has been accepted (step S105). That is, the acquisition unit 131 determines whether or not category information indicating a selected category of the categories (first category, second category) indicated in the selected content has been acquired from the terminal device 10. While the acquisition unit 131 determines that a category selection has not been accepted because it is unable to acquire category information (step S105; No), it waits until it can determine that a category selection has been accepted by acquiring category information.

[0187] On the other hand, when the acquisition unit 131 determines that the selection of a category has been accepted by acquiring the category information (step S105; Yes), the acquisition unit 131 acquires AR information indicating the shape of a mask belonging to the selected category from the product information storage unit 121 (step S106). Then, the transmission unit 134 transmits the AR information acquired by the acquisition unit to the terminal device 10.

[0188] [8-2. Processing Procedure (2)] First, a display control process procedure for superimposing an image of a disposable wearing article having a shape indicated by acquired article information on a captured image will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the latter half of the display control process procedure of the display control process according to the embodiment.

[0189] First, the acquisition unit 15a determines whether or not the AR information has been acquired from the server device 100 (Step S201). If the acquisition unit 15a has not been able to acquire the AR information from the server device 100 (Step S201; No), the acquisition unit 15a waits until the AR information can be acquired.

[0190] On the other hand, if the AR information is acquired by the acquisition unit 15a (step S201; Yes), the generation unit 15b generates a mask image from the AR information (step S202).

[0191] Furthermore, when the mask image is generated, the display control unit 15d dynamically activates the in-camera and displays guidance information that guides the user to capture an image of the face with the in-camera (Step S203).

[0192] Next, the detection unit 15c detects facial features of the user based on the captured image captured in response to the guidance (step S204).

[0193] Then, based on the facial features detected by the detection unit 15c, the display control unit 15d displays a mask image of the mask superimposed on the captured image of the user, in a state in which the user is virtually wearing a mask having the shape indicated by the AR information (step S205).

[0194] [9. Others] Among the above-mentioned processes, all or part of the processes described as being performed automatically may be performed manually. Also, all or part of the processes described as being performed manually may be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings may be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

[0195] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure. Furthermore, each component may be configured by distributing and integrating functionally or physically in any unit, in whole or in part, depending on various loads and usage conditions. Furthermore, each process described above may be executed in appropriate combination within a range that does not contradict.

[0196] [10. Hardware Configuration] The display control device according to the embodiment described above is realized by a computer 1000 having a configuration as shown in Fig. 9. Fig. 9 is a diagram showing an example of a hardware configuration. The computer 1000 is connected to an output device 1010 and an input device 1020, and a calculation device 1030, a cache 1040, a memory 1050, an output IF (Interface) 1060, an input IF 1070, and a network IF 1080 are connected by a bus 1090.

[0197] The arithmetic device 1030 operates based on programs stored in a cache 1040 or memory 1050, programs read from the input device 1020, etc., and executes various processes. The cache 1040 is a cache such as a RAM that temporarily stores data used by the arithmetic device 1030 for various calculations. The memory 1050 is a storage device in which data used by the arithmetic device 1030 for various calculations and various databases are registered, and is a memory realized by a ROM (Read Only Memory), an HDD (Hard Disk Drive), a flash memory, etc.

[0198] The output IF 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various types of information, such as a monitor or a printer, and may be realized by a connector conforming to a standard such as USB (Universal Serial Bus), DVI (Digital Visual Interface), or HDMI (registered trademark) (High Definition Multimedia Interface). On the other hand, the input IF 1070 is an interface for receiving information from various input devices 1020, such as a mouse, keyboard, scanner, etc., and is realized by, for example, a USB.

[0199] For example, the input device 1020 may be realized by a device that reads information from an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory, etc. The input device 1020 may also be realized by an external storage medium such as a USB memory.

[0200] The network IF 1080 has a function of receiving data from other devices via the network N and sending it to the arithmetic device 1030, and also has a function of transmitting data generated by the arithmetic device 1030 to other devices via the network N.

[0201] Here, the arithmetic device 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the arithmetic device 1030 loads a program from the input device 1020 or the memory 1050 onto the cache 1040, and executes the loaded program. For example, when the computer 1000 functions as a display control device, the arithmetic device 1030 of the computer 1000 executes the program loaded onto the cache 1040, thereby realizing the function of the control unit 130. [Explanation of symbols]

[0202] 10 Terminal Equipment 15 Control section 15a Acquisition part 15b Generator 15c Detection section 15d Display control unit 100 Server device 121 Product information storage section 130 Control section 131 Acquisition Department 132 Specific part 133 Generation part 134 Transmitter

Claims

1. an identification unit that refers to a storage device that stores, for a plurality of masks, item information indicating the shape of the mask, identification information of the mask, a series to which the mask belongs, and a category to which the mask belongs, in association with each other, and identifies a plurality of masks that belong to a different category from the mask corresponding to the identification information input by a user, among the masks that belong to the same series as the mask corresponding to the identification information; an acquisition unit that acquires product information indicating a shape of a mask corresponding to the content selected by the user from among the masks identified by the identification unit; a display control unit that displays an image of the mask superimposed on a captured image of the user in a state in which the user is virtually wearing the mask having the shape indicated by the item information; A display control device comprising:

2. The acquisition unit acquires the item information indicating a shape of a mask corresponding to a category selected by the user from among the masks identified by the identification unit. The display control device according to claim 1 .

3. The acquisition unit acquires, as the item information, item information indicating a shape of a mask belonging to a second category further selected by the user among masks belonging to a first category selected by the user, the second category being a lower category than the first category.

3. The display control device according to claim 2.

4. The acquisition unit acquires the item information indicating a shape of a mask selected by the user from among the masks identified by the identification unit.

4. The display control device according to claim 1, wherein the display control device is a display control device for displaying a display image.

5. The acquisition unit acquires the item information indicating a shape of a mask selected by the user from among the masks identified by the identification unit according to the attribute information or preferences of the user.

5. The display control device according to claim 1, wherein the display control device is a display control device for displaying a display image.

6. The acquisition unit acquires, as the item information, item information indicating a shape corresponding to the user that is included in a captured image.

6. The display control device according to claim 1, wherein the display control device is a display control device for displaying a display image.

7. The display control unit displays an image of the mask superimposed on the captured image so that the mask having the shape indicated by the item information is positioned at an appropriate body position according to the intended use of the mask based on body parts of the user detected from the captured image of the user.

7. The display control device according to claim 1, wherein the display control device is a display control device for displaying a display image.

8. The display control unit controls a shape indicated by the item information according to a face orientation of the user shown in the captured image relative to an image capturing means capturing the user, and displays an image of the mask having the controlled shape superimposed on the captured image in a state in which the user is virtually wearing the mask.

8. The display control device according to claim 1, wherein the display control device is a display control device for displaying a display image.

9. The display control unit controls a size of the image of the mask in accordance with a size of the face of the user, and superimposes the image of the controlled size on the captured image.

9. The display control device according to claim 1, wherein the display control device is a display control device for displaying a display image.

10. When a color or pattern of a mask is designated by the user, the display control unit superimposes an image of the mask having the designated color or pattern on the captured image as the image of the mask.

10. The display control device according to claim 1, wherein the display control device is a display control device for displaying a display image.

11. When a size of a mask is designated by the user, the display control unit superimposes an image of the mask having a size corresponding to the designated size on the captured image.

11. The display control device according to claim 1, wherein the display control device is a display control device.

12. The display control unit displays guidance information on a terminal device of a user who is identified based on user information relating to the user and who does not have an application installed that displays an image of a mask superimposed on the captured image, the guidance information instructing the user to install the application.

12. The display control device according to claim 1, wherein the display control device is a display control device.

13. The display control unit displays guidance information to prompt the user to take a photograph including a body part of the user that is virtually worn by the mask and is not included in a photographed image of the user when the display control unit determines that the body part is not included in a photographed image of the user.

13. The display control device according to claim 1, wherein the display control device is a display control device.

14. The display control unit displays images of the user that have been taken so far, among the images on which the mask image is superimposed, in a manner that allows comparison.

14. The display control device according to claim 1, wherein the display control device is a display control device for displaying a display image.

15. The display control unit displays a previously captured image among captured images of the user on which the image of the mask is superimposed, together with a currently captured image on which the image of the mask is superimposed.

15. The display control device according to claim 14.

16. The display control unit displays predetermined information corresponding to the posting to a predetermined information sharing service on a captured image of the user on which an image of the mask is superimposed.

16. The display control device according to claim 1, wherein the display control device is a display control device for displaying a display image.

17. The display control unit displays information about the mask as the predetermined information.

17. The display control device according to claim 16.

18. A display control method executed by a display control device, comprising: an identification process for identifying a plurality of masks that belong to a different category from the mask corresponding to the identification information input by the user among the masks that belong to the same series as the mask corresponding to the identification information input by the user, by referring to a storage device that stores therein item information indicating the shape of the mask, the identification information of the mask, the series to which the mask belongs, and the category to which the mask belongs, in association with each other; An acquisition step of acquiring product information indicating a shape of a mask corresponding to the content selected by the user from among the masks identified by the identification step; a display control step of displaying an image of the user in a state in which the user is virtually wearing the mask having the shape indicated by the item information, the image being superimposed on a captured image of the user; A display control method comprising:

19. an identification step of referring to a storage device that stores, for a plurality of masks, item information indicating the shape of the mask, the identification information of the mask, the series to which the mask belongs, and the category to which the mask belongs, in association with each other, and identifying a plurality of masks that belong to a different category from the mask corresponding to the identification information input by the user, among the masks that belong to the same series as the mask corresponding to the identification information; An acquisition step of acquiring product information indicating a shape of a mask corresponding to the content selected by the user from among the masks identified by the identification step; a display control step of displaying an image of the mask superimposed on an image captured of the user in a state in which the user is virtually wearing the mask having the shape indicated by the item information; A display control program for causing a computer to execute the above.

Citation Information

Patent Citations

  • Image processing method

    JP2002077592A

  • Try-on system

    JP2012108805A

  • Information processing device, information processing method, information processing system, and program

    JP2012181688A

  • Method for displaying image of dressing

    JP2016001360A

  • Apparatus, System, and Method for Virtualization in a Mirror

    JP2016532197A