Information processing apparatus, information processing method, and program

Abstract

To provide a diagnostic device or the like capable of further improving user's satisfaction.SOLUTION: The diagnosis device 100 includes a first acquisition unit that acquires a front image and a side image of a user, a second acquisition unit that acquires part characteristic information indicating a characteristic of each main part of the user based on the acquired front image and side image, a questionnaire execution unit that performs a questionnaire related to skeleton diagnosis on the user and receives a response to the questionnaire, a diagnosis unit that diagnoses a skeleton type of the user based on the part characteristic information and the response to the questionnaire, and an output unit that outputs a result of the diagnosis.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program suitable for use in apparel-related facilities and the like. [Background technology]

[0002] A skeletal diagnosis is used to determine the fashion that suits you best based on your natural bone structure, muscle structure, body texture, and body line. Based on your physical characteristics, a skeletal diagnosis can classify your hair into multiple types, such as straight, wavy, and natural.

[0003] Specific skeletal diagnosis methods include a method in which an expert certified as an analyst thoroughly analyzes the user's body and determines their skeletal type (expert diagnosis), and a method in which the user determines their skeletal type by answering multiple questions about their physical characteristics (self-diagnosis) (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-157650 Summary of the Invention [Problem to be solved by the invention]

[0005] However, it has been pointed out that expert diagnosis is difficult for beginners, and that self-diagnosis, although easy to use, is unreliable.

[0006] The present invention has been made in consideration of the above-described circumstances, and one of its objects is to provide a highly convenient and reliable skeletal diagnosis for the user. [Means for solving the problem]

[0007] An information processing device according to one embodiment of the present invention is characterized by comprising: a first acquisition unit that acquires front and side images of a user; a second acquisition unit that acquires part characteristic information that represents the characteristics of each of the user's main parts based on the acquired front and side images; a questionnaire implementation unit that conducts a questionnaire regarding skeletal diagnosis with the user and accepts responses to the questionnaire; a diagnosis unit that diagnoses the user's skeletal type based on the part characteristic information and the responses to the questionnaire; and an output unit that outputs the results of the diagnosis. [Effects of the Invention]

[0008] According to the present invention, it is possible to perform a highly convenient and reliable skeletal diagnosis for the user. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram showing a schematic configuration of a skeletal diagnosis system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a diagram illustrating a configuration of a diagnostic device. [Figure 3] 10 is a flowchart illustrating an outline of a skeletal diagnosis process executed by a control unit. [Figure 4] FIG. 10 is a diagram illustrating a preparation screen. [Figure 5A] FIG. 10 is a diagram illustrating an example of an imaging screen. [Figure 5B] FIG. 10 is a diagram illustrating an example of an imaging screen. [Figure 6A] FIG. 10 is a diagram illustrating an example of a part characteristic information correction screen. [Figure 6B] FIG. 10 is a diagram illustrating an example of a part characteristic information correction screen. [Figure 7A] FIG. 10 is a diagram illustrating an example of a questionnaire screen. [Figure 7B] FIG. 10 is a diagram illustrating an example of a questionnaire screen. [Figure 8] This is an explanatory diagram showing an overview of the 12 skeletal types. [Figure 9A] FIG. 10 is a diagram illustrating a diagnosis result screen. [Figure 9B] FIG. 10 is a diagram illustrating a diagnosis result screen. [Figure 9C] FIG. 10 is a diagram illustrating a diagnosis result screen. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the same elements are given the same reference numerals and redundant description will be omitted.

[0011] A. This embodiment A-1.Configuration FIG. 1 is a diagram showing a schematic configuration of a skeletal diagnosis system 1000 according to this embodiment. The skeletal diagnosis system 1000 includes a user terminal 10 carried by each user, and a diagnosis device (information processing device) 100 that is installed in an apparel-related store or the like and is capable of performing skeletal diagnosis. The user terminal 10 and the diagnosis device 100 are connected to each other so as to be able to communicate with each other via a communication network N. The communication network N may be, for example, the Internet, a LAN, a dedicated line, a telephone line, an in-house network, a mobile communication network, Bluetooth (registered trademark), WiFi (Wireless Fidelity), any other communication line, or a combination thereof, and may be wired or wireless.

[0012] For example, in a shopping mall or the like that houses many stores, one diagnostic device 100 may be installed on each floor. The number of user terminals 10 and diagnostic devices 100 can be set arbitrarily depending on the number of stores and users that use this system 1000.

[0013] <User terminal 10> The user terminal 10 is a terminal used by each user, and may be a tablet terminal, a handheld computer device, a wearable terminal, a mobile phone, a smartphone, or the like. The user terminal 10 is also equipped with software, a browser, a camera, and the like necessary for using the present system 1000. The user enjoys various services provided by the present system 1000 by running the software, browser, and the like. The software may be configured to be installed on the user terminal 10, or may be configured such that some or all of the functions of the software are provided from a management server (not shown) or the like via a communication network N (so-called SaaS (Software as a Service)).

[0014] <Diagnostic device 100> FIG. 2 is a diagram showing the configuration of the diagnostic device 100 according to this embodiment. As shown in FIG. 1, the diagnostic device 100 includes a half mirror 101, a display panel 102, a camera 110, a reading device 120, a printer 130, and a computer 140.

[0015] A display panel 102 is disposed behind the half mirror 101. The half mirror 101 is formed by forming a metal film, such as silver or aluminum, as a reflective material on a flat transparent substrate, such as plastic or glass, by sputtering or the like. A semi-transmissive reflective surface 101f that allows a portion of light to pass through is formed in front of the half mirror 101.

[0016] For example, the half mirror 101 functions as a normal mirror when there is strong external light from the front, and functions as a display that projects various images through the half mirror 101 when display light is emitted from the display panel 102 arranged behind the half mirror 101.

[0017] Therefore, a user positioned in front of the half mirror 101 can use the half mirror 101 as a mirror to see his or her own appearance (i.e., a mirror image), and can also use the half mirror 101 as a display to view, for example, an image of the user.

[0018] The display panel 102 is a touch panel display that can be touched via a half mirror 101, and has a display screen 103. The display panel 102 is configured by a self-luminous display panel such as an organic EL display panel. Instead of a self-luminous display panel, a backlight type or a reflective type display panel may be used.

[0019] The camera (imaging unit) 110 is a camera using, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and is embedded somewhere in the half mirror 101 (for example, above it). The camera 110 follows an operation instruction from a user positioned in front of the half mirror 101 to capture a front image when the user faces forward and a side image when the user faces to the side. In the following description, when there is no need to particularly distinguish between the front image and the side image of the user, they will be collectively referred to as a "user image." The user image captured when the user is captured is output to the computer 140.

[0020] Reading device 120 is a reader device that reads information (e.g., membership information) contained in, for example, a barcode or a QR code (registered trademark), and is provided on the outer frame of diagnostic device 100. The user's membership information read by reading device 120 is output to computer 140. Note that reading device 120 does not necessarily have to be provided.

[0021] The printer 130 is a device that prints the results of the skeletal diagnosis performed by the diagnostic device 100, and is built into the diagnostic device 100, for example.

[0022] The computer 140 comprises a control unit 141 equipped with a CPU etc., a storage device 142 consisting of a semiconductor memory, a hard disk drive etc., an input unit 143 consisting of a touch panel etc., and a communication unit 144 consisting of an ISDN modem, an ADSL modem, a cable modem, an optical modem, a soft modem etc. The control unit 141 centrally controls each unit of the computer 140 by executing various programs stored in the storage device 142.

[0023] The storage device (storage unit) 142 stores user images of each user captured by the camera 110, an application AP for performing a bone structure diagnosis (hereinafter referred to as a bone structure diagnosis application), a user management database DB1, an advice information database DB2, and the like.

[0024] The bone structure diagnosis application AP uses the diagnosis device 100 to diagnose the bone structure of the user, and outputs the diagnosis results as well as various pieces of advice information according to the diagnosis results (details will be described later).

[0025] In the user management database DB1, an identification ID and personal information are registered in association with each other for each user. The basic personal information includes the user's name, age, sex, date of birth, address, telephone number, email address, SNS account name, etc., as well as contact information such as the store ID, email address, and telephone number of the store used, history information indicating past usage history (e.g., the results of the previous diagnosis), and user images (e.g., front and side images of the user). The control unit 141 performs new registration and update (including correction and deletion) of personal information in the user management database DB1.

[0026] The advice information database DB2 stores various pieces of advice information according to the diagnosis results. The advice information includes advice on fashion according to the bone structure type, such as advice on good and bad styling (details will be described later). The control unit 141 registers new advice information in the advice information database DB2 and updates (including corrections and deletions).

[0027] A-2. Processing Overview Hereinafter, an outline of the processing when the control unit 141 executes the bone structure diagnosis application AP and performs bone structure diagnosis will be described with reference to FIG.

[0028] 3 is a flowchart illustrating an outline of the bone structure diagnosis process executed by the control unit 141. FIG. 4 is a diagram illustrating a preparation screen P1 displayed on the display panel 102. As shown in FIG. First, the control unit 141 of the diagnostic device 100 displays a preparation screen P1 showing an outline of the skeletal diagnosis process on the display panel 102 (step S1; see FIG. 4).

[0029] After checking the processing overview of the skeletal diagnosis, the user issues an instruction to start the skeletal diagnosis by operating the display panel 102. When the control unit (first acquisition unit) 141 of the diagnosis device 100 receives the input of the instruction to start the skeletal diagnosis (step S2), the control unit (first acquisition unit) 141 captures an image of the user facing forward with the camera 110, and acquires a front image of the user (step S3). Next, the control unit (first acquisition unit) 141 captures an image of the user facing to the side with the camera 110, and acquires a side image of the user (step S4).

[0030] When the imaging is completed, the control unit (second acquisition unit) 141 acquires the position, width, etc. of each of the user's main features using AI (Artificial Intelligence) installed in the diagnostic device 100 (step S5). "Main features" are body parts required for skeletal diagnosis, and include, for example, the head, neck, shoulders, chest, pelvis, buttocks, knees, heels, etc. For convenience, physical characteristics such as the position and width of the main features may be collectively referred to as "part characteristic information."

[0031] Thereafter, the control unit (accepting unit) 141 accepts an input of a correction instruction (e.g., an instruction to correct shoulder width) from the user regarding the acquired user part characteristic information (step S6). The control unit (correcting unit) 141 corrects the corresponding user part characteristic information in accordance with the correction instruction (step S7).

[0032] Furthermore, the control unit (questionnaire implementation unit) 141 conducts a questionnaire to the user (step S8) and receives responses (questionnaire results) from the user (step S9). The control unit (diagnosis unit, output unit) 141 diagnoses the user's skeletal type based on the part characteristic information acquired from the front image and side image of the user and the questionnaire results (step S10), and outputs various pieces of advice information together with the diagnosis results (step S11). The details of each process shown in the flowchart will be described below with reference to the drawings.

[0033] A-3. Processing details (1) Acquisition of front and side images 5A and 5B are diagrams illustrating an example of the captured image screen P2 displayed on the display panel 102. FIG. The user captures a front image and a side image in accordance with instructions displayed on the display panel 102 (see FIGS. 5A and 5B). Note that instead of using the camera 110 of the diagnostic device 100, the front image and the side image may be captured using, for example, a camera (not shown) mounted on the user terminal 10. The front image and the side image of the user captured by the camera 110 are acquired by the control unit 141 of the diagnostic device 100.

[0034] (2) Acquisition and correction of part characteristic information 6A and 6B are diagrams illustrating an example of the part characteristic information correction screen P3 displayed on the display panel 102. FIG. As shown in FIGS. 6A and 6B, the correction screen P3 displays an image in which an estimated line L corresponding to part characteristic information such as the position and width of the user's main part is superimposed on the user image Im1.

[0035] A learning model for estimating (acquiring) the positions, widths, etc. of major features from a user image is stored in the storage device 142 of the diagnostic device 100. When the control unit 141 acquires a user image from the camera 110, it derives an estimated line L corresponding to the positions, widths, etc. of the user's major features by, for example, inputting the user image into the learning model. The control unit 141 superimposes the estimated line L on the user image Im1 and displays it on the correction screen P3. Note that the control unit 141 may additionally train (e.g., fine-tune) the learning model stored in the storage device 142 using a new user image.

[0036] The user inputs a correction instruction for the user's part characteristic information (i.e., the position, width, etc. of the main part) according to the instructions displayed on the display panel 102. Taking Fig. 6A as an example, if the user determines that the user's own shoulder line is shifted downward while referring to the sample Sp, the user inputs a correction instruction to raise the shoulder line by touching the display panel 102, for example.

[0037] When the control unit (correction unit) 141 receives an input of an instruction to correct part characteristic information from a user, it corrects the part characteristic information of the corresponding user in accordance with the received correction instruction and displays it on the display panel 102.

[0038] (3) Conducting a survey 7A and 7B are diagrams illustrating an example of the questionnaire screen P4 displayed on the display panel 102. FIG. In this embodiment, information that is difficult to obtain from a user image is obtained by conducting a questionnaire. For example, a questionnaire is conducted to confirm which of three types ("A" to "C") the user's collarbone type most closely matches (see FIG. 7A), or a questionnaire to confirm foot size (see FIG. 7B). The user checks the content displayed on the display panel 102 and inputs answers to the questionnaire. The content of the questionnaire can be set or changed as desired, and may include, for example, checking the type of hands or thighs, or height.

[0039] (3) Conducting a skeletal diagnosis When the control unit 141 receives the answers to all the questionnaires, it performs a bone structure diagnosis using the received questionnaire answers as well as the part characteristic information of the user. Currently, a widely known method of diagnosing hair is to divide it into three types: "straight," "wavy," and "natural." In this embodiment, however, the diagnosis is made by dividing it into 12 more detailed types.

[0040] FIG. 8 is an explanatory diagram showing an overview of the 12 types of skeletons. As shown in FIG. 8, in this embodiment, for each of the three basic types of "straight," "wave," and "natural," "straight" is subdivided into four types: "THE straight," "natural MIX straight," "slender THE straight," and "wave MIX straight." "wave" is subdivided into four types: "straight MIX wave," "sharp THE wave," "natural MIX wave," and "THE wave." "natural" is subdivided into four types: "straight MIX natural," "THE natural," "wave MIX natural," and "sharp THE natural."

[0041] When performing a bone structure diagnosis, the control unit 141 scores each of the elements of the "texture" and "body line" of the user's natural body, and determines (diagnoses) the final bone structure type (for example, "straight mixed wave") based on the results of each score. "Texture" represents the characteristics of the material, and includes elements such as the characteristics of the limbs, collarbone, shoulder characteristics, hip size, waist size, and front thigh firmness. "Body line" affects the body silhouette, and includes elements such as the firmness and roundness of the upper arms, the thickness of the front and back, the décolleté line, neck characteristics, chest height, waist height, waistline, and hip line. The elements of "texture" and "body line" are merely examples, and the elements to be included are arbitrary.

[0042] The control unit 141 performs scoring for each of the elements of "texture" and "body line" using part characteristic information acquired from the user image and responses to a questionnaire. To explain this by way of example, when scoring "hand and foot characteristics," which is one element of "texture," the control unit (first scoring unit, second scoring unit) 141 determines "hand characteristics" from the responses to the questionnaire, and determines "foot characteristics" using part characteristic information acquired from the user image. Based on the results of the determination of the "hand characteristics" and "foot characteristics," the control unit 141 performs scoring such as "straightforward points of ◯×" or "natural points of △×."

[0043] As another example, when scoring "waist height," which is one element of "body line," the control unit 141 uses part characteristic information acquired from the user image to determine whether the waist height is high or low. If the "waist height" is high, the control unit 141 will assign a score such as "straight x △ points" or "natural 〇△ points," while if the "waist height" is low, the control unit 141 will assign a score such as "wavy x 〇 points" or "natural 〇〇 points." It should be noted that information required for control unit 141 to perform scoring (for example, a scoring algorithm, a scoring condition table, etc.) is stored in storage device 142.

[0044] (4) Output of diagnostic results The control unit (output unit) 141 determines the final bone structure type (for example, "straight mix wave") based on the scoring results of each element of "texture" and "body line," and then outputs the determined bone structure type, as well as the scoring results of the user's "texture" and "body line," and various advice information according to the characteristics of each of the user's main parts (i.e., characteristics taking into account bone structure type, texture, and body line).

[0045] 9A to 9C are diagrams illustrating an example of a diagnosis result screen P5 displayed on the display panel 102. FIG. As shown in Fig. 9A, the diagnosis result screen P5 displays the user's skeletal type and the characteristics of that skeletal type, as well as the scoring results of the user's "texture" and the scoring results of the user's "body line" in percentage format. Furthermore, the diagnosis result screen P5 displays advice information such as the user's preferred taste and image, preferred materials, and silhouette to keep in mind according to the characteristics of each of the user's main body parts.

[0046] As shown in FIG. 9B, another diagnosis result screen P5 displays the characteristics of each part of the user's body for each of "texture" and "body line," as well as advice information that represents personal advice based on the characteristics of each of the user's major parts. Additionally, the diagnosis result screen P5 may also display the characteristics of the user's body balance relative to the ideal body balance (e.g., "broad shoulders"). Furthermore, advice information representing correction points for the user's body balance (e.g., "adding an accent to the neck will make the body look more balanced") may also be displayed on the diagnosis result screen P5.

[0047] As shown in FIG. 9C, another diagnosis result screen P5 displays advice information on styling that the user is good at and that the user is not good at, along with items that the user is good at according to the characteristics of each of the user's main body parts. The advice information on styling that the user is good at and that the user is not good at (first styling information, second styling information) includes not only explanatory text on styling but also styling images (photographs) Im2 of other people that serve as examples of styling that the user is good at and that the user is not good at (see FIG. 9C). By referring to the styling images Im2 of other people that serve as examples, the user can more clearly imagine the styling that the user is good at and that the user is not good at.

[0048] The advice information described above is stored in an advice information database (storage unit) DB2. The control unit (output unit) 141 displays various pieces of advice information according to the characteristics of each of the user's main body parts on the display panel 102 based on the determined bone structure type, the scoring results of the user's "texture," and the scoring results of the user's "body line." The diagnostic chart showing the diagnosis results can be downloaded to the user terminal 10 by accessing the code information Co displayed on the diagnosis result screen P5, or printed out using the printer 130 (see FIGS. 9A to 9C).

[0049] According to the present embodiment, the user's skeletal type is diagnosed based on the results of a questionnaire about the user's skeletal diagnosis, as well as part characteristic information (such as shoulder width) acquired from the user's image, and various pieces of advice information are provided based on the diagnosis results. This makes it possible to perform a skeletal diagnosis that is more convenient and reliable than conventional methods.

[0050] B. Application Examples In the above-described embodiment, the case where the diagnostic device 100 is used has been described, but the present invention is not limited to this. For example, a skeletal diagnosis similar to that of the diagnostic device 100 may be performed by installing a skeletal diagnosis application AP on various terminals (for example, tablet terminals, smartphones, etc.) used by the user.

[0051] Furthermore, by utilizing the results of the bone structure diagnosis, information on recommended products (recommended product information) according to the characteristics of each main part of the user may be provided to the user terminal 10. The recommended product information may include information on fashion goods, information on health goods, and the like.

[0052] C. Other The present invention is not limited to the above-described embodiment, and can be embodied in various other forms without departing from the spirit of the present invention. Therefore, the above-described embodiment is merely an example in all respects and should not be interpreted as being limiting. For example, the order of the above-described processing steps can be arbitrarily changed or executed in parallel as long as no contradiction occurs in the processing content. [Explanation of symbols]

[0053] 1000...Bone structure diagnosis system, 10...User terminal, 100...Diagnostic device, 101...Half mirror, 102...Display panel, 103...Display screen, 110...Camera, 120...Reading device, 130...Printer, 140...Computer, 141...Control unit, 142...Storage device, 143...Input unit, 144...Communication unit, AP...Bone structure diagnosis application, DB1...User management database, DB2...Advice information database, P1...Preparation screen, P2...Capture screen, P3...Correction screen, P4...Questionnaire screen, P5...Diagnosis result screen, Im1...User image, Sp...Sample, L...Estimated line, Im2...Styling image

Claims

1. a first acquisition unit that acquires a front image and a side image of a user; a second acquisition unit that acquires part characteristic information representing characteristics of each main part of the user based on the acquired front image and side image; a questionnaire implementation unit that conducts a questionnaire regarding a skeletal diagnosis to the user and receives responses to the questionnaire; a diagnosis unit that diagnoses a skeletal type of the user based on the part characteristic information and the answers to the questionnaire; and an output unit that outputs the result of the diagnosis.

2. further comprising an imaging unit that images the user; The information processing apparatus according to claim 1 , wherein the first acquisition unit acquires the front image and the side image captured by the imaging unit.

3. a receiving unit that receives an input of an instruction to correct the part characteristic information; The information processing apparatus according to claim 1 , further comprising: a correction unit that corrects the part characteristic information in accordance with the received correction instruction.

4. The diagnostic unit a first scoring unit that performs scoring on the texture of the user's body using the part characteristic information and the answers to the questionnaire; a second scoring unit that scores the user's body line using the part characteristic information and the answers to the questionnaire; The information processing device according to claim 1 , further comprising: a determination unit that determines the skeletal type based on the results of each scoring.

5. The information processing device according to claim 4 , wherein the output unit outputs, as the results of the diagnosis, a scoring result regarding the user's body texture and a scoring result regarding the user's body line, along with the user's skeletal type.

6. a storage unit for storing advice information according to the characteristics of each of the main parts; The information processing device according to claim 1 , wherein the output unit outputs advice information according to characteristics of each of the user's main features together with the user's skeletal type.

7. The advice information includes first styling information representing a preferred styling and second styling information representing a less preferred styling, The information processing device according to claim 6 , wherein the output unit outputs the first styling information and the second styling information according to characteristics of each main feature of the user, along with the user's bone structure type.

8. The first styling information includes a styling image of another person that serves as a model of a preferred styling, The information processing device according to claim 7 , wherein the second styling information includes a styling image of another person that serves as an example of poor styling.

9. An information processing method for controlling a computer, comprising: a first acquisition step of acquiring a front image and a side image of a user; a second acquisition step of acquiring part characteristic information representing characteristics of each main part of the user based on the acquired front image and side image; a questionnaire implementation step of conducting a questionnaire regarding a skeletal diagnosis for the user and accepting responses to the questionnaire; a diagnosis step of diagnosing the user's skeletal type based on the part characteristic information and the answers to the questionnaire; and an output step of outputting the result of the diagnosis.

10. Computer, a first acquisition unit that acquires a front image and a side image of a user; a second acquisition unit that acquires part characteristic information representing characteristics of each main part of the user based on the acquired front image and side image; a questionnaire implementation unit that conducts a questionnaire regarding a skeletal diagnosis to the user and receives responses to the questionnaire; a diagnosis unit that diagnoses a skeletal type of the user based on the part characteristic information and the answers to the questionnaire; A program for causing the program to function as an output unit that outputs the results of the diagnosis.

Images