Information processing device and information processing system

Abstract

To provide a technique allowing recommendation of shoes suitable for a user.SOLUTION: An information processing apparatus comprises: a first acquisition unit; an estimation unit; a second acquisition unit; an evaluation unit; a selection unit; and an output unit. The first acquisition unit acquires image information on a user. The estimation unit estimates a skeleton of the user based on the image information acquired by the first acquisition unit. The second acquisition unit acquires shoe measurement information on a shoe to be estimated based on the image information acquired by the first acquisition unit. The evaluation unit calculates an evaluation point for the shoe to be evaluated based on skeleton information on the skeleton of the user estimated by the estimation unit and the shoe measurement information acquired by the second acquisition unit. The selection unit selects a shoe to be recommended based on the evaluation point calculated by the evaluation unit. The output unit outputs recommendation information on the shoe selected by the selection unit.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] An embodiment of the present invention relates to an information processing device and an information processing system. [Background technology]

[0002] In recent years, a service has been provided that recommends the most suitable shoes by comparing the measured foot shape data with shoe shape data. There is also a service that creates the most suitable insole for an individual based on the pressure distribution on the sole of the foot while standing. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-13822 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, it is difficult to evaluate the stability and ease of walking of shoes when actually worn using only foot shape data and shoe shape data. Also, while it is possible to evaluate sneaker-type shoes with flat soles with the same height between the toes and heels from pressure distribution, it is difficult to evaluate high-heeled shoes with high heels.

[0005] The problem to be solved by the embodiments of the present invention is to provide a technology that enables recommendations of suitable shoes for a user. [Means for solving the problem]

[0006] In one embodiment, the information processing device includes a first acquisition unit, an estimation unit, a second acquisition unit, an evaluation unit, a selection unit, and an output unit. The first acquisition unit acquires image information related to a user. The estimation unit estimates the user's bone structure based on the image information acquired by the first acquisition unit. The second acquisition unit acquires shoe measurement information related to the shoes to be evaluated based on the image information acquired by the first acquisition unit. The evaluation unit calculates an evaluation score for the shoes to be evaluated based on the bone structure information related to the user's bone structure estimated by the estimation unit and the shoe measurement information acquired by the second acquisition unit. The selection unit selects shoes to be recommended based on the evaluation score calculated by the evaluation unit. The output unit outputs recommendation information for the shoes selected by the selection unit. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram illustrating an information processing system according to the embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of measurement of shoe information according to the embodiment. [Diagram 3] FIG. 3 is a flowchart illustrating an information processing procedure by the server according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of estimation of skeleton information according to the embodiment. [Diagram 5] FIG. 5 is a diagram showing another example of estimating skeletal information according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating another example of estimating skeletal information according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, the embodiments will be described with reference to the drawings. In the drawings, the same components are denoted by the same reference numerals as much as possible, and duplicated explanations will be omitted. FIG. 1 is a block diagram illustrating an information processing system 100 according to the embodiment. The information processing system 100 includes a server 1, a sensor 2, and a terminal 3. The server 1, the sensor 2, and the terminal 3 are connected to each other via a network so as to be able to communicate with each other. For example, the network is the Internet. The sensor 2 and the terminal 3 are connected to each other via a network so as to be able to communicate with each other. For example, the network is a LAN (Local Area Network). The network may be a wireless network or a wired network. Note that the information processing system 100 may also refer to a system including at least two devices among the server 1, the sensor 2, and the terminal 3.

[0009] The server 1 is an electronic device that collects and processes data. The server 1 is connected to the sensor 2 and the terminal 3 via a network so as to be able to communicate freely. The sensor 2 and the terminal 3 are used, for example, in a commercial facility such as a store. The server 1 receives various data from the sensor 2 or the terminal 3, and outputs the data processing results to the terminal 3. The server 1 is an example of an information processing device. An example of the configuration of the server 1 will be described later.

[0010] The sensor 2 is attached, for example, to the ceiling or wall surface in the store, and outputs data acquired within the detection range. The sensor 2 outputs the acquired image data to the server 1 or the terminal 3. For example, the sensor 2 is an example of a sensor for detecting a skeleton from an image of a customer's entire body. The customer may be read as a user or a person. The sensor 2 may be a camera, an infrared sensor, a depth sensor, or another sensor. The sensor 2 may also be another type of sensor. The sensor 2 is an example of a sensing device.

[0011] The terminal 3 is an electronic device capable of communicating with other electronic devices. The terminal 3 is, for example, a device used by a store manager. For example, the terminal 3 is a smartphone, a tablet terminal, a PC, or the like. The manager may be replaced with a store clerk or a person. The terminal 3 is an example of an information processing terminal. An example of the configuration of the terminal 3 will be described later.

[0012] An example of the configuration of the server 1 will be described. The server 1 is an electronic device including a processor 11, a main memory 12, an auxiliary storage device 13, and a communication interface 14. Each component of the server 1 is connected to each other so as to be able to input and output signals. In Fig. 1, the interface is written as "I / F".

[0013] The processor 11 corresponds to the central part of the server 1. For example, the processor 11 is a CPU (Central Processing Unit), but is not limited to this. The processor 11 may be composed of various circuits. The processor 11 loads a program stored in advance in the main memory 12 or the auxiliary storage device 13 into the main memory 12. The program is a program that causes the processor 11 of the server 1 to realize or execute each unit described below. The processor 11 executes the program loaded into the main memory 12 to perform various operations.

[0014] The main memory 12 corresponds to the main storage portion of the server 1. The main memory 12 includes a nonvolatile memory area and a volatile memory area. The main memory 12 stores an operating system or programs in the nonvolatile memory area. The main memory 12 uses the volatile memory area as a work area where data is appropriately rewritten by the processor 11. For example, the main memory 12 includes a ROM (Read Only Memory) as a nonvolatile memory area. For example, the main memory 12 includes a RAM (Random Access Memory) as a volatile memory area. The main memory 12 stores programs.

[0015] The auxiliary storage device 13 corresponds to the auxiliary storage portion of the server 1. The auxiliary storage device 13 is an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), an SSD (Solid State Drive), or the like. The auxiliary storage device 13 stores the above-mentioned programs, data used by the processor 11 in performing various processes, and data generated by the processes in the processor 11. The auxiliary storage device 13 stores the above-mentioned programs.

[0016] The auxiliary storage device 13 stores a user information database (DB) 131 and a shoe information DB 132. The user information DB131 includes records constituting data associating user identification information with user data. Each record included in the user information DB131 corresponds to user information. The user identification information is unique identification information assigned to each user to identify the user individually. The user data includes the user's name, the user's skeletal information, shoe size, history of shoes purchased by the user, and the like. The user's name does not need to be a real name, and may be a nickname, user name, or the like of the user as long as the user can be identified. The user's skeletal information is information indicating the user's skeletal structure estimated by the estimation unit 112 described later. The user's skeletal information is information that can reflect the stability of the user's posture when wearing shoes.

[0017] The shoe information DB132 includes records constituting data associating shoe identification information with shoe measurement information. Each record included in the shoe information DB132 corresponds to shoe information. The shoe identification information is unique identification information assigned to each shoe to identify each shoe. The shoe identification information includes, for example, a shoe product number. The shoe identification information allows the type, color, and size (foot length, foot width, etc.) of each shoe to be specified. The shoe measurement information includes an angle (hereinafter referred to as angle θ1) between a line connecting the midpoint of the width of the heel of the shoe on the ground and the midpoint of the width of the outer dimension of the shoe when projected onto a vertical plane and a vertical axis. The shoe measurement information includes parameters that specify the shape of the shoe, such as the angle θ1. The parameters are parameters that can affect the stability of the posture when the user wears the shoe. The heel of the shoe on the ground is the heel part of the sole of the shoe, which is the surface that comes into contact with the floor. The outer dimension of the shoe is the length in the width direction of the outline of the shoe. Details of the shoe measurement information will be described later.

[0018] The communication interface 14 includes various interfaces that communicably connect the server 1 to other electronic devices via a network in accordance with a predetermined communication protocol.

[0019] The hardware configuration of the server 1 is not limited to the above-mentioned configuration. The server 1 allows the above-mentioned components to be omitted or changed and new components to be added as appropriate.

[0020] Each unit implemented in the above-mentioned processor 11 will be described. The processor 11 implements a first acquisition unit 110, a second acquisition unit 111, an estimation unit 112, an evaluation unit 113, a selection unit 114, and an output unit 115. Each unit implemented in the processor 11 can also be referred to as each function. Each unit implemented in the processor 11 can also be referred to as being implemented in a control unit including the processor 11 and the main memory 12. In the following description, "in response" may be read as "based on."

[0021] The first acquisition unit 110 acquires image information on the user acquired by the sensor 2 from the sensor 2 or the terminal 3 via the communication interface 14. For example, the first acquisition unit 110 acquires image information of the user in a state where the user is not wearing shoes. The first acquisition unit 110 acquires image information of at least the back of the user. The image information of the user includes image information of the entire body of the user. The image information of the user includes image information of at least the lower part of the knees of the user. The image information of the user may include image information that allows the center of gravity of the user to be measured. The first acquisition unit 110 acquires image information of shoes to be evaluated by the user. The shoes to be evaluated by the user are shoes that are to be evaluated by the evaluation unit 113, such as shoes worn by the user or shoes selected by the user. The first acquisition unit 110 acquires image information of the user in a state where the user is not wearing shoes and image information of the shoes to be evaluated separately. The image information on the user includes image information of the user and image information of the shoes to be evaluated.

[0022] The second acquisition unit 111 acquires shoe measurement information regarding the shoes to be evaluated. Here, "acquire" includes the meanings of measurement, analysis, and calculation.

[0023] The estimation unit 112 estimates the skeleton of the user based on the image information acquired by the first acquisition unit 110.

[0024] The evaluation unit 113 calculates an evaluation score for the shoes to be evaluated based on the skeletal information of the user estimated by the estimation unit 112 and the shoe measurement information acquired by the second acquisition unit 111. The evaluation score is a value that quantifies the degree of fit between the user's skeletal structure and the shoes. The degree of fit is, for example, the degree to which the posture is stable when the user wears the shoes. The evaluation unit 113 acquires shoe measurement information for the multiple shoes from the shoe information DB 132. The evaluation unit 113 calculates evaluation scores for the multiple shoes based on the skeletal information of the user estimated by the estimation unit 112 and the shoe measurement information for the multiple shoes.

[0025] The selection unit 114 selects shoes to be recommended based on the evaluation points calculated by the evaluation unit 113. The recommended shoes are, for example, shoes with a higher evaluation point than the evaluation point of the shoes to be evaluated.

[0026] The output unit 115 outputs recommendation information of the shoes selected by the selection unit 114 to the terminal 3 via the communication interface 14. The recommendation information is information that can identify the recommended shoes. The information that can identify the shoes corresponds to the shoe identification information included in the shoe information. In the following description, "output" may be read as "send."

[0027] Note that the first acquisition unit 110, the second acquisition unit 111, the estimation unit 112, the evaluation unit 113, the selection unit 114, and the output unit 115 have been described as being implemented in the processor 11 by executing a program, but are not limited to this.

[0028] An example of the configuration of the terminal 3 will be described. The terminal 3 is an electronic device including a processor 31, a main memory 32, an auxiliary storage device 33, a communication interface 34, an input device 35, a display device 36, and a reading device 37. Each part constituting the terminal 3 is connected to each other so as to be able to input and output signals.

[0029] The processor 31 corresponds to the central part of the terminal 3. The processor 31 has the same hardware configuration as the above-mentioned processor 11. The processor 31 executes various operations by executing programs stored in advance in the main memory 32 or the auxiliary storage device 33. The processor 31 implements a display control unit 310. The display control unit implemented in the processor 31 can also be said to be a display control function. The display control unit implemented in the processor 31 can also be said to be implemented in a control unit including the processor 31 and the main memory 32.

[0030] The display control unit 310 displays various data on the display device 36. For example, the display control unit 310 displays the recommendation information output by the output unit 115 of the server 1 on the display device 36.

[0031] The main memory 32 corresponds to a main storage portion of the terminal 3. The main memory 32 has the same hardware configuration as the above-mentioned main memory 12. The main memory 32 stores programs.

[0032] The auxiliary storage device 33 corresponds to the auxiliary storage portion of the terminal 3. The auxiliary storage device 33 has the same hardware configuration as the above-mentioned auxiliary storage device 13. The auxiliary storage device 33 stores the above-mentioned programs.

[0033] The communication interface 34 includes various interfaces that connect the terminal 3 to other devices so that they can communicate with each other via a network in accordance with a predetermined communication protocol.

[0034] The input device 35 is a device capable of inputting data or instructions to the terminal 3. For example, the input device 35 is a keyboard or a touch panel, etc. The input device 35 may include a microphone that enables voice input.

[0035] The display device 36 is a device capable of displaying various screens under the control of the processor 31. For example, the display device 36 is a liquid crystal display or an EL (Electroluminescence) display.

[0036] The reading device 37 is a device capable of reading various data. For example, the reading device 37 includes a scanner capable of reading data from a code symbol. The code symbol is a two-dimensional code symbol such as a barcode symbol and a QR code (registered trademark). The reading device 37 includes an imaging device such as a camera capable of reading data from a code symbol. The camera may be a type that reads a code symbol by scanning with a laser beam, or a type that reads a code symbol from an image captured by an imaging device.

[0037] The hardware configuration of the terminal 3 is not limited to the above-mentioned configuration. The terminal 3 allows the above-mentioned components to be omitted or changed and new components to be added as appropriate.

[0038] The shoe measurement information will now be described. FIG. 2 is a diagram illustrating an example of measurement of shoe information according to the embodiment.

[0039] In Fig. 2, the upper left figure is a plan view of the shoe, with line A-A' indicating the cutting position. The upper right figure is a cross-sectional view taken along line A-A'. Point B indicates the midpoint of the outer width of the shoe, and point C indicates the midpoint of the width at the heel's ground contact surface. The lower left figure is a side view of the shoe. The lower right figure is a rear view of the shoe, with point C indicating the midpoint of the width at the heel's ground contact surface.

[0040] The shoe measurement information includes an angle θ1 between a line connecting the midpoint of the width of the shoe's heel contact surface (point C in FIG. 2) and the midpoint of the outer width of the shoe (point B in FIG. 2) and a vertical axis when the line is projected onto a vertical plane. The shoe measurement information is information including parameters that specify the shoe as shown in FIG. 2.

[0041] The process performed by the information processing system 100 will now be described. In the following description mainly focusing on the server 1, the server 1 may be read as the processor 11. Similarly, in the following description mainly focusing on the terminal 3, the terminal 3 may be read as the processor 31. Note that the processing procedure described below is merely an example, and each process may be changed as much as possible. Also, in the processing procedure described below, steps may be omitted, replaced, or added as appropriate depending on the embodiment.

[0042] Here, it is assumed that a user X tries on shoes at a store A. The user X is also called a customer X. In this example, the user X is a member of a service provided by a server 1 that is affiliated with the store A, and is identified by user identification information. The sensor 2 and the terminal 3 are assumed to be installed in the store A.

[0043] In response to the image information of the user X being acquired by the sensor 2, the server 1 performs the following information processing.

[0044] The procedure of information processing by the server 1 will be described. FIG. 3 is a flowchart illustrating an information processing procedure by the server 1 according to the embodiment. The first acquisition unit 110 acquires image information on the user from the sensor 2 or the terminal 3 via the communication interface 14 (ACT1). In ACT1, for example, the first acquisition unit 110 acquires image information of the user not wearing shoes. The first acquisition unit 110 acquires image information of the user in a stationary state. The first acquisition unit 110 may acquire image information of the user walking in addition to image information of the user in a stationary state. The first acquisition unit 110 acquires image information of the shoes to be evaluated. The first acquisition unit 110 acquires an image of the user not wearing shoes and an image of the shoes separately. Note that the first acquisition unit 110 may acquire image information of the user wearing the shoes to be evaluated. The first acquisition unit 110 may acquire image information of the user in a stationary state wearing the shoes to be evaluated. The first acquisition unit 110 may acquire image information of the user walking wearing the shoes to be evaluated.

[0045] The estimation unit 112 estimates the skeleton of the user based on the image information acquired by the first acquisition unit 110 (ACT2). In ACT2, for example, the estimation unit 112 estimates the skeleton of the user based on image information of the user not wearing shoes. The estimation unit 112 estimates at least the skeleton below the knee of the user. The estimation unit 112 may perform skeleton estimation using the position of the center of gravity of the user. The estimation unit 112 may estimate the skeleton of the user using a known skeleton estimation method. Note that, when the first acquisition unit 110 acquires an image of the user wearing the shoes to be evaluated, the estimation unit 112 may estimate the skeleton of the user wearing the shoes. The estimation unit 112 may estimate the skeleton of the user when stationary. The estimation unit 112 may estimate the skeleton of the user when walking.

[0046] The second acquisition unit 111 acquires shoe measurement information regarding the shoes to be evaluated based on the image information acquired by the first acquisition unit 110 (ACT3). In ACT3, for example, the second acquisition unit 111 acquires image information of the shoes to be evaluated. The second acquisition unit 111 calculates the shoe measurement information from the image information of the shoes to be evaluated. The second acquisition unit 111 may calculate the shoe measurement information from image information of a user wearing the shoes to be evaluated. The second acquisition unit 111 may acquire the shoe measurement information of the shoes to be evaluated from the shoe information DB 132. The second acquisition unit 111 stores the shoe measurement information in the shoe information DB 132 every time the second acquisition unit 111 calculates the shoe measurement information. The shoe information DB 132 is updated every time the second acquisition unit 111 calculates the shoe measurement information.

[0047] The evaluation unit 113 calculates an evaluation score using different methods depending on the accuracy of the skeleton estimation estimated by the estimation unit 112. The evaluation unit 113 judges whether the accuracy of the skeleton estimation estimated by the estimation unit 112 is equal to or greater than a threshold (ACT4). When the evaluation unit 113 judges that the accuracy of the skeleton estimation is equal to or greater than the threshold (ACT4: YES), the process transitions from ACT4 to ACT5. When the evaluation unit 113 judges that the accuracy of the skeleton estimation is not equal to or greater than the threshold (ACT4: NO), the process transitions from ACT4 to ACT6. The evaluation unit 113's judgment that the accuracy of the skeleton estimation is not equal to or greater than the threshold corresponds to the evaluation unit 113's judgment that the accuracy of the skeleton estimation is less than the threshold.

[0048] When the evaluation unit 113 determines that the accuracy of the skeleton estimation is equal to or higher than the threshold, the evaluation unit 113 estimates an angle θ2 based on the skeleton estimation result below the knee and the shoe measurement information of the shoe to be evaluated (ACT5). In ACT5, for example, the evaluation unit 113 estimates an angle θ2 between a skeleton line from the knee point to the ankle point when at rest and a line connecting the ankle point to the midpoint of the width of the shoe at the heel contact surface. The knee point corresponds to the midpoint of the knee width. The knee point is also simply called the "knee". The ankle point corresponds to the midpoint of the ankle width. The ankle point is also simply called the "ankle". When at rest, it corresponds to the point when the sole of the shoe is in contact with the floor surface. The floor surface corresponds to the horizontal plane. The skeleton line is an example of skeleton information. The skeleton line from the knee point to the ankle point corresponds to the skeleton information from the knee to the ankle. A line connecting the ankle point to the midpoint of the width of the heel on the ground corresponds to skeletal information from the ankle to the heel. Skeletal information from the ankle to the heel may be read as skeletal information from the ankle to the sole. The estimation of the angle θ2 by the evaluation unit 113 may be performed by a known simulation technique. Hereinafter, the evaluation using the angle θ2 is also referred to as the evaluation by the first method.

[0049] The angle θ2 will be described below with reference to FIG. FIG. 4 is a diagram illustrating an example of skeletal information estimation according to the embodiment. In FIG. 4, the thick solid line indicates the skeletal line from the knee point to the ankle point estimated by the estimation unit 112. Point AK indicates the ankle point. The dashed line indicates a line connecting the ankle point to the midpoint of the width of the heel of the shoe on the ground. Point HPa indicates the midpoint of the width of the heel of the shoe on the ground. Point HPa is also called the midpoint of the heel of the shoe. The evaluation unit 113 combines the skeletal line from the knee point to the ankle point (point AK) estimated by the estimation unit 112 with the shoe measurement information of the shoe to be evaluated, and estimates a line connecting the ankle point (point AK) to the midpoint of the heel of the shoe (point HPa). The evaluation unit 113 estimates the angle θ2 between the skeletal line from the knee point to the ankle point (point AK) and the line connecting the ankle point (point AK) to the midpoint of the heel of the shoe (point HPa).

[0050] If the evaluation unit 113 determines that the accuracy of the skeleton estimation is not equal to or greater than the threshold, the evaluation unit 113 estimates the angle θ3 based on the skeleton estimation results by the estimation unit 112 when stationary and when walking and the shoe measurement information of the shoe to be evaluated (ACT6). In ACT6, for example, the evaluation unit 113 estimates a line connecting the ankle point to the midpoint of the width of the heel of the shoe when stationary. Next, the evaluation unit 113 estimates a line connecting the ankle point to the midpoint of the width of the heel of the shoe when walking. When walking, this corresponds to the time when the sole of the shoe is lifted off the floor. The time when the sole of the shoe is lifted off the floor corresponds to the time when the heel of the shoe is lifted off the floor. The evaluation unit 113 estimates the angle θ3 between the line connecting the ankle point to the midpoint of the width of the heel of the shoe when stationary and the line connecting the ankle point to the midpoint of the width of the heel of the shoe when walking. The estimation of the angle θ3 by the evaluation unit 113 may be performed by a known simulation technique. Hereinafter, the evaluation using the angle θ3 will also be referred to as evaluation by the second method.

[0051] The angle θ3 will be described below with reference to FIGS. 5 and 6 are diagrams showing another example of estimating skeletal information according to the embodiment. Fig. 5 is a diagram showing an example of estimating skeletal information when stationary, and Fig. 6 is a diagram showing an example of estimating skeletal information when walking.

[0052] In Fig. 5, the dashed line indicates a line connecting the ankle point at rest to the midpoint of the width of the heel of the shoe on the ground. Point AK indicates the ankle point. Point HPb indicates the midpoint of the width of the heel of the shoe on the ground. Point HPb is also called the midpoint of the heel of the shoe. The evaluation unit 113 estimates a line connecting the ankle point (point AK) at rest to the midpoint of the width of the heel of the shoe on the ground (point FPb) based on the skeleton estimation result by the estimation unit 112 at rest and the shoe measurement information of the shoe to be evaluated.

[0053] In FIG. 6, the dashed line indicates a line connecting the ankle point to the midpoint of the width of the shoe at the heel's contact surface when walking. Point AK indicates the ankle point. Point HPc indicates the midpoint of the width of the shoe at the heel's contact surface. Point HPc is also called the midpoint of the heel of the shoe. The thick solid line indicates a line connecting the ankle point to the midpoint of the width of the shoe at the heel's contact surface when stationary. The thick solid line indicates the same line as the dashed line in FIG. 5. The evaluation unit 113 estimates a line connecting the ankle point (point AK) to the midpoint of the width of the shoe at the heel's contact surface when walking (point FPc) based on the skeleton estimation result by the estimation unit 112 when walking and the shoe measurement information of the shoe to be evaluated. The estimation unit 112 estimates the angle θ3 between a line connecting the ankle point (point AK) to the midpoint of the heel of the shoe when stationary and a line connecting the ankle point (point AK) to the midpoint of the heel of the shoe when walking (point FPc).

[0054] The evaluation unit 113 calculates an evaluation score for the shoes to be evaluated based on the skeletal information of the user estimated by the estimation unit 112 and the shoe measurement information acquired by the second acquisition unit 111 (ACT7). A case where the evaluation by the first method is used will be described. In ACT7, for example, the evaluation unit 113 calculates an evaluation score based on skeletal information from the knee to the ankle and skeletal information from the ankle to the heel at the time when the sole of the shoe is in contact with the floor surface. The evaluation unit 113 calculates an evaluation score using the angle θ2 estimated based on the skeletal information of the user and the shoe measurement information. The evaluation score of the evaluation by the first method is an index representing the degree of stability of the posture when the user wears the shoes to be evaluated. Therefore, the evaluation score of the evaluation by the first method is highest when the angle θ2 is 180 degrees, and decreases as the angle θ2 deviates from 180 degrees. The evaluation score of the evaluation by the first method may be the angle θ2 itself, or may be calculated by a calculation formula using the angle θ2 as a variable. The calculation formula is such that the evaluation score is highest when the angle θ2 is 180 degrees, and the evaluation score decreases as the angle θ2 deviates from 180 degrees.

[0055] A case where the evaluation by the second method is used will be described. The evaluation unit 113 calculates an evaluation score based on skeletal information from the ankle to the heel when the sole is in contact with the floor surface and skeletal information from the ankle to the heel when the sole is released from the floor. The evaluation unit 113 calculates an evaluation score using an angle θ3 estimated based on the user's skeletal information and shoe measurement information. The evaluation score of the evaluation by the second method is an index that indicates the degree of stability of the posture when the user wears the shoes to be evaluated. Therefore, the evaluation score of the evaluation by the second method is highest when the angle θ3 is 0 degrees, and decreases as the angle θ3 moves away from 0 degrees. The evaluation score of the evaluation by the second method may be the angle θ3 itself, or may be calculated by a calculation formula that uses the angle θ3 as a variable. The calculation formula is a formula that gives the highest evaluation score when the angle θ3 is 0 degrees, and decreases as the angle θ3 moves away from 0 degrees.

[0056] Every time the evaluation unit 113 calculates an evaluation point, the evaluation unit 113 stores the evaluation point in the user information DB 131. The user information DB 131 is updated every time the evaluation unit 113 calculates an evaluation point.

[0057] The evaluation unit 113 acquires shoe measurement information for a plurality of shoes from the shoe information DB 132 (ACT8). In ACT8, for example, shoe measurement information for a plurality of shoes other than the shoe to be evaluated is acquired from the shoe information DB 132. The shoe measurement information for the plurality of shoes is information including parameters that specify the shape of each shoe, such as the angle θ1, for the plurality of shoes.

[0058] The evaluation unit 113 calculates evaluation points for the plurality of shoes based on the skeletal information and the shoe measurement information for the plurality of shoes (ACT9). In ACT9, for example, the evaluation unit 113 calculates evaluation points for each of the plurality of shoes based on the skeletal information of the user estimated by the estimation unit 112 and the shoe measurement information for the plurality of shoes. When using the evaluation by the first method, the evaluation unit 113 estimates an angle θ2 for each of the plurality of shoes based on the skeletal estimation result below the knee and the shoe measurement information for the plurality of shoes. The estimation method of the angle θ2 is the same as in ACT5. The evaluation unit 113 calculates evaluation points for each of the plurality of shoes using the angle θ2. When using the evaluation by the second method, the evaluation unit 113 estimates an angle θ3 for each of the plurality of shoes based on the skeletal estimation result by the estimation unit 112 when stationary and when walking and the shoe measurement information for the plurality of shoes. The estimation method of the angle θ3 is the same as in ACT6. The evaluation unit 113 calculates evaluation points for each of the plurality of shoes using the angle θ3. Every time the evaluation unit 113 calculates an evaluation score for each of the plurality of shoes, the evaluation unit 113 may store the evaluation score in the user information DB 131. The user information DB 131 may be updated every time the evaluation unit 113 calculates an evaluation score for each of the plurality of shoes.

[0059] The selection unit 114 selects a shoe to be recommended based on the evaluation score of the shoe to be evaluated calculated by the evaluation unit 113 and the evaluation scores of the multiple shoes (ACT10). In ACT10, for example, the selection unit 114 compares the evaluation score of the shoe to be evaluated calculated by the evaluation unit 113 with the evaluation score of each of the multiple shoes. Based on the comparison result, the selection unit 114 selects a shoe having an evaluation score higher than the evaluation score of the shoe to be evaluated as a recommended shoe. In one example, when the selection unit 114 uses evaluation by the first method, the selection unit 114 selects a shoe having an angle θ2 within a predetermined threshold centered on 180 degrees as a shoe having a high evaluation score. For example, within the threshold is 180 degrees ±α degrees. In another example, when the selection unit 114 uses evaluation by the second method, the selection unit 114 selects a shoe having an angle θ3 within a predetermined threshold as a shoe having a high evaluation score. For example, within the threshold is ±β degrees. The selection unit 114 selects at least one recommended shoe. The selection unit 114 may select the evaluated shoes as recommended shoes when the evaluation score of the evaluated shoes is higher than the evaluation scores of a plurality of other shoes.

[0060] The output unit 115 outputs recommendation information of the shoes selected by the selection unit 114 to the terminal 3 via the communication interface 14 (ACT11). In ACT11, for example, the output unit 115 acquires identification information of the recommended shoes from the shoe information DB 132. The output unit 115 outputs the identification information of the recommended shoes as recommendation information to the terminal 3. The terminal 3 receives the recommendation information via the communication interface 34. The display control unit 310 displays the recommendation information on the display device 36.

[0061] The processes in ACT5 and ACT6 may be selectively executed regardless of the accuracy of the skeleton estimation.

[0062] According to this embodiment, the server 1 can calculate the evaluation score of the shoe based on the user's skeletal information and shoe measurement information. Since the user's skeletal information and shoe measurement information are information that affect the user's posture, the server 1 can improve the calculation accuracy of the evaluation score based on the stability of the user's posture. Therefore, the server 1 can select shoes that stabilize the user's posture as recommended shoes. In addition, the evaluation unit 113 can calculate the evaluation score based on the skeletal information from the knee to the ankle and the skeletal information from the ankle to the heel when the sole of the shoe is in contact with the floor surface. For example, the evaluation unit 113 can calculate the evaluation score using the angle θ2. The evaluation unit 113 can calculate the evaluation score based on the skeletal information from the ankle to the heel when the sole of the shoe is in contact with the floor surface and the skeletal information from the ankle to the heel when the sole of the shoe is released from the floor. For example, the evaluation unit 113 can calculate the evaluation score using the angle θ3. Therefore, the server 1 can calculate the evaluation score based on the stability of the user's posture and select recommended shoes. Furthermore, even if the accuracy of the user's skeletal information estimated by the estimation unit 112 is not high, the server 1 can calculate the evaluation points of the shoes and select recommended shoes. Furthermore, the server 1 can apply the calculation process of the evaluation points for the shoe to be evaluated to a plurality of other shoes. This can reduce the amount of processing involved in the calculation of the evaluation points. The user can find the most suitable shoes by obtaining the evaluation points for all the shoes without actually wearing them.

[0063] The information processing device may be realized by one device as described above using the server 1 as an example, or may be realized by a system in which functions are distributed among a plurality of devices.

[0064] The program may be transferred in a state where it is stored in an electronic device, or in a state where it is not stored in an electronic device. In the latter case, the program may be transferred via a network, or in a state where it is recorded on a recording medium. The recording medium is a non-transitory tangible medium. The recording medium is an electronic device-readable medium. The recording medium may be in any form, such as a CD-ROM or a memory card, as long as it is capable of storing the program and is readable by an electronic device.

[0065] Although several other embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0066] 1...server, 2...sensor, 3...terminal, 11...processor, 12...main memory, 13...auxiliary storage device, 14...communication interface, 31...processor, 32...main memory, 33...auxiliary storage device, 34...communication interface, 35...input device, 36...display device, 37...reading device, 100...information processing system, 110...first acquisition unit, 111...second acquisition unit, 112...estimation unit, 113...evaluation unit, 114...selection unit, 115...output unit, 310...display control unit, 131...user information database, 132...shoe information database.

Claims

1. A first acquisition unit that acquires image information related to a user; an estimation unit that estimates a skeleton of a user based on the image information acquired by the first acquisition unit; a second acquisition unit that acquires shoe measurement information regarding the shoe to be evaluated based on the image information acquired by the first acquisition unit; an evaluation unit that calculates an evaluation score of the shoe to be evaluated based on skeletal information regarding the user's skeletal structure estimated by the estimation unit and the shoe measurement information acquired by the second acquisition unit; A selection unit that selects shoes to be recommended based on the evaluation points calculated by the evaluation unit; an output unit that outputs recommendation information about the shoes selected by the selection unit; Equipped with the evaluation unit calculates an evaluation score based on skeletal information from the ankle to the heel when the sole of the shoe is in contact with a floor surface and skeletal information from the ankle to the heel when the sole of the shoe is released from the floor. Information processing device.

2. the evaluation unit calculates an evaluation score based on skeletal information from the knee to the ankle and skeletal information from the ankle to the heel at the time when the sole of the shoe is in contact with a floor surface. The information processing device according to claim 1 .

3. The evaluation unit calculates evaluation scores of the plurality of shoes based on skeletal information and shoe measurement information regarding the plurality of shoes; The selection unit selects a shoe to be recommended based on the evaluation score of the evaluation target shoe calculated by the evaluation unit and the evaluation scores of the plurality of shoes.

3. The information processing device according to claim 1 or 2.

4. A sensing device that acquires image information about a user; An information processing device; An information processing system including an information processing terminal, The information processing device includes: A first acquisition unit that acquires image information related to a user acquired by the sensing device; an estimation unit that estimates a skeleton of a user based on the image information acquired by the first acquisition unit; a second acquisition unit that acquires shoe measurement information regarding the shoe to be evaluated based on the image information acquired by the first acquisition unit; an evaluation unit that calculates an evaluation score of the shoe to be evaluated based on skeletal information regarding the user's skeletal structure estimated by the estimation unit and the shoe measurement information acquired by the second acquisition unit; A selection unit that selects shoes to be recommended based on the evaluation points calculated by the evaluation unit; an output unit that outputs recommendation information about the shoes selected by the selection unit; Equipped with the evaluation unit calculates an evaluation score based on skeletal information from the ankle to the heel when the sole is in contact with a floor surface and skeletal information from the ankle to the heel when the sole is released from the floor; The information processing terminal includes: a display control unit that displays the recommendation information output by the output unit of the information processing device; Information processing system.

Images