Foot shape model presentation device, foot shape model presentation method, and program

Abstract

A foot shape model presentation device 60 includes an acquisition unit 64, a reference storage unit 68, an extraction unit 66, a generating unit 70, and a presentation unit 72. The acquisition unit 64 acquires a foot shape image of a user 10. The reference storage unit 68 stores a reference model that is a three-dimensional model obtained by averaging foot shapes. The extraction unit 66 extracts, from the image, shape information indicating features of a predetermined portion of the foot shape of the user 10. The generating unit 70 generates an individual shape model that is a three-dimensional model reproducing the foot shape of the user 10 by modifying a shape of a portion corresponding to the predetermined portion in the reference model, on the basis of the shape information. The presentation unit 72 visualizes the individual shape model, and performs presentation thereof to the user 10.

Description

Foot shape model presentation device, foot shape model presentation method and program

[0001] The present disclosure relates to a foot shape model presentation device, a foot shape model presentation method, and a program.

[0002] A technology is known that can easily measure a user's foot size based on an image of the user's foot (see, for example, Patent Document 1). The technology described in Patent Document 1 allows a user to easily measure their own foot size, which can be used to select footwear of a suitable size for the user's foot. Patent Document 1 also describes that a three-dimensional model (foot shape model) of the user's foot can be generated and the generated foot shape model can be displayed.

[0003] International Publication No. 2020 / 059716

[0004] In the technology described in Patent Document 1, contour data of the entire user's foot is combined with pre-stored footprint model data to generate a footprint model of the user. Although the footprint model generated in this way reflects the contour of the entire user's foot, it is difficult to say that it reflects the characteristics of the user's foot, and it tends to give an impersonal impression.

[0005] The present disclosure has been made in light of these circumstances, and its purpose is to provide a technology that can present a foot shape model that better reflects the characteristics of a user's foot.

[0006] A foot shape model presentation device according to one aspect of the present disclosure includes an acquisition unit that acquires an image of a user's foot shape, a reference storage unit that stores a reference model that is a three-dimensional model obtained by averaging the foot shape, an extraction unit that extracts shape information indicating characteristics of a specific part of the user's foot shape from the image, a generation unit that generates an individual shape model that is a three-dimensional model that reproduces the user's foot shape by transforming the shape of a part of the reference model that corresponds to the specific part based on the shape information, and a presentation unit that visualizes the individual shape model and presents it to the user.

[0007] Another aspect of the present disclosure is a foot shape model presentation method, which includes the steps of acquiring an image of a user's foot shape, extracting shape information indicating characteristics of predetermined parts of the user's foot shape from the image, generating an individual shape model, which is a three-dimensional model that reproduces the user's foot shape, by transforming the shape of a part corresponding to the predetermined part in a reference model, which is a three-dimensional model obtained by averaging foot shapes, based on the shape information, and visualizing the individual shape model and presenting it to the user.

[0008] Another aspect of the present disclosure is a program that causes a computer to perform the following functions: acquire an image of a user's foot shape; extract shape information indicating characteristics of a predetermined part of the user's foot shape from the image; generate an individual shape model, which is a three-dimensional model that reproduces the user's foot shape, by transforming the shape of a part corresponding to the predetermined part in a reference model, which is a three-dimensional model obtained by averaging foot shapes, based on the shape information; and visualize the individual shape model and present it to the user.

[0009] In addition, any combination of the above components, or mutual substitution of the components or expressions of the present disclosure between methods, devices, programs, temporary or non-temporary storage media storing programs, systems, etc., are also valid aspects of the present disclosure.

[0010] According to an aspect of the present disclosure, a technology can be provided that can present a foot shape model that better reflects the characteristics of a user's foot.

[0011] Fig. 3 is a schematic diagram showing an overview of a foot shape model presentation system. Fig. 4 is a functional block diagram showing a schematic configuration of the foot shape model presentation system shown in Fig. 1. Fig. 5 is a functional block diagram showing a schematic configuration of an extraction unit shown in Fig. 2. Fig. 6 is a diagram showing a schematic view of a part of a foot image including a toe region. Fig. 7 is a diagram showing an example of a reference model. Fig. 8 is a diagram showing an example of an individual shape model. Fig. 9 is a block diagram showing an example configuration of the foot shape model presentation system shown in Fig. 1. Fig. 10 is a functional block diagram showing a schematic configuration of a foot shape model presentation device according to a modified example.

[0012] The present disclosure will be described below based on preferred embodiments with reference to the accompanying drawings. In the embodiments and modifications, the same or equivalent components are designated by the same reference numerals, and redundant description will be omitted as appropriate.

[0013] 1 is a schematic diagram showing an overview of a foot shape model presentation system 100. The foot shape model presentation system 100 includes an information terminal 20 and a foot shape model presentation device 60. The information terminal 20 is, for example, a mobile phone terminal, and takes a picture of the feet of a user 10 with a built-in camera. The user 10 may operate the information terminal 20 to take a picture of his or her own feet, or someone other than the user 10, for example, a salesperson at a shoe store, may operate the information terminal 20 to take a picture of the user 10's feet. Alternatively, the information terminal 20 may be configured to automatically take a picture of the user 10's feet.

[0014] The information terminal 20 may capture an image of the user 10's feet so that a predetermined reference object is reflected in the image. Here, the "reference object" is a comparison object for measuring the user 10's foot length and foot width based on the image, and is a flat or three-dimensional object with a predetermined size and shape. This "reference object" may be a general-purpose object or a dedicated object as long as its size and shape are defined. A general-purpose object can be paper of a specified size, such as A4 size (210 mm x 297 mm) or letter size. White paper is preferred, but other colors are also acceptable. In this case, the user 10 may place their feet on the A4 paper and photograph their feet using the information terminal 20. A dedicated object can be the measurement mat 12 shown in FIG. 1. In this case, the user 10 may place their feet on the measurement mat 12 and photograph their feet using the information terminal 20. Whether a general-purpose object or a dedicated object is used as the reference object, someone other than the user 10 may photograph the user 10's feet using the information terminal 16. The information terminal 16 may capture an image of the feet of the user 10 without using a reference object.

[0015] The information terminal 20 may acquire multiple images by photographing the user's 10's feet from multiple angles. This allows for an image to be obtained that captures the contours of the toes and heels, and the contours of both the left and right sides of the forefoot and midfoot, making it possible to include information on foot length and foot width in the image. The information terminal 20 may acquire at least one image of the user's 10's feet photographed from above, with a part of the user's 10's foot, such as the heel, aligned with a predetermined position on a reference object. This allows the position of a part of the user's 10's foot, such as the heel, to be identified in the image even if the part of the user's 10's foot is not directly visible in the image, making it possible to include information on foot length and foot width in the image.

[0016] As described above, the information terminal 20 captures an image of the user's 10's foot shape (hereinafter referred to as a "foot image"). The foot image does not have to include the user's 10's entire foot, but includes at least a predetermined part such as the toes. The foot image may be a plurality of images or a single image. The foot image may also be a moving image based on a plurality of images captured in chronological order. The information terminal 20 transmits the foot image to the foot shape model presentation device 60.

[0017] The foot shape model presentation device 60 is, for example, a server computer connected to a plurality of information terminals 20 via a network line such as the Internet or a LAN (Local Area Network) or a communication means such as wireless communication. When the foot shape model presentation device 60 is a server computer, the foot shape model presentation device 60 may be configured as a single server computer or a combination of a plurality of server computers.

[0018] The information terminal 20 and the foot shape model presentation device 60 may each be configured as a mobile terminal or computer including a CPU (Central Processing Unit), GPU (Graphics Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), auxiliary storage device, display device, communication device, etc., and a program stored in the mobile terminal or computer. For example, they may be configured so that a program executed on the foot shape model presentation device 60 is accessed from the information terminal 20 via communication means. However, the functions of the foot shape model presentation system 100 may be realized by a standalone device having the functions of the information terminal 20 and the foot shape model presentation device 60, and this standalone device may be configured to execute a foot shape model presentation program. The standalone device may be a personal computer, a mobile terminal such as a smartphone, or a tablet terminal capable of executing a foot shape model presentation program. Alternatively, the standalone device may be a terminal installed in a shoe store capable of executing a foot shape model presentation program.

[0019] The "foot shape model presentation device" in the claims may refer to the entire foot shape model presentation system 100, or may refer to the foot shape model presentation device 60. In this embodiment, since the foot shape model presentation device 60 is equipped with many of the characteristic functions included in the "foot shape model presentation device" in the claims, the foot shape model presentation device 60 essentially corresponds to the "foot shape model presentation device."

[0020] Figure 2 is a functional block diagram showing the general configuration of the foot shape model presentation system 100. Each functional block shown in each figure, including Figure 2, can be realized in terms of hardware by elements and mechanical devices such as a computer processor and memory, and in terms of software by a computer program, etc., but here, functional blocks realized by cooperation of these elements are depicted. These functional blocks can be realized in various ways by hardware, software, or a combination of both.

[0021] The information terminal 20 and the foot shape model presentation device 60 are connected to each other via a network 40. The information terminal 20 includes an operation processing unit 22, an imaging unit 24, a display unit 26, a communication unit 28, and a presentation unit 30.

[0022] The operation processing unit 22 accepts operation inputs from the user 10. The operation processing unit 22 accepts instructions from the user 10 regarding the start of a series of foot shape measurement programs including a foot shape model presentation program. The display unit 26 starts displaying the contents of the foot shape measurement program on the screen and displays details regarding the measurement procedure based on the instructions accepted by the operation processing unit 22. The operation processing unit 22 and the display unit 26 may be configured in the form of hardware, for example, a touch panel.

[0023] The imaging unit 24 photographs the feet of the user 10 and acquires foot images based on instructions received by the operation processing unit 22. In terms of hardware, the imaging unit 24 may be configured, for example, as a camera module. The communication unit 28 transmits data such as foot images to the foot shape model presentation device 60 via the network 40. The communication unit 28 receives data such as individual shape models from the foot shape model presentation device 60. The individual shape models will be described later. In terms of hardware, the communication unit 28 may be configured, for example, as a wireless communication module for wireless LAN communication, mobile phone communication, or the like.

[0024] The presentation unit 30 visualizes the individual geometric model received from the foot shape model presentation device 60 and presents it to the user 10 through a screen display on the display unit 26. The presentation unit 30 may have the same functions as a presentation unit 72 of the foot shape model presentation device 60, which will be described later. Furthermore, at least one of the functions of these "presentations" may be realized by the information terminal 20 alone, or by the foot shape model presentation device 60 alone, or by cooperation between the information terminal 20 and the foot shape model presentation device 60. That is, after the information terminal 20 receives the data of the individual geometric model, the presentation unit 30 of the information terminal 20 may convert the data of the individual geometric model into display data and perform visualization processing, or the presentation unit 72 of the foot shape model presentation device 60 may convert the data of the individual geometric model into display data and perform visualization processing, and then transmit the converted display data to the information terminal 20.

[0025] The foot shape model presentation device 60 includes a communication unit 62, an acquisition unit 64, an extraction unit 66, a reference storage unit 68, a generation unit 70, and a presentation unit 72. The communication unit 62 receives foot images from the information terminal 20 and transmits data such as individual shape models to the information terminal 20. In terms of hardware, the communication unit 62 may be configured by a communication module such as a wired LAN.

[0026] The acquisition unit 64 acquires foot images of the user 10. The acquisition unit 64 may acquire the foot images from the information terminal 20 via the communication unit 62, or may acquire the foot images from a source other than the information terminal 20. When the acquisition unit 64 acquires the foot images from a source other than the information terminal 20, the foot images may be generated in advance by, for example, photographing the feet of the user 10 and stored in any manner.

[0027] FIG. 3 is a functional block diagram showing a schematic configuration of the extraction unit 66. The extraction unit 66 includes a shape extraction unit 82. The shape extraction unit 82 extracts shape information indicating characteristics of specific parts of the user's 10 foot shape from the foot image. The shape information is, for example, toe information that defines the appearance of the toe region. The toe region is not limited to the area of ​​the toes themselves, such as the first to fifth toes, but may also be an area closer to the heel, for example, an area including the MP joint. The toe information includes at least one of the following information: toe width, toe length, toe direction, nail shape, external shape of the toes, spacing between toes, and external shape around the MP joint.

[0028] FIG. 4 is a diagram schematically illustrating a portion of a foot image including a toe region 102. The toe region 102 is an example of a predetermined portion corresponding to shape information extracted from a foot image by the shape extraction unit 82. FIG. 4 shows an example of a foot image in which the foot of a user 10 is photographed from above. While toe information will be described mainly using the first toe as an example, the toe information may be information about any of the first to fifth toes, or may be information about multiple toes. The toe length 104 may be, for example, the length from the base to the tip of the toe along the longitudinal direction of the toe. The toe width 106 may be, for example, the width along a direction perpendicular to the longitudinal direction of the toe in a planar view.

[0029] The orientation of the toes may be the angle formed by the longitudinal direction of the toes with respect to a predetermined reference direction in the foot image, and the spacing 108 between the toes may be the width of the gap formed between two adjacent toes along a direction perpendicular to the longitudinal direction of one of the toes.

[0030] The external shape of the toes may include information such as Egyptian type, in which the first toe protrudes the furthest toward the toes, Greek type, in which the second toe protrudes the furthest toward the toes, square type, in which the tips of the first and second toes are positioned approximately the same toward the toes, etc. The external shape of the toes may also include information on whether or not symptoms such as hammer toe, claw toe, or mallet toe are present and the severity of these conditions.

[0031] The nail shape may be the size of the nail, which is obtained from the vertical width of the area occupied by the nail along the longitudinal direction of the toe and the horizontal width of the area occupied by the nail along the lateral direction of the toe, its aspect ratio, its proportion to the toe, etc. The nail shape may also be information about the shape of the nail of some of the toes, such as the first toe, which is generally the largest. The nail shape may include information about whether or not there is a condition such as ingrown nail, and the severity of such a condition.

[0032] The external shape around the MP joint may be the external shape of the medial side of the foot in the width direction around the MP joint (hereinafter also referred to as the "medial foot side"), or the external shape of the lateral side of the foot around the MP joint (hereinafter also referred to as the "lateral foot side"). The external shape of the medial side of the MP joint around the MP joint may include information on whether or not symptoms such as hallux valgus are present and their severity. The external shape of the lateral side of the MP joint around the MP joint may include information on whether or not symptoms such as hammertoe are present and their severity. The external shape around the MP joint may include information on whether or not symptoms such as splayfoot are present and their severity.

[0033] The shape information extracted from the foot image by the shape extraction unit 82 is not limited to toe information. However, the shape information may be information about at least parts of the foot shape that are likely to vary in shape depending on the user 10, unlike information about the outline of the entire foot. The shape information may be, for example, information that is not generally used for footwear fitting.

[0034] 3 , the extraction unit 66 may further include a foot size extraction unit 84. The foot size extraction unit 84 extracts foot size information including foot length and foot width from the foot image. The foot size information extracted by the foot size extraction unit 84 may include information other than foot length and foot width, such as information on foot circumference, foot height, and information on the contour shape of the entire or partial foot.

[0035] The information terminal 20 may have the same functions as the acquisition unit 64 and the extraction unit 66. In this case, the data transmitted from the information terminal 20 to the foot shape model presentation device 60 can be shape information extracted from a foot image, so the size of the transmitted data can be reduced compared to when foot image data is transmitted.

[0036] Returning to FIG. 2 , the reference storage unit 68 stores the reference model 120, which is a three-dimensional model obtained by averaging foot shapes. FIG. 5 is a diagram showing an example of the reference model 120. The reference model 120 is, for example, three-dimensional point cloud data including a plurality of contour points arranged along the contour of the foot shape. The reference model 120 may be generated, for example, by averaging a plurality of three-dimensional models obtained by scanning the foot shapes of a plurality of subjects. The reference model 120 is not limited to an actual average of three-dimensional models obtained from the foot shapes of a plurality of subjects. For example, the reference model 120 may be an existing three-dimensional model showing an average foot shape, or a three-dimensional model generated based on statistical information regarding various foot sizes, such as foot length, foot width, foot circumference, and foot height. Below, a case where the reference model 120 is three-dimensional point cloud data will be described.

[0037] The reference model 120 is a model that can represent at least the shape of a predetermined part such as the toe region 102 (see FIG. 4 ). That is, when the predetermined part is the toe region 102, the reference model 120 includes a plurality of contour points arranged along the contour of the toe region 102 that can represent at least one of the width of the toes, the length of the toes, the orientation of the toes, the shape of the nails, the external shape of the toes, and the spacing between the toes.

[0038] Returning to FIG. 2 , the generation unit 70 generates the individual shape model 130, which is a three-dimensional model that reproduces the user's foot shape, by deforming the shape of a portion of the reference model 120 corresponding to a predetermined portion stored in the reference storage unit 68 based on the shape information extracted from the foot image by the shape extraction unit 82. FIG. 6 is a diagram showing an example of the individual shape model 130. Specifically, the generation unit 70 generates the individual shape model 130 by moving each of a plurality of contour points in a portion of the reference model 120 corresponding to a predetermined portion so that the contour points approach the positions indicated by the shape information. For example, if the toe length 104 in the toe information is longer than the toe length in the reference model 120, the generation unit 70 moves the corresponding contour points so that the toes become longer, and if the toe length 104 is shorter than the toe length in the reference model 120, the generation unit 70 moves the corresponding contour points so that the toes become shorter. As shown in FIG. 6, the toe length 104A, toe width 106A, and toe spacing 108A in the toe region 102A of the individual shape model 130 are sized to correspond to the toe length 104, toe width 106, and toe spacing 108 in the toe region 102 of the foot image shown in FIG. 4, respectively.

[0039] The generator 70 does not necessarily have to move the shape of the part of the reference model 120 corresponding to the predetermined part so as to approximate the shape indicated by the shape information. The generator 70 may deform the shape of the part of the reference model 120 corresponding to the predetermined part so as to exaggerate the shape indicated by the shape information. Specifically, the generator 70 may move each of the multiple contour points in the part of the reference model 120 corresponding to the predetermined part until it exceeds the position indicated by the shape information. This makes it possible to further emphasize individual differences in the foot shape of the user 10.

[0040] When the extraction unit 66 includes a foot size extraction unit 84, the generation unit 70 may deform the overall shape of the reference model 120 so that it becomes a shape that corresponds to the foot size information extracted by the foot size extraction unit 84. For example, the generation unit 70 may deform the reference model 120 so that the foot length and foot width become sizes that correspond to the foot size information.

[0041] 3, the extraction unit 66 may further include a color extraction unit 86. The color extraction unit 86 extracts color information of at least a portion of the foot of the user 10 from the foot image. Specifically, the color extraction unit 86 may extract the color of a partial region of the foot image, or may extract a color obtained by averaging the colors of a portion or the entire foot image.

[0042] If the extraction unit 66 includes a color extraction unit 86, the generation unit 70 may generate the individual shape model 130 that reflects the color extracted by the color extraction unit 86. Specifically, the generation unit 70 may generate the individual shape model 130 by coloring at least a portion of a three-dimensional model obtained by deforming the shape of a portion corresponding to a predetermined portion of the reference model 120 based on the shape information, using a color based on the color information. The portion of the individual shape model 130 that is colored based on the color information may be the entire individual shape model 130 or may be a portion of the individual shape model 130. If the portion that is colored based on the color information is a portion of the individual shape model 130, the portion that is colored may be a portion that corresponds to the region of the foot image whose color is extracted by the color extraction unit 86. This allows, for example, the skin color or nail color of the user 10 to be reflected in the individual shape model 130.

[0043] As shown in FIG. 3 , the extraction unit 66 may further include an image extraction unit 88. The image extraction unit 88 may extract a partial image of an area including at least a portion of the predetermined part from the foot image. The partial image may be a planar image of the entire surface of the predetermined part or a portion of the surface. When the extraction unit 66 includes the image extraction unit 88, the generation unit 70 may generate the individual shape model 130 that reflects the partial image extracted by the image extraction unit 88. Specifically, the generation unit 70 may generate the individual shape model 130 by attaching the partial image to the surface of the part corresponding to the predetermined part in a three-dimensional model obtained by deforming the shape of the part corresponding to the predetermined part in the reference model 120 based on the shape information. This allows, for example, blood vessels, wrinkles, moles, scars, tattoos, etc. visible on the skin surface of the user's 10's foot to be reflected in the individual shape model 130.

[0044] When the extraction unit 66 includes a color extraction unit 86 and an image extraction unit 88, the generation unit 70 may generate the individual shape model 130 that reflects the color extracted by the color extraction unit 86 and the partial image extracted by the image extraction unit 88. Furthermore, the partial image extracted by the image extraction unit 88 may itself have color information.

[0045] Returning to FIG. 2 , the presentation unit 72 visualizes the individual shape model 130 generated by the generation unit 70 and transmits the visualized individual shape model 130 to the information terminal 20 via the communication unit 62, thereby presenting it to the user 10. The presentation unit 72 may generate display information that allows the visualized individual shape model 130 to be compared with the size of footwear such as shoes. For example, the presentation unit 72 may generate display information that displays a semi-transparent image of footwear superimposed on the image of the individual shape model 130 so that the positional relationship and size difference between the image of the individual shape model 130 and the image of the footwear are clear. This allows the user 10 to select footwear that suits their own foot shape.

[0046] When the extraction unit 66 includes the image extraction unit 88, the presentation unit 72 may generate display information in which a partial image is superimposed on a position corresponding to a predetermined part of the individual shape model 130. Alternatively, instead of the generation unit 70 generating the individual shape model 130, the presentation unit 72 may generate display information in which a partial image is superimposed on a position corresponding to a predetermined part of the reference model 120. In this way, the foot shape model presentation device 60 can reproduce and display the foot shape of the user 10 at a part corresponding to a predetermined part of the reference model 120 without necessarily performing a deformation process on the reference model 120.

[0047] The foot shape model presentation device 60 may store the individual shape model 130 generated by the generation unit 70 in an external database 90. The database 90 may be connected to the foot shape model presentation device 60 via the network 40.

[0048] Fig. 7 is a block diagram showing an example of the configuration of a foot shape model presentation system 100. The foot shape model presentation system 100 includes an integrated database 210, a first service database 220, a second service database 230, a third service database 240, a user terminal 260, and an administrator terminal 270. The integrated database 210 is a database server that mainly has the functions of a foot shape model presentation device 60. The user terminal 260 and the administrator terminal 270 mainly have the functions of an information terminal 20. Although Fig. 7 shows first to third service databases 220 to 240, the number of these is not limited to three and may be two, or four or more.

[0049] The user terminal 260 is a terminal used mainly by a person such as the user 10 who provides foot shape data based on his or her own foot images. The first to third service databases 220 to 240 are database servers for providing management services for different foot shape data. The administrator terminal 270 is a terminal used by a person who manages and operates the first to third service databases 220 to 240, researchers, etc.

[0050] The user terminal 260 is connected to each of the first to third service databases 220 to 240 via a network or the like, and transmits foot shape data to one of the first to third service databases 220 to 240 depending on the service being used. The first to third service databases 220 to 240 store foot shape data in different data formats. The administrator terminal 270 is connected to each of the first to third service databases 220 to 240 via a network or the like, and accesses the first to third service databases 220 to 240 depending on the type of service being provided.

[0051] The integrated database 210 is connected to each of the first to third service databases 220 to 240 via a network or the like, and stores normalized data (hereinafter referred to as "normalized data") such as individual shape models based on the foot shape data stored in each of the first to third service databases 220 to 240. The integrated database 210 also stores each normalized data in association with the original foot shape data stored in each of the first to third service databases 220 to 240.

[0052] The user terminal 260 and the administrator terminal 270 are connected to the integrated database 210 via a network or the like, and access the normalized data stored in the integrated database 210 as needed. Furthermore, the user terminal 260 and the administrator terminal 270 access the original foot shape data stored in each of the first to third service databases 220 to 240 associated with each normalized data as needed.

[0053] In this way, even if multiple services manage foot shape data in different data formats, the foot shape model presentation system 100 can improve convenience by linking the database servers used for each service. Furthermore, the foot shape model presentation system 100 can use normalized data while taking advantage of the advantages of each service.

[0054] 8 is a functional block diagram showing a schematic configuration of a foot shape model presentation device 60A according to a modified example. The foot shape model presentation device 60A includes a communication unit 62, an acquisition unit 64, an extraction unit 66, a determination unit 74, a reference storage unit 68A, a generation unit 70A, and a presentation unit 72. Among the components of the foot shape model presentation device 60A, the determination unit 74, the reference storage unit 68A, and the generation unit 70A, which are different from the components of the foot shape model presentation device 60, will be described below.

[0055] The determination unit 74 determines the type of toe information extracted by the extraction unit 66. The types of toe information include, for example, an Egyptian type in which the first toe protrudes furthest toward the toes, a Greek type in which the second toe protrudes furthest toward the toes, and a square type in which the tips of the first and second toes are positioned approximately the same toward the toes. The types of toe information may also include types such as hallux valgus and hammertoe varus.

[0056] The reference storage unit 68A stores multiple types of reference models corresponding to the types of toe information. The generation unit 70A generates an individual shape model using the corresponding reference model stored in the reference storage unit 68A according to the type of toe information determined by the determination unit 74.

[0057] The above-described embodiment may be a program for causing a computer to implement the functions for implementing the above-described method, or a recording medium for storing the program. The recording medium for storing such a program may be a non-transitory, tangible, computer-readable storage medium, such as a non-volatile memory, a magnetic storage medium such as a magnetic tape or a magnetic disk, or an optical storage medium such as an optical disk.

[0058] The above is a description of an embodiment. This embodiment is merely an example, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component and each treatment process, and that such modifications are also within the scope of the present disclosure. Furthermore, the above-described embodiment can be generalized to provide the following aspects.

[0059] [Aspect 1] A foot shape model presentation device comprising: an acquisition unit that acquires an image of a user's foot shape; a reference storage unit that stores a reference model, which is a three-dimensional model obtained by averaging the foot shape; an extraction unit that extracts shape information indicating characteristics of a predetermined part of the user's foot shape from the image; a generation unit that generates an individual shape model, which is a three-dimensional model that reproduces the user's foot shape by transforming the shape of a part of the reference model corresponding to the predetermined part based on the shape information; and a presentation unit that visualizes the individual shape model and presents it to the user.

[0060] The foot shape model presentation device according to this aspect generates an individual shape model that reproduces the user's foot shape by deforming the shape of a predetermined part of a reference model obtained by averaging foot shapes based on shape information indicating the characteristics of the predetermined part of the user's foot shape, and visualizes the individual shape model and presents it to the user. Therefore, the foot shape model presentation device according to this aspect can visualize and present to the user an individual shape model that reflects the user's individuality, for example, by designating as the predetermined part a part of the foot shape that is likely to show differences in shape between users. This allows the presentation of a foot shape model that more closely reflects the user's foot characteristics, giving the user the impression that the presented foot shape model accurately reproduces their own foot. This, for example, makes the user more likely to develop an attachment to the presented foot shape model, which can lead to improved customer satisfaction and increased reliability of the presentation results.

[0061] [Aspect 2] The foot shape model presentation device according to Aspect 1, wherein the shape information may be toe information defining the appearance of a toe region, and the toe information may include at least any of information on toe width, toe length, toe orientation, nail shape, external shape of the toes, spacing between toes, and external shape around MP joints.

[0062] According to this aspect, the external appearance characteristics of the toe area, which vary greatly among individuals, can be reflected in the individual shape model. Therefore, according to this aspect, a foot shape model that better reflects the characteristics of the user's feet can be presented, and the user can be given the impression that the presented foot shape model accurately reproduces their own feet.

[0063] [Aspect 3] The foot shape model presentation device according to Aspect 2, wherein the extraction unit may further extract foot size information including a foot length and a foot width from the image, and the generation unit may deform the overall shape of the reference model so as to form a shape corresponding to the foot size information.

[0064] According to this aspect, the overall shape of the individual shape model can be made to correspond to the foot size of the user. Therefore, according to this aspect, a foot shape model that better reflects the characteristics of the user's foot can be presented, and the user can be given the impression that the presented foot shape model accurately reproduces their own foot.

[0065] Aspect 4 The foot shape model presentation device according to Aspect 2 or 3, further comprising a determination unit that determines a type of the toe information, wherein the reference storage unit stores a plurality of types of the reference models respectively corresponding to the types of toe information, and wherein the generation unit generates the individual shape model using the corresponding reference model in accordance with the type of toe information determined by the determination unit.

[0066] According to this aspect, an individual shape model is generated using a reference model corresponding to the determined type of toe information. Therefore, for example, by using a reference model having a foot shape that is highly correlated for each type of toe information, the individual shape model can be made to more closely approximate the user's foot shape. Therefore, according to this aspect, a foot shape model that more closely reflects the user's foot characteristics can be presented, giving the user the impression that the presented foot shape model accurately reproduces their own foot.

[0067] [Aspect 5] The foot shape model presentation device according to any one of Aspects 1 to 4, wherein the extraction unit may extract color information of at least a part of the user's foot from the image, and the generation unit may generate the individual shape model by coloring at least a part of a three-dimensional model obtained by deforming a shape of a part corresponding to the predetermined part in the reference model based on the shape information, in a color based on the color information.

[0068] According to this aspect, the color of the user's feet can be reflected in the individual shape model, and therefore, according to this aspect, a foot shape model that better reflects the characteristics of the user's feet can be presented, giving the user the impression that the presented foot shape model accurately reproduces their own feet.

[0069] [Aspect 6] The foot shape model presentation device according to any one of Aspects 1 to 5, wherein the extraction unit may extract a partial image of an area including at least a part of the predetermined part from the image, and the generation unit may generate the individual shape model by pasting the partial image onto a surface of a part corresponding to the predetermined part of a three-dimensional model obtained by deforming a shape of a part corresponding to the predetermined part in the reference model based on the shape information.

[0070] According to this aspect, an individual shape model is generated by pasting a partial image of an area including at least a part of a predetermined part onto the surface of a part corresponding to the predetermined part in the reference model. Therefore, the surface texture of the predetermined part of the user's foot can be reflected in the part corresponding to the predetermined part of the individual shape model. Therefore, according to this aspect, a foot shape model that better reflects the characteristics of the user's foot can be presented, and the user can be given the impression that the presented foot shape model accurately reproduces their own foot.

[0071] [Aspect 7] A foot shape model presentation method comprising the steps of: acquiring an image of a user's foot shape; extracting shape information indicating characteristics of a predetermined part of the user's foot shape from the image; generating an individual shape model, which is a three-dimensional model that reproduces the user's foot shape, by transforming the shape of a part corresponding to the predetermined part in a reference model, which is a three-dimensional model obtained by averaging foot shapes, based on the shape information; and visualizing the individual shape model and presenting it to the user.

[0072] According to the foot shape model presentation method of this aspect, the shape of a predetermined part of a reference model obtained by averaging foot shapes is transformed based on shape information indicating the characteristics of the predetermined part of the user's foot shape to generate an individual shape model that reproduces the user's foot shape, and the individual shape model is visualized and presented to the user. Therefore, according to the foot shape model presentation method of this aspect, by setting, as the predetermined part, for example, a part of the foot shape that is likely to vary in shape between users, it is possible to visualize and present to the user an individual shape model that reflects the user's individuality. As a result, according to this aspect, a foot shape model that better reflects the user's foot characteristics can be presented, giving the user the impression that the presented foot shape model accurately reproduces their own foot.

[0073] [Aspect 8] A program for causing a computer to perform the following functions: acquiring an image of a user's foot shape; extracting shape information from the image that indicates characteristics of a predetermined part of the user's foot shape; generating an individual shape model, which is a three-dimensional model that reproduces the user's foot shape by transforming the shape of a part corresponding to the predetermined part in a reference model, which is a three-dimensional model that averages the foot shape, based on the shape information; and visualizing the individual shape model and presenting it to the user.

[0074] According to the program of this aspect, the shape of a predetermined part of a reference model obtained by averaging foot shapes is deformed based on shape information indicating the characteristics of the predetermined part of the user's foot shape to generate an individual shape model that reproduces the user's foot shape, and the individual shape model is visualized and presented to the user. Therefore, according to the program of this aspect, by setting, as the predetermined part, for example, a part of the foot shape that is likely to vary in shape between users, it is possible to visualize and present to the user an individual shape model that reflects the user's individuality. As a result, according to this aspect, a foot shape model that more closely reflects the user's foot characteristics can be presented, giving the user the impression that the presented foot shape model accurately reproduces their own foot.

[0075] The present disclosure relates to a foot shape model presentation device, a foot shape model presentation method, and a program.

[0076] 10 User, 30 Presentation unit, 60 Foot shape model presentation device, 64 Acquisition unit, 66 Extraction unit, 68 Reference storage unit, 70 Generation unit, 72 Presentation unit, 74 Determination unit, 102 Toe area, 104 Toe length, 106 Toe width, 108 Spacing between toes, 120 Reference model, 130 Individual shape model.

Claims

1. A foot shape model presentation device comprising: an acquisition unit that acquires an image of a user's foot shape; a reference memory unit that stores a reference model which is a three-dimensional model obtained by averaging the foot shape; an extraction unit that extracts shape information indicating characteristics of a specific part of the user's foot shape from the image; a generation unit that generates an individual shape model which is a three-dimensional model that reproduces the user's foot shape by deforming the shape of a part of the reference model corresponding to the specific part based on the shape information; and a presentation unit that visualizes the individual shape model and presents it to the user.

2. A foot shape model presentation device as described in claim 1, wherein the shape information is toe information defining the appearance of the toe region, and the toe information includes at least any one of information on toe width, toe length, toe direction, nail shape, external shape of the toes, spacing between toes, and external shape around the MP joints.

3. The foot shape model presentation device according to claim 2, wherein the extraction unit further extracts foot size information including foot length and foot width from the image, and the generation unit deforms the overall shape of the reference model so as to become a shape corresponding to the foot size information.

4. A foot shape model presentation device as described in claim 2 or 3, further comprising a judgment unit that judges the type of toe information, wherein the reference memory unit stores a plurality of types of the reference models each corresponding to the type of toe information, and the generation unit generates the individual shape model using the corresponding reference model depending on the type of toe information judged by the judgment unit.

5. A foot shape model presentation device as described in any one of claims 1 to 4, wherein the extraction unit extracts color information of at least a part of the user's foot from the image, and the generation unit generates the individual shape model by coloring at least a part of a three-dimensional model obtained by deforming the shape of a part corresponding to the specified part in the reference model based on the shape information, in a color based on the color information.

6. A foot shape model presentation device as described in any one of claims 1 to 5, wherein the extraction unit extracts a partial image of an area including at least a part of the specified part from the image, and the generation unit generates the individual shape model by pasting the partial image onto a surface of a part corresponding to the specified part of a three-dimensional model obtained by deforming a shape of a part corresponding to the specified part in the reference model based on the shape information.

7. A foot shape model presentation method comprising the steps of: acquiring an image of a user's foot shape; extracting shape information indicating characteristics of a specific part of the user's foot shape from the image; generating an individual shape model, which is a three-dimensional model that reproduces the user's foot shape, by transforming the shape of a part corresponding to the specific part in a reference model, which is a three-dimensional model obtained by averaging the foot shape, based on the shape information; and visualizing the individual shape model and presenting it to the user.

8. A program for causing a computer to perform the following functions: acquiring an image of a user's foot shape; extracting shape information indicating characteristics of a specific part of the user's foot shape from the image; generating an individual shape model, which is a three-dimensional model that reproduces the user's foot shape by transforming the shape of a part corresponding to the specific part in a reference model, which is a three-dimensional model that averages the foot shape, based on the shape information; and visualizing the individual shape model and presenting it to the user.

Images