Footprint shape model presentation device and footprint shape model presentation method and program

Abstract

To provide a technique that can present a footprint shape model that better reflects the characteristics of a user's feet.SOLUTION: A footprint shape model presentation device 60 comprises an acquisition part 64, a reference storage part 68, an extraction part 66, a generation part 70, and a presentation part 72. The acquisition part 64 acquires an image of the foot shape of a user 10. The reference storage part 68 stores a reference model that is a three-dimensional model averaged from footprint shapes. The extraction part 66 extracts shape information indicating the characteristics of predetermined parts of the user 10's foot shape from the image. The generation part 70 generates an individual shape model that is a three-dimensional model that reproduces the user 10's foot shape by deforming the shape of the corresponding parts in the reference model based on the shape information. The presentation part 72 visualizes the individual shape model and presents it to the user 10.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to a foot shape model presentation device, a foot shape model presentation method, and a program. [Background technology]

[0002] There is known a technology that can easily measure a user's foot size based on an image of the user's foot (see, for example, Patent Document 1). The technology described in Patent Document 1 allows a user to easily measure his or her own foot size, and can be used when selecting footwear of a suitable size for the user's foot. Patent Document 1 also describes that it is possible to generate a three-dimensional model (foot shape model) of the user's foot and display the generated foot shape model. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2020 / 059716 Summary of the Invention [Problem to be solved by the invention]

[0004] In the technology described in Patent Document 1, the contour data of the entire user's foot is combined with pre-stored foot model data to generate a foot model of the user. Although the foot model generated in this way reflects the contour of the entire user's foot, it is difficult to say that it reflects the characteristics of the user's foot, and it tends to give an inorganic impression.

[0005] The present disclosure has been made in consideration of these circumstances, and has as its objective to provide a technology capable of presenting a foot shape model that better reflects the characteristics of a user's foot. [Means for solving the problem]

[0006] A foot shape model presentation device of one aspect of the present disclosure comprises an acquisition unit that acquires an image of a user's foot shape, a reference memory unit that stores a reference model which is a three-dimensional model obtained by averaging the foot shape, an extraction unit that extracts shape information indicating characteristics of a specific part of the user's foot shape from the image, a generation unit that generates an individual shape model which is a three-dimensional model that reproduces the user's foot shape by deforming the shape of a part of the reference model corresponding to the specific part based on the shape information, and a presentation unit that visualizes the individual shape model and presents it to the user.

[0007] Another aspect of the present disclosure is a foot shape model presentation method, which includes the steps of acquiring an image of a user's foot shape, extracting shape information indicating features of a predetermined part of the user's foot shape from the image, generating an individual shape model, which is a three-dimensional model reproducing the user's foot shape by transforming a shape of a part corresponding to the predetermined part in a reference model, which is a three-dimensional model obtained by averaging foot shapes, based on the shape information, and visualizing the individual shape model and presenting it to the user.

[0008] Another aspect of the present disclosure is a program that causes a computer to perform the following functions: acquiring an image of a user's foot shape, extracting shape information indicating features of a predetermined part of the user's foot shape from the image, generating an individual shape model that is a three-dimensional model that reproduces the user's foot shape by transforming a shape of a part corresponding to the predetermined part in a reference model that is a three-dimensional model obtained by averaging foot shapes based on the shape information, and visualizing the individual shape model to present it to the user.

[0009] In addition, any combination of the above components, or mutual substitution of the components or expressions of the present disclosure among methods, devices, programs, temporary or non-temporary storage media storing programs, systems, etc., are also valid aspects of the present disclosure. Effect of the Invention

[0010] According to an aspect of the present disclosure, a technique can be provided that can present a foot shape model that better reflects the characteristics of a user's foot. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a schematic diagram showing an overview of a foot shape model presentation system. [Diagram 2] 2 is a functional block diagram showing a schematic configuration of the foot shape model presentation system shown in FIG. 1. [Diagram 3] 3 is a functional block diagram showing a schematic configuration of an extraction unit shown in FIG. 2. [Figure 4] FIG. 2 is a diagram showing a schematic view of a part of a foot image including a toe region. [Diagram 5] FIG. 2 illustrates an example of a reference model. [Figure 6] FIG. 13 is a diagram illustrating an example of an individual shape model. [Figure 7] 2 is a block diagram showing an example of the configuration of the foot shape model presentation system shown in FIG. 1. [Figure 8] FIG. 13 is a functional block diagram showing a schematic configuration of a foot shape model presentation device according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the present disclosure will be described based on preferred embodiments with reference to the drawings. In the embodiments and modifications, the same or equivalent components are given the same reference numerals, and duplicated descriptions are omitted as appropriate.

[0013] 1 is a schematic diagram showing an overview of a foot shape model presentation system 100. The foot shape model presentation system 100 includes an information terminal 20 and a foot shape model presentation device 60. The information terminal 20 is, for example, a mobile phone terminal, and takes an image of the feet of a user 10 with a built-in camera. The user 10 may operate the information terminal 20 to take an image of his / her own feet, or a person other than the user 10, for example a salesperson at a shoe store, may operate the information terminal 20 to take an image of the feet of the user 10. Alternatively, the information terminal 20 may be configured to automatically take an image of the feet of the user 10.

[0014] The information terminal 20 may photograph the feet of the user 10 so that a predetermined reference object is reflected in the image. Here, the "reference object" is a comparison object for measuring the foot length and foot width of the user 10 based on the image, and is a flat or three-dimensional object whose size and shape are specified in advance. This "reference object" may be a general-purpose product or a dedicated product as long as its size and shape are specified. As a general-purpose product, for example, paper of a specified size such as A4 size (210 mm x 297 mm) or letter size can be used. The color of the paper is preferably white, but paper of other colors may be used. In that case, the user 10 may place his / her foot on the A4 paper and photograph his / her foot using the information terminal 20. As a dedicated product, the measurement mat 12 shown in FIG. 1 can be used. In that case, the user 10 may place his / her foot on the measurement mat 12 and photograph his / her foot using the information terminal 20. Regardless of whether a general-purpose product or a dedicated product is used as the reference object, a person other than the user 10 may photograph the foot of the user 10 using the information terminal 16. The information terminal 16 may capture an image of the feet of the user 10 without using a reference object.

[0015] The information terminal 20 may obtain multiple images by photographing the feet of the user 10 from multiple angles. This allows an image to be obtained that reflects the contours of the toes and heels, and the contours of both the left and right sides of the forefoot to the midfoot, so that information on the foot length and foot width can be included in the image. The information terminal 20 may obtain at least one image of the foot of the user 10 photographed from above, with a part of the foot of the user 10, such as the heel, aligned with a predetermined position of a reference object. This allows the position of a part of the foot, such as the heel, in the image to be identified even if the part of the foot, such as the heel, is not directly reflected in the image, so that information on the foot length and foot width can be included in the image.

[0016] As described above, the information terminal 20 captures an image of the foot shape of the user 10 (hereinafter referred to as a "foot image") by photographing the foot of the user 10. The foot image does not have to include the entire foot of the user 10, but includes at least a predetermined part such as the toes. The foot image may be multiple images or a single image. The foot image may also be a moving image based on multiple images acquired in chronological order. The information terminal 20 transmits the foot image to the foot shape model presentation device 60.

[0017] The foot shape model presentation device 60 is, for example, a server computer connected to a plurality of information terminals 20 via a network line such as the Internet or a LAN (Local Area Network) and communication means such as wireless communication. When the foot shape model presentation device 60 is a server computer, the foot shape model presentation device 60 may be configured as a single server computer or a combination of a plurality of server computers.

[0018] The information terminal 20 and the foot shape model presentation device 60 may each be configured as a mobile terminal or computer including a central processing unit (CPU), a graphics processing unit (GPU), a random access memory (RAM), a read only memory (ROM), an auxiliary storage device, a display device, a communication device, etc., and a program stored in the mobile terminal or computer. For example, the program executed on the foot shape model presentation device 60 side may be used from the information terminal 20 side via a communication means. However, the function of the foot shape model presentation system 100 may be realized by a single device having the functions of the information terminal 20 and the foot shape model presentation device 60, and the single device may be configured to be able to execute the foot shape model presentation program. The single device may be a personal computer, a mobile terminal such as a smartphone, or a tablet terminal capable of executing the foot shape model presentation program. Alternatively, the single device may be a terminal installed in a shoe store and capable of executing the foot shape model presentation program.

[0019] The "foot shape model presentation device" in the claims may refer to the entire foot shape model presentation system 100, or may refer to the foot shape model presentation device 60. In this embodiment, since the foot shape model presentation device 60 is provided with many of the characteristic functions included in the "foot shape model presentation device" in the claims, the foot shape model presentation device 60 essentially corresponds to the "foot shape model presentation device".

[0020] Fig. 2 is a functional block diagram showing the schematic configuration of the foot shape model presentation system 100. Each functional block shown in each diagram including Fig. 2 can be realized in terms of hardware by elements and mechanical devices such as a computer processor and memory, and in terms of software by a computer program, etc., but here, functional blocks realized by cooperation of these are depicted. These functional blocks can be realized in various forms by hardware, software, or a combination of both.

[0021] The information terminal 20 and the foot shape model presentation device 60 are connected to each other via a network 40. The information terminal 20 includes an operation processing unit 22, an imaging unit 24, a display unit 26, a communication unit 28, and a presentation unit 30.

[0022] The operation processing unit 22 accepts operation input from the user 10. The operation processing unit 22 accepts instructions from the user 10 regarding the start of a series of foot shape measurement programs including a foot shape model presenting program. The display unit 26 starts displaying the contents of the foot shape measurement program on a screen and displays contents related to the measurement procedure based on the instructions accepted by the operation processing unit 22. In terms of hardware, the operation processing unit 22 and the display unit 26 may be configured, for example, by a touch panel.

[0023] The imaging unit 24 photographs the feet of the user 10 to obtain foot images based on instructions received by the operation processing unit 22. In terms of hardware, the imaging unit 24 may be configured, for example, by a camera module. The communication unit 28 transmits data such as foot images to the foot shape model presentation device 60 via the network 40. The communication unit 28 receives data such as individual shape models from the foot shape model presentation device 60. The individual shape models will be described later. In terms of hardware, the communication unit 28 may be configured, for example, by a wireless communication module for wireless LAN communication, mobile phone communication, or the like.

[0024] The presentation unit 30 visualizes the individual shape model received from the foot shape model presentation device 60 and presents it to the user 10 through a screen display by the display unit 26. The presentation unit 30 may have a function equivalent to that of a presentation unit 72 of the foot shape model presentation device 60 described later. At least one of the functions of these "presentations" may be realized by only the information terminal 20 or only the foot shape model presentation device 60, or may be realized by cooperation between the information terminal 20 and the foot shape model presentation device 60. That is, after the information terminal 20 receives the data of the individual shape model, the presentation unit 30 of the information terminal 20 may convert the data of the individual shape model into display data and perform visualization processing, or the presentation unit 72 of the foot shape model presentation device 60 may convert the data of the individual shape model into display data and perform visualization processing, and then transmit the converted display data to the information terminal 20.

[0025] The foot shape model presentation device 60 includes a communication unit 62, an acquisition unit 64, an extraction unit 66, a reference storage unit 68, a generation unit 70, and a presentation unit 72. The communication unit 62 receives foot images from the information terminal 20 and transmits data such as an individual shape model to the information terminal 20. In terms of hardware, the communication unit 62 may be configured with a communication module such as a wired LAN.

[0026] The acquisition unit 64 acquires a foot image of the user 10. The acquisition unit 64 may acquire the foot image from the information terminal 20 via the communication unit 62, or may acquire the foot image from a source other than the information terminal 20. When the acquisition unit 64 acquires the foot image from a source other than the information terminal 20, the foot image may be generated in advance, for example, by photographing the feet of the user 10, and may be stored in any manner.

[0027] FIG. 3 is a functional block diagram showing a schematic configuration of the extraction unit 66. The extraction unit 66 includes a shape extraction unit 82. The shape extraction unit 82 extracts shape information indicating characteristics of a predetermined part of the shape of the foot of the user 10 from the foot image. The shape information is, for example, toe information that defines the appearance of the toe region. The toe region is not limited to the region of the toes themselves, such as the first toe to the fifth toe, but may be a region closer to the heel, for example, a region including the MP joint. The toe information includes at least any of information on the width of the toes, the length of the toes, the direction of the toes, the shape of the nails, the external shape of the toes, the distance between the toes, and the external shape around the MP joint.

[0028] FIG. 4 is a diagram showing a schematic view of a part of a foot image including a toe region 102. The toe region 102 is an example of a predetermined part corresponding to shape information extracted from a foot image by the shape extraction unit 82. FIG. 4 shows an example of a foot image in which the foot of a user 10 is photographed from above. Although the toe information will be mainly described using the first toe as an example, the toe information may be information about any of the first toe toe toe toe toe toe toe toe toe, or may be information about a plurality of toes. The toe length 104 may be, for example, the length from the base end to the tip end of the toe along the longitudinal direction of the toe. The toe width 106 may be, for example, the width along a direction perpendicular to the longitudinal direction of the toe in a plan view.

[0029] The orientation of the toes may be the angle that the longitudinal direction of the toes makes with respect to a predetermined reference direction in the foot image. The spacing 108 between the toes may be the width of the gap between two adjacent toes along a direction perpendicular to the longitudinal direction of one of the toes.

[0030] The external shape of the toes may include information such as Egyptian type, in which the first toe protrudes the furthest toward the toes, Greek type, in which the second toe protrudes the furthest toward the toes, square type, in which the tips of the first and second toes are positioned approximately at the same position toward the toes, etc. The external shape of the toes may include information on whether or not there is a condition such as hammer toe, claw toe, or mallet toe, and the severity of such a condition.

[0031] The nail shape may be the size of the nail, which is obtained from the vertical width of the area occupied by the nail along the longitudinal direction of the toe and the horizontal width of the area occupied by the nail along the lateral direction of the toe, the aspect ratio, the proportion of the area occupied by the nail relative to the toe, etc. The nail shape may be information regarding the shape of the nail of some of the toes, such as the first toe, which is generally the largest. The nail shape may include information regarding the presence or absence of symptoms such as ingrown nails and the severity thereof.

[0032] The external shape around the MP joint may be the external shape of the inner side of the MP joint in the width direction of the foot (hereinafter also referred to as the "inner foot side"), or the external shape of the outer side of the MP joint in the width direction of the foot (hereinafter also referred to as the "outer foot side"). The external shape of the inner foot side around the MP joint may include information on whether or not symptoms such as hallux valgus are present and the extent of such symptoms. The external shape of the outer foot side around the MP joint may include information on whether or not symptoms such as miniature toe are present and the extent of such symptoms. The external shape around the MP joint may include information on whether or not symptoms such as splayfoot are present and the extent of such symptoms.

[0033] The shape information extracted by the shape extraction unit 82 from the foot image is not limited to toe information. However, the shape information may be information on parts of the foot shape that are likely to show differences in shape depending on the user 10, unlike at least information on the outline of the entire foot. The shape information may be information that is not generally used for fitting footwear, for example.

[0034] Returning to Fig. 3, the extraction unit 66 may further include a foot size extraction unit 84. The foot size extraction unit 84 extracts foot size information including foot length and foot width from the foot image. The foot size information extracted by the foot size extraction unit 84 may include information other than foot length and foot width, and may include, for example, foot circumference information, foot height information, and information on the contour shape of the entire or part of the foot.

[0035] The information terminal 20 may have the same functions as the acquisition unit 64 and the extraction unit 66. In this case, the data transmitted from the information terminal 20 to the foot shape model presentation device 60 can be shape information extracted from a foot image, so that the size of the transmitted data can be reduced compared to the case of transmitting data of a foot image.

[0036] Returning to FIG. 2, the reference storage unit 68 stores the reference model 120, which is a three-dimensional model obtained by averaging the foot shape. FIG. 5 is a diagram showing an example of the reference model 120. The reference model 120 is, for example, three-dimensional point cloud data including a plurality of contour points arranged along the contour of the foot shape. The reference model 120 may be generated, for example, by averaging a plurality of three-dimensional models obtained by scanning the foot shapes of a plurality of subjects. The reference model 120 is not limited to an actual average of three-dimensional models obtained from the foot shapes of a plurality of subjects, and may be, for example, an existing three-dimensional model showing an average foot shape, or a three-dimensional model generated based on statistical information on various foot sizes such as foot length, foot width, foot circumference, and foot height. Hereinafter, a case where the reference model 120 is three-dimensional point cloud data will be described.

[0037] Reference model 120 is a model capable of expressing at least the shape of a predetermined part such as toe region 102 (see FIG. 4). That is, when the predetermined part is toe region 102, reference model 120 includes a plurality of contour points arranged along the contour of toe region 102 so as to be capable of expressing at least any of the width of the toes, the length of the toes, the orientation of the toes, the shape of the nails, the external shape of the toes, and the spacing between the toes.

[0038] Returning to FIG. 2, the generating unit 70 generates an individual shape model 130, which is a three-dimensional model that reproduces the user's foot shape, by transforming the shape of a part corresponding to a predetermined part in the reference model 120 stored in the reference storage unit 68 based on the shape information extracted from the foot image by the shape extracting unit 82. FIG. 6 is a diagram showing an example of the individual shape model 130. Specifically, the generating unit 70 generates the individual shape model 130 by moving each of a plurality of contour points in a part corresponding to a predetermined part in the reference model 120 so as to approach a position indicated by the shape information. For example, when the length 104 of the toe in the toe information is longer than the length of the toe in the reference model 120, the generating unit 70 moves the corresponding contour points so that the toe becomes longer, and when the length 104 of the toe in the toe information is shorter than the length of the toe in the reference model 120, the generating unit 70 moves the corresponding contour points so that the toe becomes shorter. As shown in FIG. 6, the toe length 104A, toe width 106A and toe spacing 108A in the toe region 102A of the individual shape model 130 are sized to correspond respectively to the toe length 104, toe width 106 and toe spacing 108 in the toe region 102 of the foot image shown in FIG. 4.

[0039] The generating unit 70 does not necessarily have to move the shape of the part corresponding to the predetermined part in the reference model 120 so as to approach the shape indicated by the shape information. The generating unit 70 may deform the shape of the part corresponding to the predetermined part in the reference model 120 so as to exaggerate the shape indicated by the shape information. Specifically, the generating unit 70 may move each of a plurality of contour points in the part corresponding to the predetermined part in the reference model 120 until it exceeds the position indicated by the shape information. This makes it possible to further emphasize individual differences in the foot shapes of the user 10.

[0040] When the extraction unit 66 includes the foot size extraction unit 84, the generation unit 70 may deform the overall shape of the reference model 120 so that it becomes a shape corresponding to the foot size information extracted by the foot size extraction unit 84. For example, the generation unit 70 may deform the reference model 120 so that the foot length and foot width become sizes corresponding to the foot size information.

[0041] 3, the extraction unit 66 may further include a color extraction unit 86. The color extraction unit 86 extracts color information of at least a part of the foot of the user 10 from the foot image. Specifically, the color extraction unit 86 may extract the color of a part of the region of the foot image, or may extract a color obtained by averaging the colors of a part or the entirety of the foot image.

[0042] When the extraction unit 66 includes the color extraction unit 86, the generation unit 70 may generate the individual shape model 130 reflecting the color extracted by the color extraction unit 86. Specifically, the generation unit 70 may generate the individual shape model 130 by coloring at least a part of a three-dimensional model obtained by deforming the shape of a part corresponding to a predetermined part in the reference model 120 based on the shape information, in a color based on the color information. The part of the individual shape model 130 that is colored based on the color information may be the entire individual shape model 130 or may be a part of the individual shape model 130. When the part that is colored based on the color information is a part of the individual shape model 130, the part that is colored may be a part corresponding to the area of ​​the foot image whose color is extracted by the color extraction unit 86. Thereby, for example, the skin color or nail color of the user 10 can be reflected in the individual shape model 130.

[0043] As shown in FIG. 3, the extraction unit 66 may further include an image extraction unit 88. The image extraction unit 88 may extract a partial image of an area including at least a part of the predetermined part from the foot image. The partial image may be a planar image of the entire or partial surface of the predetermined part. When the extraction unit 66 includes the image extraction unit 88, the generation unit 70 may generate the individual shape model 130 reflecting the partial image extracted by the image extraction unit 88. Specifically, the generation unit 70 may generate the individual shape model 130 by attaching the partial image to the surface of the part corresponding to the predetermined part of the three-dimensional model obtained by deforming the shape of the part corresponding to the predetermined part in the reference model 120 based on the shape information. Thereby, for example, blood vessels, wrinkles, moles, scars, tattoos, etc. visible on the skin surface of the foot of the user 10 can be reflected in the individual shape model 130.

[0044] When the extraction unit 66 includes a color extraction unit 86 and an image extraction unit 88, the generation unit 70 may generate an individual shape model 130 that reflects the color extracted by the color extraction unit 86 and the partial image extracted by the image extraction unit 88. In addition, the partial image extracted by the image extraction unit 88 may itself have color information.

[0045] Returning to FIG. 2, the presentation unit 72 visualizes the individual shape model 130 generated by the generation unit 70 and transmits it to the information terminal 20 via the communication unit 62, thereby presenting it to the user 10. The presentation unit 72 may generate display information that allows the visualized individual shape model 130 to be compared with the size of footwear such as shoes. For example, the presentation unit 72 may generate display information in which a semi-transparent image of footwear is superimposed on the image of the individual shape model 130 so that the positional relationship and size difference between the image of the individual shape model 130 and the image of the footwear are clear. This allows the user 10 to select footwear that is suitable for his or her own foot shape.

[0046] When the extraction unit 66 includes the image extraction unit 88, the presentation unit 72 may generate display information in which a partial image is superimposed on a position corresponding to a predetermined part of the individual shape model 130. Alternatively, instead of the generation unit 70 generating the individual shape model 130, the presentation unit 72 may generate display information in which a partial image is superimposed on a position corresponding to a predetermined part of the reference model 120. In this way, the foot shape model presentation device 60 can reproduce and display the foot shape of the user 10 at a part corresponding to the predetermined part of the reference model 120 without necessarily performing a transformation process on the reference model 120.

[0047] The foot shape model presentation device 60 may store the individual geometric model 130 generated by the generation section 70 in an external database 90. The database 90 may be connected to the foot shape model presentation device 60 via the network 40.

[0048] Fig. 7 is a block diagram showing an example of the configuration of a foot shape model presentation system 100. The foot shape model presentation system 100 includes an integrated database 210, a first service database 220, a second service database 230, a third service database 240, a user terminal 260, and an administrator terminal 270. The integrated database 210 is a database server having mainly the functions of the foot shape model presentation device 60. The user terminal 260 and the administrator terminal 270 have mainly the functions of the information terminal 20. Although Fig. 7 shows the first to third service databases 220 to 240, the number of these is not limited to three, and may be two, or may be four or more.

[0049] The user terminal 260 is a terminal used mainly by a person such as the user 10 who provides foot shape data based on his / her own foot images. The first to third service databases 220-240 are database servers for providing management services for different foot shape data. The administrator terminal 270 is a terminal used by a person who manages and operates the first to third service databases 220-240, researchers, etc.

[0050] The user terminal 260 is connected to each of the first to third service databases 220-240 via a network or the like, and transmits foot shape data to one of the first to third service databases 220-240 depending on the service to be used. The first to third service databases 220-240 store foot shape data in different data formats. The administrator terminal 270 is connected to each of the first to third service databases 220-240 via a network or the like, and accesses the first to third service databases 220-240 depending on the form of the service to be provided.

[0051] The integrated database 210 is connected to each of the first to third service databases 220-240 via a network or the like, and stores normalized data (hereinafter referred to as "normalized data") such as individual shape models based on the foot shape data stored in each of the first to third service databases 220-240. The integrated database 210 also stores each normalized data in association with the original foot shape data stored in each of the first to third service databases 220-240.

[0052] The user terminal 260 and the administrator terminal 270 are connected to the integrated database 210 via a network or the like, and access the normalized data stored in the integrated database 210 as necessary. In addition, the user terminal 260 and the administrator terminal 270 access the original foot shape data stored in each of the first to third service databases 220 to 240 associated with each normalized data as necessary.

[0053] In this way, even if multiple services each manage foot shape data in a different data format, the foot shape model presentation system 100 can improve convenience by linking the database servers used for each service. Furthermore, the foot shape model presentation system 100 can use normalized data while taking advantage of the advantages of each service.

[0054] 8 is a functional block diagram showing a schematic configuration of a foot shape model presentation device 60A according to a modified example. The foot shape model presentation device 60A includes a communication unit 62, an acquisition unit 64, an extraction unit 66, a determination unit 74, a reference storage unit 68A, a generation unit 70A, and a presentation unit 72. Among the components of the foot shape model presentation device 60A, the determination unit 74, the reference storage unit 68A, and the generation unit 70A, which are different from the components of the foot shape model presentation device 60, will be described below.

[0055] The determining unit 74 determines the type of toe information extracted by the extracting unit 66. The types of toe information include, for example, an Egyptian type in which the first toe protrudes the furthest toward the toes, a Greek type in which the second toe protrudes the furthest toward the toes, and a square type in which the tips of the first and second toes are positioned approximately the same in the toe direction. The types of toe information may also include types such as hallux valgus and miniature toe varus.

[0056] The reference storage unit 68A stores a plurality of types of reference models each corresponding to a type of toe information. The generation unit 70A generates an individual shape model using the corresponding reference model stored in the reference storage unit 68A according to the type of toe information determined by the determination unit 74.

[0057] The above-described embodiment may be a program for causing a computer to realize the functions for implementing the above-described method, or a recording medium for storing the program. Such a recording medium for storing the program may be a non-transitory and tangible computer-readable storage medium, and may be a non-volatile memory, a magnetic recording medium such as a magnetic tape or a magnetic disk, or an optical recording medium such as an optical disk.

[0058] The embodiment has been described above. This embodiment is merely an example, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component and each processing process, and that such modifications are also within the scope of the present disclosure. Furthermore, the above-described embodiment can be generalized to obtain the following aspects.

[0059] [Aspect 1] An acquisition unit for acquiring an image of a user's foot shape; a reference storage unit that stores a reference model which is a three-dimensional model obtained by averaging a foot shape; an extraction unit that extracts shape information indicating characteristics of a predetermined part of the shape of the user's foot from the image; a generation unit that generates an individual shape model, which is a three-dimensional model that reproduces the foot shape of the user by transforming a shape of a portion of the reference model corresponding to the predetermined portion based on the shape information; a presentation unit that visualizes the individual shape model and presents it to the user; The foot shape model presentation device includes:

[0060] The foot shape model presentation device according to this embodiment generates an individual shape model that reproduces the user's foot shape by transforming the shape of a predetermined part in a reference model obtained by averaging the foot shape based on shape information indicating the characteristics of the predetermined part of the user's foot shape, and visualizes the individual shape model and presents it to the user. Therefore, the foot shape model presentation device according to this embodiment can visualize and present to the user an individual shape model that reflects the individuality of the user, for example, by setting the part of the foot shape that is likely to show differences in shape depending on the user as the predetermined part. As a result, according to this embodiment, a foot shape model that better reflects the characteristics of the user's foot can be presented, so that the user can be given the impression that the presented foot shape model reproduces his or her own foot well. As a result, for example, the user is more likely to feel attached to the presented foot shape model, which can lead to improved customer satisfaction and improved reliability of the presented results.

[0061] [Aspect 2] The shape information may be toe information defining an appearance of a toe region, The toe information may include at least one of the following information: toe width, toe length, toe direction, nail shape, toe appearance, toe spacing, and toe circumference around the MP joint. 2. The foot shape model presentation device according to embodiment 1.

[0062] According to this aspect, the external appearance characteristics of the toe region, which vary greatly from person to person, can be reflected in the individual shape model. Therefore, according to this aspect, a foot shape model that better reflects the user's foot characteristics can be presented, and the user can be given the impression that the presented foot shape model accurately reproduces his or her own foot.

[0063] [Aspect 3] The extraction unit may further extract foot size information including a foot length and a foot width from the image, The generation unit may deform an overall shape of the reference model so as to have a shape corresponding to the foot size information. 3. A foot shape model presentation device according to aspect 2.

[0064] According to this aspect, the overall shape of the individual shape model can be made to correspond to the foot size of the user. Therefore, according to this aspect, a foot shape model that more closely reflects the characteristics of the user's feet can be presented, and the user can be given the impression that the presented foot shape model accurately reproduces his or her own feet.

[0065] Aspect 4 The footwear may further include a determination unit for determining a type of the toe information, The reference storage unit may store a plurality of types of the reference models each corresponding to a type of the toe information, The generation unit may generate the individual shape model by using a corresponding reference model in accordance with the type of the toe information determined by the determination unit. 4. The foot shape model presentation device according to embodiment 2 or 3.

[0066] According to this aspect, an individual shape model is generated using a reference model corresponding to the determined type of toe information. Therefore, for example, by using a reference model having a highly correlated foot shape for each type of toe information, the individual shape model can be made to more closely resemble the user's foot shape. Therefore, according to this aspect, a foot shape model that more closely reflects the user's foot characteristics can be presented, giving the user the impression that the presented foot shape model accurately reproduces his or her own foot.

[0067] Aspect 5 The extraction unit may extract color information of at least a part of the user's foot from the image, The generation unit may generate the individual shape model by coloring, in a color based on the color information, at least a part of a three-dimensional model obtained by deforming a shape of a portion of the reference model corresponding to the predetermined portion based on the shape information. 5. A foot shape model presentation device according to any one of aspects 1 to 4.

[0068] According to this aspect, the color of the user's feet can be reflected in the individual shape model, and therefore, according to this aspect, a foot shape model that better reflects the characteristics of the user's feet can be presented, giving the user the impression that the presented foot shape model accurately reproduces his or her own feet.

[0069] Aspect 6 The extraction unit may extract a partial image of a region including at least a part of the predetermined region from the image, The generation unit may generate the individual shape model by pasting the partial image onto a surface of a portion of the reference model corresponding to the predetermined portion of a three-dimensional model obtained by deforming a shape of the portion of the reference model corresponding to the predetermined portion based on the shape information. 6. A foot shape model presentation device according to any one of aspects 1 to 5.

[0070] According to this aspect, a partial image of an area including at least a part of a predetermined part is attached to the surface of a part corresponding to the predetermined part in the reference model to generate an individual shape model. Therefore, the texture of the surface of the predetermined part of the user's foot can be reflected in the part corresponding to the predetermined part of the individual shape model. Therefore, according to this aspect, a foot shape model that better reflects the characteristics of the user's foot can be presented, and the user can be given the impression that the presented foot shape model accurately reproduces his or her own foot.

[0071] Aspect 7 acquiring an image of a user's foot shape; extracting shape information from the image that indicates characteristics of a predetermined portion of the user's foot shape; a step of generating an individual shape model, which is a three-dimensional model reproducing the user's foot shape, by transforming a shape of a portion corresponding to the predetermined portion in a reference model, which is a three-dimensional model obtained by averaging a foot shape, based on the shape information; visualizing and presenting the individual shape model to the user; The foot shape model presentation method includes:

[0072] According to the foot shape model presentation method of this aspect, the shape of a predetermined part of a reference model obtained by averaging a foot shape is transformed based on shape information indicating the characteristics of the predetermined part of the user's foot shape to generate an individual shape model that reproduces the user's foot shape, and the individual shape model is visualized and presented to the user. Therefore, according to the foot shape model presentation method of this aspect, for example, by setting a part of the foot shape that is likely to have different shapes depending on the user as the predetermined part, an individual shape model that reflects the individuality of the user can be visualized and presented to the user. As a result, according to this aspect, a foot shape model that better reflects the characteristics of the user's foot can be presented, and the user can be given the impression that the presented foot shape model reproduces his or her own foot well.

[0073] Aspect 8 A function to capture an image of the user's foot shape; A function of extracting shape information indicating characteristics of a predetermined part of the shape of the user's foot from the image; a function of generating an individual shape model, which is a three-dimensional model reproducing the user's foot shape by transforming a shape of a portion corresponding to the predetermined portion in a reference model, which is a three-dimensional model obtained by averaging a foot shape, based on the shape information; a function of visualizing the individual shape model and presenting it to the user; A program to make the above happen on a computer.

[0074] According to the program of this aspect, the shape of a predetermined part in a reference model in which the foot shape is averaged is transformed based on shape information indicating the characteristics of the predetermined part of the user's foot shape to generate an individual shape model that reproduces the user's foot shape, and the individual shape model is visualized and presented to the user. Therefore, according to the program of this aspect, for example, by setting a part of the foot shape that is likely to have different shapes depending on the user as the predetermined part, an individual shape model that reflects the individuality of the user can be visualized and presented to the user. As a result, according to this aspect, a foot shape model that better reflects the characteristics of the user's foot can be presented, and the user can be given the impression that the presented foot shape model reproduces his or her foot well. [Explanation of symbols]

[0075] 10 user, 30 presentation unit, 60 foot shape model presentation device, 64 acquisition unit, 66 extraction unit, 68 reference memory unit, 70 generation unit, 72 presentation unit, 74 determination unit, 102 toe area, 104 toe length, 106 toe width, 108 spacing between toes, 120 reference model, 130 individual shape model.

Claims

1. An acquisition unit for acquiring an image of a user's foot shape; a reference storage unit that stores a reference model which is a three-dimensional model obtained by averaging a foot shape; an extraction unit that extracts shape information indicating characteristics of a predetermined part of the shape of the user's foot from the image; a generation unit that generates an individual shape model, which is a three-dimensional model that reproduces the foot shape of the user by transforming a shape of a portion of the reference model corresponding to the predetermined portion based on the shape information; a presentation unit that visualizes the individual shape model and presents it to the user; The foot shape model presentation device includes:

2. the shape information is toe information defining an appearance of a toe region; The toe information includes at least one of the following information: toe width, toe length, toe direction, nail shape, toe appearance, toe spacing, and toe MP joint periphery.

2. A foot shape model presentation device according to claim 1.

3. The extraction unit further extracts foot size information including a foot length and a foot width from the image, The generation unit deforms an overall shape of the reference model so as to have a shape corresponding to the foot size information.

3. A foot shape model presentation device according to claim 2.

4. A determination unit for determining a type of the toe information is further provided, the reference storage unit stores a plurality of types of the reference models each corresponding to a type of the toe information; the generation unit generates the individual shape model by using a corresponding reference model in accordance with the type of the toe information determined by the determination unit.

3. A foot shape model presentation device according to claim 2.

5. The extraction unit extracts color information of at least a part of the user's foot from the image; the generation unit generates the individual shape model by coloring, in a color based on the color information, at least a part of a three-dimensional model obtained by deforming a shape of a portion of the reference model corresponding to the predetermined portion based on the shape information. The foot shape model presentation device according to claim 1 .

6. The extraction unit extracts a partial image of a region including at least a part of the predetermined portion from the image, the generating unit generates the individual shape model by attaching the partial image to a surface of a portion of the three-dimensional model corresponding to the predetermined portion, the three-dimensional model being obtained by deforming a shape of the portion of the three-dimensional model corresponding to the predetermined portion on the reference model based on the shape information. The foot shape model presentation device according to claim 1 .

7. acquiring an image of a user's foot shape; extracting shape information from the image that indicates characteristics of a predetermined portion of the user's foot shape; a step of generating an individual shape model, which is a three-dimensional model reproducing the user's foot shape, by transforming a shape of a portion corresponding to the predetermined portion in a reference model, which is a three-dimensional model obtained by averaging a foot shape, based on the shape information; visualizing and presenting the individual shape model to the user; The foot shape model presentation method includes:

8. A function to capture an image of the user's foot shape; A function of extracting shape information indicating characteristics of a predetermined part of the shape of the user's foot from the image; a function of generating an individual shape model, which is a three-dimensional model reproducing the user's foot shape by transforming a shape of a portion corresponding to the predetermined portion in a reference model, which is a three-dimensional model obtained by averaging a foot shape, based on the shape information; a function of visualizing the individual shape model and presenting it to the user; A program to make the above happen on a computer.

Images