Dimensioning system

By setting up a loading part and multiple marks on the size measurement tool, and combining 3D model construction and pressure sensors, the foot profile information is captured from multiple directions, the problem of low accuracy in the prior art is solved and high precision is achieved 3D object size measurement and 3D model construction.

CN112955931BActive Publication Date: 2024-11-05ZOZO INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980071239.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-03-29
Filing Date
2019-09-17
Publication Date
2024-11-05
Estimated Expiration
2039-09-17

AI Technical Summary

Technical Problem

The prior art requires the user to adjust the camera tilt when shooting the foot, and measure the foot in size based only on the image taken from above, resulting in insufficient accuracy and especially difficult to capture complex three-dimensional shapes.

Method used

A size measurement tool with a mounting portion and a plurality of marks around the periphery is used to capture the contour information of the subject by identifying marks from multiple directions, and the size of a three-dimensional object is accurately measured by combining 3D model construction and pressure sensor.

Benefits of technology

It realizes high-precision measurement of the size of three-dimensional objects and builds a high-precision 3D model, solving the problem of insufficient accuracy and providing a convenient user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112955931B_ABST
    Figure CN112955931B_ABST
Patent Text Reader

Abstract

A size measuring system for measuring the size of a user's foot is characterized in that it comprises: a size measuring tool, which is composed of a placing portion for a user to place his foot and a plurality of marks arranged around the placing portion; and a measuring terminal, which photographs a state in which the user places the foot on the placing portion of the size measuring tool in a manner capable of recognizing a plurality of marks from a plurality of directions, and calculates the size data of the foot based on the contour information of the foot obtained by photographing from various directions.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a dimension measuring system, and more particularly to a dimension measuring system for measuring the dimensions of a three-dimensional object, and more particularly to a dimension measuring system for capturing the three-dimensional shape of a foot and measuring the dimensions. Background Art

[0002] In recent years, due to the popularization of Internet technology, EC websites handle a wide variety of products, and their sales have continued to increase.

[0003] EC websites not only provide users with the convenience of ordering products on them using PCs, portable terminals, etc., and then receiving the delivered products at home without having to go to a physical store, but the number of users has also increased significantly.

[0004] Among the above EC websites, there are many websites dealing with clothing products such as clothes, hats and shoes, and the number of their users is approaching that of physical stores.

[0005] However, among the above-mentioned clothing products, especially shoes, there are many cases where they are selected and purchased only based on the length of the user's feet. When trying on the actually purchased shoes, the size does not fit the feet, resulting in many problems such as shoe friction, foot pain, and poor wearing feeling.

[0006] In this regard, users can get shoes that fit their feet by going to a specialty store or the like and asking a salesperson with professional knowledge to measure the size of their feet, or by having someone measure the size of their feet using a special measuring instrument to make so-called custom-made shoes.

[0007] However, in addition to the need for users to go to a store and have their feet measured, custom-made shoes take time to make and are more expensive than commercially available shoes, placing a greater burden on users.

[0008] Therefore, Patent Document 1 discloses a technology that allows a user to easily measure the size of his or her feet by photographing his or her feet without going to a store.

[0009] The invention disclosed in Patent Document 1 is a method as follows: it includes a portable information device, which has a camera, a tilt sensor, and a processing unit. Through the processing unit, a foot position guide image representing an area where the foot is placed, namely, a foot configuration area, is overlapped with an image captured by the camera, namely, a camera image. By utilizing the tilt sensor, the tilt of the camera relative to a specified plane is detected. When the tilt of the camera is below a specified tilt threshold, a still image including a foot placed on the plane in the foot configuration area and a reference object representing a specified shape and size and placed on the plane is captured by the camera to generate image data, and the size of the foot is calculated based on the reference object and the area of ​​the foot in the image data.

[0010] Prior Art Literature

[0011] Patent Literature

[0012] Patent Document 1: Japanese Patent Application Publication No. 2007-267996 Summary of the invention

[0013] Technical problem to be solved by the invention

[0014] However, the invention described in Patent Document 1 requires the user to adjust the tilt of the camera when photographing the foot, which takes time. In addition, the size of the foot is measured only based on an image of the foot taken from above, so there is a problem of insufficient accuracy in capturing the complex shape of the foot.

[0015] The present invention is made in view of the above-mentioned problems, and its object is to provide a dimensional measuring system that can measure the size of a three-dimensional object (for example, a foot) with high precision by photographing the three-dimensional object placed on a dimensional measuring tool for measuring the size of the three-dimensional object.

[0016] Another object of the present invention is to construct a 3D (three-dimensional) model that reflects the dimensions of a three-dimensional object with high accuracy in order to measure the dimensions of the three-dimensional object with high accuracy.

[0017] Solutions for solving technical problems

[0018] In order to achieve the above-mentioned purpose, the size measuring system of the present invention is used to measure the size of a subject, and is characterized in that it comprises: a size measuring tool, which is composed of a carrying portion for carrying the subject and a plurality of marks arranged around the carrying portion; a measuring terminal, which photographs the state in which the subject is carried on the carrying portion of the size measuring tool in a manner that can identify the plurality of marks from multiple directions, and calculates the size data of the subject based on the contour information of the subject obtained by photographing from various directions.

[0019] In addition, the dimension measuring system of the present invention is characterized in that the dimension measuring tool is formed in a sheet shape, the placement portion is arranged substantially in the center of the sheet, and the plurality of marks are arranged around the placement portion.

[0020] Furthermore, the dimension measuring system of the present invention is characterized in that the dimension measuring tool is provided with a unique mark for determining a photographing direction at a predetermined position, and the measuring terminal determines the photographing direction by photographing the unique mark.

[0021] In addition, the dimension measuring system of the present invention is characterized in that it also has an enterprise terminal for operation by a provider of the dimension measuring tool to the user, the enterprise terminal stores marking data representing the shape and coordinates of a mark displayed on the dimension measuring tool, and based on the marking data, measuring tool data for determining the position of the mark arranged on the dimension measuring tool is generated, and the dimension measuring tool is generated based on the measuring tool data.

[0022] Furthermore, the dimension measuring system of the present invention is characterized in that a pressure sensor for measuring the shape and weight distribution of the back side of the object is provided in the placing portion.

[0023] Furthermore, the dimension measuring system of the present invention is characterized in that the subject to be measured is a foot.

[0024] In addition, the size measurement system of the present invention is characterized in that it also has a management server, which is connected to the measurement terminal via a network and stores a database for managing product data representing the size of each shoe product for multiple shoe products that can be worn by the user. The measurement terminal sends the calculated foot size data to the management server, and the management server refers to the database, compares the foot size data with the sizes of multiple products represented by the product data, extracts the product data of products with sizes consistent with or similar to the user's foot size data, and sends it to the measurement terminal.

[0025] The present invention provides, for example, the following items.

[0026] (Item 1)

[0027] A computer system for determining the dimensions of a three-dimensional object, wherein:

[0028] The computer system comprises:

[0029] a receiving unit that receives an image of a three-dimensional object, the image being an image of the three-dimensional object and the plurality of marks placed on a dimension measuring tool having a plurality of marks, the plurality of marks being unique marks contained in the dimension measuring tool; and

[0030] The 3D model construction unit constructs the 3D model of the three-dimensional object by deforming the default 3D model based on the default 3D model and the received image.

[0031] (Item 2)

[0032] The computer system according to item 1, wherein:

[0033] The 3D model construction unit constructs a 3D model of the three-dimensional object by deforming the default 3D model based on the outline of the default 3D model in the virtual image obtained from the default 3D model and the outline of the three-dimensional object in the received image.

[0034] (Item 3)

[0035] A computer system according to item 1 or item 2, wherein:

[0036] The computer system further comprises:

[0037] A measuring unit, which measures the dimensions in the 3D model; and

[0038] A conversion unit converts the measured size into an actual size,

[0039] The default 3D model is deformed in a virtual three-dimensional space having a predetermined scale relative to the actual three-dimensional space.

[0040] The conversion unit converts the measured size into an actual size using the scale.

[0041] (Item 4)

[0042] A computer system according to item 3, wherein:

[0043] The scale between the virtual three-dimensional space and the actual three-dimensional space is predetermined based on the ratio of the size of the multiple marks of the sizing tool in the virtual three-dimensional space to the size of the multiple marks of the sizing tool in the actual three-dimensional space.

[0044] (Item 5)

[0045] The computer system according to any one of items 1 to 4, wherein:

[0046] The computer system further includes a photographing unit for photographing the three-dimensional object.

[0047] The receiving unit receives the image from the photographing unit,

[0048] The imaging unit is configured to capture an image of the three-dimensional object in response to a key marker among the plurality of markers and the three-dimensional object entering a field of view of the imaging unit.

[0049] (Item 6)

[0050] A computer system according to item 5, wherein:

[0051] The imaging unit is configured to capture an image of the three-dimensional object at least from directly above.

[0052] (Item 7)

[0053] The computer system according to any one of items 1 to 6, wherein:

[0054] The plurality of marks have distinguishing elements, and the distinguishing elements are a plurality of dots arranged in a unique pattern.

[0055] (Item 8)

[0056] The computer system according to any one of items 1 to 7, wherein:

[0057] The three-dimensional object is a foot.

[0058] (Item 9)

[0059] A dimension measuring tool for measuring the dimension of a three-dimensional object, wherein:

[0060] The size measuring tool comprises:

[0061] a mounting portion for mounting the three-dimensional object; and

[0062] a plurality of marks arranged around the mounting portion,

[0063] The plurality of markings include markings that are unique within the sizing tool.

[0064] (Item 10)

[0065] The dimension measuring tool according to item 9, wherein:

[0066] The plurality of marks include at least one key mark that defines a direction in which a three-dimensional object placed on the placement portion is photographed.

[0067] (Item 11)

[0068] The dimension measuring tool according to item 9 or item 10, wherein:

[0069] The plurality of marks have distinguishing elements, and the distinguishing elements are a plurality of dots arranged in a unique pattern.

[0070] (Item 12)

[0071] The dimension measuring tool according to any one of items 9 to 11, wherein

[0072] The size measuring tool is formed in a sheet shape.

[0073] (Item 13)

[0074] A size measurement system, comprising:

[0075] A computer system as set out in any one of items 1 to 8; and

[0076] The dimension measuring tool according to any one of items 9 to 12.

[0077] (Item 14)

[0078] A procedure for determining the dimensions of a three-dimensional object, wherein:

[0079] The program is executed in a computer system having a processor, and the program causes the processor to perform the following processing, the processing comprising:

[0080] receiving an image of a three-dimensional object, the image being an image of the three-dimensional object and the plurality of marks placed on a sizing tool having a plurality of marks, the plurality of marks being unique marks contained in the sizing tool; and

[0081] Based on the received contour of the three-dimensional object within the image, a 3D model of the three-dimensional object is constructed by deforming a default 3D model.

[0082] (Item 15)

[0083] A method for determining the size of a three-dimensional object, comprising:

[0084] receiving an image of a three-dimensional object, the image being an image of the three-dimensional object and the plurality of marks placed on a sizing tool having a plurality of marks, the plurality of marks being unique marks contained in the sizing tool; and

[0085] Based on the received contour of the three-dimensional object within the image, a 3D model of the three-dimensional object is constructed by deforming a default 3D model.

[0086] (Item 16)

[0087] A size measuring system for measuring the size of a three-dimensional object, characterized by having:

[0088] A dimension measuring tool, comprising a placing portion for placing a three-dimensional object and a plurality of marks arranged around the placing portion; and

[0089] The measuring terminal photographs a state where the three-dimensional object is placed on the placing portion of the size measuring tool in a manner that allows identification of multiple marks from multiple directions, and calculates size data of the three-dimensional object based on contour information of the three-dimensional object photographed from each direction.

[0090] (Item 17)

[0091] The dimension measuring system according to item 16 is characterized in that

[0092] The dimension measuring tool is formed in a sheet shape, the placing portion is arranged substantially in the center of the sheet, and the plurality of marks are arranged around the placing portion.

[0093] (Item 18)

[0094] The dimension measuring system according to item 16 or 17 is characterized in that

[0095] The dimension measuring tool has a unique mark for determining a photographing direction arranged at a predetermined position, and the measuring terminal determines the photographing direction by photographing the unique mark.

[0096] (Item 19)

[0097] The dimension measuring system according to any one of items 16 to 18, characterized in that

[0098] The dimension measuring system further includes a business terminal operated by a provider who provides the dimension measuring tool to the user.

[0099] The business operator terminal stores mark data indicating the shape and coordinates of a mark to be displayed on the sizing tool, and generates measuring tool data based on the mark data, wherein the measuring tool data is used to determine the position of the mark arranged on the sizing tool.

[0100] The size measuring tool is generated based on the measuring tool data.

[0101] (Item 20)

[0102] The dimension measuring system according to any one of items 16 to 19, characterized in that

[0103] The placing portion is provided with a pressure sensor for measuring the shape and weight distribution of the back side of the three-dimensional object.

[0104] (Item 21)

[0105] The dimension measuring system according to any one of items 16 to 20, characterized in that

[0106] The three-dimensional object is a foot.

[0107] (Item 22)

[0108] The dimension measuring system according to item 21 is characterized in that

[0109] The size measurement system further includes a management server connected to the measurement terminal via a network and storing a database for managing product data indicating the size of each of a plurality of shoe products that can be worn by a user.

[0110] The measuring terminal sends the calculated size data of the foot to the management server.

[0111] The management server refers to the database, compares the foot size data with the sizes of multiple products represented by the product data, extracts product data of products with sizes that are consistent with or similar to the user's foot size data, and sends the data to the measurement terminal.

[0112] (Item 23)

[0113] A computer system for determining the dimensions of a three-dimensional object, wherein:

[0114] The computer system comprises:

[0115] A receiving unit receives an image of a three-dimensional object, wherein the image is an image obtained by photographing the three-dimensional object and a plurality of markers, wherein the plurality of markers include a unique marker; and

[0116] The 3D model construction unit constructs the 3D model of the three-dimensional object by deforming a default 3D model based on the received image.

[0117] Effects of the Invention

[0118] As described above, according to the present invention, it is possible to provide a dimension measuring system capable of easily and accurately measuring the dimensions of a three-dimensional object by imaging from multiple directions.

[0119] Furthermore, according to the present invention, it is also possible to construct a 3D model that reflects the dimensions of a three-dimensional object with high accuracy in order to measure the three-dimensional object with high accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0120] Figure 1 It is a diagram showing the structure of a sizing system.

[0121] Figure 2 It is a figure which shows the structure of a dimension measuring tool.

[0122] Figure 3 This is a diagram showing another structure of the dimension measuring tool.

[0123] Figure 4A This is a diagram showing the structure of a measurement terminal.

[0124] Figure 4B It is a diagram showing an example of the configuration of the control unit 21 .

[0125] Figure 5 It is a diagram showing data and the like stored in the information storage unit 22 of the measurement terminal 20 .

[0126] Figure 6 This is a diagram showing an example of the data structure of the tag DB 221.

[0127] Figure 7 It is a diagram showing the structure of the enterprise terminal 30.

[0128] Figure 8 This is a diagram showing data and the like stored in the information storage unit 32 of the entrepreneur terminal 30 .

[0129] Fig. 9 2 is a diagram showing the configuration of the product data management server 40 .

[0130] Fig.10 This is a diagram showing data and the like stored in the information storage unit 42 of the product data management server 40 .

[0131] Fig.11 This is a diagram showing an example of the data structure of the product DB.

[0132] Fig.12 This is a flowchart showing the flow of manufacturing a sizing tool.

[0133] Fig.13A This is a flowchart showing a method for measuring the size of a user's foot.

[0134] Fig. 13B This is a flowchart showing an example of a process for measuring the size of a user's foot.

[0135] Fig. 13C This is a flowchart showing an example of the process of constructing a 3D model by the 3D model constructing unit 211 in step S302 .

[0136] Fig.14 This is a diagram showing a state in which a user places his foot on the placing portion of the size measuring tool.

[0137] Fig.15 This is a diagram showing the direction in which images are taken by the measuring terminal.

[0138] Fig.16 This is a diagram showing an example of foot model data.

[0139] Fig.17 This is a diagram showing an example of measurement results displayed on the measurement terminal. DETAILED DESCRIPTION

[0140] Next, a dimension measuring system according to the present embodiment will be described with reference to the drawings.

[0141] Figure 1 It is a diagram showing the structure of a sizing system.

[0142] As shown in the figure, the size measurement system includes: a size measurement tool 10 placed on the user's foot in order to measure the size of the user's foot; and a measurement terminal 20 for measuring the size of the foot by photographing the state of the foot placed when the user places the foot on the size measurement tool 10. The size measurement system may also include: an enterprise terminal 30 operated by a provider of the size measurement tool 10; and a product data management server 40 that stores a database of product data including size information of footwear desired by the user. The terminal device 20, the enterprise terminal 30, and the data management server 40 are respectively connected to a network 100 and can communicate with each other via the network 100.

[0143] <Dimension measuring tool 10>

[0144] Figure 2 FIG. 1 is a diagram showing the structure of a dimension measuring tool 10 according to one embodiment. Figure 3 This is a diagram showing the structure of a dimension measuring tool 10 ′ according to another embodiment.

[0145] As shown in the figure, the size measuring tool 10, 10' is formed into a substantially rectangular sheet or mat shape that can be placed on the floor, ground, etc., and is made of paper, cloth, or a material that can be processed into a sheet shape. A substantially rectangular placement portion 11 for the user to place his feet is displayed (or printed) in the substantially central portion of the surface of the sheet, and a plurality of identifiable marks 12 arranged in a grid around the placement portion 11 are arranged.

[0146] It should be noted that the shape of the main body of the dimension measuring device 10 is not limited to a substantially rectangular shape, and may be a substantially polygonal shape or a substantially circular shape.

[0147] The placing portion 11 is formed in a substantially rectangular shape as described above, and has a length and width sufficient to accommodate a normal foot size (about 29.0 cm). The placing portion 11 is formed in a color other than skin color to facilitate identification of the boundary with the placed foot.

[0148] The shape, size, surface pattern, color, material, etc. of the mark 12 are not particularly limited, and various structures can be applied. The plurality of marks 12 may be non-unique marks in the sizing tool 10, or may be unique marks in the sizing tool 10 as described below.

[0149] In addition, the marks 12 can be used to distinguish each mark 12 by making the shape, size, surface pattern (pattern), color, material, etc. different between each mark 12. Hereinafter, each element used to distinguish such a mark 12 is referred to as a "discrimination element". Each mark 12 has a different discrimination element, so that each mark 12 becomes unique in the size measuring tool 10.

[0150] The measuring terminal 20 reads the distinguishing elements of these marks 12 by optical reading, etc., thereby distinguishing each mark 12. The distinguishing elements can be any elements as long as they can be identified in image processing. The distinguishing elements can be, for example, multiple points arranged in a unique pattern in each mark, or colors arranged in each mark (for example, in the case of color matching of the entire surface of the mark, including the case where multiple colors are arranged in each area of ​​the mark and a unique mark is formed as a whole). In the present invention, the preferred distinguishing elements can be multiple points arranged in a unique pattern in each mark. The points in the mark can have a maximum size of about 5% to 15% of the maximum size of the mark. For example, in the case where the multiple marks 12 are circles with a diameter of about 20 mm, the points can be circles with a diameter of about 1 mm to about 3 mm. By changing the number and position of the points, the unique pattern of the points can be infinitely expanded, so it is easy to increase or decrease the number of multiple marks 12 on the size measuring tool 10. As a result, the size measuring tool 10 can be easily expanded or reduced.

[0151] The user places his or her foot on the placing portion 11 of the size measuring tool 10, and the measurement terminal 20 captures the placed state from multiple directions including the mark 12, thereby measuring the size of the foot (length or width, instep height).

[0152] in addition, Figure 3 The dimension measuring tool 10' of another embodiment shown in the figure includes a pressure sensor 11a and a communication unit 13, and Figure 2 The dimension measuring tool 10 of the embodiment shown is the same. Figure 3 As shown, an elastic body (not shown) made of elastic material such as rubber or resin and capable of elastic deformation in the thickness direction and a pressure sensor 11a connected to the elastic body are provided on the placement part 11 included in the size measuring tool 10. When the user places his foot on the elastic body, the pressure sensor 11a detects the depression of the placement part, thereby measuring the shape of the user's foot and the weight applied, and the measurement result can be sent from the communication part 13 to the measurement terminal 10. The communication part 13 can communicate by wire or by wireless. For example, the communication part 13 can perform short-range wireless communication such as Bluetooth (registered trademark) and Wi-Fi.

[0153] In the following description, an example using the sizing tool 10 is described, but it is obvious that the sizing tool 10 ′ can also be used in the same manner.

[0154] <Measurement Terminal 20>

[0155] Next, the configuration of the measurement terminal 20 will be described with reference to FIG. 4 .

[0156] FIG. 4 is a diagram showing the configuration of the measurement terminal 20 .

[0157] The measurement terminal 20 is an information processing device that is operated when measuring the size of the user's foot.

[0158] For example, the measurement terminal 20 is a portable information processing device such as a smartphone, a tablet terminal, a wearable terminal, a mobile phone, a PDA, a PHS, or a PC.

[0159] The user places his / her foot on the placing portion 11 of the size measuring tool 10, and takes a picture of the placed state using the measuring terminal 20. At this time, the user takes pictures of his / her foot from multiple directions in a manner such that the multiple marks 12 are reflected. Thus, the measuring terminal 10 can grasp the shooting position of the measuring terminal 10 when shooting from multiple directions by recognizing the multiple marks 12 respectively, and can measure the size of the user's foot by combining the shooting position with the captured image.

[0160] Furthermore, the measurement terminal 20 uses a communication function to communicate with the product data management server 40 via the network, and can search for footwear products that match the foot size based on the measured foot size of the user.

[0161] As shown in Figure 4, the measurement terminal 20 has the following structure: a control unit 21 composed of a CPU and the like and controls the entire measurement terminal 20; an information storage unit 22 that stores various information; a communication unit 23 that communicates with the product data management server 40 via the network 100; a display unit 24 that displays various information; an operation unit 25 that includes various buttons and the like and is used for inputting information; and a shooting unit 26 that includes a camera and the like and inputs images.

[0162] The display unit 24 and the operation unit 25 may be integrally formed to form a touch panel. Each unit 21 to 26 is connected to an internal bus, and various information is input and output via the bus, and various processes are executed under the control of the control unit 21 .

[0163] The control unit 21 is a processing unit that controls the entire measurement terminal 20, and is composed of, for example, electronic circuits such as a CPU (Central Processing Unit) and integrated circuits such as an FPGA (Field-Programmable Gate Array). The control unit 21 reads information from the information storage unit 22 and writes information to the information storage unit 22.

[0164] The information storage unit 22 is a device for storing information such as a hard disk, a memory, or a semiconductor element. The information storage unit 22 has a function of storing programs (for example, Fig.13A , Fig. 13B , Fig. 13C An area (program for at least a part of the processing shown) used temporarily when the control unit 21 executes the processing, etc. (RAM, etc.).

[0165] The control unit 21 reads out the program (three-dimensional reconstruction algorithm, optimization algorithm, bundle adjustment algorithm, etc.) stored in the information storage unit 22, and develops it in the work area to execute various processes.

[0166] The information storage unit 22 stores the mark data DB indicating the arrangement position of the mark 12 displayed on the size measuring tool 10. The information storage unit 22 may also store the foot model data indicating the foot model in general. The mark data and the foot model DB are generated by the business terminal 30 as described below.

[0167] The information storage unit 22 can store data for constructing a 3D model, for example, generated by the 3D model construction unit 211 described later. The data for constructing a 3D model can be data for expressing a 3D model known in the art. The data can be, for example, polygon data representing each vertex of the 3D model. That is, the outline of the 3D model can be represented by a plurality of vertices. Alternatively, the outline of the 3D model can be represented by a straight line or curve or a plane or a curved surface passing through a plurality of vertices.

[0168] In addition, the information storage unit 22 can store data for constructing a default 3D model. The default 3D model is a 3D model that serves as a basis when constructing a 3D model of an object. The default 3D model preferably has a shape that roughly simulates the shape of the object. As a result, the process of constructing a 3D model based on the 3D model construction unit 211 described later becomes easy to converge. For example, in the case of constructing a 3D model of a user's foot, the default 3D model that serves as a basis can, for example, select a different model for each user who serves as the object, or it can be constant for each user. In the case where the default 3D model that serves as a basis is constant for each user, the default 3D model can, for example, be constructed as a model with a foot length of approximately 25 cm.

[0169] The data used to construct the default 3D model can be data for representing a 3D model known in the art. The data can be, for example, polygon data representing each vertex of the 3D model. That is, the outline of the default 3D model can be represented by a plurality of vertices. Alternatively, the outline of the default 3D model can be represented by a curve or a curved surface passing through a plurality of vertices.

[0170] The communication unit 23 is an interface for controlling communication with the product data management server 40 via the network 100 , and includes a LAN adapter and the like.

[0171] The communication unit 23 may include a wireless transceiver and be connected to a LAN, the Internet, or the like via wireless communication, or may be connected via a wired connection such as a cable.

[0172] The display unit 24 is a display device such as a display or a lamp.

[0173] The control unit 21 reads an image from the information storage unit 22, executes image output processing to generate screen information, and executes image output processing on the image information received by the communication unit 23 from the product data management server 40 to generate screen information.

[0174] Furthermore, the control unit 21 outputs the generated image information to the display unit 24, and the display unit 24 displays the input image information on a screen of a display or the like.

[0175] Furthermore, the control unit 21 may output a control signal to the display unit 24 to light up a lamp included in the display unit 24 .

[0176] The operation unit 25 includes, for example, an information input device including various keys, and provides a pointing device in cooperation with the display unit 24. The operation unit 25 receives various operations performed by a user and outputs a signal indicating the contents of the operation to the control unit 21 and the like.

[0177] When a signal indicating the operation content is input, the control unit 21 outputs a control signal to the display unit 24 to instruct the display unit 24 to display a screen corresponding to the operation content, according to the content of the signal.

[0178] When the control signal is input, the display unit 24 performs screen display according to the control signal.

[0179] It should be noted that the display unit 24 and the operation unit 25 may be integrated into one body to form a touch panel.

[0180] The imaging unit 26 includes a camera capable of capturing still images and moving images. The user can capture a state where the foot is placed on the placing unit 11 of the sizing tool 10 by using the imaging unit 26. For example, the user sets the imaging unit 26 to a moving image mode capable of capturing a moving image, and can capture a moving image of the foot placed on the placing unit 11 of the sizing tool 10 from multiple directions in a manner that multiple marks are projected for several seconds.

[0181] The shooting unit 26 inputs the image data of the dynamic image shooting to the control unit 21. The frame rate of the image data can be any frame rate such as 10fps, 20fps, 30fps, 60fps, etc. The control unit 21 can, for example, select the best shooting frame data from the multiple frame data of the image data shot in each multiple directions. For example, the control unit 21 can select the frame data with the least shaking from the multiple frame data. For example, the control unit 21 can select the frame data with the most consistent focus from the multiple frame data.

[0182] Next, the control unit 21 recognizes the images of the plurality of marks 12 arranged on the dimension measuring tool 10 from the selected frame data, and recognizes which mark 12 is located at which position in the plane space indicated by the frame data.

[0183] In addition, the control unit 21 recognizes the outline of the size measuring tool 10 (the boundary with the background) and the outline of the foot placed on the placing unit 11 (the boundary between the placing unit 11 and the foot) in the frame data in addition to the image of the mark 12. It should be noted that the image recognition method by the control unit 21 may be, for example, a recognition method based on a conventional general optical reading method or other image recognition method.

[0184] The control unit 21 calculates the posture information (angles in each shooting direction of yaw, pitch, and roll) and distance information of the measurement terminal 20 using the principle of triangulation based on the recognition of each marker 12 and the plane coordinates of the plane space.

[0185] Furthermore, the control unit 21 extracts local contour data of each foot from the frame data from each direction, and generates contour data of the foot constituting the entire foot based on the posture information and distance information of the measurement terminal 20 and the local contour data.

[0186] Furthermore, the control unit 21 calculates optimal foot size measurement data by combining the outline data with foot model data described later.

[0187] In another example, when the control unit 21 receives an image of the user's foot on the size measuring tool 10 from the imaging unit 26, it generates contour data based on the received image, and can construct a 3D model (foot model) of the user's foot based on the contour data. The control unit 21 can calculate the foot size measurement data by measuring the size on the 3D model.

[0188] Figure 4B It is a diagram showing an example of the configuration of the control unit 21 in this example.

[0189] The control unit 21 includes at least a 3D model building unit 211 .

[0190] The 3D model construction unit 211 receives an image captured by the imaging unit 26 and constructs a 3D model based on the received image. The 3D model construction unit 211 can construct a 3D model of the user by, for example, deforming a default 3D model based on the received image.

[0191] In one example, the 3D model construction unit 211 obtains a two-dimensional virtual image from the default 3D model, and can deform the default 3D model based on the outline of the default 3D model on the virtual image obtained from the default 3D model and the outline of the foot on the received image. The virtual image is an image of the default 3D model virtually photographed from multiple directions. The shooting direction of the virtual image can be the same direction as the shooting direction of the image based on the measurement terminal 20, and the shooting position of the virtual image can be the same position as the shooting position of the image based on the measurement terminal 20. Thus, the outline of the default 3D model on the virtual image and the outline of the foot on the received image can be compared. The shooting direction and shooting position based on the measurement terminal 20 can be calculated using the principle of triangulation based on the plane coordinates of the plane space of each marker 12 recognized in the frame data.

[0192] The 3D model construction unit 211 calculates, for example, the deviation between the outline of the default 3D model on the virtual image and the outline of the foot on the received image, and deforms the default 3D model based on the default 3D model in such a way that the calculated deviation is minimized. For example, the 3D model construction unit 211 calculates the deviation between the multiple vertices representing the outline of the default 3D model on the virtual image and the multiple vertices representing the outline of the foot on the received image, determines the positions of the vertices on the default 3D model on the virtual image that minimize the calculated deviation, and moves the vertices of the basic default 3D model in such a way that the positions become the determined positions. The 3D model constructed based on the default 3D model in such a way that the deviation between the outline of the default 3D model on the virtual image taken from multiple directions and the outline of the foot on the image actually taken from multiple directions becomes the user's 3D model. Here, the deviation does not need to be completely zero, and can be set to a specific minimum value (for example, a fixed value or a value below a predetermined threshold). The 3D model construction unit 211 can derive a deformation that minimizes the calculated deviation by any method. For example, using the least squares method, it is possible to derive a deformation that minimizes the calculated deviation.

[0193] The deformation of the default 3D model based on the 3D model construction unit 211 can be performed in the virtual three-dimensional space. The virtual three-dimensional space is a space in which the actual three-dimensional space is enlarged or reduced at a predetermined scale. By performing deformation in the virtual three-dimensional space, the scale does not change before and after the deformation, and the size in the actual three-dimensional space can be easily calculated using the deformed 3D model and the scale.

[0194] The scale between the virtual three-dimensional space and the actual three-dimensional space is predetermined based on, for example, the ratio of the size of the multiple marks 12 of the sizing tool 10 in the virtual three-dimensional space to the size of the multiple marks 12 on the sizing tool 10 in the actual three-dimensional space. For example, when the size of the multiple marks 12 of the sizing tool 10 in the virtual three-dimensional space is X and the size of the multiple marks 12 on the sizing tool 10 in the actual three-dimensional space is Y, the scale is determined to be X:Y.

[0195] The control unit 21 may further include a measuring unit 212 and a converting unit 213 .

[0196] The measuring unit 212 is configured to measure the dimensions in the 3D model of the user constructed by the 3D model construction unit 211. The dimensions measured by the measuring unit 212 are dimensions in a virtual three-dimensional space. The measuring unit 212 can measure the dimensions of the 3D model using a known method. For example, the measuring unit 212 cuts the 3D model into two-dimensional sections, and measures the dimensions in the two-dimensional sections of the part of the measurement object, thereby determining the dimensions of the measurement object part. For example, in the case of measuring the length of the foot, the length between the heel and the toe is measured in a two-dimensional longitudinal section passing through the heel and the toe, thereby measuring the length of the foot. For example, in the case of measuring the circumference of the foot, the circumference is measured in a two-dimensional transverse section passing through the base of the thumb and the base of the little finger, thereby measuring the circumference of the foot.

[0197] The conversion unit 213 is configured to convert the size measured by the measurement unit 212 into the actual size of the foot. As described above, the size measured by the measurement unit 212 is a size in the virtual three-dimensional space, and therefore needs to be converted into a size in the actual three-dimensional space by the conversion unit 212. The conversion unit 213 converts the size in the virtual three-dimensional space into the size in the actual three-dimensional space, for example, using a scale between the virtual three-dimensional space and the actual three-dimensional space.

[0198] The control unit 21 calculates measured dimension data indicating the dimensions of a predetermined part of the user's foot based on the actual dimensions in the three-dimensional space output by the conversion unit 213 .

[0199] The control unit 21 can output the calculated foot size measurement data to the display unit 24 and display the data on the display unit 24 .

[0200] The user can check the displayed foot size measurement data and refer to it when purchasing shoes that match the user's foot size.

[0201] The measurement terminal 20 can receive screen information, such as a Web page, from the product data management server 40 functioning as a Web server and display the information.

[0202] The measurement terminal 20 has a function in which the control unit 21 generates and transmits an HTTP (Hyper Text Transfer Protocol) request in response to a user's request and a function in which the control unit 21 interprets an HTTP response (an example of a response) and presents it to the user.

[0203] For example, the information storage unit 22 stores a web browser as an example. Furthermore, the control unit 21 interprets the HTTP response to generate image data and voice data, and displays the HTTP response on the display unit 24 or outputs voice from the speaker of the measurement terminal 20, thereby presenting the HTTP response to the user.

[0204] When the communication unit 23 sends measurement data representing the size of the user's foot to the product data management server 40, the product data management server 40 extracts data (product data) of products that match the foot size represented by the measurement data from the database (product DB421), and sends screen information containing the product data, i.e., product retrieval result information (web page, etc.), to the measurement terminal 20.

[0205] When the communication unit 23 of the measurement terminal 20 receives the product search result information from the product data management server 40, it displays it on the display unit 24. The user can easily obtain product information of shoes that match the size of his or her feet by observing the content of the displayed product search result information, thereby making it easier to select products to be purchased.

[0206] When the product search result information is a web page of an EC website, the user can directly purchase the product on the EC website by operating the operation unit 25 and designating a predetermined area of ​​the product search result information displayed on the display unit 24 (clicking a button, etc.).

[0207] Figure 5 It is a diagram showing data and the like stored in the information storage unit 22 of the measurement terminal 20 .

[0208] The information storage unit 22 stores a mark DB 221 that manages identification elements such as the shape of each mark 12. As shown in the figure, the information storage unit 22 may store a foot model DB 222 indicating a plurality of sizes.

[0209] Figure 6 This is a diagram showing an example of the data structure of the tag DB 221.

[0210] As shown in the figure, the mark DB 221 manages text data or image data representing the shape, size, surface pattern (pattern), color, material, etc. of the mark 12 for each mark. In addition, a key mark is determined among the multiple marks 12 to define the direction from which the measurement terminal 20 is photographed.

[0211] The control unit 21 of the measurement terminal 20 can recognize the image of the captured mark 12 and identify it by referring to the mark DB 221. In addition, the control unit 21 of the measurement terminal 20 can recognize the captured key mark and identify the capturing direction.

[0212] The foot model DB 222 is data of a foot model that generally represents the shape of a foot model, and is a three-dimensional model that represents the surface of the foot. The foot model data is data prepared with various three-dimensional models based on the differences in the length, width, and instep height of the foot, and the control unit 21 of the measurement terminal 20 can combine the contour data with the approximate foot model data to calculate the foot size measurement data.

[0213] In another example, the foot model DB 222 may include data for constructing a 3D model of the user's foot and data for constructing a default 3D model.

[0214] <Entrepreneur Terminal 30>

[0215] The business operator terminal 30 is an information processing device operated by a providing business operator who provides the dimensional measuring tool 10 to the user.

[0216] For example, the business operator terminal 30 is an information processing device such as a PC, a tablet terminal, a smart phone, a wearable terminal, a mobile phone, a PDA, or a PHS. The business operator terminal 30 sets the arrangement position of the mark 12 of the dimension measuring tool 10 and generates the measuring tool data. Then, the measuring tool data in which the arrangement position of the mark 12 is set is generated.

[0217] The enterprise terminal 30 generates the sizing tool 10 based on the measuring tool data including the three-dimensional coordinates of the virtual point group displayed by the sizing tool 10. However, the generation method is not particularly limited and a conventional technique may be used.

[0218] Figure 7 It is a diagram showing the structure of the enterprise terminal 30.

[0219] As shown in the figure, the entrepreneur terminal 30 has: a control unit 31 which is composed of a CPU and controls the entire entrepreneur terminal 30; an information storage unit 32 which stores various information; a communication unit 33 which performs communication processing; a display unit 34 which displays various information; and an operation unit 35 which includes various buttons and is used for inputting information.

[0220] In addition, the display unit 34 and the operation unit 35 may be integrally formed to constitute a touch panel.

[0221] Furthermore, each of the units 31 to 35 is connected to an internal bus, and various information and the like are input and output via the bus, and various processes are executed under the control of the control unit 31 .

[0222] The control unit 31 is a processing unit that controls the entire enterprise terminal 30 , and is composed of, for example, an electronic circuit such as a CPU (Central Processing Unit) or an integrated circuit such as an FPGA (Field-Programmable Gate Array).

[0223] The control unit 31 reads information from the information storage unit 32 and writes information to the information storage unit 32 .

[0224] The information storage unit 32 is a device for storing information, such as a hard disk, a memory, or a semiconductor element.

[0225] The information storage unit 32 includes an area for storing programs executed by the control unit 31 , a work area temporarily used when the control unit 31 executes a process, and the like (RAM, etc.).

[0226] The control unit 31 reads out the program stored in the information storage unit 32 , develops it in a work area, and executes various processes.

[0227] The communication unit 33 is an interface for controlling communication, and includes a LAN adapter, etc. The communication unit 33 may include a wireless transceiver and be connected to a LAN, the Internet, etc. via wireless communication, or may be connected via a wire such as a cable.

[0228] The display unit 34 is a display device such as a display or a lamp.

[0229] The control unit 31 reads an image from the information storage unit 32, executes image output processing to generate screen information, and executes image output processing on the image information received by the communication unit 33 from the product data management server 40 to generate screen information.

[0230] The control unit 31 may output the generated image information to the display unit 34 and light up a lamp provided in the display unit 34 .

[0231] The operation unit 35 includes, for example, an information input device including various keys, and provides a pointing device in cooperation with the display unit 34. The operation unit 35 receives various operations performed by a user and outputs a signal indicating the operation content to the control unit 31 and the like.

[0232] When a signal indicating the content of the operation is input, the control unit 31 outputs a control signal to the display unit 34 for instructing the display unit 34 to display a screen corresponding to the content of the operation, according to the content of the signal.

[0233] When the control signal is input, the display unit 34 performs screen display according to the control signal. It should be noted that the display unit 34 and the operation unit 35 may be integrally formed to form a touch panel.

[0234] Figure 8 This is a diagram showing data and the like stored in the information storage unit 32 of the entrepreneur terminal 30 .

[0235] As shown in the figure, the information storage unit 32 stores foot model data 321 and mark data 322 .

[0236] The foot model data 321 is data of a foot model representing the shape of a general foot model, and is a three-dimensional model representing the surface of the foot. The foot model data is data prepared with various three-dimensional models based on differences in foot length, width, and instep height.

[0237] The foot model may be formed into a plurality of patterns in advance according to gender, age, race, etc. In this case, the information storage unit 32 stores foot model data corresponding to the plurality of patterns.

[0238] The mark data 322 is a set of three-dimensional coordinates of a virtual point group representing the shape of the mark 12 and the like.

[0239] The control unit 31 of the enterprise terminal 30 can generate three-dimensional images of the foot model and the marker 12 based on the three-dimensional coordinates of the point group constituting the foot model data 321 and the marker data 322 , and display them on the display unit 34 .

[0240] This is based on the display processing of a stereoscopic image of point group data in the general related art.

[0241] <Product Data Management Server 40>

[0242] The product data management server 40 is a server device that manages product data of shoes and generates and provides Web pages for selling shoes.

[0243] The product data management server 40 is managed by, for example, a business operator of an EC website that sells footwear products on the Internet.

[0244] Fig. 9 2 is a diagram showing the configuration of the product data management server 40 .

[0245] As shown in the figure, the product data management server 40 includes a control unit 41 for controlling the entire product data management server 40 , an information storage unit 42 for storing product data, and a communication unit 43 for transmitting and receiving various information to and from the measurement terminal 20 .

[0246] It should be noted that each of the units 41 to 43 is connected to an internal bus, and various information and the like are input and output via the bus, and various processes are executed under the control of the control unit 41 .

[0247] The control unit 41 is a processing unit that controls the entire product data management server 40 , and is composed of, for example, an electronic circuit such as a CPU (Central Processing Unit) or an integrated circuit such as an FPGA (Field-Programmable Gate Array).

[0248] The control unit 41 reads information from the information storage unit 42 and writes information to the information storage unit 42 .

[0249] The information storage unit 42 is a device for storing information, such as a hard disk, a memory, or a semiconductor element.

[0250] The information storage unit 42 includes an area for storing programs executed by the control unit 41 , a work area temporarily used when the control unit 41 executes a process, and the like (RAM, etc.).

[0251] The control unit 41 reads the program stored in the information storage unit 42, develops it in the work area, and executes various processes.

[0252] The communication unit 43 is an interface for controlling communication with the measurement terminal 20 via the network 100 , and includes a LAN adapter and the like.

[0253] The communication unit 43 may include a wireless transceiver and be connected to a LAN, the Internet, or the like via wireless communication, or may be connected via a wire such as a cable.

[0254] Fig.10 It is a diagram showing data and the like stored in the information storage unit 42 of the product data management server 40 .

[0255] As shown in the figure, the information storage unit 42 stores a product DB 421 for managing product data.

[0256] Fig.11 This is a diagram showing an example of the data structure of the product DB.

[0257] As shown in the figure, product DB 421 manages the product brand of the supplied footwear, the product category of the product, the respective size information of the product, the color of the product, the price of the product, the inventory quantity and the ID (product ID) used to identify the product in a corresponding manner.

[0258] It should be noted that the product categories include leather shoes, sneakers, light dancing shoes, sandals, long boots, etc. According to each product category of these product categories, for example, multiple levels can be set such as large category → small category, or if it is a large category of "sports shoes", the small category can include "high-top shoes" or "low-top shoes", and the product category can be set more subdivided.

[0259] In addition, the size information is generally indicated as a male size of 23.5 cm to 28.5 cm, and a female size of 21.0 cm to 26.0 cm. It may also be indicated as a smaller size or a larger size.

[0260] Alternatively, the width of the shoe or the height of the instep may be indicated.

[0261] <Regarding the manufacture of dimensional measuring tools>

[0262] Fig.12 This is a flowchart showing the flow of manufacturing a sizing tool.

[0263] First, the provider operates the provider terminal 30. The placement position of the mark 12 is set at an arbitrary position relative to the main body of the dimension measuring tool 10 on the display unit 34 (step S101).

[0264] For example, when the operation unit 35 is constituted by a mouse or the like, the arrangement position of the mark 12 is set by clicking a predetermined position of the sheet-shaped main body of the sizing tool 10 displayed on the display unit 34 .

[0265] As described above, the marks 12 are marks that can be distinguished from each other by shape, pattern, etc., and a mark ID as a distinguishing number is set in advance.

[0266] When setting the arrangement position of the mark 12 , the provider selects the mark ID of the mark 12 to be set and then sets the arrangement position of the mark 12 .

[0267] When the arrangement position of the mark 12 is set, the control unit 31 generates measuring tool data indicating the mark 12 arranged and set on the surface of the main body of the sizing tool 10 and the coordinates and identification numbers indicating the arrangement position of the mark 12 (step S102 ).

[0268] The measuring tool data associates the coordinates of the arrangement position of the mark 12 with the identification number of the mark 12 , and indicates which mark 12 is arranged at which position of the main body of the size measuring tool 10 .

[0269] Furthermore, when setting the arrangement position of the mark 12, a key mark for determining from which direction the image was taken is also set when the image is taken from multiple directions (step S103).

[0270] When the size measuring tool 10 is placed on the foot and photographed from multiple directions, key marks are set at positions where photographs from the front, right side, left side, etc. of the foot can be recognized. The setting information of the key marks is also included in the above-mentioned measuring tool data.

[0271] It should be noted that the arrangement position of the mark 12 included in the measurement tool data is set at a position that does not overlap with the placement portion 11 on which the user places his or her foot.

[0272] Next, a manufacturing device (not shown) of the dimension measuring tool 10 manufactures the dimension measuring tool 10 using the measuring tool data (step S104).

[0273] There is no particular limitation on the manufacturing method of the sizing tool 10. For example, when the manufacturing device of the sizing tool 10 is an information processing device including functions such as printing, when measuring tool data is input, the sizing tool is manufactured by printing the mounting portion 11 and the mark 12 on paper, cloth, etc. of a specified size based on the measuring tool data.

[0274] <About the method of measuring the user's foot size>

[0275] Fig.13A is a flowchart showing a method for measuring the size of a user's foot. Fig.14 FIG. 2 is a diagram showing a state in which a user places his foot on a placing portion of a size measuring tool. Fig.15 is a diagram showing the direction of the image captured by the measuring terminal. Fig.16 is a diagram showing an example of foot model data. Fig.17 This is a diagram showing an example of measurement results displayed on the measurement terminal.

[0276] First, the user places one of his or her left or right foot F on the placing portion 11 of the size measuring tool 10 (step S201). Fig.14 As shown in FIG. 1 , the user's foot F is placed on the placing portion 11 of the size measuring tool 10 . The user places the foot as close to the approximate center of the placing portion 11 as possible.

[0277] Next, the user uses the measurement terminal 10 to photograph his or her feet F from multiple directions (step S202). Fig.15 As shown, the user activates the imaging unit 26 of the measurement terminal 20, sets the mode to a motion imaging mode capable of capturing moving images, and captures images of his or her own feet F from multiple directions every few seconds.

[0278] For example, the direction of shooting is guided by voice guidance generated by an application pre-installed in the measurement terminal 10 , and the user can shoot while moving the measurement terminal 10 in the direction guided by the voice guidance.

[0279] The directions of photographing are, for example, the following ten directions.

[0280] 1. Above

[0281] 2. Ahead

[0282] 3. Right front

[0283] 4.Right rear

[0284] 5. Right side of the heel

[0285] 6. Ahead

[0286] 7. Front left

[0287] 8. Left rear

[0288] 9. Left side of the heel

[0289] 10. Above the heel

[0290] In another example, the shooting directions are, for example, the following seven directions.

[0291] 1. Above

[0292] 2. Ahead

[0293] 3. Right and diagonally forward

[0294] 4. Right oblique rear

[0295] 5. Rear

[0296] 6. Left oblique rear

[0297] 7.Left diagonally forward

[0298] The above example of the shooting direction is an example, and the shooting can be performed from any direction in addition to or instead of the above direction. In a preferred embodiment, the shooting direction includes at least directly above. The image from directly above can capture the outline of the entire foot, so the accuracy is improved by using the image from directly above to generate a 3D model. In addition, the image from directly above can capture the entire mark 12 on the size measuring tool and the foot at the same time, so the image from directly above can be used to determine whether the user has placed the foot in the correct direction relative to the size measuring tool and / or whether the foot of the measurement object on the left and right feet is placed. For example, it is determined whether the outline of the foot captured by the image from directly above is greatly different from the outline of the assumed foot. In the case of a large difference, the user has placed the foot in the wrong direction relative to the size measuring tool, or has placed the foot of one of the left and right feet that is not the measurement object, or has placed an object other than the foot. Therefore, the processing can be terminated as an error.

[0299] The user takes moving images for several seconds from various directions so that the foot F appears together with the plurality of marks 12. The user only needs to start the moving image shooting and move the measurement terminal 20, and the user himself does not need to operate the shutter.

[0300] When the control unit 21 of the measurement terminal 20 captures a dynamic image of the user's foot F and a plurality of marks 12 through the imaging unit 26, it is determined whether a mark 12 (hereinafter referred to as a key mark) necessary for determining from which direction the captured dynamic image is captured is shown. The control unit 21 of the measurement terminal 20 can respond to the situation where the key mark and the foot F enter the field of view of the imaging unit 26 and capture the image at that time. Thus, for example, when the user is instructed to capture from a specific direction, the control unit 21 of the measurement terminal 20 can recognize the key mark and the foot F that should enter the field of view of the imaging unit 26 and automatically capture the image by simply pointing the imaging unit 26 toward the size measuring tool 10 and the foot F from the specific direction.

[0301] The control unit 21 refers to the mark DB 221 stored in the information storage unit 22 to determine whether the key mark determined for each imaging direction is captured.

[0302] Furthermore, when it is determined that a plurality of marks 12 including the foot F and the key mark are captured, the capturing from that direction is terminated, and after the user is notified that the capturing from that direction is completed, the user is guided to capture from the next direction.

[0303] Then, when the user ends the moving image shooting from the above ten directions, the control unit 21 of the measurement terminal 20 selects the best shot frame data from the shooting data of the moving images shot from each direction (step S203).

[0304] As described above, the shooting unit 26 has the function of shooting moving images at any frame rate such as 10fps, 20fps, 30fps, 60fps, etc., and the control unit 21 selects the best shot (for example, the least shaking and the most consistent focus) frame data from the image data of moving images shot from various directions.

[0305] Next, the control unit 21 calculates the parameters (distance and posture) of the measurement terminal 20 when the image is captured from the size measuring tool 10 based on the frame data captured from various directions (step S204 ).

[0306] By focusing on the plurality of markers 12 that appear in each frame of data and understanding the distance between the markers 12 , the distance and posture to the measurement terminal 20 can be calculated using a triangulation technique.

[0307] Next, the local contour of the photographed foot is extracted from each frame of data (step S205).

[0308] The control unit 21 can extract the local contour of the foot shown in the frame data by identifying the boundary between the placing unit 11 and the local contour of the foot from each frame data. This extraction method can be easily performed by using conventional techniques, for example, by processing such as region growing method based on the color of the placing unit 11 and the color of the foot F.

[0309] By performing such processing for each frame of data (for example, for each of ten directions), it is possible to obtain local contour data of the foot in each direction.

[0310] Next, the above-mentioned local contours of the foot are merged (step S206).

[0311] The control unit 21 generates the overall foot contour data by combining the acquired local contour data of the foot in each of the ten directions. The control unit 21 generates the overall foot contour data by, for example, a space carving method using the local contour data in each direction and the parameters of the measurement terminal 20 when photographing in that direction.

[0312] Next, the control unit 21 generates a foot model (step S207).

[0313] For example, the control unit 21 can synthesize the generated overall foot contour data and the foot model data similar to the contour data to generate the best foot model. The control unit 21 obtains the foot model data similar to the generated overall foot contour data from the foot model DB stored in the information storage unit 22 of the measurement terminal 20 (refer to Fig.16 ), then, the contour data and the approximate foot model data are synthesized to generate the best foot model.

[0314] In another example, the control unit 21 can generate a foot model based on the generated contour data of the entire foot and the contour data of the default 3D model.

[0315] Fig. 13B FIG. 2 is a flowchart showing an example of a process for measuring the size of a user's foot, which is another example of the above-mentioned method for measuring the size of a user's foot. This process is executed by the control unit 21 of the measurement terminal 20 .

[0316] Prior to step S301, the same operations as steps S201 to S202 are performed. Thus, a plurality of images of the foot placed on the size measuring tool 10 taken from a plurality of directions can be obtained. The obtained plurality of images are input from the imaging unit 26 to the control unit 21.

[0317] When a plurality of images are input to the control unit 21, the control unit 21 receives an image from a user (step S301).

[0318] When receiving the image of the user, the 3D model construction unit 211 of the control unit 21 constructs a 3D model by deforming the default 3D model based on the received image (step S302). The control unit 21 can, for example, generate the contour data of the entire foot through the same processing as the above-mentioned steps S203 to S206, and construct the 3D model using the generated contour data of the entire foot. The 3D model construction unit 211 constructs the user's 3D model by deforming the default 3D model, for example, based on the contour of the default 3D model in the virtual image obtained from the default 3D model and the contour of the three-dimensional object in the received image. The 3D model construction unit 211 can construct the 3D model, for example, through the processing 400 described later. The deformation of the default 3D model based on the 3D model construction unit 211 is performed in a virtual three-dimensional space, that is, a space in which the actual three-dimensional space is enlarged or reduced at a predetermined scale.

[0319] When the 3D model is constructed, the measuring unit 212 of the control unit 21 measures the foot size of the constructed 3D model (step S303). The measuring unit 212 measures the foot size in the virtual three-dimensional space. The measuring unit 212 can measure the foot size of the 3D model using a known method.

[0320] When the foot size is measured, the conversion unit 213 of the control unit 21 converts the measured foot size into the actual foot size (step S304). The conversion unit 213 converts the foot size in the virtual three-dimensional space into the foot size in the actual three-dimensional space using, for example, the scale between the virtual three-dimensional space and the actual three-dimensional space. For example, the scale between the virtual three-dimensional space and the actual three-dimensional space is X:Y, and when the foot size in the virtual three-dimensional space measured by the measurement unit 212 is measured as h, the foot size h in the virtual three-dimensional space is converted into the foot size in the actual three-dimensional space (h×Y / X) by multiplying Y / X.

[0321] When the data is converted into the actual foot size, the foot size measurement process 300 is completed. Then, the control unit 21 calculates the measurement size data indicating the size of a predetermined foot portion of the user based on the actual body size.

[0322] Fig. 13C This is a flowchart showing an example of the process of constructing a 3D model by the 3D model constructing unit 211 in step S302 .

[0323] The 3D model construction unit 211 obtains a virtual image from the default 3D model (step S401). The virtual image is an image of the default 3D model virtually photographed from multiple directions. The shooting direction of the virtual image may be the same direction as the shooting direction of the image based on the measurement terminal 20, and the shooting position of the virtual image may be the same position as the shooting position of the image based on the measurement terminal 20. Thus, the outline of the default 3D model on the virtual image and the outline of the foot on the received image can be compared. The shooting direction and shooting position of the measurement terminal 20 can be calculated, for example, based on the plane coordinates of the plane space of each marker 12 recognized in the frame data using the principle of triangulation.

[0324] Next, the 3D model construction unit 211 calculates the deviation between the outline of the default 3D model in the virtual image and the outline of the three-dimensional object in the received image (step S402). For example, the 3D model construction unit 211 can calculate the deviation between each of the multiple vertices constituting the default 3D model and the vertices of the three-dimensional object in the received image that can correspond thereto. For example, the 3D model construction unit 211 can calculate the deviation between each of the multiple curves constituting the default 3D model and the curves of the three-dimensional object in the received image that can correspond thereto. The deviation between the marker in the virtual image and the corresponding marker in the received image can be calculated, for example, at the pixel level.

[0325] Next, the 3D model construction unit 211 deforms the default 3D model so that the deviation calculated in step S403 is minimized (step S403). The 3D model construction unit 121 can derive the deformation that minimizes the deviation, for example, using the least squares method.

[0326] Next, the 3D model construction unit 211 determines whether the deviation is below a predetermined threshold value (step S404). If the deviation is below the predetermined threshold value, the deformed 3D model is determined as the user's 3D model, and the process ends. If the deviation is greater than the predetermined threshold value, the process proceeds to step S405. Here, the predetermined threshold value may be, for example, 0 or any non-zero value.

[0327] When the deviation ERR is greater than a predetermined threshold, the 3D model construction unit 211 obtains a virtual image from the deformed 3D model (step S405). The virtual image is an image of the deformed 3D model virtually photographed from multiple directions. The virtual image obtained from the deformed 3D model and the virtual image obtained from the default 3D model may be an image photographed from the same direction and position as the received image.

[0328] Next, the 3D model construction unit 211 repeats steps S402 to S404 using the virtual image acquired from the deformed 3D model and the deformed 3D model. This is repeated until the deviation becomes equal to or smaller than a predetermined threshold.

[0329] In this way, a 3D model of the user is constructed.

[0330] In the above example, it is described that steps S402 to S405 are repeated until the deviation becomes less than a predetermined threshold value, but the present invention is not limited to this. For example, steps S402 to S405 may be repeated a predetermined number of times, or steps S402 to S405 may be repeated until the deviation becomes less than a predetermined threshold value or until a predetermined number of times of repetitions are reached.

[0331] The control unit 21 displays the generated foot model on the display unit 24 of the measurement terminal 20 (see Fig.17 The foot model and the measurement results (size, width, height of the instep, etc.) are displayed on the display unit 24, and the user can rotate the foot model in the up-down, left-right direction or enlarge / reduce the foot model on the display unit 24 by operating the operation unit 25 while observing the foot model displayed on the display unit 24.

[0332] As another embodiment, an elastic material such as rubber or resin, especially an elastomer that can elastically deform in the thickness direction and a pressure sensor 11a connected to the elastomer are provided on the loading portion 11 of the size measuring tool 10, thereby being able to measure the shape of the sole side of the user's foot F and the weight distribution acting on the foot F, and being able to perform analysis such as whether the shape of the sole side of the user's foot F is "normal", "flat foot" or "high arch".

[0333] In the generation of the above-mentioned foot model, the measurement result measured by the pressure sensor 11 a is added, thereby making it possible to generate a more accurate foot model.

[0334] The pressure measurement by the pressure sensor 11 a and the moving image shooting by the above-mentioned measurement terminal 20 can be performed simultaneously.

[0335] The pressure sensor 11 a and the pressure measurement method can adopt conventional techniques, and there is no particular limitation on the method.

[0336] In addition, in addition to being able to perform pressure measurement in a stationary state by placing the foot F on the pressure sensor 11 a provided on the placing portion 11 , dynamic pressure measurement can be performed by walking on the placing portion 11 .

[0337] In such a case, first, the measurement terminal 20 set to a state capable of capturing a dynamic image is placed at a position away from the dimension measurement tool 10. Then, the user walks with the foot F placed on the placement section 11 of the dimension measurement tool 10. The measurement terminal 20 can capture a dynamic image of the state in which the user's foot F is placed on the placement section 11.

[0338] This makes it possible to measure the body weight distribution such as which part of the foot F has the heaviest load, and also to measure the bending state of the toes during walking by taking moving images with the measurement terminal 20 .

[0339] The sole-side shape of the foot F and the weight distribution measured in this way can also be displayed on the display unit 24 of the measurement terminal 20 .

[0340] As described above, in the sizing system according to the embodiment of the present invention, the user places his / her foot F on the placing portion 11 of the sizing tool 10, and the user takes dynamic images from multiple directions in a manner that reflects the multiple marks 12 displayed on the sizing tool 10. In the measurement terminal 20, a foot model of the user can be generated based on the contour images of the foot F taken from multiple directions.

[0341] The user can easily understand the size of his / her foot (length, width, instep height, etc.) by using the foot model. When receiving the foot model as data from the measurement terminal 20, the product data management server 40 refers to the product DB, extracts product data of footwear that is consistent with the foot model or within a specified range, generates screen information showing the data of the product, and transmits it to the measurement terminal 20, so that the user can easily understand the footwear that matches the size of his / her foot F.

[0342] According to the present embodiment, the dimension measuring tool 10 can be manufactured by printing the placement portion 11 and the mark 12 on a material such as paper or cloth that can be placed on a floor or the like and can be processed into a sheet or mat shape, and thus can be mass-produced at low cost.

[0343] Furthermore, a pressure sensor 11 a may be provided on the placement portion 11 of the size measuring unit 10 , and the shape of the sole of the foot F or the weight distribution can be measured by placing the user's foot F on the placement portion 11 , and a dynamic image of the foot F can be simultaneously captured.

[0344] The above-mentioned measuring terminal 20, business terminal 30 and product data management server 40 are mainly implemented by a CPU and a program loaded into a memory. However, the device or server may be configured by any combination of hardware and software other than these, and the high degree of design freedom is easily understood by those skilled in the art.

[0345] In addition, when the above-mentioned measuring terminal 20, entrepreneur terminal 30 or product data management server 40 is constructed as a software module group, the program can be recorded on a recording medium such as an optical recording medium, a magnetic recording medium, an optical magnetic recording medium or a semiconductor and downloaded from the above-mentioned recording medium, or downloaded from an external device connected via a prescribed network.

[0346] It should be noted that the above-mentioned embodiment is an example of a preferred implementation of the present invention, and the embodiment of the present invention is not limited thereto, and various modifications can be made without departing from the gist of the present invention.

[0347] It should be noted that, in the present embodiment, the measurement object is described as a foot, but it is not particularly limited to the foot, and a part of the body such as a hand or a head can also be measured, and there is no particular limitation as long as it is a tangible object whose size can be measured. That is, the dimension measurement system of the present invention can measure the size of any three-dimensional object. Any three-dimensional object can be, for example, a living thing such as an animal, or it can be a non-living thing. The dimension measurement system of the present invention can measure the size of the entire three-dimensional object, and can also measure the size of a part of the three-dimensional object. The part of the three-dimensional object to be measured (that is, the whole or a part of the three-dimensional object) is placed on the dimension measurement tool 10, 10' of the present invention and the image is captured, whereby the dimension measurement system of the present invention can measure the size of the three-dimensional object by the same processing as the above-mentioned processing.

[0348] Description of Reference Numerals

[0349] 10 Dimension measuring tools

[0350] 11 Loading section

[0351] 11a Pressure sensor

[0352] 12 Mark

[0353] 13, 23, 43 Ministry of Communications

[0354] 20 Measurement terminal

[0355] 21, 31, 41 Control Unit

[0356] 22, 32, 42 Information Storage Department

[0357] 24, 34 Display unit

[0358] 25, 35 Operation Department

[0359] 26 Photography Department

[0360] 221 Tag DB

[0361] 222 Foot Model DB

[0362] 30 Entrepreneur Terminal

[0363] 321 Foot Model Data

[0364] 322 Labeled Data

[0365] 40 Product Data Management Server

Claims

1. A computer system for determining the dimensions of a three-dimensional object, wherein: The computer system includes a photographing unit for photographing a three-dimensional object and a control unit. The control unit includes: a receiving unit that receives an image of the three-dimensional object, the image being an image of the three-dimensional object and the plurality of marks placed on a dimension measuring tool having a plurality of marks, the plurality of marks being unique marks contained in the dimension measuring tool; and a 3D model building unit, based on a default 3D model and the received image, building a 3D model of the three-dimensional object by deforming the default 3D model, The control unit is configured to recognize the orientation direction of the imaging unit based on the plurality of markers. The control unit is configured to capture an image of the three-dimensional object when the imaging unit is oriented in a designated specific direction relative to the three-dimensional object while the imaging unit is capturing an image of the three-dimensional object mounted on the sizing tool.

2. The computer system according to claim 1, wherein: The 3D model construction unit constructs a 3D model of the three-dimensional object by deforming the default 3D model based on the outline of the default 3D model in the virtual image obtained from the default 3D model and the outline of the three-dimensional object in the received image.

3. The computer system according to claim 1, wherein: The control unit also includes: A measuring unit, which measures the dimensions in the 3D model; and A conversion unit converts the measured size into an actual size, The default 3D model is deformed in a virtual three-dimensional space having a predetermined scale relative to the actual three-dimensional space. The conversion unit converts the measured size into an actual size using the scale.

4. The computer system according to claim 3, wherein: The scale between the virtual three-dimensional space and the actual three-dimensional space is predetermined based on the ratio of the size of the multiple marks of the sizing tool in the virtual three-dimensional space to the size of the multiple marks of the sizing tool in the actual three-dimensional space.

5. The computer system according to claim 1, wherein: The imaging unit is configured to image the three-dimensional object at least from directly above.

6. The computer system according to claim 1, wherein: The plurality of marks have distinguishing elements, and the distinguishing elements are a plurality of dots arranged in a unique pattern.

7. The computer system according to claim 1, wherein: The three-dimensional object is a foot.

8. A dimension measuring tool, which places a three-dimensional object on the image of the three-dimensional object when the image of the three-dimensional object is captured by an imaging unit so as to measure the dimension of the three-dimensional object based on the image captured by a measuring terminal including the imaging unit and a control unit, wherein: The size measuring tool comprises: a mounting portion for mounting the three-dimensional object; and a plurality of marks arranged around the mounting portion, The plurality of marks include marks that are unique within the sizing tool, The plurality of marks are arranged so that the control unit can grasp the photographing position of the photographing unit. The control unit is configured to recognize the orientation direction of the imaging unit based on the plurality of markers. The control unit is configured to capture an image of the three-dimensional object when the imaging unit is oriented in a designated specific direction relative to the three-dimensional object while the imaging unit is capturing an image of the three-dimensional object mounted on the sizing tool.

9. The dimension measuring tool according to claim 8, wherein: The plurality of marks have distinguishing elements, and the distinguishing elements are a plurality of dots arranged in a unique pattern.

10. The dimension measuring tool according to claim 8, wherein: The size measuring tool is formed in a sheet shape.

11. A dimension measuring system, wherein: include: The computer system according to any one of claims 1 to 7; and The size measuring tool according to any one of claims 8 to 10.

12. A storage medium storing a program for measuring the size of a three-dimensional object, wherein: The program is executed in a computer system having a control unit and an imaging unit, and the program causes the control unit to perform the following processing, which includes: capturing an image of a three-dimensional object using the imaging unit, the image being an image of the three-dimensional object and the plurality of marks placed on a dimension measuring tool having a plurality of marks, the plurality of marks being unique marks contained in the dimension measuring tool; receiving a captured image of the three-dimensional object; and constructing a 3D model of the three-dimensional object by deforming the default 3D model based on the default 3D model and the received image, The control unit is configured to recognize the orientation direction of the imaging unit based on the plurality of markers. The control unit is configured to capture an image of the three-dimensional object when the imaging unit is oriented in a designated specific direction relative to the three-dimensional object while the imaging unit is capturing an image of the three-dimensional object mounted on the sizing tool.

13. A computer program product for determining the dimensions of a three-dimensional object, wherein: The computer program product includes a computer program. When the computer program is executed in a computer system having a control unit and a photographing unit, the control unit performs the following processing, which includes: capturing an image of a three-dimensional object using the imaging unit, the image being an image of the three-dimensional object and the plurality of marks placed on a dimension measuring tool having a plurality of marks, the plurality of marks being unique marks contained in the dimension measuring tool; receiving a captured image of the three-dimensional object; and constructing a 3D model of the three-dimensional object by deforming the default 3D model based on the default 3D model and the received image, The control unit is configured to recognize the orientation direction of the imaging unit based on the plurality of markers. The control unit is configured to capture an image of the three-dimensional object when the imaging unit is oriented in a designated specific direction relative to the three-dimensional object while the imaging unit is capturing an image of the three-dimensional object mounted on the sizing tool.

14. A method for determining the size of a three-dimensional object, wherein: include: capturing an image of a three-dimensional object using a camera, the image being an image of the three-dimensional object and the plurality of marks placed on a dimension measuring tool having a plurality of marks, the plurality of marks being unique marks contained in the dimension measuring tool; receiving a captured image of the three-dimensional object; and constructing a 3D model of the three-dimensional object by deforming the default 3D model based on the default 3D model and the received image, The control unit is configured to recognize the orientation direction of the imaging unit based on the plurality of markers, The control unit is configured to capture an image of the three-dimensional object when the imaging unit is oriented in a designated specific direction relative to the three-dimensional object while the imaging unit is capturing an image of the three-dimensional object mounted on the sizing tool.

15. A dimension measuring system for measuring the dimension of a three-dimensional object, characterized in that: have: A dimension measuring tool, comprising a placing portion for placing a three-dimensional object and a plurality of marks arranged around the placing portion; and The measuring terminal includes: a photographing unit for photographing a state where a three-dimensional object is placed on the placing unit of the size measuring tool in a manner that allows identification of a plurality of marks from a plurality of directions; and a control unit, which calculates the size data of the three-dimensional object based on the contour information of the three-dimensional object obtained by photographing from various directions, The control unit is configured to recognize the orientation direction of the imaging unit based on the plurality of markers. The control unit is configured to capture an image of the three-dimensional object when the imaging unit is oriented in a designated specific direction relative to the three-dimensional object while the imaging unit is capturing an image of the three-dimensional object mounted on the sizing tool.

16. The dimensioning system according to claim 15, characterized in that The dimension measuring tool is formed in a sheet shape, the placing portion is arranged substantially in the center of the sheet, and the plurality of marks are arranged around the placing portion.

17. The dimension measuring system according to claim 15, characterized in that: The dimension measuring tool has a unique mark for determining a photographing direction arranged at a predetermined position, and the measuring terminal determines the photographing direction by photographing the unique mark.

18. The sizing system according to claim 15, wherein: The dimension measuring system further includes a business terminal operated by a provider who provides the dimension measuring tool to the user. The business operator terminal stores mark data indicating the shape and coordinates of a mark to be displayed on the size measuring tool, and generates measuring tool data based on the mark data, wherein the measuring tool data is used to determine the position of the mark arranged on the size measuring tool. The size measuring tool is generated based on the measuring tool data.

19. The sizing system according to claim 15, wherein: The placing portion is provided with a pressure sensor for measuring the shape and weight distribution of the back side of the three-dimensional object.

20. The sizing system of claim 15, wherein: The three-dimensional object is a foot.

21. The sizing system according to claim 20, wherein: The size measurement system further includes a management server connected to the measurement terminal via a network and storing a database for managing product data indicating the size of each of a plurality of shoe products that can be worn by a user. The measuring terminal sends the calculated size data of the foot to the management server. The management server refers to the database, compares the foot size data with the sizes of multiple products represented by the product data, extracts product data of products with sizes that are consistent with or similar to the user's foot size data, and sends the data to the measurement terminal.