Dimensioning system
Through the combination of a stretchable body substrate and an unscalable mark, combined with the coordinated work of the measurement terminal and the management server, the problems of cumbersome and low accuracy of clothing size measurement in the prior art are solved, and high-precision body size measurement and 3D model are achieved Construction improves the accuracy of clothing purchase.
Patent Information
- Application Number
- CN201980032713.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-03-30
- Filing Date
- 2019-03-29
- Publication Date
- 2025-01-14
- Estimated Expiration
- 2039-03-29
AI Technical Summary
When measuring the size of the clothing, the existing portable information device needs to measure the size of the body by itself. The process is cumbersome and the accuracy is low, especially when wearing loose clothing.
Using a flexible main substrate and non-scalable mark, the three-dimensional coordinates of the terminal identification mark are measured, a 3D model of the user's body is constructed, the body size is accurately measured, and the clothing of the appropriate size is matched with the product database through the management server.
It realizes high-precision body size measurement without cumbersome measurements, builds a high-precision 3D model, and improves the accuracy and user experience of clothing purchases.
Smart Images

Figure CN112639875B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a dimension measuring system, and more particularly to a dimension measuring system for measuring the dimensions of a three-dimensional object, and more particularly to a dimension measuring system for capturing the three-dimensional shape of a body and measuring the dimensions. Background Art
[0002] In recent years, EC sites have come to handle a wide variety of commodities due to the spread of Internet technology, and their sales have been increasing more and more.
[0003] EC sites not only provide users with the convenience of ordering products on the site using a PC or a portable terminal, and then receiving the delivered products at home without having to go to a physical store, but also the number of users has increased significantly.
[0004] Among the above EC sites, there are many sites that deal with apparel products such as clothes, hats and shoes, and the number of users is approaching that of physical stores.
[0005] However, when purchasing the above-mentioned clothing products, sometimes it is not known whether the product actually fits the user's body size and shape. After receiving the product, the user tries it on. If it does not fit their size, they need to return the product and order a different size again.
[0006] As one of the conventional technologies for solving the above-mentioned problems, a portable information device disclosed in Patent Document 1 has been proposed.
[0007] The portable information device disclosed in Patent Document 1 calculates the size of clothing by photographing clothing placed on a flat surface and a reference object of a specified size, and inputs the size of a part of the body exposed from the clothing when the user wears the clothing, and calculates the size of each part of the user's body based on the input size of the exposed part of the body and the size of the above-mentioned clothing.
[0008] Specifically, the portable information device of Patent Document 1 calculates the overall length of the user's arm by adding the length of the sleeve of the clothing to the length of the user's exposed arm, for example, when the clothing is a top.
[0009] Furthermore, the portable information device of Patent Document 1 calculates the size of the shoulder width of clothing as the approximate shoulder width of the user.
[0010] Prior Art Literature
[0011] Patent Literature
[0012] Patent Document 1: Japanese Patent Application Laid-Open No. 2018-19843 Summary of the invention
[0013] Technical problem to be solved by the invention
[0014] However, when using the portable information device of Patent Document 1, the user has to measure the size of the body part exposed from the clothes by himself or herself, which is not only complicated but also has the problem that the measurement cannot be performed well and the measurement accuracy is reduced.
[0015] Furthermore, in addition to this, the portable information device of Patent Document 1 directly uses the size of clothing as the size of the user's body. However, if the clothing is a loose-fitting type, there is also a problem that the measurement accuracy is greatly reduced.
[0016] The present invention has been made in view of the above-mentioned problems, and an object thereof is to provide a dimension measuring system that can measure the dimensions of a three-dimensional object, particularly the body dimensions of a user, with high accuracy without performing complicated measurement operations.
[0017] An object of the present invention is also to construct a 3D model that reflects the dimensions of a three-dimensional object with high accuracy in order to measure the dimensions of the three-dimensional object with high accuracy.
[0018] Solutions for solving technical problems
[0019] In order to achieve the above-mentioned purpose, the present invention relates to a size measuring system for measuring the body size of a user, characterized in that it comprises: a size measuring tool, which is composed of a main base material and a plurality of marks, the main base material is made of a stretchable material and is stretched to match the body shape of the user when worn by the user, and the plurality of marks are arranged on the main base material and are not scalable; and a measuring terminal, which recognizes the plurality of marks of the size measuring tool in a state worn by the user, calculates the three-dimensional coordinates of the plurality of marks and measures the body size of the user.
[0020] In addition, the dimension measuring system according to the present invention is characterized in that the measuring terminal recognizes multiple markers from multiple directions, calculates the three-dimensional coordinates of the markers, and calculates the three-dimensional coordinates of the body surface of the user wearing the dimension measuring tool based on the calculated three-dimensional coordinates of the markers.
[0021] In addition, the dimension measuring system according to the present invention is characterized in that it also has an enterprise terminal for operation by an enterprise providing dimension measuring tools to users, the enterprise terminal saves main substrate data and marking data, the main substrate data showing three-dimensional coordinates representing the shape of the main substrate, the marking data showing three-dimensional coordinates representing the shape of the mark, an image of the mark displayed based on the marking data is arranged on an image of the main substrate displayed based on the main substrate data, the position of the mark on the main substrate is determined, measuring tool data representing the three-dimensional coordinates of the dimension measuring tool is generated, and based on the measuring tool data, pattern paper data of the dimension measuring tool is generated.
[0022] In addition, the size measurement system according to the present invention is characterized in that it also has a management server, which is connected to the measurement terminal via a network and stores a database that manages product data representing the size of each product for multiple products that can be worn by the user. The measurement terminal sends information about the measured body size of the user to the management server, and the management server compares the measured body size of the user with the sizes of multiple products represented by the product data with reference to the database, extracts product data of products whose sizes are consistent with the body size of the user or within the specified value, and sends it to the measurement terminal.
[0023] The present invention provides, for example, the following items.
[0024] (Item 1)
[0025] A computer system for determining the dimensions of a three-dimensional object, wherein:
[0026] The computer system comprises:
[0027] a receiving unit that receives an image of a three-dimensional object, the image being an image of the three-dimensional object wearing a sizing tool having a plurality of marks, the plurality of marks including a unique mark in the sizing tool; and
[0028] The 3D model construction unit constructs the 3D model of the three-dimensional object by deforming a default 3D model having a plurality of markers corresponding to the plurality of markers and the received image.
[0029] (Item 2)
[0030] The computer system according to item 1, wherein:
[0031] The 3D model construction unit constructs the 3D model of the three-dimensional object by deforming the default 3D model based on the virtual image obtained from the default 3D model and the received image.
[0032] (Item 3)
[0033] The computer system according to item 2, wherein:
[0034] The 3D model building unit performs:
[0035] calculating deviations between a plurality of markers in the virtual image and corresponding markers in the received image; and
[0036] The default 3D model is deformed in such a way that the deviation is minimized, thereby constructing the 3D model.
[0037] (Item 4)
[0038] The computer system according to any one of items 1 to 3, wherein:
[0039] The computer system further comprises:
[0040] a measuring unit that measures the size of the 3D model; and
[0041] A conversion unit converts the measured size into an actual size,
[0042] The default 3D model is deformed in a virtual three-dimensional space having a predetermined scale relative to the actual three-dimensional space.
[0043] The conversion unit converts the measured size into an actual size using the scale.
[0044] (Item 5)
[0045] The computer system according to item 4, wherein:
[0046] The scale between the virtual three-dimensional space and the actual three-dimensional space is predetermined by the ratio of the dimensions of the multiple marks of the default 3D model in the virtual three-dimensional space to the dimensions of the multiple marks of the sizing tool in the actual three-dimensional space.
[0047] (Item 6)
[0048] The computer system according to any one of items 1 to 5, wherein:
[0049] The plurality of indicia comprises non-unique indicia within the sizing tool,
[0050] The 3D model building unit establishes a correspondence between the non-unique marker in the default 3D model and the non-unique marker in the received image based on the relative position of the non-unique marker and the unique marker.
[0051] (Item 7)
[0052] The computer system according to any one of items 1 to 6, wherein:
[0053] The three-dimensional object is a human body.
[0054] (Item 8)
[0055] The computer system according to any one of items 1 to 7, wherein:
[0056] The unique mark has an identifying element that is a plurality of dots arranged in a unique pattern.
[0057] (Item 9)
[0058] A size measurement system, comprising:
[0059] The computer system according to any one of items 1 to 8, wherein the computer system is a terminal device of a user; and
[0060] The size measuring tool.
[0061] (Item 10)
[0062] The sizing system according to item 9, wherein:
[0063] The dimension measuring tool includes a main body substrate having stretchability and the plurality of marks arranged on the main body substrate, wherein the plurality of marks are not scalable.
[0064] (Item 11)
[0065] A procedure for determining the dimensions of a three-dimensional object, wherein:
[0066] The program is executed in a computer system having a processor, and the program causes the processor to perform the following processes:
[0067] receiving an image of a three-dimensional object, the image being an image of the three-dimensional object wearing a sizing tool having a plurality of markings, the plurality of markings including a unique marking within the sizing tool; and
[0068] Based on a default 3D model having a plurality of markers corresponding to the plurality of markers and the received image, a 3D model of the three-dimensional object is constructed by deforming the default 3D model.
[0069] (Item 12)
[0070] A method for determining the dimensions of a three-dimensional object comprising:
[0071] receiving an image of a three-dimensional object, the image being an image of the three-dimensional object wearing a sizing tool having a plurality of markings, the plurality of markings including a unique marking within the sizing tool; and
[0072] A step of constructing a 3D model of the three-dimensional object by deforming a default 3D model having a plurality of markers corresponding to the plurality of markers and the received image.
[0073] (Item 13)
[0074] A dimension measuring tool for measuring the dimension of a three-dimensional object, wherein:
[0075] The size measuring tool is configured to be worn on the three-dimensional object, and includes:
[0076] A main body substrate having stretchability; and
[0077] a plurality of marks disposed on the main substrate,
[0078] The plurality of markings include unique markings within the sizing tool, and the plurality of markings are not scalable.
[0079] (Item 14)
[0080] The sizing tool according to item 13, wherein:
[0081] The plurality of markings may include non-unique markings within the sizing tool.
[0082] (Item 15)
[0083] The sizing tool according to item 14, wherein:
[0084] The non-unique mark is arranged on the main base material so as to be disposed on at least one of a wrist, an ankle, and a neck of the user when the user wears the size measuring tool.
[0085] (Item 16)
[0086] The dimension measuring tool according to any one of items 13 to 15,
[0087] The unique mark has an identifying element that is a plurality of dots arranged in a unique pattern.
[0088] (Item 17)
[0089] An enterprise terminal is operated by an enterprise providing dimension measuring tools to users, characterized in that:
[0090] The size measuring tool comprises: a main body base material made of a stretchable material and stretched to match the body shape of the user when worn by the user; and a plurality of non-scalable marks arranged on the main body base material,
[0091] The business operator terminal stores main body substrate data and marking data, wherein the main body substrate data shows three-dimensional coordinates representing the shape of the main body substrate, and the marking data shows three-dimensional coordinates representing the shape of the marking.
[0092] The image of the mark displayed based on the mark data is arranged on the image of the main body substrate displayed based on the main body substrate data, and the position of the mark on the main body substrate is determined to generate measuring tool data indicating the three-dimensional coordinates of the size measuring tool.
[0093] Based on the measuring tool data, pattern paper data of the size measuring tool is generated.
[0094] (Item 18)
[0095] A size measuring system, characterized by having:
[0096] A measuring terminal that recognizes a plurality of marks of a size measuring tool in a state of being worn by a user, and calculates the three-dimensional coordinates of the plurality of marks to measure the body size of the user, wherein the size measuring tool is configured to include a main body substrate and a plurality of marks, the main body substrate being formed of a stretchable material and being extended to match the body shape of the user when worn by the user, and the plurality of marks being arranged on the main body substrate and not scalable; and
[0097] a management server connected to the measurement terminal via a network and storing a database for managing product data indicating the size of each product for a plurality of products that can be worn by the user;
[0098] The measuring terminal sends the measured information of the user's body size to the management server,
[0099] The management server refers to the database, compares the measured body dimensions of the user with dimensions of a plurality of products represented by the product data, extracts product data of products having dimensions that are consistent with the body dimensions of the user or within a specified value, and sends the data to the measurement terminal.
[0100] (Project A1)
[0101] A size measuring system for measuring the body size of a user, characterized by:
[0102] A size measuring tool comprising a main body substrate and a plurality of marks, wherein the main body substrate is made of a stretchable material and is stretched to match the body shape of the user when worn by the user, and the plurality of marks are arranged on the main body substrate and are not scalable; and
[0103] The measuring terminal recognizes a plurality of marks of the size measuring tool in a state worn by the user, calculates the three-dimensional coordinates of the plurality of marks, and measures the body size of the user.
[0104] (Project A2)
[0105] The dimension measuring system according to item A1 is characterized in that
[0106] The measurement terminal recognizes the plurality of markers from a plurality of directions, calculates the three-dimensional coordinates of the markers, and calculates the three-dimensional coordinates of the body surface of the user wearing the size measuring tool based on the calculated three-dimensional coordinates of the markers.
[0107] (Item A3)
[0108] The dimension measuring system according to item A1 or A2 is characterized in that
[0109] The device further comprises a business terminal for operation by a business provider who provides the dimension measuring tool to the user.
[0110] The business operator terminal stores main body substrate data and marking data, wherein the main body substrate data shows three-dimensional coordinates representing the shape of the main body substrate, and the marking data shows three-dimensional coordinates representing the shape of the marking.
[0111] The image of the mark displayed based on the mark data is arranged on the image of the main body substrate displayed based on the main body substrate data, and the position of the mark on the main body substrate is determined to generate measuring tool data indicating the three-dimensional coordinates of the size measuring tool.
[0112] Based on the measuring tool data, pattern paper data of the size measuring tool is generated.
[0113] (Item A4)
[0114] The dimension measuring system according to any one of items A1 to A3, characterized in that:
[0115] The device further comprises a management server connected to the measurement terminal via a network and storing a database for managing product data indicating the size of each product for a plurality of products that can be worn by the user.
[0116] The measuring terminal sends the measured information of the user's body size to the management server,
[0117] The management server refers to the database, compares the measured body dimensions of the user with dimensions of a plurality of products represented by the product data, extracts product data of products having dimensions that are consistent with the body dimensions of the user or within a specified value, and sends the data to the measurement terminal.
[0118] It should be noted that any combination of the above-mentioned constituent elements, and structures in which the constituent elements of the present invention, methods, apparatuses, systems, computer programs, recording media storing the computer programs, etc., are mutually replaced are also effective as aspects of the present invention.
[0119] Effects of the Invention
[0120] The size measuring system of the present invention comprises: a size measuring tool, which is composed of a main base material and a plurality of marks, wherein the main base material is made of a stretchable material and is stretched to match the body shape of the user when worn by the user, and the plurality of marks are arranged on the main base material and are not scalable; a measuring terminal, which recognizes the plurality of marks of the size measuring tool in a state worn by the user, calculates the three-dimensional coordinates of the plurality of marks and measures the body size of the user, thereby enabling the body size of the user to be measured with high precision without performing complicated measurement operations.
[0121] Furthermore, according to the present invention, in order to measure the body dimensions of the user with high accuracy, it is also possible to construct a 3D model that reflects the body dimensions of the user with high accuracy. BRIEF DESCRIPTION OF THE DRAWINGS
[0122] Figure 1 It is a diagram showing the configuration of a dimension measuring system according to a first embodiment of the present invention.
[0123] Figure 2 This is a diagram showing the appearance of the dimension measuring tool according to the first embodiment of the present invention.
[0124] Figure 3 This is a diagram showing the appearance of the dimension measuring tool according to the first embodiment of the present invention.
[0125] Figure 4A It is a diagram showing the configuration of a measurement terminal according to the first embodiment of the present invention.
[0126] Figure 4B It is a diagram showing an example of the configuration of the control unit 21 according to the first embodiment of the present invention.
[0127] Figure 5 It is a diagram showing data and the like stored in the information storage unit of the measurement terminal according to the first embodiment of the present invention.
[0128] Figure 6 This is a diagram showing an example of the data structure of the tag DB according to the first embodiment of the present invention.
[0129] Figure 7 This is a diagram showing the configuration of an enterprise terminal according to the first embodiment of the present invention.
[0130] Figure 8 This is a diagram showing data and the like stored in the information storage unit of the entrepreneur terminal according to the first embodiment of the present invention.
[0131] Fig. 9 It is a diagram showing the configuration of a product data management server according to the first embodiment of the present invention.
[0132] Fig.10 This is a diagram of data and the like stored in an information storage unit of a product data management server according to the first embodiment of the present invention.
[0133] Fig.11 This is a diagram showing an example of the data structure of the product DB according to the first embodiment of the present invention.
[0134] Fig.12 This is a flowchart showing the flow of the manufacturing operation of the sizing tool according to the first embodiment of the present invention.
[0135] Fig.13 This is a diagram showing an example of a three-dimensional image of a human body model represented by human body model data according to the first embodiment of the present invention.
[0136] Fig.14 This is a diagram showing an example of a three-dimensional image of a human body model represented by human body model data after the arrangement positions of markers according to the first embodiment of the present invention are set.
[0137] Fig.15 This is a diagram showing an example of pattern paper data according to the first embodiment of the present invention.
[0138] Fig.16A This is a flowchart showing an example of a flow 200 of an operation of measuring the body dimensions of a user according to the first embodiment of the present invention.
[0139] Fig. 16B This is a flowchart showing an example of a process 300 for measuring body size in another example of the flow 200 of the operation of measuring body size of a user according to the first embodiment of the present invention.
[0140] Fig. 16C This is a flowchart showing an example of a process 400 of constructing a 3D model in step S302 by the 3D model constructing unit 211 according to the first embodiment of the present invention.
[0141] Fig.17 This is a diagram showing a situation of a user during shooting according to the first embodiment of the present invention.
[0142] Fig.18 This is a diagram showing the appearance of a dimension measuring tool according to a second embodiment of the present invention.
[0143] Fig.19 This is a diagram showing the appearance of a dimension measuring tool according to a second embodiment of the present invention. DETAILED DESCRIPTION
[0144] <First Embodiment>
[0145] [1] Overview of the First Embodiment
[0146] The size measuring tool 10 according to the first embodiment of the present invention has a structure that is in the shape of clothing or the like as a whole, and a mark is provided on a material such as stretchable fiber or the like.
[0147] The measuring terminal 20, which is an information processing device having a photographing function, can measure the body size of the user by photographing the size measuring tool 10 worn by the user on his / her body multiple times from multiple angles, calculating the three-dimensional coordinates of the marks on the size measuring tool 10, thereby calculating the three-dimensional coordinates of the body surface of the user. The body size of the user to be measured may be the size of the entire body of the user, or the size of a part of the body of the user.
[0148] This allows users to easily purchase clothing products that match their body sizes.
[0149] The entrepreneur terminal 30 of the first embodiment of the present invention synthesizes a three-dimensional image of the main substrate (clothing, fabric, etc.) of the sizing tool 10 with a human body model, and by setting the configuration position of the mark at an arbitrary position on the main substrate, it is possible to easily generate the design data of the sizing tool 10, and by unfolding it in a plane, it is also possible to easily generate the drawing paper data of the sizing tool 10.
[0150] [2] Structure of the first embodiment
[0151] (1) Overall structure of the dimensional measurement system
[0152] Figure 1 It is a diagram showing the configuration of a dimension measuring system according to a first embodiment of the present invention.
[0153] As shown in the figure, the size measuring system is configured to include: a size measuring tool 10 that includes a plurality of identifiable marks on the surface and is worn on the user's body when the size of the user's body is measured; a measuring terminal 20 that takes a picture of the user wearing the size measuring tool 10 to measure the user's body size; an enterprise terminal 30 operated by a provider of the size measuring tool 10; and a product data management server 40 that stores a database of product data including size information of products such as clothes worn by the user.
[0154] (2) Structure of the dimension measuring tool 10
[0155] Figure 2 , 3 This is a diagram showing the appearance of a dimension measuring tool 10 according to the first embodiment of the present invention. Figure 2 A shirt-type size measuring tool 10 is shown as an example. Figure 3 A trousers-type size measuring tool 10 is shown as an example.
[0156] The sizing tool 10 is made of a material such as a fiber that is stretchable as a whole, and is formed into a shape that can be worn on the user's body, such as a garment or an ornament. The sizing tool 10 may be formed into the shape of a garment or an ornament by a single unit, or may be formed into the shape of a garment or an ornament by a combination of a plurality of sizing tools 10. The sizing tool 10 may be formed to cover the entire body of the user, or may be formed to cover a portion of the body of the user.
[0157] In the dimension measuring tool 10 , the portion made of the stretchable material will be hereinafter referred to as a main body base material 11 .
[0158] As the stretchable raw material of the above-mentioned main substrate 11, for example, synthetic fibers blended with stretchable and elastic raw materials such as polyurethane elastic fibers, polyester, etc., or other fibers (cotton, etc.) can be used. As long as the raw material can ensure its stretchability and elasticity, it can be other raw materials commonly used for clothes, etc.
[0159] For example, the main body base material 11 of the size measuring tool 10 is formed slightly smaller than the user's body size, and when the user wears it, it stretches to match the user's body shape and fits exactly to the user's body surface.
[0160] As described above, the main body base material 11 is formed into a shape such as a garment shape or an accessory shape, which can be worn (put on) exactly along the body shape of the user.
[0161] For example, the main body base material 11 may be in the shape of an accessory such as a hat, socks, a headband, or a wristband in addition to the shape of clothing such as a shirt, pants, or underwear.
[0162] A plurality of markers 12 are fixedly mounted on a main body base material 11 made of a stretchable material.
[0163] The mark 12 is made of a material such as metal or resin that does not expand or deform due to the extension of the main body base material 11. Since the mark 12 does not expand or deform, the mark 12 can be used as a reference for size even when the user wears the sizing tool 10.
[0164] In one example, the mark 12 may be formed of a stretchable material similar to the main body substrate 11 .
[0165] The shape, size, surface pattern (pattern), color, material, etc. of the mark 12 are not particularly limited, and various structures can be applied.
[0166] By making the shape, size, surface pattern (pattern), color, material, etc. of the mark 12 different from each other, it is possible to distinguish each mark 12. Hereinafter, each element for distinguishing each mark 12 is referred to as "discrimination element". Each mark 12 has a different discrimination element, so that each mark 12 becomes unique in the size measuring tool 10.
[0167] The measuring terminal 20 distinguishes each mark 12 by reading the distinguishing element of the mark 12 by optical reading or the like. The distinguishing element of the present invention can be any element as long as it can be identified in the processing of the captured image, and can be specifically exemplified by a plurality of points or colors arranged in a unique pattern in each mark (including the case where the entire surface of the mark is color-matched, and the case where multiple colors are arranged in each area in the mark to form a unique mark as a whole, etc.). In the present invention, a preferred distinguishing element can be a plurality of points arranged in a unique pattern in each mark. In the present invention, a more preferred distinguishing element can be a plurality of points arranged in a unique pattern in each mark, that is, a plurality of points formed as holes in the mark formed by a non-scalable material. The points formed as holes in the mark can be of any size within the range that does not impair the non-scalability of the mark, but for example, can have a maximum size of about 5% to 15% of the maximum size of the mark. For example, in the case where the mark 12 is a circle with a diameter of about 20 mm, the point can be a circle with a diameter of about 1 mm to about 3 mm. The mark having such a plurality of dots as distinguishing elements can be manufactured from a non-scalable material of a single color, and thus can be manufactured cheaply and easily. Furthermore, by minimizing the dots (holes in the mark), the mark 12 can be used as a size reference without impairing the non-scalability of the mark 12. Furthermore, by changing the number and position of the dots, the unique pattern of the dots can be infinitely expanded, and thus the number of the marks 12 on the sizing tool 10 can be easily increased or decreased. Thus, even a larger sizing tool 10 or a smaller sizing tool 10 can be manufactured cheaply and easily.
[0168] When the user wears the sizing tool 10 , the main base material 11 stretches along the body shape of the user, and the relative positions of the marks 12 arranged on the main base material 11 change.
[0169] The measurement terminal 20 measures the body dimensions of the user by measuring the amount of change.
[0170] For example, when the user sets Figure 3 When the sizing tool 10 of the pants type shown is worn on the user's lower body in the same manner as wearing pants, the sizing tool 10 is stretched to match the size and shape of the user's lower body, and the size and shape are measured.
[0171] For example, the sizing tool 10 is worn in such a manner that the waist portion matches the position of the user's waist and the trouser leg portion of the sizing tool 10 is located slightly above the user's ankles. Thus, the sizing tool 10 is extended in the length direction of the legs to match the user's body shape, and is extended in the circumferential direction around the waist, hips, and legs to match the shape of the waist and hips or the thickness of the legs.
[0172] When the user takes off the sizing tool 10 from the lower body in the same manner as taking off tights, the sizing tool 10 returns to its original size and shape.
[0173] (3) Configuration of the Measurement Terminal 20
[0174] The measurement terminal 20 is an information processing device that is operated when measuring the body dimensions of the user.
[0175] For example, the measurement terminal 20 is a portable information processing device such as a smartphone, a tablet terminal, a wearable terminal, a mobile phone, a PDA, a PHS, or a PC.
[0176] In one example, the measurement terminal 20 captures and recognizes the plurality of marks 12 of the size measuring tool 10 worn by the user, calculates the three-dimensional coordinates of the recognized plurality of marks 12 , and measures the user's body size based on the three-dimensional coordinates of the marks 12 .
[0177] In another example, the measurement terminal 20 captures a photo of the user wearing the dimension measuring tool 10 , constructs a 3D model of the user using the captured image, and measures the user's body dimensions based on the constructed 3D model.
[0178] Furthermore, the measurement terminal 20 uses a communication function to communicate with the product data management server 40 via a network, and based on the measured body size of the user, can search for products such as clothing that match the body size.
[0179] Figure 4A It is a diagram showing the configuration of the measurement terminal 20 according to the first embodiment of the present invention.
[0180] As shown in the figure, the measuring terminal 20 has: a control unit 21 which is composed of a CPU and the like and controls the entire measuring terminal 20; an information storage unit 22 which stores various information; a communication unit 23 which communicates with a product data management server 40 via a network 100; a display unit 24 which displays various information; an operation unit 25 which includes various buttons and the like and is used for inputting information; and a shooting unit 26 which includes a camera and the like and inputs images.
[0181] Furthermore, the display unit 24 and the operation unit 25 may be integrally formed to constitute a touch panel.
[0182] Each of the units 21 to 26 is connected to an internal bus, and various information and the like are input and output via the bus, and executes various processes under the control of the control unit 21 .
[0183] The control unit 21 is a processing unit that controls the entire measurement terminal 20 , and is composed of, for example, an electronic circuit such as a CPU (Central Processing Unit) or an integrated circuit such as an FPGA (Field-Programmable Gate Array).
[0184] The control unit 21 reads information from the information storage unit 22 and writes information to the information storage unit 22 .
[0185] The information storage unit 22 is a device for storing information, such as a hard disk, a memory, or a semiconductor element.
[0186] The information storage unit 22 has a function of storing programs executed by the control unit 21 (for example, Fig.16A A portion of the processing shown, Fig. 16B , Fig. 16C An area for a program for the processing shown in the figure) and an operation area temporarily used when the control unit 21 executes the processing (RAM, etc.).
[0187] The control unit 21 reads out the program (three-dimensional reconstruction algorithm, optimization algorithm, bundle adjustment algorithm, etc.) stored in the information storage unit 22, and develops it in the above-mentioned work area to execute various processes.
[0188] The information storage unit 22 stores in advance measuring tool data indicating the arrangement positions of the marks 12 on the main body substrate 11 of the size measuring tool 10 .
[0189] The above-mentioned measuring tool data is generated by the enterprise terminal 30 as described later.
[0190] The information storage unit 22 may store data for constructing a 3D model of the user, for example, generated by the 3D model construction unit 211 described later. The data for constructing a 3D model of the user may be data for expressing a 3D model known in the art. The data may be, for example, polygon data representing each vertex of the 3D model.
[0191] In addition, the information storage unit 22 can store data for constructing a default 3D model. The default 3D model is a 3D model that serves as a basis when constructing a user's 3D model. The default 3D model that serves as a basis can, for example, select different models according to each user that serves as the target, or it can be constant according to each user. In the case where the default 3D model that serves as a basis is constant according to each user, the default 3D model can be constructed as a model with a height of, for example, about 170 cm and a body shape that is an average of the average male body shape and the average female body shape. A height of about 170 cm is the average height of Japanese people, so such a default 3D model is easy to use when constructing 3D models of users of various body shapes.
[0192] The default 3D model includes a plurality of marks corresponding to the plurality of marks 12 included in the size measuring tool 10. The plurality of marks included in the default 3D model are unique within the default 3D model, similarly to the plurality of marks 12. The plurality of marks of the default 3D model are arranged at the same positions as the positions where the plurality of marks 12 are arranged when a person having the height and body shape of the default 3D model wears the size measuring tool 10.
[0193] The data used to construct the default 3D model may be data for expressing a 3D model known in the art, and may be, for example, polygon data representing each vertex of the 3D model.
[0194] The communication unit 23 is an interface for controlling communication with the product data management server 40 via the network 100 , and includes a LAN adapter and the like.
[0195] The communication unit 23 may include a wireless transceiver and be connected to a LAN, the Internet, or the like via wireless communication, or may be connected via a wired connection such as a cable.
[0196] The display unit 24 is a display device such as a display or a lamp.
[0197] The control unit 21 reads an image from the information storage unit 22, executes image output processing, and generates screen information. Furthermore, the control unit 21 executes image output processing on the image information received by the communication unit 23 from the product data management server 40, and generates screen information.
[0198] The control unit 21 outputs the generated image information to the display unit 24 .
[0199] The display unit 24 displays the input image information on a display or the like.
[0200] Furthermore, the control unit 21 may output a control signal to the display unit 24 to light up a lamp included in the display unit 24 .
[0201] The operation unit 25 includes, for example, an information input device composed of various keys, and provides a pointing device in cooperation with the display unit 24. The operation unit 25 receives various operations performed by a user, and outputs a signal indicating the operation content to the control unit 21, etc.
[0202] When receiving a signal indicating the above-mentioned operation content, the control unit 21 outputs a control signal to the display unit 24 for instructing the display unit 24 to display a screen corresponding to the operation content, based on the content of the signal.
[0203] When the control signal is input, the display unit 24 performs screen display according to the control signal.
[0204] It should be noted that the display unit 24 and the operation unit 25 may be integrally formed to form a touch panel.
[0205] The photographing unit 26 includes a camera, etc., and photographs the size measuring tool 10 worn by the user, and inputs the image of the size measuring tool 10 to the measuring terminal 20. In this specification, the image may be a still image or a dynamic image. In the case where the image photographed by the photographing unit 26 is a dynamic image, the measuring terminal 20 may have a structure for extracting a still image (plane image) from the dynamic image. For example, the measuring terminal 20 has a known software for extracting a still image from a dynamic image, and through this software, a still image can be extracted from a dynamic image photographed by the photographing unit 26.
[0206] Since the plurality of marks 12 on the dimension measuring tool 10 are unique within the measuring tool 10 , the plurality of marks within the planar image are also unique within the planar image.
[0207] The imaging unit 26 inputs the above-input planar image data of the sizing tool 10 to the control unit 21 .
[0208] In one example, when the planar image data of the sizing tool 10 is input, the control unit 21 recognizes images of a plurality of marks 12 arranged on the sizing tool 10 from the input planar image data, and recognizes which mark 12 is at which position in the planar space indicated by the planar image data.
[0209] Furthermore, the control unit 21 recognizes the outline (the boundary line with the background) of the size measuring tool 10 in addition to the image of the mark 12 in the planar image data.
[0210] The image recognition method of the control unit 21 may be, for example, a conventional general optical reading method or a method based on other image recognition methods.
[0211] The control unit 21 calculates the three-dimensional coordinates of each marker 12 based on the recognition of each marker 12 and the plane coordinates in the plane image, and generates marker measurement data which is a collection of the three-dimensional coordinates of the plurality of markers 12 .
[0212] For example, the control unit 21 uses the principle of triangulation to calculate the three-dimensional coordinates of the marker 12 and the posture information (three-dimensional coordinates and angles in each shooting direction of yaw, pitch, and roll) of the measuring terminal 20 performing the shooting based on the plane coordinates of the marker 12 commonly identified in the plane images of multiple image data.
[0213] The control unit 21 calculates user measurement data indicating the three-dimensional coordinates of a virtual point group located on the body surface of the user based on the marker measurement data calculated as described above.
[0214] Then, the control unit 21 calculates the measured dimension data indicating the dimension of a predetermined body part of the user based on the user measurement data.
[0215] In another example, when receiving an image captured of the user wearing the dimension measuring tool 10 from the imaging unit 26 , the control unit 21 constructs a 3D model of the user based on the received image.
[0216] Figure 4B 1 is a diagram showing an example of the configuration of the control unit 21 in this example.
[0217] The control unit 21 includes at least a 3D model building unit 211 .
[0218] The 3D model construction unit 211 receives the image captured by the image capturing unit 26 and constructs a 3D model based on the received image. For example, the 3D model construction unit 211 constructs a 3D model of the user by deforming the default 3D model based on the received image and the default 3D model.
[0219] In one example, the 3D model construction unit 211 identifies the plane coordinates of the multiple markers 12 in the received multiple images, and uses the principle of triangulation to calculate the three-dimensional coordinates of the multiple markers 12. Next, the default 3D model is deformed in such a way that the three-dimensional coordinates of the multiple markers on the default 3D model become the calculated three-dimensional coordinates of the multiple markers 12 corresponding to each other. The 3D model constructed by deforming the default 3D model in such a way that all the three-dimensional coordinates of the multiple markers on the default 3D model become the calculated three-dimensional coordinates of the multiple markers 12 corresponding to each other becomes the user's 3D model. Here, the three-dimensional coordinates of the multiple markers on the default 3D model do not need to be completely consistent with the three-dimensional coordinates of the corresponding multiple markers 12, and a specific error (for example, ±5%) is allowable.
[0220] In another example, the 3D model construction unit 211 obtains a two-dimensional virtual image from the default 3D model, and deforms the default 3D model based on the virtual image obtained from the default 3D model and the received image. The virtual image is an image of the default 3D model virtually photographed from multiple directions. At this time, the received image is preferably an image photographed from the same direction as or close to the direction in which the virtual image is photographed. This is to facilitate the comparison of the virtual image with the received image in subsequent processing. For example, in the case where the virtual image is an image of the default 3D model virtually photographed from twelve directions, namely, the direction of one o'clock, the direction of two o'clock, and the direction of twelve o'clock relative to the default 3D model, the received image is also preferably photographed in a manner that becomes an image of the user photographed from twelve directions, namely, the direction of one o'clock, the direction of two o'clock, and the direction of twelve o'clock relative to the user. In addition, the camera position at which the received image is photographed is preferably the same as or close to the camera position at which the virtual image is virtually photographed. This is to facilitate the comparison of the virtual image with the received image in subsequent processing. For example, when a virtual image is virtually captured from a camera position at a distance of about 2 meters from the subject and a camera height of about 70 cm, the received image is also preferably captured in a manner that the user is captured from a virtual camera position at a distance of about 2 meters from the subject and a camera height of about 70 cm. The multiple markers included in the default 3D model are unique within the default 3D model and therefore also unique within the virtual image.
[0221] The 3D model construction unit 211 calculates the deviation between the multiple marks in the virtual image obtained from the default 3D model and the corresponding multiple marks in the received image, and deforms the default 3D model based on the default 3D model in such a way that the calculated deviation is minimized. The multiple marks in the virtual image are unique in the virtual image, and the multiple marks in the received image are also unique, so the multiple marks in the virtual image can be associated with the corresponding multiple marks in the received image. For example, the 3D model construction unit 211 determines the positions of the multiple marks in the virtual image that minimize the calculated deviation, and deforms the basic default 3D model in such a way that the multiple marks are present at the determined positions. The 3D model constructed based on the default 3D model is made into the user's 3D model in such a way that the deviation between all the multiple marks in the virtual image obtained from the default 3D model and all the corresponding multiple marks in the received image is minimized. Here, the deviation does not need to be completely zero, and can be set to a specific minimum value (for example, a fixed value or a value below a predetermined threshold). The 3D model construction unit 211 can derive the deformation that minimizes the calculated deviation by any method. For example, the least squares method may be used to derive a deformation that minimizes the calculated deviation.
[0222] The deformation of the default 3D model based on the 3D model construction unit 211 can be performed in the virtual three-dimensional space. The virtual three-dimensional space is a space in which the actual three-dimensional space is enlarged or reduced at a predetermined scale. By performing the deformation in the virtual three-dimensional space, the scale does not change before and after the deformation, and it becomes easy to calculate the size in the actual three-dimensional space using the deformed 3D model and the scale.
[0223] The scale between the virtual three-dimensional space and the actual three-dimensional space is predetermined by, for example, the ratio of the sizes of the multiple marks on the default 3D model in the virtual three-dimensional space to the sizes of the multiple marks 12 on the sizing tool 10 in the actual three-dimensional space. For example, when the size of the multiple marks on the default 3D model in the virtual three-dimensional space is X and the size of the multiple marks 12 on the sizing tool 10 in the actual three-dimensional space is Y, the scale is determined as X:Y.
[0224] The control unit 21 further includes a measuring unit 212 and a converting unit 213 .
[0225] The measuring unit 212 is configured to measure the body dimensions of the user in the 3D model constructed by the 3D model construction unit 211. The dimensions measured by the measuring unit 212 are dimensions in a virtual three-dimensional space. The measuring unit 212 can measure the body dimensions of the 3D model using a known method. For example, the measuring unit 212 slices the 3D model into two-dimensional cross sections, and by measuring the dimensions in the two-dimensional cross sections of the measurement object, the dimensions of the measurement object portion can be determined. For example, in the case of measuring waist circumference, the circumference is measured in the two-dimensional cross section of the thinnest part of the waist, thereby measuring the waist circumference. For example, in the case of measuring shoulder width, the length between the two shoulders is measured in a two-dimensional longitudinal section passing through the two shoulders, thereby measuring the shoulder width.
[0226] The conversion unit 213 is configured to convert the body size measured by the measurement unit 212 into the actual body size. As described above, the size measured by the measurement unit 212 is a size in the virtual three-dimensional space, and therefore needs to be converted into a size in the actual three-dimensional space by the conversion unit 212. The conversion unit 213 converts the body size in the virtual three-dimensional space into a size in the actual three-dimensional space, for example, using a scale between the virtual three-dimensional space and the actual three-dimensional space.
[0227] The control unit 21 calculates the measured dimension data indicating the dimension of a predetermined body part of the user based on the actual dimension in the three-dimensional space outputted by the conversion unit 213 .
[0228] The control unit 21 can output the calculated measured dimension data to the display unit 24 and display the data on the display unit 24 .
[0229] The control unit 21 can, for example, output the stereoscopic image of the 3D model of the user constructed by the 3D model construction unit 211 to the display unit 24, and display it on the display unit 24. At this time, the display unit 24 can also display the calculated value of the measured dimension data on the corresponding part of the stereoscopic image of the 3D model or near the part.
[0230] The user confirms the displayed measured size data (e.g., height, chest circumference, waist, hips, etc.) and can refer to it when purchasing clothing products (clothing, accessories, etc.) that match their body size. For example, by displaying the value of the size indicating the neck circumference and the value of the size indicating the sleeve length in the measured size data on the display unit 24, the user can use it as a reference when selecting a shirt. For example, by displaying the value of the size indicating the sleeve length, the value of the size indicating the shoulder width, the value of the size indicating the chest circumference, and the value of the size indicating the length of the garment on the display unit 24, the user can use it as a reference when selecting a jacket. For example, by displaying the value of the size indicating the waist, the value of the size indicating the hips, the value of the size indicating the thigh circumference, the value of the size indicating the upper crotch, and the value of the size indicating the lower crotch in the measured size data on the display unit 24, the user can use it as a reference when selecting pants.
[0231] The measurement terminal 20 can receive screen information such as a Web page from the product data management server 40 functioning as a Web server and display it.
[0232] The measurement terminal 20 has a function in which the control unit 21 generates and transmits an HTTP (Hypertext Transfer Protocol) request in response to a user's request, and has a function in which the control unit 21 interprets an HTTP response (an example of a response) and presents it to the user.
[0233] For example, the information storage unit 22 stores a web browser as an example.
[0234] The control unit 21 interprets the HTTP response to generate image data and audio data, and displays the HTTP response on the display unit 24 or outputs audio from a speaker included in the measurement terminal 20 , thereby presenting the HTTP response to the user.
[0235] When the communication unit 23 sends the measured dimension data representing the user's body dimensions to the product data management server 40, the product data management server 40 extracts the data (product data) of the product that matches the body dimensions represented by the measured dimension data from the database (product DB421), and sends the screen information containing the product data, i.e., the product retrieval result information (Web page, etc.) to the measurement terminal 20.
[0236] When receiving the product search result information from the product data management server 40 , the communication unit 23 of the measurement terminal 20 displays the information on the display unit 24 .
[0237] The user can easily obtain information about products such as clothes that match his or her body size by observing the content of the displayed product search result information, thereby facilitating the selection of products to be purchased.
[0238] When the product search result information is a web page of an EC site, the user can directly purchase the product on the EC site by operating the operation unit 25 to designate a predetermined area of the product search result information displayed on the display unit 24 (clicking a button, etc.).
[0239] Figure 5 It is a diagram showing data and the like stored in the information storage unit 22 of the measurement terminal 20 according to the first embodiment of the present invention.
[0240] As shown in the figure, the information storage unit 22 stores a mark DB 221 that manages identification elements such as the shape of each mark 12 and human body model data 222 that represents a body part calculated as measured dimension data.
[0241] Figure 6 This is a diagram showing an example of the data structure of the tag DB 221 according to the first embodiment of the present invention.
[0242] In the example shown in the figure, the mark DB 221 manages text data or image data indicating the shape, size, surface pattern (pattern), color, material, etc. of the mark 12 for each mark.
[0243] The control unit 21 of the measurement terminal 20 performs image recognition on the mark 12 reflected in the captured planar image, for example, and identifies the mark 12 by referring to the mark DB 221 .
[0244] The human body model data 222 is data of a human body model representing the body shape of a general human body, and is a collection of three-dimensional coordinate data of a virtual point group located on the body surface of the human body model. The human body model data 222 may include data for constructing a 3D model of the user and data for constructing a default 3D model.
[0245] The human body model data 222 also includes information indicating the three-dimensional coordinates of a group of points located on a line indicating the length of a body part calculated as the measurement size data.
[0246] The control unit 21 of the measurement terminal 20 refers to the above-mentioned human body model data 222, identifies the position of the body part calculated as the measurement size data, determines the position of the body part calculated as the above-mentioned measurement size data in the user's body shown in the user measurement data, and calculates the user's body size by extracting the three-dimensional coordinates of the point group of the determined position.
[0247] (4) Configuration of the Enterprise Terminal 30
[0248] The business operator terminal 30 is an information processing device operated by a providing business operator who provides the dimension measuring tool 10 to the user.
[0249] For example, the entrepreneur terminal 30 is an information processing device such as a PC, a tablet terminal, a smartphone, a wearable terminal, a mobile phone, a PDA, or a PHS.
[0250] The enterprise terminal 30 sets the arrangement positions of the marks 12 on the main body substrate 11 of the dimension measuring tool 10 to generate the measuring tool data, and generates the pattern paper data of the dimension measuring tool 10 in which the arrangement positions of the marks 12 are set.
[0251] The enterprise terminal 30 generates the pattern paper data of the sizing tool 10 based on the measuring tool data including the three-dimensional coordinates of the virtual point group representing the surface of the sizing tool 10. However, the generating method may also generate the pattern paper data by converting the measuring tool data as three-dimensional data into the pattern paper data as two-dimensional data using the conventional so-called clothing CAD etc. It should be noted that there is no particular limitation on the generating method.
[0252] The generated pattern paper data is input to an information processing device including cutting and sewing functions, that is, a manufacturing device of the sizing tool 10 (not shown).
[0253] The input method is not particularly limited, and for example, the input is made to the manufacturing device of the dimension measuring tool 10 using a communication function such as short-distance wireless communication of the enterprise terminal 30. The manufacturing device of the dimension measuring tool 10 cuts and sews the raw material of the main body base material 11, i.e., fiber clothing, etc., based on the input pattern paper data, to manufacture the main body base material 11, and fixes the joining mark 12 at a predetermined position on the main body base material 11 specified in the pattern paper data. The fixing and joining method may be a conventional general method, for example, fixing and joining by resin, adhesive, or fixing and joining by sewing.
[0254] Alternatively, the pattern paper data may be input to a printer or the like, and printing and cutting may be performed based on the pattern paper data to produce normal pattern paper.
[0255] Figure 7This is a diagram showing the configuration of the enterprise terminal 30 according to the first embodiment of the present invention.
[0256] As shown in the figure, the entrepreneur terminal 30 has: a control unit 31 which is composed of a CPU and controls the entire entrepreneur terminal 30; an information storage unit 32 which stores various information; a communication unit 33 which performs communication processing; a display unit 34 which displays various information; an operation unit 35 which includes various buttons and is used for inputting information; and a shooting unit 36 which includes a camera and inputs images.
[0257] Furthermore, the display unit 34 and the operation unit 35 may be integrally formed to constitute a touch panel.
[0258] Each of the units 31 to 35 is connected to an internal bus, and various information and the like are input and output via the bus, and executes various processes under the control of the control unit 31 .
[0259] The control unit 31 is a processing unit that controls the entire enterprise terminal 30 , and is composed of, for example, an electronic circuit such as a CPU (Central Processing Unit) or an integrated circuit such as an FPGA (Field-Programmable Gate Array).
[0260] The control unit 31 reads information from the information storage unit 32 and writes information to the information storage unit 32 .
[0261] The information storage unit 32 is a device for storing information, such as a hard disk, a memory, or a semiconductor element.
[0262] The information storage unit 32 includes an area for storing programs executed by the control unit 31 , a work area temporarily used when the control unit 31 executes a process, and the like (RAM, etc.).
[0263] The control unit 31 reads the program stored in the information storage unit 32, and develops it in the above-mentioned work area to execute various processes.
[0264] The communication unit 33 is an interface for controlling communication, and includes a LAN adapter and the like.
[0265] The communication unit 33 may include a wireless transceiver and be connected to a LAN, the Internet, or the like via wireless communication, or may be connected via a wired connection such as a cable.
[0266] The display unit 34 is a display device such as a display or a lamp.
[0267] The control unit 31 reads an image from the information storage unit 32, executes image output processing, and generates screen information. Furthermore, the control unit 31 executes image output processing on the image information received by the communication unit 33 from the product data management server 40, and generates screen information.
[0268] The control unit 31 outputs the generated image information to the display unit 34 .
[0269] The display unit 34 displays the input image information on a display or the like.
[0270] Furthermore, the control unit 31 may output a control signal to the display unit 34 to light up a lamp included in the display unit 34 .
[0271] The operation unit 35 includes, for example, an information input device composed of various keys, and provides a pointing device in cooperation with the display unit 34. The operation unit 35 receives various operations performed by a user, and outputs a signal indicating the operation content to the control unit 31, etc.
[0272] When receiving a signal indicating the above-mentioned operation content, the control unit 31 outputs a control signal to the display unit 34 for instructing the display unit 34 to display a screen corresponding to the operation content, based on the content of the signal.
[0273] When the control signal is input, the display unit 34 performs screen display according to the control signal.
[0274] It should be noted that the display unit 34 and the operation unit 35 may be integrally formed to form a touch panel.
[0275] Figure 8 This is a diagram showing data and the like stored in the information storage unit 32 of the entrepreneur terminal 30 according to the first embodiment of the present invention.
[0276] As shown in the figure, the information storage unit 32 stores: data of a human body model representing the body shape of a general human body, and a collection of three-dimensional coordinate data of a virtual point group located on the body surface of the human body model, namely, human body model data 321; a collection of three-dimensional coordinate data of a virtual point group representing the shape of the main substrate 11, namely, main substrate data 322; and a collection of three-dimensional coordinate data of a virtual point group representing the shape of the marker 12, etc., namely, marker data 323.
[0277] A plurality of patterns of the human body model may be prepared in advance according to gender, age, race, etc. In this case, the information storage unit 32 stores human body model data corresponding to the plurality of patterns.
[0278] The control unit 31 of the enterprise terminal 30 can generate three-dimensional images of the human body model, the main body base material 11 and the mark 12 based on the three-dimensional coordinates of the point group constituting the human body model data 321, the main body base material data 322 and the mark data 323, and display them on the display unit 34.
[0279] This is based on the display processing of a stereoscopic image of point group data in the general related art.
[0280] The control unit 31 performs image processing such as enlarging, reducing, and rotating the stereoscopic image of the main body substrate 11 in accordance with the stereoscopic image of the human body model, and synthesizes the two stereoscopic images to generate a stereoscopic image assuming that the human body model is wearing the main body substrate 11.
[0281] Furthermore, the control unit 31 rotates the types of the marks 12 to rotate the synthesized image of the main body substrate 11, arranges and synthesizes the selected marks 12 on the three-dimensional image of the main body substrate 11, and generates measurement tool data.
[0282] The measuring tool data includes the three-dimensional coordinate data of the point group constituting the main body substrate 11 and the mark 12 , and the three-dimensional coordinate data of the arrangement position of the mark 12 .
[0283] (5) Configuration of the Product Data Management Server 40
[0284] The product data management server 40 is a server device that manages product data of apparel products and generates and provides a Web page for selling the apparel products.
[0285] The product data management server 40 is managed by, for example, a business operator of an EC site that sells apparel products on the Internet.
[0286] Fig. 9 1 is a diagram showing the configuration of the product data management server 40 according to the first embodiment of the present invention.
[0287] As shown in the figure, the product data management server 40 includes a control unit 41 for controlling the entire product data management server 40 , an information storage unit 42 for storing product data, and a communication unit 43 for transmitting and receiving various information to and from the measurement terminal 20 .
[0288] Each of the units 41 to 43 is connected to an internal bus, and various information and the like are input and output via the bus, and executes various processes under the control of the control unit 41 .
[0289] The control unit 41 is a processing unit that controls the entire product data management server 40 , and is composed of, for example, an electronic circuit such as a CPU (Central Processing Unit) or an integrated circuit such as an FPGA (Field-Programmable Gate Array).
[0290] The control unit 41 reads information from the information storage unit 42 and writes information to the information storage unit 42 .
[0291] The information storage unit 42 is a device for storing information, such as a hard disk, a memory, or a semiconductor element.
[0292] The information storage unit 42 includes an area for storing programs executed by the control unit 41 , a work area temporarily used when the control unit 41 executes a process, and the like (RAM, etc.).
[0293] The control unit 41 reads the program stored in the information storage unit 42, and develops it in the above-mentioned work area to execute various processes.
[0294] The communication unit 43 is an interface for controlling communication with the measurement terminal 20 via the network 100 , and includes a LAN adapter and the like.
[0295] The communication unit 33 may include a wireless transceiver and be connected to a LAN, the Internet, or the like via wireless communication, or may be connected via a wired connection such as a cable.
[0296] Fig.10 This is a diagram showing data and the like stored in the information storage unit 42 of the product data management server 40 according to the first embodiment of the present invention.
[0297] As shown in the figure, the information storage unit 42 stores a product DB 421 for managing product data.
[0298] Fig.11 This is a diagram showing an example of the data structure of the product DB 421 according to the first embodiment of the present invention.
[0299] In the example shown in the figure, product DB421 manages the product name of the clothing product, the brand supplying the clothing product, the product category, size information, color of the clothing product, pricing of the clothing product, and the inventory quantity of the clothing product by establishing a correspondence with the ID (product ID) that identifies the clothing product.
[0300] The above-mentioned product category is an item indicating the category to which the apparel product belongs.
[0301] For example, clothing products include tops, shorts, dresses, light jackets, heavy jackets, hats, handbags, small fashion items, accessories and shoes.
[0302] In addition, the product category can be set in multiple levels such as large category → small category. For example, the large category "tops" can include small categories such as "T-shirts", "Polo shirts", "Parkers", etc., so as to further subdivide the apparel product category.
[0303] The size information is an item indicating the size of the apparel product.
[0304] The size information includes not only the overall size such as SML which is generally described as the size, but also the size information of each part such as the bust, waist, hips, length, shoulder width, sleeve length, inseam, thigh circumference, etc.
[0305] [3] Operation of the First Embodiment
[0306] (1) Manufacturing operation of the dimension measuring tool 10
[0307] Fig.12 This is a flowchart showing the flow of the manufacturing operation of the sizing tool 10 according to the first embodiment of the present invention.
[0308] The following description will proceed according to this figure.
[0309] First, the provider operates the operation unit 35 of the provider terminal 30 to display a list of human body model data stored in the information storage unit 35 on the display unit 34, and selects human body model data of an appropriate human body model using the operation unit 35 (step S101).
[0310] For example, a business operator is provided with human body model data of an adult female of average body shape.
[0311] Fig.13 This is a diagram showing an example of a three-dimensional image 501 of a human body model represented by human body model data according to the first embodiment of the present invention.
[0312] The figure shows a stereoscopic image 501 of a general human body model.
[0313] Next, the provider operates the operation unit 35 of the provider terminal 30 to display the list of main body base material data stored in the information storage unit 35 on the display unit 34, and selects appropriate main body base material data using the operation unit 35 (step S102).
[0314] For example, a provider selects the main body base material data of the main body base material 11 showing the shape of a shirt.
[0315] Next, the provider operates the operation unit 35 to combine the image of the selected subject base material data with the image of the selected human body model data (step S103 ).
[0316] At this time, the provider operates the operation unit 35 to match the predetermined three-dimensional coordinates of the selected human body model data with the predetermined three-dimensional coordinates of the main body base material data, so that the provider terminal 30 generates an image of the human body model wearing the main body base material 11.
[0317] The technology for synthesizing the image of clothes and the like with the human body image may be a conventional technology and is not particularly limited.
[0318] The image of the subject substrate is appropriately enlarged, reduced, rotated, etc., in accordance with the size and shape of the image of the human body model.
[0319] Next, the provider operates the operation unit 35 to set the placement position of the marker 12 at an arbitrary position on the image of the main body base material 11 synthesized on the image of the human body model (step S104 ).
[0320] For example, when the operation unit 35 is constituted by a mouse or the like, a predetermined position on the image of the main body base material 11 displayed on the display unit 34 is clicked to set the arrangement position of the mark 12 .
[0321] As described above, the markers 12 are distinguishable from each other by shape, pattern, etc., and a marker ID as a distinguishing number is set in advance.
[0322] When setting the arrangement position of the mark 12 , the provider selects the mark ID of the mark 12 to be set and then sets the arrangement position of the mark 12 .
[0323] When setting the configuration position of the mark 12, the control unit 31 generates measuring tool data, which shows the three-dimensional coordinates of the point group representing the surface shape of the main substrate 11, the three-dimensional coordinates of the point representing the configuration position of the mark 12 in the point group, and the identification number of the mark 12 (step S104).
[0324] In the measuring tool data, the coordinates of the point where the mark 12 is arranged and the identification number of the mark 12 are associated with each other, indicating which type of mark 12 is arranged at which position on the main body substrate 11 .
[0325] In actuality, the mark 12 is a circle of about 10 to 30 mm or larger than the dot group, so the center or center of gravity of the outer shape of the mark 12 can be used as the placement position.
[0326] Fig.14 This is a diagram showing an example of a three-dimensional image 501 of a human body model represented by human body model data after the arrangement positions of the markers 12 according to the first embodiment of the present invention are set.
[0327] In the example of the figure, an image 502 showing the arrangement position of the marker 12 is shown at a set position on a three-dimensional image 501 of a human body model.
[0328] Next, the control unit 31 of the enterprise terminal 30 generates pattern paper data for manufacturing the dimension measuring tool 10 based on the measuring tool data generated as described above (step S105 ).
[0329] That is, the control unit 31 converts the three-dimensional coordinates of the main body base material 11 indicated by the measuring tool data into two-dimensional coordinates to generate pattern paper data for manufacturing the size measuring tool 10 .
[0330] Furthermore, the control unit 31 also converts the three-dimensional coordinates of the arrangement position of the mark 12 into the two-dimensional coordinates of the pattern paper. The pattern paper data includes information indicating which type of mark 12 is arranged at which position on the pattern paper.
[0331] The pattern paper data thus generated includes image data of the pattern paper for making the size measuring tool 10, and includes plane coordinates representing the outline of the pattern paper and plane coordinates converted from the three-dimensional coordinates of the measuring tool data in the pattern paper image portion.
[0332] When the provider operates the operation unit 35 to input a display request for the pattern paper data, the control unit 31 causes the display unit 34 to display the corresponding pattern paper data.
[0333] Fig.15 This is a diagram showing an example of pattern paper data according to the first embodiment of the present invention.
[0334] As shown in the figure, the pattern paper data includes pattern paper information 101 and 201 of the main body base material 11 for manufacturing the dimension measuring tool 10 and information 102 and 202 of the arrangement position of the mark 12 .
[0335] Furthermore, the plane coordinates of the sewing position of the main body base material 11 shown on the pattern paper can also be set in the pattern paper data by inputting them using the operation unit 35 by the provider.
[0336] For example, the supplier can generate the plane coordinates of the sewing position in the pattern paper data by operating the operation unit 35 such as a mouse to trace a predetermined position on the pattern paper image of the displayed main body base material 11 .
[0337] Next, a manufacturing device (not shown) of the dimension measuring tool 10 manufactures the dimension measuring tool 10 using the pattern paper data generated by the business operator terminal 30 (step S106).
[0338] The manufacturing method of the sizing tool 10 is not particularly limited. For example, when the manufacturing device of the sizing tool 10 is an information processing device including cutting and sewing functions, when the pattern paper data is input, the joint mark 12 is fixed to the main body base material 11 represented by the pattern paper data. The manufacturing device of the sizing tool 10 cuts and sews the raw material (fiber, etc.) of the main body base material 11 according to the information of the outer shape of the main body base material 11 represented by the pattern paper data, thereby manufacturing the sizing tool 10.
[0339] The manufacturing operation of the sizing tool 10 is completed as described above.
[0340] (2) User's body size measurement operation
[0341] Fig.16A This is a flowchart showing an example of a flow 200 of an operation of measuring the body dimensions of a user according to the first embodiment of the present invention.
[0342] Below, we will explain according to this diagram.
[0343] First, the measurer uses the imaging unit 26 of the measurement terminal 20 to capture a plurality of images of the user wearing the size measuring tool 10 (step S201 ).
[0344] Fig.17 This is a diagram showing a situation of a user during shooting according to the first embodiment of the present invention.
[0345] As shown in the figure, when photographing, the user stands on a substantially horizontal place such as a floor or ground, and rotates around an axis extending vertically upward from the floor or the like in the standing position during multiple photographs by the measurement terminal 20.
[0346] Thus, the measurement terminal 20 obtains plane images from multiple angles from the side of the user who is standing while wearing the size measuring tool 10. For example, by photographing the user from twelve directions (one o'clock, two o'clock, ... twelve o'clock), the measurement terminal 20 can obtain plane images from twelve directions.
[0347] At this time, the measurement terminal 20 performs imaging so that the same mark 12 is commonly included in the plurality of planar images.
[0348] The imaging unit 26 inputs a plurality of planar image data generated by the imaging to the control unit 21 .
[0349] The control unit 21 compares the shape of each mark 12 projected in the plane image in the above-mentioned multiple plane images with the shape registered in the mark DB 221, performs image recognition processing, identifies each mark 12, and uses a three-dimensional reconstruction algorithm to calculate the three-dimensional coordinates of the identified mark 12 in the plane image.
[0350] Then, the control unit 21 executes the calculation process of the three-dimensional coordinates of the markers 12 in the plurality of planar images, and calculates the three-dimensional coordinates of all the markers 12 that appear in the plurality of planar images (step S202 ).
[0351] The calculated set of three-dimensional coordinates of all the markers 12 is the above-mentioned marker measurement data.
[0352] It should be noted that the method for calculating the above-mentioned mark measurement data can be a method using existing technology. For example, it can be a method that focuses on the mark 12 that appears commonly in multiple plane images, uses triangulation technology, and finally calculates the three-dimensional coordinates of the mark 12.
[0353] In addition, at this time, the control unit 21 calculates posture information indicating the imaging position and direction of the measurement terminal 20 .
[0354] For example, here, when the control unit 21 calculates the three-dimensional coordinates of the above-mentioned marker 12 and the posture information of the measuring terminal 20, it can use a general bundle adjustment algorithm to re-project the three-dimensional coordinates of the above-mentioned marker 12 onto the plane image, and repeatedly re-estimate in a way that the distance between the position of the re-projected marker 12 and the position of the marker 12 on the plane image is minimized.
[0355] Next, the control unit 21 optimizes the value of the marker measurement data (the three-dimensional coordinates of the marker 12 ) calculated above using an optimization algorithm (step S203 ).
[0356] For example, the control unit 21 deletes coordinate values estimated to be erroneous values among the three-dimensional coordinates of the marker 12 shown in the marker measurement data.
[0357] Next, the control unit 21 generates user measurement data representing the user's body shape based on the optimized marker measurement data (step S204 ).
[0358] The user measurement data includes three-dimensional coordinates of a group of points representing the user's body surface.
[0359] At this time, the control unit 21 estimates that the markers 12 are located on the user's body surface, calculates the three-dimensional coordinates of a point group representing the user's body surface based on the three-dimensional coordinates of each marker 12, and calculates the user measurement data.
[0360] Next, the control unit 21 calculates the measured dimension data based on the user measurement data calculated as described above (step S205 ).
[0361] The measurement size data is data indicating the size of a predetermined body part of the user, for example, the size data of a body part such as height, chest circumference, waist, hips, shoulder width, and inseam that should be considered when purchasing an apparel product.
[0362] The information storage unit 22 stores data of a human body model. When the positions of the dimensions of the above-mentioned body parts are set on the human body model, the control unit 21 compares the human body model with the body shape of the user represented by the above-mentioned user measurement data, and determines the positions of the dimensions in the body shape of the user. The values of the three-dimensional coordinates of the positions of the dimensions are extracted and calculated from the user measurement data, thereby being able to calculate the dimensions of each body part of the user.
[0363] The above completes the operation of measuring the user's body dimensions.
[0364] Fig. 16B 1 is a flowchart showing an example of a process 300 for measuring body dimensions, which is another example of the flow 200 of the above-mentioned operation of measuring the body dimensions of the user. The process 300 is executed in the control unit 21 of the measurement terminal 20 .
[0365] Prior to step S301, the same operation as step S201 is performed. Thus, a plurality of images of the user wearing the size measuring tool 10 can be obtained from a plurality of directions. The obtained images of the user are input to the control unit 21 from the imaging unit 26.
[0366] When the user's image is input to the control unit 21 , the control unit 21 receives the user's image (step S301 ).
[0367] When receiving the image of the user, the 3D model construction unit 211 of the control unit 21 constructs a 3D model by deforming the default 3D model based on the default 3D model and the received image (step S302). The 3D model construction unit 211 constructs the 3D model of the user by deforming the default 3D model based on, for example, a virtual image obtained from the default 3D model and the received image. The 3D model construction unit 211 can construct the 3D model by, for example, the process 400 described later. The deformation of the default 3D model by the 3D model construction unit 211 is performed in a virtual three-dimensional space, which is a space in which the actual three-dimensional space is enlarged or reduced at a predetermined scale.
[0368] When the 3D model is constructed, the measuring unit 212 of the control unit 21 measures the body size of the constructed 3D model (step S303). The measuring unit 212 measures the body size in the virtual three-dimensional space. The measuring unit 212 can measure the body size of the 3D model using a known method.
[0369] When the body size is measured, the conversion unit 213 of the control unit 21 converts the measured body size into the actual body size (step S304). The conversion unit 213 converts the body size in the virtual three-dimensional space into the size in the actual three-dimensional space, for example, using the scale between the virtual three-dimensional space and the actual three-dimensional space. For example, if the scale between the virtual three-dimensional space and the actual three-dimensional space is X:Y, and the body size in the virtual three-dimensional space measured by the measurement unit 212 is measured as h, the body size h in the virtual three-dimensional space is converted into the size in the actual three-dimensional space (h×Y / X) by multiplying Y / X.
[0370] When the data is converted into the actual body size, the body size measurement process 300 is completed. Then, the control unit 21 calculates the measurement size data indicating the size of a predetermined body part of the user based on the actual body size.
[0371] Fig. 16C 3D model constructing section 211 is a flowchart showing an example of a process 400 for constructing a 3D model in step S302 .
[0372] The 3D model construction unit 211 obtains a virtual image from the default 3D model (step S401). The virtual image is an image of the default 3D model virtually photographed from multiple directions. At this time, the received image is preferably an image photographed from the same direction as or close to the direction in which the virtual image was photographed. This is to facilitate the comparison of the virtual image with the received image in subsequent processing. For example, in the case where the virtual image is an image of the default 3D model virtually photographed from twelve directions, namely, one o'clock, two o'clock, ... twelve o'clock, relative to the default 3D model, the received image is also preferably photographed in a manner that becomes an image of the user photographed from twelve directions, namely, one o'clock, two o'clock, ... twelve o'clock, relative to the user. In addition, the camera position at which the received image is photographed is preferably the same as or close to the camera position at which the virtual image is virtually photographed. This is to facilitate the comparison of the virtual image with the received image in subsequent processing. For example, in a case where a virtual image is virtually captured from a camera position that is approximately 2 m away from the subject and approximately 70 cm high, the received image is also preferably captured of the user in a manner that becomes an image captured from the virtual camera position that is approximately 2 m away from the subject and approximately 70 cm high.
[0373] Next, the 3D model construction unit 211 calculates the deviation between the marker in the virtual image and the corresponding marker in the received image (step S402). The deviation between the marker in the virtual image and the corresponding marker in the received image can be calculated, for example, at a pixel level.
[0374] The deviation between the marker in the virtual image and the corresponding marker in the received image is caused by, for example, the difference between the body shape of the default 3D model in the virtual image and the body shape of the user in the image, the difference between the orientation of the default 3D model in the virtual image and the orientation of the user in the image, the difference between the position and tilt of the camera that took the virtual image and the position and tilt of the camera that took the image, and the difference between the position of the marker in the virtual image and the position of the marker in the image caused by the distortion of the clothing. Therefore, the deviation ERR between a marker i in the virtual image and a corresponding marker i in the received image i For example,
[0375] ERR i =ERR i (body shape)+ERR i (Camera position)+ERR i (Towards)+ERR i (Twisted) (1)
[0376] express.
[0377] For example, the difference between the body shape of the default 3D model in the virtual image and the body shape of the user in the image can be represented by the difference in the X coordinate of the pixel at the left end of the mark and the difference in the Y coordinate of the pixel at the top end of the mark. This is because if the body shape of the default 3D model in the virtual image is different from the body shape of the user in the image, the position of the mark itself should be offset. i (Body size) can be
[0378] ERR i (Body Type) = ABS(X i dX i a)+ABS(Y i d Y i a) (2)
[0379] express.
[0380] Here, ABS() represents the absolute value, (X i d, Y i d) represents the position coordinates of marker i in the virtual image, (X i a,Y i a) represents the position coordinates of marker i within the received image.
[0381] For example, the difference between the position of the camera that took the virtual image and the position of the camera that took the image can be expressed by the difference in the horizontal width of the mark and the difference in the vertical width of the mark. This is because the size of the mark should be different when the position of the camera that took the virtual image is different from the position of the camera that took the image. i (Camera position) can be obtained by
[0382] ERR i (Camera position) = ABS (W i dW i a)+ABS(H i dH i a) (3)
[0383] express.
[0384] Here, ABS() represents an absolute value, (W i d, H i d) represents the horizontal and vertical widths of the mark i in the virtual image, (X i a,Y i a) represents the horizontal and vertical widths of the mark i in the received image.
[0385] The 3D model constructing unit 211 calculates the deviation between the marker in the virtual image and the corresponding marker in the received image for all the multiple markers, and calculates the total value ERR of the deviation.
[0386] ERR=ΣERR i (4)
[0387] At this time, when multiple images taken from multiple directions are received in step S401, the received images and virtual images taken from the same direction are grouped together, and for each group, the deviation between the mark in the virtual image and the corresponding mark in the received image can be calculated.
[0388] Next, the 3D model construction unit 211 deforms the default 3D model so that the deviation ERR calculated in step S403 is minimized (step S403). The 3D model construction unit 121 can derive the deformation that minimizes the deviation ERR using, for example, the least squares method.
[0389] For example, when equation (1), equation (2) and equation (3) are substituted into equation (4), ERR can be obtained by using the position coordinates (X i d, Y i d) Width (W i d, H id) etc. are polynomials. In this polynomial, the X i d. Y i d.W i d.H i d, etc. are variables, and the least square method can be used to find the X with the smallest ERR. i d. Y i d.W i d.H i d, etc. The 3D model construction unit 211 uses the multiple marks on the deformed 3D model to have the X with the smallest ERR. i d. Y i d.W i d.H i d, etc. to deform the default 3D model.
[0390] Next, the 3D model construction unit 211 determines whether the deviation ERR is below a predetermined threshold value (step S404). When the deviation ERR is below the predetermined threshold value, the deformed 3D model is determined as the user's 3D model, and the process 400 ends. When the deviation ERR is greater than the predetermined threshold value, the process proceeds to step S405. Here, the predetermined threshold value may be, for example, 0 or any non-zero value.
[0391] When the deviation ERR is greater than a predetermined threshold, the 3D model construction unit 211 obtains a virtual image from the deformed 3D model (step S405). The virtual image is an image of the deformed 3D model virtually photographed from multiple directions. The virtual image obtained from the deformed 3D model is preferably an image taken from the same direction and / or position as the received image, similar to the virtual image obtained from the default 3D model.
[0392] Next, the 3D model construction unit 211 repeats steps S402 to S404 using the virtual image obtained from the deformed 3D model and the deformed 3D model. This is repeated until the deviation ERR becomes equal to or less than a predetermined threshold.
[0393] In this way, a 3D model of the user is constructed.
[0394] In the above example, the case where steps S402 to S405 are repeated until the deviation becomes less than a predetermined threshold value is described, but the present invention is not limited to this. For example, steps S402 to S405 may be repeated a predetermined number of times, or steps S402 to S405 may be repeated until the deviation becomes less than a predetermined threshold value or reaches a predetermined number of times.
[0395] The user can also use the measured size data calculated by the measurement terminal 20 to search for apparel products that match his or her size and purchase them directly on the EC site.
[0396] When the user operates the operation unit 25 of the measurement terminal 20 and sends his own measured dimension data to the product data management server 40, the product data management server 40 refers to the product DB and performs a search for products that match (have the same or close dimensions as) the user's body dimensions shown in the measured dimension data.
[0397] Then, the product data management server 40 generates product search result information (web data) which is screen information including the search result and the data of the extracted products, and transmits it to the measurement terminal 20 .
[0398] When receiving the product search result information from the product data management server 40 , the measurement terminal 20 displays it.
[0399] The user can check the apparel product indicated by the product search result information and study the purchase. Furthermore, if the product search result information is a web page of an EC site, the user can purchase the apparel product by clicking a button displayed on the product search result information using the operation unit 25. The purchase process of the EC site is the same as the known process, so the description thereof is omitted.
[0400] <Summary of Implementation Methods>
[0401] As described above, in the size measuring system of the first embodiment of the present invention, when the user wears the size measuring tool 10, the measuring terminal 20 photographs the multiple marks 12 arranged on the surface of the size measuring tool 10 from multiple angles and calculates the three-dimensional coordinates of the marks 12, and calculates the size of each body part of the user based on this. Therefore, the user does not need to perform complicated operations such as measuring each body part by himself through measurement, etc., and can easily grasp the size of his body parts.
[0402] In addition, according to the present embodiment, when the product data management server 40 receives the data of the size of the user's body parts from the measurement terminal 20, it refers to the product DB, extracts the data of clothing products whose sizes of each body part are consistent or within a specified range, generates screen information representing the data of the product, and sends it to the measurement terminal 20, so that the user can easily grasp the clothing products whose sizes match his or her own.
[0403] In addition, according to the present embodiment, the size measuring tool 10 is constructed by fixing and joining a plurality of markers 12 made of a non-scalable and non-deformable material to a main base material 11 made of a stretchable material, so that when a user wears the size measuring tool 10, the main base material 11 stretches to match the user's body shape and fits the user perfectly. The position of the marker 12 changes according to the stretch of the main base material 11, so when the measuring terminal 20 calculates the position (three-dimensional coordinates) of the marker 12, it can perform the measurement of the user's body size based on it.
[0404] Furthermore, as described above, the mark 12 itself cannot be scaled or deformed, and therefore the measurement terminal 20 can perform image recognition of the mark 12 with high accuracy.
[0405] In addition, according to the present embodiment, the business terminal 30 selects the type of mark 12 based on the synthesis of the three-dimensional image of the main substrate 11 of the sizing tool 10 and the human body model, arranges the mark 12 on the three-dimensional image of the main substrate 11, generates design data for manufacturing the predetermined sizing tool 10, that is, measuring tool data, and generates drawing paper data of the sizing tool 10 based on the measuring tool data, thereby providing the business with the ability to easily manufacture the sizing tool 10.
[0406] The above-mentioned measuring terminal 20, business terminal 30 and product data management server 40 are mainly implemented by a CPU and a program loaded into a memory. However, the device or server may also be configured by a combination of any other hardware and software, and the high degree of design freedom is easily understood by those skilled in the art.
[0407] In addition, when the above-mentioned measuring terminal 20, entrepreneur terminal 30 or product data management server 40 is constructed as a software module group, the program can be recorded on a recording medium such as an optical recording medium, a magnetic recording medium, an optical magnetic recording medium or a semiconductor, loaded from the above-mentioned recording medium, or loaded from an external device connected via a prescribed network.
[0408] It should be noted that the above-mentioned embodiment is an example of a preferred implementation of the present invention, and the embodiment of the present invention is not limited thereto, and various modifications can be made without departing from the gist of the present invention.
[0409] When reading the plurality of marks 12 provided on the surface of the sizing tool 10 , the measurement terminal 20 can determine at which position of the sizing tool 10 each mark 12 is provided.
[0410] In order to distinguish each mark 12, for example, each mark 12 can be made different in shape, size, surface pattern (pattern), color or material, or a combination thereof.
[0411] Thus, the marks 12 may be marks having unique identification elements, for example, by making the surface patterns different from each other, or the identification elements of the marks 12 may be partially repeated in the same sizing tool 10 .
[0412] For example, the measurement terminal 20 may also distinguish the distinguishing elements of other marks 12 arranged around the mark 12 to be distinguished, and distinguish each mark 12 by combining the distinguishing elements of the plurality of marks 12 .
[0413] In this case, when giving a specific example, in the case where the mark 12 of the identification element B is arranged within a 5 cm radius of the mark 12 of the identification element A, and in the case where the mark 12 of the identification element C is arranged within a 5 cm radius of the mark 12 of the identification element A, the measuring terminal 20 can recognize the mark 12 of the same identification element A as different marks 12.
[0414] When the above-mentioned identification method is used, the identification elements of the surrounding marks are also managed for each mark in the mark DB 221 .
[0415] The measurement terminal 20 can also identify the marker 12 by the following method.
[0416] The measurement terminal 20 recognizes the boundary line between the dimension measuring tool 10 and the background, and measures the distance from a predetermined position of the boundary line to the arrangement position of each mark 12 .
[0417] The measurement terminal 20 combines information on the distance from a predetermined position of the boundary line to the arrangement position of each marker 12 with the identification element of the marker 12 to perform identification.
[0418] For example, the mark 12 disposed at the center of the body of the size measuring tool 10 and the mark 12 disposed at the front end of the sleeve have different distances from the boundary line, so the measurement terminal 20 can distinguish between the two marks 12 even if the distinguishing elements are the same.
[0419] When the above-described identification method is used, the mark DB 221 also manages information on the shortest distance to the boundary line for each mark 12 .
[0420] The measurement terminal 20 can also identify the marker 12 by the following method.
[0421] When distinguishing by the following method, the measuring terminal 20 stores in advance the two-dimensional or three-dimensional image information of the sizing tool 10. The image of the sizing tool 10 is divided into a plurality of regions such as the body, the right sleeve, and the left sleeve and managed.
[0422] As described above, when the measurement terminal 20 recognizes the boundary line between the size measuring tool 10 and the background, it is possible to identify the outer shape of the size measuring tool 10 .
[0423] The measuring terminal 20 uses the information of the determined appearance of the size measuring tool 10 and the image information of the size measuring tool 10 divided into the above-mentioned areas pre-stored in the information storage unit 22, and can divide the image of the size measuring tool 10 captured into multiple areas such as the area of the main body part, the area of the right sleeve part, the area of the left sleeve part, etc. for identification.
[0424] The measuring terminal 20 distinguishes each identified mark 12 by combining the identification elements of the mark 12 with the area (main body, right sleeve, left sleeve, etc.) where the mark 12 is identified. Thus, even if the identification elements of the mark 12 are the same, they can be distinguished as long as the identified areas are different.
[0425] When the above-described identification method is used, the mark DB 221 also manages information on the area in which the size measuring tool 10 is arranged for each mark 12 .
[0426] Furthermore, as described above, when the measurement terminal 20 performs image recognition on the boundary line between the size measuring tool 10 and the background, the measurement terminal 20 may correct the three-dimensional coordinates of the mark 12 using the boundary line.
[0427] For example, when the measurement terminal 20 recognizes that the three-dimensional coordinates of the mark 12 are located outside the closed boundary line representing the outer shape of the size measuring tool 10, it judges the three-dimensional coordinates of the mark 12 as an error value, deletes it or moves it to the above-mentioned boundary line, thereby improving the accuracy of the user's body size measurement.
[0428] <Second Embodiment>
[0429] Fig.18 and Fig.19 This is a diagram showing the appearance of a dimension measuring tool 10 ′ according to a second embodiment of the present invention. Fig.18 A shirt-type size measuring tool 10 ′ is shown as an example. Fig.19 A trousers-type size measuring tool 10' is shown as an example. Fig.18 and Fig.19 In Figure 2 and Figure 3 The same elements as those shown are denoted by the same reference numerals, and description thereof will be omitted.
[0430] The size measuring tool 10' includes a plurality of marks 12 and 13. As described above, the plurality of marks 12 may be unique within the size measuring tool 10', while the plurality of marks 13 may not be unique within the size measuring tool 10'. That is, the plurality of marks 13 may have the same shape, size, surface pattern (pattern), color, material, etc.
[0431] The multiple marks 12 and the multiple marks 13 may be the same size as each other, or they may be different sizes. For example, the multiple marks 12 and the multiple marks 13 may both be circles with the same diameter, or the multiple marks 12 may be circles with a larger or smaller diameter than the multiple marks 13. In one embodiment, the multiple marks 12 have a diameter of about 20 mm, and on the other hand, the multiple marks 13 have a diameter of about 10 mm. Moreover, the multiple marks 12 and the multiple marks 13 may be the same size as each other, or they may be different sizes. For example, the multiple marks 12 may be circles, and on the other hand, the multiple marks 13 may be polygonal.
[0432] The plurality of non-unique marks 13 may be arranged at any position on the main substrate. For example, when the user wears the size measuring tool 10', the plurality of non-unique marks 13 may be arranged on the main substrate in a manner such that they are arranged on at least one of the user's wrist, ankle, and neck. Fig.18 and Fig.19 In the example shown, a plurality of non-unique marks 13 are arranged on the main body base material in a manner of being arranged on the wrists, ankles, and neck of the user. The plurality of non-unique marks 13 arranged in this way can be used as a mark of the user. For example, when the user wears the size measuring tool 10', the user wears the size measuring tool 10' in a manner of being arranged on the wrists, ankles, and neck.
[0433] In the second embodiment, the measurement terminal may have a structure for distinguishing a plurality of non-unique markers 13 in addition to the same structure as the measurement terminal 20 of the first embodiment. For example, the 3D model construction unit of the control unit of the measurement terminal of the second embodiment may have a structure for distinguishing a plurality of non-unique markers 13 in addition to the same structure as the 3D model construction unit 211 of the measurement terminal 20 of the first embodiment.
[0434] The 3D model construction unit of the second embodiment can distinguish the non-unique multiple markers 13, for example, based on the relative relationship with the unique multiple markers 12. The 3D model construction unit of the second embodiment can distinguish the non-unique marker 13, for example, based on the positional relationship with one or more nearby unique markers 12. Thus, the 3D model construction unit of the second embodiment can, for example, establish a correspondence between the non-unique marker in the default 3D model and the non-unique marker in the received image, and can calculate the deviation between the non-unique marker in the default 3D model and the non-unique marker in the image with which the correspondence is established.
[0435] Thus, the measurement terminal of the second embodiment can measure the body dimensions of the user through the same processing as the measurement terminal 20 of the first embodiment.
[0436] It should be noted that, in the above-described embodiment, the measurement terminal 20 calculates the three-dimensional coordinates of the mark 12 and the user's human body, and calculates the user's body size, thereby measuring the user's body size, but the present invention is not limited to this. The user's body size can be measured by any computer system having the same structure as the control unit 21 of the above-mentioned measurement terminal 20. For example, in a server device (for example, an enterprise terminal 30 provided by an enterprise, a product data management server 40, or a server device not shown), the user's body size can be measured. In this case, the measurement terminal 20 can send the captured plane image data to the server device, and the server device replaces the measurement terminal 20 and performs processing up to the calculation of the measurement size data based on the received plane image data.
[0437] In this case, the server device may send the calculated measurement dimension data to the measurement terminal 20 , or may search for clothing products that match the user's body dimensions instead of the product data management server 40 and send the product search result information to the measurement terminal 20 .
[0438] In addition, the contents of each data and each database described in this embodiment are just examples and can be changed as appropriate.
[0439] In the above example, the case of measuring the body size of the user is described, but the present invention is not limited to this. The dimension measurement system of the present invention can measure the size of any three-dimensional object. The arbitrary three-dimensional object can be, for example, a living thing such as an animal, or a non-living thing. The dimension measurement system of the present invention can measure the overall size of a three-dimensional object, and can also measure the size of a part of the three-dimensional object. The dimension measurement tool 10, 10' of the present invention is worn on the part of the three-dimensional object where the size is to be measured (that is, the whole or a part of the three-dimensional object), and the dimension measurement system of the present invention can measure the size of the three-dimensional object through the same processing as the above processing.
[0440] Description of Reference Numerals
[0441] 10 Dimension measuring tools
[0442] 11 Main substrate
[0443] 12 Mark
[0444] 20 Measurement terminal
[0445] 21, 31, 41 Control Unit
[0446] 22, 32, 42 Information Storage Department
[0447] 23, 33, 43 Ministry of Communications
[0448] 24, 34 Display unit
[0449] 25, 35 Operation Department
[0450] 26 Photography Department
[0451] 30 Entrepreneur Terminal
[0452] 40 Product Data Management Server
[0453] 100 Network
[0454] 101, 201 Drawing paper information of main substrate
[0455] 102, 202 Marked configuration location information
[0456] 221 Tag DB
[0457] 222, 321 Human body model data
[0458] 322 Main substrate data
[0459] 323 Labeled Data
[0460] 421 Product DB
[0461] 501 Stereoscopic image of human body model
[0462] 502 flagged configuration location image
Claims
1. A computer system for determining the dimensions of a three-dimensional object, wherein: The computer system comprises: a receiving unit that receives an image of a three-dimensional object, the image being an image obtained by photographing the three-dimensional object wearing a sizing tool having a plurality of marks, each of the plurality of marks including a unique mark in the sizing tool, wherein the unique mark has a separate identification element, and the separate identification element is a plurality of points arranged in a pattern in the sizing tool; and a 3D model construction unit, which constructs the 3D model of the three-dimensional object by deforming a default 3D model having a plurality of markers corresponding to the plurality of markers and the received image, wherein the default 3D model is a basic 3D model for constructing the 3D model of the three-dimensional object, and the basic 3D model is constructed as a model having a height and a shape, The 3D model construction unit constructs the 3D model of the three-dimensional object by deforming the default 3D model based on the virtual image obtained from the default 3D model and the received image.
2. The computer system according to claim 1, wherein: The 3D model building unit is configured to: calculating deviations between a plurality of markers in the virtual image and corresponding markers in the received image; and The 3D model is constructed by deforming the default 3D model in such a way that the deviation is minimized.
3. The computer system according to claim 1, wherein: The computer system further comprises: a measuring unit that measures dimensions in the 3D model; and A conversion unit converts the measured size into an actual size, The default 3D model is deformed in a virtual three-dimensional space having a predetermined scale relative to the actual three-dimensional space. The conversion unit converts the measured size into an actual size using the scale.
4. The computer system according to claim 3, wherein: The scale between the virtual three-dimensional space and the actual three-dimensional space is predetermined by the ratio of the dimensions of the multiple marks of the default 3D model in the virtual three-dimensional space to the dimensions of the multiple marks of the sizing tool in the actual three-dimensional space.
5. The computer system according to claim 1, wherein: The plurality of indicia comprises non-unique indicia within the sizing tool, The 3D model building unit establishes a correspondence between the non-unique marker in the default 3D model and the non-unique marker in the received image based on the relative position of the non-unique marker and the unique marker.
6. The computer system according to claim 1, wherein: The three-dimensional object is a human body.
7. A dimension determination system, wherein: include: The computer system according to any one of claims 1 to 6, wherein the computer system is a terminal device of a user; and The size measuring tool.
8. The sizing system according to claim 7, wherein: The dimension measuring tool includes a main body substrate having stretchability and the plurality of marks arranged on the main body substrate, wherein the plurality of marks are not scalable.
9. A computer program product for determining the dimensions of a three-dimensional object, comprising a computer program, wherein: The computer program is executed in a computer system having a processor, and the computer program causes the processor to perform a process, the process comprising: receiving an image of a three-dimensional object, the image being an image of the three-dimensional object wearing a sizing tool having a plurality of markings, each of the plurality of markings comprising a unique marking within the sizing tool, wherein the unique marking has a single distinguishing element, the single distinguishing element being a plurality of dots arranged in a pattern within the sizing tool; and Based on a default 3D model having a plurality of markers corresponding to the plurality of markers and the received image, the 3D model of the three-dimensional object is constructed by deforming the default 3D model, wherein the default 3D model is a basic 3D model for constructing the 3D model of the three-dimensional object, and the basic 3D model is constructed as a model having a height and a shape, Wherein, constructing the 3D model includes: constructing the 3D model of the three-dimensional object by deforming the default 3D model based on the virtual image obtained from the default 3D model and the received image.
10. A method for determining the size of a three-dimensional object, comprising: receiving an image of a three-dimensional object, the image being an image of the three-dimensional object wearing a sizing tool having a plurality of markings, each of the plurality of markings comprising a unique marking within the sizing tool, wherein: The unique marking has a single distinguishing element, the single distinguishing element being a plurality of dots arranged in a pattern within the sizing tool; and Based on a default 3D model having a plurality of markers corresponding to the plurality of markers and the received image, the 3D model of the three-dimensional object is constructed by deforming the default 3D model, wherein the default 3D model is a basic 3D model for constructing the 3D model of the three-dimensional object, and the basic 3D model is constructed as a model having a height and a shape, Wherein, constructing the 3D model includes: constructing the 3D model of the three-dimensional object by deforming the default 3D model based on the virtual image obtained from the default 3D model and the received image.
Citation Information
Patent Citations
Portable information device, dimension measuring method, and computer program
JP2018019843A
System and method for 3D shape measurements and for virtual fitting room internet service
US20120095589A1
Method and system for optimised selection of footwear or clothing articles
WO2013026798A1