Hand measurement system

Abstract

To provide a hand measurement system capable of obtaining a measurement value of a prescribed portion of a hand without being restricted by a place or time.SOLUTION: A hand measurement system includes: (a) an input part 22 which receives a first image 14 obtained by photographing a hand 4 of a subject person, which is placed on a reference face 2 in a prescribed shape whose size is known, with the reference face 2 from a terminal 12; (b) an image conversion part 24 for converting the first image 14 into a second image 16 so that a shape of the reference face 2 included in the first image 14 is converted into the prescribed shape of the reference face 2; (c) a measurement part 26 for measuring the size of the prescribed portion of a hand 5 included in the second image 16 based on the known size of the reference face 2; and (d) an output part 28 for transmitting a measurement value measured by the measurement part 26 to the terminal 12.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a hand measurement system, and more particularly to a hand measurement system using a terminal. [Background technology]

[0002] Conventionally, three-dimensional measuring devices for measuring the three-dimensional shape of a hand have been proposed. For example, in the three-dimensional measuring device shown in the schematic diagram of FIG. 17, a hand is inserted into an insertion hole 81 formed in a housing 80, and the hand is placed on a transparent plate 82 arranged inside the housing 80 so that the palm touches the plate. In this state, images of the back and palm of the hand are captured using two CCD cameras 101, 102 arranged above and below the transparent plate 82. The upper CCD camera 101 captures a three-dimensional image of the back of the hand illuminated with slit light 106 at a predetermined interval. The lower CCD camera 102 captures a two-dimensional image including the palm lines on the palm side (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2004-3086 A Summary of the Invention [Problem to be solved by the invention]

[0004] It is conceivable that hand measurements taken using a 3D measuring device could be used in electronic commerce (EC) for ready-made gloves, custom-made gloves, and made-to-order gloves.

[0005] However, in order to obtain hand measurements, users must go to a location where a 3D measuring device is installed, which places restrictions on time and location, preventing progress in the use of this technology in e-commerce.

[0006] In view of the above circumstances, the problem that the present invention aims to solve is to provide a hand measurement system that can obtain measurement values ​​of specific parts of the hand without being restricted by location or time. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention provides a hand measurement system configured as follows.

[0008] The hand measurement system is (a) an input unit that receives from a terminal a first image of a subject's hand placed on a reference surface having a predetermined shape and known dimensions, together with the reference surface; (b) an image conversion unit that converts the first image into a second image such that a shape of the reference surface included in the first image is converted into the predetermined shape of the reference surface; (c) a measurement unit that measures a dimension of a predetermined part of the hand included in the second image based on the known dimension of the reference plane; and (d) an output unit that transmits the measurement value measured by the measurement unit to the terminal; Equipped with.

[0009] According to the above configuration, a predetermined part of the hand can be measured by sending a first image of the hand together with a reference plane from the terminal to the hand measurement system. If the terminal is configured to be able to connect to the hand measurement system at any time via a communication network such as the Internet, the measurement value of the predetermined part of the hand can be obtained without being restricted by place or time. The obtained measurement value can be used for electronic commerce and other services.

[0010] Preferably, the hand measurement system comprises: (e) a storage unit that stores the first image, the second image, and the measurement values ​​in association with information about the subject; It further comprises:

[0011] In this case, the data can be read out from the storage unit as necessary and used for the service.

[0012] Preferably, the measurement unit calculates a width of the back of the hand included in the second image, and calculates the circumference of the hand based on a correlation between the width of the back of the hand and the circumference of the hand.

[0013] In this case, the circumference of the hand, whose three-dimensional shape needs to be measured, can be calculated from two-dimensional data obtained by photographing the hand.

[0014] In a preferred embodiment, the first image is an image taken with the palm of the hand in contact with the reference surface.

[0015] In this case, since the hand placed on the reference surface is difficult to move, it is easy to photograph one hand with the smartphone and then photograph the other hand.

[0016] In another preferred embodiment, the first image is an image of the palm of the hand photographed with the back of the hand placed on the reference plane.

[0017] In this case, the influence of artificial nails, etc. can be eliminated and the finger length can be accurately measured. In addition, health-related services and palmistry can be provided.

[0018] In another preferred aspect, the first image includes a first captured image of the back side of the subject's hand together with the reference surface, and a second captured image of the palm side of the subject's hand together with the reference surface.

[0019] In this case, by combining information obtained from the first captured image of the back of the hand with information obtained from the second captured image of the palm of the hand, more advanced services or new services can be provided.

[0020] Preferably, the hand measurement system comprises: (f) an auxiliary measurement unit that, when two points on the second image read from the storage unit are specified, calculates a dimension between the two points; Prepare further.

[0021] In this case, it is easy to confirm or correct the measurement values ​​of the specified parts, measure additional parts, etc.

[0022] Preferably, the first image is an image of the hand of the subject placed on the reference surface with fingers spread apart, taken together with the reference surface.

[0023] In this case, the dimensions of a specific area can be measured by utilizing the webbing between adjacent fingers.

[0024] Preferably, the measurement unit calculates the dimension of the specified part of the hand based on a contour line of the hand on the second image and central positions of the joints of the hand on the second image.

[0025] In this case, by combining the hand outline and the center positions of the joints, the variation in the measurement value can be suppressed compared to when measuring using only the hand outline. Also, the finger length can be measured using the first image in which the fingers are closed.

[0026] Preferably, the measurement unit calculates, for each finger of the hand, a dimension in a direction connecting a center point of the MP joint and a center point of the IP joint or a DIP joint.

[0027] In this case, it is possible to suppress variation in the measurement value of the finger length caused by the degree to which the fingers are spread apart when photographing.

[0028] Preferably, a first point is a point obtained by dividing a line segment connecting the center point of the MP joint of the first finger and the center point of the MP joint of the second finger at a first predetermined ratio, a second point is a point obtained by dividing a line segment connecting the center point of the MP joint of the fifth finger and the center point of the radiocarpal joint at a second predetermined ratio, and a third point and a fourth point are intersections of a straight line passing through the first point and the second point and the contour line, and the measuring unit calculates the length of the line segment connecting the third point and the fourth point as the width of the back of the hand.

[0029] Compared to manual measurement using a tape measure, variation in the measurement values ​​is reduced.

[0030] Preferably, the first and second points are defined as points where a straight line that is parallel to a line segment connecting the center point of the MP joint of the first finger and the center point of the MP joint of the fifth finger and passes through the center point of the radiocarpal joint of the wrist intersects with the contour line, and the measurement unit calculates the length of the line segment connecting the first point and the second point as the wrist width.

[0031] In this case, the wrist width can be measured accurately even if the orientation of the hand placed on the reference plane during shooting varies.

[0032] Preferably, a first point is an intersection point between a straight line that is perpendicular to the line segment connecting the center point of the MP joint of the first finger and the center point of the IP joint of the first finger and the contour line of the second finger side of the first finger, a second point is an intersection point between a straight line that passes through the first point and is parallel to the line segment connecting the center point of the MP joint of the first finger and the center point of the IP joint of the IP joint of the first finger and the line segment connecting the center point of the MP joint of the first finger and the center point of the MP joint of the second finger, and a third point is a point where a straight line that passes through the midpoint of the line segment connecting the center point of the MP joint of the second finger and the center point of the MP joint of the third finger and has an angle equal to the line segment connecting the center point of the MP joint of the second finger and the center point of the PIP joint of the third finger intersects with the contour line, and the measurement unit calculates the length of the line segment connecting the second point and the third point as a finger descent.

[0033] When making custom gloves with the thumb sewn to the glove body, the finger drop measurement can be used to determine the position where the thumb is sewn to the glove body.

[0034] Preferably, the measurement unit calculates an angle between a first line passing through a center point of the MP joint and a center point of the IP joint of the first finger and a second line passing through a center point of the MP joint and a center point of the PIP joint of the second finger. The output unit transmits data on the angle to the terminal.

[0035] In this case, if the measured angle falls outside a predetermined range in which the finger descent can be accurately measured, it is possible to prompt the user to remeasure.

[0036] The present invention also provides a reference surface member.

[0037] The reference surface member is a plate- or sheet-shaped member used to capture the first image in the above-described hand measurement system, and has the reference surface on which the hand of the person being measured is placed.

[0038] By using the reference surface member, the dimensions of the hand can be measured accurately, which can promote the use of hand measurement systems. Effect of the Invention

[0039] According to the present invention, it is possible to provide a hand measurement system that can easily obtain hand measurements without being restricted by location or time. The obtained hand measurements can be used for electronic commerce and other services. [Brief description of the drawings]

[0040] [Figure 1] FIG. 1 is a block diagram showing the overall configuration of a hand measurement system (Example 1). [Diagram 2] FIG. 2(a) is an image diagram of the first image, and FIG. 2(b) is an image diagram of the second image. (Example 1) [Diagram 3] FIG. 3 is an explanatory diagram of image conversion (Example 1). [Figure 4] FIG. 4 is an explanatory diagram of a hand joint model (Example 1). [Diagram 5] FIG. 5 is an explanatory diagram of the measurement site (Example 1). [Figure 6] FIG. 6 is an explanatory diagram of the shell width. (Example 1) [Figure 7] FIG. 7 is an explanatory diagram of finger down movement (Example 1). [Figure 8] FIG. 8 is an image of the screen display on the terminal (Example 1). [Figure 9] FIG. 9 is an image of the screen display on the terminal (Example 1). [Figure 10]FIG. 10 is a flow chart showing the overall processing of the hand measurement system (Example 1). [Figure 11] FIG. 11 is a flow chart showing the overall processing of the hand measurement system (Example 1). [Figure 12] FIG. 12 is a flow chart showing the overall processing of the hand measurement system (Example 1). [Figure 13] FIG. 13 is an explanatory diagram of the measurement plate (Modification 1 of the first embodiment). [Figure 14] FIG. 14 is a graph showing the measurement results of the instep width and hand circumference (Modification 2 of Example 1). [Figure 15] FIG. 15 is an explanatory diagram of measured values ​​of a specific part of the hand (Modification 3 of Example 1). [Figure 16] FIG. 16 is a conceptual diagram of a screen display on a terminal (Modification 4 of Example 1). [Figure 17] FIG. 17 is a schematic diagram of a three-dimensional hand measurement device (conventional example 1). DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0041] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0042] Example 1 A hand measurement system according to Example 1 will be described with reference to Figs.

[0043] Fig. 1 is a block diagram showing the overall configuration of a hand measurement system 10. Fig. 2(a) is an image diagram of a first image 14. Fig. 2(b) is an image diagram of a second image 16. Fig. 3 is an explanatory diagram of image conversion. Fig. 4 is an explanatory diagram of a hand joint model 18. Fig. 5 is an explanatory diagram of measurement sites R1 to R8 of the hand.

[0044] As shown in FIG. 1, a hand measurement system 10 is configured such that one or more terminals 12 are connected to a measurement server 20 and a service providing server 40 via a communication network such as the Internet.

[0045] The terminal 12 is a smartphone, a tablet with a camera, or the like, and is used to transmit data of a first image 14 (see FIG. 2(a)) of a hand. The terminal 12 can also be a personal computer connected to a camera, or the like.

[0046] The measurement server 20 converts a first image 14 of a hand into a second image 16 as shown in Fig. 2, and applies a joint model 18 shown in Fig. 4 to the second image 16 to measure dimensions of predetermined parts R1 to R8 of the hand as shown in Fig. 5. The service providing server 40 provides various services using the measurement values ​​obtained by the measurement server 20. The measurement server 20 and the service providing server 40 may be configured on one or more servers, or may be configured on a cloud server.

[0047] 1, the measurement server 20 includes an input unit 22, an image conversion unit 24, a measurement unit 26, an output unit 28, and a storage unit 30, and is configured using, for example, a web application. Some of the functions of the measurement server 20 may be substituted by an application installed in the terminal 12.

[0048] The input unit 22 receives various data 12a including data on a first image 14 of a hand from the terminal 12. As shown in Fig. 2(a), the first image 14 is an image of a hand 4 of a subject placed with fingers spread on a reference surface 2 of a predetermined shape with known dimensions (e.g., a blank sheet of A4 size paper), together with the reference surface 2. When an image is taken with the fingers spread, the dimensions of a predetermined part can be measured using the webbing between adjacent fingers.

[0049] The image conversion unit 24 receives the data 14a of the first image from the input unit 22 and converts it into data 16a of the second image 16. As shown in Fig. 2(b) , the second image 16 is an image obtained by converting the first image 14 such that the shape of the reference surface 2 included in the first image 14 is converted into a predetermined shape of the reference surface 2 (e.g., a rectangle).

[0050] In detail, when the image conversion unit 24 receives the first image data 14a, the image conversion unit 24 performs pre-processing such as noise removal, smoothing, etc. For example, it adjusts the color balance to remove the influence of the light source and removes shadows.

[0051] Next, the contour line of the reference surface 2 is extracted by edge extraction, and the four corner points 2a to 2d of the reference surface 2 shown in FIG. 2(a) are extracted based on sudden changes in the direction of the contour line.

[0052] Next, the image conversion unit 24 converts the first image 14 into a second image 16 so that the shape of the reference surface 2 (e.g., a distorted square) is converted into a predetermined shape (e.g., a rectangle) with known dimensions, as shown in FIG. 2(b).

[0053] For example, the entire first image 14 is subjected to trapezoidal correction so that the long and short sides connecting the corner points 3a to 3d of the four corners of the reference surface 3 contained in the second image 16 intersect at right angles and the ratio of the long and short sides matches the ratio of the known long and short side dimensions of the reference surface 2.

[0054] Although the calculation process takes longer, the curvature distortion may be corrected so that each side of the reference plane 3 included in the second image 16 becomes a straight line.

[0055] It should be noted that the second image 16 does not have to be an image obtained by converting the entire first image 14, but may be, for example, an image obtained by converting only the image of the hand 4 and a portion of the area around it in the first image 14, or an image obtained by converting only the image of the hand 4.

[0056] The measurement unit 26 receives data 16a of the second image 16 from the image conversion unit 24, and measures the dimensions of a specific part of the hand 5 included in the second image 16 based on the known dimensions of the reference surface 2, i.e., based on the dimensional ratio between the reference surface 3 actually or virtually included in the second image 16 and the specific part, as follows:

[0057] The measurement unit 26 extracts a contour line 6 of the hand 5 based on, for example, the difference in brightness between the reference surface 3 and the hand 5, as shown in FIG. 3(a).

[0058] Furthermore, as shown in FIG. 3(b), the measurement unit 26 applies the joint model 18 to the second image 16 using an AI image processing technology (for example, MediaPipe provided by Google) and calculates the center positions, i.e., the coordinate values ​​of the center points, of the joints K0 to K3, K5 to K7, K9 to K11, K13 to K15, and K17 to K19 of the hand 5 on the second image 16.

[0059] The joint K0 shown in Figure 4 is the radiocarpal joint. The joints K2, K5, K9, K13, and K17 are metacarpophalangeal joints (MP joints). The joint K3 is an interphalangeal joint (IP joint). The joints K6, K10, K14, and K18 are proximal interphalangeal joints (PIP joints). The joints K7, K11, K15, and K19 are distal interphalangeal joints (DPI joints).

[0060] Next, the dimensions of predetermined regions R1 to R8 (see FIG. 5) of the hand 5 on the second image 16 are measured based on the contour line 6 of the hand 5 and the center points of the joints K0 to K3, K5 to K7, K9 to K11, K13 to K15, and K17 to K19 of the hand 5.

[0061] (R1 to R5) For each finger (i = 1, 2, . . . , 5), the finger length Ri is calculated as the dimension in the direction of the finger reference line connecting the center point of the MP joint K2, K5, K9, K13, K17 and the center point of the IP joint K3 or the DIP joint K7, K11, K16, K19.

[0062] For example, it is calculated using the following formula (1). Ri=Li-Di (1) Here, Li is the length of a line segment that connects the center points of the MP joints K2, K5, K9, K13, and K17 for each finger (i=1, 2, . . . , 5) to the center points of the MP joints K2, K5, K9, K13, and K17. Di is a correction value, and is, for example, a value obtained by multiplying the length of a line segment that connects the center points of the MP joints K2, K5, K9, K13, and K17 to the center points of the IP joints K3 or the DIP joints K7, K11, K15, and K19.

[0063] It is possible to measure the finger lengths R1 to R5 using only the contour lines as in Modification 3 described below, but in this case, the measurement values ​​will vary depending on the degree to which the fingers are spread apart when photographed. In contrast, if the direction of the finger reference line is determined based on the center positions of the joints and the finger lengths R1 to R5 are calculated, the variation in the measurement values ​​can be suppressed.

[0064] (R6) The instep width R6 is calculated based on the center positions of the MP joints K2, K5, K17 and the radiocarpal joint K0 and the contour line 6.

[0065] That is, the first point P1 is a point obtained by dividing the first line segment connecting the center point of the MP joint K5 of the second finger and the center point of the MP joint K2 of the first finger at a predetermined ratio (for example, 1:2). The second point P2 is a point obtained by dividing the second line segment connecting the center point of the MP joint K17 of the fifth finger and the center point of the radiocarpal joint K0 of the wrist at a predetermined ratio (for example, 1:3). The intersections of the straight line passing through the first point P1 and the second point P2 and the contour line 6 are the third point P3 and the fourth point P4. The length of the line segment connecting the third point P3 and the fourth point P4 is calculated as the instep width R6.

[0066] When the instep width R6 is measured in this manner, the variation in the measurement values ​​is reduced compared to when it is measured manually using a tape measure.

[0067] (R7) Wrist width R7 is calculated based on the positions of the center points of the MP joints K2, 17 and the radiocarpal joint K0 and the contour line 6.

[0068] That is, the first and second points are the points where a straight line that passes through the center point of the radiocarpal joint K0 of the wrist and is parallel to a line segment connecting the center point of the MP joint K2 of the first finger and the center point of the MP joint K17 of the fifth finger intersects with the contour line 6. The length of the line segment connecting the first and second points is calculated as the wrist width R7.

[0069] By measuring wrist width R7 in this manner, wrist width R7 can be accurately measured even if the orientation of the hand placed on the reference plane during shooting varies.

[0070] (R8) The finger drop R8 is calculated based on the center positions of the MP joints K2, K5, K9 and the IP joint K3 and the contour line 6.

[0071] That is, as shown in FIG. 7, the first point 90 is the intersection of a straight line that is perpendicular to the line segment connecting the center point of the MP joint K2 of the first finger and the center point of the IP joint K3 of the first finger and passes through the center point of the IP joint K3 of the first finger, and the contour line 6 on the second finger side of the first finger.

[0072] The second point 92 is the intersection of a straight line 91 that passes through the first point 90 and is parallel to the line segment connecting the center point of the MP joint K2 of the first finger and the center point of the IP joint K3, and a line segment connecting the center point of the MP joint K2 of the first finger and the center point of the MP joint K5 of the second finger.

[0073] A third point 95 is a point where a straight line 94, which passes through a midpoint 93 of a line segment connecting the center point of the MP joint K5 of the second finger and the center point of the MP joint K9 of the third finger, and has an angle with respect to a line segment connecting the center point of the MP joint K5 of the second finger and the center point of the PIP joint K6, and an angle with respect to a line segment connecting the center point of the MP joint K9 of the third finger and the center point of the PIP joint K10, intersects with the contour line 6 between the second and third fingers.

[0074] The measurement unit 26 calculates the length of the line segment connecting the second point 92 and the third point 95 as the finger down position R8.

[0075] (Opening Angle) When the opening angle between the first finger and the second finger falls outside a predetermined range, the measurement value of the finger down R8 varies widely. Therefore, the measurement unit 26 measures the opening angle.

[0076] That is, the angle between a line passing through the center point of the MP joint K2 and the center point of the IP joint K3 of the first finger and a line passing through the center point of the MP joint K5 and the center point of the PIP joint K6 of the second finger is calculated as the opening angle.

[0077] The finger drop R8 is a dimension required to determine the position where the thumb part is sewn to the glove body when making a custom-made glove by sewing the thumb part to the glove body, and is not used when selecting a ready-made glove. Therefore, the measurement unit 26 may first measure the predetermined parts R1 to R7, and later measure the finger drop R8 and the opening angle using the second image 16 stored in the memory unit 30 as necessary.

[0078] The output unit 28 receives measurement value data 17 measured by the measurement unit 26 from the measurement unit 26, transmits various data 21a including at least a portion of the measurement value data 17 to the terminal 12, and, if necessary, transmits various data 21b including the measurement value data 17 to the service providing server 40.

[0079] The output unit 28 transmits data on the spread angle between the first finger and the second finger measured by the measurement unit 26 to the terminal 12. This allows the terminal 12 to prompt the user to measure again when the spread angle between the first finger and the second finger falls outside a predetermined range in which the finger descent can be accurately measured. Whether the spread angle between the first finger and the second finger is within the predetermined range (e.g., 35° or more and 40° or less) may be determined by the measurement unit 26, the output unit 28, or the terminal 12.

[0080] The storage unit 30 is a database that receives various data 21c from the output unit 28, and stores the first image data 14a, the second image data 16a, and the measurement value data 17 in association with information about the subject.

[0081] The output unit 28 reads out various data 21d stored in the storage unit 30. For example, the output unit 28 reads out from the storage unit 30 information related to the selected subject, data of the first image, data of the second image, and / or data of the measurement value corresponding to the selected subject.

[0082] The service providing server 40 communicates with the terminal 12 as indicated by arrows 41a and 41b, and uses the data 21b received from the output unit 28 of the measurement server 20 to provide various services.

[0083] In addition, the data 16a of the second image 16 generated by the image conversion unit 24 from the data 14a of the first image 14 and / or the measurement data 17 of specific parts R1 to R8 of the hand 5 may be provided by the output unit 28 to the terminal 12 and / or the service providing server 40 without being stored in the memory unit 30, and the respective data may be stored in the terminal 12 and / or the service providing server 40.

[0084] Next, the operation of hand measurement system 10 will be described with reference to Fig. 8 to Fig. 12. Fig. 8 and Fig. 9 are image diagrams of screen displays of terminal 12. Fig. 10 to Fig. 12 are overall processing flow diagrams of hand measurement system 10.

[0085] First, the terminal 12 is used to access the measurement server 20 .

[0086] Figure 8(a) shows the top page of the site. When measurement is selected from the menu on the top page, a page explaining the measurement procedure is displayed, as shown in Figure 8(b).

[0087] For example, when a two-dimensional code displayed on a product tag, advertisement, etc. is photographed with the camera of terminal 12 and measurement server 20 is accessed, a page explaining the measurement procedure shown in Figure 8(b) is displayed on terminal 12.

[0088] Next, information about the person to be measured is entered according to the screen display of the terminal 12, and the hand 4 is photographed by the camera of the terminal 12. Fig. 8(c) shows the screen display of the measurement page.

[0089] When photographing a hand, if the palm is in contact with the reference surface 2 as shown in FIG. 2(a), the hand 4 placed on the reference surface 2 is difficult to move, so the hand 4 can be easily photographed by operating the terminal 12 with the other hand.

[0090] If necessary, the hand is photographed again or the other hand is photographed. Data of the photographed first image 14 is transmitted from the terminal to the measurement server 20, and the measurement server 20 measures the dimensions of a predetermined part of the hand based on the data of the first image 14. The measurement results are stored in the memory unit 30 and transmitted to the terminal 12.

[0091] The terminal 12 displays the measurement results as shown in Figures 8(a) and 8(b), and also displays buttons, banners, etc. that link to services that use the measurement results (e.g., membership registration, glove ordering, etc.). This allows the hand measurement results to be used for e-commerce and other services.

[0092] As described above, the dimensions of a specific part of the hand can be measured by transmitting the first image 14, which is an image of the hand 4 together with the reference plane 2, from the terminal 12 to the measurement server 20. If the terminal 12 is configured to be able to connect to the measurement server 20 at any time via a communication network such as the Internet, the measurement values ​​of the specific part of the hand can be obtained without being restricted by location or time. The obtained measurement values ​​can be used for electronic commerce and other services.

[0093] In addition, by storing the first image 14, the second image 16, and the measurement values ​​in memory unit 30 in association with information about the person being measured (e.g., member registration information), the data can be read out from memory unit 30 and used as needed in a service that allows the purchase of ready-made gloves, ordering of custom-made gloves, etc.

[0094] Furthermore, when the dimensions of a predetermined part are measured using a combination of the hand contour and the center positions of the joints, the variation in the measurement value can be suppressed compared to when measurements are taken using only the hand contour as in Modification Example 3 described below. This is because while the contour 6 of the hand 5 in the second image 16 is easily affected by the degree to which the fingers are spread when photographed and the photographing direction, the center positions of the joints of the hand 5 in the second image 16 are less susceptible to such effects.

[0095] Furthermore, by measuring the dimensions of a specific part by combining the outline of the hand and the center positions of the joints, the finger length can be measured using the first image in which the fingers are closed.

[0096] <Modification 1> A plate- or sheet-shaped reference surface member having a reference surface 2 may be used to photograph a hand.

[0097] Fig. 13 is an image diagram of a measurement plate 2x, which is a plate-shaped reference surface member. As shown in Fig. 13, the measurement plate 2x is divided into a reference surface 2s and an outer edge surface 2t that surrounds the periphery of the reference surface 2s. The outer edge surface 2t has a different brightness and / or saturation from the reference surface 2s so that the four corner points of the reference surface 2s can be accurately extracted.

[0098] The dimensions of the measurement plate 2x can be selected appropriately. For example, if both hands 4a, 4b can be placed on the reference surface 2s at the same time, a person other than the person being measured can simultaneously photograph both hands 4a, 4b of the person being measured at an event venue, a store, etc. In this case, by keeping the photographing conditions (lighting, camera direction, etc.) constant, the dimensions of the hand can be accurately measured based on the first image 14 with little variation.

[0099] Furthermore, printed materials such as pamphlets, flyers, and leaflets may be printed with instructions on how to operate hand measurement system 10 and terminal 12, and may also be provided with a portion to be used as reference surface 2. In this case, a figure indicating the position to place the hand or a figure for specifying the shape and dimensions of reference surface 2 may be printed on the portion to be used as reference surface 2. By distributing such a sheet-like reference surface member, it is possible to promote the use of hand measurement system 10.

[0100] <Modification 2> The measuring unit 26 may calculate the hand circumference using the instep width R6.

[0101] Figure 14 is a graph showing the results of measuring the instep width and hand circumference of 35 subjects using a tape measure. The x-axis is instep width (cm) and the y-axis is hand circumference (cm). The straight line of the following formula (2) determined by the least squares method and the 95% confidence interval are shown. y=1.918x+3.790 (2)

[0102] The hand circumference can be calculated from the measurement of the instep width R7 using formula (2). In this case, the hand circumference, which is a measurement of the three-dimensional shape, can be calculated from a two-dimensional image of the hand.

[0103] <Modification 3> It is also possible to measure the dimensions of a predetermined part of the hand based only on the contour line 6 extracted from the second image 16. Fig. 15 is an explanatory diagram of the measurement values ​​of a predetermined part of the hand.

[0104] 15, the measurement unit of the third modification extracts a contour 6 for the second image 16, identifies feature points 51-64 on the contour 6 based on minimum points, maximum points, inflection points, and the like of the radius of curvature of the contour 6, and calculates the dimensions of predetermined regions R1-R7 of the hand defined by the feature points 51-64 based on the known dimensions of the reference plane 2. The feature points 51-64 include fingertips 51-55, bases of the fingers 56-62, and wrist waists 63, 64.

[0105] For example, finger lengths R1-R5 are measured by measuring the length of the line segment connecting fingertips 51-55 and midpoints 71-75 of bases 56-62 on both sides of the fingers. Instep width R6 is measured by measuring the length of the line segment connecting bases 58, 62 on the outside of the second and fifth fingers. Wrist width 67 is measured by measuring the length of the line segment connecting waists 63, 64 of the wrist.

[0106] The definitions of the feature points 51 to 64 and the predetermined parts R1 to R7 of the hand are merely examples, and the definition and number of the predetermined parts to be measured may be selected appropriately.

[0107] <Modification 4> In the first embodiment, the first image capturing the back of the hand is used. However, the back and palm of the hand may be captured and the captured images of the back and palm of the hand may be used as the first image.

[0108] For example, Fig. 16(a) is an image diagram of the screen display of the terminal during shooting. By shooting the hand according to the instructions displayed on the terminal screen, a first photographed image 42a including the back side 4s of the hand photographed together with the reference plane 2 and a second photographed image 42b including the palm side 4t of the hand photographed together with the reference plane 2 are displayed on the terminal screen as shown in Fig. 16(a).

[0109] When the subject checks the photographed images and performs a predetermined operation, the terminal transmits the first and second photographed images 42a, 42b as a first image to the input unit 22 (see FIG. 1) of the measurement server 20. The image conversion unit 24 (see FIG. 1) converts the first image into a second image in the same manner as in the first embodiment, and the measurement unit 26 (see FIG. 1) measures the dimensions of the predetermined part in the second image into which the first photographed image 42a of the back of the hand is converted in the same manner as in the first embodiment, and measures the dimensions of the predetermined part in the second image into which the second photographed image 42b of the palm side is converted in the same manner as in the back of the hand. The definition of the dimensions of the predetermined part may be different between the back of the hand and the palm side. There may be a predetermined part that is measured only on one of the back of the hand or the palm side.

[0110] The output unit 28 (see FIG. 1) transmits the measurement results to the terminal. FIG. 16(b) is an image diagram of the terminal screen display on which the measurement results are displayed. As shown in FIG. 16(b), the terminal screen displays measurement images 44 of the back and palm sides used for measurement, measurement site images 46 in which a line segment indicating the specified site where the dimension was measured is superimposed on measurement image 44, and numerical data 48 of the measurement results of the dimension of the specified site. Note that the amount of information displayed on the terminal may be reduced or increased.

[0111] The second photographed image 42b of the palm side 4t of the hand contains a lot of information such as the skin line, fleshiness, and blood color, and the measuring unit 26 (see FIG. 1) may be configured to calculate the feature quantities of this information. This process may be executed simultaneously with the measurement of the predetermined part, or may be executed by reading data from the storage unit 30 (see FIG. 1) as necessary after the measurement of the predetermined part.

[0112] By combining information obtained from the first photographed image 42a of the back side 4s of the hand with information obtained from the second photographed image 42b of the palm side 4t of the hand, more advanced services or new services can be provided.

[0113] <Modification 5> An auxiliary measurement unit may be provided that measures the length of a line segment connecting any two points on the second image 16. In this case, the auxiliary measurement unit is configured to calculate the dimension between the two points when two points on the second image 16 read from the storage unit 30 are specified.

[0114] For example, when manufacturing custom-made gloves, the second image 16 is read from the memory unit 30, and the auxiliary measurement unit is used to confirm the measurement values, remeasure, and measure additional parts such as finger width, etc. This allows for the manufacturing of gloves that fit better.

[0115] <Variation 6> Hand 4 may be placed on reference plane 2 with the back of the hand, rather than the palm, touching it, and the dimensions of a specified part of the hand may be calculated using a first image capturing the palm of hand 4 together with reference plane 2.

[0116] In this case, even if the user has artificial nails, the outline of the finger can be accurately extracted, and the finger lengths R1 to R5 can be accurately measured. It is also possible to determine the base points of the finger lengths R1 to R5 based on the wrinkles at the base of the fingers. Furthermore, the captured image of the palm can be used to provide health-related services, palmistry, and other services.

[0117] As described above, by using the hand measurement system 10 with the terminal 12, it is possible to obtain measurements of a specific part of the hand without being restricted by location or time. The obtained measurements can be used for electronic commerce and other services.

[0118] Furthermore, by measuring the dimensions of a specific part by combining the outline of the hand and the center positions of the joints, variation in the measurement values ​​can be reduced.

[0119] The photographed image of the hand and the measurement results of the specified parts are used for the following services, for example: (a) Sales of ready-made gloves, proposing suitable sized ready-made gloves based on the measurements of the hand 4. (b) Manufacturing of custom-made gloves using the measurements of the hand 4. (c) A service that provides health-related information by observing the color of the nails and hands from photographed images of the hand. (d) Photographed images of the hand are used for recording and suggestions in beauty services such as nail art. (e) A personal health record service that compiles hand images and measurement data into a database and utilizes them to live a more enriching life. (f) Palmistry using photographed images of the hand.

[0120] The present invention is not limited to the above-described embodiment, but can be implemented with various modifications.

[0121] For example, the definition of the predetermined part of the hand to be measured may be changed. The reference surface on which the hand is placed is not limited to a rectangular shape of a single color, and may be modified in various ways, and may be colored, patterned, or have a shape, etc.

[0122] Moreover, the first embodiment may be combined with two or more of the first to sixth modifications. For example, captured images of the back and palm sides of both hands may be used as the first images. [Explanation of symbols]

[0123] 2,2s,3 Reference plane 2x measurement plate (reference surface member) 4,4a,4b,5 moves 4s Back of hand 4t Palm side 6 Contour 10 Hand Measurement System 12 Terminal 14 1st image 16 2nd image 22 Input section 24 Image conversion section 26 Measurement section 28 Output section 30 Storage section 42a First image 42b Second image R1~R5 Finger length (specified part) R6 Instep width (specified part) R7 Wrist width (specified part) R8 Finger down (specified area) K0 Radiocarpal joint K2, K5, K9, K13, K17 MP joints K3 IP joint K6, K10, K14, K18 PIP joint K7, K11, K15, K19 DIP joints

Claims

1. An input unit that receives, from a terminal, a first image obtained by photographing a hand of a person to be measured placed on a reference plane having a predetermined shape with a known dimension, together with the reference plane; An image conversion unit that converts the first image into a second image so that the shape of the reference plane included in the first image is converted into the predetermined shape of the reference plane; A measurement unit that measures the dimension of a predetermined part of the hand included in the second image based on the known dimension of the reference plane; An output unit that transmits a measurement value measured by the measurement unit to the terminal; A hand measurement system comprising:

2. The hand measurement system according to claim 1, further comprising a storage unit that stores the first image, the second image, and the measurement value in association with information about the person to be measured.

3. The hand measurement system according to claim 1, wherein the measurement unit calculates a dimension of the back width of the hand included in the second image, and calculates the dimension of the hand circumference based on a correlation between the dimension of the back width and the dimension of the hand circumference.

4. The hand measurement system according to claim 1, wherein the first image is an image obtained by photographing the hand with the palm of the hand in contact with the reference plane.

5. The first image is a first captured image obtained by photographing the back side of the hand of the subject together with the reference plane, a second captured image obtained by photographing the palm side of the hand of the subject together with the reference plane, The hand measurement system according to claim 1, comprising:

6. The hand measurement system according to claim 1, wherein the first image is an image obtained by photographing the palm of the hand with the back of the hand placed on the reference plane.

7. The hand measurement system according to claim 1, further comprising an auxiliary measurement unit that calculates a dimension between two specified points on the second image when the two points on the second image read from the storage unit are specified.

8. The hand measurement system according to claim 1, wherein the first image is an image obtained by photographing the hand of the person to be measured placed on the reference plane with the fingers spread apart, together with the reference plane.

9. The measurement unit calculates the dimension of the predetermined part of the hand based on the contour line of the hand on the second image and the center position of the joint of the hand on the second image. The hand measurement system according to any one of claims 1 to 8.

10. The hand measurement system according to claim 9, wherein the measurement unit calculates a dimension in a direction connecting the center point of the MP joint and the center point of the IP joint or the DIP joint for each finger of the hand.

11. A point that divides the line segment connecting the center point of the MP joint of the first finger and the center point of the MP joint of the second finger at a first predetermined ratio is defined as the first point, and a point that divides the line segment connecting the center point of the MP joint of the fifth finger and the center point of the radiocarpal joint at a second predetermined ratio is defined as the second point. When the intersection points of the straight line passing through the first point and the second point and the contour line are defined as the third point and the fourth point, The measuring unit calculates the length of the line segment connecting the third point and the fourth point as the back-of-hand width, for the hand measurement system according to claim 9. **Claim 12** When the intersection points of the straight line parallel to the line segment connecting the center point of the MP joint of the first finger and the center point of the MP joint of the fifth finger and passing through the center point of the radiocarpal joint of the wrist and the contour line are defined as the first point and the second point, The measuring unit calculates the length of the line segment connecting the first point and the second point as the wrist width, for the hand measurement system according to claim 9. **Claim 13** A point of intersection of a straight line perpendicular to the line segment connecting the center point of the MP joint and the center point of the IP joint of the first finger and passing through the center point of the IP joint of the first finger and the contour line on the second finger side of the first finger is defined as the first point. A point of intersection of a straight line passing through the first point and parallel to the line segment connecting the center point of the MP joint and the center point of the IP joint of the first finger and the line segment connecting the center point of the MP joint of the first finger and the center point of the MP joint of the second finger is defined as the second point. When a point of intersection of a straight line passing through the midpoint of the line segment connecting the center point of the MP joint of the second finger and the center point of the MP joint of the third finger and having equal angles with respect to the line segment connecting the center point of the MP joint and the center point of the PIP joint of the second finger and the line segment connecting the center point of the MP joint and the center point of the PIP joint of the third finger and the contour line is defined as the third point, The measuring unit calculates the length of the line segment connecting the second point and the third point as the finger drop, for the hand measurement system according to claim 9. **Claim 14** The measuring unit calculates the angle formed by a first straight line passing through the center point of the MP joint and the center point of the IP joint of the first finger and a second straight line passing through the center point of the MP joint and the center point of the PIP joint of the second finger. The output unit transmits data regarding the angle to the terminal, for the hand measurement system according to claim 9. **Claim 15** In the hand measurement system according to any one of claims 1 to 8, a plate-shaped or sheet-shaped member used for taking the first image, A reference surface member having the reference surface on which the hand of the measurer is placed.

Images