Method, system and program for measuring height

Abstract

To provide an improved method for measuring the body height of a subject, e.g., an infant.SOLUTION: A method (100) includes g a head top position determination step (110) of determining, by a computer, a position representing a head top of a subject for determining a body height of the subject. The method (100) determines the position representing the head top on the basis of at least a position of a waist of the subject and a position representing the head part of the subject.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to taking height measurements, for example of infants and young children. [Background technology]

[0002] It is recognized that there is a correlation between a child's nutritional status (which is roughly equivalent to poverty) and their height. For example, UNICEF is trying to obtain accurate height measurement data for children in order to understand the nutritional status of children (including infants) in each country.

[0003] However, it is difficult to measure the height of infants and young children using conventional height measuring devices that are also used by adults. Other conventional methods require skill to measure height accurately, and measuring the height of the infants and young children places a burden on them. Therefore, especially in developing countries, it is difficult to measure the height of infants and young children accurately due to environmental factors.

[0004] In this regard, there is a body measurement method etc. that can measure height while the body is in a lying position (Patent Document 1). In this body measurement method etc., at least two points including the top of the head and the soles of the feet are set as measurement points in the process of measuring height (paragraph

[0027] ). However, Patent Document 1 does not disclose a specific method for automatically determining the top of the head and the soles of the feet. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2016-96988 A Summary of the Invention [Problem to be solved by the invention]

[0006] The present disclosure has been made in view of the above, and one of its objectives is to provide an improved method for measuring the height of a subject, such as an infant.

[0007] Needless to say, measuring the height of a subject is determining the height of the subject, and vice versa. Furthermore, if the components included in a method for measuring or determining the height of a subject are improved with respect to measuring or determining the height of a subject, the method is improved. In other words, the above problem can be said to be to provide improved components included in a method for measuring or determining the height of a subject. [Means for solving the problem]

[0008] According to one embodiment of the present disclosure, there is provided a method for determining a height of a subject, the method including a top position determination step in which a computer determines a position representative of the top of the head of the subject, the position representative of the top of the head being determined based at least on a position representative of the subject's waist and a position representative of the subject's head.

[0009] It is noted that the step of determining a location representative of the top of the subject's head for determining the subject's height improves the method for measuring or determining the height of a subject, in other words, the step of determining a location representative of the top of the subject's head for determining the subject's height is an improved component of the method for measuring or determining the height of a subject, and thus the method solves the problem of the present disclosure.

[0010] In one embodiment, the top of the head position determining step may further include a step of determining one or more points that are top of the head position candidates among a plurality of points included in the three-dimensional point cloud data representing the surface of the object, wherein a point that is a top of the head position candidate is a point that at least satisfies a condition that an angle formed by a vector directed from the position representing the waist to the position representing the head and a vector directed from the position representing the head to said point is less than or equal to a predetermined angle; and a step of determining, as the position of the top of the head, the farthest point among the one or more points that are top of the head position candidates, whose distance from the position representing the head to said point is less than or equal to a predetermined distance.

[0011] In one embodiment, a point that is a candidate for the top of the head position is a point where the length of a normal line extending from the point to a straight line passing through the position representing the waist and the position representing the head is less than or equal to a predetermined length. The point may further satisfy the condition:

[0012] In one embodiment, the method further includes a multiple position determination step in which a computer determines positions representing each of a plurality of portions of the object, the multiple position determination step including the steps of acquiring a two-dimensional image of the object, determining two-dimensional positions representing each of the plurality of portions of the object in the two-dimensional image, acquiring three-dimensional point cloud data representing a surface of the object corresponding to the acquired two-dimensional image, and a synthesis step of determining, as the positions representing each of the plurality of portions of the object, the three-dimensional positions in the three-dimensional point cloud data determined by synthesizing the two-dimensional image and the three-dimensional point cloud data.

[0013] In one embodiment, the plurality of parts of the subject include a head, hips, knees, ankles, and a base of feet, and the method may further include a step of: a computer repeating the plurality of position determination step to obtain a plurality of sets of the positions representing each of the plurality of parts of the subject; a step of a computer determining a first length between the position representing the hips and the position representing the top of the head, a second length between a position representing the base of the subject and a position representing the knee of the subject, a third length between the position representing the knee and the position representing the ankle, and a fourth length between the position representing the ankle and a position representing the sole of the foot based on each set of positions representing each of the plurality of parts of the subject, the step including a step of determining the fourth length by multiplying a sum of the second length and the third length by a predetermined ratio; and a step of a computer determining a sum of a median of the first length, a median of the second length, a median of the third length, and a median of the fourth length as a height of the subject.

[0014] In one embodiment, the subject is a human, and the predetermined ratio may be determined according to at least one of the age, sex, and race of the human subject.

[0015] In one embodiment, the method may further include a step of removing, by a computer, objects other than the subject from the two-dimensional image before performing the combining step.

[0016] In one embodiment, the method may further include a plantar position determination step in which the computer determines a position representing the plantar part of the subject to determine the height of the subject, and may further be characterized in that the computer determines the position representing the plantar part based at least on a position representing the dorsum of the subject's foot, a position representing the subject's ankle, and a position representing the subject's knee.

[0017] In one embodiment, the plantar position determination step may include a step of determining a plane passing through a position representing the dorsum of the subject's foot where a straight line passing through a position representing the subject's knee and a position representing the subject's ankle intersects perpendicularly, and determining the intersection point of the straight line and the plane as the position of the plantar part.

[0018] In one embodiment, the method further includes a multiple position determination step in which a computer determines positions representing each of a plurality of portions of the object, the multiple position determination step including the steps of acquiring a two-dimensional image of the object, determining two-dimensional positions representing each of the plurality of portions of the object in the two-dimensional image, acquiring three-dimensional point cloud data representing a surface of the object corresponding to the acquired two-dimensional image, and a synthesis step of determining, as the positions representing each of the plurality of portions of the object, the three-dimensional positions in the three-dimensional point cloud data determined by synthesizing the two-dimensional image and the three-dimensional point cloud data.

[0019] In one embodiment, the multiple parts of the subject include a head, hips, knees, ankles, dorsum of the feet, and groin, and the method may further include a step of a computer repeating the multiple position determination step to obtain multiple sets of the positions representing each of the multiple parts of the subject; a step of a computer determining, based on each set of positions representing each of the multiple parts of the subject, a first length between the position representing the hips and the position representing the top of the head, a second length between a position representing the groin of the subject and a position representing the knee of the subject, a third length between the position representing the knee and the position representing the ankle, and a fourth length between the position representing the ankle and the position representing the sole of the foot; and a step of a computer determining a sum of a median of the first lengths, a median of the second lengths, a median of the third lengths, and a median of the fourth lengths as the height of the subject.

[0020] In one embodiment, the method may further include a step of removing, by a computer, objects other than the subject from the two-dimensional image before performing the combining step.

[0021] According to one embodiment of the present disclosure, there is provided a method including a plantar position determination step in which a computer determines a position representing the plantar part of a subject to determine the height of the subject, characterized in that the position representing the plantar part is determined based at least on a position representing the dorsum of the subject's foot, a position representing the subject's ankle, and a position representing the subject's knee.

[0022] It should be noted that the step of determining a location representative of the sole of the subject's foot for determining the subject's height improves the method for measuring or determining the subject's height, in other words, the step of determining a location representative of the sole of the subject's foot for determining the subject's height is an improved component of the method for measuring or determining the subject's height, and thus the method solves the problem of the present disclosure.

[0023] According to one embodiment of the present disclosure, there is provided a method for determining a height of a subject, the method including a step of a computer determining at least a second length between a position representing the base of the subject's foot and a position representing the subject's knee, a third length between the position representing the knee and a position representing the subject's ankle, and a fourth length between the position representing the ankle and a position representing the subject's sole, wherein the fourth length is determined by multiplying the sum of the second length and the third length by a predetermined ratio.

[0024] It should be noted that the step of determining at least the second length, the third length and the fourth length for determining the height of a subject improves the method for measuring or determining the height of a subject. In other words, it should be noted that the step of determining at least the second length, the third length and the fourth length for determining the height of a subject is an improved component included in the method for measuring or determining the height of a subject, and thus the method solves the problem of the present disclosure.

[0025] According to one embodiment of the present disclosure, there is provided a system configured to perform a top position determination step of determining a position representative of a top of a head of a subject in order to determine a height of the subject, wherein the position representative of the top of the head is determined based at least on a position representative of a waist of the subject and a position representative of a head of the subject.

[0026] According to one embodiment of the present disclosure, there is provided a program for causing a computer to execute a top position determination step of determining a position representing the top of the head of a subject in order to determine the height of the subject, the program being characterized in that the position representing the top of the head is determined based at least on a position representing the waist of the subject and a position representing the head of the subject. Effect of the Invention

[0027] According to an embodiment of the present disclosure, the height of an object, such as an infant, can be measured without contact. [Brief description of the drawings]

[0028] [Figure 1] 1 is a flow chart of an example process 100 for measuring a subject's height. [Diagram 2] 1 is a diagram related to an example process 100. [Diagram 3] 3 is a flow chart of a portion 300 of an example process for determining a location representative of the top of a subject's head. [Figure 3B] 3B is a flow chart of a portion 300B of an example process for determining a location representative of the top of a subject's head. [Figure 4] 4 is a flow chart of another portion 400 of an example process for determining a location representative of the top of a subject's head. [Diagram 5] 1A and 1B are diagrams relating to exemplary processes 300, 300B and 400. [Figure 5B] 11A and 11B are diagrams relating to example processes 300B and 400. [Figure 6] 6 is a flow chart of an example process 600 for determining a location representative of the plantar surface of a subject's foot. [Figure 7] FIG. 6 is a diagram related to an example process 600. [Figure 8] 8 is a flow chart of a portion 800 of an example process for determining locations and lengths between locations representing each of a plurality of portions of an object. [Figure 9] 9 is a flow chart of another portion 900 of an example process for determining locations and lengths between locations representing each of a plurality of portions of an object. [Figure 9B] 9 is a flow chart of another portion 900B of an example process for determining locations and lengths between locations representing each of a plurality of portions of an object. [Figure 10] 10 is a flow chart of an example process 1000 for determining a subject's height. [Figure 11] 10A-10C are diagrams relating to example processes 900, 900B and 1000. [Figure 12] 1 is an example of a computer hardware configuration. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0029] Hereinafter, unless otherwise specified, "smaller" or "less than" may mean "equal to or less than." Additionally, hereinafter, unless otherwise specified, "greater" may mean "equal to or greater than."

[0030] In addition, each step included in the exemplary process may be executed by a computer. In addition, each step included in the exemplary process is not limited to those described below, and some steps may be executed in parallel.

[0031] 1. An embodiment of the present disclosure 1-1 Example process for measuring the height of a subject FIG 1 is a flow chart of an example process 100 for measuring a subject's height according to one embodiment of the present disclosure. FIG 2 is a diagram associated with the example process 100.

[0032] An example of a subject whose height is measured by this embodiment is an infant (especially an infant who cannot stand up yet), but is not limited to this. The present disclosure may also be useful for humans (including adults) who have difficulty standing upright due to a disability, and other animals that have a skeleton similar to that of humans, such as apes.

[0033] 110 shows a step of determining a position representing the top of the head of the subject. Step 110 is particularly characterized in that the position representing the top of the head of the subject is determined based at least on a position representing the waist of the subject and a position representing the head of the subject. The "position representing the waist" can be defined as a point representing the waist, and may be, for example, but is not limited to, the center of gravity of the region of the subject corresponding to the term "waist". Similarly, the "position representing the head" can be defined as a point representing the head, and may be, for example, but is not limited to, the center of gravity of the region of the subject corresponding to the term "head". For example, there is a known library (e.g., Vision Pose by Next System Co., Ltd.) that outputs positions representing parts of the subject (such as body parts (waist, etc.) and joints, but is not limited to these) in a two-dimensional image of the subject captured, and the two-dimensional positions output by such a library as a point representing the waist and a point representing the head, or three-dimensional positions obtained by mapping the two-dimensional positions into three dimensions using any method, may be the "position representing the waist" and the "position representing the head".

[0034] 120 shows a step of determining a position representing the sole of the subject's foot. Step 120 is particularly characterized in that the position representing the sole of the subject's foot is determined based at least on a position representing the dorsum of the subject's foot and a position representing the subject's ankle. The "position representing the dorsum of the foot" can be defined as a point representing the dorsum of the foot, and may be, for example, the center of gravity of the area of ​​the subject corresponding to the term "dorsus of the foot", but is not limited thereto. Similarly, the "position representing the ankle" can be defined as a point representing the ankle, and may be, for example, the center of gravity of the area of ​​the subject corresponding to the term "ankle", but is not limited thereto. For example, when there is a known library that outputs positions representing parts of a subject in a two-dimensional image of a subject from the two-dimensional image of the subject, the two-dimensional positions output by such a library as a point representing the dorsum of the foot and a point representing the ankle, or three-dimensional positions obtained by mapping the two-dimensional positions into three dimensions by any method, may be the "position representing the dorsum of the foot" and the "position representing the ankle".

[0035] The features of steps 110 and 120 are described below. As described above as the background art, there is a method for measuring height by using at least two points including the top of the head and the sole of the foot as measurement points. Also, there is a known library that outputs a position representative of a part of an object in a two-dimensional image obtained by capturing an object from the two-dimensional image. Incidentally, there is a need for measuring the height of an infant while lying on its back as shown in FIG. 2. However, it is difficult to stably determine a position representing the sole of the foot from a two-dimensional image captured by capturing an infant while lying on its back. This is because, when an infant is captured while lying on its back as shown in FIG. 2, the sole of the foot may be hidden in the captured two-dimensional image (especially when the knees are raised and the soles of the feet are on the floor). Therefore, it would be useful if the position representing the sole of the foot could be determined from a position representing a part other than the sole of the foot. Also, even if the head is not hidden, it is difficult to stably determine a position representing the top of the head from a two-dimensional image captured by capturing an infant while lying on its back. In fact, at present, there is no library that outputs a representative position of the top of the head from a two-dimensional image captured by capturing an object. It would therefore be useful to be able to determine the location representing the top of the head from locations representing parts of the head other than the top of the head.

[0036] The position representing the top of the head seems to be determined by a method of searching for the top of the head direction from the position representing the head, for example, as described later. However, when trying to determine the position representing the top of the head using such a method, how to determine the top of the head direction becomes a problem. For example, in order to determine the top of the head direction, it is possible to use a position representing the chest, which is in the opposite direction to the top of the head with the head as a reference. However, when considering imaging an infant, the infant may suddenly move his / her arms or fold his / her hands in front of his / her chest, and as a result, the position representing the chest may not be correctly determined from a two-dimensional image captured while the infant is lying on his / her back. On the other hand, as a unique finding of the inventor of the present disclosure, it has been found that the position representing the waist can be relatively stably and correctly determined based at least on a two-dimensional image captured while the infant is lying on his / her back. That is, the feature of determining the position representing the top of the head of the target based at least on the position representing the waist of the target and the position representing the head of the target is based on the unique finding of the inventor of the present disclosure described above.

[0037] The position representing the sole of the foot may be determined based on the position representing the part having a constant positional relationship with the sole of the foot, as described below. The applicant's unique knowledge has revealed that, among such parts, the position representing the dorsum of the foot, the position representing the ankle, and the position representing the knee can be relatively stably and correctly determined based at least on a two-dimensional image captured while the infant is lying on its back. That is, the feature of determining the position representing the sole of the subject based at least on the position representing the dorsum of the subject's foot, the position representing the subject's ankle, and the position representing the subject's knee is based on the unique knowledge of the inventor of the present disclosure described above.

[0038] 130 illustrates determining a subject's height based at least on the location representative of the top of the head and the location representative of the bottom of the feet.

[0039] According to the exemplary process 100, step 110 is an example of a head position determining step for determining a position representing the top of the subject's head in order to determine the subject's height, and step 120 is an example of a foot position determining step for determining a position representing the sole of the subject's feet in order to determine the subject's height, as well as steps 920 (FIGS. 9 and 9B) and 930 (FIG. 9) described below.

[0040] 1-2 First Example Process for Determining a Position Representing the Top of a Subject's Head 3 and 4 are flow charts of example processes 300 and 400 for determining a position representing the top of a subject's head, which are specific examples of step 110 (FIG. 1). FIG. 5 is a diagram related to example processes 300 and 400 (and 300B described below). Note that example processes 300 and 400 are merely examples of step 110, and the specific process in step 110 is not limited thereto.

[0041] At 310, a first vector 530 (FIG. 5) is determined that points from a location 510 (FIG. 5) representing the subject's hips to a location 520 (FIG. 5) representing the subject's head.

[0042] 320 shows a step of selecting one 540 (FIG. 5) of a plurality of points included in the three-dimensional point cloud data representing the surface of the object. Each point included in the three-dimensional point cloud data essentially corresponds to one point on the surface of the object. The three-dimensional point cloud data may be acquired using a LiDAR (Light Detection And Ranging) sensor, but is not limited thereto.

[0043] 330 illustrates determining a second vector 550 (FIG. 5) from the position 520 representing the subject's head to the point 540 selected in step 320.

[0044] At 340, an angle 560 (FIG. 5) between a first vector 530 and a second vector 550 is determined.

[0045] 350 shows a step of determining whether angle 560 is less than a predetermined angle. If angle 560 is less than the predetermined angle, the process proceeds to step 360, otherwise the process proceeds to step 370. An example of the predetermined angle is, but is not limited to, 45 degrees.

[0046] The step 360 indicates a step of selecting the selected point as a head vertex position candidate. The step 360 may be, but is not limited to, a step of adding the selected point to a set corresponding to head vertex position candidates. The set corresponding to head vertex position candidates may be initialized as an empty set before execution of the example process 300.

[0047] Therefore, according to the example process 300, the point 540 selected in step 320 that is a candidate for the top of the head position is a point that satisfies the condition that the angle between a first vector 530 extending from a position 510 representing the subject's waist to a position 520 representing the subject's head and a second vector 550 extending from the position 520 representing the subject's head to said point is less than a predetermined angle.

[0048] Numeral 370 indicates a step of determining whether all points have been selected from the 3D point cloud data. If it is determined that all points have been selected, the process proceeds to step 410 (FIG. 4), and if not, the process returns to step 320, forming a loop.

[0049] 410 shows the step of selecting one of the one or more points that is a potential vertex location.

[0050] 420 shows the step of determining the distance between the position 520 representing the subject's head and the point selected in step 410 .

[0051] Step 430 indicates a step of determining whether the distance determined in step 420 is less than a predetermined distance. Three-dimensional point cloud data representing the surface of an object may erroneously include points that do not represent the surface of the object and are far from the surface of the object. Step 430 is for excluding such points that do not represent the surface of the object. If the distance determined in step 420 is less than the predetermined distance, the process proceeds to step 440; otherwise, the process proceeds to step 460.

[0052] 440 indicates a step of determining whether the distance determined in step 420 is greater than a value (hereinafter referred to as the "past maximum value") stored as the maximum value of the distances previously determined in step 420 and determined to be less than a predetermined distance in step 430. When step 440 is executed for the first time, zero may be stored as the past maximum value. If the distance determined in step 420 is greater than the past maximum value, the process proceeds to step 450; if not, the process proceeds to step 460.

[0053] Numeral 450 indicates a step of updating the past maximum value to the distance determined immediately before in step 420, and setting the point selected immediately before in step 410 as the provisional head top position.

[0054] Numeral 460 indicates a step of determining whether all of the one or more points that are candidates for the top of the head position have been selected. If it is determined that all of the one or more points that are candidates for the top of the head position have been selected, the process proceeds to step 470, and if not, the process returns to step 410 to form a loop.

[0055] 470 shows the step of determining a provisional top position as a position representative of the top of the head.

[0056] Needless to say, the first exemplary process is characterized in that the position representing the top of the head is determined based at least on the position representing the waist of the subject and the position representing the head of the subject, and is a process for determining the position representing the top of the head from the position representing the part other than the top of the head. Therefore, when the first exemplary process is executed to determine the height of the subject, even if the other components included in the method for measuring or determining the height of the subject are the same as those of the conventional method, the method is improved in the sense that the difficulty of stably determining the position representing the top of the head from a two-dimensional image captured in a supine state of an infant, for example, is resolved. In other words, the first exemplary process is an improved component included in the method for measuring or determining the height of the subject. Therefore, it should be noted that executing the first exemplary process to determine the height of the subject, and thus determining the position representing the top of the head based at least on the position representing the waist of the subject and the position representing the head of the subject, in order to determine the height of the subject, alone solves the problem of the present disclosure.

[0057] 1-3 Second Example Process for Determining a Position Representing the Top of a Subject's Head 3B is a flow chart of a portion 300B of an example process for determining a position representing the top of a subject's head (hereinafter referred to as "example process 300B"), which is a specific example of step 110 (FIG. 1). In example process 300B, the steps leading up to step 350 and the steps following step 370 may be similar to example processes 300 and 400. FIG. 5B is a diagram related to example processes 300B and 400. Note that example process 300B is merely an example of step 110, and the specific process in step 110 is not limited thereto.

[0058] Step 350 of example process 300B may be essentially similar to step 350 of example process 300, except that if angle 560 is less than a predetermined angle, then proceed to step 352 instead of step 360.

[0059] Numeral 352 indicates a step of determining the length of a normal 570 extending from the point 540 selected in step 320 to the first vector 530. Note that the normal 570 is equivalent to a normal extending from the point 540 selected in step 320 to a straight line passing through the position 510 (FIG. 5B) representing the subject's waist and the position 520 (FIG. 5B) representing the subject's head.

[0060] 354 shows a step of determining whether the length of the normal 570 is less than a predetermined length. If the length of the normal 570 is less than the predetermined length, the process proceeds to step 360, otherwise the process proceeds to step 370. An example of the predetermined length is 1 cm, but is not limited to this.

[0061] Therefore, according to the exemplary process 300B, the points 540 selected in step 320 that are candidates for the top of the head are A condition is satisfied that an angle between a first vector 530 extending from a position 510 representing the waist of the subject to a position 520 representing the head of the subject and a second vector 550 extending from the position 520 representing the head of the subject to the point is less than a predetermined angle, and The length of a normal line extending from the point to the first vector 530 or a line passing through the position 510 representing the waist of the subject and the position 520 representing the head of the subject is less than a predetermined length. It is a point.

[0062] Steps 360 and 370 of the example process 300B may be similar to steps 360 and 370 of the example process 300.

[0063] According to the exemplary process 300B (see especially steps 352 and 354), the possibility that a point that is not a top of the head is included in the points that are candidates for the top of the head position can be reduced as compared to the exemplary process 300.

[0064] That is, in the case of only the determination using the linear distance (the distance between the position 520 representing the subject's head and the point selected in step 410) and the angle (the angle 560 between the first vector 530 and the second vector 550) as in the example process 300, a point away from the ideal top of the head position may be determined as the final top of the head position. This is because the ideal top of the head position is a point near the first vector 530, and points farther away from the first vector 530 are often farther away from the position 520 representing the subject's head.

[0065] According to example process 300B, a further determination is made of the normal distance from first vector 530, so that points far from first vector 530 can be excluded from the final location representing the top of the head.

[0066] 1-4 Exemplary Process for Determining a Location Representing the Plantar Foot of a Subject Fig. 6 is a flow chart of an example process 600 for determining a position representing the sole of a subject, which is a specific example of step 120. Fig. 7 is a diagram related to the example process 600. Note that the example process 600 is merely an example of step 120, and the specific process in step 120 is not limited thereto.

[0067] 610 shows a step of determining a plane 730 (FIG. 7) that intersects at a right angle with a straight line 740 (FIG. 7) that passes through a position 715 (FIG. 7) that represents the knee of the subject and a position 720 (FIG. 7) that represents the ankle of the subject from among an infinite number of planes that pass through a position 710 (FIG. 7) that represents the dorsum of the subject's foot. The straight line and the plane may be defined in a three-dimensional space.

[0068] 620 indicates a step of determining an intersection 750 (FIG. 7) of the plane 730 determined in step 610 and the straight line 740 as a position representing the sole of the foot.

[0069] Needless to say, the above exemplary process for determining the position representing the sole of the subject is characterized in that the position representing the sole is determined based at least on the position representing the ankle of the subject and the position representing the knee of the subject, and is a process for determining the position representing the sole from the position representing the part other than the sole. Therefore, when the above exemplary process is executed to determine the height of the subject, even if the other components included in the method for measuring or determining the height of the subject are the same as those of the conventional method, the method is improved in the sense that the difficulty of stably determining the position representing the sole from a two-dimensional image captured in a supine state of an infant is resolved. In other words, the above exemplary process is an improved component included in the method for measuring or determining the height of the subject. Therefore, it should be noted that executing the above exemplary process to determine the height of the subject, and thus determining the position representing the sole based at least on the position representing the ankle of the subject and the position representing the knee of the subject, in order to determine the height of the subject, alone solves the problem of the present disclosure.

[0070] 1-5 A more comprehensive first example process for measuring the height of a subject 8-10 are flowcharts of more general example processes 800-1000 for measuring a subject's height according to an embodiment of the present disclosure. The example processes 800-1000 include the example process 100 described above.

[0071] 1-5-1 EXEMPLARY PROCESS FOR DETERMINING POSITIONS REPRESENTING EACH OF MULTIPLE PARTS OF AN OBJECT Exemplary processes 800 (FIG. 8) and 900 (FIG. 9) are processes for determining positions representative of each of a plurality of parts of an object. Here, the "plurality of parts" may include the head, hips, knees, ankles, and dorsum of the feet. The "plurality of parts" may further include the groin. Note that the "ankle", "dorsus of the foot", "groin" and "knee" may relate to either one of the feet. FIG. 11 is a diagram related to exemplary process 900 and exemplary process 1000 (and 900B) described below.

[0072] Referring to Figure 8, 810 shows a step of acquiring a two-dimensional image of an object. The acquisition of the two-dimensional image may be performed using a general digital camera. The two-dimensional image may be, but is not limited to, a color image.

[0073] 820 shows a step of determining two-dimensional positions representative of each of a plurality of portions of the object in the two-dimensional image acquired in step 810. Step 820 may be performed using a known library that outputs positions representative of portions of the object in the two-dimensional image from the two-dimensional image of the object.

[0074] Step 830 indicates a step of removing objects other than the target from the two-dimensional image acquired in step 810. Step 830 may be a step of filling in the two-dimensional image acquired in step 810 with a predetermined color, except for the target. Step 810 may be performed using a predetermined AI model trained to distinguish between the target and other objects in the two-dimensional image, or Apple's ARKit.

[0075] 840 indicates a step of synthesizing the positions representing each of the multiple portions of the object determined in step 820 onto the two-dimensional image obtained in step 830 from which the non-objects have been removed.

[0076] 850 shows a step of acquiring three-dimensional point cloud data corresponding to the two-dimensional image acquired in step 810. The acquisition of the three-dimensional point cloud data may be performed using a LiDAR sensor. Note that the "three-dimensional point cloud data corresponding to the two-dimensional image" refers to three-dimensional point cloud data acquired under the same conditions as those under which the two-dimensional image was acquired (for example, but not limited to, the position of imaging / scanning, the orientation of imaging / scanning, and the angle of view of imaging / scanning). When acquiring two-dimensional images and three-dimensional point cloud data using a computer including both a digital camera and a LiDAR sensor, for example, an Apple iPhone 14 Pro, the two-dimensional images and three-dimensional point cloud data acquired at the same time will correspond to each other.

[0077] Referring to FIG. 9, 910 shows a step of determining a three-dimensional position representing each of the multiple parts of the object by synthesizing the two-dimensional image obtained by step 840 and the three-dimensional point cloud data acquired in step 850. That is, in step 910, the two-dimensional position representing each of the multiple parts of the object determined in step 820 is mapped to a three-dimensional position. The three-dimensional position may be coordinate information in a coordinate system used by the three-dimensional point cloud data. In this embodiment, the two-dimensional position representing each of the multiple parts of the object does not completely match a point included in the three-dimensional point cloud data, i.e., a position representing each part in the three-dimensional coordinate system, but it is sufficient to map it to a point on the surface of the object related to or close to the position. However, it goes without saying that the two-dimensional position representing each of the multiple parts of the object may be mapped to a three-dimensional position inside the object that does not include a point in the three-dimensional point cloud data. It should be noted that, in the case where the two-dimensional image is a color image, step 910 may include a step of synthesizing color information of the two-dimensional image to the three-dimensional point cloud data. For example, step 910 may include assigning a color to each pixel in the two-dimensional image to a corresponding point in the three-dimensional point cloud data.

[0078] Step 920 shows determining a position representative of the top of the subject's head based on the positions representative of each of the multiple parts of the subject determined in step 910. Step 920 may be the same step as step 110 (FIG. 1).

[0079] 930 shows determining a position representative of the plantar part of the object based on the positions representative of each of the parts of the object determined in step 910. Step 930 may be the same step as step 120 (FIG. 1).

[0080] 940 shows a step of determining a length between the positions based on the positions representing each of the parts of the object determined in step 910, the position representing the top of the object determined in step 920, and the position representing the sole of the object determined in step 930. The length determined in step 940 is a first length 1110 (FIG. 11) between a location representing the subject's waist and a location representing the top of the head; a second length 1120 between a location representing the subject's hip and a location representing the knee (FIG. 11); a third length 1130 (FIG. 11) between a location representing the subject's knee and ankle; A fourth length 1140 between a location representing the subject's ankle and a location representing the sole of the foot (FIG. 11). It may be, but is not limited to,

[0081] 950 shows a step of determining whether a predetermined condition is satisfied. The predetermined condition may be any condition, such as, but not limited to, a condition that step 940 has been repeated a predetermined number of times. If it is determined that the predetermined condition is satisfied, the process proceeds to step 1010 (FIG. 10), otherwise, the process returns to step 910 to form a loop. It will be understood that the loop is repeated multiple times to obtain multiple sets of lengths between positions, such as the first length 1110, the second length 1120, the third length 1130, and the fourth length 1140 described above.

[0082] 1-5-2 Example process for determining subject height The exemplary process 1000 (FIG. 10) is a process for determining the height of a subject, and corresponds to a specific example of step 130 (FIG. 1). Note that the exemplary process 1000 is merely one example of step 130, and the specific process in step 130 is not limited thereto.

[0083] 1010 shows the step of determining the median for each length between positions from which multiple sets were obtained, for example, each of the first length 1110, second length 1120, third length 1130 and fourth length 1140 described above.

[0084] 1020 shows determining the height of the subject as the sum of the medians calculated in step 1010. Step 1020 may be, for example, determining the height of the subject as the sum of the median of the first length 1110, the median of the second length 1120, the median of the third length 1130, and the median of the fourth length 1140.

[0085] In this embodiment, the sum of the medians of the lengths is determined as the height of the subject in order to reduce errors. That is, the lengths determined for each set may contain outliers due to erroneous determination of the positions representing each of the multiple parts of the subject. By using the median of the lengths determined for each set, it is possible to eliminate such outliers as much as possible.

[0086] 1-6 A more comprehensive second exemplary process for measuring a subject's height 9B is a flow chart of a portion 900B of a larger exemplary process for measuring a subject's height (hereinafter "exemplary process 900B") in accordance with one embodiment of the present disclosure. The steps leading up to step 900 and steps following step 950 of exemplary process 900B may be similar to exemplary processes 800 and 1000.

[0087] Step 910 of the example process 900B may be similar to step 910 of the example process 900.

[0088] Step 920 of example process 900B may be essentially similar to step 920 of example process 900, except that step 920 proceeds to step 942 instead of step 940.

[0089] 942 shows a step of determining a length between the positions based on the positions representing each of the portions of the object determined in step 910 and the position representing the top of the object determined in step 920. The length determined in step 942 is a first length 1110 (FIG. 11) between a location representing the subject's waist and a location representing the top of the head; a second length 1120 between a location representing the subject's hip and a location representing the knee (FIG. 11); A third length 1130 between a location representing the subject's knee and a location representing the ankle (FIG. 11). It may be, but is not limited to,

[0090] 944 shows a step of determining a length between other positions based on the length between the positions determined in step 942. a second length 1120 between a location representing the subject's hip and a location representing the knee; a third length 1130 between a location representing the subject's knee and a location representing the subject's ankle; The method may include, but is not limited to, determining a length obtained by multiplying the sum of the above-mentioned values ​​by a predetermined ratio as a fourth length 1140 (FIG. 11) between a position representing the ankle and a position representing the sole of the subject. An example of the predetermined ratio is 8%, but is not limited to this. In addition, when the subject to be measured for height is a human, the above-mentioned predetermined ratio may be determined according to at least one of the attributes of the human subject, such as age, sex, and race. Incidentally, the above-mentioned 8% ratio is an example when the subject to be measured for height is an infant (human). Needless to say, such a predetermined ratio can be obtained in advance by experiment and stored in the memory of a computer that executes the exemplary process 900B.

[0091] Step 950 of the example process 900B may be similar to step 950 of the example process 900.

[0092] According to the exemplary process 900B, a fourth length 1140 between a position representing the ankle and a position representing the sole of the subject's foot can be determined without determining a position representing the sole of the subject's foot. As described above, when an infant is imaged in a supine position, the soles of the feet may be hidden in the two-dimensional image (particularly when the infant has their knees bent and the soles of the feet on the floor). The exemplary process 900B (see particularly step 944) provides a different solution to deal with such cases than the exemplary process 900 (see particularly step 930).

[0093] The essence of the exemplary process 900B is to determine a fourth length 1140 between a position representing the subject's ankle and a position representing the sole of the foot, without determining a position representing the subject's sole, by multiplying the sum of a second length 1120 between a position representing the subject's hip and a position representing the knee, and a third length 1130 between a position representing the subject's knee and a position representing the ankle, by a predetermined ratio. In other words, in order to determine the height of a subject, a process is performed to determine at least a second length 1120 between a position representing the base of the subject's foot and a position representing the knee, a third length 1130 between a position representing the subject's knee and a position representing the ankle, and a fourth length 1140 between a position representing the subject's ankle and a position representing the sole of the foot, and the fourth length 1140 is determined by multiplying the sum of the second length 1120 and the third length 1130 by a predetermined ratio, and even if other components included in the method for measuring or determining the height of a subject are the same as those of the conventional method, the method is improved in the sense that the difficulty in stably determining the position representing the sole of the foot from a two-dimensional image captured while the infant is lying on its back is resolved. In other words, the process is an improved component included in the method for measuring or determining the height of a subject. Thus, it should be noted that performing this process to determine the subject's height, and thus determining the fourth length 1140 by multiplying the sum of the second length 1120 and the third length 1130 by a predetermined ratio, alone solves the problem of the present disclosure.

[0094] 2. Another embodiment of the present disclosure Another embodiment of the present disclosure is a system for performing at least a portion of the exemplary process described above. In particular, such a system is preferably built on a computer that includes both a digital camera and a LiDAR sensor, such as an Apple iPhone 14 Pro.

[0095] Another embodiment of the present disclosure is a program for causing a computer to execute at least a part of the above-described exemplary processes, or a computer-readable storage medium, a non-transitory computer-readable medium, or a computer-readable storage medium storing the program. Such a computer is preferably a computer including both a digital camera and a LiDAR sensor, such as an Apple iPhone 14 Pro.

[0096] 3. Computer An example of a hardware configuration of a computer that can be used to implement an embodiment of the present disclosure will be described below.

[0097] 12 shows an example of a computer hardware configuration. As shown in the figure, the computer 1200 mainly comprises, as hardware resources, a processor 1210, a main memory device 1220, an auxiliary memory device 1230, an input / output interface 1240, and a communication interface 1250, which are connected to each other via a bus line 1260 including an address bus, a data bus, a control bus, and the like. Note that an interface circuit (not shown) may be interposed between the bus line 1260 and each hardware resource as appropriate. Note that some of these components (e.g., the communication interface 1250) may not be included in the computer 1200.

[0098] The processor 1210 controls the entire computer or at least a part of the computer, such as a CPU or a microprocessor. Note that one computer may include multiple processors 1210. In such a case, the "processor" in the above description may be a general term for the multiple processors 1210.

[0099] The main memory 1220 is a volatile memory such as a static random access memory (SRAM) or a dynamic random access memory (DRAM) that provides a working area for the processor 1210.

[0100] The auxiliary storage device 1230 is a non-volatile memory such as an HDD, SSD, or flash memory that stores software programs and data. The programs and data are loaded from the auxiliary storage device 1230 to the main storage device 1220 via a bus line 1260 at any time. The auxiliary storage device 1230 may be called a computer-readable storage medium, a non-transitory computer-readable medium, or a computer-readable storage medium. The programs include instructions that cause the processor to execute desired processes.

[0101] The input / output interface 1240 presents information and / or receives information input, and may be a digital camera, a LiDAR sensor, a keyboard, a mouse, a display, a touch panel display, a microphone, a speaker, various sensors, etc.

[0102] The communication interface 1250 is connected to a network 1255 consisting of one or more of the Internet, a local area network (LAN), etc., and transmits and receives data via the network 1255. The communication interface 1250 and the network 1255 can be connected by wire or wirelessly. The communication interface 1250 may also obtain information related to the network, such as information related to Wi-Fi access points and information related to the base stations of a communication carrier.

[0103] It will be apparent to those skilled in the art that the above-exemplified hardware resources and software can cooperate to cause the computer 1200 to function as desired means, execute desired steps, and achieve desired functions.

[0104] 4. Conclusion Although several examples of the embodiments of the present disclosure have been described above, it should be understood that these are merely illustrative and do not limit the technical scope of the present disclosure. It should be understood that modifications, additions, improvements, etc. can be appropriately made to the described embodiments without departing from the spirit and scope of the present disclosure. The technical scope of the present disclosure should not be limited by any of the above-described embodiments, but should be defined only by the claims and their equivalents. [Explanation of symbols]

[0105] 100...Example process for measuring the height of a subject 300, 300B, 400... Exemplary processes for determining a position representing the top of a subject's head 510: Position representing the subject's waist 520: Position representing the subject's head 530...A first vector extending from a position representing the subject's waist to a position representing the subject's head 540…Selected point 550 - Second vector from the target's waist to the selected point 560...the angle between the first and second vectors 570...Normal extending from the selected point to the first vector 600... Exemplary process for determining a location representative of the plantar part of a subject 710…Position representing the dorsum of the subject’s foot 715... Position representing the subject's knee 720: Position representing the subject's ankle 730…Plane 740…straight line 750…Position representing the sole of the subject’s foot 800, 900, 900B... Exemplary processes for determining positions and lengths between positions representing each of a plurality of portions of an object 1000...Example process for determining subject height 1110: The distance between the position representing the subject's waist and the position representing the top of the head 1120: The length between the position representing the base of the subject's foot and the position representing the knee 1130: Length between the position representing the knee and the position representing the ankle of the subject 1140...Length between the position representing the subject's ankle and the position representing the sole of the foot 1255…Network 1260…Bus line

Claims

1. a top of head position determining step in which the computer determines a position representing the top of the subject's head to determine the subject's height; A method comprising: determining the location representing a top of a head based at least on a location representing a waist of the subject and a location representing a head of the subject.

2. 2. The method of claim 1, wherein the step of determining the top of the head comprises: A step of determining one or more points that are head top position candidates among a plurality of points included in the three-dimensional point cloud data representing the surface of the object, the points that are head top position candidates being: The angle between the vector from the position representing the waist to the position representing the head and the vector from the position representing the head to the point is less than or equal to a predetermined angle. A step, which is a point that satisfies at least the condition determining, as the position of the top of the head, the farthest point, the distance between which is less than or equal to a predetermined distance from the position representing the head, among the one or more points that are candidates for the position of the top of the head; The method further comprises:

3. 3. The method according to claim 2, wherein the points which are candidates for the top of the head are The length of a normal line extending from the point to a straight line passing through the position representing the waist and the position representing the head is less than or equal to a predetermined length. The method further satisfies the above condition.

4. 4. The method according to any one of claims 1 to 3, comprising: a computer determining a plurality of positions representing each of a plurality of portions of the object; Further comprising: The multiple position determining step includes: acquiring a two-dimensional image of the object; determining a two-dimensional location representing each of the portions of the object in the two-dimensional image; acquiring three-dimensional point cloud data representative of a surface of the object corresponding to the acquired two-dimensional image; a synthesis step of determining, as the positions representing each of the plurality of parts of the object, three-dimensional positions representing each of the plurality of parts of the object in the three-dimensional point cloud data determined by synthesizing the two-dimensional image and the three-dimensional point cloud data; A method comprising:

5. 5. The method of claim 4, the plurality of parts of the subject include a head, a waist, a knee, an ankle, and a groin; The method comprises: a computer repeating the step of determining multiple positions to obtain multiple sets of positions representing each of the multiple portions of the object; a computer based on each set of locations representing each of the plurality of portions of the object, a first length between the location representing a waist and the location representing a top of a head; a second length between a location representing the subject's hip and a location representing the subject's knee; a third length between the location representing the knee and the location representing the ankle; a fourth length between the location representing the ankle and a location representing the sole of the foot; determining the fourth length by multiplying the sum of the second length and the third length by a predetermined ratio; a computer determining a sum of the median of the first length, the median of the second length, the median of the third length, and the median of the fourth length as a height of the subject; Further comprising: method.

6. 6. The method of claim 5, the subject is a human; The predetermined ratio is determined according to at least one of the age, sex, and race of the human subject. method.

7. 5. The method of claim 4, further comprising the step of: removing objects other than the subject from the two-dimensional image before performing the combining step.

8. 2. The method of claim 1 , The method further includes a step of determining a position representative of a sole of the subject's foot in order to determine a height of the subject, and determining the location representative of the sole of the foot based at least on a location representative of the dorsum of the subject's foot, a location representative of the subject's ankle, and a location representative of the subject's knee. method.

9. 9. The method of claim 8, wherein the step of determining the plantar position comprises: determining a plane passing through a position representing the dorsum of the subject's foot, the plane being perpendicular to a line passing through a position representing the subject's knee and a position representing the subject's ankle; determining an intersection point between the straight line and the plane as the position of the sole of the foot; A method comprising:

10. 10. The method according to claim 8 or 9, a computer determining a plurality of positions representing each of a plurality of portions of the object; Further comprising: The multiple position determining step includes: acquiring a two-dimensional image of the object; determining a two-dimensional location representing each of the portions of the object in the two-dimensional image; acquiring three-dimensional point cloud data representative of a surface of the object corresponding to the acquired two-dimensional image; a synthesis step of determining, as the positions representing each of the plurality of parts of the object, three-dimensional positions representing each of the plurality of parts of the object in the three-dimensional point cloud data determined by synthesizing the two-dimensional image and the three-dimensional point cloud data; A method comprising:

11. 11. The method of claim 10, the plurality of portions of the subject include a head, a hip, a knee, an ankle, a back of the foot, and a groin; The method comprises: a computer repeating the step of determining multiple positions to obtain multiple sets of positions representing each of the multiple portions of the object; a computer based on each set of locations representing each of the plurality of portions of the object, a first length between the location representing a waist and the location representing a top of a head; a second length between a location representing the subject's hip and a location representing the subject's knee; a third length between the location representing the knee and the location representing the ankle; a fourth length between the location representing the ankle and the location representing the sole of the foot; determining a computer determining a sum of the median of the first length, the median of the second length, the median of the third length, and the median of the fourth length as a height of the subject; Further comprising: method.

12. 11. The method of claim 10, further comprising the step of: removing objects other than the subject from the two-dimensional image before performing the combining step.

13. a sole position determining step in which the computer determines a position representative of the sole of the subject's foot in order to determine the subject's height; A method comprising: determining the location representing the plantar part based at least on a location representing the dorsum of the subject's foot, a location representing the subject's ankle, and a location representing the subject's knee.

14. The computer determines the subject's height by: a second length between a location representing the subject's hip and a location representing the subject's knee; a third length between the location representing the knee and a location representing the subject's ankle; and a fourth length between the location representing the ankle and a location representing the sole of the subject's foot; determining at least A method comprising: determining said fourth length by multiplying the sum of said second length and said third length by a predetermined ratio.

15. determining a position representative of the top of the subject's head to determine the subject's height; A system configured to execute 13. A system for determining the position representative of a top of a head based at least on a position representative of a waist of the subject and a position representative of a head of the subject.

16. determining a position representative of the plantar part of the subject's foot to determine the subject's height; A system configured to execute A system for determining the location representing a plantar portion of a foot based at least on a location representing a dorsum of the subject's foot, a location representing the subject's ankle, and a location representing the subject's knee.

17. To determine the subject's height, a second length between a location representing the subject's hip and a location representing the subject's knee; a third length between the location representing the knee and a location representing the subject's ankle; and a fourth length between the location representing the ankle and a location representing the sole of the subject's foot; determining at least A system for executing The system further comprising: determining the fourth length by multiplying the sum of the second length and the third length by a predetermined ratio.

18. determining a position representative of the top of the subject's head to determine the subject's height; A program for causing a computer to execute the following: determining the position representing a top of the head based at least on a position representing a waist of the subject and a position representing a head of the subject.

19. determining a position representative of the plantar part of the subject's foot to determine the subject's height; A program for causing a computer to execute the following: A program that determines the position representing the sole of the foot based on at least a position representing the dorsum of the subject's foot, a position representing the subject's ankle, and a position representing the subject's knee.

20. To determine the subject's height, a second length between a location representing the subject's hip and a location representing the subject's knee; a third length between the location representing the knee and a location representing the subject's ankle; and a fourth length between the location representing the ankle and a location representing the sole of the subject's foot; determining at least A program for causing a computer to execute the following: determining the fourth length by multiplying a sum of the second length and the third length by a predetermined ratio.

Images