Waist circumference estimation device and waist circumference estimation program

Abstract

The purpose is to reduce the effort required for subjects to measure their abdominal circumference. [Solution] The information processing device of this embodiment includes a thickness estimation unit that estimates the thickness of the abdomen based on the Z coordinate value of the abdominal surface obtained from point cloud data acquired from the front of the abdomen of a subject with his back to a wall and the Z coordinate value of the wall surface obtained from the point cloud data, a width estimation unit that estimates the abdominal width using the estimated abdominal thickness together with the point cloud data, and an abdominal circumference calculation unit that calculates the ellipse circumference as the subject's abdominal circumference from the estimated abdominal thickness and the estimated abdominal width.

Description

[Technical field]

[0001] An embodiment of the present invention relates to an abdominal circumference estimation device and an abdominal circumference estimation program for estimating the abdominal circumference of a subject. [Background technology]

[0002] In the "specific health checkup and specific health guidance" that began in April 2008, whether or not a person is eligible for specific health guidance is determined by the degree of abdominal obesity. To determine the degree of abdominal obesity, waist circumference is measured. Traditionally, waist circumference was measured using a tape measure. However, when the "specific health checkup and specific health guidance" is conducted online, the examinee must prepare a tape measure and wrap it around their own abdomen to measure waist circumference. Preparing a tape measure and wrapping it around their own abdomen to measure is a time-consuming task for the examinee, and reducing the labor required to measure waist circumference is an important factor in popularizing the "specific health checkup and specific health guidance." Summary of the Invention [Problem to be solved by the invention]

[0003] The purpose is to reduce the effort required for subjects to measure their abdominal circumference. [Means for solving the problem]

[0004] The information processing device according to this embodiment includes a thickness estimation unit that estimates the thickness of the abdomen based on the Z coordinate value of the abdominal surface obtained from point cloud data acquired from the front with respect to the abdomen of a subject with his / her back against a wall and the Z coordinate value of the wall surface obtained from the point cloud data, a width estimation unit that estimates the abdominal width using the point cloud data and the estimated abdominal thickness, and an abdominal circumference calculation unit that calculates the ellipse circumference as the subject's abdominal circumference from the estimated abdominal thickness and the estimated abdominal width. [Brief description of the drawings]

[0005] [Figure 1]FIG. 1 shows an example of an abdominal circumference estimation system including an information processing device according to the first embodiment. [Diagram 2] FIG. 2 is a plan view showing the position of the portable information processing terminal with respect to the subject when acquiring point cloud data in the first embodiment. [Diagram 3] FIG. 3 is a side view showing the posture of the subject when acquiring point cloud data in the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a guide screen displayed on the portable information processing terminal in the first embodiment. [Diagram 5] FIG. 5 is a hardware configuration diagram of the information processing device according to the first embodiment. [Figure 6] FIG. 6 is a functional configuration diagram of the information processing device according to the first embodiment. [Figure 7] FIG. 7 is a supplementary diagram for explaining the umbilicus identification processing unit and the thickness estimation processing unit in FIG. [Figure 8] FIG. 8 is a supplementary diagram for explaining the width estimation processing unit in FIG. [Figure 9] FIG. 9 is a flowchart showing an example of a procedure of an abdominal circumference estimation process by the information processing device according to the first embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a gap information management table stored in the storage device of FIG. [Figure 11] FIG. 11 is a diagram showing an example of an input screen for body type information displayed on the portable information processing terminal in the first embodiment. [Figure 12] FIG. 12 is a plan view showing the position of the portable information processing terminal with respect to the subject when acquiring point cloud data in the second embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a guide screen displayed on the portable information processing terminal in the second embodiment. [Figure 14] FIG. 14 is a supplementary diagram for explaining the thickness estimation process by the information processing device according to the second embodiment. [Figure 15]FIG. 15 is a flowchart illustrating an example of a procedure of an abdominal circumference estimation process performed by the information processing device according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0006] Hereinafter, a first embodiment and a second embodiment of the present invention will be described with reference to the drawings. The information processing device according to the first and second embodiments has a function of estimating the abdominal circumference of a subject using point cloud data related to the abdomen of the subject. In the first embodiment, an example will be described in which the abdominal circumference estimation process is performed using one type of point cloud data related to the front of the abdomen. In the second embodiment, an example will be described in which the abdominal circumference estimation process is performed using two types of point cloud data related to the side of the abdomen and the front of the abdomen.

[0007] In the following description, components having substantially the same functions and configurations are denoted by the same reference numerals, and repeated description will be given only when necessary.

[0008] Hereinafter, the information processing apparatus according to the first embodiment will be described with reference to FIGS. FIG. 1 shows an example of an abdominal circumference estimation system including an information processing device 1 according to the first embodiment. As shown in FIG. 1, the abdominal circumference estimation system includes an information processing device 1 according to the first embodiment (hereinafter, simply referred to as the first information processing device 1) and a plurality of portable information processing terminals 2 owned by a plurality of subjects connected to the first information processing device 1 via a network 9 such as the Internet. The portable information processing terminal 2 is an information processing terminal such as a smartphone or a tablet equipped with a three-dimensional sensor 21 for acquiring point cloud data related to a visual field range. An application program for determining the degree of abdominal obesity is installed in the portable information processing terminal 2. By executing the application program, various processes related to the estimation of abdominal circumference are executed. The various processes include a process of displaying a guide screen related to the acquisition of point cloud data, a process of displaying an input screen related to the input of body type information, a process of transmitting point cloud data to the first information processing device 1, a process of displaying an abdominal circumference estimated by the first information processing device 1, and the like.

[0009] The three-dimensional sensor 21 typically includes a dot projector that projects an infrared beam onto the field of view, an infrared camera that receives the infrared beam projected from the dot projector and reflected by an object in the field of view, and a calculation processor that calculates the distance to the object from the time difference between when the infrared beam is projected and when it is received by the infrared camera. The three-dimensional sensor 21 generates three-dimensional point cloud data on the field of view by scanning the infrared beam in the horizontal and vertical directions. Of course, the three-dimensional sensor 21 is not limited to the above-mentioned TOF (Time Of Flight) type sensor as long as it can acquire point cloud data on the object (the object's surface) in a non-contact manner. For example, the three-dimensional sensor 21 may be a so-called stereo matching type sensor that is configured with two cameras and simultaneously captures an object from different directions with the two cameras, and calculates the distance to the object based on parallax information obtained from the captured images.

[0010] A method for acquiring point cloud data in the first embodiment will be described below with reference to Fig. 2, Fig. 3, and Fig. 4. Fig. 2 is a plan view showing the position of the portable information processing terminal 2 with respect to the subject when acquiring point cloud data in the first embodiment. Fig. 3 is a side view showing the posture of the subject 80 when acquiring point cloud data in the first embodiment. Fig. 4 is a diagram showing an example of a guide screen displayed on the portable information processing terminal 2 in the first embodiment.

[0011] 2 and 3, in order to estimate the thickness of the abdomen from one type of point cloud data related to the front of the abdomen (hereinafter referred to as front data), the front data is acquired with the subject 80 in a position with his / her back against a wall 90. For example, the position with his / her back against the wall 90 means a position with at least the back and buttocks against the wall 90.

[0012] As shown in FIG. 2, the subject 80 places the portable information processing terminal 2 at a position Pf in front of the abdomen of the subject 80, and performs an operation to acquire point cloud data using the three-dimensional sensor 21. At this time, it is preferable that a guide screen is displayed on the portable information processing terminal 2 to guide the subject 80 in a posture for appropriately acquiring point cloud data related to the front of the abdomen. For example, as shown in FIG. 4, a rectangular photographing frame 510 corresponding to the field of view of the three-dimensional sensor 21 is displayed on the guide screen 500. In the photographing frame 510, a marker 511 is displayed as a target for the subject 80 to align the position of the navel, a first guide line 513 is displayed as a target for the subject 80 to align the vertical axis (midline) of the body, and a pair of second guide lines 514, 515 is displayed as a target for the subject 80 to align the left and right ends of the abdomen. The portable information processing terminal 2 is placed at a position Pf in front of the abdomen of the subject 80, and its orientation is adjusted so that the navel of the subject 80 overlaps the marker 511, the midline overlaps the first guide line 513, and both left and right ends of the abdomen overlap the pair of second guide lines 514, 515. This sets a visual field range for the front of the abdomen of the subject 80 for the three-dimensional sensor 21. The three-dimensional sensor 21 scans the visual field range in the horizontal and vertical directions to generate point cloud data 100 (hereinafter referred to as front data 100) for the front of the abdomen of the subject 80. The front data 100 generated by the three-dimensional sensor 21 is transmitted from the portable information processing terminal 2 to the first information processing device 1 together with a request for calculating the abdominal circumference.

[0013] Each of the multiple points included in the front data has coordinate information on the X axis, coordinate information on the Y axis, and coordinate information on the Z axis as information indicating a position in three-dimensional space. Here, the X axis is defined as an axis parallel to the horizontal direction in the field of view, the Y axis is defined as an axis parallel to the vertical axis in the field of view, and the Z axis is defined as an axis parallel to the depth direction (also called the viewpoint direction) of the field of view. The origin of these coordinate axes is the position of the viewpoint of the three-dimensional sensor 21. In other words, the Z coordinate value of a point included in the front data corresponds to the distance in the depth direction from the three-dimensional sensor 21, and is also called a depth value. In the front data, the X axis corresponds to an axis parallel to the width direction of the abdomen, the Y axis corresponds to an axis parallel to the height direction of the abdomen, and the Z axis corresponds to an axis parallel to the thickness direction of the abdomen.

[0014] FIG. 5 is a diagram illustrating an example of a hardware configuration of the information processing device 1 according to the first embodiment. As shown in FIG. 5, the information processing device 1 as an abdominal circumference estimation device has a processor 11. A RAM 12, a ROM 13, a storage device 14, and a communication interface 17 are connected to the processor 11 via a system bus 10. The processor 11 is composed of, for example, a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The RAM 12 functions as a main memory, a work area, and the like of the processor 11. The ROM 13 stores a BIOS (Basic Input Output System) and an operating system program (OS) executed by the processor 11. The storage device 14 stores an abdominal circumference estimation processing program for realizing the abdominal circumference estimation processing, and various data required for the abdominal circumference estimation processing. The various data required for the abdominal circumference estimation processing include point cloud data related to the front of the abdomen of the subject 80, a calculation formula for an ellipse circumference length for calculating the abdominal circumference from the thickness and width of the abdomen, and the like. Various data such as the abdominal circumference estimation processing program stored in the storage device 14 may be recorded on a removable medium (non-temporary storage medium) such as a USB and distributed to users, or may be distributed by being downloaded to the portable information processing terminal 2 via a network.

[0015] FIG. 6 is a diagram showing an example of a functional configuration diagram of the information processing device 1 according to the first embodiment. As shown in FIG. 6, the processor 11 executes an abdominal circumference estimation processing program stored in the storage device 14, thereby functioning as a receiving processing unit 111, a transmitting processing unit 112, a memory processing unit 113, a navel identification processing unit 114, a thickness estimation processing unit 115, a width estimation processing unit 116, and an abdominal circumference calculation processing unit 117.

[0016] The reception processing unit 111 receives the front data together with the abdominal circumference calculation request from the portable information processing terminal 2 via the communication interface 17. The transmission processing unit 112 transmits the abdominal circumference calculated by the abdominal circumference calculation processing unit 117 to the portable information processing terminal 2 via the communication interface 17. The front data is stored in the storage device 14 by the storage processing unit 113.

[0017] The navel identification processing unit 114 uses the front data to identify the center of the navel region of the subject 80 within the field of view. The navel identification processing unit 114 will be described in detail later.

[0018] The thickness estimation processing unit 115 uses the front data to estimate the thickness of the abdominal area of ​​the subject 80. The thickness estimation processing by the thickness estimation processing unit 115 will be described in detail later.

[0019] The width estimation processing unit 116 uses the front data and the thickness of the abdomen estimated by the thickness estimation processing unit 115 to estimate the width of the abdomen of the subject 80. The width estimation process by the width estimation processing unit 116 will be described in detail later.

[0020] The abdominal circumference calculation processing unit 117 estimates the abdominal circumference of the subject 80 based on the abdominal thickness estimated by the thickness estimation processing unit 115 and the abdominal width estimated by the width estimation processing unit 116. Typically, the abdominal circumference is estimated by utilizing the fact that the cross-sectional shape of the abdomen is approximately elliptical. The abdominal circumference calculation processing unit 117 calculates the perimeter of the ellipse as the abdominal circumference of the subject 80, taking the abdominal thickness as the minor axis of the ellipse and the abdominal width as the major axis of the ellipse.

[0021] Hereinafter, the navel identification process by the navel identification processor 114 and the thickness estimation process by the thickness estimation processor 115 will be described with reference to Fig. 7. Fig. 7 is a supplementary diagram for explaining the navel identification processor 114 and the thickness estimation processor 115 in Fig. 6. First, the navel identification process performed by the navel identification processor 114 will be described. The navel identification processing unit 114 identifies the navel region that is recessed from the surroundings within the field of view based on the Z coordinate value obtained from the front data, and identifies the position coordinate values ​​of the center point of the navel region based on the XY coordinate values ​​obtained from the front data.

[0022] For example, the center point of the navel region is identified by the following procedure. First, the navel identification processing unit 114 creates a line profile related to the Z coordinate value for each Y coordinate value. Next, the navel identification processing unit 114 calculates the difference between the Z coordinate values ​​of two adjacent points for multiple points on the line profile, identifies two boundary points (first and second boundary points) where the absolute value of the difference value is equal to or greater than a first threshold value as the points at the left and right ends of the abdomen, and identifies the inner point between the two boundary points on the line profile as the point corresponding to the abdominal region. Next, the navel identification processing unit 114 sequentially calculates the difference between the Z coordinate values ​​of two adjacent points from the first boundary point to the second boundary point for multiple points on the line profile, and identifies a first change point where the absolute value of the difference value is equal to or greater than a second threshold value and the polarity of the difference value changes. Similarly, the navel identification processing unit 114 sequentially calculates the difference between the Z coordinate values ​​of two adjacent points from the second boundary point to the first boundary point, and identifies a second change point where the absolute value of the difference value is equal to or greater than a second threshold value and the polarity of the difference value changes. Then, the point between the two transition points on the line profile is identified as the point corresponding to the navel region. Finally, the navel identification processor 114 identifies the center point of the navel region from the multiple points corresponding to the navel region based on the XY coordinate values.

[0023] Specifically, as shown in Fig. 7, the navel identification processing unit 114 calculates the difference between the Z coordinate values ​​of two adjacent points on the line profile 101, and identifies two boundary points 101d and 101t where the absolute value of the difference value is equal to or greater than a first threshold value as the points at the left and right ends of the apparent abdomen. The navel identification processing unit 114 calculates the difference between the Z coordinate values ​​of two adjacent points from the first boundary point 101d to the second boundary point 101t on the line profile 101, and identifies a first change point 101k where the absolute value of the difference value is equal to or greater than a second threshold value and where the polarity of the difference value changes. Similarly, the navel identification processing unit 114 calculates the difference between the Z coordinate values ​​of two adjacent points from the second boundary point 101t to the first boundary point 101d on the line profile 101, and identifies a second change point 101m where the absolute value of the difference value is equal to or greater than a second threshold value and where the polarity of the difference value changes. Then, the navel identification processing unit 114 identifies points 101k, 101l, and 101m between the two change points 101k and 101m on the line profile as points corresponding to the navel region. By performing the same process on the other line profiles, multiple points 101k, 101l, 101m, 102l, and 103l corresponding to the navel region are identified. Then, the navel identification processing unit 114 identifies the center point 101l of the navel region based on the XY coordinate values ​​of the multiple points 101k, 101l, 101m, 102l, and 103l corresponding to the navel region. For example, the navel identification processing unit 114 calculates an average value from the minimum and maximum X coordinate values ​​of each of the multiple points 101k, 101l, 101m, 102l, and 103l corresponding to the navel region, and calculates an average value from the minimum and maximum Y coordinate values. Then, navel identification processor 114 identifies the point closest to the point represented by the average X coordinate value and the average Y coordinate value as the center point of the navel region. Of course, the center position of the navel region may be represented by the point represented by the average X coordinate value and the average Y coordinate value. Note that center point 101l of the navel region in Fig. 7 corresponds to center point R of the navel region in Fig. 8, and two boundary points 101d and 101t in Fig. 7 correspond to points G and F at the left and right ends of the abdomen in Fig. 8, respectively.

[0024] Next, the abdominal thickness estimation process performed by the thickness estimation processing unit 115 will be described. The thickness estimation processing unit 115 calculates the difference between the Z coordinate value of the surface of the abdomen obtained from the front data and the Z coordinate value of the surface of the wall 90 as the thickness of the abdomen. Specifically, as shown in FIG. 7, the thickness estimation processing unit 115 performs the same processing as the navel identification processing unit 114 to identify the center point 101l of the navel region and the point 101b corresponding to the surface of the wall 90. For example, points other than those between the two boundary points 101d and 101t on the line profile, that is, points outside the boundary points, are identified as points corresponding to the wall surface, and one of those points, point 101b, is identified as a point corresponding to the surface of the wall 90. Then, the absolute value (|Zb-Zl|) of the difference between the Z coordinate value Zl of the center point 101l of the navel region and the Z coordinate value Zb of the point 101b corresponding to the surface of the wall 90 is calculated as the thickness Dth of the abdomen. The Z coordinate value of the center point 101l of the navel region is an example of a Z coordinate value of the surface of the abdomen, and the Z coordinate value of the point 101b corresponding to the surface of the wall 90 is an example of a Z coordinate value of the wall surface.

[0025] Hereinafter, the abdominal width estimation process performed by width estimation processing unit 116 will be described with reference to FIG. Fig. 8 shows a horizontal cross section of the abdomen passing through the center point of the navel region. In Fig. 8, point C corresponds to the viewpoint of the three-dimensional sensor 21. Point R is the center point of the navel region, and corresponds to point 101l in Fig. 7. Point F is a point at the left end of the abdomen in the horizontal cross section passing through the center of the navel region, and corresponds to point 101t in Fig. 7. Point G is a point at the right end of the abdomen in the horizontal cross section passing through the center of the navel region, and corresponds to point 101d in Fig. 7. A roughly elliptical frame 80 shown by a dotted line represents the abdominal circumference of the actual subject 80.

[0026] For example, the width of the abdomen is estimated by the following procedure. First, the width estimation processor 116 defines an ellipse as the cross section of the abdomen using the front data, assuming that the cross section of the abdomen can be approximated by an ellipse. Specifically, the width estimation processor 116 sets the center point of the ellipse to point O, which passes through the center point R of the navel region from point C and is 1 / 2 the thickness Dth of the abdomen (in the depth direction) from the center point R of the navel region. Then, the width estimation processor 116 defines an ellipse A, which passes through point F, with the center point of the ellipse at point O, the major axis (line segment PQ) of the ellipse at length a, and the minor axis (line segment SR) of the ellipse at length b.

[0027] The width estimation processing unit 116 creates an equation of a tangent to the ellipse A with a point F on the ellipse A as a tangent point. The equation of the tangent can be expressed as shown in Formula (1) using the length a of the major axis of the ellipse A, the length b of the minor axis of the ellipse A, the center point O (Xo, Zo) of the ellipse A, and the point F (Xf, Zf).

[0028]

number

[0029]

number

[0030]

number

[0031] Hereinafter, the procedure of the abdominal circumference estimation process according to the first embodiment will be described with reference to FIG. FIG. 9 is a flowchart showing an example of the procedure of the abdominal circumference estimation process by the information processing device 1 according to the first embodiment. As shown in FIG. 9, the reception processing unit 111 receives point cloud data (front data) acquired from the front of the abdomen of the subject 80 from the portable information processing terminal 2 (S11). The navel identification processing unit 114 identifies the center point of the navel region of the subject 80 based on the Z coordinate value obtained from the front data (S12). The thickness estimation processing unit 115 calculates the difference between the Z coordinate value of the center point of the navel region and the Z coordinate value of the wall region as the abdominal thickness of the subject 80 (S13). The width estimation processing unit 116 calculates the abdominal width of the subject 80 using the front data and the abdominal thickness calculated in step S13 (S14). The abdominal circumference calculation processing unit 117 calculates the ellipse perimeter as the abdominal circumference of the subject 80 from the abdominal thickness calculated in step S13 and the abdominal width calculated in step S14 (S15). The transmission processing unit 112 transmits the waist circumference calculated in step S15 to the portable information processing terminal 2 (S16). As a result of the process of step S16, for example, the waist circumference is displayed on the portable information processing terminal 2 as a measurement result of the waist circumference.

[0032] According to the information processing device 1 of the first embodiment, the abdominal circumference of the subject 80 can be estimated using point cloud data (front data) acquired from the front of the abdomen of the subject 80 with the wall 90 as his / her back. One feature for realizing this is that the cross-sectional shape of the abdomen can be approximated to an ellipse, and the abdominal circumference can be approximated to the circumference of the ellipse. Since the minor axis of the ellipse used in calculating the circumference of the ellipse corresponds to the thickness of the abdomen, and the major axis of the ellipse corresponds to the width of the abdomen, the abdominal circumference can be estimated by calculation as long as the thickness and width of the abdomen are known. Another feature is that the subject 80 is made to stand with the wall 90 as his / her back when the point cloud data is acquired. In reality, the point cloud data relating to the front of the abdomen of the subject 80 who does not have the wall 90 as his / her back can estimate the width of the abdomen of the subject 80, but cannot estimate the thickness of the abdomen. This is because the point cloud data relating to the front of the abdomen of the subject 80 who does not have the wall 90 as his / her back does not include information regarding the thickness of the abdomen. However, if the point cloud data is related to the front of the abdomen of the subject 80 with his / her back against the wall 90, the thickness of the abdomen can be estimated from the difference between the Z coordinate value (depth value) of the point corresponding to the surface of the abdomen and the Z coordinate value of the point corresponding to the surface of the wall. With the above two features, the subject 80 can obtain the measurement result of the abdominal circumference from the information processing device 1 by simply placing the portable information processing terminal 2 equipped with the three-dimensional sensor 21 in front of the subject 80 and inputting an instruction to obtain point cloud data to the portable information processing terminal 2. Since it is only necessary to scan the abdominal circumference using the three-dimensional sensor 21 of the widely used portable information processing terminal 2, the subject 80 can easily obtain the result of the abdominal circumference anytime and anywhere, compared to the task of measuring the abdominal circumference using a tape measure. In addition, the number of times that the point cloud data is obtained using the portable information processing terminal 2 is only one. In this way, the information processing device 1 according to the first embodiment can reduce the labor required for the subject 80 to measure the abdominal circumference.

[0033] The method of identifying the center point of the navel region is not limited to the above. For example, a two-dimensional image showing the distribution of brightness values ​​corresponding to the Z coordinate value in the field of view may be created from the front data, and the center point of the navel region in the two-dimensional image may be identified based on the brightness value. Of course, each of the points constituting the front data may have XYZ position information as well as RGB color information, and a two-dimensional image showing the color distribution in the field of view may be created from the front data, and the center point of the navel region may be identified by performing image processing such as pattern matching on the created two-dimensional image.

[0034] As shown in FIG. 3, a gap of several centimeters may occur between the waist of the subject 80 with his / her back against the wall and the wall 90. Therefore, the thickness estimation processing unit 115 may calculate the thickness of the abdomen by subtracting a value corresponding to the gap between the wall and the waist of the subject 80 from the difference between the Z coordinate value of the surface of the abdomen and the Z coordinate value of the surface of the wall. This allows for more accurate calculation of the abdominal circumference. The value corresponding to the gap between the wall and the waist of the subject 80 may be a fixed value or a variable value. In the case of using a variable value, it is preferable that the value corresponding to the gap is determined based on body type information representing the body type of the subject 80. In this case, the storage device may previously store a gap information management table in which gaps are associated with body type information of the subject 80. For example, as shown in FIG. 10, the gap information management table manages gender, age, height, weight, and gaps. The four items of gender, age, height, and weight are examples of body type information. The body type information may be composed of two items, height and weight, as long as it includes at least height and weight, or may be composed of three items, height, weight, and sex. Moreover, the body type information may be composed of five or more items including other items such as country name in addition to the above four items. The gaps managed in the gap information management table are average gaps of a plurality of subjects 80 having corresponding body type information. As shown in FIG. 11, the portable information processing terminal 2 displays an input screen 400 for body type information. The input screen 400 displays input boxes 401, 402, 403, and 404 corresponding to gender, age, height, and weight, respectively. When the user inputs gender, age, height, and weight and operates the registration button 410, the body type information of the subject 80 is transmitted from the portable information processing terminal 2 to the first information processing device 1. The receiving processing unit 111 receives the body type information of the subject 80 from the portable information processing terminal 2 via the communication interface 17. The thickness estimation processing unit 115 refers to the gap information management table, identifies a gap corresponding to the body type information of the subject 80, and calculates the abdominal thickness Dth by subtracting the identified gap from the difference between the Z coordinate value of the abdominal surface and the Z coordinate value of the wall surface. Of course, the gap may not be determined based on the body type information of the subject 80, but the subject 80 may directly determine the gap.For example, a number of options with different gaps may be displayed on the screen of the portable information processing terminal 2, and the gap corresponding to the option selected by the subject 80 may be used in the calculation, or an input box for inputting the gap may be displayed on the screen of the portable information processing terminal 2, and the gap input by the subject 80 may be used in the calculation.

[0035] The abdominal thickness calculation method described above is based on the premise that the wall surface is perpendicular to the Z-axis direction (depth direction). However, even if the wall surface is not perpendicular to the Z-axis, the thickness estimation processing unit 115 can estimate the abdominal thickness using the front data. For example, the thickness estimation processing unit 115 extracts a plurality of points corresponding to the wall surface from a plurality of points included in the front data based on the Z coordinate value. Next, the thickness estimation processing unit 115 assumes that the equation of the two-dimensional plane corresponding to the wall surface is ax+by+cz+d=0, and derives coefficients a, b, c, and d for minimizing the distance between the extracted plurality of points and the two-dimensional plane. Finally, the thickness estimation processing unit 115 uses the center point of the navel region and the equation of the two-dimensional plane corresponding to the wall surface to calculate the distance (line segment RH) from the center point of the navel region (point R in FIG. 8) to the intersection point (point H in FIG. 8) of the perpendicular line dropped onto the two-dimensional plane and the two-dimensional plane as the abdominal thickness Dth.

[0036] In the abdominal circumference estimation process according to the first embodiment, the thickness and width of the abdomen are estimated using one type of measurement data, namely, point cloud data (front data) acquired from the front of the abdomen, and the ellipse perimeter is calculated as the abdominal circumference from the estimated abdominal thickness and width. However, instead of estimating the thickness of the abdomen using the front data, the thickness of the abdomen may be estimated using point cloud data (side data) acquired from the side of the abdomen. In other words, the abdominal circumference may be estimated using two types of measurement data, namely, point cloud data (front data) acquired from the front of the abdomen and point cloud data (side data) acquired from the side of the abdomen.

[0037] Hereinafter, the information processing device 1' according to the second embodiment will be described with reference to Figs. 12 to 15. The first embodiment and the second embodiment are different only in the method of estimating the thickness of the abdomen. Therefore, in the second embodiment, the contents related to the thickness estimation process, which is the difference from the first embodiment, will be mainly described. Specifically, in the second embodiment, since it is necessary to acquire side data, the acquisition of the side data will be described with reference to Figs. 12 and 13. In addition, the thickness estimation process by the thickness estimation processing unit 115 of the information processing device 1' according to the second embodiment (hereinafter, simply referred to as the second information processing device 1') will be described with reference to Fig. 14. Then, the procedure of the abdominal circumference estimation process by the second information processing device 1' will be described with reference to Fig. 15. Note that the second information processing device 1' has the same hardware configuration as the first information processing device 1 shown in Fig. 5, so the description thereof will be omitted. Similarly, the second information processing device 1 has the same functional configuration as the first information processing device 1 shown in Fig. 6. However, since the contents of the process of the thickness estimation processing unit 115 are different, the details of the thickness estimation processing unit 115 will be described later, and the description of the other components will be omitted.

[0038] A method of acquiring point cloud data in the second embodiment will be described below with reference to Figs. 12 and 13. Fig. 12 is a plan view showing the position of the portable information processing terminal 2 with respect to the subject 80 when acquiring point cloud data in the abdominal circumference estimation process according to the second embodiment. The point cloud data is acquired by the portable information processing terminal 2 held by the subject 80. As shown in Fig. 12, the subject 80 is placed at a position Pf in front of the abdomen of the subject 80, and an operation of acquiring point cloud data is performed using the three-dimensional sensor 21. The subject 80 is also placed at a position Ps to the side of the abdomen of the subject 80, and an operation of acquiring point cloud data is performed using the three-dimensional sensor 21. At this time, the portable information processing terminal 2 In this case, it is desirable to display a guidance screen that guides the subject 80 in a posture so that point cloud data relating to the front and side of the abdomen can be appropriately acquired.

[0039] For example, as shown in Fig. 13, when acquiring front data, a first guide screen 500 is displayed on the portable information processing terminal 2, and when acquiring side data, a second guide screen 600 is displayed on the portable information processing terminal 2. The first guide screen 500 corresponds to the guide screen 500 in Fig. 4, and therefore a description thereof will be omitted. The second guide screen 600 displays a rectangular photographing frame 610 corresponding to the field of view of the three-dimensional sensor 21. The photographing frame 610 displays a first guide line 611, which is a target for the subject 80 to align a horizontal plane passing through the navel, a second guide line 613, which is a target for the subject 80 to align a vertical axis (center line) of the body, and a pair of third guide lines 614, 615, which are targets for the subject 80 to align both the front and rear ends of the abdomen. The portable information processing terminal 2 is placed at a position Ps lateral to the abdomen of the subject 80, and its orientation is adjusted so that the navel of the subject 80 is aligned with the first guide line 611, the vertical axis of the body is aligned with the second guide line 613, and both left and right end points of the abdomen are aligned with the pair of third guide lines 614, 615. This sets a visual field range for the side of the abdomen of the subject 80 for the three-dimensional sensor 21. The three-dimensional sensor 21 scans the visual field range to generate point cloud data 200 (side data 200) for the side of the abdomen of the subject 80 placed within the visual field range. The side data 200 generated by the three-dimensional sensor 21 is transmitted from the portable information processing terminal 2 to the second information processing device 1' together with a request for calculating an abdominal circumference.

[0040] Each of the points included in the front data and the side data has coordinate information on the X axis, coordinate information on the Y axis, and coordinate information on the Z axis as information indicating a position in three-dimensional space. Here, the X axis is defined as an axis parallel to the horizontal direction in the field of view, the Y axis is defined as an axis parallel to the vertical axis in the field of view, and the Z axis is defined as an axis parallel to the depth direction (also called the viewpoint direction) of the field of view. The origin of these coordinate axes is the position of the viewpoint of the three-dimensional sensor 21. That is, the Z coordinate value of a point included in the front data and the side data corresponds to the distance from the three-dimensional sensor 21. In the front data, the X axis corresponds to an axis parallel to the width direction of the abdomen, the Y axis corresponds to an axis parallel to the height direction of the abdomen, and the Z axis corresponds to an axis parallel to the thickness direction of the abdomen. In the side data, the X axis corresponds to an axis parallel to the thickness direction of the abdomen, the Y axis corresponds to an axis parallel to the height direction of the abdomen, and the Z axis corresponds to an axis parallel to the width direction of the abdomen. In order to distinguish between the XYZ axes in the front data and the XYZ axes in the side data, the X-axis, Y-axis, and Z-axis in the front data are written as the X1-axis, Y1-axis, and Z1-axis, respectively, and the X-axis, Y-axis, and Z-axis in the side data are written as the X2-axis, Y2-axis, and Z2-axis, respectively.

[0041] Hereinafter, the estimation process of the abdominal thickness by the thickness estimation processing unit 115 will be described with reference to FIG. 14. The thickness estimation processing unit 115 estimates the abdominal thickness of the subject 80 using the side data. For example, the abdominal thickness is estimated by the following procedure. First, the thickness estimation processing unit 115 creates a line profile related to the Z coordinate value corresponding to the Y coordinate value of the center point of the navel region. Next, the thickness estimation processing unit 115 calculates the difference between the Z coordinate values ​​of two adjacent points for multiple points on the line profile related to the Z coordinate value, and identifies two boundary points where the absolute value of the difference value is equal to or greater than a first threshold value. Finally, the thickness estimation processing unit 115 calculates the abdominal thickness based on the X coordinate value of each of the two identified boundary points.

[0042] 14, the thickness estimation processor 115 creates a Z coordinate value line profile 201 whose Y2-axis coordinate value is Yr, sequentially calculates the difference in Z coordinate values ​​between two adjacent points on the line profile 201, and identifies two boundary points 201g, 201p whose absolute value of the difference is equal to or greater than a first threshold as the front and rear end points of the abdomen. The absolute value of the difference (Xg-Xp) between the X2 coordinate value Xg of the front end point 201g of the abdomen and the rear end point Xp of the abdomen is estimated as the thickness Dth of the abdomen.

[0043] Hereinafter, the procedure of the abdominal circumference estimation process according to the second embodiment will be described with reference to FIG. FIG. 15 is a flowchart showing an example of the procedure of abdominal circumference estimation processing by the information processing device 1 according to the second embodiment. As shown in FIG. 15, the reception processing unit 111 receives point cloud data (front data) acquired from the front of the abdomen of the subject 80 and point cloud data (side data) acquired from the side of the abdomen of the subject 80 from the portable information processing terminal 2 (S21). The navel identification processing unit 114 identifies the center point of the navel region of the subject 80 based on the Z coordinate value obtained from the front data (S22). The thickness estimation processing unit 115 estimates the thickness of the abdomen of the subject 80 based on the Z coordinate value obtained from the side data (S23). The width estimation processing unit 116 calculates the width of the abdomen of the subject 80 using the front data and the thickness of the abdomen estimated in step S23 (S24). The abdominal circumference calculation processing unit 117 calculates the perimeter of an ellipse as the abdominal circumference of the subject 80 from the abdominal thickness estimated in step S23 and the abdominal width calculated in step S24 (S25). The transmission processing unit 112 transmits the abdominal circumference calculated in step S25 to the portable information processing terminal 2 (S26). As a result of the processing of step S26, for example, the portable information processing terminal 2 displays the abdominal circumference as a measurement result of the abdominal circumference.

[0044] According to the information processing device 1 of the second embodiment, the abdominal circumference of the subject 80 can be estimated using point cloud data (front data) acquired from the front of the abdomen of the subject 80 and point cloud data (side data) acquired from the side of the abdomen of the subject 80. One feature for realizing this is that the cross-sectional shape of the abdomen can be approximated to an ellipse, and the abdominal circumference can be approximated to the circumference of the ellipse. Since the minor axis of the ellipse used in calculating the circumference of the ellipse corresponds to the thickness of the abdomen, and the major axis of the ellipse corresponds to the width of the abdomen, the abdominal circumference can be estimated by calculation as long as the thickness and width of the abdomen are known. With this feature, the subject 80 can obtain the estimated result of the abdominal circumference from the information processing device 1 by simply scanning the front and side of the abdomen with the three-dimensional sensor 21 mounted on the portable information processing terminal 2. Since it is only necessary to acquire the abdominal circumference using the widely used portable information processing terminal 2, the subject 80 can easily acquire the abdominal circumference anytime and anywhere, compared to the task of measuring the abdominal circumference using a tape measure. Therefore, the information processing device 1 according to the second embodiment can reduce the effort required for the subject 80 to measure the abdominal circumference.

[0045] In the first embodiment, the front data had to be acquired with the back to the wall 90, but in the second embodiment, there is no such restriction on the location. Therefore, it can be said that the second embodiment is superior to the first embodiment in terms of not being limited to a specific location for acquiring point cloud data. Meanwhile, in the first embodiment, the subject 80 only had to perform one operation to acquire front data, but in the second embodiment, the subject 80 must perform two operations to acquire front data and side data. Therefore, it can be said that the first embodiment is superior to the second embodiment in terms of the effort required for acquiring point cloud data.

[0046] In the second embodiment, the side data is used to estimate the absolute value of the difference between the X-coordinate values ​​of the end point corresponding to the front end of the abdomen and the end point corresponding to the rear end of the abdomen as the thickness of the abdomen. However, as described in FIG. 10 of the first embodiment, the absolute value of the difference between the X-coordinate values ​​of the end point corresponding to the front end of the abdomen and the end point corresponding to the rear end of the abdomen may be corrected based on the user's body type information, and the corrected result may be estimated as the thickness of the abdomen. For example, the absolute value of the difference may be multiplied by a coefficient (coefficient is 1 or more) according to the user's body type information to be the thickness of the abdomen, or the absolute value of the difference may be added to a correction value (correction value is 0 or more) according to the user's body type information to be the thickness of the abdomen.

[0047] As described in the first and second embodiments, one feature of the embodiment of the present invention is that the cross-sectional shape of the abdomen can be approximated to an ellipse, and the ellipse perimeter is calculated using point cloud data related to the abdomen, and the calculated ellipse perimeter is used as the abdominal circumference. In order to calculate the ellipse perimeter, the point cloud data related to the abdomen is used to estimate the width of the abdomen as the major axis of the ellipse, and the thickness of the abdomen as the minor axis of the ellipse is estimated. Therefore, if point cloud data related to the abdomen is used, the method of estimating the width and thickness of the abdomen is not limited to the embodiment. For example, the method of estimating the thickness of the abdomen in the second embodiment can be used for the method of estimating the width of the abdomen in the first and second embodiments. As shown in FIG. 7, the width estimation processing unit 116 may use the front data to identify an end point Xt corresponding to the left end of the abdomen and an end point Xd corresponding to the right end of the abdomen, and estimate the absolute value of the difference (Xt-Xd) between the X coordinate value Xt of the end point Xt corresponding to the left end of the abdomen and the end point Xd corresponding to the right end of the abdomen as the width Dwi of the abdomen.

[0048] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0049] 1...information processing device, 2...portable information processing terminal, 3...abdominal circumference estimation system, 9...network, 10...system bus, 11...processor, 12...RAM, 13...ROM, 14...memory unit, 17...communication I / F (communication interface), 21...three-dimensional sensor, 111...receiving processing unit, 112...transmitting processing unit, 113...memory processing unit, 114...navel identification processing unit, 115...thickness estimation processing unit, 116...width estimation processing unit, 117...abdominal circumference calculation processing unit.

Claims

1. a thickness estimation unit that estimates a thickness of the abdomen based on a Z coordinate value of a surface of the abdomen obtained from point cloud data acquired from the front of the abdomen of a subject with his / her back against a wall, and a Z coordinate value of a surface of the wall obtained from the point cloud data; a width estimation unit that estimates a width of the abdomen using the point cloud data and the estimated thickness of the abdomen; an abdominal circumference calculation unit that calculates an ellipse circumference as an abdominal circumference of the subject from the estimated abdominal thickness and the estimated abdominal width; An information processing device comprising:

2. The information processing device according to claim 1 , wherein the thickness estimation unit calculates a difference between a Z coordinate value of the surface of the abdomen and a Z coordinate value of the surface of the wall as the thickness of the abdomen.

3. The information processing device according to claim 1 , wherein the thickness estimation unit calculates the thickness of the abdomen as a value obtained by subtracting a value corresponding to a gap between the wall and the subject's waist from a difference between a Z coordinate value of the surface of the abdomen and a Z coordinate value of the surface of the wall.

4. 4. The information processing apparatus according to claim 3, wherein the corresponding value is a variable value according to at least height and weight.

5. The information processing apparatus according to claim 3 , wherein the corresponding value is a fixed value.

6. a navel identification unit that identifies a center of an umbilical region of the subject based on a Z coordinate value profile obtained from the point cloud data, The width estimation unit is In a horizontal cross section passing through the center of the specified umbilicus region, an ellipse is defined that has a center point at a point that passes through the center of the specified umbilicus region from the viewpoint of the point cloud data and is 1 / 2 the estimated thickness of the abdomen, passes through a left or right end point of the abdomen obtained from the point cloud data, and has a minor axis length equal to the estimated thickness of the abdomen; generating an equation of a tangent to the ellipse with the end point as a tangent point and an equation of a straight line connecting a viewpoint of the point cloud data and the end point, using a length of a minor axis of the ellipse and a length of a major axis of the ellipse as variables; 2 . The information processing device according to claim 1 , wherein the equation of the tangent and the equation of the straight line are treated as simultaneous equations, and the estimated value of the abdominal thickness is substituted for the length of the minor axis of the ellipse, to calculate the length of the major axis of the ellipse as the abdominal width.

7. Computer, A means for estimating a thickness of the abdomen based on a Z coordinate value of a surface of the abdomen obtained from point cloud data acquired from a front view of the abdomen of a subject with his / her back against a wall, and a Z coordinate value of a surface of the wall obtained from the point cloud data; means for estimating a width of the abdomen using the point cloud data together with the estimated thickness of the abdomen; A program that functions as a means for calculating an ellipse circumference as the subject's abdominal circumference from the estimated abdominal thickness and the estimated abdominal width.

Images