Shooting system

Abstract

To provide an imaging system that enables a user to easily image a whole-body image using an imaging terminal.SOLUTION: An imaging system includes a measuring instrument for measuring a physical feature of a subject and an imaging terminal. The measuring instrument includes a measurement surface on which the subject stands whose physical feature is to be measured, and a marker disposed at a predetermined position on the measuring instrument. The imaging terminal includes: a generation unit that images an imaged range including the measuring instrument and generates an imaged image; and a determination unit that determines, on the basis of a shape of the marker that appears in the imaged image, whether or not the imaged range includes a whole body of the subject when the subject stands on the measurement surface.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to an imaging system. Background Art

[0002] In dieting, motivation is maintained by continuously photographing one's own body shape to record changes in body shape. For example, Patent Document 1 describes a physique information measurement device that includes a weight scale and an imaging unit fixed to the weight scale, and calculates body dimensions based on a body image captured by the imaging unit. Prior Art Documents Patent Documents

[0003] Patent Document 1 Japanese Unexamined Patent Publication No. 2010-184073 Summary of the Invention Problem to be Solved by the Invention

[0004] It is desired to enable continuous imaging of one's own body shape even at home and the like which are not equipped with dedicated imaging equipment.

[0005] The present invention has been made to solve the above-mentioned problem, and an object of the present invention is to provide an imaging system that enables easy capturing of whole-body images using an imaging terminal. Means for Solving the Problem

[0006] An embodiment of the present invention is an imaging system comprising a measuring instrument for measuring the physical characteristics of a subject and an imaging terminal, wherein the measuring instrument comprises a measuring surface on which the subject whose physical characteristics are to be measured stands and a marker positioned at a predetermined location on the measuring instrument, and the imaging terminal comprises a generation unit that captures an imaging range including the measuring instrument and generates an image, and a determination unit that determines, based on the shape of the marker in the image, whether or not the imaging range includes the entire body of the subject when the subject stands on the measuring surface.

[0007] Furthermore, it is preferable that the marker has a first portion that extends in the direction of the subject's line of sight while standing on the measurement surface and is positioned to straddle the subject's position on the measurement surface, and a second portion that extends in a direction perpendicular to the line of sight.

[0008] Furthermore, it is preferable that the imaging terminal further includes an identification unit that identifies the skeleton of the subject as it appears in the captured image, and a body shape generation unit that generates an image of an ideal body shape by deforming a predetermined part of the subject's body as it appears in the captured image, based on the subject's skeleton.

[0009] Furthermore, the imaging terminal preferably includes a calculation unit that calculates the subject's current sebum thickness and the sebum thickness in the subject's ideal body shape based on the subject's weight, body fat percentage, and height, and the body shape generation unit preferably deforms a predetermined area based on the difference between the subject's current sebum thickness and the sebum thickness in the subject's ideal body shape.

[0010] Furthermore, the calculation unit calculates the total skin thickness of the subject's upper arm back and below the scapula based on the subject's weight, body fat percentage, and height, and based on the calculated total, it calculates the subject's current abdominal skin thickness and the abdominal skin thickness in the subject's ideal body type, respectively. The body shape generation unit preferably deforms the subject's abdomen as seen in the captured image based on the difference between the subject's current abdominal skin thickness and the abdominal skin thickness in the subject's ideal body type.

[0011] Furthermore, it is preferable that the imaging terminal further includes a display control unit that displays an image of the subject's body in the captured image in a way that allows for comparison with an image of an ideal body shape. [Effects of the Invention]

[0012] The imaging system according to the present invention makes it possible to easily capture a full-body image using an imaging terminal. [Brief explanation of the drawing]

[0013] [Figure 1] This figure shows an example of the schematic configuration of the imaging system 1. [Figure 2] This is an illustrative functional block diagram of the shooting terminal 3. [Figure 3] This diagram shows an example of guidance screen G1. [Figure 4] This diagram shows an example of guidance screen G1. [Figure 5] This figure shows an example of comparison screen G2. [Figure 6] This diagram shows an example of the image processing flow. [Figure 7] This diagram shows an example of the decision-making process flow. [Figure 8] (A) and (B) are schematic diagrams illustrating the generation of an image of an ideal body shape. [Modes for carrying out the invention]

[0014] Various embodiments of the present invention will be described below with reference to the drawings. Please note that the technical scope of the present invention is not limited to these embodiments, but extends to the invention described in the claims and its equivalents.

[0015] Figure 1 is a diagram showing an example of the schematic configuration of an imaging system 1 according to an embodiment of the present invention. The imaging system 1 includes a measuring instrument 2 and an imaging terminal 3. The imaging system 1 uses the imaging terminal 3 to capture a full-body image of a subject whose physical characteristics are measured by the measuring instrument 2.

[0016] The measuring instrument 2 is a device that measures physical characteristics of a subject, such as body weight and body composition, and is, for example, a weight scale or a body composition analyzer. The measuring instrument 2 includes a measuring surface 21 on which the subject steps, and a display unit 22 disposed on the measuring surface 21. The measuring instrument 2 measures the physical characteristics of the subject stepping on the measuring surface 21, and displays the measurement result on the display unit 22.

[0017] Further, the measuring instrument 2 includes a marker M disposed at a predetermined position on the measuring surface 21. The marker M is disposed, for example, by printing paint of a color different from that of the measuring surface 21 on the measuring surface 21. The marker M may also be disposed by joining a member of a color different from that of the measuring surface 21 to the measuring surface 21. The marker M has a first portion M1 that extends in the line-of-sight direction LS of the subject stepping on the measuring surface 21 and is disposed so as to sandwich the position of the subject on the measuring surface, and a second portion M2 that extends in a direction orthogonal to the line-of-sight direction LS. In the example shown in FIG. 1, the second portion M2 is disposed on the side closer to the line-of-sight direction than the position of the subject on the measuring surface 21.

[0018] The line-of-sight direction LS of the subject stepping on the measuring surface 21 and the position of the subject on the measuring surface 21 are defined by the configuration of the measuring instrument 2. For example, the position of the subject on the measuring surface 21 is defined by electrode surfaces disposed on the measuring surface 21 for measuring the physical characteristics of the subject. The position of the subject on the measuring surface 21 may also be defined by the position of a display (e.g., foot-shaped marks) on the measuring surface 21. Further, the line-of-sight direction LS of the subject stepping on the measuring surface 21 is defined as the direction in which the display unit 22 is disposed when viewed from the center of the measuring surface 21. The line-of-sight direction LS of the subject stepping on the measuring surface 21 may also be defined by the orientation of the display on the measuring surface 21.

[0019] The imaging terminal 3 is a computer that is not fixed to the measuring instrument 2 and can be carried by the subject, such as a digital camera, a mobile phone, a smartphone, a tablet terminal, a notebook PC (Personal Computer), etc. possessed by the subject. The imaging terminal 3 images an imaging range including the measuring instrument 2 to generate a captured image. Further, the imaging terminal 3 determines whether or not the imaging range is a range including the whole body of the subject when the subject steps onto the measuring instrument. The subject can capture an image of the whole body of the subject by referring to the determination result and placing the imaging terminal 3 at a position such that the whole body of the subject is included in the imaging range.

[0020] FIG. 2 is an exemplary functional block diagram of the imaging terminal 3. The imaging terminal 3 includes a storage unit 31, a communication unit 32, a display unit 33, an operation unit 34, an imaging unit 35, and a processing unit 36.

[0021] The storage unit 31 is configured to store data and programs, and includes, for example, a semiconductor memory. The storage unit 31 stores an operating system program, a driver program, an application program, data, and the like used for processing by the processing unit 36. The program is installed in the storage unit 31 from a computer-readable non-transitory portable storage medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or the like.

[0022] The communication unit 32 is configured to enable the imaging terminal 3 to communicate with other devices, and includes a communication interface circuit. The communication interface circuit is, for example, a communication interface circuit such as a wireless LAN (Local Area Network). The communication unit 32 supplies data received from another device to the processing unit 36, and transmits data supplied from the processing unit 36 to the other device.

[0023] The display unit 33 is configured for displaying images and includes a display such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The display unit 33 displays images based on display data supplied from the processing unit 36.

[0024] The operation unit 34 is configured to receive operations for the shooting terminal 3 and includes a keyboard, keypad, mouse, etc. The operation unit 34 may also include a touch panel integrated with the display unit 33. The operation unit 34 generates a signal corresponding to the received operation and supplies it to the processing unit 36.

[0025] The imaging unit 35 is configured to capture a predetermined shooting range and generate an image, and includes an imaging optical system, an image sensor, and an image processing circuit. The imaging optical system guides incident light to the image sensor so as to form an image on the light-receiving surface of the image sensor. The image sensor is an imaging sensor such as a CMOS (Complementary Metal Oxide Semiconductor) or CCD, and outputs the pixel values ​​of multiple pixels included in the captured image according to the light incident on the light-receiving surface. The image processing circuit generates data of the captured image based on the pixel values ​​output by the image sensor and supplies it to the processing unit 36.

[0026] The processing unit 36 ​​is configured to comprehensively control the operation of the imaging terminal 3 and comprises one or more processors and peripheral circuits. The processing unit 36 ​​may include, for example, a CPU (Central Processing Unit). The processing unit 36 ​​may also include a GPU (Graphics Processing Unit), LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), etc. The processing unit 36 ​​executes various processes based on the program stored in the storage unit 31.

[0027] The processing unit 36 ​​comprises a generation unit 361, a determination unit 362, an acquisition unit 363, a identification unit 364, a calculation unit 365, a body shape generation unit 366, and a display control unit 367 as functional blocks. Each of these units is a functional module realized based on a program executed by the processing unit 36. Each of these units may be implemented in the shooting terminal 3 as a dedicated calculation circuit.

[0028] The following describes the various screens displayed on the display unit 33 of the camera terminal 3.

[0029] Figure 3 shows an example of a guidance screen G1 displayed on the display unit 33. The guidance screen G1 is a screen that guides the subject holding the imaging terminal 3 so that the imaging range of the imaging terminal 3 includes the entire body of the subject when the subject is standing on the measurement surface 21. The guidance screen G1 is displayed, for example, when the operation unit 34 receives an operation to execute an imaging application program that has been pre-stored in the storage unit 31. The guidance screen G1 includes an image G11, an image of the subject G12, and guidance information G13.

[0030] The captured image G11 is an image of the shooting range generated by the imaging unit 35. The subject image G12 is a virtual image showing the subject when the subject is standing on the measurement surface 21 of the measuring instrument 2. The subject image G12 is displayed based on the position of the measurement surface 21 and the position and orientation of the shooting terminal 3, which are calculated in the shooting process described later. The guidance information G13 is a string of characters used to guide the subject. In the example shown in Figure 3, since the entire body of the subject in the image G12 is not included in the shooting range, the guidance information G13 displays a string of characters indicating that the shooting terminal 3 should be moved to a position where the entire body can be captured.

[0031] Figure 4 shows another example of the guidance screen G1. In the example shown in Figure 4, since the entire body of the subject's image G12 is included in the imaging range, the guidance information G13 displays a string of text indicating that the imaging terminal should be fixed at the current position.

[0032] Note that the subject's image G12 does not need to be displayed on the guidance screen G1. Also, instead of displaying text as guidance information G13, voice guidance for the subject may be output from an audio output unit (not shown).

[0033] Figure 5 shows an example of the comparison screen G2 displayed on the display unit 33. The comparison screen G2 is displayed when the imaging range on the guidance screen G1 includes the entire body of the subject and the subject is standing on the measuring instrument 2. The comparison screen G2 includes an image of the subject's current body G21 and an image of the subject's ideal body shape G22, and displays the current body image G21 and the ideal body shape image G22 in a way that allows for comparison.

[0034] The current body image G21 is generated by extracting the region corresponding to the subject from an image captured by the imaging terminal 3, which includes the subject standing on the measuring instrument 2. The ideal body shape image G22 is an image in which the abdomen of the subject's body as seen in the captured image has been deformed.

[0035] Figure 6 is a flowchart showing an example of the imaging process performed by the imaging terminal 3. The imaging process is performed with the subject's weight, body fat percentage, and height information stored in the storage unit 31. The imaging process is performed, for example, when the operation unit 34 receives an operation to execute an imaging application program. The imaging process is realized by the processing unit 36 ​​cooperating with other components of the imaging terminal 3 based on the program stored in the storage unit 31.

[0036] First, the generation unit 361 captures the shooting range including the measuring instrument and generates a captured image (step S101). The generation unit 361 acquires the captured image generated by the imaging unit 35. The generation unit 361 displays the guidance screen G1 including the acquired captured image.

[0037] Next, the determination unit 362 performs a determination process (step S102). The determination process determines whether the imaging range includes the entire body of the subject when the subject is standing on the measurement surface 21.

[0038] Figure 7 is a flowchart showing an example of the decision-making process.

[0039] First, the determination unit 362 determines whether or not marker M has been detected in the captured image (step S201). The determination unit 362 detects marker M from the captured image based on the color and shape of marker M that have been stored in advance. For example, the determination unit 362 performs pattern matching with the color and shape of marker M that have been stored in advance for multiple regions set in the captured image and calculates the similarity for each region. The determination unit 362 determines that marker M has been detected in the captured image if a region with a similarity of a predetermined value or more is detected. The determination unit 362 also extracts the region with the highest similarity as the region corresponding to marker M.

[0040] If a marker M is detected from the captured image (step S201-Yes), the determination unit 362 calculates the position and orientation of the imaging terminal 3 (step S202). The determination unit 362 calculates the position and orientation of the imaging terminal 3 based on the shape of the marker M that appears in the captured image. The position is represented by a three-dimensional translation vector, and the orientation is represented by a three-dimensional rotation vector. For example, the determination unit 362 calculates the position and orientation of the imaging terminal 3 using a known P3P (Perspective-3-Point) solver or the like.

[0041] In this case, the determination unit 362 identifies the feature points of marker M in the captured image. The determination unit 362 identifies at least three feature points. These feature points are, for example, the endpoints of the first part M1 and the connection points between the first part M1 and the second part M2. Based on the positional relationships of the feature points of marker M that have been stored in advance, the determination unit 362 sets the position coordinates of the feature points in the world coordinate system. Based on the relationship between the position coordinates of the feature points in the world coordinate system and the position coordinates in the camera coordinate system, the determination unit 362 calculates the position and orientation of the camera capture terminal 3.

[0042] Next, the determination unit 362 calculates the position of the subject's head when the subject is standing on the measuring device 2 (step S203). Based on the shape of the marker M captured in the image, the determination unit 362 calculates the position coordinates of the measurement surface 21 in the world coordinate system. The determination unit 362 calculates the position coordinates of a point located above the measurement surface 21 by a distance equivalent to the subject's height, which has been stored in advance, in the world coordinate system. The determination unit 362 calculates the position of the subject's head by converting the calculated position coordinates of the point into coordinates in the camera coordinate system.

[0043] Next, the determination unit 362 displays an image of the subject so as to connect the points on the measurement surface 21 with the position of the subject's head (step S204). The determination unit 362 deforms the pre-stored image of the subject so as to connect the points on the measurement surface 21 with the position of the subject's head and displays it on the guidance screen G1.

[0044] Next, the determination unit 362 determines whether the shooting range includes the entire body of the subject when the subject is standing on the measurement surface 21 (step S205). The determination unit 362 determines whether the position of the subject's head is included in the shooting range. For example, the determination unit 362 determines that the shooting range includes the entire body of the subject if the coordinates of the subject's head in the camera coordinate system are included in the captured image.

[0045] If the imaging range includes the entire body of the subject (step S205-Yes), the determination unit 362 determines that the imaging range includes the entire body of the subject when the subject is standing on the measurement surface 21 (step S206). The determination unit 362 displays a string of characters indicating that the imaging terminal should be fixed in its current position as guidance information G13 on the guidance screen G1. This completes the determination process.

[0046] If marker M is not detected in step S201 (step S201-No), or if the imaging range does not include the entire body of the subject in step S205 (step S205-No), the determination unit 362 determines that the imaging range does not include the entire body of the subject when the subject is standing on the measurement surface 21 (step S207). The determination unit 362 displays a string of characters as guidance information G13 on the guidance screen G1 indicating that the imaging terminal 3 should be moved to a position where the entire body is visible. This completes the determination process.

[0047] Returning to Figure 6, the acquisition unit 363 then refers to the result of the determination process and determines whether the imaging range includes the entire body of the subject (step S103).

[0048] If the imaging range includes the entire body of the subject (step S103-Yes), the acquisition unit 363 determines whether or not the subject is standing on the measuring instrument 2 (step S104). The acquisition unit 363 determines that the subject is standing on the measuring instrument 2 if a person is detected in the captured image from a predetermined area including above the measuring instrument 2.

[0049] For example, the acquisition unit 363 extracts a predetermined area from the captured image, including the area above the measuring instrument 2, as the detection target area. The detection target area includes the entire measuring surface 21, as well as an area that is a distance above the measuring surface 21 equivalent to the height of the subject. The acquisition unit 363 extracts HOG (Histogram of Oriented Gradient) features from the detection target area. The acquisition unit 363 calculates the similarity between the extracted features by comparing them with pre-set features of a person. The acquisition unit 363 determines that the subject is standing on the measuring instrument 2 if the calculated similarity is greater than or equal to a predetermined value. The acquisition unit 363 also acquires the detection target area as the person area.

[0050] The acquisition unit 363 is not limited to this example, and may also detect a person from a captured image using a trained model, such as a convolutional neural network, which has been trained to output a person region when an image is input. In this case, the acquisition unit 363 determines that a person is on the measuring instrument 2 when a person region is output from the trained model and the positional relationship between the person region output from the trained model and the measuring instrument 2 satisfies predetermined conditions.

[0051] If the imaging range in step S103 does not include the entire body of the subject (step S103-No), or if the subject is not on the measuring instrument 2 in step S104 (step S104-No), the imaging process returns to step S101. In other words, the acquisition unit 363 waits until the imaging range includes the entire body of the subject and the subject is on the measuring instrument 2.

[0052] If the subject is standing on the measuring instrument 2 in step S104 (step S104-Yes), the acquisition unit 363 acquires the captured image as the image to be processed (step S105).

[0053] Next, the identification unit 364 identifies the subject's skeleton as captured in the image (step S106). The identification unit 364 identifies the subject's skeleton based on the person region detected in step S104. For example, the identification unit 364 identifies the subject's skeleton by inputting the person region into a trained model, which is a convolutional neural network for pose estimation such as OpenPose or HRNet. For example, the identification unit 364 identifies the positions of the subject's shoulders, elbows, wrists, both ends of the waist, and knees as part of the subject's skeleton.

[0054] Next, the calculation unit 365 calculates the subject's current skin thickness and the skin thickness of the subject's ideal body type, based on the subject's weight, body fat percentage, and height (step S107). For example, the calculation unit 365 calculates the subject's current skin thickness using the caliper method. In this case, the calculation unit 365 calculates the sum of the subject's current skin thickness on the back of the upper arm and below the scapula based on the subject's weight, body fat percentage, and height, and then calculates the subject's current skin thickness on the abdomen based on the calculated sum.

[0055] According to the caliper method, the total skin thickness α of the upper arm dorsum and the area below the scapula is calculated using the following formula with the skin thickness coefficient X, body weight W, and body surface density A.

number

[0056] The skin sebum thickness coefficient X is defined using body density D, and the body surface area A is defined using body weight W and height H, respectively, by the following formulas.

number

[0057] Body density D is defined using body fat percentage (FAT) by the following formula:

number

[0058] The calculation unit 365 calculates the subject's current abdominal sebum thickness by multiplying the sum of the sebum thickness of the upper arm back and the area below the scapula by a pre-stored sebum thickness correction coefficient. The sebum thickness correction coefficient is set based on the ratio of sebum thickness for each body part for each age group and sex. The ratio of sebum thickness for each body part is determined, for example, based on the standard sebum thickness for each body part shown in Hidekazu Komiya, "Body Composition of Japanese People" (Health Science Vol. 19, 1997). The correction coefficient for calculating abdominal sebum thickness is, for example, 0.52 for young men, 0.5 for middle-aged men, 0.5 for elderly men, 0.41 for young women, 0.42 for middle-aged women, and 0.4 for elderly women.

[0059] Furthermore, the calculation unit 365 calculates the standard weight based on the subject's height. Based on the subject's height, standard weight, and standard body fat percentage, the calculation unit 365 similarly calculates the total skin thickness of the upper arm and below the scapula in the subject's ideal body type, and calculates the skin thickness of the abdomen in the ideal body type based on the calculated total. The standard body fat percentage is set in advance, for example, to 18%.

[0060] Next, the body shape generation unit 366 generates an image of the ideal body shape by deforming the abdomen of the subject's body as seen in the captured image, based on the subject's skeleton (step S108). Based on the subject's skeleton, the body shape generation unit 366 extracts the region corresponding to the abdomen from the human region detected in step S104 as the region to be deformed. The body shape generation unit 366 generates an image of the ideal body shape by deforming the region to be deformed based on the difference between the subject's current skin sebum thickness and the skin sebum thickness in the ideal body shape.

[0061] Figures 8(A) and (B) are schematic diagrams illustrating the generation of an image of an ideal body shape. For example, the body shape generation unit 366 applies edge detection technology to the person region detected in step S104 to identify the person's edge pixels. Based on the positional relationship between the subject's skeleton and the person's edge pixels, the body shape generation unit 366 identifies the edge pixels of the torso region and the edge pixels of the arms from among the person's edge pixels. The body shape generation unit 366 extracts a region as the deformation target region that is a predetermined distance above both ends of the person's waist, includes the edges of the person's torso region, and does not include the edges of the arms. In the example shown in Figure 8(A), the rectangular region A is extracted as the deformation target region.

[0062] The body shape generation unit 366 calculates the difference between the subject's current sebum thickness and the sebum thickness in the ideal body shape. The body shape generation unit 366 calculates the deformation amount by converting the calculated difference into the number of pixels in the captured image. The body shape generation unit 366 generates an image of the ideal body shape by deforming the deformation target area based on the deformation amount. In the example shown in Figure 8(B), each side of region A is curved so that it is indented inward by a deformation amount Δ at the center. In addition, along with the curvature of the side edges, each of the multiple pixels contained in region A is deformed so that it moves inward according to its position. As a result, an image of the subject's abdomen being indented is generated as the image of the ideal body shape. For example, the amount of movement of each pixel is set to be larger as the pixel's position is closer to the outside in the left-right direction and closer to the center in the up-down direction.

[0063] Returning to Figure 6, the display control unit 367 displays the image of the subject's body in the captured image and the image of the ideal body shape in a way that allows for comparison (step S109). The display control unit 367 displays a comparison screen G2 on the display unit 33, which includes the image of the subject's current body extracted in step S104 and the image of the subject's ideal body shape. This completes the shooting process.

[0064] As described above, the imaging system 1 includes a measuring instrument 2 having a marker M positioned at a predetermined location on the measurement surface 21 on which the subject stands, and an imaging terminal 3. The imaging terminal 3 includes a generation unit 361 that captures the imaging range and generates an image, and a determination unit 362 that determines, based on the shape of the marker M in the image, whether the imaging range includes the entire body of the subject when the subject stands on the measurement surface 21. This makes it possible for the imaging system 1 to easily capture a full-body image using the imaging terminal.

[0065] Furthermore, it is preferable that the marker M has a first portion M1 that extends in the direction of the subject's line of sight on the measurement surface 21 and is positioned to straddle the subject's position on the measurement surface 21, and a second portion M2 that extends in a direction perpendicular to the line of sight. By positioning the marker M to straddle the subject's position on the measurement surface 21, the position and orientation of the imaging terminal 3 relative to the subject's position on the measurement surface 21 can be calculated with high accuracy. Therefore, the imaging system 1 enables the simple and reliable acquisition of whole-body images using the imaging terminal.

[0066] Furthermore, it is preferable that the imaging terminal 3 includes an identification unit 364 that identifies the subject's skeleton as seen in the captured image, and a body shape generation unit 366 that generates an image of the subject's abdomen as seen in the captured image, based on the subject's skeleton, as an image of the ideal body shape. This allows the imaging system 1 to help the subject understand their ideal body shape and improve their motivation to diet.

[0067] Furthermore, the imaging terminal 3 preferably includes a calculation unit 365 that calculates the subject's current sebum thickness and the sebum thickness in the subject's ideal body shape, and the body shape generation unit 366 preferably deforms the subject's abdomen as seen in the captured image based on the difference between the subject's current sebum thickness and the sebum thickness in the ideal body shape. This allows the imaging system 1 to help the subject understand their appropriate ideal body shape and further enhance their motivation to diet.

[0068] Furthermore, it is preferable that the calculation unit 365 calculates the total skin thickness of the subject's upper arm and below the scapula based on the subject's weight, body fat percentage, and height, and then calculates the subject's current abdominal skin thickness and the abdominal skin thickness of the subject's ideal body type based on the calculated total. The relationship between the total skin thickness of the subject's upper arm and below the scapula and the subject's weight, body fat percentage, and height is used in the caliper method, and a strong correlation between the two is known. By calculating the subject's skin thickness via the total skin thickness of the upper arm and below the scapula, the imaging system 1 can calculate the subject's skin thickness with high accuracy, allowing the subject to understand a more appropriate ideal body type and further increasing the subject's motivation to diet.

[0069] Furthermore, it is preferable that the imaging terminal 3 further includes a display control unit 367 that displays an image of the subject's body in the captured image in a way that allows for comparison with an image of the ideal body shape. This enables the imaging system 1 to allow the subject to understand the difference between their ideal body shape and their current body shape, thereby further increasing the subject's motivation to diet.

[0070] The following modifications may be applied to the imaging system 1.

[0071] In the embodiment described above, the marker M has a first part M1 and a second part M2. However, the marker M is not limited to this example and may have any shape and be placed at any position on the measurement surface 21. In this case as well, the imaging system 1 calculates the position and orientation of the imaging terminal 3 relative to the measurement surface 21 with high precision, enabling easy and reliable capture of a whole-body image using the imaging terminal. Furthermore, the marker M may be placed at a position other than the measurement surface 21, such as the side of the measuring instrument 2.

[0072] In the embodiment described above, in step S107 of the imaging process, the calculation unit 365 calculates the skin thickness for the subject's ideal body type based on the standard weight and standard body fat percentage. However, the calculation unit 365 may also calculate the skin thickness for the subject's ideal body type based on the ideal weight and ideal body fat percentage set by the subject. In this case, the imaging terminal 3 obtains the ideal weight and ideal body fat percentage in advance in response to the subject's operation of the operation unit 14.

[0073] In the embodiment described above, in step S108 of the imaging process, the body shape generation unit 366 deforms the subject's abdomen as seen in the image based on the difference between the subject's current skin thickness and the skin thickness of the subject's ideal body shape, based on the subject's weight, body fat percentage, and height. The body shape generation unit 366 is not limited to this example, and may also deform the subject's abdomen as seen in the image based on a deformation amount pre-stored in the memory unit 31. The deformation amount may be set, for example, based on the difference between the subject's current waist circumference and the waist circumference the subject desires. In this case, the imaging terminal 3 obtains the subject's desired waist circumference in advance in response to the subject's operation of the operation unit 14.

[0074] In the embodiment described above, in step S108 of the imaging process, the body shape generation unit 366 deforms the subject's abdomen as seen in the captured image. However, the body shape generation unit 366 is not limited to this example and may deform any part of the subject's body. For example, the body shape generation unit 366 may deform the subject's upper arm, thigh, etc. In this case, in step S107, the calculation unit 365 calculates the subject's current skin thickness at the target site by multiplying the sum of the skin thickness at the back of the subject's upper arm and below the scapula by a correction coefficient corresponding to the target site to be deformed. Similarly, the calculation unit 365 calculates the skin thickness at the target site in the subject's ideal body shape.

[0075] In the embodiment described above, the determination unit 362 determines that the imaging range includes the entire body of the subject if the position of the subject's head is included in the imaging range. However, the determination unit 362 may also determine that the imaging range includes the entire body of the subject if the position and shape of the marker in the captured image are in a predetermined position and shape set based on past captured images. The predetermined position and shape are, for example, the position and shape of the marker that was in the captured image at the time when it was determined in a previously executed determination process that the imaging range included the entire body of the subject.

[0076] In this case, after the determination process step S206, the determination unit 362 stores the position and shape of the marker M in the captured image in the storage unit 31. For example, the determination unit 362 stores the coordinates of the feature points of the marker M extracted from the captured image as the position and shape of the marker M. The determination unit 362 may also store the edge pixels of the marker M detected from the captured image using known edge detection techniques as the position and shape of the marker M.

[0077] If the position and shape of marker M are stored in the determination process, the determination unit 362 displays the stored position and shape of marker M superimposed on the guidance screen G1. The subject moves the imaging terminal 3 so that the actual marker M in the captured image overlaps with the position and shape of marker M displayed superimposed on the guidance screen G1. The determination unit 362 determines that the imaging range includes the entire body of the subject if the position and shape of the actual marker M in the captured image is similar to the position and shape of marker M displayed on the guidance screen G1. For example, the determination unit 362 calculates the similarity between the feature points of the actual marker M in the captured image and the feature points of the stored marker M, and determines that the position and shape of the actual marker M are similar to the position and shape of the stored marker M if the similarity is greater than or equal to a predetermined value.

[0078] For subsequent imaging sessions, the subject can capture a full-body image by recreating the positional relationship between the measuring instrument 2 and the imaging terminal 3 from previous imaging sessions. The determination unit 362 assists the subject in recreating the positional relationship between the measuring instrument 2 and the imaging terminal 3 from previous imaging sessions based on the position and shape of the markers visible in the captured image, enabling the subject to easily capture a full-body image.

[0079] In the embodiment described above, in step S207 of the determination process, the determination unit 362 displays a string of characters as guidance information G13 indicating that the imaging terminal 3 should be moved to a position where the entire body is visible. The determination unit 362 is not limited to this example, and may display different strings of characters as guidance information G13 depending on the position of the subject's head. For example, if the coordinates of the subject's head are outside the imaging range and located to the side of the imaging range, the determination unit 362 displays a string of characters indicating that the tilt of the imaging terminal 3 should be corrected. The determination unit 362 may also display different strings of characters as guidance information G13 based on the position or orientation of the imaging terminal 3. For example, if the coordinates of the subject's head are outside the imaging range and located above the imaging range, the determination unit 362 may display a string of characters indicating that the tilt of the imaging terminal 3 should be corrected if the tilt of the imaging terminal 3 is large, or a string of characters indicating that the subject should move away from the measuring instrument 2 if the tilt of the imaging terminal 3 is small. The tilt of the imaging terminal 3 may be calculated based on the captured image, or it may be obtained from the tilt sensor provided by the imaging terminal 3. This allows the imaging system 1 to more easily capture full-body images of the subject using the imaging terminal 3.

[0080] In the embodiment described above, the imaging terminal 3 pre-stores the subject's height, weight, and body fat percentage in the storage unit 31. However, the invention is not limited to this example, and the imaging terminal 3 may also acquire height, weight, and body fat percentage from the measuring instrument 2 via the communication unit 32.

[0081] The functions of the imaging terminal 3 described above may be implemented by multiple devices.

[0082] Those skilled in the art will understand that various changes, substitutions, and modifications can be made without departing the scope of the present invention. For example, the embodiments and modifications described above may be combined as appropriate within the scope of the present invention. [Explanation of Symbols]

[0083] 1. Shooting System 2 Measuring Instruments 21 Measurement surface 3. Shooting device 35 Imaging Unit 361 Generation part 362 Judgment section 363 Acquisition Department 364 Specific part 365 Calculation Department 366 Body shape generation department 367 Display Control Unit

Claims

1. A imaging system comprising a measuring instrument for measuring the physical characteristics of a subject and an imaging terminal, The aforementioned measuring instrument is The measurement surface on which the subject whose physical characteristics are to be measured stands, The measuring instrument has a marker positioned at a predetermined location, The aforementioned shooting terminal is A generation unit that captures the shooting range including the aforementioned measuring instrument and generates a captured image, A determination unit that determines whether the shooting range includes the entire body of the subject when the subject is standing on the measurement surface, based on the shape of the marker captured in the captured image, The system includes an output unit that outputs guidance information to guide the subject to a position where their entire body can be seen, according to the determination result from the determination unit. A shooting system characterized by the following features.

2. The shooting system according to claim 1, wherein the guidance information is a guidance screen or audio.

3. The marker has a first portion that extends in the direction of the subject's line of sight while standing on the measurement surface and is positioned to straddle the subject's position on the measurement surface, and a second portion that extends in a direction perpendicular to the direction of the line of sight. The imaging system according to claim 1.

4. The aforementioned shooting terminal is An identification unit that identifies the skeleton of the subject as seen in the aforementioned captured image, The system further includes a body shape generation unit that generates an image of an ideal body shape by deforming a predetermined part of the subject's body as seen in the captured image, based on the subject's skeletal structure. The imaging system according to claim 1.

5. The aforementioned imaging terminal further includes a calculation unit that calculates the subject's current skin sebum thickness and the skin sebum thickness in the subject's ideal body type, based on the subject's weight, body fat percentage, and height. The body shape generating unit deforms the predetermined area based on the difference between the subject's current sebum thickness and the sebum thickness in the subject's ideal body shape. The imaging system according to claim 4.

6. The calculation unit calculates the total skin thickness of the subject's upper arm and below the scapula based on the subject's weight, body fat percentage, and height, and calculates the subject's current abdominal skin thickness and the abdominal skin thickness in the subject's ideal body type based on the calculated total value. The body shape generation unit deforms the subject's abdomen as seen in the captured image based on the difference between the subject's current abdominal sebum thickness and the abdominal sebum thickness in the subject's ideal body shape. The imaging system according to claim 5.

7. The imaging system according to claim 4, wherein the imaging terminal further comprises a display control unit that displays an image of the subject's body in the captured image in a way that allows for comparison with the image of the ideal body shape.

Images