Skin condition measurement system

Abstract

To provide a skin condition measurement system that acquires measurement data on a user's skin condition using respective imaging by a skin condition measurement device and an imaging device to make it possible, on the basis of a plurality of sets of data, to improve quality of information on the user's skin condition.SOLUTION: A skin condition measurement system images a predetermined part of a user's skin using a skin condition measurement device 10, images a predetermined range of the user's body using an imaging device, acquires, by a control unit 31 on the basis of the respectively obtained image data, information on a skin condition, and associates the information on the skin condition of the predetermined part with partial information corresponding to the predetermined part of the skin out of information on a skin condition in the predetermined range of the body to enable utilization of the separately acquired information when trying to use the partial information corresponding to the predetermined part, which makes it possible to improve quality of information on the skin condition based on the picture data, to accurately perform processing on the skin condition, and to appropriately and efficiently perform skin condition diagnosis to allow the user to recognize the skin condition more accurately.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] The present invention relates to a skin condition measuring system capable of providing a user with information related to the user's skin condition. [Background technology]

[0002] There has long been a service in which stores are equipped with skin condition measuring devices and analytical equipment to measure customers' skin conditions, analyze the measurement data to obtain analysis results, and then recommend and sell to customers skin care cosmetics and beauty tools that correspond to the skin condition indicated by the analysis results.

[0003] In response to this, in recent years, proposals have been made to use personal electronic devices to acquire a user's facial data, analyze the facial data, and share the information obtained with other users, thereby enabling the data to be used for facial skin care. An example of such a conventional device for acquiring information for facial skin care is disclosed in JP 2017-211970 A. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-211970 A Summary of the Invention [Problem to be solved by the invention]

[0005] Conventional devices for acquiring facial skin care information were configured as shown in the above-mentioned patent document, and were capable of capturing an image of the user's entire face, analyzing the acquired facial data, and acquiring information for skin care.

[0006] However, these conventional devices obtain facial data by capturing an image of the user's entire face with an imaging device, which results in coarse detection accuracy of the user's skin condition and insufficient information to analyze, and the care information obtained from the analysis is not sufficient for skin care, making it difficult for users to use the care information to perform appropriate skin care.

[0007] The present invention has been made to solve the above-mentioned problems, and aims to provide a skin condition measuring system that obtains measurement data of a user's skin condition by imaging with a skin condition measuring device and an imaging device, and improves the quality of information about the user's skin condition that is presented to the user based on multiple sets of data. [Means for solving the problem]

[0008] The skin condition measuring system disclosed in the present invention comprises a skin condition measuring device capable of imaging a predetermined part of a user's skin, an imaging device capable of imaging a predetermined range of the user's body including the part of the skin to be imaged by the skin condition measuring device, and a control unit that acquires information regarding the skin condition based on image data of the skin obtained by imaging, wherein the control unit is capable of acquiring information regarding the skin condition of the predetermined range of the body based on image data of the predetermined range of the body obtained by imaging with the imaging device, and is also capable of acquiring information regarding the skin condition of the predetermined part based on image data of the predetermined part of the skin obtained by imaging with the skin condition measuring device, and further associates information regarding the skin condition of the predetermined part with information corresponding to the predetermined part of the skin among the information regarding the skin condition of the predetermined range of the body.

[0009] Thus, according to the disclosure of the present invention, a predetermined part of the user's skin is imaged with a skin condition measuring device, and a predetermined area of ​​the user's body is imaged with an imaging device, and a control unit acquires information regarding the skin condition based on the image data of the predetermined part and the image data of the predetermined area of ​​the body obtained, and among the information regarding the skin condition of the predetermined area of ​​the body derived from the image data of the predetermined area of ​​the body, information regarding the skin condition of the predetermined area of ​​the skin derived from the image data of the predetermined area is associated with partial information corresponding to the predetermined area of ​​the skin, so that when an attempt is made to use the partial information corresponding to the predetermined area of ​​the skin, information regarding the skin condition of the predetermined area obtained separately can be utilized, thereby improving the quality of the information regarding the user's skin condition based on the image data obtained by imaging, and processing such as displaying and analyzing the skin condition can be performed with high accuracy, and skin condition diagnosis can be carried out appropriately and efficiently, allowing the user to more accurately grasp their skin condition.

[0010] In addition, in the skin condition measuring system disclosed in the present invention, if necessary, the control unit acquires information regarding the skin condition of a specified area of ​​the body based on image data of the specified area of ​​the body obtained by imaging with the imaging device, selects a specified area of ​​the skin to be imaged by the skin condition measuring device from the information regarding the skin condition of the specified area of ​​the body, and enables imaging of the specified area of ​​the skin by the skin condition measuring device.

[0011] Thus, according to the disclosure of the present invention, information regarding the skin condition of a specified area of ​​the body is obtained from image data of the specified area of ​​the body obtained by imaging with an imaging device, and this information is used to select a specified area of ​​the skin to be imaged with a skin condition measuring device, and imaging is performed with the skin condition measuring device to obtain image data of the specified area.By doing so, for example, even if the quality of the information regarding the skin condition of the specified area of ​​the body is insufficient, such as when only a portion of the information corresponding to the specified area of ​​the skin in the information regarding the skin condition of the specified area of ​​the body is insufficient, and the image data of the specified area of ​​the body is coarse data with insufficient resolution in the details due to the wide imaging range, and the information required for evaluating the skin condition of the specified area is lacking, new information regarding the skin condition is obtained from image data of that area obtained by imaging with the skin condition measuring device, and this information is used as information related to the information regarding the skin condition of the specified area of ​​the body, it is possible to allow the user to reliably grasp the skin condition from the entire information regarding the skin condition of the specified area, and further encourage the user to take appropriate care and other measures regarding the skin of the specified area.

[0012] In addition, the skin condition measuring system disclosed in the present invention is equipped with a display unit capable of at least displaying an image of the specified area of ​​the user's body as necessary, and the control unit acquires an image of the specified area of ​​the body derived from image data of the specified area of ​​the body as information regarding the skin condition of the specified area of ​​the body, and acquires an image of the specified area of ​​the skin derived from image data of the specified area of ​​the skin as information regarding the skin condition of the specified area, the display unit is capable of executing the display of the images acquired by the control unit, and the control unit associates the image of the specified area with a part of the image of the specified area of ​​the body that corresponds to the specified area of ​​the skin, and displays the image of the specified area simultaneously with or consecutively with the display of an image of part or all of the specified area of ​​the body on the display unit.

[0013] Thus, according to the disclosure of the present invention, a display unit capable of displaying an image is provided, information regarding the skin condition is treated as display image information, and the display unit displays an image based on this display image information. Part of the information in the display image information of the specified area of ​​the body corresponding to the specified part of the skin is associated with display image information of the specified part of the skin based on image data obtained by imaging the skin condition measuring device, and when the display unit displays an image of the specified area of ​​the body, the display of the image of the specified part based on the display image information of the specified part is performed simultaneously with or successively in succession to the image display of the specified area of ​​the body. By displaying the specified part of the specified area of ​​the body displayed on the display unit as a new image on the same display unit, the content of the image showing the user's skin condition based on the image data obtained by imaging is enriched, and at least for the area to be imaged by the skin condition measuring device, the skin condition can be confirmed not only from the image display of the entire specified area of ​​the body but also from a more detailed image display from the skin condition measuring device, allowing the user to grasp the skin condition more accurately and easily.

[0014] In addition, the skin condition measuring system disclosed in the present invention is equipped with a display unit that can display information regarding the user's skin condition as necessary, and the control unit obtains diagnostic information on the skin condition of the specified area of ​​the body by analyzing image data of the specified area of ​​the body as information regarding the skin condition of the specified area of ​​the body, and obtains diagnostic information on the skin condition of the specified area of ​​the skin by analyzing image data of the specified area of ​​the skin as information regarding the skin condition of the specified area, and the control unit associates the diagnostic information on the skin condition of the specified area with some information that corresponds to the specified area of ​​the skin in the diagnostic information on the skin condition of the specified area of ​​the body, and when displaying the diagnostic information on the skin condition of the specified area of ​​the body on the display unit, the diagnostic information on the skin condition of the specified area is displayed by adding or replacing the some information that corresponds to the specified area of ​​the skin.

[0015] Thus, according to the disclosure of the present invention, a display unit capable of displaying information regarding the skin condition is provided, the information regarding the skin condition is diagnostic information regarding the skin condition obtained by analysis of image data, and some information corresponding to the specified part of the skin in the diagnostic information regarding the skin condition of the specified part of the skin based on image data obtained by imaging with the skin condition measuring device is associated with diagnostic information regarding the skin condition of the specified part of the skin based on image data obtained by imaging with the skin condition measuring device, and when the diagnostic information regarding the skin condition of the specified part of the body is displayed on the display unit, for the part of the diagnostic information corresponding to the specified part, the diagnostic information of the skin condition of the specified part associated with it is displayed so as to supplement or replace the part of the diagnostic information, and the diagnostic information is provided to the user as detailed information including information analyzed from the image data obtained by the skin condition measuring device, thereby enriching the content of the diagnostic information regarding the user's skin condition based on the image data obtained by imaging, and at least for the part imaged by the skin condition measuring device, the user can understand the skin condition by referring to diagnostic information from a different perspective obtained by analysis of the image data from the skin condition measuring device, thereby enabling the user to grasp the skin condition more accurately and easily.

[0016] In addition, in the skin condition measuring system disclosed in the present invention, if necessary, the skin condition measuring device captures an image of a specified part of the user's skin by irradiating it with light from a specified light source that is different from the light used as illumination light for imaging the specified area of ​​the body by the imaging device.

[0017] Thus, according to the disclosure of the present invention, when imaging with a skin condition measuring device, imaging is performed under conditions in which a specific part of the user's skin is irradiated with light from a specific light source that is different from the light used as illumination light for imaging by the imaging device. By obtaining image data with different imaging conditions between the skin condition measuring device and the imaging device, it is possible to increase the difference in skin images, which are affected by the reflection, absorption, and attenuation of light irradiated as illumination in each layer of the skin, between the skin condition measuring device and the imaging device, thereby increasing the information content of the image data as diagnostic material used in diagnosing the skin condition and enabling an appropriate diagnosis of the skin condition. In particular, depending on the selection of the light to be irradiated, it is possible to perform imaging with the skin condition measuring device under conditions suitable for detailed analysis of partial skin condition, thereby improving the accuracy of skin condition diagnosis.

[0018] In addition, in the skin condition measuring system disclosed in the present invention, if necessary, the control unit performs image correction processing on a part or all of the image data of the specified area of ​​the body, based on the image data of the specified part.

[0019] Thus, according to the disclosure of the present invention, the image data of the specified area of ​​the body based on the image data of the skin condition measuring device, which makes it easier to prepare the imaging conditions by limiting the imaging range, is used as a reference by the control unit to perform image correction processing on the image data of the specified area of ​​the body, and the color of the skin image of the specified area of ​​the body shown in this image data can be adjusted to match that of the skin image in the image data of the specified area, so that the skin image of the specified area of ​​the body shown in the image data more accurately indicates the skin condition.Irrespective of the imaging conditions of the imaging device, the image data of the specified area of ​​the body obtained by imaging can be made in a state that makes it easier to perform image display and analysis related to diagnosing the skin condition, thereby encouraging the user to correctly understand the skin condition.

[0020] In addition, in the skin condition measuring system disclosed in the present invention, if necessary, the control unit executes a process to synthesize a predetermined guide design portion, indicating that the position is to be imaged by the skin condition measuring device, at least at a predetermined position on the image of the predetermined area of ​​the body derived from image data of the predetermined area of ​​the body, and the display unit displays the guide design portion as part of the image while displaying the image of the predetermined area of ​​the body.

[0021] Thus, according to the disclosure of the present invention, the control unit executes image processing to synthesize a specified guide design portion at a position in the image of the specified body area that corresponds to the part of the skin condition measuring device that is to be imaged, and the image of the specified body area, now including this guide design portion through synthesis, is displayed on the display unit, and the part of the skin condition measuring device that is to be imaged is shown at the position of the guide design portion, thereby making it possible for the user to easily understand which part of the specified body area is to be imaged by the skin condition measuring device, and the user can appropriately perform imaging using the skin condition measuring device. [Brief description of the drawings]

[0022] [Figure 1] 1 is a schematic configuration diagram of a skin condition measuring system according to a first embodiment of the present invention. [Diagram 2] 1 is a block diagram showing the configuration of a skin condition measuring system according to a first embodiment of the present invention. [Diagram 3] 1 is a schematic configuration diagram of a skin condition measuring device in a skin condition measuring system according to a first embodiment of the present invention. [Figure 4] FIG. 2 is an explanatory diagram of a display screen of the terminal device immediately before imaging in the skin condition measuring system according to the first embodiment of the present invention. [Diagram 5] FIG. 2 is an explanatory diagram of a display screen showing a skin condition measuring device guidance state based on recorded information of a terminal device in the skin condition measuring system according to the first embodiment of the present invention. [Figure 6] FIG. 11 is an explanatory diagram of a display screen showing another skin condition measuring device guidance state based on recorded information of the terminal device in the skin condition measuring system according to the first embodiment of the present invention. [Figure 7] FIG. 2 is an explanatory diagram of the display screen of the terminal device immediately before imaging by the skin condition measuring device in the skin condition measuring system according to the first embodiment of the present invention. [Figure 8] FIG. 2 is an explanatory diagram showing a skin image displayed by a terminal device in the skin condition measuring system according to the first embodiment of the present invention, based on an image captured by the skin condition measuring device. [Figure 9] FIG. 2 is an explanatory diagram showing a state in which diagnostic information of a skin condition based on imaging by a skin condition measuring device is displayed by a terminal device in the skin condition measuring system according to the first embodiment of the present invention. [Figure 10] FIG. 5 is a block diagram showing the configuration of a skin condition measuring system according to a second embodiment of the present invention. [Figure 11] FIG. 11 is an explanatory diagram showing a display state of diagnostic information of a skin condition based on an image captured by a terminal device in a skin condition measuring system according to a second embodiment of the present invention. [Figure 12] FIG. 11 is an explanatory diagram of a skin image display state based on imaging by a terminal device and a skin condition measuring device in a skin condition measuring system according to a second embodiment of the present invention. [Figure 13] FIG. 11 is an explanatory diagram of a display state of diagnostic information of a skin condition based on imaging by a terminal device and a skin condition measuring device in a skin condition measuring system according to a second embodiment of the present invention. [Figure 14] FIG. 11 is an explanatory diagram of a display screen showing a state in which a mark is added to a hidden blemish by a terminal device in a skin condition measuring system according to a second embodiment of the present invention. [Figure 15] 13 is an explanatory diagram of another display state of a skin image based on imaging by the terminal device and the skin condition measuring device in the skin condition measuring system according to the second embodiment of the present invention. FIG. [Figure 16] FIG. 11 is an explanatory diagram of a display screen immediately before an image of a foot is captured by a terminal device in a skin condition measuring system according to a second embodiment of the present invention. [Figure 17] FIG. 11 is an explanatory diagram of the display screen of the terminal device immediately before imaging of a predetermined part of the foot by the skin condition measuring device in the skin condition measuring system according to the second embodiment of the present invention. [Figure 18]13 is an explanatory diagram showing a display state of a skin image of a foot based on imaging by a terminal device and a skin condition measuring device in a skin condition measuring system according to a second embodiment of the present invention. FIG. [Figure 19] FIG. 11 is a schematic configuration diagram of a skin condition measuring system according to a third embodiment of the present invention. [Figure 20] FIG. 11 is an explanatory diagram of information transmission and reception between a terminal device and a server in a skin condition measuring system according to a third embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] (First embodiment of the present invention) Hereinafter, a skin condition measuring system according to a first embodiment of the present invention will be described with reference to FIGS. In each of the above figures, the skin condition measuring system 1 of this embodiment is configured to include a skin condition measuring device 10 capable of measuring the skin condition of a user, and a terminal device 20 that is communicatively connected to the skin condition measuring device 10, serves as the imaging device, and has the recording unit 21, display unit 22, and control unit 23.

[0024] In this embodiment, a user who is a subject of skin condition measurement has signed a contract to receive a skin condition diagnosis service with a business entity (hereinafter referred to as a provider entity) that provides the skin condition measuring system 1. The user can use the skin condition measuring device 10 by purchasing it himself or by having it loaned to him.

[0025] This allows the user to receive a skin condition diagnosis using the skin condition measuring system 1, obtain the skin condition diagnosis results from the skin condition measuring system 1, and, if necessary, enjoy the benefits of obtaining advice information according to the diagnosis results. Furthermore, the provider can obtain data regarding the user's skin condition, and can enjoy the benefit of realizing a sales promotion effect for the skin care products and skin care services provided by a specified provider (e.g., a sponsor of the provider) by recommending these products to the user through advertising, etc. Skin care products are products used for skin care, such as lotions, beauty serums, supplements, facial massagers, and facial cleansers. Skin care services are services for providing skin care, such as aesthetic services, etc.

[0026] The skin condition measuring device 10 is a kind of camera capable of capturing an image of a predetermined part of the user's skin to measure the user's skin condition. The skin condition measuring device 10 has a built-in specified light source for illumination, and when capturing an image, a specified part of the user's skin is imaged by irradiating it with light from the light source that is different from the light used as illumination light when capturing an image of the specified area of ​​the body by the terminal device 20 as the imaging device.

[0027] In detail, the skin condition measuring device 10 comprises a substantially cylindrical main body case 11 having an opening large enough to capture a predetermined number of skin ridges when the tip portion 11a is in contact with the user's skin, an image sensor 12 housed within the main body case 11 and converting light reflected from the user's skin into an electrical signal representing image data of the skin, an optical mechanism 13 that focuses the light reflected from the user's skin at the image sensor 12 so that it can be incident on the image sensor 12, and a number of LEDs 14, 15 as light sources that irradiate illumination light onto the user's skin from inside the main body case 11.

[0028] In addition to an optical system that shifts the focal position of the reflected light, the optical mechanism 13 is configured to include a light diffusion plate 13a that is arranged adjacent to the light irradiation direction of the LEDs 14, 15 and diffuses the light of each LED 14, 15, a first polarizing plate 13b that is arranged adjacent to the light diffusion plate 13a on the opposite side of the LEDs 14, 15 and polarizes the incident light in a predetermined direction, a second polarizing plate 13c that is disposed between the LEDs 14, 15 and the imaging element 12 and polarizes the incident light in a direction perpendicular to the polarization direction of the first polarizing plate 23, and a light shielding plate 13d that is arranged adjacent to the second polarizing plate 13c and allows only the light reflected by the user's skin to pass to the imaging element 12 side.

[0029] Of these, the first polarizing plate 13b has notches provided at locations facing some of the LEDs 14, so that the diffused light from these LEDs 14 is directed to the user's skin as unpolarized light, while the diffused light from the other LEDs 15 is directed to the user's skin as linearly polarized light in a predetermined direction.

[0030] In the skin condition measuring device 10 of this embodiment, the light from the LED 14 is diffused by the light diffuser 13a and then irradiated to the user's skin as unpolarized light, and this unpolarized light irradiation is used as illumination for detecting the user's skin texture. Also, the light from another LED 15 is diffused by the light diffuser 13a and then irradiated to the user's skin as linearly polarized light by the first polarizer 13b, and this linearly polarized light irradiation is used as illumination for detecting blemishes on the user's skin.

[0031] Then, the reflected light from the user's skin, based on two types of light, unpolarized and linearly polarized light, passes through openings provided in the first polarizing plate 13b and the light diffuser plate 13a, and then passes through the second polarizing plate 13c, is adjusted by the optical system of the optical mechanism section 13, and then enters the image sensor 12, where the light is converted into an electrical signal and output.

[0032] In addition, the skin condition measuring device 10 uses unpolarized light and linearly polarized light as illumination to capture images and appropriately detect skin texture and blemishes, but it is not limited to this, and a circular polarizing filter may be used as a polarizing plate to irradiate circularly polarized light as illumination, and specifically, right-handed circularly polarized light can be used as illumination corresponding to skin texture detection, and left-handed circularly polarized light can be used as illumination corresponding to skin blemish detection. In addition, the color (wavelength) of the light irradiated as illumination may be made to correspond to skin texture detection and blemish detection, respectively, and for example, the skin condition measuring device 10 may be configured to include a light source capable of irradiating skin-colored light for texture detection and white light for blemish detection as illumination.

[0033] The skin condition measuring device 10 is a device that captures an image of the user's skin to measure the user's skin condition, but is not limited to a device dedicated to skin condition measurement that incorporates a light source for illumination as described above, and may be another device with a camera, for example, a portable device such as a smartphone having a camera unit, or a device in which a conversion lens suitable for capturing images of the skin is attached to the camera unit of such a device. The skin condition measuring device is not limited to such a device that captures images of the skin, and may be configured to include other sensors for measuring the skin condition instead of or in combination with the imaging mechanism. For example, the skin condition measuring device may include a sensor that detects at least one of the moisture content of the user's skin, the oil content of the user's skin, the elasticity of the user's skin, etc. (i.e., a moisture meter, oil content meter, elasticity meter, etc. for the skin).

[0034] The terminal device 20 serves as an imaging device and is capable of imaging a specified range of the user's body including the area to be measured for skin condition by the skin condition measuring device 10, and the skin condition measuring device 10 that is present in the vicinity of the area to be measured, and has the recording unit 21, display unit 22, and control unit 23.

[0035] In addition, the terminal device 20 is communicatively connected via wired or wireless communication to a skin condition measuring device 10 capable of capturing images of specific areas of the user's skin, and when skin condition measurement (imaging) is performed by this skin condition measuring device 10, image data of the skin can be obtained.

[0036] The terminal device 20 is a known portable terminal device such as a mobile phone, a so-called smartphone, or a tablet device having wireless communication means 24 for connecting to and communicating with an IP communication network, and among these, an application program can be executed on the device, and has a (hardware) interface 25 such as a USB to which the skin condition measuring device 10 can be connected. The terminal device 20 is provided with a camera unit 26 capable of capturing images of a predetermined area of ​​the user's body and the skin condition measuring device 10, so that it can function as an imaging device.

[0037] The terminal device 20 as an imaging device is an information processing device that realizes the functions and processing of the terminal device 20 by executing a program stored in advance, and is not limited to a portable device, but may be a computer such as a notebook type or desktop type with a camera, as long as it can measure the skin condition by connecting the skin condition measuring device 10. The imaging device may also be another information processing device specialized for a specific purpose such as beauty, for example, an electronic device that incorporates a camera and a display behind the mirror part (half mirror) of a dressing table or a table mirror for makeup or beauty, and that can display, as necessary, an image of a user captured by a camera, an image processed from the image, information obtained by analyzing the image of the user, etc., on the mirror surface as needed, in addition to being used as a normal mirror.

[0038] Furthermore, it goes without saying that the terminal device 20 serving as an imaging device is a separate device from the skin condition measuring device 10 since it images the user's skin and the skin condition measuring device 10. However, when a portable device with a camera such as a smartphone as described above is used as the skin condition measuring device 10, the imaging device (terminal device) may be a similar portable device with a camera.

[0039] The terminal device 20 is capable of analyzing image data obtained by imaging and acquiring diagnostic information using an application program for diagnosing skin conditions, and the acquired diagnostic information can be referred to by the user. In this case, the terminal device 20 executes the application program to display the acquired diagnostic information as content on the display unit 22, thereby enabling the user to refer to the information.

[0040] The recording unit 21 in the terminal device 20 records data related to the skin condition measuring device 10 in association with the measurement data of the skin condition obtained by measurement using the skin condition measuring device 10, i.e., image data of the specified part of the skin obtained by imaging using the skin condition measuring device 10.

[0041] This recording unit 21 records, as data related to the skin condition measuring device 10, information about the usage status of the skin condition measuring device 10 detected by analyzing image data obtained by imaging with the terminal device 20 as the imaging device when acquiring image data of the skin by imaging as a skin condition measurement using the skin condition measuring device 10.

[0042] The display unit 22 is capable of displaying an image representing at least the predetermined area of ​​the user's body. The display unit 22 in the terminal device 20 is a touch panel type display device, and also serves as an input device.

[0043] The control unit 23 controls the measurement of skin condition by the skin condition measuring device 10, and also causes the display unit 22 to display an image based on image data of the specified area of ​​the body obtained by imaging at least the terminal device 20, which also serves as the imaging device.

[0044] When a new skin condition measurement is performed using the skin condition measuring device 10, the control unit 23 acquires an image relating to the previous usage state of the skin condition measuring device for the measurement target area of ​​the user based on information about the usage state of the skin condition measuring device recorded in the recording unit 21, performs a synthesis process on the acquired image by overlaying it on an image representing the specified area of ​​the user's body, and displays this processed image on the display unit 22.

[0045] The control unit 23 detects the usage state of the skin condition measuring device 10 by analyzing image data obtained by imaging the terminal device 20 received from the terminal device 20, and continuously monitors it. The control unit 23 determines whether the usage state of the skin condition measuring device 10 matches the previous usage state of the skin condition measuring device 10 included in the information about the usage state of the skin condition measuring device 10 recorded in the recording unit 21, and when it determines that the usage state matches the previous usage state, it can cause the skin condition measuring device 10 to measure the skin condition.

[0046] In addition, the control unit 23 can also cause the display unit 22 to display guidance or a predetermined notification means to notify the user of the guidance so as to adjust the usage state (position and orientation) of the skin condition measuring device 10 in which the skin condition is to be measured to the previous usage state of the skin condition measuring device displayed on the display unit 22, based on information about the usage state of the skin condition measuring device 10 (e.g., information about the position and orientation of the skin condition measuring device 10) detected by analyzing an image captured and acquired by the terminal device 20 as an imaging device.

[0047] If the image (such as a face) representing a specified range of the user's body that the control unit 23 causes to be displayed on the display unit is based on image data of the specified range of the body obtained by capturing an image with the terminal device 20 that also functions as an imaging device, the image data may be directly converted for display and, if necessary, trimmed to produce an actual image of the specified range of the body, or a simplified image such as computer graphics (CG) may be generated and displayed.

[0048] In addition, as a control of the imaging of the skin condition measuring device 10, the control unit 23 can also, based on information about the usage state of the skin condition measuring device 10 recorded in the recording unit 21, determine that the usage state of the skin condition measuring device 10 of the user for the measurement target range matches a previous specified usage state of the skin condition measuring device 10, so that the skin condition measuring device 10 performs a skin condition measurement corresponding to the specified usage state.

[0049] Specifically, the control unit 23 grasps the position and orientation of the skin condition measuring device 10 as the usage state of the skin condition measuring device 10 corresponding to the part to be imaged, and changes the imaging conditions accordingly. For example, when the skin condition measuring device 10 images a part of the skin that is easily exposed to sunlight or a part that is easily dried, the control unit 23 controls the skin condition measuring device 10 so that the illumination used when imaging by the skin condition measuring device 10 is changed from that used when imaging other parts. Furthermore, the control unit 23 can also set different conditions according to the characteristics of each part for processing related to diagnosis, such as image analysis when deriving diagnostic information on the skin condition, which will be described later.

[0050] The control unit 23 has a function of acquiring diagnostic information on the user's skin condition by analyzing image data of the predetermined part of the skin acquired by imaging with the skin condition measuring device 10 and image data of the predetermined area of ​​the body acquired by imaging with the terminal device 20. These functions are realized by the control unit 23 executing processes according to application programs.

[0051] As the above process, the control unit 23 evaluates the user's skin based on the image data, and obtains an index value indicating the user's skin condition. For example, the control unit 23 evaluates at least one of the following items as the skin condition: skin age, fineness of skin texture, degree of whiteness of skin, degree of openness of skin pores, amount of skin blemishes, amount of moisture contained in skin (degree of moisturization), amount of oil contained in skin, etc., and obtains an index value indicating the skin condition from the evaluation result.

[0052] In this embodiment, the control unit 23 performs predetermined image processing on the images captured by the skin condition measuring device 10 and the terminal device 20 to obtain an index value indicating the skin condition of the user. For example, the control unit 23 performs edge detection on the captured image, detects skin grooves in the image, identifies the area of ​​the skin mound surrounded by the detected skin grooves, and calculates an index value indicating the fineness of the skin texture (index value indicating the skin condition) such that the smaller the size of the identified skin mound area is and the more uniform it is, the larger the index value becomes. Furthermore, if the skin condition measuring device 10 includes other sensors, the control unit 23 may determine an index value indicating the user's skin condition based on a signal obtained by the other sensor.

[0053] In this embodiment, the control unit 23 determines, as the diagnostic information, information indicating that the diagnostic result has been obtained as an index value indicating the user's skin condition. Then, the control unit 23 performs control so that the acquired diagnostic information can be appropriately displayed on the display unit 22 as the display content of the display unit 22. For example, the control unit 23 can create a graph for some index values ​​indicating the user's skin condition from the diagnostic result, and display this on the display unit 22 as the display content.

[0054] In addition, the control unit 23 accepts data on the terminal device 20 including information such as skin condition, information on skin care actions, skin images, and the time when the skin was imaged, and associates the accepted index value indicating the skin condition, the information on skin care actions, the skin image, and information on the time when the skin was imaged, and temporarily stores the data in the recording unit 21 of the terminal device 20.The control unit 23 can also diagnose the user's skin condition based on the stored index value for the skin condition and the information on the time when the skin was imaged.

[0055] Specifically, the control unit 23 identifies the transition of the skin condition index value over time based on the skin condition index value stored in the recording unit 21 and information on the time when the skin condition measurement was performed, and diagnoses whether the skin condition has improved based on the state of the identified transition. For example, the control unit 23 identifies the transition of the skin condition index value over time during a period (e.g., about 28 days ± 1 to 7 days) required for the user's skin metabolism (turnover) immediately before the treatment, and diagnoses the skin condition.

[0056] In addition, the control unit 23 may identify the time-dependent changes in the skin condition index values ​​during a period different from the period required for the user's turnover immediately before the treatment (for example, a period of a predetermined length immediately before the treatment (for example, one week, ten days, one month, etc.), a specified period, etc.) and diagnose the skin condition.

[0057] When the index value of the skin condition changes over time in a direction indicating an improvement in the skin condition, the control unit 23 gives a diagnosis result that the user's skin condition has improved. On the other hand, when the index value of the skin condition does not change over time in a direction indicating an improvement in the skin condition (changing in a direction indicating deterioration or showing no change), the control unit 23 gives a diagnosis result that the user's skin condition has not improved. Furthermore, the control unit 23 may perform a skin condition diagnosis process that takes into account attributes such as the user's age.

[0058] The control unit 23 performs control so that images including graphs and texts indicating diagnostic information are appropriately displayed on the display unit 22 of the terminal device 20. In addition, the control unit 23 may perform control so that images including a transition graph indicating the transition of skin conditions, a group of images that are skin images, a group of action information indicating information on skin care actions corresponding to the skin images, and an advertisement indicating an advertisement (with a link) for a specific skin care product or skin care service are appropriately displayed on the display unit 22.

[0059] Furthermore, the control unit 23 may create content indicating the diagnosis result as part of the diagnosis information, and cause the display unit 22 to display the content so as to be able to be referred to from the terminal device 20. For example, the control unit 23 may create content including bar objects indicating index values ​​of the skin condition for each of the degree of moisturization, the degree of pore opening, the degree of whitening, and the skin age (aging), and cause the display unit 22 to display the content.

[0060] Next, the usage state of the skin condition measuring system according to this embodiment will be described. As a premise, the target parts of the skin condition measured by the skin condition measuring device 10 are the main parts of the skin of the face (cheeks, eyes, mouth, etc.), and the entire face including these is considered to be a predetermined range of the user's body. The terminal device 20 is a smartphone, and functions as an imaging device by using a camera unit (so-called in-camera) provided on the side where the display unit 22 is located, to which the skin condition measuring device 10, which is a camera, can be connected. The skin condition measuring device 10 has a narrower imaging range than the terminal device 20, but can capture images at a higher resolution, and captures an image of the skin of an extremely narrow range of the face to measure the skin condition.

[0061] In order to measure a skin condition using the terminal device 20 and the skin condition measuring device 10, first, the skin condition measuring device 10 is connected to the terminal device 20 by a user. Next, the user operates an application program on the terminal device 20 that already exists on the terminal device and provides a user interface for using the skin condition measuring device 10, and the user is then able to use the skin condition measuring device 10 for measurement through the terminal device 20.

[0062] In addition, when the skin condition measuring device 10 is connected to a user's terminal device 20, an application program that is pre-recorded in the terminal device 20 and provides a user interface for using the skin condition measuring device 10 may be automatically started without user operation, allowing the user to use the skin condition measuring device 10 through the terminal device 20.

[0063] When the user performs an operation to start measurement on the user interface displayed on the terminal device 20, the terminal device 20 starts capturing an image of the face as a predetermined area of ​​the user's body. In detail, when an application program for measuring skin condition is executed on the terminal device 20, the user operates the user interface displayed on the display unit 22, and first, the terminal device 20 as an imaging device begins capturing an image of the user's face, and image data is continuously acquired by the terminal device 20.

[0064] When the user's face is imaged by the terminal device 20, the image of the face is displayed on the display unit 22 based on the image data obtained by imaging. The terminal device 20 prompts the user to maintain a state in which the terminal device 20 is held so that the face is displayed in a predetermined orientation and size, using a predetermined guide display or the like on the display unit 22 (see FIG. 4).

[0065] At this time, the control unit 23 of the terminal device 20 refers to the recording unit 21 to determine whether or not there is a record of information about the usage state of the skin condition measuring device 10 at the time of the previous skin condition measurement, i.e., information related to the position and orientation of the skin condition measuring device 10 when imaging was performed for the skin condition measurement.

[0066] If the recording unit 21 has a record of information about the previous usage state, an image showing the usage state of the skin condition measuring device 10, for example a predetermined guide design portion (mark) showing the position and orientation of the skin condition measuring device 10, is generated based on this information, and a process is performed to combine this with the face image obtained by imaging the terminal device 20, and the combined image is displayed on the display unit 22.

[0067] While looking at the screen of the display unit 22, which shows an image of the user's face and the previous usage state of the skin condition measuring device 10 (the position and orientation of the skin condition measuring device 10), the user adjusts the position of the skin condition measuring device 10 to match the usage state shown on the display unit 22 (see Figure 5).

[0068] Here, based on the record of information about the previous usage state, a guide design showing the position and orientation of the skin condition measuring device 10 is synthesized and displayed as the usage state of the skin condition measuring device 10, but this is not limited to this, and it is also possible to synthesize an image showing the position on the face to be imaged according to the position and orientation of the skin condition measuring device 10 as information about the usage state of the skin condition measuring device 10 (see Figure 6).

[0069] The control unit 23 of the terminal device 20 analyzes the continuously acquired image data to derive information about the current usage state of the skin condition measuring device 10 held by the user, and if this usage state matches the usage state of the skin condition measuring device 10 (position and orientation of the skin condition measuring device 10) in the information recorded in the recording unit 21, it indicates this fact on the display unit 22 of the terminal device 20, if necessary, and then causes the skin condition measuring device 10 to capture an image of the specified part of the skin at which the skin condition measuring device 10 is pointed (see Figure 7).

[0070] Note that imaging by the skin condition measuring device 10 is automatically performed when a match between the usage state of the skin condition measuring device 10 and the recorded previous usage state is recognized; however, this is not limited to the above, and the user may simply be notified by a notification or the like that the usage state of the skin condition measuring device 10 matches the recorded previous usage state, and the user who has confirmed the match between the usage states may operate the terminal device 60 to capture an image with the skin condition measuring device 10.

[0071] On the other hand, when the recording unit 21 does not have information about the previous use state of the skin condition measuring device 10, such as when the skin condition measurement is performed for the first time, the control unit 23 of the terminal device 20 executes a guide display or voice guide for the user to take an image of a part of the face of the user as a predetermined body area, which is a part of the skin condition that is the target part of the skin condition measured by the skin condition measuring device 10, that is, a part of the skin that can be imaged by the skin condition measuring device 10 on the face, which is a part of the face that the user is concerned about. Alternatively, a process is performed in which a predetermined guide design part indicating one or more parts of the skin that are generally often measured and registered as an initial measurement position is selected in advance, and the synthesized image is displayed on the display unit 22. In this way, the position of the skin condition measuring device 10 is adjusted so that the user can point the skin condition measuring device 10 at any part of the face that is of concern, or can image the part while looking at the initial measurement position on the face indicated by the guide design part displayed on the display unit 22.

[0072] In this case, instead of synthesizing the image of the initial measurement position with the face image and displaying it, the control unit 23 of the terminal device 20 analyzes the image data obtained by imaging with the terminal device 20 in advance, derives diagnostic information for the user's face skin condition, and from this information, identifies an area for which a detailed image needs to be obtained by imaging with the skin condition measuring device 10 in order to further appropriately diagnose the skin condition, for example, when a sign of the presence of a blemish or the like is found in a part of the skin and the presence or absence of a blemish is to be confirmed. The control unit 23 sets the area thus identified as the measurement target position of the skin condition measuring device 10. Then, the control unit 23 performs a process of synthesizing a predetermined guide design portion indicating this measurement target position with the face image based on the image data, and displays the synthesized image on the display unit 22, so that the user can adjust the position of the skin condition measuring device 10 while looking at the display unit 22.

[0073] The control unit 23 of the terminal device 20 analyzes the continuously acquired image data to derive information about the current usage state of the skin condition measuring device 10 held by the user, and when it determines from this usage state that the skin condition measuring device 10 is positioned to point toward the area of ​​concern to the user or so that the initial measurement position can be imaged, it indicates this fact on the display unit 22 of the terminal device 20 as necessary, and causes the skin condition measuring device 10 to image the specified area of ​​the skin toward which the skin condition measuring device 10 is pointed in the same manner as described above.

[0074] In this case, instead of automatically performing imaging by skin condition measuring device 10 when it is determined that skin condition measuring device 10 is positioned, the user may recognize that skin condition measuring device 10 is positioned toward the area of ​​concern or so that the initial measurement position can be imaged, or when the display unit 22 of the terminal device 20 or the like indicates that skin condition measuring device 10 is positioned so that the initial measurement position can be imaged, the user may operate the terminal device 20 themselves, such as by pressing the shutter button of the terminal device 20, to cause the skin condition measuring device 10 to take an image.

[0075] The skin condition measuring device 10, which has reached the stage of taking an image, takes an image of the skin surface under a predetermined illumination condition by a built-in light source as a skin condition measurement, and outputs image data. This image data is acquired by a terminal device 20 that is communicatively connected to the skin condition measuring device 10. For example, in the skin condition measuring device 10, a built-in light source capable of adjusting the light emitted as illumination optimizes the light irradiation condition of the part to be imaged through verification of the skin image obtained by trial imaging of the skin condition measuring device 10, and then imaging is performed. Each of the image data of the texture diagnosis image obtained by imaging the skin under illumination by irradiation with unpolarized light and the blemish diagnosis image obtained by imaging the skin under illumination by irradiation with linearly polarized light is sent to and acquired by the terminal device 20.

[0076] When imaging is performed by the skin condition measuring device 10, the control unit 23 acquires and analyzes image data including the user's face and the skin condition measuring device 10 captured by the terminal device 20, derives information about the usage state of the skin condition measuring device 10, i.e., information about the position and orientation of the skin condition measuring device 10 relative to the user's face during imaging, and records this in the recording unit 21. As information about the usage state of the skin condition measuring device 10, information about the imaging conditions of the skin condition measuring device 10, for example, information about the lighting conditions caused by the built-in light source, etc., is also recorded.

[0077] Then, the control unit 23 of the terminal device 20 acquires image data of the specified area of ​​the skin obtained by imaging with the skin condition measuring device 10, and then generates an image of the specified area for display based on this image data, and displays the image of the specified area on the screen of the display unit 22 (see Figure 8).

[0078] In this case, the control unit 23 of the terminal device 20 displays a face image for display based on image data obtained by imaging the terminal device 20 in a predetermined area on the screen of the display unit 22, and at the same time, displays an image of the predetermined part on the screen of the display unit 22 in an area different from the face image, so that an image of the entire face including the predetermined part and an image of the predetermined part can be displayed in parallel at the same time, and it becomes possible to compare each image with respect to the skin condition of the predetermined part. Note that, as the face image here, an image of the face as the predetermined body range overlapping with the skin condition measuring device 10 based on image data obtained by imaging by the terminal device 20 during imaging by the skin condition measuring device 10 can be used, but it is preferable to use an image of the face not overlapping with the skin condition measuring device 10 based on image data obtained by imaging by the terminal device 20 before imaging by the skin condition measuring device 10. When the skin condition measuring device 10 displays an image of the face not overlapping with the skin condition measuring device 10, it is more preferable to indicate the imaging position of the skin condition measuring device 10 in the face image based on information about the usage state.

[0079] Furthermore, the control unit 23 of the terminal device 20 analyzes the image data of the predetermined area to obtain diagnostic information on the user's skin condition, and displays it on the display unit 22 simultaneously with the skin image or in place of the skin image (see FIG. 9). The display of this diagnostic information marks the completion of one skin condition measurement using the skin condition measuring device 10.

[0080] Regarding the display of diagnostic information, it is possible not only to display diagnostic information on the skin condition of the specified area based on the image captured by skin condition measuring device 10, but also to display diagnostic information on the skin condition of the entire face obtained by analyzing image data of the face as the specified area of ​​the body that is not overlapped by skin condition measuring device 10, obtained before the image is captured by skin condition measuring device 10, on display unit 22 in parallel with the diagnostic information on the skin condition of the specified area.

[0081] Thereafter, in order to grasp the progress of the skin condition, the user will repeat the skin condition measurement at predetermined measurement intervals using the terminal device 20 and skin condition measuring device 10 as described above. As described above, the user connects the skin condition measuring device 10 to the terminal device 20, makes the skin condition measuring device 10 available for measurement, and then operates the terminal device 20 to cause it to capture an image of the user's face, and the terminal device 20 will continuously acquire image data by capturing the image.

[0082] Based on the image data obtained by imaging, the terminal device 20 displays an image of the face on the display unit 22, while reading out information about the previous usage state of the skin condition measuring device 10 recorded in the recording unit 21, generates an image showing the usage state of the skin condition measuring device 10 based on the information, performs a process of combining this with the image of the face, and displays the combined image on the display unit 22. When skin condition measurements are thus performed repeatedly, since information about the usage state of the skin condition measuring device 10 is recorded and exists in the recording unit, it is possible to smoothly guide and guide the user to adjust the skin condition measuring device 10 to the usage state based on the information recorded in the recording unit 21.

[0083] When the user adjusts the position of the skin condition measuring device 10 by referring to the display unit 22, and the usage state of this skin condition measuring device 10 (the position and orientation of the skin condition measuring device 10) matches the usage state of the skin condition measuring device 10 in the information recorded in the recording unit 21, the control unit 23 of the terminal device 20 causes the skin condition measuring device 10 to capture an image of a specified part of the skin.

[0084] The skin condition measuring device 10 performs appropriate imaging after adjusting the lighting conditions using the built-in light source, etc., based on information relating to the imaging conditions among the information about the usage status of the skin condition measuring device 10 recorded in the recording unit 21 of the terminal device 20, and transmits the obtained image data to the terminal device 20.

[0085] The control unit 23 of the terminal device 20 causes the display unit 22 to display an image for display based on the image data received from the skin condition measuring device 10, and also analyzes the image data to obtain diagnostic information on the user's skin condition and displays this diagnostic information on the display unit 22, thereby completing a series of skin condition measurements.

[0086] Information about the usage state of skin condition measuring device 10 is recorded in recording unit 21, and this information is used to proceed with imaging with skin condition measuring device 10.As a result, skin condition measuring device 10 can quickly optimize the settings of imaging conditions, such as the light conditions from the light source, based on the information about the usage state, so that skin imaging is performed appropriately and smoothly, and the obtained image data accurately reflects the skin condition, improving the quality of diagnostic information derived by analyzing the image data in control unit 23 of terminal device 20.

[0087] In this way, the skin condition measuring system of this embodiment is provided with a terminal device 20 as an imaging device that images a wider area of ​​the skin together with the skin condition measuring device 10, in addition to the skin condition measuring device 10 that takes images to measure the skin condition, and analyzes the image including the skin condition measuring device 10 obtained by imaging with this terminal device 20, and records information about the usage state of the skin condition measuring device 10 in the recording unit 21. Based on the recorded information of the skin condition measuring device 10, the area measured by the skin condition measuring device 10 within a specified area of ​​the user's body can be correctly identified, thereby enabling efficient use of the results of skin condition measurement, for example, more accurate diagnosis based on the measured skin condition taking into account the skin characteristics of each area of ​​the specified area of ​​the body.

[0088] Furthermore, based on the recorded information of the skin condition measuring device 10, the skin condition measuring device 10 can be used on another occasion to measure the skin condition in the same state as the skin condition measuring device 10 on the previous measurement occasion. Therefore, by repeating the measurement of the skin condition with the position and orientation of the skin condition measuring device 10 set to the same as on the previous measurement occasion, it is possible to correctly obtain time-series changes in the skin condition, and the measurement can be appropriately managed, thereby improving the accuracy of skin condition diagnosis and reducing the workload associated with the user aligning the skin condition measuring device 10 during measurement, making it easy and effortless to use the device.

[0089] (Second embodiment of the present invention) A skin condition measuring system according to a second embodiment of the present invention will be described with reference to FIGS. In each of the above figures, the skin condition measuring system 1 of this embodiment is configured to include a skin condition measuring device 10 capable of capturing an image of a specific part of a user's skin, and a terminal device 30 that is communicatively connected to this skin condition measuring device 10, serves as the imaging device as well, and has the control unit 31 and display unit 32.

[0090] In this embodiment, as in the first embodiment, a user who is a subject of skin condition measurement enters into a contract to receive a skin condition diagnosis service with a provider of the skin condition measuring system 1. In addition, the user can use the skin condition measuring device 10 by purchasing it himself or by having it loaned to him or her.

[0091] As a result, similarly to the first embodiment, the user can obtain the results of a skin condition diagnosis by the skin condition measuring system 1, and the provider can enjoy benefits such as being able to obtain data regarding the user's skin condition.

[0092] The skin condition measuring device 10 is a type of camera capable of capturing an image of a specific part of a user's skin to measure the user's skin condition, and has a device configuration similar to that shown in the first embodiment, including the incorporation of a specific light source for illumination, and therefore detailed description thereof will be omitted.

[0093] The terminal device 30 serves as the imaging device and is capable of capturing an image of a predetermined range of the user's body including the region of the skin to be imaged by the skin condition measuring device 10 , and includes the control unit 31 and the display unit 32 .

[0094] In addition, the terminal device 30 is communicatively connected via wired or wireless communication to a skin condition measuring device 10 capable of capturing an image of a specific part of the user's skin, and when an image is captured by this skin condition measuring device 10, image data of the skin can be obtained.

[0095] As in the first embodiment, this terminal device 30 is a known portable terminal device such as a mobile phone, a so-called smartphone, or a tablet device having wireless communication means 34 for connecting to and communicating with an IP communication network, and among these, an application program can be executed on the device, and a (hardware) interface 35 such as a USB can be connected to the skin condition measuring device 10. The terminal device 30 is provided with a camera unit 36 ​​capable of capturing images of a predetermined area of ​​the user's body and the skin condition measuring device 10, so that it can function as an imaging device.

[0096] The terminal device 30 is an information processing device that realizes the functions and processing of the terminal device 30 by executing a pre-stored program, and as long as it is capable of connecting the skin condition measuring device 10 to measure the skin condition, it is not limited to a portable device as in the first embodiment, but may be a notebook or desktop computer, or another information processing device specialized for a specific purpose.

[0097] As in the first embodiment, the terminal device 30 is capable of acquiring diagnostic information by analyzing image data obtained by imaging using an application program for diagnosing skin conditions, and the acquired diagnostic information can be referred to by the user. In this case, the terminal device 30 executes the application program to display the acquired diagnostic information as content on the display unit 32, thereby enabling the user to refer to the information.

[0098] The control unit 31 in the terminal device 30 acquires information about the skin condition based on image data of the skin obtained by imaging. This control unit 31 is capable of acquiring information relating to the skin condition of the predetermined body area based on image data of the predetermined body area obtained by imaging with the terminal device 30 which also serves as the imaging device, and is also capable of acquiring information relating to the skin condition of the predetermined area based on image data of the predetermined area of ​​the skin obtained by imaging with the skin condition measuring device 10. Then, the control unit 31 associates information relating to the skin condition of the predetermined area with a portion of information corresponding to the predetermined area of ​​the skin, among the information relating to the skin condition of the predetermined body area, and makes it available.

[0099] In detail, the control unit 31 obtains an image for displaying a specified area of ​​the body derived from image data of the specified area of ​​the body as information regarding the skin condition of the specified area of ​​the body, and obtains an image for displaying the specified area of ​​the skin derived from image data of the specified area of ​​the skin as information regarding the skin condition of the specified area.

[0100] The control unit 31 can then associate an image of the specified part of the skin with a portion of information in the image of the specified area of ​​the body, and cause the image of the specified part to be displayed simultaneously with the display of part or all of the image of the specified area of ​​the body on the display unit 32.

[0101] Furthermore, the control unit 31 acquires diagnostic information on the skin condition of the predetermined body region by analyzing image data of the predetermined body region as other information on the skin condition of the predetermined body region, and similarly acquires diagnostic information on the skin condition of the predetermined region by analyzing image data of the predetermined region of the skin as other information on the skin condition of the predetermined region. The function of the control unit 31 to analyze each image data and acquire diagnostic information on the user's skin condition in this manner is based on the same mechanism as in the first embodiment, which is realized by the control unit 31 executing processing according to an application program, and detailed description thereof will be omitted.

[0102] The control unit 31 then associates the diagnostic information on the skin condition of the specified area with some of the information in the diagnostic information on the skin condition of the specified area of ​​the body that corresponds to the specified part of the skin, and when displaying the diagnostic information on the skin condition of the specified area of ​​the body on the display unit 32, the display unit 32 displays the diagnostic information on the skin condition of the specified area by supplementing or replacing the partial information that corresponds to the specified part of the skin.

[0103] In addition, the control unit 31 can perform image correction processing (e.g., color calibration) on a part or all of an image of a specified area of ​​the body derived from image data of the specified area of ​​the body, based on an image of the specified area derived from image data of the specified area.

[0104] Furthermore, the control unit 31 can execute a process for synthesizing a predetermined guide design portion, which indicates that the position is to be imaged by the skin condition measuring device 10, on the image of the predetermined body area derived from the image data of the predetermined body area, at a predetermined position on the image that is to be imaged by the skin condition measuring device 10, and can display the processed image on the display unit 32. As a result, the guide design portion is displayed as part of the image of the predetermined body area displayed on the display unit 32, and the user can visually recognize and understand the position in the predetermined body area that should be imaged by the skin condition measuring device 10.

[0105] In addition, the control unit 31 can obtain diagnostic information on the skin condition as information relating to the skin condition of the specified area of ​​the body based on image data of the specified area of ​​the body obtained by imaging with the terminal device 30 as the imaging device, and from this diagnostic information on the skin condition of the specified area of ​​the body, select a specified area of ​​the skin to be imaged by the skin condition measuring device 10, and enable imaging of this specified area of ​​the skin by the skin condition measuring device 10.

[0106] The display unit 32 is capable of at least displaying an image of the predetermined body area of ​​the user. More specifically, the display unit 32 displays an image for displaying the predetermined body area and an image for displaying the predetermined part acquired by the control unit 31, and also displays diagnostic information on the skin condition of the predetermined body area including the predetermined part. As in the first embodiment, the display unit 32 is a touch panel type display device and also serves as an input device.

[0107] When an image of the specified part of the body is associated with a part of the image of the specified part that corresponds to the specified part, the display unit 32, under the control of the control unit 31, displays the image of the specified part of the body including the specified part, while simultaneously and in parallel displaying an image of the specified part with a larger magnification than the image of the specified part of the body in an area separate from the area on the screen of the display unit 32 where the image of the specified part is displayed.

[0108] In addition, when the image of the predetermined body region is associated with a part of the image of the predetermined body region that corresponds to the predetermined region, the display unit 32 may, under the control of the control unit 31 receiving an operation instruction to enlarge and display the predetermined region while displaying the image of the predetermined body region including the predetermined region, enlarge the image of the predetermined body region and then switch to the image of the predetermined region in the same region on the screen of the display unit 32 where the image of the predetermined body region is displayed, and display the image of the predetermined region in a continuous manner without interruption from the previous image (see FIG. 15). Conversely, when an operation instruction to reduce the specified region is given while the image of the specified region is in an enlarged state, the control unit 31 receiving the instruction may, under the control of the control unit 31 receiving the instruction, reduce the image of the specified region and then switch to the image of the specified body region in the same region on the screen of the display unit 32 where the image of the specified region is displayed, and display the image of the specified body region in a continuous manner without interruption from the previous image, with the specified region at the center.

[0109] Furthermore, when diagnostic information of the skin condition of the specified part of the skin is associated with partial information in the diagnostic information of the skin condition of the specified area of ​​the body, the display unit 32, under the control of the control unit 31, will display the partial information of the diagnostic information of the skin condition of the specified area of ​​the body that corresponds to the specified part of the skin by adding the diagnostic information of the skin condition of the specified part to this partial information or by replacing the partial information with the diagnostic information of the skin condition of the specified part.

[0110] Next, the usage state of the skin condition measuring system according to this embodiment will be described. As a premise, as in the first embodiment, the target parts of the skin condition measured by the skin condition measuring device 10 are the main parts of the skin on the face, and the entire face including these parts is considered to be a predetermined range of the user's body. The terminal device 30 is a smartphone, and is made to function as an imaging device by using the camera on the display side. The skin condition measuring device 10 connected to the terminal device 30 has a narrower imaging range than the terminal device 30, but is capable of imaging at a higher resolution, and images the skin of an extremely narrow range of the face.

[0111] As in the first embodiment, in order to perform imaging as a measurement of the skin condition using the terminal device 30 and the skin condition measuring device 10, first, the skin condition measuring device 10 is connected to the terminal device 30 by a user.

[0112] Next, the user operates the terminal device 30 to start an application program that already exists on the terminal device 30 and that provides a user interface for using the skin condition measuring device 10, and the user is then able to use the skin condition measuring device 10 for imaging through the terminal device 30.

[0113] In addition, when the skin condition measuring device 10 is connected to a user's terminal device 30, an application program that is pre-recorded in the terminal device 30 and provides a user interface for using the skin condition measuring device 10 may be automatically started without any user operation, allowing the user to use the skin condition measuring device 10 through the terminal device 30.

[0114] When the user performs an operation to start capturing an image on the user interface displayed on the terminal device 30, the terminal device 30 starts capturing an image of the user's face. In detail, when an application program for measuring skin condition is executed on the terminal device 30, the user operates the user interface displayed on the display unit 32, and first, an image of the user's face is captured by the terminal device 30 as an imaging device, and image data is continuously acquired by the terminal device 30.

[0115] When the user's face is imaged by the terminal device 30, an image of the face is displayed on the display unit 32 based on the image data obtained by imaging. The terminal device 30 prompts the user to maintain a state in which the terminal device 30 is held so that the face is displayed in a predetermined orientation and size, using a predetermined guide display or the like on the display unit 32.

[0116] The terminal device 30 displays an image of the face based on image data obtained by imaging on the display unit 32, and prompts the user by displaying guidance displays, audio guidance, etc., so that the user can take images using the skin condition measuring device 10 of the areas of the face that are a specified area of ​​the user's body and that are subject to skin condition measurement by the skin condition measuring device 10, i.e., the skin parts of the face that can be imaged by the skin condition measuring device 10, regarding the areas of concern regarding skin condition, after looking at the display of the face on the display unit 32.

[0117] Alternatively, the control unit 31 of the terminal device 30 analyzes the image data obtained by imaging, derives diagnostic information for the user's facial skin condition, and from this information, for example, finds signs of the presence of blemishes or the like in a part of the skin and therefore determines an area for which a detailed image needs to be obtained by imaging with the skin condition measuring device 10 in order to more appropriately diagnose the skin condition (see FIG. 11). Then, the control unit 31 sets the area thus determined as the imaging target position of the skin condition measuring device 10. Then, the control unit 31 performs a process of synthesizing a predetermined guide design portion indicating this imaging target position with the face image based on the image data, and causes the display unit 32 to display the synthesized image.

[0118] While viewing the screen of the display unit 32, which shows the user's face and, if necessary, the guide design section, the user adjusts the position of the handheld skin condition measuring device 10 so that it faces a part of the face where the user is concerned about the skin condition or the imaging target position shown by the guide design section. When the imaging target position of the skin condition measuring device 10 is shown by the guide design section, the user can easily understand the part of the face, which is the predetermined body area, to be imaged by the skin condition measuring device 10, and imaging can be appropriately performed using the skin condition measuring device 10 whose position the user has adjusted.

[0119] The control unit 31 of the terminal device 30 analyzes the continuously acquired image data to derive information about the current usage state of the skin condition measuring device 10 held by the user, and when it determines from this usage state that the skin condition measuring device 10 is positioned to point toward the area of ​​concern to the user or so that the measurement target position can be imaged, it indicates this fact on the display unit 32 of the terminal device 30 as necessary, and causes the skin condition measuring device 10 to image the specified area of ​​the skin toward which the skin condition measuring device 10 is pointed.

[0120] Note that imaging by skin condition measuring device 10 is automatically performed when it is determined that skin condition measuring device 10 is positioned properly; however, this is not limited to the above. The user may recognize that skin condition measuring device 10 is positioned toward an area of ​​concern or so that the measurement target position can be imaged, or when the display unit 32 of terminal device 30 or the like indicates that skin condition measuring device 10 is positioned so that the measurement target position can be imaged, the user may operate terminal device 30 themselves, such as by pressing the shutter button of terminal device 30, to cause skin condition measuring device 10 to take an image.

[0121] The skin condition measuring device 10, which has reached the stage of performing imaging, performs imaging of the skin surface under a predetermined illumination condition by a built-in light source as a skin condition measurement, and outputs image data. This image data is acquired by a terminal device 30 that is communicatively connected to the skin condition measuring device 10. For example, in the skin condition measuring device 10, an internal light source capable of adjusting the light emitted as illumination optimizes the light irradiation condition of the imaging target part through verification of the skin image obtained by trial imaging of the skin condition measuring device 10, and imaging is performed. Each image data of an image for texture diagnosis obtained by imaging the skin under illumination by irradiation with unpolarized light and an image for blemish diagnosis obtained by imaging the skin under illumination by irradiation with linearly polarized light are sent to and acquired by the terminal device 30.

[0122] In the imaging by the skin condition measuring device 10, imaging is performed under a condition in which a predetermined part of the user's skin is irradiated with light from a built-in light source different from the light used as illumination light in imaging by the terminal device 30, for example, natural light, indoor illumination light, or the strobe light of the terminal device 30, and image data can be obtained under different imaging conditions by the skin condition measuring device 10 and the terminal device 30. This makes it possible to increase the difference between the images of the skin, which is affected by the reflection, absorption, and attenuation of the light irradiated as illumination, in each layer of the skin, captured by the skin condition measuring device 10 and the terminal device 30, and increases the information content of the image data used as diagnostic material for diagnosing the skin condition, enabling appropriate diagnosis of the skin condition. In particular, by selecting light, such as by selecting an appropriate wavelength of light irradiated as illumination, the skin condition measuring device 10 can perform imaging under conditions suitable for detailed analysis of partial skin conditions, improving the accuracy of diagnosis of the skin condition based on the image data obtained by imaging.

[0123] When capturing an image using this skin condition measuring device 10, the control unit 31 acquires and analyzes image data including the user's face and the skin condition measuring device 10 captured by the terminal device 30, derives information on the position and orientation of the skin condition measuring device 10 relative to the user's face during image capture, and records this information in a specified recording means. It is also desirable to associate this information with information related to the imaging conditions of the skin condition measuring device 10 at the time of image capture, such as information about the lighting conditions caused by the built-in light source, and similarly record this information so that it can be used for subsequent imaging opportunities.

[0124] The control unit 31 of the terminal device 30 acquires image data of the predetermined part of the skin obtained by imaging with the skin condition measuring device 10, and then generates an image of the predetermined part for display based on this image data. The control unit 31 associates this image of the predetermined part with a part of the face image based on the image data obtained by imaging with the terminal device 30, which corresponds to the predetermined part. However, the face image here is an image of the face as the predetermined body range that is not overlapped by the skin condition measuring device 10, based on image data obtained by imaging with the terminal device 30 before imaging with the skin condition measuring device 10.

[0125] Then, the control unit 31 causes the display unit 32 to display a part or the whole of the face image associated with the image of the predetermined part. The display of all or part of the facial image on the display unit 32 can be controlled by the control unit 31 based on the user's operation to set the desired display range of the face, but when the entire face is displayed on the display unit 32 or when only part of the face is displayed, if the range of the face displayed on the display unit 32 includes a part that corresponds to the specified part, an image of the specified part associated with the part that corresponds to the specified part is simultaneously displayed in an area on the screen of the display unit 32 different from the area where the image of the face as the specified body range is displayed (see Figure 12).

[0126] In this way, the image of the face as the predetermined body range based on the image captured by the terminal device 30 and the image of the predetermined part based on the image captured by the skin condition measuring device 10 are displayed simultaneously and in parallel on the display unit 32. The image of the predetermined part is displayed as a detailed image with a larger magnification than the image of the face based on the specifications of the skin condition measuring device 10, and can show a more detailed skin condition compared to the image of the face based on the image captured by the terminal device 30. The user can check the skin condition from the two image displays, and can grasp the skin condition more accurately and easily.

[0127] On the other hand, the control unit 31 of the terminal device 30 acquires image data of the predetermined part of the skin from the skin condition measuring device 10, and then analyzes the image data to acquire diagnostic information on the skin condition of the predetermined part of the skin. The control unit 31 associates the diagnostic information on the predetermined part with partial information corresponding to the predetermined part in diagnostic information on the facial skin condition as the predetermined body range based on image data acquired by imaging with the terminal device 30. However, the diagnostic information on the facial skin condition here is diagnostic information based on image data acquired by imaging with the terminal device 30 before imaging with the skin condition measuring device 10, and the analysis of the image data is performed from immediately after imaging with the terminal device 30 until acquisition of diagnostic information on the skin condition of the predetermined part.

[0128] Then, the control unit 31 causes the display unit 32 to display the diagnostic information of the facial skin condition associated with the diagnostic information of the skin condition of the specified area, either simultaneously with the skin images of the face and the specified area, or in place of the skin images (see Figure 13).

[0129] When displaying the diagnostic information for the skin condition on the display unit 32, the control unit 31 displays diagnostic information for the skin condition of the specified area by supplementing or replacing some of the diagnostic information for the skin condition of the face as the specified area of ​​the body, which corresponds to the specified part of the skin.

[0130] In this way, diagnostic information for the skin condition of the specified area associated with the facial skin diagnostic information is displayed so as to be supplemented or replaced with a portion of the information corresponding to the specified area, and the diagnostic information is provided to the user as detailed information including information analyzed from image data obtained by skin condition measuring device 10. This enriches the content of the diagnostic information for the user's skin condition based on image data obtained by imaging, and enables the user to understand the skin condition, at least for the facial area imaged by skin condition measuring device 10, by referring to diagnostic information from a different perspective obtained by analysis of image data from skin condition measuring device 10, thereby enabling the user to more accurately and easily grasp the skin condition.

[0131] The display of diagnostic information on the facial skin condition on the display unit 32 is not limited to text-based information display, and it is also possible to provide information by specifically indicating areas and symptoms of the skin that require attention using marking images on the facial image, etc. For example, the position and size of hidden blemishes derived as diagnostic information analyzed from the detailed image data obtained by the skin condition measuring device 10 can be displayed as marks of a predetermined color superimposed on the corresponding areas on the facial image (see FIG. 14), which can be used as reference information when carrying out skin care such as measures against blemishes. When such diagnostic information is displayed, one skin condition measurement using the skin condition measuring device 10 is completed.

[0132] The user can grasp the transition of the skin condition of the face and the transition of the skin condition of the specified part at a specified measurement interval by repeating the imaging of the face as the specified body area by the terminal device 30 similar to the above and the imaging of the specified part by the skin condition measuring device 10. The terminal device 30 can record the images of the face and the specified part for display on the display part 32 based on the image data obtained by the repeated imaging in the recording part of the terminal device 30 for each imaging, and can be configured to display the images in a list arranged in chronological order as necessary, or to display them in a sequential switching order in chronological order, which is preferable because it allows the user to easily grasp the changes in the skin.

[0133] The facial image data obtained by imaging with the terminal device 30, which is the basis for the display image and diagnostic information on the skin condition for the face as the specified body area, is image data obtained by imaging with the terminal device 30 before imaging with the skin condition measuring device 10. Alternatively, the control unit 31 of the terminal device 30 may obtain image data of the specified part of the skin from the skin condition measuring device 10, and then perform image correction processing on the facial image data based on the image data of the specified part, and then generate a display facial image based on this corrected facial image data, and display the facial image on the display unit 32, or analyze the corrected facial image data to obtain diagnostic information on the facial skin condition.

[0134] In this case, since the imaging range is limited and imaging conditions are easier to prepare, image correction processing is performed on the image data of the specified body range based on the image data of the specified body area captured by skin condition measuring device 10, and the color of the skin image of the specified body range shown in this image data can be matched to that of the skin image in the image data of the specified body range. Therefore, regardless of the imaging conditions on terminal device 30, the image data of the specified body range obtained by imaging can be made in a state that makes it easy to display the image and perform analysis related to diagnosing the skin condition, thereby encouraging the user to correctly understand the skin condition.

[0135] In this way, in the skin condition measuring system according to this embodiment, the face as a predetermined area of ​​the user's body is captured by the terminal device 30, and a predetermined part of the user's skin is captured by the skin condition measuring device 10. Based on the obtained image data of the face and the image data of the predetermined part, the control unit 31 obtains an image for display as information regarding the skin condition and diagnostic information on the skin condition. Among the image of the face and diagnostic information on the skin condition based on the image captured by the terminal device 30, some information corresponding to the predetermined part of the skin is associated with the image of the predetermined part and diagnostic information on the skin condition based on the image captured by the skin condition measuring device 10. When attempting to use the partial information corresponding to the predetermined part of the skin, it is possible to use the image of the predetermined part and diagnostic information on the skin condition that have been separately obtained. This improves the quality of each piece of information regarding the user's skin condition based on the image data obtained by imaging, and enables processes such as display and analysis of the skin condition to be performed with high accuracy. This allows the skin condition to be diagnosed appropriately and efficiently, allowing the user to grasp the skin condition more accurately.

[0136] In the skin condition measuring system according to the embodiment, when the control unit 31 displays the image of the specified body area on the display unit 32, if the image of the specified body area is associated with a part of the image of the specified body area that corresponds to the specified area imaged by the skin condition measuring device 10, the image of the specified area is displayed simultaneously and in parallel in a separate area on the screen from the area on which the image of the specified body area is displayed. Alternatively, as shown in FIG. 15, a method for displaying the image of the specified body area and the image of the specified area on the display unit 32 may be such that, while the image of the specified body area is initially displayed, the control unit 31 receives an operational instruction to enlarge and display the specified area in this image, and then the image of the specified body area is enlarged in the same area on the screen of the display unit 32 where the image of the specified body area is displayed, and then the image of the specified area is displayed, and the image of the specified area is displayed in sequence, without interruption from the previous image.

[0137] In this case, the image of the specified part can be easily recognized as an enlarged portion of the image of the specified area of ​​the body, and the position of the specified part within the specified area of ​​the body imaged by the skin condition measuring device 10 can be easily understood, allowing care based on the skin condition diagnostic information to be reliably applied to the appropriate location.

[0138] In addition, in the skin condition measuring system according to the embodiment, the target areas for measuring the skin condition by the skin condition measuring device 10 are the essential parts of the skin on the face, and the entire face including these parts is imaged as a predetermined range of the user's body using a camera unit (so-called in-camera) 36 provided on the side of the display unit 32 of the terminal device 30. However, this is not limited to this, and as shown in Figures 16 to 18, a camera unit (so-called out-camera) provided on the opposite side of the display unit 32 of the terminal device 30, which is a smartphone, can be used to image predetermined parts of the body away from the head, such as the arms, legs, and torso, as the predetermined range of the body, while a narrow range of the skin is imaged by the skin condition measuring device 10, and the imaged skin image can be displayed on the terminal device 30, or diagnostic information can be obtained based on the image data obtained by imaging and the information content can be displayed on the display unit 32 of the terminal device 30.

[0139] In this case, unlike the case of the face in the above embodiment, the image of the specified area of ​​the body based on the image taken by the terminal device 30 is not a constant size relative to the image of the specified part based on the image taken by the skin condition measuring device 10, making it difficult to grasp the size from the image, so it is desirable to synthesize an image of a scale indicating dimensional reference values ​​into the image to make it easier to grasp the size.

[0140] (Third embodiment of the present invention) A skin condition measuring system according to a third embodiment of the present invention will be described with reference to FIGS. In each of the figures, the skin condition measuring system 2 of this embodiment comprises a skin condition measuring device 10 and a terminal device 40 which also serves as the imaging device, like the first embodiment, but differs in that the terminal device 40 has the display unit, and also comprises a server 90 having the control unit 42 which is arranged so as to be able to communicate data with the terminal device 40 via a network 100.

[0141] In this embodiment, as in the first embodiment, the user who is the subject of skin condition measurement has entered into a contract with the provider of the skin condition measuring system 2 to receive skin condition diagnosis services, and is able to use the skin condition measuring device 10, thereby enabling the user to obtain skin condition diagnostic information from the skin condition measuring system 2.

[0142] The skin condition measuring device 10 is a type of camera capable of capturing an image of a specific part of a user's skin to measure the user's skin condition, and has a device configuration similar to that shown in the first embodiment, including the incorporation of a specific light source for illumination, and therefore detailed description thereof will be omitted.

[0143] The terminal device 40, as the imaging device, is capable of imaging a specified range of the user's body including the area to be measured for skin condition by the skin condition measuring device 10, and the skin condition measuring device 10 that is present in the vicinity of the area to be measured, and has the display unit 41.

[0144] In addition, the terminal device 40 is communicatively connected via wired or wireless communication to a skin condition measuring device 10 capable of capturing an image of a specific part of the user's skin, and when an image is captured by this skin condition measuring device 10, image data of the skin can be obtained.

[0145] As in the first embodiment, this terminal device 40 is a known portable terminal device such as a mobile phone, a so-called smartphone, or a tablet device having wireless communication means 44 for connecting to and communicating with an IP communication network, and among these, an application program can be executed on the device, and has a (hardware) interface 45 such as a USB to which the skin condition measuring device 10 can be connected. The terminal device 40 is provided with a camera unit 46 capable of capturing an image of a predetermined area of ​​the user's body or the skin condition measuring device 10, so that it can function as an imaging device.

[0146] The terminal device 40 is an information processing device that realizes the functions and processing of the terminal device 40 by executing a pre-stored program, and as long as it is capable of communicating via the network 100 and can be connected to the skin condition measuring device 10 to measure the skin condition, it is not limited to a portable device as in the first embodiment, and may be a notebook or desktop computer, or another information processing device specialized for a specific purpose.

[0147] This terminal device 40 launches a measurement application program, and captures an image of the user's face as the specified area of ​​the body using the terminal device 40, which also serves as the imaging device, to obtain the image data. It also causes the skin condition measuring device 10 to capture an image of the specified area of ​​the skin as a measurement of the skin condition, obtains image data of the specified area of ​​the skin from the skin condition measuring device 10, and transmits this image data to the server 90.

[0148] Furthermore, by executing an application program, the terminal device 40 communicates to request that the diagnostic information acquired by the server 90 be made accessible to the terminal device 40, and acquires the diagnostic information as content from the server 90 in response to the request, and displays the content on the display unit 41. In addition, in order to make the diagnostic information accessible to the terminal device 40, the terminal device 40 can receive diagnostic information data transmitted from the server 90 and display the data, or can download the diagnostic information data and display it.

[0149] In addition, the terminal device 40 can use the notification function of the measurement application program to notify the user that the skin condition is ready to be measured using the skin condition measuring device 10, and can also provide information on how to access videos and other information explaining how to use the skin condition measuring device 10, making this information available for reference.

[0150] The display unit 41 of the terminal device 40 is a display device having a display area capable of displaying an image of the predetermined area of ​​the user's body. The display unit 41 is a touch panel type display device and also serves as an input device.

[0151] More specifically, the display unit 41 not only displays images for displaying the specified range of the body and images for displaying the specified part, which are acquired by the control unit 92 of the server 90, but also displays diagnostic information on the skin condition of the specified range of the body including the specified part, which is also acquired by the control unit 92.

[0152] The server 90 is arranged to be capable of data communication with the terminal device 40 via the network 100, receives image data acquired by the terminal device 40, acquires an image for display based on the image data, and analyzes the image data to acquire diagnostic information on the user's skin condition. The server 90 transmits the image for display and the diagnostic information to the terminal device 40, causing the display unit 41 of the terminal device 40 to display the image and the diagnostic information, respectively.

[0153] This server 90 is a computer that functions as a server and is equipped with a CPU, etc. The computer executes processes according to a recorded program, thereby realizing the functions of the server.

[0154] It should be noted that the server 90 in this embodiment is not necessarily limited to a single physical computer, but may be a group of devices in which multiple computer devices are connected to a network and work together to provide one or more requested services as a whole, or may be a virtual device that, although it is only a portion of the functions of a computer device, has the function of providing one or more requested services as if they were a single device and can be treated as a single device by the service recipient.

[0155] The server 90 is configured to include a control unit 92 that acquires image information for display on the terminal device and diagnostic information on the skin condition, as information on the skin condition, based on skin image data obtained by imaging with the skin condition measuring device 10 and the terminal device 40. In other words, the server 90 realizes the functions of the control unit 92 by the computer constituting the server 90 executing processes according to a program.

[0156] The control unit 92 in the server 90 acquires information regarding the skin condition based on image data of the skin obtained by imaging. The control unit 92 is capable of acquiring information relating to the skin condition of the predetermined body area based on image data of the predetermined body area obtained by imaging with the terminal device 40 and received from the terminal device 40, and is also capable of acquiring information relating to the skin condition of the predetermined area based on image data of the predetermined area of ​​the skin obtained by imaging with the skin condition measuring device 10 and similarly received from the terminal device 40. The control unit 92 then associates information relating to the skin condition of the predetermined area with a portion of the information relating to the skin condition of the predetermined body area and makes it available.

[0157] In detail, the control unit 92 obtains an image for displaying a specified area of ​​the body derived from image data of the specified area of ​​the body as information regarding the skin condition of the specified area of ​​the body, and obtains an image for displaying the specified area of ​​the skin derived from image data of the specified area of ​​the skin as information regarding the skin condition of the specified area.

[0158] Then, the control unit 92 can associate a portion of information corresponding to the predetermined part of the skin in the image of the predetermined body area with the image of the predetermined body area, and transmit information on this associated image to the terminal device 40. Under such control of the control unit 92, the terminal device 40 can cause the display unit 41 to display the image of the predetermined body area including the predetermined part, while simultaneously and in parallel displaying the image of the predetermined part with a larger magnification than the image of the predetermined body area in an area on the screen of the display unit 41 other than the area on which the image is displayed.

[0159] Separately, when an operation instruction is given to enlarge and display the predetermined region while the display unit 41 displays the image of the predetermined region of the body transmitted by the control unit 92, the terminal device 40 that receives the instruction transmits information of the operation instruction to the server 90, and by corresponding control from the control unit 92, the image of the predetermined region of the body is enlarged and then switched to the image of the predetermined region in the same region on the screen of the display unit 41 where the image of the predetermined region of the body is displayed, and the image of the predetermined region is displayed successively without interruption from the previous image. Conversely, when an operation instruction is given to reduce the image of the predetermined region while the image of the predetermined region is enlarged, the terminal device 40 that receives the instruction transmits information of the operation instruction to the server 90, and by corresponding control from the control unit 92, the image of the predetermined region is reduced and then switched to the image of the predetermined region of the body in the same region on the screen of the display unit 41 where the image of the predetermined region is displayed, and the image of the predetermined region of the body is displayed successively without interruption from the previous image, with the predetermined region at the center.

[0160] Furthermore, the control unit 92 acquires diagnostic information on the skin condition of the predetermined body region by analyzing image data of the predetermined body region as other information on the skin condition of the predetermined body region, and similarly acquires diagnostic information on the skin condition of the predetermined region by analyzing image data of the predetermined region of the skin as other information on the skin condition of the predetermined region. The function of the control unit 92 to analyze each image data and acquire diagnostic information on the user's skin condition is based on the same mechanism as in the first embodiment, except that the server 90 executes the process according to the application program, and detailed description thereof will be omitted.

[0161] Then, the control unit 92 can associate partial information corresponding to the predetermined part of the skin in the diagnostic information on the skin condition of the predetermined body area with diagnostic information on the skin condition of the predetermined part, and transmit this associated diagnostic information to the terminal device 40. Under the control of the control unit 92, the terminal device 40 can display, on the display unit 41, for the partial information corresponding to the predetermined part of the skin among the diagnostic information on the skin condition of the predetermined body area, by adding the diagnostic information on the skin condition of the predetermined part to this partial information or by replacing the partial information with the diagnostic information on the skin condition of the predetermined part.

[0162] In addition, the control unit 92 can perform image correction processing (e.g., color calibration) on a part or all of an image of a specified area of ​​the body derived from image data of the specified area of ​​the body, based on an image of the specified area derived from image data of the specified area.

[0163] Furthermore, the control unit 92 executes a process for synthesizing a predetermined guide design portion, which indicates that the position is to be imaged by the skin condition measuring device 10, on the image of the predetermined body area derived from the image data of the predetermined body area, at a predetermined position on the image that is to be imaged by the skin condition measuring device 10, and can also transmit the processed image to the terminal device 40 and display it on the display unit 41 of the terminal device 40. As a result, the guide design portion is displayed as part of the image of the predetermined body area displayed on the display unit 41 of the terminal device 40, and the user can visually recognize and understand the position in the predetermined body area that should be imaged by the skin condition measuring device 10.

[0164] In addition, the control unit 92 obtains diagnostic information on the skin condition as information relating to the skin condition of the specified area of ​​the body based on image data of the specified area of ​​the body obtained by imaging by terminal device 40 received from terminal device 40, selects a specified area of ​​the skin to be imaged by skin condition measuring device 10 from the diagnostic information on the skin condition of the specified area of ​​the body, transmits information related to this specified area of ​​the skin to terminal device 40, and shows this information to the user on display unit 41 of terminal device 40, etc., thereby making it possible to perform imaging of the specified area of ​​the skin by skin condition measuring device 10.

[0165] Next, the usage state of the skin condition measuring system according to this embodiment will be described. As a premise, as in the second embodiment, the target parts of the skin condition measured by the skin condition measuring device 10 are the main parts of the skin of the face, and the entire face including these parts is considered to be a predetermined range of the user's body. The terminal device 40 is a smartphone, and is made to function as an imaging device by using the camera on the display side, and is capable of communicating with the server 90 through the network 100. The skin condition measuring device 10 connected to the terminal device 40 has a narrower imaging range than the terminal device 40, but is capable of imaging at a higher resolution, and images the skin of an extremely narrow range of the face.

[0166] As in the second embodiment, in order to perform imaging as a measurement of the skin condition using the terminal device 40 and the skin condition measuring device 10, first the skin condition measuring device 10 is connected to the terminal device 40 by a user.

[0167] Next, the user operates the terminal device 40 to access a specific web page prepared by a skin condition measurement service providing server (e.g., server 90), and this access makes it possible for the terminal device 40 to use online services such as web applications provided by the server, and an application program that provides a user interface for using the skin condition measuring device 10 is launched in the terminal device 40, allowing the user to use the skin condition measuring device 10 for skin condition measurement through the terminal device 40.

[0168] Alternatively, an application program that is pre-recorded in the terminal device and provides a user interface for using the skin condition measuring device 10 may be started on the terminal device 40 by a user's operation on the terminal device 40, so that the user can use the skin condition measuring device 10 for skin condition measurement through the terminal device 40. Also, when the skin condition measuring device 10 is connected to the user's terminal device 40, an application program that is pre-recorded in the terminal device 40 and provides a user interface for using the skin condition measuring device 10 may be automatically started without user operation, so that the user can use the skin condition measuring device 10 through the terminal device 40.

[0169] When the user performs an operation to start measurement on the user interface displayed on the display unit 41 of the terminal device 40, the terminal device 40 executes imaging of the face as the predetermined area of ​​the user's body.

[0170] In detail, in the terminal device 40, an application program for measuring a skin condition is executed, and a user interface is displayed on the display unit 41. When a user operates this user interface, the terminal device 40 as an imaging device starts capturing an image of the user's face, and the image data is continuously acquired by the terminal device 40 and transmitted to the server 90.

[0171] Then, based on the image data obtained by capturing an image, terminal device 40 displays an image of the face on display unit 41. Terminal device 40, by using a predetermined guide display or the like on display unit 41, causes the user to maintain a state in which terminal device 40 is held so that the face is displayed in a predetermined orientation and size.

[0172] In the server 90, the control unit 92 displays an image of the face based on the image data obtained by imaging on the display unit 41 of the terminal storage 60, and sends instructions to the terminal device 40 to guide the user to take images using the skin condition measuring device 10 of the areas of the face that are a specified area of ​​the user's body and that are subject to skin condition measurement by the skin condition measuring device 10, i.e., the skin parts of the face that can be imaged by the skin condition measuring device 10, where the user is concerned about the skin condition after looking at the display of the face on the display unit 41, and causes the terminal device 40 to display guidance and provide audio guidance to the user, etc.

[0173] Alternatively, the control unit 92 receives and analyzes image data obtained by imaging with the terminal device 40 from the terminal device 40, derives diagnostic information for the user's facial skin condition, and from this information, identifies an area for which a detailed image needs to be acquired by imaging with the skin condition measuring device 10 for a more appropriate diagnosis of the skin condition, for example, when a sign of the presence of a blemish or the like is found in a part of the skin and the presence or absence of a blemish is to be confirmed. Then, the control unit 92 sets the area thus identified as the imaging target position of the skin condition measuring device 10. Then, the control unit 92 performs a process of synthesizing a predetermined guide design portion indicating this imaging target position with an image of the face based on the image data, transmits the synthesized image to the terminal device 40, and causes the display unit 41 of the terminal device 40 to display it.

[0174] While looking at the screen of the display unit 41, which shows the user's face and, if necessary, the guide design section, the user adjusts the position of the handheld skin condition measuring device 10 so that it faces a part of the face where the user is concerned about the skin condition or the imaging target position shown by the guide design section. When the imaging target position of the skin condition measuring device 10 is shown by the guide design section, the user can easily understand the part of the face, which is the predetermined body area, to be imaged by the skin condition measuring device 10, and imaging can be appropriately performed using the skin condition measuring device 10 whose position the user has adjusted.

[0175] In the server 90, the control unit 92 analyzes the image data continuously acquired by the terminal device 40 and transmitted to the server 90, detects the current usage state of the skin condition measuring device 10 held by the user, and monitors it. When the control unit 92 determines from this usage state that the skin condition measuring device 10 is positioned so as to be directed toward an area of ​​concern to the user or so as to be able to image the measurement target position, it transmits to the terminal device 40 an instruction to have the skin condition measuring device 10 perform imaging of the specific area of ​​the skin to which the skin condition measuring device 10 is directed, and causes the skin condition measuring device 10 to perform imaging via the terminal device 40.

[0176] The skin condition measuring device 10, which has reached the stage of taking an image, takes an image of the skin surface under a predetermined lighting condition using a built-in light source for skin condition measurement, and outputs image data. This image data is acquired by the terminal device 40, which is communicatively connected to the skin condition measuring device 10, and is further transmitted from the terminal device 40 to the server 90 (see FIG. 20).

[0177] For example, in skin condition measuring device 10, a built-in light source capable of adjusting the light emitted as illumination optimizes the light irradiation state on the area to be imaged through verification of skin images obtained in trial imaging by skin condition measuring device 10, and then imaging is performed. Image data for a texture diagnosis image obtained by imaging the skin under illumination with unpolarized light irradiation and a blemish diagnosis image obtained by imaging the skin under illumination with linearly polarized light irradiation are sent to terminal device 40, acquired by terminal device 40, and transmitted from terminal device 40 to server 90.

[0178] In the case of the second embodiment, the skin condition measuring device 10 performs imaging under conditions where a predetermined part of the user's skin is irradiated with light from a built-in light source of the skin condition measuring device 10, which is different from the light used as illumination light in imaging by the terminal device 40, and image data can be obtained under different imaging conditions by the skin condition measuring device 10 and the terminal device 40. This makes it possible to increase the difference between the images of the skin, which is affected by the reflection, absorption, and attenuation of the light irradiated as illumination, in each layer of the skin, captured by the skin condition measuring device 10 and the terminal device 40, and increases the information content of the image data used as diagnostic material in diagnosing the skin condition in the server 90, enabling appropriate diagnosis of the skin condition. In particular, by selecting light, such as by selecting an appropriate wavelength of light irradiated as illumination, the skin condition measuring device 10 can perform imaging under conditions suitable for detailed analysis of partial skin conditions, thereby improving the accuracy of the diagnosis of the skin condition in the server 90 based on the image data obtained by imaging.

[0179] When imaging is performed using this skin condition measuring device 10, the control unit 92 receives image data including the user's face and the skin condition measuring device 10 obtained by imaging with the terminal device 40, which is transmitted from the terminal device 40 to the server 90, analyzes this image data including the user's face and the skin condition measuring device 10, and derives information about the usage state of the skin condition measuring device 10, i.e., information about the position and orientation of the skin condition measuring device 10 relative to the user's face during imaging, and records this in the recording unit 91 of the server 90 in association with the terminal device 40. It is also desirable to similarly record information related to the imaging conditions of the skin condition measuring device 10 transmitted together with the image data as part of the information about the same usage state, such as information about the lighting conditions caused by the built-in light source, so that this information about the usage state of the skin condition measuring device 10 can be used for subsequent imaging opportunities.

[0180] In the server 90, the control unit 92 receives and acquires image data of the predetermined part of the skin obtained by imaging with the skin condition measuring device 10 from the terminal device 40, and then generates an image of the predetermined part for display based on this image data. Next, the control unit 92 associates the image of the predetermined part with a part corresponding to the predetermined part in an image of the face based on image data obtained by imaging with the terminal device 40. However, the face image here is an image of the face as the predetermined body range that is not overlapped by the skin condition measuring device 10, based on image data obtained by imaging with the terminal device 40 before imaging with the skin condition measuring device 10.

[0181] The control unit 92 transmits information about the facial image associated with the image of the specified part to the terminal device 40 (see Figure 20), and displays part or all of the facial image in a specified area on the screen of the display unit 41 of the terminal device 40.

[0182] While a part or the whole of the face image is displayed on the display unit 41, the terminal device 40 that receives the user's operation instructions transmits information of the operation instructions to the control unit 92 of the server 90, and the control unit 92 controls the display range of the image in response to the operation instructions, so that a desired display range of the face can be set and displayed to display a part or the whole of the face image. When the control unit 92 sets the display range so that the whole face is displayed on the display unit 41, or when the control unit 92 sets the display range so that only a part of the face is displayed on the display unit 41 and the displayed range of the face includes a part corresponding to the predetermined part, the control unit 92 displays the image of the predetermined part associated with the part of the face image corresponding to the predetermined part in an area on the screen of the display unit 41 of the terminal device 40 different from the area where the image of the face as the predetermined body area is displayed.

[0183] In this way, the image of the face as the predetermined body range based on the image captured by the terminal device 40 and the image of the predetermined part based on the image captured by the skin condition measuring device 10 are displayed simultaneously and in parallel on the display unit 41. The image of the predetermined part is displayed as a detailed image with a larger magnification than the image of the face based on the specifications of the skin condition measuring device 10, and can show a more detailed skin condition compared to the image of the face based on the image captured by the terminal device 40. The user can check the skin condition from the two image displays, and can grasp the skin condition more accurately and easily.

[0184] Meanwhile, in the server 90, the control unit 92 receives and acquires image data of the predetermined part of the skin obtained by imaging with the skin condition measuring device 10 from the terminal device 40, and then analyzes the image data to acquire diagnostic information on the skin condition of the predetermined part of the skin. The control unit 92 associates the diagnostic information on the predetermined part with partial information corresponding to the predetermined part in diagnostic information on the facial skin condition as the predetermined body range based on image data obtained by imaging with the terminal device 40. However, the diagnostic information on the facial skin condition here is diagnostic information based on image data obtained by imaging with the terminal device 40 before imaging with the skin condition measuring device 10, and the analysis of the image data by the control unit 92 is performed from immediately after the image data is obtained by imaging with the terminal device 40 and this image data is received by the server 90 via transmission until the diagnostic information on the skin condition of the predetermined part is acquired.

[0185] Then, the control unit 92 transmits diagnostic information of the facial skin condition associated with the diagnostic information of the skin condition of the specified area to the terminal device 40 (see Figure 20), and displays the diagnostic information on the display unit 41 of the terminal device 40 simultaneously with the skin image of the face and the specified area, or in place of the skin image.

[0186] When displaying the diagnostic information for the skin condition on the display unit 41, the control unit 92 displays diagnostic information for the skin condition of the specified area by supplementing or replacing some of the diagnostic information for the skin condition of the face as the specified area of ​​the body, which corresponds to the specified part of the skin.

[0187] In this way, diagnostic information for the skin condition of the specified area associated with the facial skin diagnostic information is displayed so as to be supplemented or replaced with a portion of the information corresponding to the specified area, and the diagnostic information is provided to the user as detailed information including information analyzed from image data obtained by skin condition measuring device 10. This enriches the content of the diagnostic information for the user's skin condition based on image data obtained by imaging, and enables the user to understand the skin condition, at least for the facial area imaged by skin condition measuring device 10, by referring to diagnostic information from a different perspective obtained by analysis of image data from skin condition measuring device 10, thereby enabling the user to more accurately and easily grasp the skin condition.

[0188] The display of diagnostic information on the facial skin condition on the display unit 41 of the terminal device 40 is not limited to displaying text-based information, but can also be provided in a format in which areas of the skin requiring attention or symptoms are specifically indicated by marking images or the like on the facial image based on display control of the diagnostic information by the control unit 92. For example, image information can be displayed in which the positions and sizes of hidden blemishes derived as diagnostic information analyzed from the detailed image data obtained by the skin condition measuring device 10 are indicated by marks of a predetermined color superimposed on the corresponding areas on the facial image, and this can be used as reference information when carrying out skin care such as measures against blemishes. By displaying such diagnostic information, one skin condition measurement using the skin condition measuring device 10 is completed.

[0189] The user can grasp the transition of the skin condition of the face and the transition of the skin condition of the predetermined part at a predetermined measurement interval by repeating the imaging of the face as the predetermined body area by the terminal device 40 similar to the above and the imaging of the predetermined part by the skin condition measuring device 10. The server 90 records the images of the face and the predetermined part for display on the display unit 41 of the terminal device 40 based on the image data obtained by the repeated imaging in the recording unit 91 of the server 90 for each imaging, and can be configured to display the images on the display unit 41 of the terminal device 40 in chronological order as necessary, or to sequentially switch between images in chronological order, which is preferable because it allows the user to easily grasp the changes in the skin.

[0190] The facial image data obtained by imaging with terminal device 40, which is the basis for the display image and skin condition diagnostic information for the face as the specified body area obtained by server 90, is image data obtained by imaging with terminal device 40 before imaging with skin condition measuring device 10. Alternatively, the control unit 92 of server 90 may obtain image data of the specified part of the skin imaged with skin condition measuring device 10 from terminal device 40, and then perform image correction processing on the facial image data based on the image data of the specified part, generate a display facial image based on this corrected facial image data, transmit this facial image to terminal device 40 and display it on display unit 41 of terminal device 40, or analyze the corrected facial image data to obtain diagnostic information for the facial skin condition.

[0191] In this case, since the imaging range is limited and imaging conditions are easier to prepare, image correction processing is performed on the image data of the specified body range based on the image data of the specified body area captured by skin condition measuring device 10, and the color of the skin image of the specified body range shown in this image data can be matched to that of the skin image in the image data of the specified body range. Therefore, regardless of the imaging conditions on terminal device 40, the image data of the specified body range obtained by imaging can be made in a state that makes it easy to display the image and perform analysis related to diagnosing the skin condition, thereby encouraging the user to correctly understand the skin condition.

[0192] In this way, the skin condition measuring system according to this embodiment captures an image of the face as a predetermined area of ​​the user's body with the terminal device 40, and captures an image of a predetermined part of the user's skin with the skin condition measuring device 10. Based on the obtained image data of the face and the image data of the predetermined part, the server 90 obtains an image for display as information related to the skin condition and diagnostic information on the skin condition. Among the image of the face and diagnostic information on the skin condition based on the image taken by the terminal device 40, some information corresponding to the predetermined part of the skin is associated with the image of the predetermined part and the diagnostic information on the skin condition based on the image taken by the skin condition measuring device 10. When the terminal device 40 tries to use the partial information corresponding to the predetermined part of the skin, it is possible to use the image of the predetermined part and the diagnostic information on the skin condition that were obtained separately. This improves the quality of each piece of information related to the user's skin condition based on the image data obtained by imaging, and enables the server 90 to perform processing related to the display and analysis of the skin condition with high accuracy. This allows the skin condition to be diagnosed appropriately and efficiently, allowing the user to grasp the skin condition more accurately.

[0193] In the skin condition measuring system according to each embodiment, the skin condition measuring device 10 is configured as a close-up camera of a completely different type from the terminal devices 20, 30, and 40 as the imaging devices, but the present invention is not limited to this, and the skin condition measuring device may be configured as the same type of device as the imaging device (terminal device), for example, a camera-equipped portable device such as a smartphone. In this case, the shape information of the characteristic parts such as texture and blemishes in the image data of the face as a predetermined body range of the user obtained by imaging with the imaging device is compared with the shape information of the same characteristic parts such as texture and blemishes in the image data of the predetermined skin part obtained by imaging with the skin condition measuring device to obtain the mutual relationship, whereby the imaging position of the skin condition measuring device on the face image can be accurately detected, and the detected position information can be recorded and used for diagnosing the skin condition or for positioning the skin condition measuring device in the next imaging or later. In addition, when comparing the shape information of characteristic parts such as texture and blemishes based on each of these images, information related to texture, blemishes, etc. contained in previous skin condition diagnostic information based on image data from the skin condition measuring device can also be used as reference information, thereby improving the accuracy of position detection.

[0194] Furthermore, in the skin condition measuring system according to each of the above embodiments, the skin condition measuring device 10 is a device that locally images the user's skin to measure the user's skin condition, but is not limited to this, and the skin condition measuring device can also be other skin analysis devices such as a moisture sensor that detects the moisture contained in the user's skin, an oil sensor that detects the oil contained in the user's skin, or an elasticity sensor that detects the elasticity of the user's skin, and by repeating the measurement of the diagnostic information of the skin condition based on the sensor output while keeping the usage state of the skin condition measuring device as a sensor in the same state as the previous measurement occasion, the same skin position can be reliably measured in the same manner as above, and an accurate diagnosis of the skin condition can be made.

[0195] In addition, in the skin condition measuring system according to each of the above embodiments, the predetermined area of ​​the user's body imaged by the terminal device 20, 30, 40 as the imaging device is the face, and the predetermined part of the skin imaged by the skin condition measuring device 10 is any part of the skin on the face, but it is also possible to use a configuration in which the imaging device images the user's hair as the predetermined area of ​​the user's body, and the skin condition measuring device images the user's scalp (hair roots). In this case, the skin condition measurement of a specific part of the scalp can be accurately repeated as in the case of the facial skin, and a diagnosis based on the time-series change in the skin condition can be appropriately performed.

[0196] Furthermore, the subject of skin condition measurement using an imaging device and a skin condition measuring device is not limited to humans, but skin condition measurement may also be performed on animals such as pets. As with human skin, skin condition measurements can be accurately repeated on specific points of an animal's skin to appropriately perform a diagnosis based on changes in skin condition over time.

[0197] Furthermore, in the skin condition measuring system according to each of the above embodiments, the skin condition is, in principle, configured to diagnose the condition of bare skin. However, the present invention is not limited to this, and the skin condition can also be diagnosed using an imaging device and a skin condition measuring device to diagnose skin in a made-up state (including the state in which basic cosmetics are applied) where cosmetics have been applied to the skin.

[0198] In this case, instead of or in addition to the skin condition diagnosis results for bare skin and information related to skin care in response to the diagnosis, diagnostic information can include the quality of the makeup condition using cosmetics or basic cosmetics, methods of improvement depending on the cosmetics or basic cosmetics, and methods of skin care for makeup.In addition, by repeatedly measuring the skin condition, the effects of makeup, etc. on the skin can be understood and appropriate measures can be taken.

[0199] Furthermore, in the skin condition measuring system according to each of the above embodiments, a predetermined area of ​​the user's body is imaged using the terminal device 20, 30, 40 as an imaging device, and a predetermined part of the skin is imaged using the skin condition measuring device 10, and diagnostic information on the skin condition is obtained. Alternatively, a series of actions related to the user's facial skin care may be imaged and recorded using the terminal device, and diagnostic information on the skin condition may be derived from image data captured by the skin condition measuring device, and an image showing the contents of the skin care (including the beauty equipment and cosmetics used) captured by the terminal device and the diagnostic information may be displayed simultaneously in parallel, allowing the user's skin care to be evaluated based on the diagnostic information.

[0200] In this case, a care method for improving the skin condition based on the analysis result of the skin condition, for example, a care method different from the previous care imaged, or points to be improved from the previous care, can be more smoothly proposed to the user based on the display on the display unit. Furthermore, at this time, the terminal device can communicate and talk with a counselor, etc., to share the skin care content and diagnostic information, and the user can receive advice (counseling) on ​​the care method. Then, while the user is receiving advice, the skin condition measuring device can take an image and obtain the skin condition at that time, and it becomes possible to establish an appropriate care method based on the advice, etc., based on the latest information.

[0201] Furthermore, in the skin condition measuring system according to each of the above embodiments, the terminal devices 20, 30, 40 as imaging devices capture images of the skin condition measuring device 10 together with a specified area of ​​the user's body, and the obtained image data is analyzed to derive information on the position and orientation of the skin condition measuring device 10, which is recorded as information on the usage state. The imaging conditions of the skin condition measuring device 10 at the time of imaging are also recorded as information on the usage state, and these are used during subsequent skin condition measurements to control the imaging of the skin condition measuring device 10 according to the usage state. However, this is not limited to this, and it is also possible to use other devices (e.g., a shaver or a facial massager) instead of the skin condition measuring device, and control such other devices according to the usage state of the other devices obtained by imaging with the imaging device.

[0202] In this case, as in the above embodiment, information about the usage status, for example, information about the position of the device, can be obtained by analyzing image data captured by the imaging device, and control such as adjusting the output for each position can be performed to use the equipment appropriately.

[0203] Furthermore, when a device equipped with a camera is applied to a specified area of ​​the user's body (e.g., the face), image data of the specified area obtained by imaging with the device can be analyzed to obtain diagnostic information and the information can be displayed. At the same time, an image of the specified area of ​​the user's body including the device can be captured with an imaging device, and the obtained image data can be analyzed to obtain information about the usage status of the device (e.g., position and orientation), and based on this, appropriate control can be performed for each position of the target of application of the device (e.g., the face). [Explanation of symbols]

[0204] 1, 2 Skin condition measurement system 10. Skin condition measuring device 11 Main unit case 11a Tip 12 Image sensor 13 Optical mechanism section 13a Light diffusion plate 13b First polarizing plate 13c Second polarizing plate 13d light shielding plate 14, 15 LEDs 20, 30, 40 Terminal Equipment 21 Recording Section 22, 32, 41 Display section 23, 31 Control section 24, 34, 44 Wireless communication means 25, 35, 45 Interface 26, 36, 46 Camera section 90 Servers 91 Recording Department 92 Control section 100 Network

Claims

1. A skin condition measuring device capable of capturing an image of a predetermined part of a user's skin; an imaging device capable of imaging a predetermined range of a user's body including a target part of the skin to be imaged by the skin condition measuring device; A control unit that acquires information about a skin condition based on image data of the skin obtained by imaging; a display unit capable of displaying at least an image of the predetermined area of ​​the user's body; the control unit acquires, as first information regarding the skin condition of the predetermined body area, an image of the predetermined body area derived from image data of the predetermined body area obtained by imaging with the imaging device, and acquires, as second information regarding the skin condition of the predetermined area, an image of the predetermined area of ​​the skin derived from image data of the predetermined area of ​​the skin obtained by imaging with the skin condition measuring device; The display unit is capable of displaying the image acquired by the control unit, the control unit associates an image of the predetermined body region with a portion of the skin corresponding to the predetermined body region in the image of the predetermined body region, and causes the display unit to sequentially display an image of the associated predetermined body region in succession to an image of a portion or the entirety of the predetermined body region including at least the portion corresponding to the predetermined body region. A skin condition measuring system.

2. A skin condition measuring device capable of imaging a predetermined area of ​​a user's skin; an imaging device capable of imaging a predetermined range of a user's body including a target part of the skin to be imaged by the skin condition measuring device; A control unit that acquires information about a skin condition based on image data of the skin obtained by imaging; A display unit capable of displaying information regarding a user's skin condition, the control unit acquires diagnostic information on the skin condition of the predetermined body region as first information on the skin condition of the predetermined body region by analyzing image data of the predetermined body region obtained by imaging with the imaging device, and acquires diagnostic information on the skin condition of the predetermined region as second information on the skin condition of the predetermined region by analyzing image data of the predetermined region of the skin obtained by imaging with the skin condition measuring device; The display unit is capable of displaying the diagnostic information acquired by the control unit, the control unit associates diagnostic information on the skin condition of the predetermined region with a portion of diagnostic information on the skin condition of the predetermined region of the body that corresponds to the predetermined region of the skin in the diagnostic information on the skin condition of the predetermined region of the body, and when displaying the diagnostic information on the skin condition of the predetermined region of the body on the display unit, causes the display unit to display the diagnostic information on the skin condition of the associated predetermined region in a manner that supplements or replaces the portion of diagnostic information. A skin condition measuring system.

3. 3. The skin condition measuring system according to claim 1, The control unit acquires information about the skin condition of the predetermined body area based on image data of the predetermined body area obtained by imaging with the imaging device, selects a predetermined part of the skin to be imaged with the skin condition measuring device from the information about the skin condition of the predetermined body area, and enables imaging of the predetermined part of the skin by the skin condition measuring device. A skin condition measuring system.

4. 4. The skin condition measuring system according to claim 1, The skin condition measuring device captures an image of a predetermined part of the user's skin that is irradiated with light from a predetermined light source different from the light used as illumination light for capturing an image of the predetermined body range by the imaging device. A skin condition measuring system.

5. 5. The skin condition measuring system according to claim 1, The control unit performs image correction processing on a part or the whole of the image data of the predetermined body range based on the image data of the predetermined part. A skin condition measuring system.

6. In the skin condition measuring system according to claim 3 , the control unit executes a process of synthesizing a predetermined guide design portion, which indicates that the position is a target position for imaging by the skin condition measuring device, on an image of the predetermined body area derived from the image data of the predetermined body area, at least at a predetermined position on the image that is a target position for imaging by the skin condition measuring device; The display unit displays the guide design portion as a part of an image of the predetermined body area in a state where the image is displayed. A skin condition measuring system.

Images