Information processing apparatus, skin care prescription system, method, and storage medium

Abstract

The present application provides an information processing device, a skin care prescription system, a method, and a storage medium. The problem is to provide a prescription for skin care at a timing at which a sufficient skin improvement effect can be obtained. A CPU of the information processing device acquires history record data of an index value indicating a change in blood flow before and after a treatment based on a first skin image obtained by imaging the skin before the treatment for promoting blood flow and a second skin image obtained by imaging the skin after the treatment, and generates and outputs prescription data for skin care based on the acquired history record data.

Description

[0001] This application claims priority and interest in Japanese Patent Application No. 2021-150829, filed on September 16, 2021. The specification, claims, and drawings of Japanese Patent Application No. 2021-150829 are incorporated herein by reference in their entirety. Technical Field

[0002] This disclosure relates to information processing apparatus, skin care prescription system, skin care prescription method, and storage medium. Background Technology

[0003] Previously, techniques were known to obtain blood flow information from images of a subject's facial skin, calculate skin index values ​​(skin viscoelasticity, water transpiration, stratum corneum water content, skin color (a*, b*), stratum corneum cell area, etc.) based on the obtained blood flow information, and suggest skin care techniques and products based on these skin index values. Furthermore, techniques for obtaining information on the effects of skin care techniques and products based on skin index values ​​before and after their use are also known (for example, see JP Patent Application Publication No. 2019-25071).

[0004] However, during the cold winter months, when blood flow to the skin stagnates due to age-related changes in blood vessels, even using skincare products may not provide sufficient skin improvement. In the technology described in Patent Document 1, since skincare products are provided regardless of whether the desired skin improvement is achieved, sometimes even using the provided skincare products may not yield sufficient skin improvement. Summary of the Invention

[0005] The present invention was made in view of the above-mentioned problems, and its object is to provide a prescription for skin care at a time when sufficient skin improvement effect can be obtained.

[0006] To address the aforementioned issues, the information processing apparatus of this disclosure is characterized by having a processor that generates prescription data for skin care based on historical data of index values ​​representing changes in blood flow before and after the procedure, calculated from a first skin image obtained by photographing the skin before the procedure for improving blood flow and a second skin image obtained by photographing the skin after the procedure.

[0007] Invention Effects

[0008] According to the present invention, a prescription for skin care can be made at a time when sufficient skin improvement effects are achieved. Attached Figure Description

[0009] Figure 1 This is a diagram illustrating the overall structure of a skin care prescription system.

[0010] Figure 2 It means Figure 1 A block diagram of the functional structure of an information processing device.

[0011] Figure 3 It means by Figure 2 The flowchart shows the process of skin improvement treatment executed by the CPU.

[0012] Figure 4 It is a diagram used to illustrate the amplitude of the pulse wave.

[0013] Figure 5 It is a chart showing the time-varying changes in RGB brightness values ​​in skin image data before and after a massage.

[0014] Figure 6 From Figure 5 The chart is obtained by extracting only the brightness value of G from the recorded RGB brightness values ​​over time and enlarging the vertical axis.

[0015] Figure 7 From Figure 5 Subtract from the recorded brightness value of G over time Figure 5 A graph showing the time-varying changes in the brightness value of R, with the vertical axis magnified.

[0016] Figure 8 It is a graph showing the change in pulse wave amplitude over time before and after a massage.

[0017] Figure 9 It is a graph showing the shift in the ratio of the offset value before and after the massage (offset value after massage / offset value before massage).

[0018] Figure 10 It is a graph showing the shift in the ratio of PA values ​​before and after massage (PA value after massage / PA value before massage). Detailed Implementation

[0019] The following description uses the accompanying drawings to illustrate methods for implementing this disclosure. However, various technically preferred limitations are attached to the embodiments described below for the purpose of implementing this disclosure. Therefore, the scope of the technology of this disclosure is not limited to the following embodiments and the illustrated examples.

[0020] [Structure of Skin Care Prescription System 100]

[0021] Figure 1 This is a diagram illustrating an example of the overall structure of the skin care prescription system 100 disclosed herein.

[0022] like Figure 1 As shown, the skin care prescription system 100 is configured such that an information processing device 1, a server 3, and an automatic preparation dispensing system 4, which are connected to a measuring sensor 2, are connected via a communication network N such as a WAN (Wide Area Network) or the Internet in a manner that enables data transmission and reception.

[0023] Furthermore, the number of information processing devices 1 can be multiple, and there is no particular limitation.

[0024] Information processing device 1 is an apparatus that, based on skin image data (first skin image) acquired by measuring sensor 2 before a treatment to improve blood flow, such as massage, and skin image data acquired by measuring sensor 2 after the treatment (second skin image), calculates an index value (blood flow change index) characterizing the change in blood flow before and after the treatment. At a time when a blood flow activation state is determined based on historical data of this index value, prescription data for skin care is generated and output. Hereinafter, "treatment" refers to a treatment to improve blood flow.

[0025] The information processing device 1 can be, for example, a tablet terminal, a smartphone, or a PC (Personal Computer) equipped with a dedicated application for skin improvement, or a beauty-specific device with a smart mirror or the like. In addition, it can be integrated with the measuring sensor 2, and there are no particular limitations on the method.

[0026] Figure 2 This is a block diagram representing the functional structure of the information processing device 1.

[0027] Figure 2 As shown, the information processing device 1 consists of at least one CPU (Central Processing Unit) 11, RAM (Random Access Memory) 12, at least one storage unit 13 as a memory, an operation unit 14, a display unit 15, a camera unit 16, a sound output unit 17, a communication unit 18, an I / F 19, etc., and each unit is connected by a bus.

[0028] CPU 11 is a processor that centrally controls various parts of the information processing device 1 by reading programs and data stored in the storage unit 13 and using RAM 12 as a working area. For example, CPU 11 performs the skin improvement processing described later by cooperating with the skin improvement application 131 (referred to as skin improvement application 131) stored in the storage unit 13, thereby functioning as a calculation unit and a generation unit.

[0029] RAM12 serves as a temporary storage area for programs, input or output data, and parameters during the various processes controlled by CPU11.

[0030] The storage unit 13 is composed of non-volatile semiconductor memory, hard disk, etc., and stores various programs and data used in the programs.

[0031] In this embodiment, a skin improvement application 131 is stored in the storage unit 13. The skin improvement application 131 is a program used by the CPU 11 to execute the skin improvement processing described later. The skin improvement application 131 can be downloaded, for example, from the server 3.

[0032] The operation unit 14 consists of operation buttons for users to make various settings, a touch panel on the display unit 15, etc., and outputs the operation information of the operation buttons and the touch panel to the CPU 11.

[0033] The display unit 15 is composed of LCD (Liquid Crystal Display), EL (ElectroLuminescence) display, etc., and performs various displays according to the display information instructed by the CPU 11.

[0034] The camera unit 16 is composed of a camera lens, an image sensor consisting of an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-oxide Semiconductor), and an A / D conversion circuit. The image sensor converts the optical image passing through the camera lens into a two-dimensional image signal to obtain image data (brightness signals of R (red), G (green), and B (blue)).

[0035] The sound output unit 17 includes a sound synthesis unit, a D / A converter, an amplifier, a speaker, etc., and synthesizes or outputs sound according to the control of the CPU 11.

[0036] The communication unit 18 performs communication control via the communication network N for communicating with external devices such as server 3 and automated preparation dispensing system 4.

[0037] The I / F19 connects to external devices such as the measuring sensor 2 and serves as an interface for data communication. Furthermore, the information processing unit 1 and the measuring sensor 2 can function as a structure for data communication via wireless communication.

[0038] The measuring sensor 2 is a cylindrical sensor that measures the condition of a user's skin, and includes a camera unit 21, an illumination unit 22, a semiconductor sensor 23, an outer cover 24, a control unit 25, and an I / F unit 26.

[0039] The camera unit 21 is composed of a camera lens, a camera element, and an A / D conversion circuit facing the front end of the cylindrical outer cover 24. The camera element converts the optical image passing through the camera lens into a two-dimensional image signal to obtain image data (brightness signals of R, G, and B).

[0040] The lighting unit 22 is composed of, for example, LEDs (Light Emitting Diodes) and dimming circuits, and projects light into the field of view of the camera unit 21.

[0041] Semiconductor sensor 23 is an electrostatic capacitive semiconductor sensor and is disposed at the front end of housing 24. Semiconductor sensor 23, for example, has multiple capacitor elements arranged in two dimensions, and obtains the capacitance value of each capacitor element when in contact with the measurement object (user's skin).

[0042] The outer cover 24 is cylindrical, isolating the camera unit 21 and the illumination unit 22, which are located inside the outer cover 24, from the outside. By illuminating the object being measured (the user's skin) with light from the illumination unit 22 while the front end of the outer cover 24 is in contact with the object, and capturing images with the camera unit 21, the brightness inside the outer cover 24 can be kept constant, and image data (skin image data) can be obtained while suppressing the influence of external interference.

[0043] The control unit 25 centrally controls the operation of each part of the measuring sensor 2.

[0044] For example, the control unit 25, based on control from the information processing device 1, causes the illumination unit 22 to emit light and the imaging unit 21 to capture images, and outputs the obtained image data to the information processing device 1 via the I / F 26. Furthermore, the control unit 25, based on control from the information processing device 1, causes the semiconductor sensor 23 to perform measurements, measuring the oil and water content of the object to be measured based on the obtained capacitance values ​​of each capacitor element, and outputs the oil and water content data to the information processing device 1 via the I / F 26. As a method for measuring the oil and water content of the object to be measured based on the capacitance values ​​of each capacitor element obtained by the semiconductor sensor 23, for example, the method described in JP Japanese Patent Application Publication No. 2004-141259 can be used.

[0045] Furthermore, the structure of the measuring sensor 2 is not limited to the above; for example, the oil content can be obtained using an optical sensor.

[0046] Server 3 is composed of a storage unit 30, CPU, RAM, storage unit, operation unit, display unit, communication unit, etc. The storage unit 30 of server 3 contains user DB (Data Base) 31, skin measurement results DB32, blood flow change history records DB33, prescription DB34, etc. Server 3 stores (saves) the skin measurement data, blood flow change index history records, and prescription data sent from information processing device 1 by establishing a correspondence between them and user IDs.

[0047] User DB31 stores user information (user ID, authentication information, name, age, gender, address, phone number, email address, etc.) of users utilizing the skin care prescription system 100. Additionally, as authentication information, any of the following biometric information can be used: password, facial information, fingerprint information, etc. In this embodiment, a password will be used.

[0048] DB32 stores the skin measurement results by establishing a correspondence between the user's skin measurement data and the user ID, as well as the date and time of acquisition.

[0049] The blood flow change history DB33 stores historical data, including the offset values ​​of the indicator values ​​representing changes in blood flow on the user's skin before and after the procedure, as well as PA values ​​(details to follow), and establishes a correspondence between the data and the user ID and the date and time of acquisition.

[0050] Prescription DB34 stores prescription data for a user's skin care products, along with the user ID and the prescription date and time.

[0051] In addition, the server 3 stores the skin improvement application 131 in its storage section, and the server 3 sends the skin improvement application 131 in response to a request from the information processing device 1.

[0052] The automated preparation dispensing system 4 includes a control device (not shown) and an automated preparation dispensing device. The control device of the automated preparation dispensing system 4 receives prescription data and information on the delivery address of the skin care product from the information processing device 1, and causes the automated preparation dispensing device to dispense the skin care product based on the received prescription data, and to arrange and manage the delivery of the dispensed skin care product. The automated preparation dispensing device automatically dispenses the skin care product based on the prescription data input from the control device.

[0053] [Skin Care Prescription System 100 Actions]

[0054] Next, the operation of the skin care prescription system 100 will be explained.

[0055] Figure 3This is a flowchart illustrating the process of skin improvement treatment performed by the information processing device 1. When the operation unit 14 initiates the skin improvement application 131 and instructs the execution of skin improvement treatment, the skin improvement treatment is performed through the cooperation of the CPU 11 and the skin improvement application 131 stored in the storage unit 13.

[0056] First, CPU11 performs user authentication (step S1).

[0057] For example, CPU 11 causes display unit 15 to display a login screen and sends the user ID and password entered from the login screen via operation unit 14 to server 3. Server 3 compares the received user ID and password with the user information of user DB31. If they match, server 3 notifies information processing device 1 of authentication OK. If they do not match, server 3 notifies information processing device 1 of authentication NG.

[0058] Next, CPU11 determines whether authentication is OK based on the notification from server 3 (step S2).

[0059] In the case of NG authentication (step S2; no), CPU11 accepts the new registration and issues the user ID (step S3), and returns to step S1.

[0060] In step S3, the CPU 11, for example, displays a new registration screen on the display unit 15 and accepts user information input through the operation unit 14. If user information is input from the new registration screen, the CPU 11 sends the input user information to the server 3 through the communication unit 18 to make a new registration request. If the server 3 receives a new registration request from the information processing device 1, it issues a user ID, notifies the information processing device 1, and establishes a correspondence between the received user information and the issued user ID, saving it in the user DB 31. If the CPU 11 receives the user ID, it displays a registration completion notification and the user ID on the display unit 15.

[0061] If authentication is successful (step S2; Yes), CPU11 obtains from server 3 the user information corresponding to the authenticated user ID, the initial skin measurement data, and the historical data of blood flow change indicators (if data is available) (step S4), and then proceeds to step S5.

[0062] In step S5, CPU11 determines whether the initial skin measurement is complete (step S5). For example, if the initial skin measurement data can be obtained from server 3, it is determined that the initial skin measurement is complete.

[0063] If the initial skin measurement is deemed complete (step S5; Yes), CPU11 proceeds to step S7.

[0064] If it is determined that the initial skin measurement is not completed (step S5; no), the CPU 11 uses the measurement sensor 2 to perform the initial skin measurement, stores the obtained initial skin measurement data in the RAM 12, and sends the initial skin measurement data and user ID to the server 3 through the communication unit 18 (step S6), and then proceeds to step S7.

[0065] In step S6, for example, the CPU 11 outputs messages such as "Perform skin measurement. Please place the measurement sensor 2 against this area" and images indicating a given part of the face (e.g., cheek, under the eyes) using the display unit 15, sound output unit 17, etc., so that the user places the front end of the outer cover 24 of the measurement sensor 2 against the given part of the face, and obtains skin image data, moisture content, and oil content data from the measurement sensor 2. Then, the CPU 11 obtains measurement values ​​of predetermined skin diagnostic items (in this case, the color intensity of dark circles under the eyes, the number of pores, oil content, moisture content, the number of wrinkles, the number of blemishes, and the skin tone) from the obtained skin image data and moisture and oil content data, and uses the obtained measurement values ​​as the initial skin measurement data. The color intensity of dark circles under the eyes, the number of pores, the number of wrinkles, the number of blemishes, and the skin tone are obtained by parsing the skin image data. As a method for analyzing skin image data to obtain the number of pores, wrinkles, and blemishes, for example, the method described in JP Patent Application Publication No. 2007-152084 can be used. Regarding the color intensity of dark circles under the eyes and the hue of the skin, for example, the method of converting the RGB brightness values ​​of the skin image data (here, for example, the converted brightness described later) into the L*a*b* color system and using the lightness index L* value can be used, but it is not particularly limited to these methods.

[0066] In step S7, CPU11 performs preoperative blood flow measurement (step S7).

[0067] In step S7, for example, the CPU 11 outputs messages such as "Perform preoperative blood flow measurement. Please place the measuring sensor 2 against this location and wait a moment." and images indicating a given part of the face (e.g., cheek, lower part of the eye, etc.) using the display unit 15, sound output unit 17, etc., so that the user places the front end of the outer cover 24 of the measuring sensor 2 against the given part of the face to acquire skin image data (first skin image. For example, dynamic image data for a given time (e.g., 60 seconds)). If the acquisition of skin image data is completed, the CPU 11 outputs messages such as "Measurement completed." through the display unit 15 and sound output unit 17. Then, the CPU 11 parses the skin image data and calculates the offset value representing the blood volume of the skin and the PA (Pulse Amplitude) value representing the pulse wave amplitude of the skin as index values ​​representing the blood flow of the skin before the procedure.

[0068] The offset value is a representative value obtained by subtracting the R luminance value (the representative value of the R luminance value (the representative value of the converted luminance) of all pixels) from the G luminance value (the representative value of the G luminance value (converted luminance) of each frame in the acquired skin image data (dynamic image data).

[0069] The PA value is a representative value of the amplitude of the waveform representing the time change of the brightness value of G (the representative value of the brightness value of G (converted brightness) of all pixels) in the acquired skin image data (dynamic image data).

[0070] Here, the wavelength of green (G) is generally considered to be 495-570 nm, with hemoglobin having a higher absorption coefficient around 500-600 nm. Since the more blood there is on the skin's surface, the more hemoglobin is absorbed, and therefore more green light is absorbed by hemoglobin. Thus, the better the blood flow and the more blood volume in the user's skin, the lower the brightness value of G.

[0071] In this embodiment, since the increase in blood flow is easily perceived, a conversion process is performed whereby the brightness value increases as blood volume increases. More specifically, when using an image sensor that outputs 8 bits for each of the RGB colors to detect the brightness value, the value obtained by subtracting the detected brightness value from the maximum brightness value of 255 is used as the "converted brightness," and this converted brightness is used as the brightness value. Hereinafter, the term "brightness value" refers to this converted brightness.

[0072] In this way, the brightness value of G represents the amount of blood in the skin. By subtracting the brightness value of R from the brightness value of G, noise such as external light and hand tremors can be suppressed. Therefore, in this embodiment, as one of the indicators representing blood flow, the offset value is used as a representative value obtained by subtracting the brightness value of R from the brightness value of G for each frame of the skin image data.

[0073] In addition, the time-varying brightness value of G, which characterizes blood volume, is as follows: Figure 4 The waveform, as shown, represents the pulse wave. The amplitude of each waveform, i.e., the pulse wave amplitude (the difference PA between adjacent maximum and minimum values ​​of the pulse wave signal), represents the intensity of the pulsation that propels blood (promotes blood flow). Therefore, in this embodiment, as one of the indicators representing blood flow, the representative value of the amplitude (pulse wave amplitude) of the waveform representing the time variation of the brightness value of G in the skin image data, i.e., the PA value, is used. Furthermore, in cases where an abnormal value exceeding a preset threshold is detected in the amplitude of each waveform, the abnormal value can be excluded from the calculation of the representative value.

[0074] As a representative value, the average, median, mode, maximum, minimum, etc. can be used. In this embodiment, the average value will be used for explanation.

[0075] Next, the CPU11 displays a guide for the treatment to improve blood flow to the skin on the display unit 15, allowing the user to perform the treatment (step S8).

[0076] For example, as a guide for a massage technique to improve blood flow to the skin, the CPU 11 displays an animation of the face representing the massage method on the display unit 15, or sequentially displays arrows representing the areas and directions of the massage in the facial image. Simultaneously, audio guidance for the massage technique can also be output through the audio output unit 17.

[0077] Here, as a technique to improve blood flow to the skin, massage is listed for example, but other techniques such as applying creams to improve blood flow, physical therapy, relaxation, and facial muscle training can also be used.

[0078] Next, the CPU11 determines whether the operation unit 14 has input the meaning that the spell has ended (step S9).

[0079] If the CPU determines that the input indicates the end of the procedure (step S9; Yes), the CPU11 performs post-procedure blood flow measurement (step S10).

[0080] The processing of step S10 is the same as that described in step S7, except that the message to be output is "after treatment". Therefore, the description is used here.

[0081] Next, CPU11 calculates the index values ​​that characterize the changes in blood flow before and after the procedure (step S11).

[0082] Figure 5 This represents the temporal changes in RGB brightness values ​​in skin image data before and after a massage.

[0083] To elaborate further, as an example, Figure 5 (A) represents the temporal change in RGB brightness values ​​before the massage on October 3rd. Furthermore, Figure 5 (B) represents the change in RGB brightness values ​​over time after the massage on the same day, October 3rd. Furthermore, Figure 5 (C) indicates from Figure 5 (A) and Figure 5 The temporal changes in RGB brightness values ​​before the massage, approximately two months after time point (B), i.e., November 28th. Furthermore, Figure 5 (D) represents the change in RGB brightness value over time after the massage on the same day, November 28.

[0084] In addition, the RGB brightness values ​​in the chart represent the time variation of the average brightness of the RGB signals of all pixels in the skin image data.

[0085] also, Figure 6 From Figure 5 The graph shown is obtained by extracting only the brightness value of G from the time variation of RGB brightness values ​​and enlarging the vertical axis. Figure 6 (A) Figure 6 (B) Figure 6 (C) and Figure 6 (D) and respectively Figure 5 (A) Figure 5 (B) Figure 5 (C) and Figure 5 (D) corresponds to.

[0086] also, Figure 7 In order to suppress the influence of external interference Figure 5 Subtract from the time variation of the brightness value of G shown Figure 5 The graph shows the time variation of the brightness value of R, and is obtained by magnifying the vertical axis. Figure 7 The average value of the brightness change of GR over time is the offset value mentioned above. Figure 7 (A) Figure 7 (B) Figure 7 (C) and Figure 7 (D) and respectively Figure 5 (A) and Figure 6 (A) Figure 5 (B) and Figure 6 (B) Figure 5 (C) and Figure 6 (C) and Figure 5 (D) and Figure 6 (D) corresponds to.

[0087] Figure 8 This indicates the temporal change in pulse wave amplitude before and after the massage procedure. Figure 8 The pulse wave amplitude shown is Figure 6 The amplitude of the waveform showing the time-varying brightness value of G is shown. Figure 8 The average value of the time variation shown is the PA value mentioned above. More specifically, Figure 8 (A) and Figure 6 (A) corresponds to Figure 8 (B) and Figure 6 (B) corresponds to Figure 8 (C) and Figure 6 (C) corresponds to Figure 8 (D) and Figure 6 (D) corresponds to.

[0088] In step S11, for example, calculate the... Figure 7 The average value of the time-varying GR brightness value after massage, as shown in (B) and (D), i.e., the offset value, is divided by . Figure 7 The ratio obtained from the average value of the time-varying change in GR brightness values ​​before massage, as shown in (A) and (C), and / or the ratio obtained from the offset value, and / or the ratio obtained from the time-varying change in GR brightness values ​​before massage. Figure 8 The average value of the time variation of the pulse wave amplitude shown in (B) and (D), i.e., the PA value, is divided by . Figure 8 The ratio obtained from the average value of the time-varying pulse wave amplitude shown in (A) and (C), i.e., the PA value, is used as an indicator value to represent the changes in blood flow before and after the procedure.

[0089] In addition, as an indicator value that characterizes changes in blood flow before and after the procedure, it is not limited to ratios, as long as it characterizes changes in offset or PA values ​​before and after the procedure. For example, the rate of change can be used.

[0090] If the index value representing the change in blood flow before and after the procedure is calculated, the CPU11 obtains the historical data of the index value representing the change in blood flow before and after the procedure (including the index value calculated this time). Based on the historical data of the index value representing the change in blood flow before and after the procedure, it determines whether the blood flow of the skin is in an activated state (= whether the activated state of blood flow is maintained) (step S12).

[0091] If blood flow to the skin stagnates, the necessary oxygen and nutrients will not be adequately distributed, and the skin's turnover will become disordered (slowed down). As a result, dead skin cells that should normally shed every 28 days remain on the skin and thicken, preventing skincare ingredients from reaching deep into the skin and achieving sufficient skin improvement.

[0092] Therefore, in this embodiment, by determining whether the skin is in an activated state, and by prescribing and distributing a skin care product at a time when the skin is determined to be in an activated state, the skin care product can be provided at a time when the skin care product can achieve sufficient skin improvement effects.

[0093] Figure 9 It is a graph representing the shift in the ratio of the offset value before and after massage (offset value after massage / offset value before massage) under long-term continuous massage conditions (a graph obtained by charting the historical data of the ratio of the offset value before and after the treatment).

[0094] like Figure 9 As shown, at the beginning of the massage, the ratio of the offset value after the massage to the offset value before the massage is high (the offset value after the massage is larger than the offset value before the massage). However, after the massage begins, as time goes by, the ratio of the offset value after the massage to the offset value before the massage gradually decreases. Eventually, the change in the ratio of the offset values ​​before and after the massage disappears and becomes roughly fixed.

[0095] This is because when you first start a massage, the blood flow is improved, so the amount of blood increases significantly after the massage. However, as you continue to massage, the state of blood flow activation before the massage is maintained, so the change in blood volume gradually stabilizes.

[0096] Therefore, the CPU11, for example, determines whether the ratio of the offset values ​​before and after the procedure has become approximately fixed (e.g., whether the change from the previous value is within a given threshold) based on historical data of the ratio of offset values ​​before and after the procedure. If it is determined that the ratio has become approximately fixed, it is determined to be a state of blood flow activation. For example, Figure 9 The time points indicated by the arrows in the chart are considered to be the state of blood flow activation.

[0097] Figure 10 It is a graph that represents the shift in the ratio of PA values ​​before and after massage (PA value after massage / PA value before massage) under long-term continuous massage conditions (a graph obtained by charting historical data of the ratio of PA values ​​before and after the treatment).

[0098] like Figure 10As shown, regarding PA values, initially at the start of a massage, as the days go by, the ratio of the post-massage PA value to the pre-massage PA value increases, soon reaching a peak, and then gradually decreases, hovering around 100% (i.e., the change in PA values ​​before and after the massage becomes smaller).

[0099] This is because when the massage begins, the capillaries dilate under the external pressure of the massage, resulting in increased blood flow due to pulsation after the massage. As the massage continues, the dilation is maintained, and the changes before and after the massage gradually decrease.

[0100] Therefore, CPU11, for example, uses historical data on the ratio of PA values ​​before and after the procedure to determine whether the ratio of PA values ​​before and after the procedure has decreased. If it determines that the ratio has decreased, it determines that the blood flow has been activated. For example, in Figure 10 In the diagram, the time point indicated by the arrow is considered to be a state of activated blood flow.

[0101] Furthermore, in step S12, the determination of whether blood flow has been activated can be based on historical data of both the ratio of offset values ​​before and after the procedure and the ratio of PA values, or it can be based on historical data of either the ratio of offset values ​​before and after the procedure or the ratio of PA values. For example, since the ratio of offset values ​​before and after the procedure does not change for individuals with good blood flow from the beginning, it is preferable to use only historical data of the ratio of PA values ​​to determine whether blood flow has been activated.

[0102] If it is determined that the blood flow is not activated (step S13; no), the CPU 11 will output a message prompting the user to restart the skin improvement application to perform the treatment after a given time has elapsed (e.g., after 24 hours) via the display unit 15 or the sound output unit 17 (step S23), and end the skin improvement treatment.

[0103] If it is determined that the blood flow is activated (step S13; Yes), the CPU11 uses the measuring sensor 2 to perform skin measurement and obtain skin measurement data (step S14).

[0104] In step S14, the same processing as in step S6 is performed (no data transmission is required) to obtain skin measurement data for the same items as those obtained in step S6.

[0105] Next, CPU11 compares the initial skin measurement data with the skin measurement data obtained in step S14 (step S15) to determine whether there are any unimproved skin diagnostic items (step S16).

[0106] Here, if the measurement values ​​of each skin diagnostic item in the initial skin measurement data are set as the initial values, and the measurement values ​​of each skin diagnostic item obtained in step S14 are set as measurement value a, then, for example, if the following conditions are met, the skin diagnostic item is judged to be unimproved.

[0107]

[0108]

[0109] If it is determined that there are skin diagnostic items that have not been improved (step S16; yes), CPU11 generates prescription data for a skin care agent to improve the unimproved items (step S17).

[0110] For example, for each skin diagnosis item, a table containing the ingredients and amounts (e.g., the amount corresponding to measurement value a) of the skin care product to be prescribed is stored in the storage unit 13 in advance. The CPU 11 generates prescription data for the skin care product based on the unimproved skin improvement items and the table.

[0111] For example, if the intensity of dark circles under the eyes does not improve, a skin care product with blood flow-promoting effects can be prescribed. If the number of pores does not improve, a facial cleanser can be prescribed. If the oil and / or water content does not improve, a skin care product with moisturizing ingredients (glycerin, propylene glycol, etc.) can be prescribed. If the number of wrinkles and / or blemishes does not improve, a skin care product with UV protection ingredients (histidine, tyrosine, tryptophan, uric acid, etc.) can be prescribed. If the skin tone does not improve, a skin care product with whitening ingredients (e.g., hydroquinone, vitamin C derivatives, kojic acid, arbutin, etc.) can be prescribed. If multiple aspects other than the number of pores do not improve, a skin care product can be formulated by mixing ingredients corresponding to the respective aspects to create a single skin care product.

[0112] Alternatively, in step S15, CPU11 may not compare the measurement value a with the initial measurement value, but rather compare it with, for example, a predetermined threshold (e.g., the average of the user's (logged-in) measurement values ​​with those of the same age; or, in the case where the user group is classified into multiple groups with similar skin types based on the initial skin measurement data using machine learning, etc.), to determine whether each skin diagnostic item has improved. Alternatively, it may compare the measurement value a with the measurement value from the previous skin measurement data.

[0113] Next, the CPU11 transmits the acquired blood flow change index data, skin measurement data, and prescription data to the server 3 via the communication unit 18, establishing a correspondence between the data and the user ID (step S18).

[0114] Server 3 stores the received skin measurement data in Skin Measurement DB32, the blood flow change index data in Blood Flow Change History DB33, and the prescription data in Prescription DB34.

[0115] If the transfer is completed (step S19; yes), the CPU 11 sends (outputs) the generated prescription data and the delivery address information of the skin care product (e.g., name, address, etc. contained in the user information) to the automatic preparation dispensing system 4 through the communication unit 18, and instructs the dispensing of the skin care product based on the generated prescription data and delivery to the delivery address (step S20).

[0116] Here, if the control device of the automated preparation dispensing system 4 receives prescription data and delivery address information from the information processing device 1, it outputs the prescription data to the automated preparation dispensing device to dispense the skin care product based on the prescription data. Furthermore, it arranges the delivery of the generated skin care product based on the delivery address information, and notifies the information processing device 1 when the delivery arrangement is complete.

[0117] If the communication unit 18 receives a notification from the automatic preparation and delivery system 4 that the preparation and delivery of the skin care product has been completed (step S21; Yes), the CPU 11 will notify the user that the preparation and delivery of the skin care product has been completed (step S22), and end the skin improvement treatment.

[0118] In step S22, the CPU 11 displays, for example, a notification that the delivery arrangement for the skin care product has been completed on the display unit 15 of the information processing device 1. Alternatively, the notification may be sent to the user's email address, etc.

[0119] As explained above, the CPU 11 of the information processing device 1 acquires historical data of index values ​​representing changes in blood flow before and after the procedure, calculated based on a first skin image obtained by photographing the skin before the procedure to improve blood flow and a second skin image obtained by photographing the skin after the procedure. Based on the acquired historical data, the CPU 11 generates and outputs prescription data for skin care.

[0120] Therefore, based on historical data of indicators characterizing changes in blood flow before and after procedures to improve blood flow, it is possible to prescribe skin care products at a time when adequate skin improvement can be achieved.

[0121] For example, CPU11 uses historical data of index values ​​that characterize changes in blood flow before and after treatment to determine whether the blood flow in the skin is in an activated state. If it is determined to be in an activated state, it generates and outputs prescription data for skin care.

[0122] Therefore, a prescription for skin care can be given at regular intervals when the blood flow to the skin is activated and sufficient skin improvement can be achieved.

[0123] For example, CPU11 calculates an index value that characterizes the change in pulse wave amplitude before and after the procedure, and uses it as an index value to characterize the change in blood flow before and after the procedure. If the index value is detected to have decreased based on its historical data, prescription data is generated and output.

[0124] Therefore, a prescription for skin care can be given at regular intervals when the blood flow to the skin is activated and sufficient skin improvement can be achieved.

[0125] In addition, for example, the CPU11 calculates an index value representing the change in blood volume before and after the procedure, and uses it as an index value representing the change in blood flow before and after the procedure. If it detects that the change in the index value representing the change in blood volume before and after the procedure is within a given range based on its historical data, it generates prescription data and outputs it.

[0126] Therefore, a prescription for skin care can be given at regular intervals when the blood flow to the skin is activated and sufficient skin improvement can be achieved.

[0127] In addition, for example, CPU11 diagnoses the skin based on skin measurement data obtained by measuring the skin, and generates and outputs prescription data based on the diagnosis results.

[0128] Therefore, it is possible to generate and output optimal prescription data based on skin diagnostic results.

[0129] Furthermore, since the prescription data includes the prescription data for skin care products applied to the skin, it is possible to prescribe skin care products at the appropriate time to achieve sufficient skin improvement.

[0130] Furthermore, CPU11 sends instructions for the preparation and delivery of skin care products based on prescription data to a given receiving address of the automated preparation preparation system 4, etc. Therefore, it is possible to instruct the preparation and delivery of the prescribed skin care products.

[0131] Furthermore, the descriptions in the above embodiments are preferred examples of the information processing apparatus, skin care prescription system, skin care prescription method, and procedure involved in this disclosure, and are not limited thereto.

[0132] For example, some or all of the skin improvement processing performed by the CPU 11 of the information processing device 1 in the above embodiment can be executed by other processors, such as the CPU of the server 3. That is, other processors, such as the CPU of the server 3, can have some or all of the functions of the information processing device 1 (e.g., functions as a calculation unit or a generation unit).

[0133] As an example, skin image data, as well as data on water and oil content, obtained by the measuring sensor 2 can be sent to the server 3, where the server 3 calculates the measurement values ​​for skin diagnostic items. Alternatively, skin image data before and after the procedure obtained by the measuring sensor 2 can be sent to the server 3, where the server 3 calculates the index values ​​characterizing changes in blood flow. Based on historical data of the index values ​​characterizing changes in blood flow before and after the procedure, the blood flow activation status can be determined and prescription data can be generated.

[0134] In addition, for example, the functions and various databases of the server 3 in the skin care prescription system 100 can also be configured in the information processing device 1.

[0135] Furthermore, while the above embodiment describes using the measuring sensor 2 to capture skin image data, the image data can also be acquired using the camera unit 16 provided in the information processing device 1. Additionally, if the measuring sensor 2 is used, the information processing device 1 may not need to include the camera unit 16.

[0136] Furthermore, in the above embodiments, prescription data for skin care agents corresponding to skin diagnostic items is generated based on historical data of index values ​​characterizing changes in blood flow before and after the procedure. However, it can also be prescription data for massage techniques for skin care or physical therapy to be performed.

[0137] Furthermore, in the above embodiments, an example was described of using converted brightness as a brightness value to calculate an index value characterizing changes in blood flow before and after the procedure, but it is not limited to this, and the detected brightness value may be used without conversion processing.

[0138] Furthermore, in the above embodiments, the automatic preparation dispensing device automatically dispenses skin care products based on prescription data, but skin care products can also be dispensed by a person based on prescription data.

[0139] Furthermore, in the above embodiment, instructions for dispensing and distributing skin care products based on prescription data are sent to the automated preparation dispensing system 4; however, the destinations for sending the dispensing instructions and the distribution instructions may be different. Alternatively, dispensing-only instructions or distribution-only instructions may be sent to a given receiving address.

[0140] Furthermore, while the above embodiments disclose an example of using ROM as the computer-readable medium for the program disclosed herein, this is not a limitation. Other computer-readable media include removable recording media such as hard disks, SSDs, and CD-ROMs. Additionally, a carrier wave can be used as the medium for providing data of the program disclosed herein via a communication line.

[0141] In addition, the detailed structure and operation of each device constituting the skin care prescription system can be appropriately modified without departing from the main purpose of the disclosure.

[0142] The embodiments of this disclosure have been described above, but the scope of the technology of this disclosure is not limited to the above-described embodiments, but is determined based on the description in the claims. Furthermore, equivalent scopes obtained by adding modifications unrelated to the essence of this disclosure according to the description in the claims are also included in the scope of the technology of this disclosure.

Claims

1. An information processing device, characterized in that, Equipped with a processor The processor performs the following processing: Based on historical data of indicators representing changes in blood flow before and after multiple treatments to improve blood flow, it is determined whether the blood flow of the skin is in an activated state. If it is determined to be in an activated state, prescription data for skin care of the skin is generated. The indicator values ​​are calculated based on a first skin image obtained by photographing the skin before each treatment and a second skin image obtained by photographing the skin after each treatment.

2. The information processing apparatus according to claim 1, wherein, The index values ​​characterizing the changes in blood flow before and after the procedure are index values ​​characterizing the changes in pulse wave amplitude calculated based on the first skin image and the second skin image. The processor generates the prescription data when it detects, based on the historical data, that an indicator value representing the change in pulse wave amplitude before and after the procedure has decreased.

3. The information processing apparatus according to claim 1, wherein, The index value characterizing the changes in blood flow before and after the procedure is an index value characterizing the changes in blood volume calculated based on the first skin image and the blood volume calculated based on the second skin image. The processor generates the prescription data when it detects, based on the historical data, that the change in the value of an indicator characterizing the change in blood volume before and after the procedure falls within a given range.

4. The information processing apparatus according to claim 1, wherein, The processor diagnoses the skin based on measurement data obtained by measuring the skin, and generates the prescription data based on the diagnostic results of the skin.

5. The information processing apparatus according to claim 1, wherein... The prescription data includes prescription data for skin care products applied to the skin.

6. The information processing apparatus according to claim 5, wherein, The processor sends instructions for the preparation and / or delivery of skin care products based on the prescription data to a given receiving address.

7. A skin care prescription system, characterized in that, have: The calculation unit calculates index values ​​characterizing changes in blood flow before and after the treatment based on a first skin image obtained by photographing the skin before each treatment to improve blood flow and a second skin image obtained by photographing the skin after each treatment. The storage unit stores historical data of index values ​​representing changes in blood flow before and after multiple treatments. and The generation unit acquires the historical data and, based on the acquired historical data, determines whether the blood flow of the skin is in an activated state. If it is determined to be in an activated state, it generates prescription data for skin care of the skin.

8. A skin care prescription method, wherein the following processing is performed by a computer: Based on historical data of indicators representing changes in blood flow before and after multiple treatments to improve blood flow, it is determined whether the blood flow of the skin is in an activated state. If it is determined to be in an activated state, prescription data for skin care of the skin is generated. The indicator values ​​are calculated based on a first skin image obtained by photographing the skin before each treatment and a second skin image obtained by photographing the skin after each treatment.

9. A storage medium, being a non-transitory computer-readable storage medium, storing a program that causes a computer to perform the following processes: Based on historical data of indicators representing changes in blood flow before and after multiple treatments to improve blood flow, it is determined whether the blood flow of the skin is in an activated state. If it is determined to be in an activated state, prescription data for skin care of the skin is generated. The indicator values ​​are calculated based on a first skin image obtained by photographing the skin before each treatment and a second skin image obtained by photographing the skin after each treatment.

Images