Skin influence estimation system, information processing device, and skin influence estimation method

Abstract

To visualize an influence of sleeping on skin.SOLUTION: A skin influence estimation system includes a sleeping sensor that detects sleeping information being information on sleeping of a user, and a control part. The control part estimates an influence of sleeping of the user on skin on the basis of the sleeping information detected by the sleeping sensor.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] An embodiment of the present disclosure relates to a skin effect estimation system, an information processing device, and a skin effect estimation method. [Background technology]

[0002] 2. Description of the Related Art Skin diagnostic devices that diagnose the condition of a user's skin are known. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2017-209280 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, it has become known that sleep has a significant impact on skin condition. However, while the above-mentioned prior art can diagnose skin condition, it cannot evaluate the impact of sleep, and therefore it is unclear how to improve sleep habits in order to improve skin condition.

[0005] The problem that the present disclosure aims to solve is to visualize the effects of sleep on the skin. [Means for solving the problem]

[0006] The skin effect estimation system according to the embodiment includes a sleep sensor that detects sleep information, which is information relating to a user's sleep, and a control unit, and the control unit estimates the effect of the user's sleep on the skin based on the sleep information detected by the sleep sensor. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram showing the functional configuration of a skin effect estimation system according to an embodiment. [Figure 2]FIG. 2 is a perspective view showing the appearance of an electric bed provided in the skin effect estimation system. [Figure 3] FIG. 3 is a perspective view showing the appearance of a mattress provided in the skin effect estimation system. [Figure 4] FIG. 4 is a block diagram showing the functional configuration of the electric bed. [Figure 5] FIG. 5 is a perspective view showing an example of the arrangement of sleeping posture sensors in the skin effect estimation system. [Figure 6] FIG. 6 is a distribution diagram showing an example of a pressure detection area of ​​the sleeping posture sensor. [Figure 7] FIG. 7 is a block diagram showing an example of the connection of the sleeping posture sensor. [Figure 8] FIG. 8 is a block diagram for explaining the process of detecting the sleeping posture. [Figure 9] FIG. 9 is a distribution diagram showing an example of the output result when the user is determined to be in a lateral position. [Figure 10] FIG. 10 is a distribution diagram showing an example of the output result when the user is determined to be in the supine position. [Figure 11] FIG. 11 is a diagram showing an example of a screen display of sleep information. [Figure 12] FIG. 12 is a diagram showing an example of detailed sleep information. [Figure 13] FIG. 13 is a diagram showing another example of the detailed sleep information. [Figure 14] FIG. 14 is a screen diagram showing an example of the sleep evaluation results. [Figure 15] FIG. 15 is a screen diagram showing an example of the effect on the skin based on sleep information. [Figure 16] FIG. 16 is a diagram showing an example of a screen showing recommendation information for improving skin condition. [Figure 17] FIG. 17 is a flowchart showing the flow of processing by the skin effect estimation system. [Figure 18] FIG. 18 is a block diagram showing the hardware configuration of an information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0008] <1. Embodiment> Each embodiment of the present disclosure will be described below with reference to the drawings. In the present specification and each drawing, elements similar to those already described will be designated by the same reference numerals, and detailed descriptions will not be repeated. Note that the drawings are schematic or conceptual, and the relationship between the thickness and width of each part, the size ratio between parts, and the like are not necessarily the same as those in reality. Even when the same part is shown, the dimensions and ratios may be different depending on the drawing. Furthermore, in the present specification and each drawing, elements similar to those previously described with reference to the previously mentioned drawings will be designated by the same reference numerals, and detailed descriptions will be omitted as appropriate.

[0009] (1.1. Functional configuration of Skin Effect Estimation System 1) The functional configuration of a skin effect estimation system 1 according to an embodiment will be described with reference to Fig. 1. As shown in Fig. 1, the skin effect estimation system 1 includes a terminal device 50, an electric bed 210, an air mattress device 110, a sleeping posture sensor 260, a sleep sensor 310, and a skin diagnosis device 410. These components are configured to be able to communicate with each other.

[0010] The terminal device 50 is an information processing device that includes input means and output means and can be operated by a user of the skin effect estimation system 1. The terminal device 20 may be, for example, a smartphone, a tablet terminal, or a wearable device such as a smart watch (watch-type) or a smart ring (finger ring-type), or may be a general-purpose or dedicated personal computer. The hardware configuration of the terminal device 50 will be described later. The terminal device 50 includes a control unit 51, a storage unit 52, and a display 53.

[0011] The control unit 51 estimates the effect of sleep on the user's skin based on sleep information detected by the sleep sensor 310. Details of the processing by the control unit 51 will be described later.

[0012] The storage unit 52 stores programs and data necessary for processing by the control unit 51, data obtained by processing by the control unit 51, etc. As an example, the storage unit 52 stores sleep information acquired by a sleep sensor 310 (described later). The display 53 functions as an output means, and presents predetermined information to the user by displaying it. The information displayed on the display 53 will be described in detail later.

[0013] The electric bed 210 is bedding used by a user when sleeping, and includes a drive mechanism that adjusts at least one of the height and hardness. As an example, the control unit 51 may be configured to control the drive mechanism to adjust at least one of the height and hardness of the electric bed 210 based on the effect on the skin estimated based on the sleep information. Details of the electric bed 210 will be described later.

[0014] The air mattress device 110 is placed on an electric bed 210. Details of the air mattress device 110 will be described later. The sleeping posture sensor 260 is placed on the electric bed 210 and detects the sleeping posture of the user while sleeping. Details of the sleeping posture sensor 260 will be described later.

[0015] The sleep sensor 310 detects sleep information, which is information related to the user's sleep. As an example, the sleep sensor 310 may be a vibration sensor attached to the bedding. Examples of the vibration sensor include, but are not limited to, a piezoelectric sensor with a piezoelectric element or an angular velocity sensor with a gyroscope. The sleep sensor 310 detects at least one of the user's sleep time and sleep quality based on the vibration of the electric bed 210, which is the bedding. The control unit 51 estimates the effect of the user's sleep on the skin based on at least one of the user's sleep time and sleep quality.

[0016] As another example, the sleep sensor 310 may be a posture detection sensor attached to the user's body, or a biosensor that detects biometric information such as the user's body temperature and pulse rate.

[0017] Skin diagnostic device 410 is a device that diagnoses the condition of the user's skin. As an example, skin diagnostic device 410 may be a so-called skin scope that analyzes light reflected from the skin to diagnose the fineness of skin texture, the presence or absence of blemishes and wrinkles, the moisture content, the oil content, the state of pores, keratin turnover, etc. Alternatively, as another example, skin diagnostic device 410 may be a skin diagnostic kit that diagnoses the amount of sebum, the fineness of skin texture, the opening and distortion of pores, the turnover of keratin, etc., based on biological information acquired from a sebum tester or a pack applied to the skin. Control unit 51 may estimate the effect of sleep on the user's skin by further considering the results of the diagnosis by skin diagnostic device 410.

[0018] (1.2. Configuration of the electric bed 210) 2 is a perspective view showing an example of the appearance of an electric bed 210. As shown in FIG. 2, the electric bed 210 includes a movable part 70 and an air mattress device 110 placed on the movable part 70.

[0019] Fig. 3 is a diagram showing an example of an air mattress device 110. As shown in Fig. 3, the air mattress device 110 includes an air mattress 10 and an operation panel 30. The air mattress 10 includes a plurality of air cells 11, a pump unit 12, and a cover 13.

[0020] Gas (e.g., air) is stored inside the multiple air cells 11 and the air pillow 14. The pump unit 12 is connected to the multiple air cells 11 and the air pillow 14, respectively, and supplies gas to the multiple air cells 11 and the air pillow 14. Alternatively, the pump unit 12 exhausts gas from inside the multiple air cells 11 and the air pillow 14. A cover 13 covers the multiple air cells 11 and the pump unit 12. The air pillow 14 is placed on the air mattress 10. Note that the air pillow 14 does not have to be used; any other pillow whose height can be adjusted may be used.

[0021] The pump unit 12 is located, for example, on the foot side of a person sleeping on the air mattress 10. The head side and foot side of the air mattress 10 can be determined, for example, by letters or pictures attached to the air mattress 10.

[0022] The operation panel 30 accepts operations to control the pump unit 12. For example, a user can operate the operation panel 30 to make the pump unit 12 discharge gas, thereby increasing or decreasing the pressure inside the air cell 11 and the air pillow 14. This makes the air mattress 10 and the air pillow 14 harder or softer. The operation panel 30 is electrically connected to the pump unit 12 by a cable 35, as shown in FIG. 3, for example. Furthermore, the control unit 51 of the terminal device 50 is connected to the pump unit 12 by wireless communication means. That is, the control unit 51 can control the hardness of the air mattress 10 and the air pillow 14 via the wireless communication means.

[0023] The electric bed 210 includes a movable unit 70 and an operating unit 230. The operating unit 230 accepts operations for controlling the movable unit 70. For example, the user can operate the operating unit 230 to change the angle of at least one of the back bottom 70a, knee bottom 70b, and leg bottom 70c provided on the movable unit 70.

[0024] Fig. 4 is a diagram showing an example of the configuration of the movable unit 70. As shown in Fig. 4, the movable unit 70 includes, for example, a back bottom part 70a, a knee bottom part 70b, a leg bottom part 70c, a back bottom driving unit 71a, a knee bottom driving unit 71b, and a height driving unit 72. For example, each of the back bottom driving unit 71a, the knee bottom driving unit 71b, and the height driving unit 72 includes an actuator.

[0025] Driving the back bottom drive unit 71a moves the back bottom 70a, allowing the angle of the back of the user P on the air mattress device 110 to be changed. Driving the knee bottom drive unit 71b moves the knee bottom 70b and leg bottom 70c, allowing the angle between these bottoms to be changed. This allows the angle of the user's knees to be changed. The angles between each bottom may change in conjunction with each other. Driving the height drive unit 72 allows the height of the movable unit 70 (the distance between the floor surface and the bed surface) to be changed.

[0026] The electric bed 210 includes a control unit 220. The control unit 220 includes a bottom control unit 221 and a height control unit 222. The back bottom drive unit 71a and the knee bottom drive unit 71b are electrically connected to the bottom control unit 221. The operations of the back bottom drive unit 71a and the knee bottom drive unit 71b are controlled based on signals transmitted from the bottom control unit 221. The height drive unit 72 is electrically connected to the height control unit 222. The operation of the height drive unit 72 is controlled based on signals transmitted from the height control unit 222.

[0027] The operation unit 230 is electrically connected to the control unit 220. The operation unit 230 is connected to the control unit 220, for example, by a cable 235 shown in Fig. 2. Furthermore, the control unit 51 of the terminal device 50 is connected to the control unit 220 by wireless communication means. That is, the control unit 51 can control the height and angle of the movable unit 70 via the wireless communication means.

[0028] FIG. 5 is a diagram showing an example of the arrangement of the sleeping posture sensor 260. As shown in FIG. 5, the sleeping posture sensor 260 is arranged on the air mattress 10. The sleeping posture sensor 260 is strip-shaped, and its vertical width along the longitudinal direction of the air mattress 10 is width W11, which covers a portion of the user P. Furthermore, its horizontal width along the lateral direction of the air mattress 10 is width W12, which is the same as the horizontal width of the air mattress 10. Width W11 is, for example, a width that covers the waist region of the user P. Therefore, the sleeping posture sensor 260 is arranged to cover the waist region of the user P and to cover the entire width of the air mattress 10. A thin sheet may be arranged on the sleeping posture sensor 260. Note that the width of the sleeping posture sensor 260 does not have to be the entire width of the air mattress 10, and may be limited to the range within which the user P can move.

[0029] FIG. 6 is a diagram showing an example of the pressure detection area AR2 of the sleeping posture sensor 260. As shown in FIG. 6, the sleeping posture sensor 260 is configured with 24 pressure sensors, with a width W11 of 2 columns and a width W12 of 12 rows, or 2 × 12. Each pressure sensor outputs pressure data indicating the pressure state of the magnitude of the applied pressure. In this way, the sleeping posture sensor 260 is a sensor unit that measures pressure at multiple locations. Note that the width W11 does not have to be 2 columns, but may be 3 or more columns, and the width W12 does not have to be 12 columns, but may be less than 12 columns, or may be 13 or more columns.

[0030] 7 is a diagram showing an example of the connection of the sleeping posture sensor 260. As shown in Fig. 7, the sleeping posture sensor 260 is connected to the receiving unit 227 in the control unit 220. This allows the management unit 228 in the control unit 220 to acquire pressure data output from each pressure sensor of the sleeping posture sensor 260. Furthermore, the sleeping posture detection unit 228a1 included in the management unit 228 can detect the sleeping posture of the user P based on the pressure output from the sleeping posture sensor 260.

[0031] FIG. 8 is a diagram illustrating the process of detecting sleeping posture. As shown in FIG. 8, pressure data detected by 24 pressure sensors included in the detection area AR2 of the sleeping posture sensor 260 is input to the sleeping posture detection unit 228a1 via the receiving unit 227. In this embodiment, the pressure data is acquired as image data that indicates a color corresponding to the pressure. The sleeping posture detection unit 228a1 performs CNN (Convolutional Neural Network) processing on the input image data. By performing CNN processing, it becomes possible to locally extract features. In this embodiment, the CNN processing is performed using three layers: a convolutional layer 271, a pooling layer 272, and a fully connected layer 273. Note that CNN processing is merely an example, and other processing may be performed without using CNN processing. Furthermore, the processing will be described using three layers: the convolutional layer 271, the pooling layer 272, and the fully connected layer 273, but this is not limiting. For example, the convolutional layer and the pooling layer may each be double or triple. The fully connected layer 273 may have two layers, or may have three or more layers.

[0032] The sleeping posture detection unit 228a1 performs convolution processing on multiple image data using the convolution layer 271. The convolution processing is a process of locally extracting features of an image to be identified from multiple image data. Next, the sleeping posture detection unit 228a1 compresses the data using the pooling layer 272. By providing the convolution layer 271 before the pooling layer 272, the pooling layer 272 can receive data that is more likely to have features as input. The sleeping posture detection unit 228a1 uses the fully connected layer 273 to connect the image data from which the feature parts have been extracted after performing convolution and pooling to one node and output a value converted by an activation function. The sleeping posture detection unit 228a1 may perform this fully connected processing using multiple connection layers. In this way, the output result R is output.

[0033] 9 and 10 are diagrams showing examples of the output result R. FIG. 9 is a diagram showing an example of the output result R1 when the user P is determined to be in a lateral position. FIG. 10 is a diagram showing an example of the output result R2 when the user P is determined to be in a supine position. As shown in FIG. 9, the pressure is concentrated in a region P1 where the pressure is the highest, and the pressure gradually decreases in a direction away from the region P1. In other words, the user P is present in a region with high pressure. Therefore, the sleeping posture detection unit 228a1 determines that the user P is in a lateral position. Furthermore, as shown in FIG. 10, the regions P2a and P2b have the second highest pressure, and the areas around the regions P2a and P2b have the third highest pressure. In this way, the pressure distribution is similar in the width direction with P2 in the regions P2a and P2b as the center. Therefore, the sleeping posture detection unit 228a1 determines that the user P is in a supine position.

[0034] In this way, the sleeping posture detection unit 228a1 of the sleeping posture sensor 260 can detect the sleeping posture of the user P. Furthermore, the sleeping posture sensor 260 only needs to be large enough to cover the lower back, which is a part of the user P, and therefore the cost of the configuration for detecting the sleeping posture can be reduced.

[0035] (1.3. Screen example) 11 to 16, the screens displayed on the display 53 of the terminal device 50 will be described. Note that the screens shown below are examples, and the terminal device 50 may display only a portion of the screens shown below on the display 53. Furthermore, the terminal device 50 may display at least a portion of the screens shown below on an output device other than the display 53.

[0036] 11 is an example of a sleep information display screen 510. The sleep information display screen 510 has a sleep time display area 510a, a sleep cycle display area 510b, and a sleep quality display area 510c. The sleep time display area 510a displays information related to the user's sleep time detected by the sleep sensor 310. In the example shown in FIG. 11, the sleep time display area 510a displays the bedtime (i.e., the time from when the user goes to bed to when they wake up), the sleep time (i.e., the time from when the user goes to sleep to when they wake up), and the sleep efficiency (i.e., the sleep time / time in bed).

[0037] Sleep cycle display area 510b displays information about the sleep cycle of user P detected by sleep sensor 310. Human sleep involves sleep cycles in which light sleep and deep sleep states alternate. Sleep sensor 310 detects the sleep cycle from the body movements of user P. Control unit 51 displays the sleep cycle detected by sleep sensor 310 in sleep cycle display area 510b. Note that if sleep sensor 310 acquires biometric information of the user, sleep sensor 310 may detect the sleep cycle based on body temperature, pulse rate, and the like acquired from the user.

[0038] Sleep quality display area 510c displays information about the user's sleep quality detected by sleep sensor 310. Sleep quality includes information about, for example, sleep duration, bedtime, sleep cycles, number of awakenings, etc. Control unit 51 obtains the sleep quality based on the sleep-related information detected by sleep sensor 310 and displays it in sleep quality display area 510c.

[0039] FIG. 12 is an example of a sleeping posture information display screen 520 that displays the user's sleeping posture as detailed sleep information. The sleeping posture information display screen 520 has a sleeping posture time display area 520a. The sleeping posture time display area 520a displays the sleeping posture of the user P during sleep and the time spent in that sleeping posture. In the example shown in FIG. 12, the sleeping posture time display area 520a displays that the time spent in the lateral position with the right side down was 4.0 hours, the time spent in the supine position was 2.0 hours, and the time spent in the lateral position with the left side down was 1.5 hours. As described above, the sleeping posture of the user P during sleep is detected by the sleeping posture sensor 260. The control unit 51 displays information related to the sleeping posture detected by the sleeping posture sensor 260 in the sleeping posture time display area 520a.

[0040] FIG. 13 is an example of a face state display screen 530 showing the user's facial state while sleeping as detailed sleep information. The face state display screen 530 has a face state display area 530a and a face effect display area 530b. The face state display area 530a displays the user's facial state while sleeping. The face effect display area 530b displays the degree of effect on the user's facial skin based on the facial state. The control unit 51 estimates the degree of effect on the facial skin from information related to the sleeping posture detected by the sleeping posture sensor 260. As an example, in the example shown in FIG. 13, the effect on the facial skin, friction, pressure, and degree of stuffiness are estimated.

[0041] In estimating the degree of effect on the facial skin, the control unit 51 may further consider other information in addition to the information about the sleeping posture detected by the sleeping posture sensor 260. Examples of other information include, but are not limited to, the temperature and humidity of the bedroom, the user's weight (and the weight of the head estimated from the weight), and the surface material of the air pillow 14. The control unit 51 may also estimate the degree of effect on the facial skin during the user's sleep by further considering the results of the diagnosis by the skin diagnosis device 410.

[0042] FIG. 14 shows an example of a sleep evaluation display screen 540 in which an evaluation is performed based on sleep information. The sleep evaluation display screen 540 has an evaluation result display area 540a, an evaluation item display area 540b, and a graph display icon 540c. The evaluation result display area 540a displays the evaluation result of sleep based on the user's sleep information. In the example shown in FIG. 14, the control unit 51 evaluates the user's sleep qualitatively (for example, on a three-level scale from A to C) and displays the evaluation result as a "beautiful skin sleep score" in the evaluation result display area 540a. The control unit 51 may also evaluate the evaluation result of the effect on the skin quantitatively (for example, on a scale of 100 points).

[0043] The evaluation item display area 540b displays information about the evaluation items used to evaluate sleep. In the example shown in Fig. 14, the evaluation item display area 540b displays the evaluation results for each of the evaluation items: "sleep duration," "bedtime," "sleeping posture," and "sleep cycle."

[0044] When evaluating sleep, the control unit 51 may first perform an evaluation for each evaluation item. That is, it may determine whether or not a predetermined threshold is exceeded for each evaluation item, and calculate an evaluation value for the evaluation item. Then, it may derive a sleep evaluation result by tallying up the evaluation values ​​for each evaluation item.

[0045] When user P presses graph display icon 540c, the sleep evaluation results are displayed in a graph. As an example, the graph display may be a time series transition of the sleep evaluation results (i.e., the "beautiful skin sleep score" in FIG. 14), or a ladder chart showing evaluation values ​​of multiple evaluation items for the sleep evaluation results on a specific day.

[0046] FIG. 15 is an example of a skin effect display screen 550 showing the effects on the skin based on the sleep evaluation results. The skin effect display screen 550 has a skin effect detail area 550a. The skin effect detail area 550a displays details of the effects on the skin estimated based on the sleep evaluation results. The control unit 51 estimates the effects on the skin based on the sleep evaluation results. As an example, the memory unit 52 may store a skin effect list that associates a "skin-beautifying sleep score" as the sleep evaluation result with information related to the effects on the skin, and the control unit 51 may compare the "skin-beautifying sleep score" as the evaluation result with the skin effect list to estimate the effects on the skin of the user's sleep.

[0047] Furthermore, in the skin effect list, information regarding the effect on the skin may be associated in more detail with the evaluation results of the evaluation items (for example, "sleep time," "bedtime," "sleeping posture," and "sleep cycle") that are the basis for calculating the "beautiful skin sleep score." This allows for more precise association of the effect on the skin with the evaluation value of the evaluation item.

[0048] Furthermore, the storage unit 52 may store a skin diagnosis list that associates information about effects on the skin with information about problems that may occur in the user's skin, and the control unit 51 may compare the information about the estimated effects on the user's skin with the skin diagnosis list, estimate problems that may occur in the user's skin, and present them to the user. In this way, it is possible to make the user aware of skin problems and encourage them to develop sleeping habits that are appropriate for their skin condition.

[0049] FIG. 16 shows an example of a recommended information display screen 560 for improving skin condition based on sleep information. The recommended information display screen 560 has a recommended product display area 560a and a purchase page icon 560b. The recommended product display area 560a displays information about recommended products (e.g., cosmetics) recommended to alleviate the estimated impact on the skin. The control unit 51 selects recommended products based on the estimated impact on the skin. As an example, the memory unit 52 may store a recommended product list that associates the estimated impact on the skin with information about recommended products, and the control unit 51 may compare the estimated impact on the skin with the recommended product list and select recommended products to present to the user.

[0050] When user P presses purchase page icon 560b, a screen for purchasing the recommended product displayed in recommended product display area 560a is displayed. This screen may be a homepage screen where the recommended product is sold as an electronic commerce transaction (for example, online sales, etc.). As an example, the recommended product list stored in memory unit 52 may store the URL of the sales homepage for each product, and control unit 51 may refer to the recommended product list and display the sales homepage for that product.

[0051] (1.4. Processing flow) The processing flow of the skin effect estimation system 1 will be described with reference to FIG. 17. In step S100, the control unit 51 acquires sleep information detected by the sleep sensor 310. The control unit 51 may acquire sleep information for each sleep session of the user each day. As an example, the terminal device 50 receives an operation indicating when the user starts to sleep. The sleep sensor 310 receives an instruction to detect sleep information from the terminal device 50 and starts detecting sleep information. The sleep sensor 310 may be configured to transmit the detected sleep information to the terminal device 50 when it detects the end of sleep (i.e., awakening and / or getting up) of the user.

[0052] In step S200, the control unit 51 evaluates the user's sleep based on the acquired sleep information. As an example, the control unit 51 evaluates the sleep based on evaluation values ​​of evaluation items such as sleep duration, time, sleep cycle, and number of awakenings in the sleep information.

[0053] In step S300, the control unit 51 estimates the effect on the skin. As an example, the control unit 51 may refer to a skin effect list that associates the sleep evaluation results stored in the storage unit 52 with information on the effect on the skin, and estimate the effect on the skin due to the user's sleep.

[0054] In step S400, the control unit 51 estimates a problem that may occur in the user's skin. As an example, the control unit 51 may estimate a problem that may occur in the user's skin by referring to a skin diagnosis list that associates information about effects on the skin stored in the storage unit 52 with information about problems that may occur in the user's skin.

[0055] In step S500, the control unit 51 presents to the user a method for improving the skin condition based on the estimated effect. As an example, the control unit 51 presents information about cosmetics for alleviating the estimated effect on the skin.

[0056] In step S600, the control unit 51 adjusts the bedding. The control unit 51 controls the movable unit 70 or the air mattress 10 to adjust at least one of the height and hardness of the electric bed 210 based on the estimated effect on the skin. As an example, when the estimated effect on the skin exceeds a predetermined standard, the control unit 51 may adjust at least one of the height of the movable unit 70 and the hardness of the air mattress 10 to reduce the effect on the skin.

[0057] (1.5. Hardware Configuration) The hardware configuration of an information processing device used in the terminal device 50 will be described with reference to Fig. 18. The terminal device 50 as an information processing device is realized, for example, by a computer 90 shown in Fig. 18. The computer 90 includes a CPU 91, a ROM 92, a RAM 93, a storage 94, an input interface 95, an output interface 96, and a communication interface 97.

[0058] The CPU 91 functions as a processor that executes processing. Specifically, the CPU 91 uses the RAM 93 as a work memory and executes a program stored in at least one of the ROM 92 and the storage 94. During program execution, the CPU 91 controls each component via a system bus 98 and executes various processes.

[0059] The ROM 92 stores a program that controls the operation of the computer 90. The ROM 92 stores a program necessary for causing the computer 90 to perform each of the above-described processes. The RAM 93 functions as a storage area in which the programs stored in the ROM 92 are expanded.

[0060] The storage 94 stores data necessary for executing the programs and data obtained by executing the programs. The storage 94 includes one or more selected from a hard disk drive (HDD) and a solid state drive (SSD).

[0061] The input interface (I / F) 95 can connect the computer 90 to an input device 95a. The input interface 95 is, for example, a serial bus interface such as USB. The CPU 91 can read various data from the input device 95a via the input interface 95.

[0062] The output interface (I / F) 96 can connect the computer 90 and an output device 96a. The output interface 96 is, for example, a video output interface such as a Digital Visual Interface (DVI) or a High-Definition Multimedia Interface (HDMI (registered trademark)). The CPU 91 can transmit data to the output device 96a via the output interface 96 and cause the output device 96a to output the data.

[0063] The input device 95a includes one or more selected from a mouse, a keyboard, a microphone (voice input), and a touchpad. The output device 96a includes one or more selected from a display, a projector, a printer, and a speaker. A device having the functions of both the input device 95a and the output device 96a, such as a touch panel, may also be used.

[0064] The communication interface (I / F) 97 can connect the computer 90 to an external server 97a located outside the computer 90. The communication interface 97 is, for example, a network card such as a LAN card. The CPU 91 can read various data from the external server 97a via the communication interface 97.

[0065] Each process executed by the terminal device 50 may be realized by one computer 90 or by a plurality of computers 90 working together.

[0066] The various data processing operations described above may be recorded as a computer-executable program on a magnetic disk (such as a flexible disk or hard disk), an optical disk (such as a CD-ROM, CD-R, CD-RW, DVD-ROM, DVD±R, or DVD±RW), a semiconductor memory, or other non-transitory computer-readable storage medium.

[0067] For example, information recorded on a recording medium can be read by a computer (or an embedded system). The recording medium may have any recording format (storage format). For example, the computer reads a program from the recording medium and causes a processor to execute instructions written in the program based on the program. The computer may acquire (or read) the program via a network.

[0068] (1.6.Summary) As described above, the skin effect estimation system 1 according to this embodiment includes a sleep sensor 310 that detects sleep information, which is information related to the user's sleep, and a control unit 51. The control unit 51 estimates the effect of the user's sleep on the skin based on the sleep information detected by the sleep sensor 310. This configuration makes it possible to visualize the effect of sleep on the skin, and to clarify how the user should review their sleeping habits in order to improve their skin condition. It also makes it possible to take measures necessary to improve their skin condition.

[0069] Furthermore, sleep sensor 310 may be a vibration sensor attached to electric bed 210 as bedding. Sleep sensor 310 detects at least one of the user's sleep time and sleep quality based on the vibration of the bedding. Control unit 51 estimates the effect of the user's sleep on the skin based on at least one of the user's sleep time and sleep quality. With this specification, it is possible to obtain the user's sleep information using a known vibration sensor and estimate the effect of the user's sleep on the skin.

[0070] The sleep sensor 310 may also be a posture detection sensor attached to the user. This allows the user's sleeping posture to be detected, allowing for more precise estimation of the effects of sleep on the user's skin.

[0071] Furthermore, the control unit 51 may present to the user a method for improving the skin condition based on the estimated effect. As an example, the control unit 51 may present information about cosmetics for alleviating the estimated effect as a method for improving the skin condition. By adopting such specifications, the user can learn specific methods for improving the skin condition.

[0072] Furthermore, the electric bed 210 as bedding includes a movable part 70 and a pump unit 12 as a drive mechanism for adjusting at least one of the height and hardness, and the control unit 51 may adjust at least one of the height and hardness of the electric bed 210 based on the estimated effect. As an example, when the estimated effect of sleep on the skin exceeds a predetermined standard, the control unit 51 may control the drive mechanism to adjust at least one of the height and hardness of the electric bed 210. With such specifications, it is possible to provide an appropriate sleeping environment taking into consideration the effect of sleep on the user's skin.

[0073] Furthermore, the skin effect estimation system 1 may further include a skin diagnostic device 410 that diagnoses the skin condition, and the control unit 51 may estimate the effect of the user's sleep on the skin by further considering the results of the diagnosis by the skin diagnostic device 410. By adopting such specifications, not only the sleep information but also the current skin condition is taken into consideration, allowing for a more precise estimation of the effect of the user's sleep on the skin.

[0074] Furthermore, the storage unit 52 included in the skin effect estimation system 1 may store a skin diagnosis list that associates information about effects on the skin with information about problems that may occur on the user's skin, and the control unit 51 may compare the information about the estimated effects on the user's skin with the skin diagnosis list and present skin problems that may occur on the user's skin. This configuration can make the user aware of skin problems and encourage them to develop sleeping habits that are appropriate for their skin condition.

[0075] <2. Other embodiments> The skin effect estimation system 1 according to the present embodiment has been described above, but application of the technical concept of the present disclosure is not limited to the above embodiment. For example, in the above embodiment, a vibration sensor that detects vibrations of the electric bed 210 is used as the sleep sensor 310, but the present disclosure is not limited to this example. For example, the sleep sensor 310 may be a pressure distribution sensor attached to the electric bed. That is, the pressure distribution sensor may be configured to detect both the user's sleep information and sleeping posture. In this case, the control unit 51 may estimate the effect of the user's sleep on the skin based on at least one of the user's sleeping posture, sleeping time, and sleep quality acquired from the sleep sensor.

[0076] In the above embodiment, the influence on the skin of the face is shown as an example (see, for example, FIG. 13), but the degree of influence on the skin of other parts affected by sleeping posture may also be estimated, such as the neck, chest, shoulders, etc. Furthermore, the subject of estimation is not limited to the skin, and in cases where the influence of sleeping posture is known, such as when the scalp and hair at the back of the head are damaged when sleeping on one's back for a long period of time, the influence on the scalp and hair may be estimated based on information from the sleep sensor.

[0077] Furthermore, in the above embodiment, the skin effect estimation system 1 has been described as including both the terminal device 50 and the sleep sensor 310, but the present invention is not limited to this example. For example, a wearable device such as a smart watch or smart ring may be used as the terminal device 50, and the terminal device 50 may be configured to have the function of the sleep sensor 310. In this case, since the terminal device 50 is worn on the user's body as a wearable device, it may be configured to acquire biological information such as the user's body temperature and pulse rate while sleeping as sleep information.

[0078] In the above embodiment, the control unit 51 presents information about cosmetics for reducing the effects of sleep on the skin as a method for improving the skin condition, but the present invention is not limited to this example. For example, the control unit 51 may present information other than cosmetics, such as information about bedding for reducing the effects of sleep on the skin, information about massage devices, information about massage methods, information about areas that require focused care and care methods, and information about supplements, as a method for improving the skin condition.

[0079] In the above embodiment, the sleeping posture sensor 260 is arranged in a position that covers the waist area of ​​the user P, but this is not limiting. For example, it may be arranged to cover the shoulder area of ​​the user P. Furthermore, two sleeping posture sensors 260 may be prepared, with one arranged to cover the waist area of ​​the user P and the other to cover the shoulder area of ​​the user P. Furthermore, the two sleeping posture sensors 260 may be divided into one for the upper body and one for the lower body of the user P. By detecting the sleeping posture using the two output results R acquired from the two sleeping posture sensors 260 in this way, the sleeping posture detection unit 228a1 can detect the sleeping posture of the user P more accurately.

[0080] In the above embodiment, the sleeping posture sensor 260 is used to detect the user's sleeping posture, but this is not limiting. For example, instead of (or in addition to) the sleeping posture sensor 260, an infrared sensor 250 may be used to detect the temperature of the user's face area and determine the user's sleeping posture. Also, a photographing device such as a camera that photographs the user P may be provided. In this case, the sleeping posture detection unit 228a1 detects the posture of the user P based on an image photographed by the photographing device. Also, for example, a depth sensor may be provided. In this case, the sleeping posture detection unit 228a1 detects the posture of the user P based on a depth image photographed by the depth sensor.

[0081] Furthermore, in the above embodiment, the sleeping posture sensor 260 detects the sleeping posture of the user P by detecting pressure at multiple locations, but this is not limited to this. For example, a sensor unit that measures temperatures at multiple locations may be used instead of the sleeping posture sensor 260. The sensor unit may acquire temperature information from each of the divided regions obtained by dividing an area including the lower back and / or shoulders of the user P according to multiple locations, and the sleeping posture detection unit 228a1 may determine the sleeping posture of the user P based on the temperature information for each of the divided regions. Even with this configuration, it is possible to detect the sleeping posture of the user P.

[0082] Furthermore, in the above embodiment, an example in which the processes of steps S100 to S600 are performed is shown, but the present invention is not limited to this. That is, some of the processes of steps S100 to S600 may not be performed. For example, at least one of the process of estimating possible skin defects in step S400, the process of presenting improvement methods in step S500, and the process of adjusting bedding in step S600 may not be performed.

[0083] The disclosure may include the following features. (Appendix 1) a sleep sensor that detects sleep information that is information related to the user's sleep; a control unit, The control unit estimates the effect of the user's sleep on the skin based on the sleep information detected by the sleep sensor. (Appendix 2) the sleep sensor is a vibration sensor attached to bedding, the sleep sensor detects at least one of the user's sleep time and sleep quality based on the vibration of the bedding; The skin effect estimation system according to claim 1, wherein the control unit estimates the effect of the user's sleep on the skin based on at least one of the user's sleep time and sleep quality. (Appendix 3) The sleep sensor further detects the sleeping posture of the user, The skin effect estimation system according to claim 2, wherein the control unit estimates the effect of the user's sleep on the skin based on at least one of the user's sleeping posture, sleeping time, and sleep quality. (Appendix 4) 4. The skin effect estimation system according to claim 2, wherein the sleep sensor is a pressure distribution sensor attached to bedding. (Appendix 5) 4. The skin effect estimation system according to claim 2, wherein the sleep sensor is a posture detection sensor attached to the user. (Appendix 6) The control unit, based on the estimated influence, 2. The skin effect estimation system according to claim 1, which presents the user with methods for improving their skin condition. (Appendix 7) The skin effect estimation system according to claim 6, wherein the control unit presents information about cosmetics for mitigating the effect as the method. (Appendix 8) The bedding includes a drive mechanism that adjusts at least one of the height and hardness of the bedding, The skin effect estimation system described in Appendix 2 or 3, wherein the control unit controls the drive mechanism to adjust at least one of the height and hardness of the bedding based on the estimated effect. (Appendix 9) Further provided is a diagnostic device for diagnosing a skin condition, The skin effect estimation system according to claim 1, wherein the control unit estimates the effect of sleep on the user's skin by further taking into consideration the results of the diagnosis by the diagnostic device. (Appendix 10) Further comprising a storage unit, the storage unit stores a skin diagnosis list in which information regarding the effect on the skin and information regarding problems that may occur on the user's skin are associated with each other; The control unit compares information about the estimated impact on the user's skin with the skin diagnosis list and identifies skin defects that are estimated to occur to the user. (Appendix 11) receiving sleep information that is information about the user's sleep detected by the sleep sensor; An information processing device comprising: a control unit that estimates an effect of sleep on the user's skin based on the received sleep information. (Appendix 12) Detecting sleep information that is information related to the sleep of a user; A method for estimating a skin effect, comprising estimating an effect on the skin due to the user's sleep based on detected sleep information.

[0084] Although several embodiments of the present disclosure have been illustrated above, these embodiments are presented by way of example only and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, etc. can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention and its equivalents as set forth in the claims. Furthermore, the above-described embodiments can be implemented in combination with each other. [Explanation of symbols]

[0085] 1: Skin effect estimation system, 10: Air mattress, 11: Air cell, 12: Pump unit, 13: Cover, 14: Air pillow, 20: Terminal device, 30: Operation panel, 35: Cable, 50: Terminal device, 51: Control unit, 52: Memory unit, 53: Display, 70: Movable unit, 72: Height drive unit, 90: Computer, 91: CPU, 92: ROM, 93: RAM, 94: Storage, 95: Input interface, 96: Output interface, 97: Communication interface, 98: System bus, 110: Air mattress device, 2 10: Electric bed, 220: Control unit, 221: Bottom control unit, 222: Height control unit, 227: Receiving unit, 228: Management unit, 230: Operation unit, 235: Cable, 240: Headboard, 250: Infrared sensor, 260: Sleeping posture sensor, 271: Convolution layer, 272: Pooling layer, 273: Fully connected layer, 310: Sleep sensor, 410: Skin diagnosis device, 510: Sleep information display screen, 520: Sleeping posture information display screen, 530: Face condition display screen, 540: Sleep evaluation display screen, 550: Skin effect display screen, 560: Recommendation information display screen.

Claims

1. a sleep sensor that detects sleep information that is information related to the user's sleep; a control unit, The control unit estimates the effect of the user's sleep on the skin based on the sleep information detected by the sleep sensor.

2. the sleep sensor is a vibration sensor attached to bedding, the sleep sensor detects at least one of the user's sleep time and sleep quality based on the vibration of the bedding; The skin effect estimating system according to claim 1 , wherein the control unit estimates the effect on the skin of the user due to sleep on the basis of at least one of the user's sleep duration and sleep quality.

3. The sleep sensor further detects the sleeping posture of the user, The skin effect estimation system according to claim 2 , wherein the control unit estimates the effect of sleep on the user's skin based on at least one of the user's sleeping posture, sleeping time, and sleep quality.

4. The skin effect estimation system according to claim 2 or 3, wherein the sleep sensor is a pressure distribution sensor attached to bedding.

5. The skin effect estimation system according to claim 2 or 3, wherein the sleep sensor is a posture detection sensor attached to the user.

6. The control unit, based on the estimated influence, The skin effect estimation system according to claim 1 , wherein a method for improving the skin condition is presented to the user.

7. The skin effect estimation system according to claim 6 , wherein the control unit presents, as the method, information about cosmetics for alleviating the effect.

8. The bedding includes a drive mechanism that adjusts at least one of the height and hardness of the bedding, The skin effect estimation system according to claim 2 or 3, wherein the control unit controls the drive mechanism to adjust at least one of the height and hardness of the bedding based on the estimated effect.

9. Further provided is a diagnostic device for diagnosing a skin condition, The skin effect estimating system according to claim 1 , wherein the control unit estimates the effect of sleep on the user's skin by further taking into consideration the result of the diagnosis by the diagnostic device.

10. Further comprising a storage unit, the storage unit stores a skin diagnosis list in which information regarding the effect on the skin and information regarding problems that may occur on the user's skin are associated with each other; The skin effect estimation system according to claim 1 , wherein the control unit compares information about the estimated effect on the user's skin with the skin diagnosis list and identifies skin problems that are estimated to occur to the user.

11. receiving sleep information that is information about the user's sleep detected by the sleep sensor; An information processing device comprising: a control unit that estimates an effect of sleep on the user's skin based on the received sleep information.

12. Detecting sleep information that is information related to the sleep of a user; A method for estimating a skin effect, comprising estimating an effect on the skin due to the user's sleep based on detected sleep information.

Images