Information processing device

Abstract

To provide an information processing device that can compare a skin condition at timings desired by a user and inform the user of beauty-related information based on the comparison results.SOLUTION: An information processing device comprises an image selection unit 353, a skin image acquisition unit 354, a color information acquisition unit 355, and a beauty information notification unit 358. The image selection unit 353 allows a user to select a plurality of images captured at different times by imaging means 33. The skin image acquisition unit 354 acquires skin images for comparing a skin color from each image selected by the image selection unit 353. The color information acquisition unit 355 compares the skin color of each skin image acquired by the skin image acquisition unit 354 with a color chart containing an array of color samples to acquire color information of a corresponding skin color. The beauty information notification unit 358 informs the user of beauty-related information based on each color information acquired by the color information acquisition unit 355.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing device that acquires information about a user's skin and provides the user with information about beauty based on the acquired information. [Background technology]

[0002] Conventionally, information processing devices are known that acquire information about a user's skin and provide the user with beauty information based on the acquired information. For example, the skin information collection and utilization system described in Patent Document 1 is composed of a smartphone and a server device, and measures skin color and skin temperature using an image sensor, a sensor, etc. to detect temporary changes from the skin's normal state. Based on the skin measurement results and UV protection information acquired through user input, including the use of UV-blocking agents, the system estimates the degree of UV exposure of the skin. Furthermore, the skin information collection and utilization system described in Patent Document 1 recommends cosmetics such as lotions to mitigate the effects of sunburn, suggests cosmetics appropriate for the amount of UV rays and the sunburned area, and suggests cosmetics based on data on time-series changes in the skin. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-141203 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the invention described in Patent Document 1, the skin information collection and utilization system detects temporary changes in the skin's normal condition, which poses a problem in that it is not possible to compare the skin condition at a point in time desired by the user. Patent Document 1 discloses a method for capturing skin image data, processing the data, and comparing the skin color with past skin colors to identify the skin color. However, Patent Document 1 does not disclose a specific method for detecting temporary changes from the normal state.

[0005] An object of the present invention is to provide an information processing device that can compare the skin condition at a time point desired by the user and notify the user of beauty-related information based on the comparison results. [Means for solving the problem]

[0006] The information processing device of the present invention is an information processing device comprising an imaging means for capturing images, an input means for accepting operational input from a user, and a control means for controlling the imaging means and the input means, wherein the control means comprises a memory unit for storing information relating to a color chart in which color samples are arranged, an image selection unit for allowing the user to select multiple images captured by the imaging means at different capture times based on operational input from the input means, a skin image acquisition unit for acquiring skin images for comparing skin color from each image selected by the image selection unit, a color information acquisition unit for comparing the skin color of each skin image acquired by the skin image acquisition unit with the color chart stored in the memory unit to acquire color information of the corresponding skin color, and a beauty information notification unit for notifying the user of beauty-related information based on each color information acquired by the color information acquisition unit.

[0007] According to this configuration, the information processing device includes an image selection unit that allows a user to select from multiple images captured by the imaging device at different capture times, and a skin image acquisition unit that acquires skin images for comparing skin colors from each image selected by the image selection unit. By comparing the skin colors of each skin image acquired by the skin image acquisition unit, the user can compare their skin condition at a desired time. The information processing device also includes a color information acquisition unit that compares the skin color of each skin image acquired by the skin image acquisition unit with a color chart stored in the memory unit to acquire color information for the corresponding skin color, and a beauty information notification unit that notifies the user of beauty information based on the color information acquired by the color information acquisition unit. Therefore, the information processing device can notify the user of beauty information based on the comparison results of the skin colors of each skin image. Furthermore, since a color chart is used when comparing the skin colors of each skin image, skin colors can be easily compared using the color chart as a reference.

[0008] In the present invention, it is preferable that the control means includes an image management unit that manages multiple images captured by the imaging means at different imaging times by date, and the image selection unit selects multiple images to be managed by the image management unit by having the user select a date based on operational input from the input means.

[0009] According to this configuration, the image selection unit selects multiple images managed by the image management unit by having the user select a date based on operational input from the input means, so that the user can compare the skin condition at the time of the user's choice, for example, by selecting a date by referring to a calendar.

[0010] In the present invention, it is preferable that the skin image acquisition section acquires the skin image by having the user select a predetermined area from each image selected by the image selection section.

[0011] With this configuration, the skin image acquisition unit acquires skin images by having the user select a predetermined area from each image selected by the image selection unit, so that the user can, for example, select an area where changes in skin color are of concern and compare the skin conditions. Also, the user can select different areas, such as the cheek and nose, and compare the skin conditions.

[0012] In the present invention, the control means preferably includes a regional information receiving unit that receives input of regional information regarding a region specified by the user based on operational input from the input means, and a weather information acquisition unit that acquires meteorological information regarding at least one of weather and humidity based on the regional information received by the regional information receiving unit, and the beauty information notification unit preferably notifies the user of beauty-related information based on the weather information acquired by the weather information acquisition unit.

[0013] According to this configuration, the weather information acquisition unit acquires weather information relating to at least one of the weather and humidity based on regional information relating to the region specified by the user, and the beauty information notification unit notifies the user of beauty-related information based on the weather information acquired by the weather information acquisition unit. This allows the user to know beauty-related information such as the weather and humidity in the desired region, and to take effective preventative measures such as applying sunscreen.

[0014] In the present invention, it is preferable that the information processing device is provided with a pedometer that measures the number of steps taken by a user carrying the information processing device, the control means is provided with a step count acquisition unit that acquires the number of steps taken by the user measured by the pedometer, and the beauty information notification unit notifies the user of beauty-related information based on the number of steps taken by the user acquired by the step count acquisition unit.

[0015] According to this configuration, the beauty information notification unit notifies the user of beauty-related information based on the user's number of steps acquired by the step count acquisition unit, so that the user can estimate the amount of UV rays they have been exposed to when walking outdoors, for example, and can take effective preventative measures such as applying sunscreen. [Brief explanation of the drawings]

[0016] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of an information processing system according to an embodiment of the present invention. [Figure 2] A schematic diagram showing the functions of the management server and the information processing terminal. [Figure 3] FIG. 1 is a diagram showing the initial screen of application software launched on an information processing terminal. [Figure 4] A diagram showing a normal screen of an application launched on an information processing terminal. [Figure 5] A diagram showing a pop-up screen of an application launched on an information processing terminal. [Figure 6] A diagram showing an analysis screen when a facial photo is taken using an application launched on an information processing terminal and the facial photo is analyzed. [Figure 7] A diagram showing the first selection screen for selecting a facial photo for a certain date [Figure 8] A diagram showing the second selection screen for selecting a face photo for another date [Figure 9] FIG. 10 is a diagram showing an area selection screen for selecting a predetermined area for comparing skin color from images captured at different times. [Figure 10] A diagram showing a comparison screen for comparing the skin color of a skin image with a color chart. [Figure 11] FIG. 10 is a diagram showing a result display screen that displays the results of comparing each skin image. DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a schematic configuration of an information processing system according to an embodiment of the present invention. 1, the information processing system 1 includes a management server 2 that manages information and an information processing terminal 3 carried by a user who uses the service. The information processing terminal 3 is, for example, a terminal device such as a mobile phone, a smartphone, or a desktop or tablet personal computer. In this embodiment, the functions of the information processing system 1 will be described assuming that the information processing terminal 3 is a smartphone. The management server 2 and the information processing terminal 3 are connected to each other so as to be able to communicate with each other via the Internet 4, which is a public network serving as a communication line.

[0018] In this embodiment, the information processing device of the present invention is configured as an information processing system 1 having a management server 2, an information processing terminal 3, and the Internet 4, and the functions of the information processing device are implemented separately in the management server 2 and the information processing terminal 3, but it may also be configured so that all functions are implemented in a single server or terminal.

[0019] FIG. 2 is a schematic configuration diagram showing the functions of the management server and the information processing terminal. As shown in FIG. 2, the information processing terminal 3 includes an input means 31 for accepting user operation input, a display means 32 for displaying information, an imaging means 33 for capturing images, a pedometer 34 for counting the number of steps taken by a user carrying the information processing terminal 3, and a terminal-side control means 35 for controlling the information processing terminal 3. The input means 31 and the display means 32 may be configured to have both functions integrated using a touch panel or the like, or the functions may be configured separately by using push buttons or the like as the input means and a liquid crystal panel or the like as the display means.

[0020] The terminal side control means 35 is configured with a CPU (Central Processing Unit), a memory, etc., and executes information processing in accordance with a predetermined program stored in this memory. This terminal side control means 35 includes a memory unit 351, an image management unit 352, an image selection unit 353, a skin image acquisition unit 354, a color information acquisition unit 355, a regional information reception unit 356, a step count acquisition unit 357, and a beauty information notification unit 358.

[0021] The storage unit 351 stores information about a color chart in which color samples are arranged, and other information. The image management unit 352 manages, by date, a plurality of images captured at different image capture times by the imaging means 33. Specifically, the image management unit 352 stores, by date, the images captured by the imaging means 33 in the storage unit 351, thereby managing, by date, a plurality of images captured at different image capture times. The image selection unit 353 allows the user to select multiple images captured by the imaging unit 33 at different imaging times, based on the operational input of the input unit 31. In this embodiment, the image selection unit 353 allows the user to select a date based on the operational input of the input unit 31, thereby selecting multiple images managed by the image management unit 352.

[0022] Skin image acquisition unit 354 acquires skin images for comparing skin colors from each image selected by image selection unit 353. In this embodiment, skin image acquisition unit 354 acquires skin images by having the user select a predetermined area from each image selected by image selection unit 353. The color information acquisition unit 355 compares the skin color of each skin image acquired by the skin image acquisition unit 354 with the color chart stored in the storage unit 351, and acquires color information of the corresponding skin color. The area information receiving unit 356 receives input of area information relating to an area designated by a user based on an operation input from the input means 31. The area information receiving unit 356 also transmits this area information to the management server 2. The step count acquisition unit 357 acquires the number of steps taken by the user measured by the pedometer 34 .

[0023] Beauty information notification unit 358 transmits various pieces of information, such as the color information acquired by color information acquisition unit 355 and the user's step count information acquired by step count acquisition unit 357, to management server 2. Then, based on the various pieces of information transmitted to management server 2, beauty information notification unit 358 receives beauty information transmitted from management server 2, and notifies the user of this beauty information.

[0024] The management server 2 includes a server-side control means 21 that controls the management server 2 . The server-side control means 21 is configured with a CPU (Central Processing Unit), a memory, etc., and executes information processing in accordance with a predetermined program stored in this memory. The server-side control means 21 includes a storage unit 211 , a user information management unit 212 , a weather information acquisition unit 213 , a received information analysis unit 214 , and an analyzed information transmission unit 215 .

[0025] The storage unit 211 stores information about the user of the information processing terminal 3 and other information. The user information management unit 212 manages information about the user of the information processing terminal 3 by storing the information about the user received from the information processing terminal 3 in the storage unit 211. Here, the information about the user of the information processing terminal 3 is, for example, information such as the user's ID (identification) and password, and area information accepted by the area information acceptance unit 356.

[0026] The weather information acquisition unit 213 acquires weather information related to at least one of weather and humidity based on the regional information received by the regional information reception unit 356. In this embodiment, the weather information acquisition unit 213 acquires weather information related to all weather conditions, including weather and humidity, as well as weather information related to UV (UltraViolet) intensity. The weather information acquisition unit 213 also transmits this weather information to the information processing terminal 3. In this embodiment, the weather information acquisition unit 213 acquires weather information relating to all weather conditions, including weather and humidity, but it is sufficient to acquire weather information relating to at least one of weather and humidity.

[0027] The received information analysis unit 214 analyzes each piece of information transmitted from the information processing terminal 3, such as each piece of color information acquired by the color information acquisition unit 355 and information on the number of steps of the user acquired by the step number acquisition unit 357. For example, the received information analysis unit 214 classifies each piece of color information acquired by the color information acquisition unit 355 into five levels: fair skin, yellow skin, flesh-colored skin, tanned skin, and dark skin. When comparing color information based on a past skin image with color information based on a current skin image, if there is a change toward dark skin, it analyzes it as "tanned," and if there is a change toward fair skin or no change, it analyzes it as "not tanned."

[0028] Furthermore, for example, the received information analysis unit 214 analyzes whether the user is in a "condition that makes it easy to get sunburned" or a "condition that makes it difficult to get sunburned" based on the information on the user's number of steps acquired by the step count acquisition unit 357 and the weather information on weather and humidity acquired by the weather information acquisition unit 213. Specifically, the received information analysis unit 214 classifies the weather acquired by the weather information acquisition unit 213 into three levels: sunny, cloudy, and rainy; humidity into three levels: wet, normal humidity, and dry; and UV intensity into three levels: strong, medium, and weak, and analyzes whether the user is in a "condition that makes it easy to get sunburned" or a "condition that makes it difficult to get sunburned" for each combination of weather, humidity, and UV intensity. Furthermore, the received information analysis unit 214 sets an upper limit on the user's number of steps for each combination of weather, humidity, and UV intensity (for example, the upper limit on the number of steps for sunny, dry, and strong UV intensity is lower than the upper limit on the number of steps for rainy, wet, and weak UV intensity). The received information analysis unit 214 then monitors the user's step count acquired by the step count acquisition unit 357, and if the step count exceeds the upper limit, analyzes it as "sunburned," and if the step count does not exceed the upper limit, analyzes it as "not sunburned."

[0029] The analyzed information transmitting unit 215 transmits to the information processing terminal 3 analyzed information (for example, information on whether or not the situation is such that sunburn is likely to occur, and information on the presence or absence of sunburn) that is the result of the analysis by the received information analyzing unit 214. Then, the beauty information notification unit 358 of the information processing terminal 3 notifies the user of beauty-related information based on the analysis information transmitted from the analysis information transmission unit 215. For example, when the beauty information notification unit 358 receives analysis information such as "conditions that make it easy to get sunburned" or "you are sunburned" from the analysis information transmission unit 215, the beauty information notification unit 358 notifies the user of beauty-related information such as "please apply sunscreen." Furthermore, when the beauty information notification unit 358 receives analysis information such as "conditions that make it difficult to get sunburned" or "you are not sunburned" from the analysis information transmission unit 215, the beauty information notification unit 358 notifies the user of beauty-related information such as "it's a good day to go out." The operation of the information processing system 1 will be described below with reference to the drawings.

[0030] FIG. 3 is a diagram showing an initial screen of application software started up on an information processing terminal. A user of the information processing terminal 3 can launch application software (hereinafter referred to as an app) by operating the input means 31, as shown in FIG. 3, and the terminal side control means 35 causes the display means 32 to display an initial screen AP1.

[0031] This initial screen AP1 has an input field AP11 for entering a nickname, email address, and password, a first selection field AP12 for selecting gender and age, a second selection field AP13 for selecting prefecture and city / ward / town / village, an exit button AP14 for closing the app, and a register button AP15 for registering the information entered or selected in the input field AP11, first selection field AP12, and second selection field AP13 in the app.

[0032] By operating the input means 31, the user inputs a nickname, email address, and password into the input field AP11, selects gender and age in the first selection field AP12, and selects prefecture and city / ward / town / village in the second selection field AP13. Thereafter, the user presses the registration button AP15 to register the user in the application. The user can press the exit button AP14 to exit the application without executing user registration.

[0033] When the registration button AP15 is pressed, the terminal control means 35 stores the user information, including the nickname, email address, password, gender, and age, in the storage unit 351 and transmits it to the management server 2. Furthermore, when the registration button AP15 is pressed, the area information receiving unit 356 stores the area information of prefectures and cities, wards, towns and villages in the storage unit 351 and transmits it to the management server 2. Here, the user information management unit 212 of the management server 2 stores the user information and area information received from the information processing terminal 3 in the storage unit 211 , thereby managing information relating to the user of the information processing terminal 3 .

[0034] FIG. 4 is a diagram showing a normal screen of an application started on an information processing terminal. When the user presses the registration button AP15 on the initial screen AP1, or when the user registers and then enters an email address as an ID and a password to launch the app, the terminal-side control means 35 causes the display means 32 to display the normal screen AP2, as shown in FIG. 4. This normal screen AP2 has an information display field AP21 that displays date and area information, a weather information display field AP22 that displays weather information such as weather, temperature, wind speed, humidity, and UV, an alert display field AP23 that displays alerts for the user, a diary field AP24 for entering the user's diary, an entry button AP25 for storing the diary entered in the diary field AP24 in the memory unit 351, and an image capture button AP26 for capturing a photo of the user's face using the imaging means 33 and storing the photo in the memory unit 351.

[0035] The information display field AP21 displays information about the date on which the app was launched on the left side, and area information based on area information stored in the storage unit 351 on the right side. By pressing the calendar button displayed to the right of the date information, it is possible to refer to past records (for example, facial photographs taken in the past). In addition, by pressing the map button displayed to the right of the area information, it is possible to reselect the prefecture and city / ward / town / village.

[0036] The weather information display field AP22 displays the weather information for the day the app is started. Specifically, the weather information display field AP22 displays the weather information for the day the app is started, based on the weather information transmitted from the weather information acquisition unit 213 of the management server 2. In the example of FIG. 4, the weather information acquisition unit 213 acquires weather information such as weather, temperature, wind speed, humidity, and UV.

[0037] Alert display field AP23 displays and notifies the user of beauty-related information. Specifically, beauty information notification unit 358 displays the beauty-related information in alert display field AP23 based on the analysis information transmitted from analysis information transmission unit 215. In the example of FIG. 4, the beauty information notification unit 358 displays the comment "Please apply sunscreen" in the alert display field AP23 to notify the user that the user is in a "situation where sunburn is likely to occur."

[0038] FIG. 5 is a diagram showing a pop-up screen of an application started on an information processing terminal. 5, the user can display a pop-up screen AP3 on the display means 32 by pressing the (continued) area displayed on the right side of the alert display field AP23. Furthermore, the beauty information notification unit 358 automatically displays the pop-up screen AP3 on the display means 32 when the app is started, when the UV intensity or humidity changes to strong or dry, or when the number of steps taken by the user acquired by the step count acquisition unit 357 exceeds the upper limit.

[0039] The pop-up screen AP3 includes an end button AP31 for closing the pop-up screen AP, a UV intensity display field AP32 for informing the user of the UV intensity level, a humidity display field AP33 for informing the user of the humidity level, a step count status display field AP34 for informing the user whether the number of steps of the user acquired by the step count acquisition unit 357 has exceeded the upper limit, and a general display field AP35 for informing the user of comprehensive beauty information.

[0040] The UV intensity display field AP32 notifies the user of three levels of information (very strong (strong), medium (medium), and very weak (weak)) according to the level of UV intensity acquired by the weather information acquisition unit 213. The humidity display field AP33 notifies the user of three levels of information (very low (dry), medium (normal humidity), and very high (wet)) according to the humidity level acquired by the weather information acquisition unit 213. The step count status display field AP34 notifies the user of the analysis information "sunburned" when the user's step count acquired by the step count acquisition unit 357 exceeds the upper limit, and notifies the user of the analysis information "not sunburned" when the number of steps acquired does not exceed the upper limit.

[0041] The general display field AP35 notifies the user of general beauty-related information such as "Please apply sunscreen" or "It's a good day to go out." Specifically, when the beauty information notification unit 358 receives analysis information such as "conditions that make it easy to get sunburned" or "you are sunburned" from the analysis information transmission unit 215, it notifies the user of beauty-related information such as "Please apply sunscreen." Furthermore, when the beauty information notification unit 358 receives analysis information such as "conditions that make it difficult to get sunburned" or "you are not sunburned" from the analysis information transmission unit 215, it notifies the user of beauty-related information such as "It's a good day to go out."

[0042] FIG. 6 is a diagram showing an analysis screen when a facial photograph is taken by an application started on an information processing terminal and analysis of the facial photograph is executed. By pressing the image capture button AP26 on the normal screen AP2 described above, the user can have the image capture means 33 capture a facial photo of the user and store it in the storage unit 351, and can also execute an analysis of the facial photo using the app. When the analysis of the facial photo is executed, the terminal-side control means 35 displays an analysis screen AP4 on the display means 32, as shown in FIG.

[0043] The analysis screen AP4 includes a facial photo display field AP41 that displays a facial photo of the user captured by the imaging means 33, a skin condition display field AP42 that displays the skin condition analyzed by the terminal control means 35, and a comparison button AP43 for comparing the skin conditions of multiple facial photos. The skin condition display field AP42 displays the skin condition such as blemishes, wrinkles, dark circles, acne, skin age, skin type, skin index, etc. Specifically, the terminal control means 35 performs image analysis of the skin condition such as blemishes, wrinkles, dark circles, acne, skin age, skin type, skin index, etc. based on the face photo of the user captured by the imaging means 33, and displays the results in the skin condition display field AP42. Here, when a photograph of the user's face is taken by the imaging means 33, the image management unit 352 stores the images taken by the imaging means 33 in the memory unit 351 by date, thereby managing multiple images taken at different times by date.

[0044] Furthermore, by pressing the comparison button AP43, the user can compare a facial photograph taken on a certain date with a facial photograph taken on another date, based on a plurality of images managed by the image management unit 352.

[0045] FIG. 7 shows a first selection screen for selecting a facial photograph on a certain date. When the comparison button AP43 is pressed on the analysis screen AP4, the terminal control means 35 causes the display means 32 to display a first selection screen AP5, as shown in FIG. The first selection screen AP5 includes a first calendar display field AP51 that allows the user to select a date, and a first confirmation button AP52 that allows the user to confirm the date selected by the user. The user can select a desired date from the first calendar display field AP51 (the circle on the 28th in the figure) and press the first confirmation button AP52 to select a facial photograph for a certain date. In this way, the image selection unit 353 allows the user to select an image captured by the imaging means 33 at a first imaging time based on an operational input from the input means 31.

[0046] FIG. 8 shows a second selection screen for selecting a facial photograph taken on another date. When the first confirm button AP52 is pressed on the first selection screen AP5, the terminal control means 35 causes the display means 32 to display a second selection screen AP6, as shown in FIG. The second selection screen AP6 has a second calendar display field AP61 that allows the user to select a date, and a second confirmation button AP62 that allows the user to confirm the date selected by the user. Here, the second calendar display field AP61 shows the date selected on the first selection screen AP5 as already selected (the circle mark on the 28th in the figure). The user can select a desired date from the second calendar display field AP61 (the circle on the 30th in the figure) and select a facial photograph for another date by pressing the second confirm button AP62. In this way, the image selection unit 353 allows the user to select an image captured by the imaging means 33 at the second imaging time, based on the operational input of the input means 31. Therefore, the image selection unit 353 selects a plurality of images managed by the image management unit 352 by having the user select a date based on the operation input of the input means 31 .

[0047] FIG. 9 shows an area selection screen for selecting a predetermined area for comparing skin colors from images captured at different times. When the second confirm button AP62 is pressed on the second selection screen AP6, the terminal control means 35 causes the display means 32 to display an area selection screen AP7, as shown in FIG. The area selection screen AP7 includes a first image display field AP71 that allows the user to select a specific area from the image captured at the first imaging time, a second image display field AP72 that allows the user to select a specific area from the image captured at the second imaging time, and a confirmation button AP73 that confirms the specific area selected by the user.

[0048] The first image display field AP71 displays the image captured at the first capture time and also displays a square marker. The user can select a first area from the image captured at the first capture time by dragging and dropping the marker. The second image display field AP72 displays the image captured at the second capture time and also displays a square marker, which the user can drag and drop to select a second area from the image captured at the second capture time. Thereafter, the user can select a predetermined area from the images captured at each capture time as a skin image for comparing skin colors by pressing the confirm button AP73. In this way, the skin image acquisition unit 354 acquires a skin image by having the user select a predetermined area. Therefore, skin image acquisition section 354 acquires a skin image by having the user select a predetermined area from each image selected by image selection section 353.

[0049] FIG. 10 is a diagram showing a comparison screen for comparing the skin color of a skin image with a color chart. When the confirm button AP73 is pressed on the area selection screen AP7, the terminal control means 35 causes the display means 32 to display a comparison screen AP8, as shown in FIG. The comparison screen AP8 includes a skin image display field AP81 that displays a skin image, a color chart display field AP82 that displays a color chart, an RGB display field AP83 that displays RGB value information, and a result display button AP84 for displaying the results of comparing each skin image.

[0050] The skin image display field AP81 displays the image of the first region on the left side and the image of the second region on the right side. Here, the color information acquisition unit 355 compares the skin color of each skin image acquired by the skin image acquisition unit 354 with the color chart stored in the storage unit 351 to acquire color information of the corresponding skin color. The color chart display field AP82 displays a five-level color chart from left to right: fair skin, yellow skin, flesh-colored skin, tanned skin, and brown skin. In the color chart on the left side of the color chart display field AP82, the color chart corresponding to the skin color in the first region (the flesh-colored skin color chart) is enclosed in a square frame. In addition, in the color chart display field AP82, the color chart corresponding to the skin color in the second region (the tanned skin color chart) is enclosed in a square frame. The RGB display field AP83 displays the RGB values ​​of the image in the first region on the left side, and the RGB values ​​of the image in the second region on the right side.

[0051] Furthermore, the user can display the results of comparing each skin image by pressing the result display button AP84.

[0052] FIG. 11 is a diagram showing a result display screen that displays the results of comparing each skin image. When the result display button AP84 is pressed on the comparison screen AP8, the terminal control means 35 causes the display means 32 to display a result display screen AP9, as shown in FIG. The result display screen AP9 includes a second image display field AP91 that displays the image at the second imaging time, a first image display field AP92 that displays the image at the first imaging time, a result display field AP93 that displays the results of comparing each skin image, and a comment display field AP94 that displays information about beauty based on the results of comparing each skin image.

[0053] The result display field AP93 and the comment display field AP94 display information related to beauty and notify the user. Specifically, the beauty information notification unit 358 displays the information related to beauty in the result display field AP93 and the comment display field AP94 based on the analysis information transmitted from the analysis information transmission unit 215.

[0054] In this embodiment, the received information analysis unit 214 classifies each piece of color information acquired by the color information acquisition unit 355 into five levels: fair skin, yellow skin, flesh-colored skin, tanned skin, and brown skin. When comparing color information based on a past skin image with color information based on a current skin image, if there is a change from flesh-colored skin to brown skin, it analyzes it as "tanned," and if there is a change toward fair skin or no change, it analyzes it as "not tanned." In the example of Figure 11, when the received information analysis unit 214 compares the color information based on the skin image at the first imaging time with the color information based on the skin image at the second imaging time, it determines that the skin is changing toward darker color and analyzes it as "tanned." Therefore, the beauty information notification unit 358 displays the beauty information "tanned" in the result display field AP93 and the beauty information "please apply sunscreen" in the comment display field AP94.

[0055] According to this embodiment, the following actions and effects can be achieved. (1) The information processing terminal 3 is equipped with an image selection unit 353 that allows the user to select from multiple images captured by the imaging means 33 at different capture times, and a skin image acquisition unit 354 that acquires skin images for comparing skin color from each image selected by the image selection unit 353.Therefore, by comparing the skin color of each skin image acquired by the skin image acquisition unit 354, the skin condition at a time point desired by the user can be compared.

[0056] (2) Information processing terminal 3 includes color information acquisition unit 355 that compares the skin color of each skin image acquired by skin image acquisition unit 354 with a color chart stored in memory unit 351 to acquire color information about the corresponding skin color, and beauty information notification unit 358 that notifies the user of beauty information based on the color information acquired by color information acquisition unit 355. Therefore, it is possible to notify the user of beauty information based on the comparison result of the skin color of each skin image. Furthermore, because a color chart is used when comparing the skin color of each skin image, skin colors can be easily compared using the color chart as a reference.

[0057] (3) The image selection unit 353 selects multiple images managed by the image management unit 352 by having the user select a date based on the operational input of the input means 31. Therefore, the user can compare the skin condition at the time of the user's choice, for example, by selecting a date by referring to a calendar. (4) The skin image acquisition unit 354 acquires skin images by having the user select a predetermined area from each image selected by the image selection unit 353. Therefore, the user can select an area where changes in skin color are of concern and compare the skin conditions. Also, the user can select different areas, such as the cheek and nose, to compare the skin conditions.

[0058] (5) The weather information acquisition unit 213 acquires weather information related to at least one of the weather and humidity based on regional information related to the region specified by the user, and the beauty information notification unit 358 notifies the user of beauty-related information based on the weather information acquired by the weather information acquisition unit 213. This allows the user to know beauty-related information such as the weather and humidity in the desired region, and to take effective preventative measures such as applying sunscreen.

[0059] (6) The beauty information notification unit 358 notifies the user of beauty-related information based on the number of steps taken by the step count acquisition unit 357. This allows the user to estimate the amount of UV rays they have been exposed to when walking outdoors, and to take effective preventative measures, such as applying sunscreen.

[0060] [Modifications of the embodiment] The present invention is not limited to the above-described embodiment, and modifications and improvements within the scope of achieving the object of the present invention are included in the present invention. For example, in the above embodiment, the image selection unit 353 selects multiple images managed by the image management unit 352 by having the user select a date based on an operational input from the input means 31. In contrast, the image selection unit only needs to allow the user to select multiple images captured by the imaging means at different imaging times based on an operational input from the input means, and may also allow the user to select multiple images based on options other than date, such as the season.

[0061] In the above embodiment, skin image acquisition unit 354 acquires skin images by having the user select a predetermined area from each image selected by image selection unit 353. In contrast, the skin image acquisition unit is only required to acquire skin images for comparing skin colors from each image selected by the image selection unit, and may, for example, automatically acquire skin images of predetermined areas based on image analysis or the like, or may acquire skin images from the entire image rather than from a predetermined area.

[0062] In the above embodiment, weather information acquisition unit 213 acquires weather information related to at least one of weather and humidity based on regional information received by regional information reception unit 356, and beauty information notification unit 358 notifies the user of beauty information based on the weather information acquired by weather information acquisition unit 213. However, beauty information notification unit 358 does not have to be configured to notify the user of beauty information based on the weather information acquired by weather information acquisition unit 213.

[0063] In the above embodiment, beauty information notification unit 358 notifies the user of beauty information based on the user's step count acquired by step count acquisition unit 357. However, beauty information notification unit 358 does not have to be configured to notify the user of beauty information based on the user's step count acquired by step count acquisition unit 357. In this case, information processing terminal 3 does not have to include pedometer 34 and step count acquisition unit 357. [Industrial Applicability]

[0064] As described above, the present invention can be suitably used in an information processing device that acquires information about a user's skin and provides the user with beauty-related information based on the acquired information. [Explanation of symbols]

[0065] 1. Information processing system (information processing device) 2 Management Server 3. Information processing terminal 4. Internet 21 Server-side control means (control means) 31 Input Method 32 Display means 33 Imaging means 34 Pedometer 35 Terminal side control means (control means) 211 Storage section 212 User Information Management Department 213 Weather Information Acquisition Department 214 Received Information Analysis Unit 215 Analysis Information Transmission Unit 351 Storage section 352 Image Management Department 353 Image Selection Section 354 Skin image acquisition unit 355 Color information acquisition section 356 Regional Information Reception Department 357 Step count acquisition unit 358 Beauty Information Department

Claims

1. An information processing apparatus comprising: an imaging means for capturing an image; an input means for receiving an operation input from a user; and a control means for controlling the imaging means and the input means, The control means a storage unit that stores information about a color chart in which color samples are arranged; an image selection unit that allows a user to select a plurality of images captured by the imaging unit at different imaging times based on an operation input from the input unit; a skin image acquisition unit that acquires a skin image for comparing skin colors from each image selected by the image selection unit; a color information acquisition unit that compares the skin color of each skin image acquired by the skin image acquisition unit with the color chart stored in the storage unit to acquire color information of the corresponding skin color; and a beauty information notification unit that notifies a user of beauty-related information based on the color information acquired by the color information acquisition unit.

2. 2. The information processing device according to claim 1, The control means an image management unit that manages, by date, a plurality of images captured by the imaging means at different imaging times; The information processing apparatus is characterized in that the image selection unit selects a plurality of images managed by the image management unit by having a user select a date based on an operation input from the input means.

3. 2. The information processing device according to claim 1, The skin image acquisition unit An information processing device, characterized in that a skin image is acquired by having a user select a predetermined area from each image selected by the image selection unit.

4. In the information processing device according to any one of claims 1 to 3, The control means a region information receiving unit that receives input of region information related to a region designated by a user based on an operation input of the input means; a weather information acquisition unit that acquires weather information related to at least one of weather and humidity based on the area information received by the area information reception unit, The beauty information notification unit An information processing device that notifies a user of beauty-related information based on the weather information acquired by the weather information acquisition unit.

5. In the information processing device according to any one of claims 1 to 3, a pedometer that measures the number of steps taken by a user who carries the information processing device; The control means a step count acquisition unit that acquires the number of steps taken by the user measured by the pedometer, The beauty information notification unit An information processing device that notifies a user of beauty-related information based on the number of steps taken by the user acquired by the step count acquisition unit.

Images