Information processing system

Abstract

To provide an information processing system that provides a care method that is easily executed continuously.SOLUTION: An information processing system comprises a care method determination unit. The care method determination unit acquires, for a care method for caring body symptoms, care method information in which a plurality of care methods are associated with each other for every body symptom. The care method determination unit acquires body symptom information indicating a user's body symptom, and at least one of timing information indicating the timing at which the user can carry out care according to the body symptom and time length information indicating the length of time the user can spare for the care. The care method determination unit determines a care method to be presented to the user from the plurality of care methods based on the body symptom information and at least one of the timing information and the time length information.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present technology relates to an information processing system that suggests care methods for physical symptoms. [Background technology]

[0002] For example, Patent Document 1 describes providing advice for improving the user's skin according to the skin concerns acquired through a network.

[0003] For example, users with skin diseases are likely to feel psychological stress and are forced to restrict their activities in daily life due to various physical symptoms such as inflammation, dryness, and darkening of the skin. For example, due to skin symptoms, users may feel stressed about exposing their skin, not want to talk to people, lose sleep due to itching, unconsciously scratch their skin and soil their bedding, symptoms may worsen or pain may occur due to work that requires excessive disinfection or water work, and users may hesitate to have physical contact with their children, and skin diseases can easily impair the quality of life. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2002-56281 A Summary of the Invention [Problem to be solved by the invention]

[0005] When caring for physical symptoms, it can be difficult to choose a care method that is most appropriate for one's own symptoms. Patients may also feel unsure as to whether the care method they are using is correct, or find it difficult to judge how long they should continue using the care method, making it difficult to continue providing care.

[0006] The present invention relates to an information processing system that provides a care method that is easy to carry out continuously. [Means for solving the problem]

[0007] An information processing system according to an embodiment of the present invention includes a care method determination unit. The care method determination unit is Acquire care method information in which a plurality of care methods are associated with each physical symptom with respect to a care method for caring for the physical symptom; Acquire physical symptom information indicating the physical symptom of the user, and at least one of timing information indicating a timing at which the user can provide care in response to the physical symptom and time length information indicating a time length that the user can provide the care, A care method to be proposed to the user is determined from among the plurality of care methods based on the physical symptom information and at least one of the timing information and the time length information. Effect of the Invention

[0008] According to the present invention, it is possible to suggest to the user a care method that is easy to carry out continuously. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating services etc. provided to a user with a skin disease by an information processing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a hardware configuration diagram of a care method proposal server (information processing device) of the information processing system. [Diagram 3] FIG. 2 is a block diagram showing a functional configuration of the information processing system. [Figure 4] FIG. 13 is a diagram (part 1) showing an example of information stored in a care method database included in the information processing system. [Diagram 5] FIG. 2 is a diagram (part 2) showing an example of information stored in a care method database included in the information processing system. [Figure 6] 10 is a flow diagram of an information processing method relating to a care method suggestion process in the information processing system. FIG. [Figure 7]FIG. 7 is a flow diagram of an information processing method related to the care method determination (ST6) processing shown in FIG. [Figure 8] 13 is an example of a questionnaire image (input image) for acquiring user information, which is displayed on a display unit of a user terminal included in the information processing system. [Figure 9] 13 is an example of a care method presentation image that shows the care method determined by the information processing system and is displayed on a display unit of a user terminal. [Figure 10] 13 is an example of a care method presentation image that shows the care method determined by the information processing system and is displayed on a display unit of a user terminal. [Figure 11] 4 is a flowchart of an information processing method relating to skin monitoring processing in the information processing system. FIG. [Figure 12] 13 is an example of an image displayed on the display unit of the user terminal before the start of execution of a skin care method during skin monitoring processing in the information processing system. [Figure 13] 13 is another example of an image displayed on the display unit of the user terminal before the start of execution of a skin care method during skin monitoring processing in the information processing system. [Figure 14] 12 is a flow diagram of an information processing method according to a first example of the processing of the monitoring result presentation (ST30) shown in FIG. [Figure 15] 13 is an example of an image displayed on the display unit of the user terminal when execution of a skin care method is started during skin monitoring processing in the information processing system. [Figure 16] 13 is an example of an image displayed on the display unit of the user terminal when execution of a care method during skin monitoring processing in the information processing system is completed. [Figure 17] FIG. 12 is a flow diagram of an information processing method according to a second example of the monitoring result presentation (ST30) process shown in FIG. [Figure 18] FIG. 12 is a flow diagram of an information processing method according to a third example of the monitoring result presentation (ST30) process shown in FIG. [Figure 19] 13 is an example of an image showing detailed instructions for using a care item, which is displayed on the display unit of a user terminal while the care method is being performed. [Figure 20]13 is an example image showing information related to a care method that is displayed on the display unit of a user terminal while the care method is being performed. [Figure 21] 4 is a flow diagram of an information processing method relating to information transmission processing in the information processing system. FIG. [Figure 22] FIG. 11 is a block diagram showing a functional configuration of an information processing system according to another embodiment. [Figure 23] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to still another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] The present invention will be described below with reference to the drawings. Note that the present invention is not limited to the following embodiments, and various modifications can be made without departing from the scope of the present invention. In the following description, the same reference numerals will be used to designate previously mentioned configurations, and descriptions thereof may be omitted. In addition, in the description of the information processing method, the same step numbers will be used to designate previously mentioned steps, and descriptions thereof may be omitted.

[0011] <Overview of services provided by information processing systems> An overview of services provided by an information processing system according to the present invention will be described. The information processing system provides users with care methods for caring for physical symptoms. Here, skin symptoms will be taken as an example of a physical symptom.

[0012] 1, the information processing system 100 includes a care method suggestion server (hereinafter simply referred to as the “server”) 10 and a plurality of user terminals 1 (1A to 1C . . . ). The server 10 and the user terminals 1 are connected via the Internet 50.

[0013] In the information processing system 100, a server 10 serving as an information processing device used by a care method suggestion service provider can provide various services S including a care method suggestion service 21 that suggests skin care methods (hereinafter simply referred to as "care methods") to each of a number of users (user A, user B, user C, etc.) who have a skin disease. In this specification, "care" includes treatment, treatment, etc. By the user carrying out the suggested care method, the user's skin concerns, in other words, symptoms that the user is currently suffering from, can be improved.

[0014] The information processing system 100 of this embodiment provides a skin care method for a user with a skin disease, the execution period of which is set to a predetermined length in advance. In this embodiment, the execution period of the skin care method is, for example, about 28 days, which is the skin turnover cycle, but is not limited to this length. In this way, by setting the execution period of the skin care method to match the skin turnover cycle or to a length longer than that, it is easy to realize the effect of executing the skin care method. In addition, by setting the execution period of the skin care method, the time goal for executing the skin care method becomes clear, making it easier for the user to continue the care. It is not necessary to set the execution period of the skin care method.

[0015] The "care method" proposed to the user is a method of caring for the symptom manifestation site where the physical symptom (in this embodiment, skin symptom) that the user is currently suffering from is manifested so as to improve the physical symptom. Typically, the "care method" includes information on the care items used for the care. The care item information includes information such as the type of care item (product name, etc.), how to use the care item, and precautions for using the care item. The method of using the care item includes information such as the amount to be used, the timing of use (e.g., morning, before going to bed, etc.), and the frequency of use (e.g., once a day, twice a day, once a week, etc.). In addition, the care items include pharmaceuticals, non-pharmaceutical quasi-drugs, miscellaneous goods, etc. In this embodiment, all of the care methods suggested to the user include care items, but care methods that do not use special care items such as "ice packs" or "steamed towels" may also be suggested.

[0016] As shown in Fig. 1, before a user purchases a care item, the server 10 provides a care method suggestion service 21. After the user purchases a care item, the server 10 provides a skin monitoring service 22 and a period information transmission service 23 as services during the period of execution of the care method, and provides a post-end information transmission service 24 as a service after the end of the period of execution of the care method.

[0017] The skin care method suggestion service 21 suggests a skin care method to the user. When the user agrees to the suggested skin care method and applies for membership registration, the server 10 performs a membership registration process. By registering as a member, the user can receive a skin monitoring service 22, a period information transmission service 23, and a post-termination information transmission service 24 from the member site of the skin care method suggestion service provider. Hereinafter, unless there is a need to distinguish between the period information transmission service 23 and the end information transmission service 24, they will be referred to as information transmission services 23 and 24.

[0018] In this embodiment, the skin care method suggestion service 21 is a service provided to the user before membership registration, but the skin care method suggestion service 21 may be provided after membership registration. The skin monitoring service 22 and the information transmission services 23 and 24 are services provided to the user after membership registration. Each service will be explained below.

[0019] [Care method suggestion service] As shown in FIG. 1, the server 10 determines a care method suitable for the user based on the user information 20, by referring to a care method database (hereinafter referred to as "care method DB") 152 serving as a care method information storage unit described later, and provides the user with the care method (care method suggestion service 21). In the present invention, the server 10 determines a care method to be proposed to the user using at least one of timing information indicating the timing when the user can perform care according to the skin condition (physical condition) and time length information indicating the length of time the user can take for care. This makes it possible to provide the user with a care method that is suitable for the user's lifestyle and that is easy for the user to continue.

[0020] An example of a method for acquiring the user information 20 is a questionnaire. The questionnaire may be conducted in a form in which the user fills out the questionnaire, or may be conducted directly by the care method suggestion service provider operating the server 10 to the user. Alternatively, the questionnaire may be displayed on the display unit 41 of the user terminal 1 (1A to 1C, ...) via a web page or a social networking service (SNS) such as LINE (registered trademark), and the user may input answers to the questionnaire.

[0021] User information can be obtained from the survey results. The user information includes, for example, user attribute information, user skin information, life problem information, current countermeasure information, and timing information. The timing information is information about the timing when the user can take care of their skin.

[0022] The above-mentioned user attribute information includes general information such as name, age (generation), occupation, address (area of ​​residence), sex, contact information such as email address, etc. The user attribute information also includes a user ID (user identification information) for identifying the user, which is assigned to the user by the server 10 when the user applies for membership registration.

[0023] The user's skin information is the user's skin symptom information (physical symptom information). The user's skin information includes one or more pieces of information selected from the symptom manifestation site, symptoms at the symptom manifestation site, the severity of the symptom, and the symptom manifestation frequency. The "symptom manifestation site" is the site where the symptom that the user is currently suffering from is manifesting, and is the site to be cared for.

[0024] The life problem information is, for example, information about worries or problems in life associated with skin trouble (currently bothersome symptoms).

[0025] The current treatment information is information on a care method that the user is currently taking for a skin trouble (a symptom that the user is currently bothered by). The information may include information on a care item that the user is currently using.

[0026] The server 10 refers to a care method DB 152 described later, and determines a care method to be proposed to the user based on the acquired user information 20. Then, when the user confirms and agrees to the contents of the proposed care method, membership registration is performed. In this embodiment, the care method suggestion service 21 is provided before a care item is purchased (hereinafter, referred to as "pre-purchase"). Details of the care method suggestion service 21 will be described later.

[0027] [Skin monitoring service] After the member registration, the care items used in the care method proposed by the server 10 are sold and shipped in response to the user's operation, and are acquired by the user. The acquisition means of the care items may be purchase at a store, and is not limited to shipping. For example, the server 10 may display a selection button on the display unit 41 of the user terminal 1 for the user to select whether to purchase online or at a store. The server 10 registers that the acquisition means is online purchase in the user information database 153 described later, based on the user's selection input operation of the selection button for online purchase at the user terminal 1. Also, the server 10 registers that the acquisition means is purchase at a store in the user information database 153, based on the user's selection input operation of the selection button for in-store purchase at the user terminal 1. In the case of purchase at a store, the server 10 may transmit to the user terminal 1 store information where the care items can be purchased, a notice encouraging the purchase at the store after a certain period of time, or the like. Also, for example, a survey to acquire user information may be conducted by the store clerk at a store where the care items are sold, and the survey results may be transmitted to the server 10 from an information processing device at the store by the operation of the store clerk. Then, the care items used in the care method proposed by the server 10 may be sold by a store clerk at the store after the user's membership registration is approved. In this way, only in-store purchases may be possible, and services can be provided to users who do not wish to purchase online. In the case of in-store purchases, for example, a membership card with a user ID (user identification information) such as a membership number may be issued to a user who uses the service. The user can use various services by accessing a member site from, for example, his / her own terminal (user terminal) using the user ID written on the membership card and setting up to receive various services. In addition, for example, as a member-only service, electronic coupons may be issued to users who use online purchases and paper coupons to users who use in-store purchases, and the same services can be received regardless of which acquisition method is selected.Additionally, users who make online purchases may be able to use paper coupons, and users who make in-store purchases may be able to use electronic coupons.

[0028] After the care item is purchased and obtained by the user (hereinafter referred to as "after purchase"), the user performs care based on the proposed care method. During the execution of the care method, the server 10 provides the user with a skin monitoring service 22, such as presenting a monitoring result of the skin condition using the user's skin image acquired from the user. In the skin monitoring service 22, for example, the server 10 acquires a skin image including a symptom manifestation site before the start of the care method, and further acquires skin images including the user's symptom manifestation site periodically multiple times during the execution of the care method, and provides images in which these skin images are arranged in chronological order for comparison. By providing such a service, the user can check the change in skin condition due to the execution of the care method, and it becomes easier to maintain a good motivation to continue the execution of the care method. The skin monitoring service will be described in detail later. Note that instead of acquiring skin images by the user terminal, for example, a camera connected to an information processing device in a store may acquire skin images of the user, and the skin images may be transmitted from the information processing device to the server 10. This allows even a user who is not familiar with using a camera mounted on a user terminal to easily use the skin monitoring service.

[0029] [Information dissemination service during the period] After purchase, the user performs care based on the provided care method. During the care method execution period, the server 10 provides the user with a period information transmission service 23 that transmits information about the care method and the like. In the period information transmission service 23, transmission information generated by the transmission information generation unit 146 described later is transmitted to the user. The transmission information is, for example, detailed usage of the care item, advice according to the season, dietary advice, evaluation information generated using symptom manifestation site information and evaluation results of the care method of other users who performed the same care method as the user. The information transmitted by the service makes the user feel that they are being supported in their skin disease worries, and they can know that there are other users who are suffering from the same symptoms as the user, which makes it easier to reduce the psychological burden caused by having a skin disease and to maintain a good motivation to continue performing the care method. In addition, by transmitting evaluation information generated using evaluation results of other users who performed the same care method as the user, the importance of care, which tends to become monotonous, can be reaffirmed, and motivation to continue the care method can be maintained.

[0030] [Post-conclusion information service] After the specified care method execution period ends, the server 10 provides the user with a post-end information transmission service 24 that transmits information aimed at following up on skin after the execution of the care method. In the post-end information transmission service 24, transmission information generated by a transmission information generation unit 146 described below is transmitted to the user. The transmission information is, for example, information inviting monitoring of skin conditions at the change of seasons. The information transmitted by the service can provide the user with an opportunity to reconfirm their current skin condition.

[0031] <Hardware configuration of the care method proposal server> As shown in FIG. 2, the server 10 includes a central processing unit (CPU) 31, a read only memory (ROM) 32, a random access memory (RAM) 33, an input / output interface 35, and a bus 34 connecting these to each other.

[0032] The CPU 31 appropriately accesses the RAM 33 etc. as necessary, and performs various arithmetic processing while controlling all the blocks of the server 10. The ROM 32 is a non-volatile memory in which the OS, programs, various parameters, and other firmware to be executed by the CPU 31 are fixedly stored. The RAM 33 is used as a working area for the CPU 31, and temporarily stores the OS, various applications being executed, and various data being processed.

[0033] The input / output interface 35 is connected to a display unit 36, an operation reception unit 37, a storage unit 38, a communication unit 39, and the like.

[0034] The display unit 36 ​​is a display device using, for example, an LCD (Liquid Crystal Display) or an OELD (Organic Electro Luminescence Display).

[0035] The operation reception unit 37 is, for example, a pointing device such as a mouse, a keyboard, a touch panel, or other input device. When the operation reception unit 37 is a touch panel, the touch panel can be integrated with the display unit .

[0036] The storage unit 38 is, for example, a non-volatile memory such as a hard disk drive (HDD), a flash memory (SSD; Solid State Drive), or other solid-state memory. The storage unit 38 stores the OS, various applications, and various data.

[0037] The communication unit 39 is, for example, a NIC (Network Interface Card) for Ethernet or various modules for wireless communication such as wireless LAN, and is responsible for communication processing with the user terminal 1.

[0038] Although not shown, the basic hardware configuration of the user terminal 1 is substantially the same as that of the server 10. It is preferable that the user terminal 1 has a camera for photographing skin connected to the bus 34 directly or via the input / output interface 35; specifically, a so-called smartphone satisfies this requirement.

[0039] <Functional configuration of information processing system> As shown in Fig. 3, the information processing system 100 includes a user terminal 1 and a server 10 as an information processing device. The user terminal 1 and the server 10 can be connected to each other via a wireless or wired communication network, and data can be transmitted and received via the communication network. The communication network is, for example, the Internet 50 (see Fig. 1).

[0040] [User terminal functional configuration] As shown in FIG. 1 and FIG. 3, the user terminal 1 is a terminal carried by a user who has, for example, a skin disease and receives a skin care method suggestion service or the like. The user terminal 1 displays an input image (questionnaire image) for inputting user information on its display unit 41. The user terminal 1 transmits user information (questionnaire result information) input by the user based on the input image to the server 10. The user terminal 1 receives a skin care method proposed by the server 10 based on the user information and presents it to the user. The user terminal 1 transmits a skin image of the user to the server 10. The user terminal 1 also presents to the user skin monitoring results, various information (transmitted information) transmitted during or after the execution of the skin care method, and the like, provided by the server 10. The user terminal 1 is, for example, a mobile phone such as a smartphone, a tablet terminal, a personal computer, or the like.

[0041] As shown in FIG. 3, the user terminal 1 includes a communication unit 2, an input unit 3, an output unit 4, a processing unit 5, an imaging unit 6, and a storage unit .

[0042] (Communications Department) The communication unit 2 transmits and receives various information to and from the server 10 via the Internet 50, for example. The communication unit 2 transmits input information input by the user on the user terminal 1 to the server 10. Specifically, the communication unit 2 transmits to the server 10 input information (survey result information) input by the user on the input image 70 (70A to 70C) showing a survey for acquiring user information, which is displayed on the display unit 41 of the user terminal 1. The communication unit 2 transmits the image captured by the imaging unit 6 of the user terminal 1 to the server 10. The communication unit 2 receives presentation information indicating a proposed care method determined by the server 10 based on user information from the server 10. In this embodiment, the presentation information is image information displayed on the display unit 41.

[0043] (Input section) The input unit 3 is, for example, an input device such as a touch panel, a touch pad, a pen tablet, a pointing device such as a mouse, or a keyboard. The input unit 3 may also include a microphone and may be capable of voice input. When the input unit 3 includes a touch panel, the touch panel may be integrated with a display unit 41 described later.

[0044] (Output section) The output unit 4 is an output device that presents various information. In this embodiment, the output unit 4 includes a display unit 41. The display unit 41 is configured with an image display panel such as a liquid crystal display or an organic EL display. The display unit 41 is capable of displaying information based on the presentation information received by the communication unit 2 from the server 10. For example, the display unit 41 displays an input image showing a questionnaire, a care method presentation image showing a care method, etc.

[0045] Furthermore, in addition to the display unit 41, the output unit 4 may include an audio output unit such as a speaker, and a vibration presentation unit such as a vibration motor that presents tactile vibration to the user. In this embodiment, an example is given in which an image is displayed (visual presentation) on the display unit 41 as a means for presenting the care method, etc. to the user, but in addition to this, or instead of this, the care method, etc. may be presented by voice (auditory presentation). For example, by reading out the matters shown in the image by voice in addition to the image, the presented contents can be easily understood even when the screen is difficult to see due to the surrounding environment. Also, for example, notifications informing the user of the time to perform skin care or notifications informing the user that it is a skin monitoring day may be made by voice or vibration in addition to or instead of images. As an example, by making a voice notification or vibration notification such as "Today is a monitoring day," the user can know that it is a skin monitoring day without checking the display unit 41 of the user terminal 1.

[0046] (Processing section) The processing unit 5 controls, for example, image display on the display unit 41. Specifically, an image based on the presentation information received by the communication unit 2 is displayed on the display unit 41. The processing unit 5 also controls input information input by the user on an input image showing a questionnaire to be transmitted to the server 10 via the communication unit 2. The processing unit 5 may also control the presentation of audio by a speaker (not shown) or the presentation of tactile vibration by a vibration motor (not shown), etc.

[0047] (Imaging unit) The imaging unit 6 is capable of capturing an image of, for example, the skin including the symptom manifestation site of the user who uses the user terminal 1. As the imaging unit 6, for example, a camera equipped with an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Devices) sensor is used.

[0048] The imaging unit 6 can capture a skin image including the symptom manifestation site before the start of the care method, a skin image including the symptom manifestation site during the period of the care method, a skin image of the symptom manifestation site at the end of the period of the care method, etc. The captured skin image information is transmitted to the server 10 via the communication unit 2 and stored in the memory unit 7 of the user terminal 1. By storing the skin image information in the memory unit 7, it is possible to eliminate the transmission of skin image information from the server 10 to the user terminal 1, and to reduce the amount of communication data.

[0049] (Storage part) The storage unit 7 may store, for example, various information transmitted and received by the communication unit 2 with the server 10. By storing the information on the user terminal 1 side, for example, it is possible to reduce the transmission and reception of images and the amount of communication data. This makes it possible to improve the processing speed and operability on the user terminal 1 side, and for example, even in a poor communication environment, processing is less likely to be delayed, and the psychological burden on the user due to slow processing speed can be reduced.

[0050] [Server (information processing device) functional configuration] The server 10 serving as an information processing device includes a communication unit 11, a processing unit 14, and a storage unit 15.

[0051] (Communications Department) The communication unit 11 transmits and receives various types of information to and from the user terminal 1 via, for example, the Internet. The communication unit 11 receives input information (survey result information) inputted at the user terminal 1. The input information is user information, and includes the user's attribute information, the user's skin information, the user's lifestyle issue information, and the user's skin care timing information. The communication unit 11 also receives images acquired at the user terminal 1, more specifically, skin image information including the user's symptom manifestation area (care target area). The received user's input information and skin image information are outputted to the processing unit 14. The received input information and skin image information are also stored in a user information database (hereinafter referred to as "user information DB") 153. The communication unit 11 transmits to the user terminal 1 presentation information generated by the processing unit 14 using information acquired from the user terminal 1 and the like.

[0052] (Processing section) The processing unit 14 performs a series of processes related to the provision of the service S. In detail, the processing unit 14 performs a skin care method suggestion process related to the skin care method suggestion service 21, a skin monitoring process related to the skin monitoring service 22, and an information transmission process related to the information transmission services 23 and 24.

[0053] The processing unit 14 includes a care method determination unit 141 , a processing unit 142 , a presentation information generation unit 143 , an index value determination unit 144 , a judgment unit 145 , a transmission information generation unit 146 , and a color correction unit 147 . The care method determination unit 141 and the presentation information generation unit 143 are responsible for the care method suggestion process. The processing unit 142, the presentation information generation unit 143, the index value determination unit 144, the determination unit 145, and the color correction unit 147 are responsible for the skin monitoring process. The transmission information generating unit 146 and the presentation information generating unit 143 are responsible for information transmission processing. The CPU 31 loads a program stored in the program memory unit 151 into the RAM 33 and executes it, thereby realizing a care method determination unit 141, a processing unit 142, a presentation information generation unit 143, an index value determination unit 144, a judgment unit 145, and a transmission information generation unit 146.

[0054] ((Care method determination unit)) The care method determination unit 141 determines whether to suggest a care method to the user based on the user information. In detail, the care method determination unit 141 determines whether to suggest a care method to the user based on the symptom occurrence frequency information. If the occurrence frequency is less than about once a month, the care method determination unit 141 determines not to suggest a care method, and outputs the result of the determination to the presentation information generation unit 143. The care method determination unit 141 determines to suggest a care method when the occurrence frequency is equal to or greater than about once a month.

[0055] When the care method determination unit 141 decides to propose a care method, the care method determination unit 141 decides a care method suitable for the user based on the user information by referring to a table stored in the care method DB 152. More specifically, the care method determination unit 141 decides the timing to execute the care method based on the user's skin information (specifically, symptom manifestation site information and symptom information) and timing information and / or time length information, and decides a care method that reflects the decision result. The presentation information generation unit 143 outputs information on the decided care method to the presentation information generation unit 143.

[0056] ((Processing Department)) The processing unit 142 generates a processed image of the symptom manifestation site in a state where the symptom has been alleviated, using a skin image including the symptom manifestation site of the user before starting to carry out the care method. The processing unit 142 may generate a plurality of processed images with different degrees of symptom reduction as the processed images. For example, three processed images may be generated: a processed image with a high degree of symptom reduction, a processed image with a second high degree of symptom reduction, and a processed image with a low degree of symptom reduction. Note that, although an example of three processed images is given here, there may be one or more processed images.

[0057] The processing unit 142 may generate a processed image by referring to, for example, other user information stored in the user information DB 153. In detail, the processing unit 142 may generate a processed image by referring to skin images of other users who have skin information that matches or is similar to that of the user and who have performed the same care method as the user. The user information DB 153 is updated from time to time and more user information of more users is stored, so that the skin condition at the end of the care method execution period can be predicted with high accuracy. This makes it possible to present the user with a processed image in which the skin at the end of the care method execution period is more realistic, making it easier for the user to imagine the skin at the end of the care method execution period.

[0058] An example of a method for generating a processed image will be described. For example, in generating a processed image (redness-reduced processed image) in which the symptom "color unevenness (redness)" is reduced, the K-means method is used to reduce the colors of the captured image (original image before processing) to 20 colors, and then processing (blurring) is performed using a bilateral filter. By reducing the colors to 20 using the K-means method, the base skin color becomes dominant and the redness can be reduced. When only the K-means method is used, the boundaries between colors are noticeable, but by performing the above-mentioned blurring process, the image can be processed so that the skin appears smooth by blending the colors inside while leaving the outline of the body. Furthermore, the color difference between the processed image and the original image before processing is calculated using a color difference calculation formula based on CIE DE2000, and for parts where the difference is too far from a certain value, the color (RGB value) is adjusted so that the above difference is equal to or less than the certain value. This allows the generation of a processed image in which "color unevenness (redness)" is reduced. The reduction (degree of processing) of color unevenness (redness) is performed by comparing the original image and the image processed by the K-means method and bilateral filter pixel by pixel, and replacement is performed based on "how far the color difference is in CIE DE2000," but this can be changed by changing the size of the threshold value for replacement execution. Processed images with reduced scale can also be generated using the above method.

[0059] ((Index value determination unit)) The index value determination unit 144 determines an index value of the skin condition of the symptom manifestation site by using at least one of a skin image including the symptom manifestation site of the user and symptom information of the symptom manifestation site acquired by an input operation of the user. The index value is a quantitative evaluation of the skin condition of the symptom manifestation site. The index value determination unit 144 determines index values ​​for each of the skin conditions, such as the skin barrier function, skin unevenness (redness), and skin itching. A higher index value indicates a higher skin barrier function in terms of barrier function, a reduced skin unevenness (redness) in terms of skin unevenness (redness), and a reduced skin itching in terms of itching. One or more index values ​​selected from the skin barrier function, skin unevenness (redness), and skin itching may be determined as the index value.

[0060] Specifically, the index value determination unit 144 performs image analysis of the acquired skin image of the user using a known image analysis method to determine the analysis value obtained as the index value of the skin barrier function. Image analysis related to the skin barrier function can grasp structural changes of the skin surface, such as the strength of the skin against external stimuli, the likelihood of symptoms recurring, the smoothness of the skin surface, and the state of scales (whether they have decreased, etc.). In addition, the index value determination unit 144 determines an analysis value obtained by performing image analysis on the acquired skin image of the user using a known image analysis method as an index value for skin unevenness (redness). Image analysis related to skin unevenness (redness) can grasp color changes such as changes in skin redness and reduction in redness unevenness. In this way, by obtaining index values ​​through image analysis, skin conditions such as skin barrier function and skin unevenness (redness) can be objectively evaluated. Note that in addition to the skin image analysis result, which is an objective evaluation, the barrier function and skin unevenness (redness) index values ​​may be determined by taking into account the subjective evaluation by the user.

[0061] In addition, the index value determination unit 144 determines the index value of itching using the results of a questionnaire about itching input by the user. In other words, the index value of a skin condition such as itching, which is difficult to judge by image analysis, is determined based on the subjective evaluation by the user. For example, the index value can be set to 4 when there is no itching, 3 when there is mild itching, 2 when there is moderate itching, and 1 when there is severe itching.

[0062] Each index value determined by index value determination unit 144 is stored in user information DB 153 (described later) in association with the user, together with the skin image and the questionnaire result.

[0063] Here, in this embodiment, in the skin monitoring service 22, the presentation information generating unit 143 uses a plurality of skin images acquired at different times to generate an image (an example image will be described later) showing how the skin has changed by executing a care method. The presentation information generating unit 143 may generate an image showing the change in skin condition over time by displaying actually captured skin images side by side, or in addition to or instead of this, may generate an image showing the change in skin condition over time using an index value obtained by quantitatively evaluating the skin by the index value determining unit 144. The change in index value over time may be shown in a graph or may be expressed as a numerical value. In the examples shown in Figs. 15 and 16 described later, the index values ​​are shown in graph form.

[0064] The above-mentioned "skin images taken at different times" refers to, for example, a skin image before starting to perform a skin care method, a skin image one week after starting to perform the skin care method, a skin image two weeks after starting to perform the skin care method, a skin image three weeks after starting to perform the skin care method, and a skin image four weeks after starting to perform the skin care method (which in this embodiment corresponds to the end of performing the skin care method). Details will be described later, but in an example of the skin monitoring service 22 of this embodiment, skin images are obtained a total of five times: before starting to perform the care method, and one week, two weeks, three weeks, and four weeks after starting to perform the care method.

[0065] It is difficult to always maintain the same shooting conditions, such as the brightness of the background, when shooting skin images at different times for each skin image. If the shooting conditions are different, it is difficult to accurately compare the change in skin color (hue, saturation, brightness) over time using multiple skin images acquired at different times. In addition, it is difficult to always shoot subjects (skin images including the symptom manifestation site) with the same size, making it difficult to accurately grasp the change over time in the area (size) of the symptom manifestation site using skin images captured at different times.

[0066] In contrast, in this embodiment, in providing the skin monitoring service 22, a plurality of correction stickers 61 (see FIG. 12) may be provided to the user at the time of purchasing a care item in addition to the care item such as a preparation. The correction stickers 61 have a color correction area that serves as a reference for evaluating the skin color and the area of ​​the symptom manifestation site, and by using the correction stickers 61, it is possible to perform a comparative evaluation of a plurality of skin images acquired at different times with higher accuracy. Details of the correction stickers will be described later.

[0067] Furthermore, when determining the index value by image analysis, the index value determination unit 144 may determine the index value after correcting the color of the skin image using the correction sticker 61 based on the color correction area of ​​the correction sticker 61. This improves the accuracy of comparison of index values ​​determined based on skin images captured at different times, and enables accurate understanding of changes in skin condition.

[0068] ((judgment section)) The determination unit 145 retrieves an index value associated with the previously acquired skin image of the user from the user information DB 153, and compares and determines the index value with an index value determined using the currently acquired skin image and questionnaire results. The determination unit 145 compares and determines at least one index value of the skin barrier function, uneven skin tone (redness), and itching. The index value to be used for the comparison and determination may be determined, for example, using symptom information included in the user information. For example, when "itchiness" is listed as a symptom, the determination unit 145 may use an index value of itching to make the comparison and determination. Also, for example, when "redness" or "darkening" is listed as a symptom, the determination unit 145 may use an index value of uneven skin tone (redness) to make the comparison and determination. Note that since the barrier function is an index suitable for quantitatively indicating the skin condition of relatively various symptoms, the barrier function index value may be used for the comparison and determination.

[0069] If the current index value is higher than the previous index value, the determination unit 145 determines to recommend continuation of the currently performed care method. The determination unit 145 outputs the determination result to the presentation information generation unit 143.

[0070] If the current index value is equal to or less than the previous index value, the determination unit 145 determines to present, as warning information, matters that are considered to be the cause of no improvement in the skin condition. The determination unit 145 outputs the determination result to the presentation information generation unit 143. For example, if the care item is a detergent, the presentation information generation unit 143 generates, as presentation information, an image showing warning information that calls attention to whether or not any detergent has been left behind after washing. Alternatively, the judgment unit 145 may make a judgment to propose a new care method when the current index value is equal to or lower than the previous index value, preferably when the current index value is a predetermined value lower than the previous index value, in other words, when the current index value is significantly lower than the previous index value. The judgment unit 145 outputs a judgment result to the care method determination unit 141. The care method determination unit 141 refers to the care method DB 152 and proposes a new care method.

[0071] ((Transmission Information Generation Unit)) The transmission information generation unit 146 generates transmission information to be transmitted by the during-period information transmission service 23 and the after-termination information transmission service 24 , and outputs the information to the presentation information generation unit 143 . The transmitted information includes evaluation information generated using other users' evaluation results of symptom occurrence areas and care methods, detailed instructions on how to use care items, seasonal advice, dietary advice, invitations to monitor skin conditions, etc.

[0072] (Color correction section) The color correction unit 147 performs color correction on the user's skin image acquired from the user terminal 1 based on the color of the color correction area of ​​the correction sticker 61. The color correction unit 147 outputs the color-corrected skin image to the presentation information generation unit 143 and the processing unit 142. The processing unit 142 may generate a processed image using the color-corrected skin image. The presentation information generation unit 143 may generate a display image using the color-corrected skin image.

[0073] ((Presentation information generation unit)) The presentation information generating unit 143 generates presentation information such as a display image to be displayed on the display unit 41 of the user terminal 1. The generated presentation information is transmitted to the user terminal 1 via the communication unit 11. In the user terminal 1, an image is displayed on the display unit 41 based on the presentation information. Note that, although the presenting information generating unit 143 generates an image signal as the presentation information in this embodiment, the presentation information generating unit 143 may generate, as the presentation information, an audio signal output from an audio output unit of the user terminal 1 or a drive signal for a vibration motor that presents haptic vibration.

[0074] The presentation information generating unit 143 generates, as presentation information, an image for input showing a questionnaire for acquiring user information. An example of the image for input will be described later.

[0075] The presentation information generating unit 143 generates various images related to the provision of the care method suggestion service 21 as presentation information. For example, based on the result of the decision by the care method decision unit 141 that no care method is to be proposed, the presentation information generation unit 143 generates an image with display content indicating that there is no care method to be proposed. The presentation information generating unit 143 generates an image of display contents recommending continuation of the currently performed care method, based on the determination result by the care method determining unit 141 to recommend continuation of the currently performed care method. The presentation information generating unit 143 uses the care method determined by the care method determining unit 141 to generate a care method presentation image showing a care method to be proposed to the user.

[0076] The presentation information generating unit 143 generates various images related to the provision of the skin monitoring service 22 as presentation information. For example, the presentation information generating unit 143 generates an image in which the image color-corrected by the color correcting unit 147, the processed image generated by the processing unit 142, the index value determined by the index value determining unit 144, etc. are displayed. The presentation information generating unit 143 generates an image on which warning information is displayed or an image suggesting a new care method based on the determination result by the determining unit 145.

[0077] The presentation information generation unit 143 generates, as presentation information, an image related to the provision of the information transmission services 23 and 24. For example, the presentation information generation unit 143 generates an image on which the transmission information generated by the transmission information generation unit 146 is displayed.

[0078] ((Correction sticker)) FIG. 12(A) is an example of an image including a skin image including a symptom manifestation site acquired by the user terminal 1, in which the symptom manifestation site is the cheek. 12(A), the correction sticker 61 is placed near the symptom manifestation site 60 when a skin image is acquired. An instruction is given to the user to capture an image so that the correction sticker 61 and the symptom manifestation site 60 are included in the capture range.

[0079] The correction sticker 61 has, for example, a square outer shape, and inside the correction sticker 61, a square color correction area is located, which is smaller than the square outer shape of the correction sticker 61. The color correction area is divided into 3×3 squares. Each of the nine squares in the color correction area is colored with a different color with known hue, saturation, and brightness. Also, a scale is provided around the entire periphery of the color correction area.

[0080] As described above, in the skin monitoring service 22, skin images of the user are taken five times in total: before starting the care method, and one week, two weeks, three weeks, and four weeks after starting the care method. The correction sticker 61 is used every time a skin image is captured. The color correction unit 147 corrects the hue, saturation, and brightness of the symptom manifestation site 60 included in the skin image based on the color of the color correction area of ​​the correction sticker 61, which is colored with a known hue, saturation, and brightness. This makes it possible to accurately grasp the change over time in color of the condition of the symptom manifestation site 60 using skin images captured at different times. In addition, by using the scale on the correction sticker 61 and the outer dimensions of the correction sticker 61 as a reference, the change over time in the size of the symptom occurrence site 60 can be accurately grasped.

[0081] In addition, it is preferable to use at least one correction sticker 61 for one photographing, and multiple correction stickers 61 may be used. In the example shown in FIG. 12(A), the symptom manifestation site 60 is on the cheek, and the correction sticker 61 is placed next to the lip near the symptom manifestation site 60. In addition, another correction sticker 61 may be attached to the cheek. For example, in the case of photographing conditions in which shadows are generated in the photographed image, such as when the lighting that illuminates the mouth area is bright and the lighting that illuminates the face becomes darker toward the upper part of the face, multiple correction stickers 61 are used, and the hue, saturation, and brightness of each pixel corresponding to the symptom manifestation site 60 are calculated while taking into account the variation in brightness in the image caused by the lighting, etc., so that the change in the condition of the skin over time can be grasped more accurately.

[0082] Furthermore, when generating a display image (for example, a fourth display image 74 described later) in which a plurality of skin images captured at different times are displayed, the presentation information generating unit 143 may generate the display image by reducing or enlarging the image color-corrected by the color correcting unit 147 using the correction stickers 61 so that the sizes of the correction stickers 61 shown on all of the skin images are the same. This allows the symptom manifestation sites to be compared in a plurality of skin images to have the same size and the same color conditions, making it possible to grasp accurate changes over time in the symptom manifestation sites.

[0083] (Storage part) The storage unit 15 includes a program storage unit 151, a care method DB 152, and a user information DB 153. The storage unit 15 corresponds to the storage unit 38 in the hardware configuration of FIG.

[0084] ((Program Memory Section)) The program storage unit 151 stores programs for executing a care method suggestion process including a care method determination process, a skin monitoring process, an information transmission process, and the like, which are performed in the information processing system 100. The programs may be read from a portable recording medium such as an optical disk or a semiconductor memory, or may be downloaded from a server on a network.

[0085] The program storage unit 151 stores a program for causing the server (information processing device) 10 of the information processing system 100 to execute the above-mentioned care method determination process. The care method determination process includes the steps of acquiring care method information in which a plurality of care methods are associated with each physical symptom as a method for caring for the physical symptom, acquiring physical symptom information indicating the physical symptom of the user, and at least one of timing information indicating a time when the user can provide care in accordance with the physical symptom and duration information indicating the length of time the user can provide the care, and determining a care method to be proposed to the user from among the plurality of care methods based on the physical symptom information and at least one of the timing information and the duration information.

[0086] The program storage unit 151 stores a program for causing the server (information processing device) 10 of the information processing system 100 to execute the above-mentioned monitoring process. The monitoring process includes a step of acquiring an image of the symptom manifestation site where the user's symptoms are manifested, which was acquired before the start of execution of the care method, and using the image of the symptom manifestation site to generate a processed image of the symptom manifestation site in a state in which the symptoms have been alleviated, and a step of generating a second display image as the presentation information, in which the image of the symptom manifestation site before the start of execution of the care method and the processed image are displayed. In addition, in the step of generating the processed image, a plurality of processed images having different degrees of symptom relief may be generated, and in the step of generating the second display image, the second display image may be generated as the presentation information, in which an image of the affected area before the start of performance of the care method and the plurality of processed images are displayed.

[0087] The program storage unit 151 stores a program for causing the server (information processing device) 10 of the information processing system 100 to execute the above-mentioned information transmission process. The information transmission process includes the steps of acquiring user information of the target of information transmission, referring to a user information DB to acquire symptom manifestation site information and evaluation results for the care method associated with other users who are performing the same care method as the user, and generating presentation information to be shown to the target of information transmission using the acquired symptom manifestation site information and evaluation results for the care method of the other users.

[0088] ((Care Method DB)) The care method DB 152, which serves as a care method information storage unit, stores a table including care method information in which a plurality of care methods for caring for physical symptoms are associated with each physical symptom, as shown in Fig. 4 and Fig. 5. The table has data in which care methods, convenience of life, timing for performing the care methods, physical symptoms (skin symptoms in this embodiment, simply referred to as "symptoms" in the figures), and areas where symptoms are manifested (simply referred to as "areas" in the figures) are associated with each other. For convenience, Figs. 4 and 5 use eczema, rash, redness, itchiness, roughness, and darkening as examples of symptoms.

[0089] The item "care method" in the table includes information on care items that can care for skin symptoms (physical symptoms). The care method information includes care item information that associates a plurality of care items with each skin symptom. The care items include essential care items for carrying out a care method for caring for skin conditions, and optional care items that the user can select whether or not to use. The essential care items are essential care items that are proposed to solve problems regarding skin symptoms that are currently bothering the user. Optional care items are care items proposed to further enhance the care method using essential care items. In this embodiment, all of the care methods stored in the care method DB 152 are configured to include care items, but there may also be care methods that do not use special care items such as "ice packs" or "steamed towels."

[0090] The "lifestyle convenience" item in the table includes information on life convenience that makes use of the characteristics of the care item listed as the care method.

[0091] For example, anti-inflammatory topical preparations E to H, Nos. 5 to 8 in FIG. 4, are mist-type preparations that can be sprayed quickly and directly onto the site of symptoms without getting the hands dirty. In other words, Nos. 5 to 8 are preparations that can be used for very short periods of time and are suitable for use in situations where the hands cannot be soiled. In the table shown in FIG. 4, anti-inflammatory topical preparations E to H are associated with the information that "I cannot get my hands dirty during the day or at work" as a "lifestyle factor." This information indicates that it is a care method that requires very little time for care (can be done in a very short time).

[0092] The sheet-type anti-inflammatory agent No. 9, the sheet-type anti-itch agent No. 10, and the sheet-type moisturizing agent No. 11 in FIG. 4 are all preparations that are applied to the site where symptoms appear and left on for a certain period of time. In other words, No. 9 to No. 11 require a relatively long time for care, and are a care method that is unsightly when applied to the skin, and are preferably used in situations where users do not care about the public's attention. In the table shown in FIG. 4, the sheet-type anti-inflammatory agent, the sheet-type anti-itch agent, and the sheet-type moisturizing agent are associated with the information "appearance is not a concern (not a concern about public attention)" as a "lifestyle consideration." This information indicates that the care method takes a relatively long time (is time-consuming).

[0093] Cleansing sheet A-C, No. 13-15 in Fig. 4, are wipe-off type cleaners that can be used in a very short time. In other words, No. 13-15 are products that can be used in a very short time and are not noticeable when used. In the table shown in Fig. 4, cleaning sheet A-C are associated with the information "I don't have time in the morning" as a "lifestyle factor." This information indicates that it is a care method that requires very little time for care (can be done in a very short time).

[0094] Foam cleansers A to B, Nos. 16 to 17 in FIG. 4, are cleansers that do not require lathering and are applied to the target area and then washed off with water, allowing for cleaning in a relatively short time. In other words, Nos. 16 to 17 can be said to be products that can be used for a relatively short time for care, and are also products that are preferable for use in situations where users do not care about being seen by others. In the table shown in FIG. 4, foam cleansers A to B are associated with the information that "I don't have time in the morning (I don't care about being seen by others)" as "lifestyle reasons." This information indicates that it is a care method that requires a relatively short time for care (can be done in a relatively short time).

[0095] UV protection agent B No. 20 in FIG. 4, allergen adhesion prevention agent B No. 25 in FIG. 5, medicated lotion / milk D No. 29, medicated lotion / milk E No. 30, and medicated lotion / milk F No. 31 are mist-type formulations, so they can be sprayed directly onto the symptom site without getting the hands dirty, and can also be sprayed onto the face while applying makeup. In other words, No. 20, No. 25, No. 29, No. 30, and No. 31 are products that can be used without causing any change in appearance and are suitable for use in situations where the time required for care is very short and the hands cannot be soiled. In the tables shown in FIGS. 4 and 5, the information "I cannot get my hands dirty during the day at work (I have makeup on my face and cannot remove my makeup)" is associated with UV protection agent B medicated lotion / milk D to F as "lifestyle reasons". This information indicates that it is a care method that requires very little time for care (can be done in a very short time).

[0096] The scratching protection means No. 39 in Fig. 5 is a care item for preventing unconscious scratching of the symptom site and aggravating the symptom, specifically, gloves worn on the hands to prevent direct scratching of the symptom site and a protective bandage for covering the symptom site. In the table shown in Fig. 5, the scratching protection means is associated with information that "unconsciously scratches while sleeping" as "lifestyle reasons". This information indicates that it is a care method that takes a long time (time-consuming).

[0097] The "Timing" item in the table indicates the timing for performing the corresponding "care method." In the "Timing" item, "Daytime" indicates "When you feel itchy or painful during the day," and "When going out" indicates "While you're out (at work or in the bathroom)." "Optional" indicates that the timing is not limited.

[0098] In the tables shown in Figures 4 and 5, the "timing" associated with each care method is set taking into consideration the timing at which the corresponding care method is most effective and the convenience of a typical user's life. For example, in the morning, people generally have little time to spare, but since they are at home, they are often not concerned about people looking at them. Meanwhile, during the day, people have little time to spare because they have to go to work, and are often concerned about people looking at them. Both UV protection agent A (No. 19) and UV protection agent B (No. 20) are formulations that protect the skin from UV rays, and are most effective when used in the morning or during the day. Also, UV protection agent A (No. 19) is a formulation that is applied to the skin, while UV protection agent B (No. 20) is a formulation that is dispensed as a mist, and it can be said that UV protection agent A is a formulation that requires more effort to apply than UV protection agent B. In such a case, taking into consideration the timing at which the care method is most effective and the convenience of the general user's life, UV protection agent A can be associated with "morning" as a "timing," and UV protection agent B can be associated with "daytime, when going out" as a "timing."

[0099] Although details will be described later, in this embodiment, the care method determination unit 141 extracts, from the multiple care methods in the table of the care method DB 152, care methods that match any of the symptom information, symptom occurrence site information, and timing information included in the user information, as candidates for care methods to be suggested to the user.

[0100] Regardless of the selection result in question 6 (Q.06, question asking about timing information) of input image 70C shown in FIG. 8(C) for acquiring user information described later, a care method for which “optional” is associated with the “Timing” item in the tables of FIG. 4 and FIG. 5 can be extracted as a care method if other conditions (symptom information and symptom occurrence site information) match. In the following description, "the timing information included in the user information matches the timing information in the care method DB 152" includes a case where the timing information in the care method DB 152 matches completely, as well as a case where the timing information in the care method DB 152 is "optional."

[0101] The "symptoms" item in the table indicates symptoms of a target area for which a corresponding "care method" is to be performed. The "site" item in the table indicates the site where the symptom occurs, that is, the body site on which the corresponding "care method" is to be performed.

[0102] ((User Information DB)) The user information DB 153 stores user information for each user who receives the care method suggestion service 21, the skin monitoring service 22, the period information transmission service 23, and the end information transmission service 24.

[0103] The user information includes user attribute information, user skin information (physical symptom information), user lifestyle issue information, user care timing information and / or time length information, etc. This information is mainly obtained by a questionnaire before purchase.

[0104] Furthermore, the user information DB 153 stores, for each user, a skin image including the site where the user's symptoms appear, the results of a questionnaire given to the user when the user's skin image was acquired, and information on an index value indicating a skin condition determined using the skin image and the questionnaire results, together with information on the date and time when the skin image was acquired. The skin condition is one or more skin conditions selected from the skin barrier function, skin unevenness (redness), and skin itchiness.

[0105] Further, evaluation results such as impressions and findings on a care method that the user is performing or has performed may be stored for each user in the user information DB 153. The evaluation results on the care method are acquired by a questionnaire after purchase.

[0106] The above-mentioned user attribute information includes general information such as name, user ID (user identification information) for identifying the user, age (generation), occupation / industry, address (residential area), gender, and contact information such as email address. The user ID is issued to the user terminal 1 by the care method suggestion service provider based on a membership registration application from the user terminal 1. The user ID may function as account information for using various services in the information processing system 100.

[0107] The skin information of the user includes one or more pieces of information selected from a symptom manifestation site, a symptom at the symptom manifestation site, a symptom severity, and a symptom manifestation frequency. The skin information preferably includes at least symptom manifestation site information and symptom information at the symptom manifestation site.

[0108] <Details of server processing related to service provision> The process related to each service provision will be described in detail according to the flow of the service provision by the information processing system 100. The process performed by the information processing system 100 before and after the purchase of a care item will be described below. Note that, although the image displayed on the display unit 41 of the user terminal 1 will be described below, this is an example and the content of the image is not limited to the above.

[0109] [Before purchase] As described above, before the purchase of a care item, the server 10 provides the user with the care method suggestion service 21. The care method suggestion service 21 will be described below.

[0110] (Care method suggestion service) In the care method suggestion service 21, the server 10 transmits presentation information showing an input image, which is a questionnaire image for acquiring user information, to the user terminal 1 that has accessed the site operated by the server 10. The user terminal 1 displays the input image 70 (70A to 70C) shown in Figs. 8(A) to (C) on the display unit 41 based on the received presentation information.

[0111] In the input image 70A shown in FIG. 8(A), question 1 (Q.01) and question 2 (Q.02) for obtaining skin information of the user are displayed.

[0112] Question 1 asks about the details of skin trouble as skin information of the user. "Skin trouble" refers to skin symptoms (symptoms at the site of symptom appearance) that the user is currently troubled by. In the example shown in FIG. 8(A), multiple symptoms are displayed in advance and can be selected by the user. In the example shown in FIG. 8(A), options of "eczema (bumps) / rash", "redness", "itch", "cracking / chapping", "darkening", "roughness / stiffness / flaking / peeling", "acne / pimples", "scar", and "other" are displayed as skin symptoms (physical symptoms). Here, an example is given in which one symptom is selected by the user, but one or more symptoms may be selected. The questionnaire result for Question 1 is used to determine the care method to be provided to the user.

[0113] Question 2 (Q.02) asks about the user's skin information, such as the area where the symptom currently bothers them (symptom manifestation area) and the severity of the symptom. In the example shown in FIG. 8(A), a full-body diagram of the human body viewed from the front and the back is displayed. The user can input the symptom manifestation site by specifying the site where the symptom is manifested using the full-body diagram, and can intuitively and accurately indicate the symptom manifestation site. In addition, in the example shown in FIG. 8(A), the degree of the symptom can be input by the number of times tapping or clicking the symptom manifestation site. One tap or click indicates that the symptom is mild. Two taps or clicks indicate that the symptom is moderate. Three taps or clicks indicate that the symptom is severe. In this way, the degree of the symptom can be input by the number of taps or clicks, and input operability is good. In addition, the color of the specified symptom manifestation site on the image may change depending on the degree of the symptom, and the user can intuitively confirm the degree of the input symptom from the change in color. In addition, the input of the specified symptom manifestation site and the input of the degree of the symptom may be canceled by tapping or clicking four times. And, once the input is canceled, the next new tap or click may be counted as the first tap or click. As a result, even if an input of the symptom manifestation site designation or symptom severity is incorrect, the input up to that point can be cancelled and new input can be made. The symptom occurrence site information obtained from the questionnaire result of question 2 is used to determine the care method to be provided to the user. The symptom severity information obtained from the questionnaire result of question 2 is used to determine the index value of the skin condition of the skin monitoring service 22, etc.

[0114] In the example shown in FIG. 8(B), question 3 (Q.03) for obtaining skin information of the user and question 4 (Q.04) for obtaining life task information are displayed on the input image 70B.

[0115] Question 3 asks the user about the frequency of the currently bothersome symptoms (occurrence frequency) as skin information. In the example shown in FIG. 8(B), the frequency of occurrence is divided into six options: "always," "more than once a week," "about once every 2-3 weeks," "about once a month," "about once every 2-3 months," and "less frequently than once every 2-3 months." The survey result for question 3 is used to determine the care method to be provided to the user.

[0116] Question 4 asks about life issues such as worries and problems. Specifically, it asks about worries and problems in life associated with skin troubles (currently bothersome symptoms). While questions 1 to 3 above are questions for obtaining skin information from the user, question 4 asks about the impact on quality of life caused by skin troubles (currently bothersome information). The survey result for question 4 may be used when determining the care method to be provided to the user.

[0117] In the example shown in FIG. 8(C), the input image 70C displays question 5 (Q.05) for obtaining information on the countermeasures (care methods) currently being taken by the user, and question 6 (Q.06) for obtaining information on the timing at which the user can perform care according to the skin condition (physical condition).

[0118] Specifically, question 5 asks how the user is currently dealing with the cause of skin trouble. In the example shown in FIG. 8(C), the user is instructed to select all that apply from seven options. The seven options are "using medicines prescribed by a doctor," "using medicines purchased at a pharmacy or drugstore," "frequently applying moisturizer," "using a mild detergent," "frequently keeping bedding and clothing clean," "not currently dealing with anything in particular," and "none of these apply." The survey result for question 5 is used to determine the care method to be provided to the user. The survey result for question 5 may also be used to determine the content of information to be sent to the user. Also, although not shown in Fig. 8(C), if "I use medicines prescribed by a doctor" or "I use medicines purchased at a pharmacy or drugstore" is checked in question 5, the name of the medicine (care item name) being used may be made inputtable. In this case, the user may type in the name of the medicine himself, or multiple medicine candidates may be listed in advance as a drop-down list from which the user may select.

[0119] Question 6 asks when care is possible. In the example shown in FIG. 8(C), the user is instructed to select all that apply from seven options. The seven options are "after waking up in the morning," "when itching or pain occurs during the day," "while out (at work or in the bathroom while out)," "after doing water chores," "while taking a bath," "after a bath or shower," and "before going to bed." The survey result for question 6 is timing information indicating when the user can take care of their skin condition (physical condition), and is used to determine the care method to be provided to the user.

[0120] Furthermore, the questionnaire for acquiring user information may include a question asking about the length of time the user can devote to care. For example, a question may be provided with three options for the length of time the user can devote to care: "less than 10 minutes," "10 to 20 minutes," and "20 minutes or more." The questionnaire result for this question is time length information indicating the length of time the user can devote to care, and can be used when determining the care method to be provided to the user. If the questionnaire contains both a question about the length of time and question 6 about the timing of care, the length of time available for care may be input for each timing. For example, if two options, "after waking up in the morning" and "before going to bed", are selected as timing information, the length of time may be selected for each selected timing, such as "less than 10 minutes" for the timing "after waking up in the morning" and "more than 20 minutes" for the timing "before going to bed."

[0121] In the present invention, at least one of the timing information and the time length information may be acquired as user information, and the questionnaire for acquiring the user information may include at least one of a question asking about the timing at which care can be performed and a question asking about the length of time available for care. By using the timing information and / or the time length information to determine the care method to be proposed to the user, it is possible to propose a care method that is easy for the user to continue. In the present embodiment, an example in which timing information is used is described.

[0122] In addition, the server 10 displays an input image on the display unit 41 of the user terminal 1 as a questionnaire screen for acquiring user information, for inputting general attribute information of the user, such as name, age (generation), occupation, address (residential area), gender, and contact information such as email address.

[0123] In the user terminal 1, the user inputs answers in accordance with the questionnaires in the above-mentioned input images 70 (70A to 70C) displayed on the display unit 41, and this input information is transmitted to the server 10. The input operation information is questionnaire result information and user information.

[0124] Next, the flow charts of FIG. 6 and FIG. 7 will be used for explanation. As shown in FIG. 6, the care method determination unit 141 of the server 10 acquires user information (input information) which is a questionnaire result from the user terminal 1 (ST1). Next, the care method determination unit 141 acquires care method information from the care method DB 152 (ST2). The care method information is information necessary for determining a care method. Next, the care method determination unit 141 refers to the care method information stored in the care method DB 152 and determines a care method based on the user information (ST3). Details of the care method determination process in step ST3 will be described with reference to FIG. 7.

[0125] As shown in FIG. 7, when the care method determination unit 141 starts the care method determination process, it uses symptom occurrence frequency information at the symptom occurrence site contained in the user information to determine whether the frequency of occurrence of skin symptoms (physical symptoms) is about once a month or more (ST10). The occurrence frequency information is information input in question 3 of the input image 70B in Fig. 8(B). If "about once every 2-3 months" or "less frequently than once every 2-3 months" is checked in question 3, the care method determination unit 141 judges NO for ST10, and if "always," "more than once a week," "about once every 2-3 weeks," or "about once a month" is checked, the care method determination unit 141 judges YES for ST10.

[0126] When the care method determination unit 141 determines that the occurrence frequency is not about once a month or more (NO to ST10), it determines that the service by the information processing system 100 is unnecessary and determines that there is no care method that can be suggested. The care method determination unit 141 outputs the determination result that "there is no care method that can be suggested" to the presentation information generation unit 143. The presentation information generation unit 143 generates an image displaying, for example, "there is no care method that can be suggested" as presentation information and transmits it to the user terminal 1 (ST14), and ends the care method determination process. The user terminal 1 displays a message "There are no suggested care methods" on the display unit 41 based on the received presentation information. In this way, if the information processing system 100 determines that the user does not need the care method it proposes, it notifies the user that there is no care method that can be proposed, thereby preventing the user from wasting valuable time and effort that could be spent on caring for themselves.

[0127] When the care method determination unit 141 determines that the occurrence frequency is about once a month or more (YES in ST10), it extracts candidate care methods from the care method information stored in the care method DB 152 based on the user information (ST11). More specifically, the care method determination unit 141 extracts care methods that match the symptom occurrence site information and symptom information included in the user information from the care method DB 152. The symptom occurrence site information is information input in question 2 of the input image 70A in FIG. 8(A). The symptom information is information input in question 1 of the input image 70A in FIG. 8(A). A specific example of the extraction of potential care methods in ST11 will be described later.

[0128] Next, the care method determination unit 141 determines whether or not the extracted candidate care methods include a care method currently being performed by the user (a method currently being performed) based on the current handling information included in the user information (ST12). The current handling information is information input in question 5 of the input image 70C in FIG. 8(C).

[0129] When the care method determination unit 141 determines that the extracted candidate care methods include a care method currently being performed by the user (YES to ST12), it decides to recommend continuation of the currently being performed care method. The care method determination unit 141 outputs the decision result of "recommending continuation of the care method" to the presentation information generation unit 143. The presentation information generation unit 143 generates an image displaying, for example, "We recommend that you continue the currently being performed care method" as presentation information, transmits it to the user terminal 1 (S15), and ends the care method determination process. Based on the presentation information transmitted from the server 10, the user terminal 1 displays on the display unit 41 a message saying "We recommend that you continue the care method you are currently using." In this way, if the user is currently performing a care method that the information processing system 100 is going to suggest, by encouraging the user to continue the care method that they are currently performing, the user can be reminded that the care method that they are currently performing is suitable for them. Here, when a plurality of care methods of different categories are extracted in ST11, in S12, it is determined whether or not there is a currently executed care method for each different category.

[0130] On the other hand, if the care method determination unit 141 determines that there is no currently executed care method among the extracted candidate care methods (NO in ST12), the process proceeds to ST13. In ST13, the care method determination unit 141 determines a care method to be proposed to the user by using timing information included in the user information. Then, the presentation information generation unit 143 generates, as presentation information, a care method presentation image 71 (71A to 71D) as a first display image in which the determined care method is displayed, and transmits it to the user terminal 1. The timing information is information input in question 6 of the input image 70C in FIG. 8(C). In ST13, the care method determination unit 141 determines the timing information included in the user information as the timing to execute the care method proposed to the user, and determines the care method by reflecting the determination result. That is, the care method determination unit 141 determines the care method that matches the determined timing from the care methods stored in the care method DB 152 as the care method to be proposed to the user. Details of the determination of the care method in ST13 will be described later.

[0131] The user terminal 1 displays a care method presentation image 71 (71A to 71D) on the display unit 41 based on the presentation information transmitted from the server 10, as shown in FIGS.

[0132] As shown in Fig. 9(A), a care method presenting image 71A showing a care method proposed to a user is displayed on the display unit 41 of the user terminal 1. In the example shown in Fig. 9(A), the care method presenting image 71A displays types of care items as care methods proposed to a user who has listed "itchiness" as a symptom that is currently bothering them.

[0133] In detail, the following care items (1) to (5) are proposed. (1) Treatment for dry skin, (2) Medication for treating skin inflammation, (3) Foam type facial cleanser, (4) Gel-type moisturizer, (5) Skin protection tools The above care items (1) to (4) are essential care items for carrying out a care method aimed at improving a currently bothersome symptom (in this case, itching). The above care item (5) is an optional care item. An optional care item is an item that is not necessarily required for carrying out a care method aimed at improving a currently bothersome symptom, but can further enhance the care method.

[0134] In the care method presentation image 71A, a box for the user to check to approve the purchase is displayed to the right of each care item. By checking the box, the user approves the purchase of the care item. In addition, a box for inputting the number of purchases is provided to the right of the box. In addition, in the care method presentation image 71A, a box for checking whether or not to receive the skin monitoring service 22 provided after membership registration is provided, and by the user checking the box, the user approves the provision of the service. The skin monitoring service 22 may be provided using, for example, an SNS such as LINE (registered trademark) as a care index measurement navigator.

[0135] As shown in FIG. 9(B), the display unit 41 of the user terminal 1 displays a care method presentation image 71B showing a care method proposed to the user. In the example shown in FIG. 9(B), the care method presentation image 71B displays types of care items as care methods proposed to a user who has listed "itchiness" as a symptom that is currently bothering them. In the example shown in FIG. 9(B), a UV care agent that also protects against pollen and PM2.5, a sweat wipe, and cleaning supplies are proposed, all of which are optional care items. In the care method presentation image 71A, a box for the user to check to confirm purchase is displayed to the right of each care item, and a box for inputting the number of items to be purchased is displayed to the right of the box.

[0136] The care method presentation images 71A and 71B are presented, and the user can know the care items suitable for his / her skin trouble by checking the presented contents. This eliminates the need to be confused about which care item to use, and the need to carry out a care method while worrying about whether the care item is suitable for his / her skin trouble.

[0137] As shown in Fig. 10(A), a care method presentation image 71C showing information on how to spend one day (24 hours) using the above care items is displayed on the display unit 41 of the user terminal 1. In Fig. 10(A), (1), (2) ... correspond to (1), (2) ... given to each care item in Fig. 9(A).

[0138] As shown in Fig. 10(A), the care method presentation image 71C displays information including the timing of use of the care items proposed in Fig. 9(A), the amount of use of the care items, and points for using the care items (points to note when using the care items) as care methods. In the example shown in Fig. 10(A), a day is displayed in chronological order, such as morning, daytime / when going out, bathing, after bathing, and before sleep, and the type of care to be performed at each timing is displayed. The care method presentation image 71C displaying the flow of care for a day can be viewed, for example, even during the period of performing the care method, and the user can check the care method by looking at the care method presentation image 71C as necessary.

[0139] In the present invention, a care method is determined based on timing information (user information obtained by answering question 6 in input image 70C in FIG. 8(C)) indicating the timing at which the user can perform care according to the skin condition (physical condition), so the timing of use of the care items included in the care method proposed to the user is set to a timing at which the user can perform the care. Therefore, a care method that is easier to continue can be proposed to the user. This allows the user to perform care with a care method that is easy to continue and that suits their own lifestyle.

[0140] In addition, by presenting the timing of use of the care items and the appropriate amount of use of the care items, the user can carry out the care method without worrying that he / she is using the care items incorrectly. In this way, the suggested care method is easy for the user to continue to carry out. In addition, the motivation to continue the care method is easily maintained.

[0141] In addition, by being able to check the daily flow of a care method before purchasing a care item, users can easily simulate what a day would be like when actually performing the care method, making it easier for them to determine whether or not it is a care method that they can perform.

[0142] In this embodiment, a predetermined execution period is set, such as 28 days (about one month) for the execution of the care method. In such a case, the presentation information generating unit 143 may divide the above-mentioned care method execution period into a plurality of divided periods as shown in Fig. 10(B), and generate a care method presentation image 71D including care goal information for each divided period as the presentation information. The care method presentation image 71D, which displays the care flow for 28 days (approximately one month), can be viewed, for example, even during the care method implementation period, and the user can check the overall care flow, etc., by looking at the care method presentation image 71D as necessary.

[0143] In the example shown in Fig. 10(B), the 28-day (about one month) care method execution period is divided into four, and each divided period is the first divided period, the first week (1st Week in the figure), the second divided period, the second divided period, the third divided period, and the fourth divided period. The care method start date is the first day, and the first week is from the first day to the seventh day, the second week is from the eighth day to the fourteenth day, the third week is from the fifteenth day to the twenty-first day, and the fourth week is from the twenty-second day to the twenty-eighth day.

[0144] In the example of the care method presentation image 71D, detailed information on the care method may be displayed for each divided period, such as the goal or purpose of care, the role of the care item at the current timing (divided period), the timing to stop using the care item, etc. This allows the user to have a deeper understanding of the overall flow of care for 28 days, the goal or purpose of care for each divided period, etc.

[0145] In the example shown in Figure 10(B), during the first week, the message displayed is, "First, treat any skin concerns such as itchiness and uneven skin tone," and "Establish a good skin care routine for seven days using treatment drug (1) for dry skin and treatment drug (2) for skin inflammation." In the second week, messages such as "Take care to prevent a recurrence," and "Once the itching goes away, you can stop using the medication for skin inflammation (2). Continue to use the medication for dry skin (1) for a solid 7-day care routine. If you feel itchy, continue using the medication for skin inflammation (2) until the itching goes away." are displayed. In the third week, the message "Let's create a good skin environment" and "Use the dry skin treatment (1) and foam type facial cleanser (3) effectively to achieve your original condition for 7 days" will be displayed. In the fourth week, the message displayed is, "The final step: Regulate your skin's functions with a gel-type moisturizer (4)," and "Use a foam-type facial cleanser (3) for the final 7 days to prepare your skin."

[0146] By displaying such detailed information about the skin care method, the user can gain a deeper understanding of the role of each proposed skin care item for each divided period, and can continue to perform the skin care method with a sense of purpose. Also, while performing the skin care method, the user can grasp the overall flow of the skin care for 28 days, and can understand the stage of the skin care method that the user is currently performing, and can become continuously aware of changes in his / her skin, and can continue to perform the skin care method. In addition, while it is generally difficult to determine the timing to stop using a care item, in this embodiment, detailed information about the care method includes information about the timing to stop using the care item, so that the user can carry out the care method without having to wonder until what time the care item should be used.

[0147] In this way, the care method suggested to the user includes information on the type of care item to be used, information on the amount of the care item used, information on the timing of use of the care item, information on the frequency of use, information on precautions for using the care item, information on the goals and objectives of care for each divided period, and information on the role of the care item in each divided period.

[0148] When the user examines the care method presenting images 71A to 71D and then selects a care method to be performed, a decision button (not shown) corresponding to the selected care method is selected by clicking, tapping, or the like. The user terminal 1 transmits information resulting from the selection, in other words, answer information regarding the execution of the care method by the user, to the server 10. As shown in FIG. 6, the care method determination unit 141 acquires the user's answer (selection result) regarding the execution of the care method (ST4).

[0149] Next, the care method determination unit 141 determines whether or not there is a purchase desire based on the user's answer regarding the practice of the care method (ST5).

[0150] When the care method determination unit 141 determines that there is no purchase desire (NO in ST5), it ends the care method suggestion process. On the other hand, if the care method determination unit 141 determines that there is a purchase request (YES in ST5), it determines that a membership registration application has been made and performs membership registration processing for the user (ST6). The server 10 issues a user ID to the user in response to the user's application for membership registration. After the user is registered, the user ID and user information (input images 70A to 70C, questionnaire results input using the input images for acquiring the user's attribute information) associated with each user, and information on the care method that the user has agreed to carry out are stored in the user information DB 153. Furthermore, if the server 10 determines that there is a purchase request (YES in ST5), it delivers the care item to the user.

[0151] Completion of the membership registration process enables the server 10 to provide post-purchase services such as a skin monitoring service 22, a period information transmission service 23, and a post-purchase information transmission service 24.

[0152] When the membership registration process is performed, the server 10 starts a skin monitoring process (ST7). The skin monitoring process may be started and initiated following the membership registration process. Alternatively, the skin monitoring process may be initiated by the user at any time after the purchased care item arrives at the user's hand, for example by the user accessing a member site. The skin monitoring process will be described later.

[0153] In addition to the care items proposed by the server 10 and requested by the user, a user who wishes to make a purchase is sent a number of correction stickers 61 to be used when taking skin images when receiving the above-mentioned skin monitoring service 22.

[0154] ((Details of ST13 Determining Feasible Care Options)) The details of determining ST13's feasible care approach are described below. As described above, in ST11, the care method determination unit 141 extracts a care method that matches the symptom manifestation site information and the symptom information included in the user information from the care method DB 152. At this time, a plurality of care methods of the same category that show the same efficacy may be extracted. In this embodiment, in ST13, the care method determination unit 141 refers to the "timing" item of the care method extracted from the tables shown in Figs. 4 and 5, and determines whether or not the "timing" of the extracted care method matches the timing information included in the user information. If the care method determination unit 141 determines that the timing information matches the timing information included in the user information, it determines that the care method is executable. Here, in ST13, the care method determination unit 141 judges whether the extracted care methods are executable in order from the top to the bottom of the table. Then, the care method that is first judged to be executable is determined as the care method to be proposed to the user. That is, although each care method is assigned a serial number in Figs. 4 and 5, when one care method is determined in ST13 from the multiple care methods of the same category showing the same efficacy extracted in ST11, the care method with the smallest serial number that matches the timing information included in the user information is determined as the care method to be proposed to the user.

[0155] For example, when the symptom occurrence site included in the user information is "arm" and the symptom is "eczema", anti-inflammatory topical agent B of No. 2 and anti-inflammatory topical agent F of No. 6 are extracted as care methods of the same category showing the same efficacy. Furthermore, when the timing included in the user information is "when itching or pain is noticed during the day", both anti-inflammatory topical agent B of No. 2 and anti-inflammatory topical agent F of No. 6 have timing information that matches the timing information included in the user information, so they can be care methods proposed to the user. However, when the extracted care methods are judged to be executable in order from the top to the bottom on the table as in this embodiment, anti-inflammatory topical agent B of No. 2 is judged to be executable first, so anti-inflammatory topical agent B of No. 2 is determined to be the care method proposed to the user as the anti-inflammatory topical agent.

[0156] In this manner, in the present embodiment, when the care method determination unit 141 extracts multiple care methods of the same category that have the same efficacy and match the user information in all symptoms, symptom occurrence locations, and timing, the care method determination unit 141 determines the care method that is higher on the table as the care method to be suggested to the user. In this case, the order in which a plurality of care methods of the same category that show the same efficacy for the same symptom and the same site of symptom occurrence should be placed on the table may be determined, for example, as follows. That is, a care method having a wider range of timing for use may be positioned higher on the table. In the example shown in FIG. 4, the timing of No. 1 anti-inflammatory topical agent A is "any". On the other hand, the timing of No. 5 anti-inflammatory topical agent E, which is in the same category as No. 1 anti-inflammatory topical agent A and has the same efficacy for the same symptoms and the same symptom manifestation site, is "daytime, when going out". In other words, No. 1 anti-inflammatory topical agent A has a wider range of timing for use of the care method than No. 5 anti-inflammatory topical agent E, and is more versatile in terms of timing for use. By positioning a care method having a wider range of timing for use higher on the table, a care item that satisfies the conditions of the timing information included in the user information and can be used at other times can be proposed to the user, so that a care method that is easier for the user to continue can be provided. Also, the care method with higher usability may be positioned higher on the table. For example, anti-inflammatory topical preparation E (No. 5) is a mist-type preparation, which can be sprayed on the symptom site without soiling the hands. On the other hand, anti-inflammatory topical preparation A (No. 1), which is in the same category as anti-inflammatory topical preparation E (No. 5) and has the same efficacy for the same symptoms and the same symptom site, is a spreadable type. In other words, anti-inflammatory topical preparation E (No. 5) is less likely to soil the hands and is easier to use than anti-inflammatory topical preparation A (No. 1). In such a case, anti-inflammatory topical preparation E may be positioned higher on the table than anti-inflammatory topical preparation A. In addition, when there are multiple care methods in the same category that have the same efficacy for the same symptoms and the same site of symptom occurrence, each care method may be ranked higher in the table so that the method with the lowest frequency of common side effects appears at the top.

[0157] In the present embodiment, when there are multiple care methods of the same category that show the same efficacy and match the user information in all of the symptoms, symptom appearance site, and timing, the care method that is higher on the table is determined as the care method to be proposed to the user, but this is not limited to the above. For example, the care method determination unit 141 may use the user information to determine the care method to be proposed to the user from the multiple extracted care methods. As an example, the care method determination unit 141 may select and determine a care method to be proposed to the user from the extracted multiple care methods, using life task information included in the user information. As another example, when the user information includes time length information, the care method determination unit 141 may select and determine a care method to be proposed to the user from the extracted multiple care methods using the time length information. The time length information indicates the length of time that the user can take for care according to the skin condition (physical condition). As yet another example, if the user information includes preference information indicating a preferred feeling such as a refreshing feeling or a moist feeling, the care method determination unit 141 may use the preference information to select and determine a care method to be suggested to the user from the multiple extracted care methods. As yet another example, if the user information includes budget information indicating the amount of money the user can spend on a care method, the care method determination unit 141 may use the budget information to select and determine a care method to be suggested to the user from the extracted multiple care methods so as to fit within the budget. In addition, the care method determination unit 141 may select and determine a care method to be proposed to the user from the extracted multiple care methods using two or more pieces of information selected from life task information, time length information, preference information, and budget information. The above-mentioned time length information, preference information, and budget information may be obtained through a questionnaire administered to the user by the care method proposal service 21, and questions requesting this information may be included in the questionnaire.

[0158] In addition, in this example, a care method that matches the symptom appearance site information and symptom information included in the user information is extracted from the care method DB152 in ST11, and a care method that matches the timing information included in the user information is selected from the care method DB152 in ST13. However, a care method that matches the symptom appearance site information, symptom information, and timing information may be extracted from the care method DB152 in ST11. In this case, when multiple care methods of the same category that have the same efficacy are extracted in ST11, in this embodiment, the care method that is at the top of the table among the multiple extracted care methods of the same category that have the same efficacy is determined as the care method to be proposed to the user in ST13. Alternatively, in ST13, the care method to be proposed to the user may be selected and determined using other user information such as life task information, time length information, preference information, and budget information as described above.

[0159] ((Specific examples of ST11 extraction of care method candidates and ST13 determination of feasible care methods)) A specific example of the extraction of candidate care methods in ST11 and a specific example of the determination of a care method in ST13 will be described.

[0160] (((ST11 Specific examples of care method extraction))) In ST11, the care method determination unit 141 extracts candidate care methods that match the symptom manifestation site information and symptom information included in the user information from the care method DB 152. The symptom manifestation site information is information input in the question 2 field of the input image 70A in Fig. 8(A). The symptom information is information input in the question 1 field of the input image 70A in Fig. 8(A).

[0161] For example, suppose that "eczema" is checked in question 1 asking about symptoms, and "arm" is checked in question 2 asking about the location where the symptoms occur. In ST11, the care method determination unit 141 extracts a care method by referring to a table (see Figs. 4 and 5) stored in the care method DB based on "eczema" (symptom information) and "arm" (symptom manifestation site information) included in the user information. That is, the care method determination unit 141 extracts a care method associated with "eczema" and "arm" from the care method DB 152. In this specific example, the care methods extracted are No. 2 anti-inflammatory topical agent B, No. 6 anti-inflammatory topical agent F, No. 13 sheet-type cleanser A, No. 19 UV protection agent A, No. 20 UV protection agent B, No. 21 sweat wipe sheet A, No. 24 allergen adhesion prevention agent A, No. 25 allergen adhesion prevention agent B, No. 32 medicinal input agent, No. 36 beverage A, and No. 39 scratching protection means. Of these care methods, No. 2 anti-inflammatory topical agent B and No. 6 anti-inflammatory topical agent F are care items in the same category with the same efficacy. No. 19 UV protection agent A and No. 20 UV protection agent B are care items in the same category with the same efficacy. No. 24 allergen adhesion prevention agent A and No. 25 allergen adhesion prevention agent B are care items in the same category with the same efficacy.

[0162] 7, in ST12, the care method determination unit 141 determines whether or not there is a care method being performed among the candidates extracted in ST11. Here, a case where the result of the determination in ST12 is NO and the process proceeds to ST13 will be described.

[0163] (((ST13 Specific examples of determining care methods))) In ST13, the care method determination unit 141 uses timing information contained in the user information (user information obtained by answering question 6 in input image 70C of FIG. 8(C)) to determine whether the care method extracted in ST11 is a feasible care method. Here, we will explain an example where "morning" is checked in question 6, which asks about the best time to provide care.

[0164] In ST13, the care method determination unit 141 determines whether or not the multiple care methods (No. 2, 6, 13, 19, 20, 21, 24, 25, 36, 39) extracted in ST11 are executable, in order from the top to the bottom of the table, using timing information included in the user information. The following will explain each method in order.

[0165] As shown in FIG. 4, the timing associated with No. 2 anti-inflammatory topical agent B is “any”, so the care method determination unit 141 determines No. 2 anti-inflammatory topical agent B as the care method to be recommended to the user. On the other hand, since the timing associated with No. 6 anti-inflammatory topical agent F is "daytime, when going out," the care method determination unit 141 does not determine No. 6 anti-inflammatory topical agent F as the care method to be recommended to the user.

[0166] Since the timing associated with the sheet-type detergent A of No. 13 is "morning," the care method determination unit 141 determines the sheet-type detergent A of No. 13 as the care method to be recommended to the user.

[0167] Since the timing associated with UV protection agent A of No. 19 is "morning", the care method determination unit 141 determines UV protection agent A of No. 19 as the care method to be recommended to the user. On the other hand, since the timing associated with UV protection agent B of No. 20 is "daytime, when going outside", the care method determination unit 141 does not determine UV protection agent B of No. 20 as the care method to be recommended to the user.

[0168] Since the timing associated with No. 21 sweat wipe A is "daytime, when going out," the care method determination unit 141 does not determine No. 21 sweat wipe A as the care method to be recommended to the user.

[0169] Since the timing associated with the allergen adhesion preventive agent A of No. 24 is "morning", the care method determining unit 141 determines the allergen adhesion preventive agent A of No. 24 as the care method to be proposed to the user. On the other hand, since the timing associated with No. 25 allergen adhesion preventive agent B is “daytime, when going out”, the care method determination unit 141 does not determine No. 25 allergen adhesion preventive agent B as the care method to be recommended to the user.

[0170] The care method determination unit 141 does not determine the medicinal bath agent No. 32 as the care method to be recommended to the user because the timing associated with the medicinal bath agent No. 32 is "during bathing."

[0171] Since the timing associated with the drink A of No. 36 is "optional", the care method determination unit 141 determines the drink A of No. 36 as the care method to be proposed to the user.

[0172] As shown in FIG. 5, the timing associated with the scratching protection measure No. 39 is "before going to bed / night", so the care method determination unit 141 does not determine the scratching protection measure No. 39 as the care method to be suggested to the user.

[0173] In this specific example, in ST13, the care method determination unit 141 determines that the care methods to be suggested to the user are No. 2 anti-inflammatory topical agent B, No. 13 sheet-type cleanser A, No. 19 UV protection agent A, No. 24 allergen adhesion prevention agent A, No. 25 allergen adhesion prevention agent B, No. 32 medicinal input agent, and No. 36 beverage A.

[0174] In the above specific example, there is one care method associated with symptoms, areas (sites where symptoms appear), and timing that all match the symptom information, symptom appearance area information, and timing information contained in the user information, for each care method in the same category that has the same efficacy, but there may be multiple care methods. For example, if the user information includes "arm" as the symptom occurrence location, "eczema" as the symptom, and "morning" and "when itching or pain occurs during the day" as the timing, the care method determination unit 141 extracts two anti-inflammatory topical agents, anti-inflammatory topical agent No. 2 B and anti-inflammatory topical agent No. 6 F, as anti-inflammatory topical agents. In such a case, in this embodiment, the care method determination unit 141 determines the possibility of implementing the care methods in order from the top to the bottom of the table, and therefore determines the care method located at the top of the table as the care method to be proposed to the user. In the above example, the anti-inflammatory external agent B of No. 2 is determined as the care method to be proposed to the user.

[0175] In this embodiment, when multiple care methods of the same category and the same efficacy are extracted, all of which match the user information in terms of symptom appearance site information, symptom information, and timing information, the care method that is higher on the table is determined as the care method to be proposed, but it is not necessary to narrow it down to one care method. For example, if the timing of use of each care method is different and they can be used together, multiple care methods of the same category and the same efficacy may be proposed.

[0176] In the above-described embodiment, an example was given in which a care method to be suggested to a user is determined using timing information indicating the timing at which the user can provide care, in addition to the user's skin information (more specifically, symptom information and symptom manifestation site information). However, instead of or in addition to the timing information, a care method to be suggested to a user may also be determined using duration information indicating the length of time the user can provide care.

[0177] The time length information can be acquired by including a question about the length of time the user can take for care in the questionnaire for acquiring user information, as described above. The time length information is also user information, and when the time length information is acquired, it is stored in the user information DB 153 in the same manner as other user information. Here, we will explain an example in which a user selects "less than 1 minute" from the three options for the length of time available for care, "less than 10 minutes," "10 to less than 20 minutes," and "20 minutes or more."

[0178] When the care method is determined using the time length information, the care method determination unit 141 may refer to the item "life circumstances" in the table stored in the care method DB 152 to determine the care method. As described above, the "lifestyle convenience" in the tables shown in Figs. 4 and 5 includes information on lifestyle convenience in which the features of the care items can be utilized. For example, anti-inflammatory topical preparations E to H, No. 5 to 8, are mist-type preparations that can be sprayed quickly and directly onto the area where symptoms appear without getting the hands dirty, and these anti-inflammatory topical preparations E to H are associated with the information that "I cannot get my hands dirty during the day or at work" as a "lifestyle consideration." This information indicates that the time available for care is very short. When the symptom manifestation site included in the user information is "arm" and the symptom is "eczema", the care method determination unit 141 uses the user's skin information and refers to the table in Fig. 4 to extract two anti-inflammatory topical agents, anti-inflammatory topical agent B No. 2 and anti-inflammatory topical agent F No. 6, as anti-inflammatory topical agents. Furthermore, when the time length information included in the user information is "less than 10 minutes", the care method determination unit 141 can use the time length information to determine, from the two extracted anti-inflammatory topical agents B and F, anti-inflammatory topical agent F No. 6, which is associated with "cannot get hands dirty during the day or at work", indicating that the time available for care as a "lifestyle reason", is very short, as the care method to be proposed to the user. In this way, a care method may be determined using the user's skin information (specifically, symptom information and symptom manifestation site information) and time length information.

[0179] The care method determination unit 141 may determine a care method using both the user's skin information (specifically, symptom information and symptom manifestation site information), timing information, and time length information. This makes it possible to propose a care method that is more suitable for the user's life style from among multiple candidates for care methods proposed for the same symptom manifestation site and the same symptom.

[0180] As described above, in the present invention, the care method determination unit determines a care method to be suggested to a user using at least one of timing information indicating the timing when the user can provide care in accordance with their physical symptoms and duration information indicating the amount of time the user can provide care. This allows the user to be suggested a care method that is suited to the user's lifestyle and that is easy to continue to perform. Since the user is suggested a care method to be performed at a time that is convenient for them, the user can easily continue the care method and can maintain a good motivation to continue performing the care method.

[0181] In this embodiment, for ease of explanation, the table stored in the care method DB 152 shown in Figs. 4 and 5 does not include an item of the degree of symptoms, but the item of the degree of symptoms may be included. For example, when a plurality of care methods are presented as candidates for the proposed care method, a more suitable care method may be proposed to the user using the information on the degree of symptoms.

[0182] [After purchase] As described above, after purchasing a care item (after registering for membership), a skin monitoring service 22 and a period information transmission service 23 are provided as services during the period in which the care method is being performed, and after the end of the period in which the care method is being performed, a post-end information transmission service 24 is provided as a service.

[0183] In the skin monitoring service 22, the period information transmission service 23, and the after-term information transmission service 24 described later, information can be delivered using a mechanism such as email or push notification or a similar mechanism. For example, a message may be sent to a LINE (registered trademark) account.

[0184] Each service will be explained in detail below.

[0185] (Skin monitoring service) The skin monitoring process executed by the server 10 will be described with reference to the flow chart of FIG. For example, when the server 10 permits the user terminal 1 to log in to the member site based on the user ID and password entered by the user on the member site (authentication process), the user becomes able to receive the skin monitoring service 22 from the member site.

[0186] ((Skin monitoring process during initial monitoring)) Hereinafter, the skin monitoring process at the time of the first monitoring will be described in detail with reference to FIG. 12 along the flow of FIG. Fig. 12 shows an example of an image generated by the monitoring process and displayed on the display unit 41 of the user terminal 1. The example image in Fig. 12 shows an example in which the user has selected "redness" as the symptom that is currently bothering them, and "cheeks" as the site where the symptom occurs. In Fig. 12, the "redness" of the skin is represented by dots, and the difference in the degree of redness is represented by the density of the dots. The higher the degree of redness (i.e., the more severe the symptoms), the denser the dots are shown, and the lower the degree of redness (i.e., the milder the symptoms), the sparser the dots are shown.

[0187] When the skin monitoring process is started, the presentation information generation unit 143 generates an image instructing to capture a skin image including the symptom manifestation site as presentation information and transmits it to the user terminal 1. The user terminal 1 displays an image instructing to capture an image on the display unit 41 based on the received presentation information. In the image, a correction sticker 61 is attached near the symptom manifestation site 60, and an instruction is given to capture a skin image including the symptom manifestation site 60 and the correction sticker 61, and also including skin around the symptom manifestation site 60 where the symptom is not manifested.

[0188] FIG. 12(A) shows a photo check image 75 displayed on the display unit 41 of the user terminal 1, including a skin image 90 including a symptom manifestation site 60 and a correction sticker 61, photographed by a user or the like. When a "Check with this photo" button displayed on the photo check image 75 is selected by tapping or clicking, the skin image 90 photographed by the user is approved for use as a check image. The user terminal 1 transmits the skin image 90 to the server 10 based on the user's selection input operation of the "Check with this photo" button. The skin image 90 is a skin image before the start of the care method, and is hereinafter referred to as the "first-time-photographed skin image 90."

[0189] 11, the index value determination unit 144, the processing unit 142, and the presentation information generation unit 143 acquire the first-time captured skin image 90 from the user terminal 1 via the communication unit 11, and also acquire user information from the user information DB 153 (ST20). The user information is information stored in the user information DB 153 during the membership registration process in ST6 described above.

[0190] Next, index value determination unit 144 performs image analysis of analysis area 80 (described later) in first-captured skin image 90 to determine index values ​​for each of skin barrier function and uneven skin tone (redness), and determines an index value for itching using symptom severity information included in user information (ST21). User information DB 153 stores the index values ​​determined by index value determination unit 144 for each user (ST22). Note that the image analysis for determining the index value may use first-captured skin image 90 corrected by color correction unit 147 using correction sticker 61. The index value of "skin barrier function" can be suitably used to evaluate the condition of skin in symptomatic areas, where symptoms such as "eczema (bumps) / rash", "redness", "cracked / chapped skin", "darkening", "roughness / stiffness / flaking / peeling", "acne / pimples" and "scars" are present. The index value for "uneven skin tone (redness)" can be suitably used to evaluate the condition of the skin at symptom sites having symptoms such as "redness" and "darkening." The index value of "itch" can be used to evaluate the condition of the skin at the site where the symptom of "itch" occurs. If the user does not select "itch" in the questionnaire, there is no index value for "itch."

[0191] The analysis area 80 is an area to be subjected to image analysis when determining an index value of a skin condition by image analysis. The analysis area 80 is specified, for example, by the user from the initially captured skin image 90. For example, as shown in the area on the left side of the lower half area of ​​the display image 78 shown in FIG. 12(B), the analysis area 80 used for determining the index value is specified by the user's input operation using a bounding box. When determining an index value using a skin image acquired during the second or subsequent monitoring, the index value determination unit 144 sets an area located at the same position as the analysis area 80 specified in the initially captured skin image 90 as the analysis area, and performs image analysis of the set analysis area to determine the index value. Note that the image analysis for determining the index value may use a skin image corrected by the color correction unit 147 using the correction sticker 61.

[0192] Next, the processing unit 142 judges whether or not this is the first monitoring, in other words, whether or not the acquired skin image is the first captured skin image (ST23). If it is judged that this is not the first monitoring (NO in ST23), the process proceeds to ST30. The process of presenting the monitoring result in ST30 will be described later.

[0193] Here, since it is assumed that this is the first monitoring, the processing unit 142 determines that this is the first monitoring. When the processing unit 142 determines that this is the first monitoring (YES in ST23), it uses the first-captured skin image 90 to generate a processed image of the skin in a state in which the symptoms have been alleviated (ST24). The processing unit 142 outputs the generated processed image to the presentation information generation unit 143. The processing unit 142 generates one or more processed images. When generating multiple processed images, the processing unit 142 generates processed images with different degrees of symptom alleviation. Here, an example is given in which three processed images with different degrees of symptom alleviation are generated.

[0194] Next, the presentation information generating section 143 generates, as presentation information, a second display image 72 in which the first-captured skin image 90 and the three processed images 90A to 90C are displayed side by side, and transmits this to the user terminal 1 (ST25). Based on the received presentation information, the user terminal 1 displays a second display image 72 in the upper half of the display image 78 shown in FIG. 12(B).

[0195] In the second display image 72 shown in FIG. 12(B), the initially captured skin image 90 is a photograph of the user's face in which the symptom manifestation site 60 is located on the cheek. The first processed image 90A is an image in which the symptom of the symptom manifestation site 60A is slightly less severe than that of the symptom manifestation site 60 in the initially captured skin image 90, that is, the redness is slightly reduced. The second processed image 90B is an image in which the symptoms of the symptom manifestation portion 60B are further alleviated compared to the symptoms of the symptom manifestation portion 60A in the first processed image 90A, that is, the redness is further reduced. The third processed image 90C is an image in which the symptoms of the symptom manifestation portion 60C are further alleviated compared to the symptoms of the symptom manifestation portion 60B in the second processed image 90B, that is, the image in which the redness is alleviated to the greatest extent. In this way, processed images 90A-90C, which are generated using the user's current skin image (first-time captured skin image) and show the currently bothersome symptom (here, redness) reduced, are displayed on the display unit 41 of the user terminal 1, making it easier for the user to imagine the condition of their skin after performing the care method.

[0196] An instruction to select one of the three edited images 90A to 90C as the user's target is displayed on the display unit 41 of the user terminal 1. In accordance with the instruction, the user selects an edited image for the skin condition (target part condition) that the user is aiming for. The user terminal 1 transmits selection result information to the server 10, which indicates the result of the selection of one edited image by the user.

[0197] Next, the presentation information generating unit 143 receives the selection result information from the user terminal 1 (ST26). Here, it is assumed that the third processed image 90C has been selected by the user. Based on the received selection result information, the presentation information generating unit 143 sets the state of the symptom manifestation part (symptom manifestation part 60C here) of the processed image selected by the user (third processed image 90C here) as the target skin condition (part condition). The third processed image 90C can be said to be a skin image of the skin condition targeted by the user.

[0198] Furthermore, the index value determination unit 144 determines the index value of the skin barrier function and the index value of uneven color (redness) using image data of the analysis area 85 of the third processed image 90C having the symptom manifestation site 60C of the target skin condition. The index value of the skin barrier function and the index value of uneven color (redness) are target values ​​that quantitatively indicate the target skin condition when carrying out the care method. Furthermore, index values ​​for skin conditions that are difficult to judge through image analysis, such as itching, may be determined based on the results of a questionnaire that asks users what kind of skin condition they would like to achieve (for example, no itching, mild itching, etc.).

[0199] User information DB 153 stores for each user the first-captured skin image 90, an index value determined using an image of the analysis region of the first-captured skin image, etc., date information on the acquisition of the first-captured skin image, a target edited image selected by the user, an index value determined using an image of the analysis region of the edited image, etc., an index value determined by questionnaire results, etc. (ST27). The target edited image selected by the user is the "target skin image."

[0200] Next, the presentation information generating unit 143 generates, as presentation information, a third display image 73A in which the first-captured skin image 90 and a third processed image 90C that is a skin image targeted by the user are displayed, and transmits the generated information to the user terminal 1 (ST28). Based on the received presentation information, the user terminal 1 displays a third display image 73A in the lower half area of ​​a display image 78 shown in FIG. 12(B).

[0201] 12(B), the left half of the third display image 73A includes an initially captured skin image 90 and an enlarged image of an analysis area 80 selected by the user using the initially captured skin image 90. The right half of the third display image 73A includes a third processed image 90C having a skin condition targeted by the user and an enlarged image of an analysis area 85 in the third processed image 90C. The analysis area 85 is set at the same position as the analysis area 80 specified by the user using the initially captured skin image 90. In the third display image 73A, the first-taken skin image 90 and the third processed image 90C (target skin image) are displayed side by side to facilitate comparison of skin conditions. In this way, the current skin image before the skin care method is performed and the target skin image are displayed, and the specific target is visualized as an image, which can increase the user's motivation to perform the skin care method.

[0202] Furthermore, as shown in FIG. 13, the presentation information generating section 143 may generate, as the presentation information, a third display image 73B in which the index values ​​of each image are indicated, in addition to the first-captured skin image 90 and the third processed image 90C.

[0203] FIG. 13 is a third display image 73B displayed on the display unit 41 of the user terminal 1 based on the presentation information generated by the presentation information generating unit 143. In the third display image 73B, an enlarged image of the skin in the analysis area 80 of the symptom manifestation site 60 of the initially captured skin image 90, an enlarged image of the skin in the analysis area 85 of the symptom manifestation site 60C of the third processed image 90C (target skin image), and index values ​​80a and 85a determined based on the skin images of the analysis areas 80 and 85 are displayed. The index values ​​are displayed in a graph, and the skin condition is quantitatively evaluated and displayed in this manner, making it easy to intuitively grasp the difference between the current skin condition and the target skin condition. In the example shown in FIG. 13, the current skin condition and the target skin condition are visualized and displayed with images and index values, so that the user can motivate himself to continue the skin care method for 28 days with the aim of achieving the target skin condition.

[0204] As described above, the index value is determined for each of the barrier function, color unevenness (redness), and itching. The index value displayed in the third display image 73B is one or more index values ​​selected from the index value of the barrier function, the index value of color unevenness (redness), and the index value of itching. In the third display image 73B shown in FIG. 13, an example in which the index value of the barrier function is displayed is given, but in addition to this, the index value of color unevenness (redness) and the index value of itching may be displayed. Also, the index value of a symptom corresponding to the symptom information included in the user information may be displayed. For example, the index value of itching may be presented to a user who has listed "itch" as a symptom. Note that since the barrier function is an index suitable for quantitatively indicating the skin condition of relatively various symptoms, the index value of the barrier function may be always displayed.

[0205] Next, the presentation information generating unit 143 generates a display image indicating the next monitoring date and time as presentation information, and transmits it to the user terminal 1 (ST29). The user terminal 1 displays, on the display unit 41, a display image indicating the next monitoring date and time, based on the received presentation information. In this embodiment, the monitoring dates are set one week, two weeks, three weeks, and four weeks after the first monitoring date and time. One week after the first monitoring date and time is the second monitoring date, two weeks after the first monitoring date and time is the third monitoring date, three weeks after the first monitoring date and time is the fourth monitoring date, and four weeks after the first monitoring date and time is the fifth monitoring date. The fifth monitoring date is the date on which the 28-day care method implementation period ends. Furthermore, when the monitoring date is approaching, a notification to that effect may be transmitted from the server 10 to the user terminal 1. By checking the notification, the user can prevent forgetting to monitor.

[0206] ((Skin monitoring process from the second monitoring onwards)) Hereinafter, the skin monitoring process during the second and subsequent monitoring will be described in detail with reference to the flow of FIG.

[0207] In the case of the monitoring process during the second or subsequent monitoring, the presentation information generation unit 143 generates a display image as presentation information, which displays an instruction to obtain a current skin image and a questionnaire including questions about the severity of symptoms in the current symptom manifestation area (care target area), and transmits the generated display image to the user terminal 1. The questionnaire may include questions about the severity of symptoms, as well as questions about evaluations of current care methods, such as impressions and observations.

[0208] The user terminal 1 displays an image on the display unit 41 based on the received presentation information. In the image, a correction sticker 61 is attached near the symptom manifestation site, and an instruction is given to capture a skin image including the symptom manifestation site (the site where the currently bothersome symptom is manifested) and the correction sticker 61, and also including the skin surrounding the symptom manifestation site where the symptom is not manifested. In addition, instructions are given to answer questions about the severity of the current symptom manifestation site, etc. The answers to the questions (questionnaire results) are user information obtained after membership registration.

[0209] Hereinafter, the skin image acquired in the second monitoring is referred to as the second skin image, the skin image acquired in the third monitoring is referred to as the third skin image, the skin image acquired in the fourth monitoring is referred to as the fourth skin image, and the skin image acquired in the fifth monitoring is referred to as the fifth skin image, and when no particular distinction is made, they are referred to as "current skin image". In this embodiment, since the execution period of the care method is set to 28 days, the first skin image is a skin image before the execution of the care method, and the second to fifth skin images are skin images acquired from the start to the end of the execution of the care method. More specifically, the second to fourth skin images are skin images during the execution period of the care method, and the fifth skin image is a skin image at the end of the execution period of the care method. All skin images include a symptom manifestation site.

[0210] The user terminal 1 transmits the current skin image acquired by the user terminal 1 and the answers to the questions by the user (survey results) to the server 10. As shown in Fig. 11, the index value determination unit 144, the processing unit 142, and the presentation information generation unit 143 acquire the current skin image and the answers to the questions (survey results) from the user terminal 1 via the communication unit 11 (ST20).

[0211] Next, the index value determination unit 144 performs image analysis of the analysis area of ​​the current skin image, determines index values ​​for the skin barrier function and uneven skin tone (redness), and determines an index value for itching using symptom level information included in the questionnaire results (ST21). The user information DB 153 associates the determined index value with the user and stores it together with the current skin image (ST22). The analysis area used for image analysis is an area in the same position as the analysis area 80 specified by the user in the initially captured skin image 90.

[0212] Next, the processing unit 142 determines whether or not this is the first monitoring (whether or not the acquired skin image is the first captured skin image) (ST23). Since it is assumed here that this is the second or subsequent monitoring, the processing unit 142 determines that this is not the first monitoring. If it is determined that this is not the first monitoring (NO in ST23), the processing unit 142 proceeds to ST30 (monitoring result presentation processing). The monitoring result presentation processing will be described later.

[0213] In this way, a skin image and a questionnaire result of the user are acquired at each monitoring time, and an index value is determined using the skin image and the questionnaire result. The user information DB 153 stores the skin image and the index value of each monitoring time.

[0214] ((Monitoring result presentation process)) (((First Example))) As described above, when it is determined that it is not the first monitoring in the determination of whether or not it is the first monitoring in ST23 of the flow diagram shown in Fig. 11 (NO in ST23), the process proceeds to the monitoring result presentation process in ST30. The monitoring result presentation process will be described with reference to Fig. 14. Fig. 14 shows a first example.

[0215] As shown in FIG. 14, when the presentation information generation unit 143 starts the monitoring result presentation process, it acquires, from the user information DB 153, previously acquired skin images of the user (first-time captured skin image, second-time captured skin image, etc.) and their index values, as well as an edited image (hereinafter referred to as the "target skin image") that the user has set as a skin image having a target skin condition and its index value (ST31).

[0216] Next, the presentation information generation unit 143 generates a fourth display image 74 (74A, 74B) to be displayed on the display unit 41 of the user terminal 1 as presentation information based on previously acquired skin images of the user (first captured skin image, second captured skin image, etc.) and their index values, the target skin image and its index value, user information including symptom severity information (questionnaire results) of the symptom manifestation area acquired in ST20, the current skin image, and the index value of the current skin condition determined in ST21, and transmits it to the user terminal 1 (ST32).

[0217] FIG. 15 is an example of a fourth display image 74A displayed based on the presentation information generated in ST32 during the second monitoring. FIG. 16 is an example of a fourth display image 74B displayed based on the presentation information generated in ST32 during the fourth monitoring (at the end of the care method execution period). As shown in FIG. 15 and FIG. 16, the fourth display image 74 (74A, 74B) includes an intermediate skin image and an initially captured skin image. The "intermediate skin image" includes not only the current skin image, but also skin images captured earlier than that, excluding the initially captured skin image. Furthermore, as shown in FIG. 15, the fourth display image 74A further includes a target skin image.

[0218] In the fourth display image 74 (74A, 74B) shown in Fig. 15 and Fig. 16, enlarged analysis areas of the skin images are arranged in chronological order based on the photographing date. The analysis areas of each skin image are set to be at the same skin position, so that skin parts at the same position can be compared. In the example shown in Figure 15, analysis area 80 of the initially captured skin image 90 and analysis area 81 of the intermediate skin image are arranged in chronological order from left to right with the most recent capture date, and further analysis area 85 of the target skin image is arranged to the right of analysis area 81 of the current skin image. In the example shown in FIG. 16, the analysis area 80 of the initially captured skin image 90 and the analysis areas 81 to 84 of the intermediate skin images are arranged in chronological order from left to right with the most recent capture date. In this way, by arranging the skin images in chronological order, the user can check the current skin condition, as well as understand the changes in skin condition since the first day of the skin care method, and intuitively understand the progress toward the target skin. This makes the results of the skin care method visible, and helps to maintain the motivation to continue the skin care method. In the example shown in FIG. 16, the analysis area of ​​the target skin image is not displayed, but the analysis area of ​​the target skin image may be displayed. This allows the user to understand how close the skin is to the target skin after the care method execution period is completed, and gives the user a sense of accomplishment. In addition, even after the care method execution is completed, the user is more likely to be motivated to maintain the improved skin, and the user's interest in skin can be further increased.

[0219] 15 and 16, in addition to the skin images, the index values ​​corresponding to each skin image (80a, 81a, 85a in FIG. 15, and 80a, 81a, 82a, 83a, 84a in FIG. 16) are displayed in graph form. In this way, the change in index value from the first day of the start of the care method is displayed in graph form as an evaluation result in which the skin condition is quantitatively evaluated, making it easier to intuitively grasp the change in skin condition and the degree to which the target skin has been achieved.

[0220] (((Second Example))) In the monitoring result presentation process, in addition to generating the fourth display image shown in FIG. 14, presentation information for presenting caution information to the user may be generated, which will be described below with reference to FIG. 17 as a second example.

[0221] As shown in FIG. 17, when the presentation information generating unit 143 starts the monitoring result presentation process, it obtains the previously acquired user's skin image and its index value, and the target skin image and its index value from the user information DB 153 (ST31).

[0222] Next, the determination unit 145 determines whether the index value determined in ST21 for the current skin image is greater than the index value determined for the previously captured skin image (ST34). If the index value for the current skin image is greater than the index value for the previously captured skin image, this indicates that the condition has improved. If the index value for the current skin image is equal to or less than the index value for the previously captured skin image, this indicates that the condition has not changed or has worsened. The comparison of index values ​​is performed using, for example, an index value for the barrier function.

[0223] In this embodiment, in ST34, in comparing the index value for the current skin image with the index value for the previously captured skin image, it is determined whether the index value for the current skin image is greater than the index value for the previously captured skin image, but this is not limited to the above. For example, it may be determined whether the index value for the current skin image is equal to or greater than the index value for the previously captured skin image. In other words, if there is no change in the symptoms or if there is an improvement in the symptoms, the process may proceed to ST35. Furthermore, when the analysis value of the image analysis is used as the index value, the accuracy of the image analysis may be taken into account. Even if the index value for the current skin image is smaller than the index value for the previously captured skin image, if the difference is less than or equal to a (where a is an arbitrary numerical value), it may be determined that there is no change in symptoms and the process may proceed to ST35. Also, the index value of the current skin image may be compared with the index value of the initially captured skin image, making it easier to grasp the improvement in skin condition as a result of the implementation of the skin care method, even if the improvement in condition is moderate.

[0224] When the determination unit 145 determines that the index value of the current skin image is greater than the index value of the previously captured skin image (YES in ST34), it outputs the determination result to the presentation information generation unit 143. The presentation information generation unit 143 generates an image showing a recommendation to continue the currently performed skin care method as presentation information, and transmits it to the user terminal 1 (ST35). The user terminal 1 displays a display image recommending continuation of the currently performed care method based on the received presentation information.

[0225] On the other hand, if the determination unit 145 determines that the index value of the current skin image is not greater than the index value of the previously captured skin image (NO in ST34), it outputs the determination result to the presentation information generation unit 143. The presentation information generation unit 143 generates an image showing caution information about the currently performed care method as presentation information, and transmits it to the user terminal 1 (ST36).

[0226] The above-mentioned warning information includes information that is considered to be the cause of symptoms not improving or worsening, such as reviewing the usage method of the care item, etc. For example, when a cleaning agent is included in the care method, the presentation information generating unit 143 generates an image displaying warning information that recommends reviewing the care method, such as whether the cleaning agent has been rinsed off or whether the cleaning agent has been used excessively (over-washed). The presentation information generation unit 143 may refer to a warning information DB (not shown) in which warning information including data corresponding to the cause, area, and symptoms for which no improvement in symptoms is observed by performing the care method is pre-stored for each care method, to determine the warning information to be presented, and generate the presentation information including the warning information. In this way, by providing warning information, it is possible to provide support tailored to the condition of the skin.

[0227] (((Example 3))) In the monitoring result presentation process, in addition to the fourth display image generated by the flow shown in Figure 14, a display image showing another care method newly proposed to the user may be generated as presentation information, which will be explained below using Figure 18 as a third example.

[0228] As shown in FIG. 18, when the presentation information generating unit 143 starts the monitoring result presentation process, it acquires a previously acquired user's skin image and its index value, and a target skin image and its index value from the user information DB 153 (ST31).

[0229] Next, the determination unit 145 determines whether or not the index value determined in ST21 for the current skin image is greater than the index value determined for the previously captured skin image (ST34).

[0230] When the determination unit 145 determines that the index value of the current skin image is greater than the index value of the previously captured skin image (YES in ST34), it outputs the determination result to the presentation information generation unit 143. The presentation information generation unit 143 generates an image showing a recommendation to continue the currently performed skin care method as presentation information, and transmits it to the user terminal 1 (ST35). The user terminal 1 displays a display image recommending continuation of the currently performed care method based on the received presentation information.

[0231] On the other hand, when the determination unit 145 determines that the index value of the current skin image is not greater than the index value of the previously captured skin image (NO in ST34), it outputs the determination result to the care method determination unit 141. The care method determination unit 141 obtains, from the user information DB 153, the user information acquired before the purchase and the questionnaire results (user information) answered by the user at the same time as acquiring the current skin image in ST20 after the purchase (ST37).

[0232] Next, the care method determination unit 141 extracts candidate care methods from the care method information stored in the care method DB 152 based on the user information (ST38). Specifically, a care method that matches the symptom manifestation site information and the symptom information included in the user information is extracted from the care method DB 152. The candidate care method extraction step of ST38 is substantially similar to the candidate care method extraction step of ST11. In ST38, if the answer to the same question is different before and after purchase in the user information acquired from the user information DB 153, the candidate care method is extracted by using the information after purchase with priority. For this reason, the care method extracted in the candidate care method extraction step of ST38 may not match the care method extracted in the candidate care method extraction step of ST11 performed before purchase.

[0233] Next, the care method determination unit 141 determines whether or not there is a care method currently being performed by the user among the extracted candidate care methods (ST39).

[0234] When the care method determination unit 141 determines that there is a care method currently being executed (YES in ST39), it excludes the currently executed care method from the extracted candidates (ST40) and proceeds to ST41.

[0235] On the other hand, if the care method determination section 141 determines that no care method is currently being executed (NO in ST39), the process proceeds to ST41. In ST41, the care method determination unit 141 determines an executable care method using timing information included in the user information. The care method determination unit 141 outputs information on the determined care method to be proposed to the user to the presentation information generation unit 143. The care method determination step of ST41 is substantially the same as the care method determination step of ST13 described above.

[0236] The presentation information generating unit 143 generates a care method presentation image showing the determined care method as presentation information, and transmits it to the user terminal 1 (ST42). The user terminal 1 displays, on the display unit 41, a care method presentation image showing the new care method, based on the received presentation information. In this way, if no improvement is seen in the symptoms, a new care method may be suggested, and support tailored to the skin condition may be provided. This dispels the user's concerns about whether it is okay to continue with the initially suggested care method.

[0237] (Information dissemination service during the period) The period information transmission service 23 is a service provided to the user during the period in which the care method is performed, and provides information on the care method, etc. For example, the service 23 transmits information generated by the transmission information generation unit 146. The transmission information generation unit 146 generates evaluation information, detailed information on how to use a care item, etc., based on symptom manifestation site information and evaluation results of the care method of other users who have performed or are performing the same care method as the user.

[0238] 19 and 20 are examples of images of information transmission displayed on the user terminal 1. As in the display image 76 shown in Fig. 19, the amount of use of the care item may be displayed in text, or information may be transmitted so that the amount of use can be confirmed by a still image or a video. Also, as in the display image 77 shown in Fig. 20, on the first day (the 1st, 8th, 15th, and 22nd days after starting the care method) of the divided period (1st to 4th weeks), the goal of the divided period, evaluation information based on the evaluation results of other users who actually performed the care method, and the like may be transmitted.

[0239] The transmission information generating unit 146 can acquire user information such as symptom manifestation site information and information on the evaluation results of the care method of other users from the user information DB 153. An example of information transmission processing in which transmission information is generated using user information of other users will be described with reference to the flow diagram of Fig. 21 .

[0240] As shown in FIG. 21, the transmission information generating section 146 acquires user information of a user who is a target of information transmission from the user information DB 153 (ST60). Next, the transmission information generating unit 146 refers to the user information DB 153 to acquire symptom manifestation site information and evaluation results for the care method associated with other users who are performing the same care method (ST61). Next, the transmission information generation unit 146 generates evaluation information to be presented to the user to whom information is to be transmitted, using the acquired symptom manifestation site information of other users and the evaluation results of the care method, and outputs the evaluation information to the presentation information generation unit 143. The presentation information generation unit 143 generates presentation information in which the evaluation information is associated with the care method, and transmits the presentation information to the user terminal 1 (ST62). Based on the presentation information received from the server 10, the user terminal 1 displays an image such as FIG. 20 including the evaluation information on the display unit 41.

[0241] (Post-retirement information service) The post-termination information transmission service 24 is a service provided to the user after the completion of the care method implementation period, and provides information on the care method, etc. For example, information inviting monitoring of skin condition at the change of seasons, advice on maintaining improved skin condition, etc. are transmitted.

[0242] Furthermore, a questionnaire may be conducted for the user, for example, two weeks after the end of the execution of the care method, to ask for an evaluation such as the current state of the symptom manifestation site (care target site) where the care method was executed, and impressions and realizations after the execution of the care method. The user's cooperation in the questionnaire is optional. The user information DB 153 stores the questionnaire results (user information) from the user for each user. The evaluation results after the execution of the care method may be used to generate information to be transmitted to other users during the period by the information transmission service 23. Note that, although an example is given here in which the questionnaire is conducted two weeks after the execution of the care method, the timing of the questionnaire is not limited to this.

[0243] <Other> The following describes modified examples.

[0244] [Variation 1] In the above embodiment, an example was given in which a skin image of the user before starting a skin care method is acquired after member registration, but a skin image before starting a skin care method may be acquired before member registration. Then, a skin care method may be determined by the skin care method determination unit 141 using the analysis result of the skin image before starting the skin care method, in addition to the user's skin information based on the questionnaire result obtained from the input image. Also, at this time (before member registration), a processed image of skin in a state where symptoms are alleviated may be generated using the skin image before starting the skin care method and presented to the user. This makes it easier to imagine the skin condition after the skin care method is performed, making it easier for the user to get an opportunity to perform the skin care method.

[0245] [Variation 2] In the above embodiment, only one server 10 is shown, but the processes executed by the server 10 may be distributed and executed by a plurality of servers. For example, among the care method determination process by the care method determination unit 141, the processing process by the processing unit 142, the presentation information generation process by the presentation information generation unit 143, the index value determination process by the index value determination unit 144, the determination process by the determination unit 145, and the transmission information generation process by the transmission information generation unit 146, which are performed in the processing unit 14, some of the processes and the other processes may be executed by different servers.

[0246] In addition, in the above-described embodiment, an example was given in which one server 10 has a processing unit 14 and a memory unit 15. However, as in the information processing system 100A shown in FIG. 22, the care method suggestion server 10A having the processing unit 14 and the data server 25A having various databases such as a care method DB 152 and a user information DB 153 may be separate servers. In addition, as in the information processing system 100B shown in FIG. 23, a program for executing the processing performed by the above-mentioned processing unit 14 may be downloaded to the user terminal 8, and the processing may be performed by the user terminal 8, and the user terminal 8 may have a processing unit 5A having a care method determination unit 141, a processing unit 142, a presentation information generation unit 143, an index value determination unit 144, a judgment unit 145 and a transmission information generation unit 146, and a program memory unit 151.

[0247] In particular, the care method DB 152 referred to by the care method determination unit 141 is preferably realized by a plurality of individual servers under the management of a plurality of companies that provide care items.

[0248] [Variation 3] In the above embodiment, an example was given in which the timing information and / or time length information of the user is acquired by directly asking the user in a questionnaire about the timing when the user can perform care according to the physical symptoms and / or the length of time the user can take for care, but this is not limited to the above. For example, the timing when the user can perform care according to the physical symptoms and / or the length of time the user can take for care may be predicted from the answer result to a question that does not directly ask about the timing or the length of time, and the predicted result may be the timing information and / or time length information of the user (user information).

[0249] The questions that do not directly ask about timing or time are, for example, questions asking about the user's lifestyle, the user's personality, the user's approach to care, etc. From the answer to at least one of these questions, it is possible to predict the timing when the user can provide care according to physical symptoms and / or the length of time the user can provide care. For example, only questions about the user's lifestyle may be asked, or only questions about the user's personality may be asked, or only questions about the user's approach to care may be asked. Three questions may be asked: questions about the user's lifestyle, questions about the user's personality, and questions about the user's approach to care. Questions about the user's lifestyle and questions about the user's personality or questions about the user's approach to care may be asked. Questions about the user's personality and questions about the user's approach to care may be asked. From the viewpoint of proposing a care method that is more suited to the user's lifestyle, it is preferable to ask questions about the user's lifestyle and questions about the user's personality or questions about the user's approach to care. Below are some specific examples of questions.

[0250] As questions about the user's lifestyle, for example, <1> ~ <8> You may choose one or more of the eight options that best suit your lifestyle. <1> I want to sleep as much as possible in the morning <2> There is so much to do in the morning and so little time <3> I want to get up early in the morning and be well prepared for the day. <4> I value my bath time and stay in it for a long time. <5> At night, people have less free time and tend to take a short bath. <6> I often work late into the night, so it's hard to find time in the evenings. <7> I was helping my child to sleep and before I knew it, I was sleeping with him <8> There is plenty of time before bedtime

[0251] Answers to questions about the user's lifestyle can predict when the user will be able to provide care and / or the length of time the user will have to provide care. <1> or <2> By selecting this, it can be predicted that the time available for care after waking up in the morning (timing information) is short (time length information). <3> By selecting this, it can be predicted that the time available for care after waking up in the morning (timing information) is long (time length information, longer than "short time"). <4> By selecting this, it can be predicted that the time available for care during bathing (timing information) will be long (duration information). <5> By selecting this, it can be predicted that the time available for care at night (during / after bathing, before going to bed) (timing information) will be short (time length information). <6> By selecting this, it can be predicted that the time available for care at night (during / after bathing, before going to bed) (timing information) will be short (time length information). <7> By selecting this, it can be predicted that the time available for care at night (during / after bathing, before going to bed) (timing information) will be short (time length information). <8> By selecting this, it can be predicted that the time available for care at night (during / after bathing, before going to bed) (timing information) will be short (time length information).

[0252] As a question about the user's personality, for example, <9> and <10> Alternatively, the user may select one of the two options that best represents his or her own personality. <9> Once I decide to do something, I do it well <10> I don't like to do anything troublesome

[0253] The answers to questions about the user's personality can predict when the user will be able to provide care and / or the amount of time the user will be able to provide care, and in particular can more accurately predict the amount of time the user will be able to provide care. <9> By selecting this option, it is possible to predict that the time available for care will be long (time length information), and that the timing when care can be provided will not be restricted (timing information). <10> By selecting this, it can be predicted that the time available for care will be short (time length information). In addition, since people generally tend to be busy in the morning and have more time to take care of their pet in the evening, it can be predicted that the best time for care will be before going to bed (timing information). In addition, when two questions, one about the user's lifestyle and the other about the user's personality, are asked, the answer to the question about the user's lifestyle predicts that the time available for care will be long, and the answer to the question about the user's personality predicts that the time available for care will be long. <9> When you are in a hurry, you can take the time to care for yourself. <10> In this case, it can be predicted that the time available for care will be "adequate" (shorter than "enough").

[0254] As a question about how the users approach care, for example, <11> and <12> Patients may be asked to choose one of the two options that best describes how they want to care for themselves. <11> I like to take time to look after my skin (I like to take good care of it) <12> I am concerned about my skin, but I want to continue with my lifestyle (I don't have much time).

[0255] Answers to questions regarding the user's approach to care can be used to predict when the user will be able to provide care and / or the amount of time the user will be able to devote to care, and in particular can more accurately predict the amount of time the user will be able to devote to care. <11> By selecting this option, it is possible to predict that the time available for care will be long (time length information), and that the timing when care can be provided will not be restricted (timing information). <12> By selecting this, it can be predicted that the time available for care will be short (time length information). In addition, since people generally tend to be busy in the morning and have more time to take care of their pet in the evening, it can be predicted that the best time for care will be before going to bed (timing information). In addition, when two questions, one about the user's lifestyle and the other about the user's approach to care, are asked, as described above, the answer to the question about the user's lifestyle predicts that the time available for care will be long, and the answer to the question about the user's approach to care is <11> When you are in a hurry, you can take the time to care for yourself. <12> In this case, it can be predicted that there will be a "reasonable amount" of time available for care.

[0256] In this way, the server may indirectly predict the timing at which care can be provided and / or the length of time available for care from the answers to questions asking about these, use the predicted result as timing information and / or length of time information for the user, and suggest a care method in accordance with the timing information and / or length of time information.

[0257] In detail, the server may extract care items based on the symptom information and symptom occurrence location information contained in the user information, and then select and present from among them a care method appropriate to the timing of care and the amount of time available for care, by referring to the answers to questions asking about at least one of the user's lifestyle, the user's personality, and the user's approach to care.

[0258] Here is a concrete example. Here, two questions are asked: one about the user's lifestyle and the other about the user's personality (or the user's approach to care).

[0259] For example, a questionnaire can be used to ask questions about the user's lifestyle. <1> , <2> , <4> , <7> was selected, and the question about the user's personality <9> (Or questions about how to approach user care <11> ) is selected, the server will suggest "light care in the morning, thorough care during / after bathing" (a care method that takes time to thoroughly care during / after bathing) as the care method. As the care method, a care method that can be performed in a short time in the morning is selected, and a care method that takes more time during / after bathing is selected (care that takes 20 minutes or more during / after bathing).

[0260] The survey asks questions about the user's lifestyle. <1> , <2> , <4> , <7> was selected, and the question about the user's personality <10> (Or questions about how to approach user care <12> ) is selected, the server will suggest "light care in the morning, thorough care during / after bathing" (a care method that takes a moderate amount of time during / after bathing) as the care method. As the care method, a care method that can be performed in a short time in the morning is selected, and a care method that takes more time during / after bathing is selected (10 to 20 minutes of care during / after bathing).

[0261] The survey asks questions about the user's lifestyle. <1> , <2> , <5> , <8> was selected, and the question about the user's personality <9> (Or questions about how to approach user care <11> ) is selected, the server will suggest "light care in the morning and thorough care before going to bed" (a care method that takes time to thoroughly care before going to bed) as the care method. As the care method, a care method that can be performed in a short time in the morning is selected, and a care method that takes more time before going to bed is selected (care that can be performed for 20 minutes or more before going to bed).

[0262] The survey asks questions about the user's lifestyle. <1> , <2> , <5> , <8> was selected, and the question about the user's personality <10> (Or questions about how to approach user care <12> ) is selected, the server will suggest "light care in the morning and thorough care before bedtime" (a care method that takes a moderate amount of time before going to bed) as the care method. As the care method, a care method that can be performed in a short time in the morning is selected, and a care method that takes more time before going to bed is selected (care that can be performed for 10 to 20 minutes before going to bed).

[0263] The survey asks questions about the user's lifestyle. <3> , <6> was selected, and the question about the user's personality <9> (Or questions about how to approach user care <11> ) is selected, the server proposes "strong care in the morning and light care at night" (a care method that takes time in the morning) as the care method. As the care method, a care method that takes a lot of time in the morning is selected, and a care method that can be done in a short time at night (during / after bathing, before going to bed) is selected (care for 20 minutes or more in the morning).

[0264] The survey asks questions about the user's lifestyle. <3> , <6> was selected, and the question about the user's personality <10> (Or questions about how to approach user care <12> ) is selected, the server will suggest "strong care in the morning and light care at night" (a care method that takes a moderate amount of time in the morning) as the care method. As the care method, a care method that takes a lot of time in the morning is selected, and a care method that can be performed in a short time in the evening (during / after bathing, before going to bed) is selected (10 to 20 minutes of care in the morning).

[0265] The survey asks questions about the user's lifestyle. <1> , <4> , <6> was selected, and the question about the user's personality <9> or <10> (Or a question about how to approach user care <11> or <12> ) is selected, the server will suggest "light care in the morning and light care in the evening" as the care method. As the care method, a care method that can be performed in a short time both in the morning and in the evening (during / after bathing and before going to bed) is selected.

[0266] The survey asks questions about the user's lifestyle. <3> , <4> , <8> was selected, and the question about the user's personality <9> (Or questions about how to approach user care <11> ) is selected, the server proposes "good care in the morning and good care at night" (a care method that takes time and good care) as the care method. As the care method, a time-consuming care method is selected both in the morning and in the evening (during / after bathing and before going to bed) (care for 20 minutes or more each in the morning and evening).

[0267] The survey asks questions about the user's lifestyle. <3> , <4> , <8> was selected, and the question about the user's personality <10> (Or questions about how to approach user care <12> ) is selected, the server will suggest "good care in the morning and good care at night" (a care method that takes a moderate amount of time) as the care method. As the care method, a time-consuming care method is selected both in the morning and in the evening (during / after bathing and before going to bed) (10 to 20 minutes of care each in the morning and evening).

[0268] [Variation 4] (Variation 4-1) The pre-purchase questionnaire may include a multiple choice question asking about the type of user, which may include one or more selected from personality, habits, values, behavioral patterns, etc., and the multiple choices may be presented in text. The server may assume the user's type based on the user's answers to the questions, and display an iconized character representing the user's type on the display unit of the user's terminal. The user can visually and intuitively grasp the user's type from the design of the character icon. By looking at the character icon representing the user's type, the user can easily recognize that the care method is for the user, in which the user is involved as a person involved, which leads to a desire to carry out the care method. The character icon may be displayed by tapping "My care method" on the monitoring screen after purchase (see Figs. 19 and 20). By seeing the character icon that represents the user's type, the user is reminded that the care method is for him / her, and is likely to maintain a good motivation to continue the care method.

[0269] The characters may be, for example, anime characters that are generally well known for their types of personality, habits, values, behavior patterns, etc. As an example, it is generally known that a character named A in a certain anime is reliable and neat, while a character named B is lazy and does things at his own pace. The server assumes the user's type based on the above answer results, and decides whether to display the character A or B to the user. The server may present a care method corresponding to the character. For example, the server presents a care method of "good care in the morning and good care at night" to a user of a user terminal on which the icon of A is displayed. The server presents a care method of "light care in the morning and light care at night" to a user of a user terminal on which the icon of B is displayed.

[0270] (Variation 4-2) In the modified example 4-1, multiple options for a question inquiring about the user's type, such as personality, habits, values, and behavioral patterns, are displayed in text form in the pre-purchase questionnaire, but they may be displayed in pictures. The server may display multiple iconized characters representing various types as options for the question inquiring about the user's type in the pre-purchase questionnaire on the display unit of the user terminal. The user may then be allowed to select one type that best suits him or her.

[0271] As in the modified example 4-1, the displayed characters may be images of well-known anime characters, etc. Alternatively, an iconized character may be displayed together with text explaining the type that the character represents.

[0272] Assume that it is generally known that a character named A in a certain anime is reliable and neat, while a character named B is lazy and does things at his own pace. The server displays the characters A and B on the display unit of the user's terminal as options for a question asking about the user's type. Then, based on the user's character selection, a care method may be presented to the user. For example, a care method of "good care in the morning and good care at night" is presented to a user who selects A. A care method of "light care in the morning and light care at night" is presented to a user who selects B.

[0273] In this way, multiple options for the question asking about the user's type may be displayed in pictures. By looking at the pictures of multiple iconized characters and selecting one's type, a simple and intuitive selection is possible. By looking at the character icon that represents one's type, the user can easily recognize that the care method is for oneself, in which oneself is involved as a person involved, which leads to a desire to carry out the care method. The character icon may be displayed by tapping "My care method" on the monitoring screen after purchase (see Figs. 19 and 20). By seeing the character icon that represents the user's type, the user is reminded that the care method is for him / her, and is likely to maintain a good motivation to continue the care method. [Explanation of symbols]

[0274] 41...Display section 100...Information processing systems 141…Care Method Decision Unit 142…Processing department 143…Presentation information generation unit 152...Care method DB (care method information storage unit)

Claims

1. Acquire care method information that associates multiple care methods for each physical symptom with care methods for physical symptoms; Acquire physical symptom information indicating the physical symptom of the user, and at least one of timing information indicating a timing at which the user can provide care in response to the physical symptom and time length information indicating a time length at which the user can provide the care; A care method to be proposed to the user is determined from the plurality of care methods based on the physical symptom information and at least one of the timing information and the time length information. Care Method Decision Unit An information processing system comprising:

2. the care method information includes care item information in which a plurality of care items are associated with each physical symptom with respect to care items capable of caring for the physical symptom, and The care method determination unit determines the care method including a care item to be proposed to the user, which is determined from the plurality of care items, based on physical symptom information and at least one of the timing information and the time length information. The information processing system according to claim 1 .

3. The care method proposed to the user includes timing information for using the care item. The information processing system according to claim 2 .

4. The care method determination unit acquiring the physical symptom information and at least one of the timing information and the duration information; A timing for executing the care method is determined based on at least one of the timing information and the time length information, and the care method is determined by reflecting the determination result. The information processing system according to claim 1 .

5. the physical symptom information includes symptom occurrence site information indicating a body site where a symptom has occurred and symptom information indicating a symptom of the body site; The care method determination unit determines the care method based on the symptom occurrence site information and the symptom information. The information processing system according to claim 1 .

6. the physical symptom information includes symptom occurrence frequency information at a symptom occurrence site, The care method determination unit determines whether or not to suggest the care method to the user based on the occurrence frequency information. The information processing system according to claim 5 .

7. a presentation information generation unit that generates presentation information for proposing the care method to the user; Further provided with The information processing system according to claim 1 .

8. The presentation information generation unit generates a first display image showing the care method as the presentation information. The information processing system according to claim 7 .

9. The presentation information generation unit A period for carrying out the care method is set as a care method execution period of a predetermined length; Dividing the care method execution period into a plurality of divided periods and generating the presentation information including care goal information for each divided period The information processing system according to claim 7 .

10. a processing unit that acquires an image of a symptom manifestation site where the user's symptoms are manifested, which is acquired before the start of execution of the care method, and generates a processed image of the symptom manifestation site in a state where the symptoms are alleviated, using the image of the symptom manifestation site; Further provided with The presentation information generation unit A second display image is generated as the presentation information, in which an image of the symptom manifestation site before the start of the care method and the processed image are displayed. The information processing system according to claim 7 .

11. The processing unit is As the processed image, a plurality of processed images having different degrees of symptom relief are generated, The presentation information generation unit The second display image, in which an image of the symptom manifestation site before the start of the care method and the plurality of processed images are displayed, is generated as the presentation information. The information processing system according to claim 10.

12. The presentation information generation unit acquiring selection result information indicating a result of the user selecting one of the plurality of processed images displayed on the second display image; Based on the selection result information, the processed image selected by the user is set as a target part state, and a third display image is generated as the presented information, in which the processed image of the target part state and an image of the symptom-presenting part before the start of the care method are displayed. The information processing system according to claim 11.

13. The presentation information generation unit receiving images of the symptom site during the course of the care method; A fourth display image is generated as the presentation information, in which the image of the symptom manifestation site during the progress, the processed image of the target site state, and the image of the symptom manifestation site before the start of the care method are displayed. The information processing system according to claim 12.

14. The presentation information generation unit The fourth display image further includes an evaluation result obtained by quantitatively evaluating the state of the symptom manifestation site for each of the image of the symptom manifestation site before the start of the care method, the image of the symptom manifestation site during the progress, and the processed image of the target site state, as the presented information. The information processing system according to claim 13.

15. The method further includes a transmission information generation unit that generates evaluation information to be presented to the user using symptom occurrence site information and evaluation results of the care method of other users who have performed the care method, The presentation information generation unit The presentation information is generated by associating the care method with the transmitted information. The information processing system according to claim 7 .

16. a display unit that displays the presentation information generated by the presentation information generation unit and presents it to the user; Further provided with The information processing system according to claim 7 .

17. a care method information storage unit for storing the care method information; Further provided with 3. The information processing system according to claim 1 or 2.

Images