Information processing device, client device, program, and system
The information processing system uses a tactile sensor and estimation formulas to standardize skin condition assessment, reducing variability and providing personalized skincare advice based on tactile and behavioral data.
Patent Information
- Application Number
- JP2023000344
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2017-11-30
- Filing Date
- 2023-01-05
- Publication Date
- 2025-08-08
- Estimated Expiration
- 2038-10-18
AI Technical Summary
The results of skin palpation for determining skin condition vary based on the expertise of the person performing the palpation, leading to inconsistent advice in cosmetics selection.
An information processing system that includes a tactile sensor to measure skin characteristics, a client device to acquire and transmit tactile information, and a server to estimate skin condition using estimation formulas, providing real-time and one-time information based on tactile and behavioral data to standardize skin assessment.
Standardizes skin condition assessment, reducing variations and providing personalized skincare advice tailored to individual skin conditions.
Smart Images

Figure 0007720873000001 
Figure 0007720873000002 
Figure 0007720873000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device, a client device, and a program. [Background technology]
[0002] In general, cosmetics used for skin care are preferably selected according to the condition of the skin. At a cosmetics store, a salesperson with specialized skin knowledge directly touches the customer's skin to identify the physical characteristics of the customer's skin (e.g., the unevenness and hardness of the skin). The salesperson then provides the customer with advice (e.g., skin care methods and cosmetics to be used for skin care) according to the identified skin condition. The customer then purchases cosmetics according to the salesperson's advice.
[0003] For example, Patent Document 1 discloses a technique for determining the skin condition according to the results of palpation in order to identify the skin condition based on the feel of the skin. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 5357363 Summary of the Invention [Problem to be solved by the invention]
[0005] However, the results of the skin palpation in Patent Document 1 depend on the expertise or experience of the person performing the palpation. Therefore, the results vary from person to person. Therefore, if the technology in Patent Document 1 is used in a cosmetics store, the advice provided by the salesperson may not be suitable for the subject's skin.
[0006] An object of the present invention is to prevent variations in the results of skin condition assessment based on the feel of the skin. [Means for solving the problem]
[0007] One aspect of the present invention is means for acquiring tactile information indicating physical characteristics related to the tactile sensation of a user's skin; The information processing device comprises means for presenting first information regarding the user's skin condition based on the tactile information, and at least one of second information regarding the user's skin condition based on tactile log information including a plurality of tactile information. [Effects of the Invention]
[0008] According to the present invention, it is possible to prevent variations in the results of skin condition assessment based on the feel of the skin. [Brief explanation of the drawings]
[0009] [Figure 1] 1 is a block diagram showing a configuration of an information processing system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a schematic diagram showing the configuration of the tactile sensor of FIG. [Figure 3] FIG. 1 is an explanatory diagram of an overview of the present embodiment. [Figure 4] FIG. 2 is a diagram illustrating a data structure of a user information database according to the present embodiment. [Figure 5] FIG. 2 is a diagram showing the data structure of a tactile log information database according to the present embodiment. [Figure 6] FIG. 2 is a diagram illustrating a data structure of an action log information database according to the present embodiment. [Figure 7] FIG. 2 is a diagram showing the data structure of a mind-body log information database according to the present embodiment. [Figure 8] FIG. 2 is a diagram showing a data structure of a skin evaluation log information database according to the present embodiment. [Figure 9] FIG. 2 is a diagram showing the data structure of a content matching table according to the present embodiment. [Figure 10] FIG. 2 is a diagram illustrating a data structure of a task information database according to the present embodiment. [Figure 11] FIG. 10 is a sequence diagram of a content presentation process according to the present embodiment. [Figure 12]12A and 12B are diagrams showing examples of screens displayed in the information processing of FIG. 11. [Figure 13] 12A and 12B are diagrams showing examples of screens displayed in the information processing of FIG. 11. [Figure 14] 12A and 12B are diagrams showing examples of screens displayed in the information processing of FIG. 11. [Figure 15] FIG. 10 is a sequence diagram of a task update process according to the present embodiment. [Figure 16] 16 is a diagram showing an example of a screen displayed in the information processing of FIG. 15. FIG. [Figure 17] 10 is a flowchart of a process for correcting an estimation formula according to the present embodiment. [Figure 18] FIG. 13 is a schematic diagram showing the configuration of a tactile sensor according to a sixth modification. DETAILED DESCRIPTION OF THE INVENTION
[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In the drawings for explaining the embodiment, the same components are generally designated by the same reference numerals, and repeated description thereof will be omitted.
[0011] (1) Information processing system configuration The configuration of the information processing system will now be described with reference to Fig. 1, which is a block diagram showing the configuration of the information processing system according to this embodiment.
[0012] As shown in FIG. 1, the information processing system 1 includes a client device 10, a server 30, a tactile sensor 40, a log device 50, and a predicted information providing server 70. The client device 10, the server 30, and the prediction information providing server 70 are connected via a network (for example, the Internet or an intranet) NW.
[0013] The client device 10 is an example of an information processing device that transmits a request to the server 30. The client device 10 is, for example, a smartphone, a tablet terminal, or a personal computer.
[0014] The server 30 is an example of an information processing device that provides the client device 10 with a response in response to a request transmitted from the client device 10. The server 30 is, for example, a web server.
[0015] Touch sensor 40 is configured to measure information relating to the physical properties of human skin that are related to touch.
[0016] The log device 50 acquires at least one of environmental information relating to the environment in which the user spent time, behavioral information relating to the user's behavior, and mental and physical information relating to the user's mind and body. The log device 50 is, for example, a wearable device that can be worn by the user. The log device 50 is connected to the client device 10 via a wired or wireless connection.
[0017] The predicted information providing server 70 is an example of an information processing device that provides predicted information indicating future predictions. The predicted information providing server 70 provides, for example, the following information: Tactile sensation prediction information indicating a prediction of the future tactile sensation of the user's skin Behavioral prediction information indicating predictions (e.g., plans) of future user behavior · Physical and mental prediction information showing the user's future physical and mental predictions (e.g., predicted dates of the menstrual cycle)
[0018] (1-1) Client device configuration The configuration of the client device 10 will be described with reference to FIG.
[0019] As shown in FIG. 1, the client device 10 includes a storage device 11, a processor 12, an input / output interface 13, a communication interface 14, and a GPS module 15.
[0020] The storage device 11 is configured to store programs and data, and is, for example, a combination of a read-only memory (ROM), a random access memory (RAM), and a storage (for example, a flash memory or a hard disk).
[0021] The programs include, for example, the following programs: OS (Operating System) programs Applications that process information (e.g., web browsers)
[0022] The data includes, for example, the following data: Databases referenced in information processing Data obtained by performing information processing (i.e., the results of performing information processing)
[0023] The processor 12 is configured to implement the functions of the client device 10 by running a program stored in the storage device 11. The processor 12 is an example of a computer.
[0024] The input / output interface 13 is configured to receive user instructions from an input device connected to the client device 10, acquire information from the tactile sensor 40, and output the information to an output device connected to the client device 10. The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display.
[0025] The communication interface 14 is configured to control communication between the client device 10 and the server 30 .
[0026] The GPS module 15 is configured to acquire location information of the client device 10 by communicating with a GPS (Global Positioning System) satellite.
[0027] (1-2) Server configuration The configuration of the server 30 will be described with reference to FIG.
[0028] As shown in FIG. 1, the server 30 includes a storage device 31, a processor 32, and a communication interface .
[0029] The storage device 31 is configured to store programs and data, and is, for example, a combination of ROM, RAM, and storage (for example, flash memory or a hard disk).
[0030] The programs include, for example, the following programs: OS programs Application programs that perform information processing
[0031] The data includes, for example, the following data: Databases referenced in information processing - Results of information processing
[0032] The processor 32 is configured to implement the functions of the server 30 by running a program stored in the storage device 31. The processor 32 is an example of a computer.
[0033] The input / output interface 33 is configured to receive user instructions from an input device connected to the server 30 and to output information to an output device connected to the server 30 . The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display.
[0034] The communication interface 34 is configured to control communication between the server 30 and the client device 10 .
[0035] (1-3) Structure of the tactile sensor The configuration of the tactile sensor 40 of this embodiment will be described below. Fig. 2 is a schematic diagram showing the configuration of the tactile sensor of Fig. 1.
[0036] 2, the first example of the tactile sensor 40 includes a sensor unit 40a, a base portion 40b, and a controller 40c. The sensor unit 40a can be attached to a user's finger FIN.
[0037] The sensor unit 40a includes an acceleration sensor 40aa and a pair of strain gauges 40ab.
[0038] The acceleration sensor 40aa is configured to measure, for example, at least one of the following characteristics: vibration characteristics of the skin (for example, vibration frequency); - Skin roughness characteristics (for example, values estimated from vibration frequency)
[0039] The pair of strain gauges 40ab is configured to measure skin characteristics when a user applies a force in a predetermined direction (e.g., a downward (Y-direction) pressing force or a lateral (X-direction) shear force) to the base portion 40b with the user's finger FIN. The measured skin characteristics include, for example, at least one of the following: Skin contact characteristics Skin deformation characteristics Skin friction properties
[0040] The controller 40c is configured to calculate the frictional characteristics of the skin by applying the deformation characteristics of the skin measured by the strain gauges 40ab to a predetermined estimation formula.
[0041] (1-4) Overview of this embodiment An outline of this embodiment will be described below with reference to Fig. 3, which is an explanatory diagram of the outline of this embodiment.
[0042] The tactile sensor 40 acquires tactile information that indicates physical characteristics related to the tactile sensation of the skin of the user U. The tactile information is information that indicates physical characteristics related to the tactile sensation of the user U's skin.
[0043] The client device 10 acquires tactile information from the tactile sensor 40 and transmits the tactile information to the server 30.
[0044] The server 30 estimates the skin condition based on the tactile information acquired from the client device 10. The skin condition is the state of the user U's skin estimated from physical characteristics related to the tactile sensation of the skin.
[0045] The client device 10 acquires the skin condition estimation result from the server 30 and presents to the user U at least one of two types of information based on the skin condition estimation result: real-time information (an example of "first information") and one-time information (an example of "second information").
[0046] According to this embodiment, a skin condition estimation result is obtained based on tactile information acquired by the tactile sensor 40. This prevents variations in the skin condition determination results based on the tactile sensation of the skin. As a result, it is possible to provide information that is more suited to the skin condition of the user U.
[0047] (2) Database The databases of this embodiment will be described. The following databases are stored in the storage device 31.
[0048] (2-1) User information database The user information database of this embodiment will now be described with reference to Fig. 4, which is a diagram showing the data structure of the user information database of this embodiment.
[0049] The user information database in FIG. 4 stores information about users (hereinafter referred to as "user information"). The user information database includes a "user ID" field, a "user name" field, a "user attribute" field, and an "estimation formula" field. Each field is associated with the other fields.
[0050] The "user ID" field stores a user ID that identifies the user.
[0051] The "user name" field stores information (for example, text) indicating the user name.
[0052] The "user attribute" field stores information about the user's attributes (hereinafter referred to as "user attribute information"). The user attribute information is information that is arbitrarily determined by the user. The "user attribute" field includes a "gender" field and an "age" field. The "gender" field stores information indicating the gender of the user. The "age" field stores information indicating the age of the user.
[0053] The "Estimation Formula" field stores an estimation formula for estimating the user's skin condition. The estimation formula includes coefficients for each factor that affects the user's skin (for example, tactile information acquired by the tactile sensor 40).
[0054] An estimation formula is prepared for each index of the user's skin condition (hereinafter referred to as "skin index"). In other words, the coefficients included in the estimation formula are different for each skin index. A skin index is a quantitative value that represents the condition of the user's skin. For example, the skin index is at least one of the following: Stratum corneum moisture content ·texture Skin tone Dry skin ·Smooth skin ·Clear skin ·Skin whitening level · Whether or not your skin is rough ·Severity of skin inflammation - The degree of fine lines on the skin · Skin firmness ·Skin softness
[0055] (2-2) Tactile Log Information Database The tactile log information database of this embodiment will now be described with reference to Fig. 5, which is a diagram showing the data structure of the tactile log information database of this embodiment.
[0056] Tactile log information is stored in the tactile log information database of Fig. 5. Tactile log information is information relating to the history of tactile information acquired from the tactile sensor 40. The tactile log information database includes a "tactile log ID" field, a "date and time" field, and a "tactile information" field. Each field is associated with the other fields. The tactile log information database is associated with a user ID.
[0057] The "tactile log ID" field stores a tactile log ID that identifies the tactile information that constitutes the tactile log information.
[0058] The "date and time" field stores information indicating the date and time when the tactile information was acquired.
[0059] The "tactile information" field includes a "vibration" field, a "bump" field, a "contact" field, a "deformation" field, and a "friction" field.
[0060] The "vibration" field stores vibration characteristic information relating to the vibration characteristics of the skin (for example, the vibration frequency measured by the acceleration sensor 40aa).
[0061] The "unevenness" field stores unevenness characteristic information relating to the unevenness characteristics of the skin (for example, a value estimated from the vibration frequency measured by the acceleration sensor 40aa).
[0062] The "contact" field stores contact characteristic information regarding the contact characteristics of the skin (for example, values measured by the strain gauge 40ab).
[0063] The "deformation" field stores deformation characteristic information relating to the deformation characteristics of the skin (for example, the amount of deformation measured by the strain gauge 40ab).
[0064] The "friction" field stores friction characteristic information relating to the friction characteristics of the skin (for example, the friction force calculated by the base part 40b).
[0065] (2-3) Behavior log information database The action log information database of this embodiment will be described below with reference to Fig. 6, which is a diagram showing the data structure of the action log information database of this embodiment.
[0066] 6 stores information indicating the history of behavioral information (hereinafter referred to as "behavior log information"). The behavior log information is information acquired from the log device 50, information determined according to a user instruction (for example, a user's response to a questionnaire or a user's voluntary input), or a combination thereof. The action log information database includes an "action log ID" field, a "date and time" field, an "action" field, a "start time" field, an "end time" field, a "calorie change" field, a "location information" field, and an "environment information" field. Each field is associated with the other fields. The action log information database is associated with a user ID.
[0067] The "action log ID" field stores an action log ID that identifies the action information that constitutes the action log information.
[0068] The "date and time" field stores information indicating the date and time when the behavior information was acquired.
[0069] The "behavior" field stores information about the user's behavior. The user's actions include at least one of the following: Meals (e.g., what you eat) Exercise (e.g., type of exercise) Sleep (e.g., number of times you turn over during sleep) Care behavior (e.g., whether or not morning washing was performed, whether or not skin care was performed, the content of care, and information about the products used in care)
[0070] The "start time" field stores information indicating the start time of the action.
[0071] The "end time" field stores information indicating the end time of the action.
[0072] The "calorie change" field stores information indicating the calorie intake or calorie expenditure depending on the activity.
[0073] In the "location information" field, the location information acquired by the GPS module 15 is stored.
[0074] The "environment information" field stores environmental information about the environment at the location indicated by the location information. The environmental information includes at least one of the following: Temperature ·Humidity ·UV exposure amount
[0075] (2-4) Mind and body log information database The mind-body log information database of this embodiment will now be described with reference to Fig. 7, which is a diagram showing the data structure of the mind-body log information database of this embodiment.
[0076] 7 stores information indicating the history of the user's mental and physical information (hereinafter referred to as "mental and physical log information"). The mental and physical log information is information obtained from the log device 50, information determined according to user instructions (e.g., the user's responses to a questionnaire), or a combination thereof. The mind-body log information database includes a "mind-body log ID" field, a "date and time" field, a "pulse value" field, a "menstrual cycle" field, and a "stress" field. Each field is associated with the others. The mind-body log information database is associated with a user ID.
[0077] The "psycho-physical log ID" field stores a psycho-physical log ID that identifies the psycho-physical information that constitutes the psycho-physical log information.
[0078] The "date and time" field stores information indicating the date and time when the psychosomatic information was acquired.
[0079] The "pulse value" field stores the user's pulse value. The pulse value is information acquired from the log device 50, for example.
[0080] The "menstrual cycle" field stores information indicating the menstrual cycle (an example of hormone balance information).
[0081] The "Stress" field stores stress information indicating an index of stress. The stress information indicates, for example, the intensity of stress, the cause of stress, the type of stress, or a combination thereof. The stress information is determined by the pulse value, the menstrual cycle, or a combination thereof.
[0082] (2-5) Skin evaluation log information database The skin evaluation log information database of this embodiment will be described below with reference to Fig. 8, which is a diagram showing the data structure of the skin evaluation log information database of this embodiment.
[0083] The skin evaluation log information database of FIG. 8 stores information (hereinafter referred to as "skin evaluation log information") indicating the history of qualitative evaluations of skin conditions (hereinafter referred to as "skin evaluations"). The skin evaluation log information database includes a "skin evaluation log ID" field, a "date and time" field, and a "skin score" field. Each field is associated with the other fields. The skin evaluation log information database is associated with a user ID.
[0084] The "skin evaluation log ID" field stores a skin evaluation log ID that identifies the skin evaluation that constitutes the skin evaluation log information.
[0085] The "date and time" field stores information indicating the date and time when the skin evaluation was generated.
[0086] The "skin score" field stores the skin score obtained from the tactile information and the estimation equation. The "skin score" field includes a "first skin score" field and a "second skin score" field. The "first skin score" field stores a first skin score (an example of a first skin index). The first skin score indicates the current skin condition (for example, at the time the tactile information was acquired) estimated from the tactile log information. The "Second Skin Score" field stores a second skin score (an example of a second skin index). The second skin score indicates the skin condition in the future (for example, one week after the day the tactile information is acquired) estimated from the tactile log information and tactile prediction information.
[0087] (2-6) Content Matching Table The content matching table of this embodiment will now be described with reference to Fig. 9, which is a diagram showing the data structure of the content matching table of this embodiment.
[0088] The content matching table in FIG. 9 has a data structure showing the relationship between skin evaluations and the contents of two types of information (real-time information and one-time information) to be presented to the user. The content matching table includes a "criteria score" field, a "real-time content" field, and a "one-time content" field.
[0089] The "criterion score" field stores a criteria score for identifying real-time content or one-time content.
[0090] The "real-time content" field stores a content ID that identifies the real-time content that constitutes the real-time information. The real-time content may be, for example, text, an image, audio, a URL (Uniform Resource Locator), or a combination thereof. Real-time content includes, for example: Messages encouraging immediate care actions Advice on immediate care · Advice on suitable products for care (for example, the URL of the website where you can purchase the product) · First skin score showing your past skin condition
[0091] The "one-time content" field stores a content ID that identifies the one-time content that constitutes the one-time information. The one-time content may be, for example, text, an image, audio, a URL, or a combination thereof. One-time content includes, for example: - Messages encouraging you to take care of yourself before bedtime Advice on what to do before bed Advice on suitable products for care (e.g., website URL for purchasing the product) Second skin score indicating future skin condition
[0092] (2-7) Task Information Database The task information database of this embodiment will now be described with reference to Fig. 10, which is a diagram showing the data structure of the task information database of this embodiment.
[0093] The task information database of FIG. 10 stores information about care actions that the user should perform (hereinafter referred to as "task information"). The task information database includes a "task ID" field, a "reference content" field, a "registration date and time" field, and an "end date and time" field. Each field is associated with the other fields. The task information database is associated with a user ID.
[0094] The "task ID" field stores a task ID that identifies task information.
[0095] The "reference content" field stores a content ID that identifies the reference content (real-time content or one-time content) that serves as the reference for the care action.
[0096] The "registration date and time" field stores information indicating the date and time when the task information was registered in the task information database.
[0097] The "End Date and Time" field stores information indicating the date and time when the care action corresponding to the task information was completed. The code "NOT" means that the care action has not been completed.
[0098] (3) Information processing The information processing of this embodiment will be described.
[0099] (3-1) Content presentation processing The content presentation process of this embodiment will be described below. Fig. 11 is a sequence diagram of the content presentation process of this embodiment. Figs. 12 to 14 are diagrams showing examples of screens displayed in the information processing of Fig. 11.
[0100] As shown in FIG. 11, the client device 10 acquires tactile information (S100). Specifically, the processor 12 acquires tactile information from the tactile sensor 40 at regular intervals. The processor 12 stores the tactile information and information indicating the date and time when step S100 was performed (that is, the date and time when the tactile information was acquired) in the storage device 11 in association with each other. The processor 12 displays a screen P100 (FIG. 12) on the display.
[0101] As shown in FIG. 12, a screen P100 includes a display object A100 and a button object B100. The display object A100 displays tactile information acquired from the tactile sensor 40 (for example, vibration frequency, amount of unevenness, contact force, amount of deformation, and estimated values of friction). The button object B100 is an object that accepts a user instruction to start a content request (S101).
[0102] After step S100, the client device 10 executes a content request (S101). Specifically, when the user operates the button object B100, the processor 12 transmits content request data to the server 30. The content request data includes the following information: User ID ·Tactile information acquired in step S100 (i.e., tactile information included in the display object A100) ·Information indicating the execution date and time of step S100
[0103] After step S101, the server 30 updates the database (S300) based on the content request data.
[0104] Specifically, the processor 32 adds a new record to the tactile log information database (FIG. 5) associated with the user ID included in the content request data. The following information is stored in each field of the new record: "Tactile Log ID" field: New tactile log ID "Date and time" field: information included in the content request data indicating the date and time of execution of step S100. "Vibration" field: information about vibration characteristics included in the content request data. "Roughness" field: Roughness characteristic information included in the content request data "Contact" field: Contact characteristic information included in content request data "Transformation" field: Transformation characteristics information included in the content request data "Friction" field: Friction characteristics information included in the content request data - "Sticky" field: Sticky characteristics information included in content request data As a result, the tactile information acquired in step S100 is recorded in the server 30.
[0105] After step S300, the server 30 performs skin condition estimation (S301). Specifically, the processor 32 refers to the user information database (FIG. 4) to identify the estimation formula associated with the user ID included in the content request data.
[0106] The processor 32 identifies, from among the records of tactile log information stored in the tactile log information database updated in step S300, records whose "date and time" field values fall within a certain period (e.g., one week) prior to the execution date of step S100 (hereinafter referred to as "tactile reference records"). The processor 32 calculates the average value of the values of each subfield (the "vibration" field, the "unevenness" field, the "contact" field, the "deformation" field, and the "friction" field) of the "tactile information" field of the tactile reference record. The processor 32 calculates the first skin score by applying the calculated average value to the specified estimation formula.
[0107] The first skin score is calculated for each of the following indicators. - Skin score for stratum corneum moisture content Skin texture score Skin tone score Skin score for qualitative skin condition Skin score for rough skin Skin score for inflammation level Skin score for the degree of fine lines · Skin firmness ·Skin softness
[0108] The processor 32 acquires tactile sensation prediction information from the prediction information providing server 70. The processor 32 calculates the second skin score by applying the average value of the values of each subfield of the "tactile information" field of the tactile reference record and the tactile prediction information to the specified estimation formula. The second skin score is calculated for each index, similar to the first skin score.
[0109] The processor 32 adds a new record to the skin evaluation log information database (FIG. 8) associated with the user ID included in the content request data. The following information is stored in each field of the new record: "Skin evaluation log ID": New skin evaluation log ID "Date and time" field: Information indicating the execution date and time of step S100 "First Skin Score" field: First Skin Score "Second Skin Score" field: Second skin score
[0110] After step S301, the server 30 executes content selection (S302). Specifically, processor 32 refers to the "standard score" field in the content matching table (FIG. 9) to identify the content ID corresponding to the first skin score calculated in step S301. For example, if the first skin score is "30", the content ID "REAL001" associated with the standard score "20 to 39" is identified. Processor 32 refers to the "standard score" field to identify the content ID corresponding to the second skin score calculated in step S301. For example, if the second skin score is "60", the content ID "ONE003" associated with the standard score "60 to 89" is identified.
[0111] After step S302, the server 30 executes a content response (S303). Specifically, the processor 32 transmits the content response data to the client device 10. The content response data includes the following information: The first skin score and the second skin score calculated in step S301 Tactile information referenced to calculate the first skin score in step S301 Touch log information referenced to calculate the second skin score in step S301 The content ID identified in step S302 and the content identified by that content ID (real-time content or one-time content)
[0112] After step S303, the client device 10 presents the content (S102) based on the content response data. Specifically, the processor 12 displays a screen P102 (FIG. 13) on the display.
[0113] The screen P102 includes display objects A102a to A102b and button objects B102a to B102d.
[0114] The display object A102a displays graphs corresponding to at least a portion of the tactile log information included in the content response data (for example, graphs showing changes over time in vibration characteristics, unevenness characteristics, contact characteristics, and deformation characteristics). The display object A102b displays the first skin score and the second skin score included in the content response data.
[0115] The button object B102a is an object that accepts a user instruction to display the real-time content screen P104a (FIG. 14A). The button object B102b is an object that accepts a user instruction to display the one-time content screen P104b (FIG. 14B). The button object B102c is an object that receives a user instruction for presenting a task (S111 in FIG. 15). The button object B102d is an object that receives a user instruction to access a shopping site for purchasing care items that are useful when performing care in accordance with the real-time content or one-time content.
[0116] When the user designates the button object B102a, the processor 12 displays a screen P104a (FIG. 14A) on the display. The screen P104a includes a display object A104a and a button object B104a.
[0117] The display object A 104a displays real-time content identified by the content ID included in the content response data.
[0118] The button object B 104a is an object that receives a user instruction to notify the server 30 that the care indicated by the real-time content displayed on the display object A 104a has ended.
[0119] When the user designates the button object B102b, the processor 12 displays a screen P104b (FIG. 14B) on the display. The screen P104b includes a display object A104b and a button object B104b.
[0120] The display object A104b displays the one-time content identified by the content ID included in the content response data.
[0121] The button object B 104b is an object that receives a user instruction to notify the server 30 that the care indicated by the one-time content displayed on the display object A 104b has ended.
[0122] After step S102, the client device 10 executes a task update request (S103).
[0123] As a first example, when the user designates the button object B104a (FIG. 14A), the processor 12 transmits task update request data to the server 30. The task update request data includes the following information: User ID The content ID of the real-time content displayed in the display object A 104a. Information indicating the execution date and time of step S103.
[0124] As a second example, when the user designates the button object B104b (FIG. 14B), the processor 12 transmits task update request data to the server 30. The task update request data includes the following information: User ID Content ID of the one-time content displayed in the display object A 104b Information indicating the execution date and time of step S103
[0125] After step S103, the server 30 updates the database (S304). Specifically, the processor 32 adds a new record to the task information database (FIG. 10) associated with the user ID included in the task update request data. The following information is stored in each field of the new record: "Task ID" field: New task ID "Content ID" field: Content ID included in the task update request data. "Registration date and time" field: Information indicating the execution date and time of step S103 included in the task update request data. "End date and time" field: Code "NOT" As a result, the task designated by the user on the screen P104a or P104b (FIG. 14) is recorded in the server 30.
[0126] (3-2) Task update processing The task update process of this embodiment will be described below. Fig. 15 is a sequence diagram of the task update process of this embodiment. Fig. 16 is a diagram showing an example of a screen displayed in the information processing of Fig. 15.
[0127] As shown in FIG. 15, the client device 10 executes a task presentation request (S110). Specifically, when the user designates the button object B102c (FIG. 13), the processor 12 transmits task presentation request data to the server 30. The task presentation request data includes a user ID.
[0128] After step S110, the server 30 executes a task presentation response (S310). Specifically, processor 32 refers to the task information database (Figure 10) associated with the user ID included in the task presentation request data, and identifies the task ID and content ID of the record in which the code "NOT" is stored in the "End Date and Time" field (i.e., the record in which task information related to an unfinished task is stored).
[0129] The processor 32 transmits the task presentation response data to the client device 10. The task presentation response data includes the following information: Task ID of the unfinished task - Content ID associated with the task ID of the unfinished task
[0130] After step S310, the client device 10 executes task presentation (S111). Specifically, the processor 12 displays a screen P110 (FIG. 16) on the display based on the task presentation response data.
[0131] The screen P110 includes display objects A110a to A110b and button objects B110a to B110b.
[0132] The display objects A110a to A110b display content identified by the content ID included in the task presentation response data.
[0133] The button objects B110a to B110b are objects that accept a user instruction for notifying the server 30 of the end of a task corresponding to the content displayed on the display objects A110a to A110b, respectively. The button objects B110a to B110b are assigned task IDs that are associated with content IDs that identify the content displayed on the display objects A110a to A110b, respectively.
[0134] After step S111, the client device 10 executes a task update request (S112). Specifically, when the user designates the button object B110a (FIG. 16), the processor 12 transmits task update request data to the server 30. The task update request data includes the following information: User ID Task ID assigned to the button object B110a specified by the user Information indicating the execution date and time of step S112
[0135] After step S112, the server 30 updates the database (S311).
[0136] Specifically, the processor 32 identifies the task information database (FIG. 10) associated with the user ID included in the task update request data. The processor 32 identifies a record in the identified task information database that includes the task ID included in the task update request data. The processor 32 stores information indicating the execution date and time of step S112, which is included in the task update request data, in the "end date and time" field of the identified record.
[0137] The processor 32 identifies the action log information database (FIG. 6) associated with the user ID included in the task update request data. The processor 32 adds a new record to the identified action log information database. The following information is stored in each field of the new record: "Action Log ID" field: New action log ID "Date and time" field: Information indicating the execution date and time of step S112 included in the task update request data. "Action" field: Task ID included in the task update request data.
[0138] As a result, the completion of the task designated by the user on the screen P110 (FIG. 16) and the care action performed to complete the task are recorded in the server 30.
[0139] (3-3) Correction of the estimation formula The process of correcting the estimated formula in this embodiment will be described below with reference to the flowchart of FIG.
[0140] The process of FIG. 17 is executed after the user's user ID is registered in a dedicated measurement device (for example, a device installed in a cosmetics store).
[0141] As shown in FIG. 17, the server 30 acquires the measurement results (S320). Specifically, when a user measures a reference value REF for skin condition using a dedicated measuring device (for example, a device located in a cosmetics store), the processor 32 obtains the user ID and the reference value REF from the measuring device.
[0142] After step S320, the server 30 calculates the difference value (hereinafter referred to as "deviation value") D between the reference value REF and the skin score f using Equation 1 (S321). (Formula 1)D=|REF-f|
[0143] If the deviation value D calculated in step S321 is less than the predetermined threshold value Th (S322-NO), the processing of FIG. 17 ends.
[0144] If the deviation value D calculated in step S321 is equal to or greater than the predetermined threshold value Th (YES in S322), the server 30 corrects the estimation formula (S323). Specifically, the processor 32 changes the coefficients of the estimation equation (FIG. 4) associated with the user ID acquired in step S320 so that the deviation value D becomes less than a predetermined threshold value Th. This allows the estimation formula to be adjusted for each user.
[0145] The process in FIG. 17 is executed for each skin index.
[0146] (4) Variations A modification of this embodiment will now be described.
[0147] (4-1) Variation 1 A description will be given of Modification 1. Modification 1 is an example in which content presentation processing (FIG. 11) is executed using a combination of tactile log information (FIG. 5) and action log information (FIG. 6).
[0148] Specifically, the estimation formula of the first modification includes coefficients of the user's behavior and parameters determined according to the behavior information.
[0149] In step S301 (FIG. 11), processor 32 identifies a record (hereinafter referred to as a "behavior reference record") from among records in the behavior log information database (FIG. 6) associated with the user ID included in the content request data, whose "date and time" field value falls within a certain period (e.g., one week) prior to the execution date of step S100. The processor 32 calculates a first skin score by applying an estimation formula to at least one of the "action" field, "start time" field, "end time" field, "calorie change" field, and "location information" field of the action reference record and the average value calculated from the tactile reference record. The first skin score indicates the current skin condition estimated from the tactile log information and the action log information.
[0150] The processor 32 acquires behavior prediction information from the prediction information providing server 70. The processor 32 calculates a second skin score by applying to an estimation formula at least one of the information in the "action" field, "start time" field, "end time" field, "calorie change" field, and "location information" field of the action reference record, the average value calculated from the tactile reference record, and the action prediction information. The second skin score indicates a future skin condition estimated from the tactile log information, the action log information, and the action prediction information.
[0151] The real-time and one-time content further includes advice regarding user behavior.
[0152] According to the first modification, the skin condition is estimated based on the tactile log information and the action log information, thereby making it possible to provide content according to a combination of the physical characteristics related to the tactile sensation of the user's skin and the user's actions.
[0153] (4-2) Variation 2 A description will now be given of Modification 2. Modification 2 is an example in which content presentation processing (FIG. 11) is performed using a combination of tactile log information (FIG. 5) and mind-body log information (FIG. 7).
[0154] Specifically, the estimation formula of the second modification includes the user's mind and body coefficients and parameters determined according to the mind and body log information.
[0155] In step S301 (FIG. 11), processor 32 identifies records in the mind-body log information database (FIG. 7) associated with the user ID included in the content request data, whose "date and time" field values fall within a certain period (e.g., one week) prior to the execution date of step S100 (hereinafter referred to as "mind-body reference records"). The processor 32 calculates a first skin score by applying an estimation formula to at least one of the "pulse value" field, "menstrual cycle" field, and "stress" field of the mind-body reference record and the average value calculated from the tactile reference record. The first skin score indicates the current skin condition estimated from the tactile log information and the mind-body log information.
[0156] The processor 32 acquires the mental and physical prediction information from the prediction information providing server 70. The processor 32 calculates a second skin score by applying information from at least one of the "pulse value" field, "menstrual cycle" field, and "stress" field of the mind-body reference record, the average value calculated from the tactile reference record, and the mind-body prediction information to an estimation formula. The second skin score indicates a future skin condition estimated from the tactile log information, mind-body log information, and mind-body prediction information.
[0157] The real-time content and one-time content further include the following information: - Advice for users on hormone balance User stress advice
[0158] According to the second modification, the skin condition is estimated based on a combination of tactile log information and mind-body log information, thereby making it possible to provide content that corresponds to the combination of the physical characteristics related to the tactile sensation of the user's skin and the user's mind-body condition.
[0159] (4-3) Variation 3 A description will be given of Modification 3. Modification 3 is an example in which future skin conditions are estimated in consideration of the skin care behavior of the user.
[0160] Specifically, the estimation formula of the third modification includes a coefficient of the care behavior of the user and a parameter determined according to the task information.
[0161] In step S301 (FIG. 11), processor 32 calculates the average value, and then refers to the task information database (FIG. 10) associated with the user ID included in the content request data to identify records (hereinafter referred to as "reference records") within a certain period (for example, one week prior to the execution date of step S301). The processor 32 calculates the second skin score by applying the information of the identified reference record (that is, information on skin care behavior within a certain period of time) and the calculated average value to the estimation formula.
[0162] According to the third modification, the future skin condition is estimated taking into consideration the user's history of skin care actions, thereby making it possible to present a future skin condition suited to each user.
[0163] (4-4) Variation 4 A description will be given of Modification 4. Modification 4 is an example in which the skin score is output to an external device other than the client device 10.
[0164] Specifically, the server 30 is connected to a cosmetics production device that produces cosmetics based on the skin score. The cosmetics production device is equipped with a plurality of cartridges. Each cartridge contains a raw material that will become an ingredient of the cosmetics, or a mixture of a plurality of raw materials (hereinafter referred to as "cosmetics"). The raw materials may be, for example, liquid, powder, solid, or a combination thereof.
[0165] In step S301 (FIG. 11), the processor 32 transmits the first skin score and the second skin score to the cosmetic product generating device.
[0166] The cosmetic product generating device determines the amount of raw material or cosmetic material contained in each cartridge to be used based on at least one of the first skin score and the second skin score transmitted from the server 30. The cosmetic preparation device extracts a determined amount of ingredient or cosmetic product from each cartridge and provides it to the user.
[0167] According to the fourth modification, it is possible to provide the user with cosmetics that are produced using ingredients or cosmetics that are suited to the physical characteristics related to the feel of the user's skin.
[0168] (4-5) Variation 5 A description will be given of Modification 5. Modification 5 is a modification of advice included in at least one of real-time content and one-time content.
[0169] At least one of the real-time content and the one-time content of Variation 5 further includes advice based on the skin condition.
[0170] Specifically, the server 30 further estimates the skin condition in step S301 (FIG. 11). In this case, the server 30 further calculates a first skin score and a second skin score related to the index of the skin condition. The skin condition is, for example, skin balance. Skin balance is an index related to the health state of the skin. Skin balance is derived from measurements related to the skin condition (for example, the state of the stratum corneum, epidermis, dermis, and blood flow).
[0171] In step S302, the server 30 further selects content according to the skin condition. The content according to the skin condition includes advice based on the skin condition.
[0172] In step S102, the client device 10 further presents advice to the user U based on the skin condition.
[0173] According to the fifth modification, it is possible to provide the user with information according to the condition of their skin.
[0174] (4-6) Variation 6 The following describes Modification 6. Modification 6 is a modification of tactile sensor 40. FIG. 18 is a schematic diagram showing the configuration of the tactile sensor of Modification 6.
[0175] A first example of the tactile sensor 40 of the sixth modification is an adhesive sensor 41 shown in Fig. 18A. The adhesive sensor 41 includes a base member 41a and a plurality of contacts 41b.
[0176] Each contactor 41b is extendable and retractable relative to the base member 41a. The multiple contactors 41b are arranged in a matrix on the base member 41a. An adhesive substance may be applied to the surfaces of the multiple contactors 41b. The multiple contactors 41b are configured to detect a physical quantity of the skin SK that they come into contact with.
[0177] When the user's skin SK applies downward pressure (Y-direction) to the contacts 41b, the adhesive sensor 41 generates an electrical signal indicating at least one of the following parameters based on the physical quantity detected by the contacts 41b: adhesive force of the skin (e.g., a value estimated from the spatiotemporal change in the force generated when the skin SK is separated from the contacts 41b); and distribution of contact force (e.g., distribution of contact force generated when the contacts 41b press the skin SK). Contact area (for example, a value estimated from the number of contacts 41b that come into contact when the contacts 41b press against the skin SK)
[0178] A second example of the tactile sensor 40 of Modification 6 is a flexibility sensor 42 shown in Fig. 18B. The flexibility sensor 42 includes a piezoelectric vibrator 42a and a load cell 42b.
[0179] When pressed against the user's skin SK, the piezoelectric vibrator 42a acquires the following biological information: Skin viscoelasticity (for example, a value estimated from the amount of pressure applied to the skin SK, the pressure speed, and the reaction force measured by the piezoelectric vibrator 42a) An index of the flexibility of the surface of the skin SK (for example, the amount of frequency change on the surface of the skin SK measured by the piezoelectric vibrator 42a)
[0180] The load cell 42b is configured to measure the contact characteristics when the piezoelectric vibrator 42a is pressed against the skin SK. The measured contact characteristics are an index of the overall flexibility of the skin SK. The contact force includes, for example, at least one of the following: Maximum value of the contact force Hysteresis Stress relief Waveform characteristics
[0181] It should be noted that the piezoelectric vibrator 42a can be omitted in the second example of Modification 6. In this case, the load cell 42b is configured to measure the contact force when pressed directly against the skin SK.
[0182] A third example of the tactile sensor 40 of the sixth modification is a temperature sensor (not shown). The temperature sensor is configured to measure the temperature of the skin.
[0183] (4-7) Variation 7 A description will be given of Modification 7. Modification 7 is an example of a method for the predicted information providing server 70 to generate tactile prediction information.
[0184] The prediction information providing server 70 in Fig. 1 stores a formula for calculating a predicted value of a tactile sensation. This formula is a function of at least one of the following pieces of information: Tactile sensation log information · Behavior log information ·Mental and physical log information
[0185] When the predicted information providing server 70 acquires a user ID from the client device 10 or the server 30, it refers to at least one of the following databases associated with the user ID: Tactile log information database (FIG. 5) Action log information database (Figure 6) Mind and body log information database (Figure 7)
[0186] The predicted information providing server 70 calculates the predicted value of the tactile sensation by applying the information in the referenced database to a calculation formula.
[0187] (5) Summary of this embodiment The present embodiment will be briefly summarized.
[0188] The first aspect of this embodiment is a means for acquiring tactile information indicating physical characteristics related to the tactile sensation of the user's skin (for example, a processor 32 that executes the process of step S300); The information processing device includes a means (e.g., a processor 32 that executes the processing of step S303) for presenting first information regarding a user's skin condition based on tactile information, and at least one piece of second information regarding a user's skin condition based on tactile log information including a plurality of pieces of tactile information.
[0189] According to the first aspect, the skin condition is determined based on physical characteristics related to the feel of the skin. This prevents variations in the determination results that occur when an examiner determines the skin condition by palpation. As a result, the user can receive advice suitable for their skin through content (e.g., at least one of real-time content and one-time content).
[0190] A second aspect of this embodiment is An information processing device in which at least one of the first information and the second information includes at least one of advice on how to care for the user's skin, advice on products suitable for caring for the user's skin, advice on the user's hormone balance, and advice on the user's stress.
[0191] According to the second aspect, at least one of advice on at least one of skin care methods, products suitable for skin care, hormone balance, and stress is presented, allowing the user to take care of their skin in accordance with the more detailed advice.
[0192] A third aspect of this embodiment is a means for estimating a skin index of a user's skin condition based on tactile log information (for example, a processor 32 that executes the process of step S301); The information processing device includes a means for presenting the estimated skin index (for example, the processor 32 that executes the process of step S303).
[0193] According to the third aspect, a skin index of the skin condition based on the physical characteristics related to the feel of the skin is presented, thereby allowing the user to know the exact skin condition.
[0194] A fourth aspect of this embodiment is a means for acquiring tactile information indicating physical characteristics related to the tactile sensation of the user's skin (for example, a processor 32 that executes the process of step S300); a means for estimating a skin index of a skin condition based on tactile log information including a plurality of pieces of tactile information (for example, a processor 32 that executes the process of step S301); The information processing device includes a means for presenting the estimated skin index (for example, the processor 32 that executes the process of step S303).
[0195] According to the fourth aspect, a skin index based on physical characteristics related to the feel of the skin is presented, thereby allowing the user to know the exact condition of their skin.
[0196] A fifth aspect of this embodiment is The system includes a means for acquiring action log information indicating a history of action information relating to the user's actions, The estimation means is an information processing device that estimates skin indices based on tactile log information and action log information.
[0197] According to the fifth aspect, a skin index based on a combination of physical properties related to the feel of the skin and an action log is presented, allowing the user to know the skin condition based on both the physical properties related to the feel of the skin and their own actions.
[0198] A sixth aspect of this embodiment is A means for acquiring mental and physical log information relating to the user's mind and body is provided, The estimation means is an information processing device that estimates skin indices based on tactile log information and mind-body log information.
[0199] According to the sixth aspect, a skin index based on a combination of physical characteristics related to the feel of the skin and a mind-body log is presented, allowing the user to know their skin condition based on both the physical characteristics related to the feel of the skin and their own mind-body.
[0200] A seventh aspect of this embodiment is A means for acquiring tactile sensation prediction information indicating physical characteristics related to future tactile sensations on the skin is provided, The estimation means is an information processing device that estimates skin indices based on tactile log information and tactile prediction information.
[0201] According to the seventh aspect, a skin condition based on a log and a prediction of physical properties related to the feel of the skin is presented, allowing the user to know the skin condition based on the past and future states of the physical properties related to the feel of the skin.
[0202] An eighth aspect of this embodiment is The acquiring means is an information processing device that acquires tactile information from a tactile sensor 40 configured to measure tactile information.
[0203] A ninth aspect of this embodiment is The tactile information includes at least one of vibration characteristics, unevenness characteristics, contact characteristics, deformation characteristics, temperature, and friction characteristics of the skin.
[0204] According to a tenth aspect of this embodiment, A client device 10 connectable to an information processing device (for example, a server 30), Equipped with a display, The client device includes a means (for example, a processor 12 that executes the process of step S102) for displaying the first information and the second information presented by an information processing device (for example, the server 30) on a display.
[0205] According to an eleventh aspect of this embodiment, It is a program for causing a computer (for example, the processor 12 or 32) to function as each of the above means.
[0206] (6) Other variations Other modifications will be described.
[0207] The storage device 11 may be connected to the client device 10 via a network NW. The storage device 31 may be connected to the server 30 via the network NW.
[0208] Each step of the above information processing can be executed by either the client device 10 or the server 30.
[0209] The tactile sense log information and the action log information may be acquired by a module built into the client device 10. The tactile log information, the behavior log information, and the mind-body log information may be acquired from an external server different from the server 30.
[0210] In step S301, estimation of one of the first skin score and the second skin score can be omitted.
[0211] Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited to the above-described embodiments. Furthermore, the above-described embodiments can be improved or modified in various ways without departing from the spirit of the present invention. Furthermore, the above-described embodiments and modifications can be combined. [Explanation of symbols]
[0212] 1: Information processing system 10: Client device 11:Storage device 12: Processor 13: Input / output interface 14: Communication interface 15: GPS module 30: Server 31:Storage device 32: Processor 33: Input / output interface 34: Communication interface 40: Tactile sensor 41: Adhesion sensor 42: Flexibility sensor 50: Log device 70: Prediction information server
Claims
1. means for acquiring tactile information indicating physical characteristics related to the tactile sensation of a user's skin; the tactile information includes at least one of vibration characteristics, unevenness characteristics, contact characteristics, deformation characteristics, adhesive characteristics, temperature, and friction characteristics of the skin; The system includes a means for acquiring action log information indicating a history of action information related to the user's actions, or a means for acquiring mind-body log information related to the mind and body of the user, a means for estimating a skin index of the user's skin condition based on tactile log information, which is a history of the tactile information, and the behavior log information or the mind-body log information; a means for outputting information for presenting the estimated skin index; Information processing device.
2. means for acquiring tactile information indicating physical characteristics related to the tactile sensation of a user's skin; means for acquiring mental and physical log information relating to the user's mind and body; the mind-body log information is log information related to at least one of the user's pulse value, menstrual cycle, and stress, a means for estimating a skin index of the user's skin condition based on tactile log information, which is a history of the tactile information, and the mind-body log information; a means for outputting information for presenting the estimated skin index; Information processing device.
3. The output means outputs information for presenting the skin index and skin condition information based on the skin index.
3. The information processing device according to claim 1.
4. The skin condition information includes at least one of advice on how to care for the user's skin, advice on products suitable for caring for the user's skin, advice on the user's hormone balance, advice on the user's stress, and advice based on the user's skin condition. The information processing device according to claim 3 .
5. A means for acquiring tactile sensation prediction information indicating physical characteristics related to future tactile sensations on the skin is provided, 5. The information processing device according to claim 1, wherein the estimation means estimates the skin index based on the tactile log information and the tactile prediction information.
6. 6. The information processing device according to claim 1, wherein the acquiring means acquires the tactile information from a tactile sensor configured to measure the tactile information.
7. A client device connectable to the information processing device according to any one of claims 1 to 6, Equipped with a display, A client device comprising: means for displaying information output by the information processing device on the display.
8. A system comprising an information processing device and a client device connectable to the information processing device via a communication line, means for acquiring tactile information indicating physical characteristics related to the tactile sensation of a user's skin; the tactile information includes at least one of vibration characteristics, unevenness characteristics, contact characteristics, deformation characteristics, adhesive characteristics, temperature, and friction characteristics of the skin; The system includes a means for acquiring action log information indicating a history of action information related to the user's actions, or a means for acquiring mind-body log information related to the mind and body of the user, a means for estimating a skin index of the user's skin condition based on tactile log information, which is a history of the tactile information, and the behavior log information or the mind-body log information; a means for outputting information for presenting the estimated skin index; system.
9. A system comprising an information processing device and a client device connectable to the information processing device via a communication line, means for acquiring tactile information indicating physical characteristics related to the tactile sensation of a user's skin; means for acquiring mental and physical log information relating to the user's mind and body; the mind-body log information is log information related to at least one of the user's pulse value, menstrual cycle, and stress, a means for estimating a skin index of the user's skin condition based on tactile log information, which is a history of the tactile information, and the mind-body log information; a means for outputting information for presenting the estimated skin index; system.
10. A program for causing a computer to function as each of the means according to any one of claims 1 to 9.
Citation Information
Patent Citations
Disk brake structure
JP1978057363A
Portable terminal unit, advice system, skin diagnosing evaluating method, skin diagnosing evaluating program, makeup advice providing method and makeup advice providing program
JP2002224049A
JPP7208153B
System for management of skin condition measurement analysis information, and method for management of skin condition measurement analysis information
WO2013122233A1
Analyzer, analysis method, program, and skin sample collection kit
WO2015029452A1