Estimation device, estimation system, and program

Abstract

To estimate an objective quantity of pain that is difficult for a user to explain, and explain it to the others in place of the user.SOLUTION: A presentation unit 111 refers to a schedule DB 121 and performs presentation to urge a user to measure vitals on a predetermined date. A moving image acquisition unit 112 acquires moving image data showing moving images obtained by the user of an estimation device 1 photographing his / her own face. A vital measurement unit 113 measures vitals on the basis of the moving image data read out from a moving image DB 122. A reference information acquisition unit 114 refers to a vital DB 123 and acquires values of the user's vitals measured in the past as reference information. A subjective quantity receiving unit 115 receives a designation and a subjective quantity of an affected part input by the user. An observation information acquisition unit 116 acquires observation information such as an atmospheric pressure, and a temperature observed by an observation unit 17. An objective quantity estimation unit 117 estimates an objective quantity of the user's pain by using the values of measured vitals, reference information that is the values of past vitals, and the subjective quantity received from the user.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an estimation device, an estimation system, and a program. [Background technology]

[0002] Some physical problems, such as vague symptoms, can be difficult to express even if you are aware of them. Menstrual pain in particular is a pain unique to women, and some women find it difficult to explain to their male superiors at work, for example. In addition, because chronic illnesses are personal information, some women may not want to report them to the human resources department. Furthermore, since the cause of vague symptoms is usually unknown, and the name of the disease and symptoms are also unknown, even if you go to the hospital, you often don't know which department to consult.

[0003] When people find it difficult to explain the pain they are feeling, they often give up on explaining it to their workplace and continue working while enduring the pain. As a result, their work efficiency does not improve and their physical condition worsens further. Therefore, there is a need for a way to objectively explain the strength and degree of these vague symptoms to others.

[0004] For example, Patent Document 1 discloses an image processing method for stress monitoring that acquires facial image data using an RGB camera, creates hemoglobin image data from the facial image data using pigment component separation, creates heart rate data based on the hemoglobin image data, creates heart rate interval data based on the heart rate data, and creates heart rate variability spectrogram data by performing frequency conversion on the heart rate interval data. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2017-29318 A Summary of the Invention [Problem to be solved by the invention]

[0006] The technology described in Patent Document 1 can determine whether a person being measured is in a relaxed or stressed state based on an image of the person's face. However, this technology cannot estimate the degree of stress as an objective quantity and prove it to others at work, etc.

[0007] One of the objects of the present invention is to estimate the objective amount of pain that is difficult for a user to describe and to explain it to others on behalf of the user. [Means for solving the problem]

[0008] In one aspect, the present invention provides an estimation device that measures a user's pulse based on a video of the user's body, accepts input from the user of a subjective amount of pain felt by the user, and estimates an objective amount of pain of the user using the measured pulse, a reference pulse which is a pulse measured in the past, and the subjective amount received from the user. Effect of the Invention

[0009] According to the present invention, it is possible to estimate an objective amount of pain that is difficult for a user to describe, and to explain it to others on behalf of the user. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 shows an example of the configuration of an estimation device 1. [Diagram 2] FIG. 12 is a diagram showing an example of a schedule DB 121. [Diagram 3] FIG. 4 is a diagram showing an example of a video DB 122. [Figure 4] FIG. 1 is a diagram for explaining an example of the concept of video data. [Diagram 5] FIG. 12 shows an example of a vital sign DB123. [Figure 6] FIG. 4 is a diagram showing an example of a condition DB 124. [Figure 7] FIG. 2 is a diagram showing an example of the functional configuration of the estimation device 1. [Figure 8]FIG. 2 is a diagram showing an example of the flow of operation of the estimation device 1. [Figure 9] FIG. 4 is a diagram showing an example of a display area R0. [Figure 10] 11A and 11B are diagrams showing examples of displays when shooting a selfie video. [Figure 11] FIG. 13 is a diagram showing an example of an image displayed in the display area R0 in step S106. [Figure 12] FIG. 13 is a diagram showing an example of a screen displayed according to an estimated objective amount of pain. [Figure 13] FIG. 13 is a diagram showing an example of the overall configuration of an estimation system 9 according to a modified example. [Figure 14] FIG. 13 is a diagram showing an example of the configuration of a server device 2 according to a modified example. [Figure 15] FIG. 13 is a diagram showing an example of the upper part of a display region R0 according to a modified example. [Figure 16] FIG. 13 is a diagram showing an example of a lower part of a display area R0 according to a modified example. [Figure 17] FIG. 13 is a diagram showing an example of the configuration of an estimation device 1 according to a modified example. [Figure 18] FIG. 12 shows an example of a recommendation DB 125. [Figure 19] FIG. 13 is a diagram showing an example of an alert DB 126. [Figure 20] FIG. 13 is a diagram showing an example of a user expression DB 127. [Figure 21] FIG. 13 is a diagram showing an example of a functional configuration of an estimation device 1 according to a modified example. [Figure 22] FIG. 11 is a diagram showing an example of the flow of operation of the estimation device 1 according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] <Embodiment> <Configuration of the estimation device> FIG. 1 is a diagram showing an example of the configuration of an estimation device 1. The estimation device 1 is a device that measures the physical condition of a user based on an image of the user's face (hereinafter, also referred to as a "face image"). The estimation device 1 shown in FIG. 1 is a mobile terminal, for example, a smartphone. Moreover, the "physical condition" here refers mainly to the state and condition of the mind and body resulting from a disturbance in the autonomic nerves.

[0012] 1, the estimation device 1 includes a processor 11, a memory 12, a communication unit 13, an operation unit 14, a display unit 15, a camera 16, and an observation unit 17. These are connected by a bus.

[0013] The processor 11 reads out and executes a program stored in the memory 12 to control each part of the estimation device 1. The processor 11 is, for example, a CPU (Central Processing Unit).

[0014] The communication unit 13 is a communication circuit that communicatively connects the estimation device 1 to another device by wire or wirelessly. For example, the communication unit 13 may have a circuit that complies with a wireless communication system standard such as IMT-2000, IMT-Advanced, IMT-2020, etc. In addition, for example, the communication unit 13 may have a circuit that complies with a wireless LAN standard such as IEEE802.11.

[0015] Furthermore, for example, the communication unit 13 may have a module that realizes near field communication (NFC), etc. Standards for this NFC include, for example, ISO / IEC18092 (NFCIP-1), ISO / IEC14443, ISO / IEC15693, and IEEE802.15.

[0016] The operation unit 14 includes operation buttons, a touch panel, and other operators for issuing various instructions, and receives an operation and sends a signal according to the operation content to the processor 11. This operation is, for example, pressing a button, a gesture on the touch panel, and the like.

[0017] The operation unit 14 may have a microphone for collecting voice. In this case, the processor 11 may perform voice recognition processing on the voice data representing the user's voice collected by the microphone, and accept the recognition result as the user's operation.

[0018] The display unit 15 has a display screen such as a liquid crystal display, and displays images under the control of the processor 11. A transparent touch panel of the operation unit 14 may be disposed on top of the display screen.

[0019] 1 has a display screen that displays images and the like that are visually perceived by the user, the display unit 15 may be a presentation unit that presents information by a medium that is perceived by the user other than by the user's vision. For example, the display unit 15 may have a speaker that emits sound instead of or in addition to the above-mentioned display screen.

[0020] The camera 16 is an imaging means, such as a digital still camera, that captures an image of the surroundings of the estimation device 1 and generates an image. The camera 16 includes an optical system such as a lens, as well as an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The camera 16 shown in Fig. 1 has a common configuration with, for example, the "RGB camera" of Patent Document 1 mentioned above. That is, this camera 16 is a device that acquires image data by arranging a plurality of detection elements, each of which has sensitivity to the light intensity of a wavelength region corresponding to each of the colors R (red), G (green), and B (blue), as one pixel unit. The wavelength regions corresponding to each color are preferably, for example, 580 nm to 680 nm for R (red), 500 nm to 630 nm for G (green), and 410 nm to 530 nm for B (blue).

[0022] The camera 16 may have a polarizing plate as an optical system. The polarizing plate is disposed in the direction in which the camera 16 photographs the object. This allows the camera 16 to remove reflected components from the surface of the object.

[0023] Furthermore, the camera 16 may detect light in a wavelength range other than the above-mentioned ranges. For example, the camera 16 may be a 5-band camera in which two sensitivities, cyan (C) and orange (O), are added to a normal RGB camera.

[0024] The observation unit 17 is a sensor or the like that observes physical quantities in the environment surrounding the user of the estimation device 1. The observation unit 17 is, for example, a barometer, a hygrometer, a thermometer, or the like.

[0025] The memory 12 is a storage means for storing an operating system, various programs, data, etc., which are loaded into the processor 11. The memory 12 includes a RAM (Random Access Memory) and a ROM (Read Only Memory).

[0026] The memory 12 may include a solid state drive, a hard disk drive, etc. The memory 12 shown in FIG.

[0027] <Schedule DB configuration> 2 is a diagram showing an example of the schedule DB 121. The schedule DB 121 is a database that stores a schedule for measuring the vital signs of a user in the estimation device 1.

[0028] The schedule DB 121 has a table structure that stores values ​​for each of the items that are associated with each other. The schedule DB 121 shown in Fig. 2 has the following items: schedule ID, day of the week, and start time. The schedule ID is identification information assigned to each schedule for performing vital sign measurement. Vital sign measurement refers to measuring the physical condition of a user. The date and time for performing vital sign measurement is determined for each purpose.

[0029] For example, a schedule for vital sign measurement performed at 9:00 a.m. every Monday through Friday is a schedule for recording physical condition at the start of work on weekdays and working days. Also, for example, vital sign measurement performed at 5:00 p.m. every Monday is a measurement for fixed-point observation of fatigue at the end of work hours on the first day of weekly activities. Also, for example, vital sign measurement performed at 12 noon on Saturdays, Sundays, and holidays is a measurement for fixed-point observation of physical condition on days off. The estimation device 1 performs vital sign measurement at a date and time determined in accordance with this schedule DB 121.

[0030] <Video DB configuration> Fig. 3 is a diagram showing an example of the moving image DB 122. The moving image DB 122 is a database that stores data of moving images (also called moving image data) of a user's face. The moving image DB 122 shown in Fig. 3 has a table structure that stores values ​​for each item that is associated with each other. The moving image DB 122 shown in Fig. 3 has items such as a moving image ID, a start date and time, a length, a schedule ID, and moving image data.

[0031] In this video DB 122, the value of the video data is the video data itself. The value of the video ID is identification information for uniquely identifying the corresponding video data. The value of the start date and time is information on the date and time when shooting of the corresponding video data started (i.e., the start date and time). The value of the length is a numerical value indicating the length of the corresponding video data. The unit of length is, for example, minutes, seconds, or other time units. The value of the schedule ID is data that stores information on the schedule identified by which schedule ID defined in the schedule DB 121 the corresponding video data was shot according to.

[0032] FIG. 4 is a diagram for explaining an example of the concept of video data. Video data is composed of a number of still images taken at regular intervals. One frame of the number of still images is called a frame. The number of still images taken per unit time is called the frame rate. As shown in FIG. 4, video data is such that each of a number of ordered frames is associated with image data indicating a still image taken at each moment. Note that video data may be compressed as long as the image data for each frame can be acquired by decompressing it.

[0033] <Vital DB configuration> Fig. 5 is a diagram showing an example of the vital DB 123. The vital DB 123 is a database that stores vital signs (hereinafter also referred to as vitals) that indicate the vital signs and physical condition of the user measured based on video data. The vital DB 123 shown in Fig. 5 has a table structure that stores values ​​for each item that is associated with each other. The vital DB 123 shown in Fig. 5 has the following items: video ID, pulse, heart rate variability, respiratory rate, LF, and HF. Of these items, the vital values ​​are five items: pulse, heart rate variability, respiratory rate, LF, and HF.

[0034] Note that the vital signs measured by the vital sign measurement are not limited to the five items mentioned above, but include at least pulse rate.

[0035] The moving image ID is identification information for identifying the moving image data that was the subject of the measurement, and is common information with that stored in the moving image DB 122. From the moving image data identified by this moving image ID, the corresponding five vital signs are obtained.

[0036] The pulse value is the number of times the blood vessels in the user's face beat per minute. Pulse is synonymous with heart rate, since it is equal to the number of times the heart beats per minute.

[0037] Heart rate variability is a numerical value that represents the fluctuation observed in the time interval between heartbeats, and is also called HRV (Heart Rate Variability). Heart rate variability reflects information related to biological control such as the autonomic nervous system, and it is known that its characteristics change depending on aging and the presence or absence of disease.

[0038] The respiration rate is the number of breaths per minute measured from the user's facial image.

[0039] The LF and HF values ​​are both calculated values ​​obtained by performing power spectrum analysis on heartbeat interval fluctuations. For example, the LF value is the sum (integral value) of the intensities of low frequency components, and the HF value is the sum (integral value) of the intensities of high frequency components. It is said that the low frequency components correspond to blood pressure fluctuations, and the high frequency components correspond to respiratory fluctuations.

[0040] The objective expression of the user's pain (called the objective quantity) is estimated using at least one of these five vitals.

[0041] <Condition DB configuration> Fig. 6 is a diagram showing an example of the condition DB 124. The condition DB 124 is a database that stores messages to be displayed and conditions for permitted processes according to the objective amount of pain of the user estimated from vital signs. The condition DB 124 shown in Fig. 6 has a table structure that stores values ​​for each item that is associated with each other. The condition DB 124 shown in Fig. 6 has the following items: objective amount, vacation request creation, chat relay, and message.

[0042] In this condition DB 124, the value of the objective quantity is a numerical value indicating the objective quantity of the user's pain estimated by the estimation device 1 from the vital signs. In this example, the value of the objective quantity is expressed as an integer from 1 to 10. In this condition DB 124, the values ​​of the objective quantity are divided into five groups of two, such as "1-2" and "3-4."

[0043] The value of "Create leave request" is data that indicates whether the process of creating a leave request is permitted for each corresponding objective quantity category. In the condition DB 124 shown in Figure 6, when the objective quantity category is "9-10" or "7-8" (i.e., when the objective quantity is 7 or more), the user can create a leave request.

[0044] The value of chat relay is data indicating whether or not chat relay is permitted for each corresponding objective quantity category. Here, "chat relay" refers to conducting a medical interview (chat) with a predetermined attending doctor, etc., by relaying an interactive application. In the condition DB 124 shown in FIG. 6, when the objective quantity category is other than "1-2" (i.e., when the objective quantity is 3 or more), the user can perform chat relay.

[0045] The message value is the wording of a message to be presented to the user according to the classification of the estimated objective quantity. For example, when the objective quantity is "9" or "10", the classification of this objective quantity is "9-10", and the estimation device 1 displays a message to the user saying "Rest is required."

[0046] <Functional configuration of the estimation device> Fig. 7 is a diagram showing an example of the functional configuration of the estimation device 1. The processor 11 of the estimation device 1 reads out and executes programs stored in the memory 12, thereby functioning as a presentation unit 111, a video acquisition unit 112, a vital sign measurement unit 113, a reference information acquisition unit 114, a subjective amount reception unit 115, an observation information acquisition unit 116, an objective amount estimation unit 117, a vacation request creation unit 118, and a chat relay unit 119 shown in Fig. 7.

[0047] The presentation unit 111 refers to the schedule DB 121 stored in the memory 12, and presents a presentation to prompt the user to measure vital signs at a predetermined date and time written in the schedule DB 121. This presentation is presented, for example, on the display screen of the display unit 15.

[0048] When a predetermined date and time arrives, the presenting unit 111, for example, prompts the user to take a picture of his or her own face (also called a selfie).

[0049] Also, before and after taking a selfie, the presenting unit 111 presents an illustration of the body on the display unit 15. The presenting unit 111 then prompts the user looking at the presented illustration to input the part of the body that is particularly painful (hereinafter also referred to as the affected part) and the subjective amount of pain (hereinafter referred to as the subjective amount). At this time, the subjective amount receiving unit 115, which will be described later, receives the user's input.

[0050] The presentation unit 111 also presents observation information acquired by an observation information acquisition unit 116 and an objective quantity estimated by an objective quantity estimation unit 117, which will be described later.

[0051] The video acquisition unit 112 controls the camera 16 to acquire video data showing a video of the user of the estimation device 1 capturing his / her own face. At this time, the video acquisition unit 112 may associate the content presented by the presentation unit 111 with the video data. The video data acquired by the video acquisition unit 112 is stored in the video DB 122 of the memory 12.

[0052] Vital sign measurement unit 113 reads video data from video DB 122 and measures vital signs based on this video data. The values ​​of vital signs measured by vital sign measurement unit 113 are stored in vital sign DB 123 together with a video ID that identifies the video data, as shown in FIG.

[0053] As described above, vital signs include at least pulse rate, so the estimation device 1 having a processor 11 functioning as this vital sign measurement unit 113 is an example of an estimation device that measures the user's pulse rate based on a video of the user's body.

[0054] The reference information acquisition unit 114 refers to the vital DB 123 and acquires the values ​​of the user's vital signs measured in the past as reference information. This reference information is, for example, an arithmetic mean value (so-called moving average value) of the values ​​of the vital signs measured in the most recent 100 days. Note that the vital signs always include a pulse. Therefore, this pulse treated as the reference information is an example of a reference pulse, which is a pulse measured in the past.

[0055] The subjective quantity receiving unit 115 receives, for example, from the operation unit 14, the specification of the affected area and the subjective quantity input by the user operating the operation unit 14 when the presentation unit 111 is presenting an illustration of the body on the display unit 15 as described above. This subjective quantity is the subjective quantity of pain felt by the user himself / herself. In other words, the estimation device 1 having the processor 11 functioning as the subjective quantity receiving unit 115 is an example of an estimation device that receives an input of the subjective quantity of pain felt by the user from the user. In the example shown in Fig. 7, the subjective quantity is input in association with the information on the affected area presented by the presentation unit 111 described above.

[0056] The observation information acquisition unit 116 acquires observation information such as atmospheric pressure and temperature observed by the observation unit 17. For example, atmospheric pressure is known to be a major cause of weather-related pain. Weather-related pain is pain caused by the brain overreacting due to the stress caused by the change in atmospheric pressure, which increases the activity of the sympathetic nerves and disrupts the balance of the autonomic nerves. There are various symptoms of weather-related pain, but typical ones include worsening chronic pain such as migraine and tension headache, pain in the shoulders, neck, knees, and lower back, dizziness, fatigue, and depression. The observation information acquisition unit 116 supplies the acquired observation information to the objective quantity estimation unit 117.

[0057] The objective quantity estimation unit 117 estimates the objective quantity of the user's pain using the vital sign values ​​measured by the vital sign measurement unit 113, reference information which is past vital sign values ​​acquired by the reference information acquisition unit 114, and the subjective quantity accepted from the user by the subjective quantity acceptance unit 115.

[0058] In other words, the estimation device 1 having the processor 11 functioning as this objective quantity estimation unit 117 is an example of an estimation device that estimates the objective quantity of the user's pain using the measured pulse, a reference pulse measured in the past, and a subjective quantity received from the user.

[0059] For example, the user's doctor records the subjective quantities of symptoms that the user has previously complained about in a medical interview in association with the diagnosis results. This record is stored in the memory 12 of the estimation device 1. In this case, the objective quantity estimation unit 117 may use the subjective quantity input this time and the measured vital sign value to search for a similar combination of subjective quantity and vital sign value from the stored data, and estimate the objective quantity from the associated diagnosis result.

[0060] Furthermore, the objective quantity estimation section 117 may estimate the objective quantity by inputting the above-mentioned reference information, vital signs (current values), and subjective quantities as variables into a predetermined function.

[0061] In addition, the objective quantity estimation unit 117 may estimate the objective quantity from the above-mentioned reference information, vital sign values ​​(current values), and subjective quantities using a machine learning model that has been trained on the vital sign values, subjective quantities, and objective quantities indicated by the doctor's diagnosis results as teacher data.

[0062] The leave request creation unit 118 refers to the condition DB 124 and judges whether the objective quantity estimated by the objective quantity estimation unit 117 satisfies the conditions. If the leave request creation unit 118 judges that the conditions are met (i.e., the creation of a leave request is permitted), it creates a leave request with data attached that proves the objective quantity of pain. The leave request creation unit 118 then controls the communication unit 13 to send the created leave request to a communication destination, such as the user's work email address, that has been stored in advance in the memory 12.

[0063] The chat relay unit 119 refers to the condition DB 124 and judges whether or not the objective quantity estimated by the objective quantity estimation unit 117 satisfies the condition. If the chat relay unit 119 judges that the condition is satisfied (i.e., chat relay is permitted), it controls the communication unit 13 to transmit a request for a medical interview via chat relay to a notification destination such as a chat account of the user's doctor stored in advance in the memory 12.

[0064] Here, chat refers to real-time communication using text, voice, etc., over the Internet or the like, and is executed by a chat application executed by the processor 11 of the estimation device 1. The chat account is information for authenticating an individual by the above-mentioned chat application. The chat application can conduct a medical interview by chat between the user and the attending doctor by using the chat account of the user of the estimation device 1 and the chat account of the attending doctor. The chat relay unit 119 relays the medical interview by chat by providing these chat accounts according to the API (Application Programming Interface) of the chat application.

[0065] <Operation of the estimation device> 8 is a diagram showing an example of the flow of the operation of the estimation device 1. The processor 11 of the estimation device 1 checks the schedule stored in the schedule DB 121 (step S101), and judges whether the date and time scheduled for vital sign measurement has arrived by comparing with the current time (step S102). When it is judged that the date and time scheduled for measurement has not arrived (step S102; NO), the processor 11 returns the process to step S101.

[0066] On the other hand, when it is determined that the scheduled date and time of measurement has arrived (step S102; YES), the processor 11 controls the observation unit 17 to acquire observation information (step S103). In this example, the processor 11 acquires information on the atmospheric pressure measured by the observation unit 17.

[0067] In addition, the processor 11 controls the display unit 15 to prompt the user to take a selfie video, and acquires video data from the camera 16 (step S104).

[0068] Fig. 9 is a diagram showing an example of a display area R0. As shown in Fig. 9, a display unit 15 and a camera 16 are provided on the front side of the estimation device 1. As described above, the display unit 15 has a display screen such as a liquid crystal display. In the upper part of this display screen, a general information display area for displaying radio wave reception sensitivity, remaining battery level, time, etc. is provided, and in the lower part, a general operation area for receiving operations on the operating system is provided. Then, a display area R0 is provided between these areas. This display area R0 is assigned to a program for estimating the objective amount of pain.

[0069] Fig. 10 is a diagram showing an example of a display when shooting a selfie video. When the processor 11 prompts the user to take a selfie, a stop icon area R1, an explanation area R2, a face shooting area R3, and a shooting start button area R4 are displayed in the display area R0, as shown in Fig. 10.

[0070] The cancel icon area R1 is an area for accepting an instruction to cancel selfie video shooting.

[0071] The explanation area R2 is an area for displaying text and the like that explains the procedure for taking a selfie video. In the example shown in Fig. 10, the explanation area R2 displays the following explanation: "Hold the smartphone directly in front of your face, align your face with the circle, and press the 'Start recording' button."

[0072] The face shooting area R3 is an area that indicates the range in which the user's own face should fit within the image area that simultaneously displays the selfie video being shot.

[0073] The shooting start button area R4 is an area that displays a button for starting selfie video shooting.

[0074] Returning to the description of the operation shown in Fig. 8, when the user presses the shooting start button to shoot his / her own face and video data is supplied from camera 16, processor 11 analyzes this video data and measures vital signs (step S105).

[0075] Next, the processor 11 controls the display unit 15 to prompt the user to tap each affected area where the user feels pain and input the subjective amount of pain for each affected area (step S106).

[0076] 11 is a diagram showing an example of an image displayed in display region R0 in step S106. At this time, display region R0 displays a description region R5, an illustration region R6, a switching region R7, a subjective amount input region R8, and a total subjective amount region R9.

[0077] The explanation area R5 is an area that displays an explanation of how to input the subjective amount. The explanation area R5 shown in Fig. 11 displays the text "FRONT" indicating that the currently displayed illustration is the front of the body, and the text "Tap the painful area" to explain the procedure for inputting the subjective amount.

[0078] The illustration area R6 is an area in the center of the display area R0 that displays an illustration of the body. The type of illustration displayed in the illustration area R6 is linked to the explanatory text displayed in the upper part of the explanatory area R5, which explains from which direction the illustration is viewed.

[0079] The switching area R7 is an area that displays an icon for instructing to switch the type of illustration displayed in the illustration area R6. The switching areas R7 shown in Fig. 11 are provided on the left and right sides of the illustration area R6. The user can switch the type of illustration displayed in the illustration area R6 by touching the icon displayed in each of the switching areas R7 on the left and right.

[0080] The subjective amount input area R8 is an area for inputting the amount of subjective pain felt by the user for the affected area selected by the user tapping on the illustration area R6. The subjective amount input area R8 shown in FIG. 11 is a so-called slide bar. Note that the area for inputting the amount of subjective pain felt by the user is not limited to a slide bar, and other configurations may be displayed. For example, a pull-down menu for inputting the above-mentioned amount of subjective pain may be displayed in this area.

[0081] This subjective quantity input area R8 displays an image in which a round symbol is drawn on a bar extending from left to right. When the user's finger or the like touches this round symbol and moves it from left to right, the processor 11 controls the display unit 15 to slide (move) the symbol from left to right along the bar in accordance with the movement of the finger or the like. In the subjective quantity input area R8 shown in Fig. 11, a numerical value indicated by the position of the round symbol is displayed on the right side of the bar, where the right end of the bar is 10 and the left end of the bar is 0. This numerical value is the subjective quantity input by the user.

[0082] 11, for example, the user taps on the abdomen of the human-shaped illustration displayed in the illustration area R6 to input a subjective amount of "6.1" in the subjective amount input area R8. This causes the estimation device 1 to accept information that the user is feeling pain in the abdomen with a subjective amount of "6.1."

[0083] The total subjective amount area R9 is an area that displays a total subjective amount of pain obtained by tallying up the subjective amounts input by the user for each affected area. In Fig. 11, the total subjective amount area R9 displays a total subjective amount of "1.4".

[0084] In the flow diagram shown in Fig. 8, after measuring the vital signs in step S105, the processor 11 displays an illustration of the affected area and accepts the input of the subjective amount in step S106, thereby associating the measured vital signs with the subjective amount for each affected area of ​​the user. In other words, the estimation device 1 having this processor 11 is an example of an estimation device that measures the pulse of a user before presenting information to the user to make the user aware of the area where pain is occurring. The order of inputting the subjective amount and measuring the vital signs may be reversed.

[0085] 8, the illustration of the affected area is displayed, that is, information for making the patient aware of the area where pain is occurring is presented when the scheduled date and time of measurement arrives as a result of referring to the schedule DB 121 in step S102. In other words, this estimation device 1 is an example of an estimation device that presents information according to a predetermined schedule. The above-mentioned information may be presented according to a schedule or in response to a user's instruction via the operation unit 14.

[0086] Returning to the description of the operation shown in Fig. 8, upon acquiring the observation information, vital signs, and subjective quantities, processor 11 estimates the objective quantities according to a combination of the acquired observation information, vital signs (current measured values ​​and reference information which are past values), and subjective quantities (step S107).

[0087] Therefore, the estimation device 1 having this processor 11 is an example of an estimation device that acquires observational information observed in the environment surrounding the user, and estimates the objective amount of the user's pain based on a combination of this observational information, the measured pulse rate, and the reference pulse rate.

[0088] When the objective quantity is estimated, the processor 11 causes the display unit 15 to display the estimated objective quantity (step S108). Here, the estimation device 1 may display the estimated objective quantity as a numerical value, but may display an image corresponding to the objective quantity, rather than the numerical value itself.

[0089] Fig. 12 is a diagram showing an example of a screen displayed according to the estimated objective amount of pain. When the objective amount is displayed on the display unit 15, a facial expression icon area R10, a message area R11, a leave request creation button area R12, and a chat relay button area R13 are displayed in the display area R0, as shown in Fig. 12(a).

[0090] The facial expression icon area R10 is an area in which the user's physical condition, which is indicated by the objective amount of pain, is expressed by displaying facial expression icons (also called facial expression icons). The facial expression icon area R10 is disposed in the center of the display area R0. Note that the method of conveying the user's physical condition to the user does not have to be facial expression icons, and other expression methods such as numerical values ​​may also be used.

[0091] The message area R11 is an area for displaying a character string indicating a message to be conveyed to the user according to the user's physical condition indicated by the objective amount of pain. The message area R11 is disposed immediately below the facial expression icon area R10.

[0092] The combinations of facial expression icons and messages are assigned to each of the five objective amount categories, as shown in FIG. 12(b), for example.

[0093] The leave request create button area R12 is an area that displays a button (called the leave request create button) that accepts instructions to create and send a leave request. The estimation device 1 refers to the condition DB 124 shown in Fig. 6, and when the conditions are met, displays the leave request create button in this leave request create button area R12. If the conditions are not met, the estimation device 1 displays the leave request create button in a grayed-out state. In this case, the user cannot give instructions to create and send a leave request.

[0094] The chat relay button area R13 is an area for displaying a button (called a chat relay button) for receiving an instruction to start a medical interview via chat with the patient's doctor (industrial physician). The estimation device 1 refers to the condition DB 124 shown in FIG. 6, and when the conditions are met, displays the chat relay button in this chat relay button area R13. When the conditions are not met, the estimation device 1 displays the chat relay button in a grayed-out state. In this case, the user cannot give an instruction to relay the chat.

[0095] Returning to the description of the operation shown in Fig. 8, the processor 11 refers to the condition DB 124 stored in the memory 12 and determines whether the estimated objective quantity satisfies the condition (step S109). When it is determined that the estimated objective quantity does not satisfy the condition (step S109; NO), the processor 11 returns the process to step S101.

[0096] On the other hand, when it is determined that the estimated objective quantity satisfies the condition (step S109; YES), the processor 11 starts accepting processing that is permitted because the condition is satisfied (step S110). As this processing, the processor 11 starts creating a leave request or inquiring with the attending physician using a chat application. When the processing accepted in step S110 ends, the processor 11 returns the processing to step S101.

[0097] Through the operations described above, the estimation device 1 can estimate an objective amount of pain that is difficult for the user to explain, and can explain it to others on behalf of the user.

[0098] <Modification> The above is a description of the embodiment, but the contents of this embodiment may be modified as follows. In addition, the following modifications may be combined with each other.

[0099] In the above-described embodiment, the estimation device 1 has the processor 11 configured as a CPU, but the control means for controlling the estimation device 1 may have other configurations.

[0100] That is, the estimation device 1 may have, as the processor 11, various types of processors, such as a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), a programmable logic device, etc., other than a CPU.

[0101] The operations of the processor in the above-described embodiments may not only be performed by one processor, but may also be performed by a plurality of processors located at physically separate locations working together.

[0102] Furthermore, the order of each operation of the processor is not limited to the order described in the above embodiment, and may be changed as appropriate.

[0103] In the above-described embodiment, the estimation device 1 measures the user's pulse before the user is presented with information to make the user aware of the area where pain is occurring, but the user's pulse may be measured after the information is presented to the user. In this case, the estimation device 1 is an example of an estimation device that measures the user's pulse after the information is presented to the user to make the user aware of the area where pain is occurring.

[0104] In this case, the estimation device 1 may receive a user's response to the presentation of information to make the user aware of the area where the pain is occurring (i.e., the affected area) and estimate the objective amount of pain based on the response. This estimation device 1 is an example of an estimation device that receives a user's response to the presentation of information and estimates the objective amount of pain based on the response.

[0105] In the above-described embodiment, the estimation device 1 estimates the objective amount of the user's pain, but in addition to this objective amount, the type of pain may be estimated. The type of pain is, for example, a type that is distinguished by expressions such as "throbbing pain," "tightening pain," and "pain that digs into the back of the eyes," and is specified by conditions such as whether the sympathetic nerve or the parasympathetic nerve is dominant among the autonomic nerves. The type of pain may be specified at least according to the state of the autonomic nerves of the user. That is, the estimation device 1 in this modified example is an example of an estimation device that estimates the type of pain corresponding to at least the state of the autonomic nerves of the user along with the estimated objective amount of the user's pain.

[0106] In the above-described embodiment, the schedule DB stored in the memory 12 of the estimation device 1 In the schedule DB 121, the actual time (also called absolute time) is described as the start time, but a relative time indicating the time difference from a reference time may be described. For example, the schedule DB 121 may store the elapsed time from the wake-up time as the start time.

[0107] In this case, the estimation device 1 compares and considers the measured vital signs and the previously measured vital signs as reference information for each elapsed time from the wake-up time, which is the reference time. In other words, the estimation device 1 in this modification is an example of an estimation device that compares the measured pulse rate and the previously measured reference pulse rate for each elapsed time from the wake-up time to estimate an objective quantity.

[0108] In the above-described embodiment, the estimation device 1 is a single mobile terminal, but some of the functions may be realized by an external device.

[0109] 13 is a diagram showing an example of the overall configuration of an estimation system 9 according to a modified example. The estimation system 9 shown in FIG.

[0110] The estimation device 1 is a mobile terminal, for example a smartphone. The server device 2 is a computer connected to one or more estimation devices 1 so as to be able to communicate with each other.

[0111] The communication line 3 is a line that communicatively connects the estimation device 1 and the server device 2. The communication line 3 may be, for example, a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, or a combination of these.

[0112] It should be noted that the respective numbers of the estimation devices 1 and the server devices 2 in the estimation system 9 are not limited to those shown in Fig. 13. For example, the server device 2 may be configured as a cluster system in which a plurality of devices share functions.

[0113] Fig. 14 is a diagram showing an example of the configuration of a server device 2 according to a modified example. As shown in Fig. 14, the server device 2 includes a processor 21, a memory 22, and a communication unit 23. These are connected by a bus.

[0114] The processor 21 reads and executes a program stored in the memory 22 to control each part of the estimation device 1. The processor 21 is, for example, a CPU.

[0115] The communication unit 23 is a communication circuit that communicatively connects the server device 2 to other devices via the communication line 3 in a wired or wireless manner.

[0116] The memory 22 is a storage means for storing an operating system, various programs, data, etc., which are loaded into the processor 21. The memory 22 includes a RAM and a ROM.

[0117] The memory 22 may include a solid state drive, a hard disk drive, etc. The memory 22 also stores a schedule DB 221, a video DB 222, a vital DB 223, and a condition DB 224. These are databases common to the schedule DB 121, the video DB 122, the vital DB 123, and the condition DB 124 stored in the memory 12 of the estimation device 1 shown in the embodiment.

[0118] The processor 21 of the server device 2 may realize any of the functional configurations realized by the processor 11 in the embodiment, instead of the processor 11. For example, the processor 21 may function as an acquisition unit that acquires video data from the estimation device 1. In this case, the processor 11 of the estimation device 1 may transmit the video data to the server device 2 via the communication unit 13, the communication line 3, and the communication unit 23.

[0119] The processor 21 may also function as a measuring means for measuring the vital signs of the user based on the video data. The processor 21 may also function as a receiving means for receiving the subjective amount of pain input by the user in the estimation device 1 via the communication unit 13, the communication line 3, and the communication unit 23.

[0120] In addition, the processor 21 may function as an estimation means for estimating the objective amount of pain of the user using vital signs measured from video data in the estimation device 1 or the server device 2, reference information which is vital signs measured in the past, and the subjective amount of pain received from the user.

[0121] The acquisition means, the measurement means, the reception means, and the estimation means may be realized by either the estimation device 1 or the server device 2. As described above, the vital signs are measured values ​​including at least information on the user's pulse. That is, in this modified example, the estimation system 9 having the estimation device 1 and the server device 2 is an example of an estimation system having an acquisition means for acquiring a video of the user's body, a measurement means for measuring the user's pulse based on the video, a reception means for receiving an input of the subjective amount of pain felt by the user from the user, and an estimation means for estimating the objective amount of the user's pain using the measured pulse, a reference pulse which is the user's pulse previously measured, and the subjective amount received from the user.

[0122] The above-mentioned program for estimating the objective amount of pain is an example of a program for causing a computer to execute the steps of acquiring a video of the user's body, measuring the user's pulse based on the video, accepting input from the user of the subjective amount of pain he or she is feeling, and estimating the objective amount of the user's pain using the measured pulse, a reference pulse which is a pulse previously measured by the user, and the subjective amount received from the user.

[0123] The program for executing each of the above steps may be provided in a state stored in a computer-readable recording medium such as a magnetic recording medium such as a magnetic tape or a magnetic disk, an optical recording medium such as an optical disk, a magneto-optical recording medium, a semiconductor memory, etc. This program may also be downloaded via a communication line such as the Internet.

[0124] In the above-described embodiment, the estimation device 1 acquires the observation information observed in the environment surrounding the user, but the observation information may not be acquired. In this case, the estimation device 1 may not have the observation unit 17, and may not use the observation information to estimate the objective quantity. Furthermore, the processor 11 may not function as the observation information acquisition unit 116. When the observation information is not used, the objective quantity estimation unit 117 may estimate the objective quantity of the user's pain using the measured pulse, a reference pulse measured in the past, and a subjective quantity received from the user.

[0125] In the above-described embodiment, the input of the subjective amount by the user is accepted through the illustration area R6, the subjective amount input area R8, etc. shown in FIG. 11, but it may be accepted through other areas.

[0126] Furthermore, in the above-described embodiment, the input of the subjective amount of pain was a set of the painful area, i.e., the affected area, and a numerical value indicating the subjective magnitude of the pain, but it may also include subjective information related to physiology, information about what the user believes to be the cause of the pain, and the user's expressions regarding the pain (words, actions, etc.).

[0127] Furthermore, in the above-described embodiment, the estimation device 1 receives the input of the subjective amount from the user after measuring the vital signs, but this order may be reversed.

[0128] Fig. 15 is a diagram showing an example of the upper part of the display area R0 according to the modified example. Fig. 16 is a diagram showing an example of the lower part of the display area R0 according to the modified example. When the upper part of the display area R0 shown in Fig. 15 is displayed on the screen, if the user performs an upward swipe operation, the lower part of the display area R0 is displayed on the screen as shown in Fig. 16. When the lower part of the display area R0 shown in Fig. 16 is displayed on the screen, if the user performs a downward swipe operation, the upper part of the display area R0 is displayed on the screen as shown in Fig. 15.

[0129] The display area R0 has a part designation area R20, a subjective amount selection area R21, a menstrual flow input area R22, a menstrual blood amount input area R23, a cause input area R24, a comment input area R25, and a measurement start button area R26.

[0130] The part designation area R20 is an area where the user designates the affected area (painful area). This part designation area R20 is a so-called pull-down menu, and when clicked, a list of candidates for the affected area prepared in advance is displayed. The user can designate the affected area by selecting one of the listed candidates and then clicking it. Note that this part designation area R20 may also include an option for "no painful area" as a candidate. In this case, when the user selects "no painful area" in this part designation area R20, the estimation device 1 may set the subjective amount of pain to "0" indicating "no" pain without accepting a selection in the subjective amount selection area R21.

[0131] The subjective amount selection area R21 is an area where the user selects one of a plurality of pain levels prepared in advance, instead of inputting a numerical value using a slide bar as in the subjective amount input area R8, to input the subjective amount of pain. The subjective amount selection area R21 shown in FIG. 15 is configured to display five pain levels as buttons, so that the user can select one of them. The user may input that there is "no pain" by not selecting any of the five pain levels.

[0132] The menstruation input area R22 is an area for inputting whether or not a female user has a period (menstruation) and the number of days since the menstruation. The user is prompted to select either the "absent" or "present" button for menstruation. If the user selects "present," the estimation device 1 displays a pull-down menu for accepting the designation of the number of days since the menstruation.

[0133] The menstrual blood amount input area R23 is an area for receiving the input of the menstrual blood amount from the female user. The menstrual blood amount input area R23 shown in Fig. 15 is configured to display three stages of menstrual blood amount with buttons, so that the user can select one of them.

[0134] 16 is an area for prompting the user to input "possible causes of pain" other than menstruation. The cause input area R24 shown in this example includes a number of buttons on which character strings indicating causes are written, and when the user selects one or more of these, the estimation device 1 accepts input of information on the cause of pain thought by the user. Among these buttons, "None" may be set so that it cannot be selected in parallel with other buttons.

[0135] The comment input area R25 is an area for receiving input of a user's comment regarding the subjective amount of pain. This comment input area R25 receives words expressed in text as an expression uttered by the user.

[0136] The estimating device 1 that accepts a subjective amount through this comment input area R25 is an example of an estimating device that accepts an expression uttered by a user as an input of the subjective amount of pain felt by the user himself / herself.

[0137] The words uttered by the user may be characters (including emojis) or sentences inputted via a software keyboard on a smartphone, but the input method is not limited to this.

[0138] For example, the estimation device 1 may extract expressions made by the user from gestures, hand movements, movements, body language, illustrations, line drawings, and the like of the user obtained by analyzing video recorded by the camera 16.

[0139] The estimation device 1 may also analyze the user's voice collected by a microphone (not shown) and accept the analysis result as an expression made by the user. The estimation device 1 may also accept the collected user's voice itself as an expression made by the user.

[0140] Furthermore, the estimation device 1 may acquire the content posted by the user from a social networking service (SNS) application used by the user, and extract the expression uttered by the user from the content posted.

[0141] That is, the expression that the estimation device 1 accepts as an input of the subjective amount of pain may be a character, a voice, or a movement input by the user, or an expression extracted from content posted by the user.

[0142] The measurement start button area R26 is a button for starting a selfie and instructing measurement of autonomic nerves based on a video of a face, etc. In this way, the estimation device 1 may start measuring vital signs after receiving an input of the subjective amount of pain from the user.

[0143] In the above-described embodiment, the estimation device 1 estimates the objective amount of the user's pain using the measured pulse rate of the user, the user's reference pulse rate measured in the past, and the subjective amount input by the user, and displays it on the display unit 15, but various other information may also be displayed in addition to this.

[0144] 17 is a diagram showing an example of the configuration of the estimation device 1 according to the modified example. The estimation device 1 according to the modified example further stores a recommendation DB 125, an alert DB 126, and a user expression DB 127 in the memory 12.

[0145] Fig. 18 is a diagram showing an example of recommendation DB 125. Recommendation DB 125 shown in Fig. 18 is a database that stores identification information of content to be recommended to a user according to a combination of a painful body part, an autonomic nerve state, and a measurement time period. Recommendation DB 125 has a body part list 1251 and a recommended content table 1252. Note that recommendation DB 125 may store identification information of the above-mentioned content according to a combination of a painful body part, an autonomic nerve state, and a measurement time period, as well as the user's medical history.

[0146] Body part list 1251 is a list of body parts that can be received from the user. Recommended content table 1252 is a table provided for each body part listed in body part list 1251. This recommended content table 1252 is a table that stores identification information of content corresponding to a combination of a corresponding body part, the state of the user's autonomic nerves, and the time period when the measurement was performed.

[0147] Here, the state of the autonomic nerves is information obtained by analyzing the measured pulse of the user, and indicates whether the sympathetic or parasympathetic nerves of the user are dominant. For example, according to the recommendation DB 125 shown in Fig. 18, if the user selects "head" as the part of the body that hurts in the "morning" and the pulse measured at that time is analyzed to indicate that the user is in a "parasympathetic dominant" state, the identification information of the content to be recommended is "V2".

[0148] "Content" refers to videos, music, and articles that users watch, such as lesson videos for mindfulness and yoga, background music, etc. In particular, in mindfulness and meditation, the content recommended to the user varies depending on the time of day, the state of the autonomic nervous system, and the painful area. The recommendation DB 125 stores appropriate mindfulness and other content in association with each combination of time of day, state of the autonomic nervous system, and painful area.

[0149] By referring to this recommendation DB 125, the estimation device 1 determines the content to be recommended based on the body part specified by the user when inputting the subjective amount, the state of the autonomic nerves obtained from the measured vital signs, and the time period during which the measurement was performed.

[0150] Fig. 19 is a diagram showing an example of the alert DB 126. The alert DB 126 is a database that stores information for alerting a user based on index values ​​calculated from the measured values ​​of the user's pulse and the relationship with the statistics of the index values. The alert DB 126 shown in Fig. 19 has a vital sign division table 1261 and an alert data list 1262.

[0151] The vital sign division table 1261 is a table that classifies the relationship between the index value calculated from the measured value of the user's pulse and the statistics thereof. In the alert DB 126 shown in FIG. 19, the index values ​​in the vital sign division table are TP and LF / HF. For example, when TP is below the average and LF / HF is above the average, the relationship is classified as "W3", which is the identification information of the alert. In other words, the vital sign division table 1261 classifies users according to how the above-mentioned (current) index value of the user is compared with the statistics of the user's past index values. Note that the index value calculated from the measured value of the user's pulse at the present time may be compared with the statistics of the user's past index values ​​as described above, but may also be compared with, for example, the statistics of index values ​​calculated from the results of measuring the pulses of multiple users.

[0152] The alert data list 1262 is a list that lists alert data for each identification information of the alerts classified in the vital sign classification table 1261. An alert is a warning, and alert data is data that indicates information about an event to which the user should be warned. Here, "event" refers to an occurrence, symptom, etc., that occurs in the user's body. The alert data list 1262 shown in FIG. 19 stores the WID item, which is the identification information of the alert, in association with the alert data.

[0153] The alert data shown in FIG. 19 describes three events: "pain," "menstrual blood volume," and "first day." "Pain" is information indicating whether or not the user is likely to experience pain in the future. "Menstrual blood volume" is information indicating the user's predicted future menstrual blood volume. "First day" is information indicating the predicted first day of the user's menstruation, for example, "how many days from today." By referring to this alert DB 126, the estimation device 1 determines the information to be warned about based on where the user's current index value is relative to these statistics.

[0154] Fig. 20 is a diagram showing an example of the user expression DB 127. The user expression DB 127 shown in Fig. 20 is a database that stores, for each word included in an expression uttered by a user, a mode to which the word belongs and a score indicating the strength with which the word belongs to the mode in association with each other.

[0155] Here, a "mode" is a classification of mental states, for example, a "Doing mode" and a "Being mode."

[0156] "Doing mode" is a state of mind in which one tries to achieve a goal. When in this "Doing mode," people are said to be conscious of the gap between their ideals and reality, and to feel the urge to close that gap as much as possible.

[0157] On the other hand, "Being mode" is also called "being mode," and is a state of mind in which one receives events as they are, detached from evaluation and judgment regarding the achievement of goals.

[0158] For example, in the user expression DB 127 shown in Fig. 20, the expression "I have to" belongs to the "Doing" mode and has a score of "1." The estimation device 1 refers to the user expression DB 127 and tallies up the mode to which each word belongs and the score for each word included in the sentence input in the comment input area R25 described above. Then, the estimation device 1 determines to what extent the center of gravity of the user's mental state lies in which mode based on the respective scores.

[0159] 20 stores a mode and a score for each word in association with each other, but is not limited to this. The user expression DB 127 may include, for example, information on the position of a word in a sentence, information on other words that appear before and after the word, etc. The user expression DB 127 may store a rule for calculating the mode and score of a word by analyzing the context of the entire sentence, paragraph, or comment and taking into consideration the usage of the word therein. The user expression DB 127 may be a machine learning model generated by providing training data consisting of a group of sentences labeled in advance by mode.

[0160] 21 is a diagram illustrating an example of a functional configuration of an estimation device 1 according to a modified example. The processor 11 of the estimation device 1 reads and executes a program stored in the memory 12, thereby functioning as a recommendation unit 110a, a warning unit 110b, and a determination unit 110c in addition to the functions illustrated in FIG.

[0161] Processor 11 shown in Fig. 21 may or may not function as vacation request creation unit 118 and chat relay unit 119 shown in Fig. 7. Furthermore, estimation device 1 does not need to have observation unit 17, and processor 11 does not need to function as observation information acquisition unit 116.

[0162] The recommendation unit 110a refers to the recommendation DB 125 and identifies identification information of content to be recommended that corresponds to the combination of the subjective quantity and vital values ​​acquired from the objective quantity estimation unit 117. Then, the recommendation unit 110a transmits the content indicated by the identified identification information, or the title, thumbnail, URI (Uniform Resource Identifier), etc. of the content to the presentation unit 111, and causes the presentation unit 15 to present the content. In this way, the estimation device 1 recommends the above-mentioned content to the user.

[0163] The recommendation unit 110a may directly acquire the vital signs value from the reference information acquisition unit 114 and the subjective amount from the subjective amount receiving unit 115. The recommendation unit 110a may also acquire observation information and recommend content according to the observation information. In this case, the recommendation DB 125 referred to by the recommendation unit 110a may store the identification information of the content according to the combination with the observation information in addition to the painful part of the body, the state of the autonomic nerves, and the time period. The recommendation unit 110a may not need to consider the time period when the measurement was performed when deciding the content to be recommended.

[0164] Therefore, the estimation device 1 in which the processor 11 functions as the recommendation unit 110a is an example of an estimation device that analyzes a pulse rate and presents content according to the pulse rate analysis result and an input of a subjective amount to a user.

[0165] The warning unit 110b issues a warning about an event that is predicted to occur in the user's body in the future, based on the vital values ​​acquired from the objective quantity estimation unit 117. The warning unit 110b, for example, compares the TP and LF / HF index values ​​calculated from the vital values ​​measured for the current user with their past statistical values, and identifies alert data that should be warned to the current user.

[0166] The warning unit 110b then transmits the identified alert data to the presentation unit 111 to have it presented on the display unit 15. In this way, the estimation device 1 warns the user about the above-mentioned event. The warning unit 110b may directly acquire the vital signs value from the reference information acquisition unit 114.

[0167] Therefore, the estimation device 1 in which the processor 11 functions as the warning unit 110b is an example of an estimation device that issues a warning about a specified event that is predicted to occur in the user's body in the future based on statistics of the pulse rate and the reference pulse rate.

[0168] The judgment unit 110c refers to the user expression DB 127, analyzes the "expression made by the user" included in the subjective quantity input acquired from the objective quantity estimation unit 117, and judges the user's mental state based on the analysis result.

[0169] Then, the determination unit 110c conveys the determined "mental state of the user" to the presentation unit 111 to have it presented on the display unit 15. In this way, the estimation device 1 presents the mental state of the user determined from the expression uttered by the user. That is, the estimation device 1 determines, for example, to what extent the user is more likely to be in the "Doing mode" or the "Being mode" according to the expression uttered by the user, and shows the determination result to the user.

[0170] The determination unit 110c may directly obtain the input of the subjective amount from the subjective amount receiving unit 115 and analyze the "expression uttered by the user."

[0171] Therefore, the estimation device 1 in which the processor 11 functions as the determination unit 110c is an example of an estimation device that determines a mental state of a user based on an expression uttered by the user and presents the determination result to the user.

[0172] The recommendation unit 110a described above recommends content according to a combination of the subjective amount and the vital values, but may recommend content according to the judgment result of the judgment unit 110c. In this case, the recommendation DB 125 may store identification information of the content to be recommended in association with the user's mental state.

[0173] Fig. 22 is a diagram showing an example of the flow of the operation of the estimation device 1 according to the modified example. Among the steps shown in Fig. 22, explanations of steps common to the operation shown in Fig. 8 will be omitted. For example, when step S102 shown in Fig. 8 is judged as YES or step S103 is completed, the processor 11 of the estimation device 1 accepts an input of the subjective amount of pain from the user (step S201). At this time, under the control of the processor 11, the display unit 15 displays, for example, the display area R0 shown in Figs. 15 and 16.

[0174] 16, the processor 11 starts a selfie and captures a video of the user's body (step S202). When the capture of the video is completed, the processor 11 measures vital signs from the captured video (step S203).

[0175] As described above, the processor 11 estimates the objective quantity according to a combination of the vital signs and the subjective quantity, and when the processor 11 causes the display unit 15 to display the estimation result, it further presents the above-mentioned three items to the user.

[0176] The processor 11 causes the display unit 15 to display the mental state determination result (step S204). The processor 11 also displays a warning regarding an event that is predicted to occur to the user's body in the future (step S205). Furthermore, the processor 11 recommends content to the user (step S206).

[0177] Through the above operations, the estimation device 1 presents the objective amount of pain of the user, as well as various other information such as the mental state assessment result, a warning regarding a specific event that may occur in the user's body, and content that should be recommended to the user.

[0178] In the above-described embodiment, an example was given in which the objective quantity estimation unit 117 realized by the processor 11 of the estimation device 1 uses a predetermined function when estimating an objective quantity. This function is expressed, for example, by the following equation (1).

[0179] [Number 1] y = α x1 + β x2 + γ x3 … (1) In this formula, x1 is the level of pain input by the user and is given as an integer in one of six levels, for example, from 0 to 5. Furthermore, x2 is the HF value calculated from the measured pulse rate of the user, and x3 is the LF / HF value.

[0180] Therefore, the estimation device 1 in this modified example is an example of an estimation device that estimates an objective quantity using a function obtained by multiplying a subjective quantity, a sympathetic nerve index value calculated from the pulse rate, and a parasympathetic nerve index value calculated from the pulse rate by a coefficient and adding them together.

[0181] The coefficients in the above formula (1) are, for example, α = 10, β = 1, and γ = 10. These coefficients should be determined so that the proportions of the three terms x1, x2, and x3 are close to equal. This determination should take into account, for example, the ranges that x1, x2, and x3 can take, statistical distribution, and the like.

[0182] In the above-described embodiment, the objective quantity estimation unit 117 realized by the processor 11 of the estimation device 1 estimates the objective quantity of the user's pain using the vital sign values ​​measured by the vital sign measurement unit 113, reference information which is the past vital sign values ​​acquired by the reference information acquisition unit 114, and the subjective quantity accepted from the user by the subjective quantity acceptance unit 115, but the objective quantity may be estimated without using the reference information, as in the case of using the function shown in the above-described formula (1). In this case, the objective quantity estimation unit 117 estimates the objective quantity of the user's pain from the currently measured vital sign values ​​of the user and the subjective quantity accepted from the user at the current time. [Explanation of symbols]

[0183] 1...estimation device, 11...processor, 111...presentation unit, 112...video acquisition unit, 113...vital measurement unit, 114...reference information acquisition unit, 115...subjective quantity reception unit, 116...observation information acquisition unit, 117...objective quantity estimation unit, 118...vacation request creation unit, 119...chat relay unit, 12...memory, 121...schedule DB, 122...video DB, 123...vital DB, 124...condition DB, 13...communication unit, 14...operation unit, 15...display unit, 16...camera, 17...observation unit, 2...server device, 21...processor, 22...memory , 221...schedule DB, 222...video DB, 223...vital DB, 224...condition DB, 23...communication unit, 3...communication line, 9...estimation system, R0...display area, R1...cancel icon area, R2...explanation area, R3...face capture area, R4...start capture button area, R5...explanation area, R6...illustration area, R7...switching area, R8...subjective value input area, R9...total subjective value area, R10...facial expression icon area, R11...message area, R12...vacation request creation button area, R13...chat relay button area.

Claims

1. The pulse of the user is measured based on a video of the user's body, and an input of a subjective amount of pain felt by the user is received from the user. The objective amount of pain of the user is estimated using the measured pulse, a reference pulse which is the pulse measured in the past, and the subjective amount received from the user. Estimation device.

2. Measure the pulse of the user before or after the user is presented with information for making the user aware of the area where the pain is occurring. The estimation device according to claim 1 .

3. A response of the user to the presentation of the information is received, and the objective quantity is estimated in response to the response. The estimation device according to claim 2 .

4. A type of pain corresponding to at least the state of the autonomic nerves of the user is estimated together with the objective quantity. The estimation device according to claim 3 .

5. The pulse rate and the reference pulse rate are compared for each elapsed time from the wake-up time to estimate the objective quantity. The estimation device according to claim 1 .

6. The information is presented according to a predetermined schedule. The estimation device according to claim 2 .

7. Obtaining observation information observed in the environment surrounding the user, and estimating the objective quantity according to a combination of the observation information, the pulse rate, and the reference pulse rate. The estimation device according to claim 1 .

8. An expression uttered by the user is accepted as an input of the subjective amount. The estimation device according to claim 1 .

9. The expression is extracted from the characters, voice, or action input by the user, or from the content posted by the user. The estimation device according to claim 8.

10. The pulse is analyzed, and content corresponding to the pulse analysis result and the input of the subjective amount is presented to the user. The estimation device according to claim 1 .

11. Based on the statistics of the pulse and the reference pulse, a warning is given regarding a predetermined event that is predicted to occur in the user's body in the future. The estimation device according to claim 1 .

12. determining a state of mind of the user based on the expression and presenting the determined state of mind to the user; The estimation device according to claim 8.

13. The objective quantity is estimated by a function obtained by multiplying the subjective quantity, the sympathetic nerve index value calculated from the pulse rate, and the parasympathetic nerve index value calculated from the pulse rate by a coefficient and adding them together. The estimation device according to claim 1 .

14. The pulse rate of the user is measured based on a video of the user's body, and an input of a subjective amount of pain felt by the user is received from the user. The objective amount of pain felt by the user is estimated using the measured pulse rate and the subjective amount received from the user. Estimation device.

15. An acquisition means for acquiring a video of a user's body; A measuring means for measuring the pulse rate of the user based on the video; A receiving means for receiving an input of a subjective amount of pain felt by the user; an estimation means for estimating an objective amount of pain of the user using the measured pulse, a reference pulse which is the pulse previously measured by the user, and the subjective amount received from the user; An estimation system having the following:

16. On the computer, acquiring a video of a user's body; measuring the pulse of the user based on the video; receiving an input of a subjective amount of pain felt by the user from the user; estimating an objective amount of pain of the user using the measured pulse, a reference pulse which is the pulse previously measured by the user, and the subjective amount received from the user; A program for executing the above.

Images