Information processing program, information processing method, and information processing device

Abstract

This will enable caregivers to promptly present images of the person being cared for, taken when their health deteriorated, to a doctor, along with the health information at the time the image was taken. [Solution] The information processing program is an information processing program that causes the information processing device to perform information processing on the person being assisted. The information processing program is a program that causes the information processing device to perform the following steps: a health condition information storage step in which health condition information on the person being assisted's daily health, acquired by the health condition information acquisition unit of the information processing device, is stored in a storage unit provided inside or outside the information processing device; and a specific image storage step in which images selected by the input unit of the information processing device from among the images of the person being assisted, acquired by the image acquisition unit of the information processing device, are stored in a storage unit as specific images linked to health condition information.

Description

Technical Field

[0001] The present invention relates to an information processing program, an information processing method, and an information processing apparatus.

Background Art

[0002] Conventionally, a system for managing interview information and the like for each animal patient has been proposed in a terminal device installed in a veterinary hospital or a management server connected to the terminal device via a network (see, for example, Patent Document 1 or 2).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] Animals such as pets are not animals that speak like humans, and cannot communicate their intentions through language with their owners. Therefore, when an owner feels that there is an abnormality in the pet's physical condition, the owner subjectively judges the pet's condition and takes the pet to a veterinary hospital if necessary. At the veterinary hospital, during the examination (interview), the owner explains the pet's condition to the veterinarian. At this time, in addition to the physical condition information indicating the condition when the pet's physical condition deteriorated (for example, having no appetite on a certain date), if there is an image of the pet when the physical condition deteriorated, the owner can present the above physical condition information and the image to the veterinarian during the interview. Then, the veterinarian can comprehensively judge the pet's condition by referring to the presented physical condition information and the image during the interview.

[0005] Here, the above image is stored in a designated folder in the memory of a mobile device (e.g., a smartphone) owned by the pet owner. Therefore, when the pet owner presents the above image to the veterinarian, they must search for the image in the designated folder during the consultation. If the time spent searching for the above image during the consultation is long, the overall consultation time will be longer, and the efficiency of the veterinarian's examination will decrease. For this reason, it is desirable for the pet owner to be able to quickly present the above image along with the above health information to the veterinarian on their mobile device. However, no technology has been proposed to date, including in Patent Documents 1 and 2, that enables the simultaneous presentation of the above image and the above health information on the pet owner's mobile device.

[0006] While the above explanation used the example of a pet becoming ill, the same principles apply to situations where an infant with difficulty speaking becomes ill. In other words, it is desirable for parents to be able to promptly present images of their infant's condition when they become ill, along with information about the infant's condition at the time the image was taken, to the doctor when taking the infant to the hospital (e.g., a pediatrician). However, no technology has been proposed to date that would enable such information presentation on a parent's mobile device.

[0007] Furthermore, when the owner or guardian is referred to as the caregiver assisting the pet or infant, the pet or infant can be referred to as the person being assisted by the caregiver. In this case, it is desirable for the caregiver to be able to promptly provide a doctor with images of the person being assisted when their health deteriorates, along with information about the person's health condition at the time the images were taken.

[0008] The present invention was made to solve the above-mentioned problems, and its purpose is to provide an information processing program, an information processing method, and an information processing device that enable a caregiver to promptly present to a doctor images of a person being assisted when their physical condition deteriorates, along with information about the person's physical condition at the time the images were acquired. [Means for solving the problem]

[0009] An information processing program relating to one aspect of the present invention is an information processing program for causing an information processing device to perform information processing on a person being assisted, and is a program for causing an information processing device to perform the following steps: a health condition information storage step for storing health condition information relating to the daily health condition of the person being assisted, acquired by the health condition information acquisition unit of the information processing device, in a storage unit provided inside or outside the information processing device; and a specific image storage step for storing an image selected by the input unit of the information processing device from among the images of the person being assisted, acquired by the image acquisition unit of the information processing device, in the storage unit as a specific image linked to the health condition information.

[0010] An information processing method relating to another aspect of the present invention is an information processing method for processing information relating to a person receiving assistance, comprising: a health condition information storage step of storing health condition information relating to the daily health condition of the person receiving assistance, acquired by a health condition information acquisition unit of the information processing device, in a storage unit provided inside or outside the information processing device; and a specific image storage step of storing in the storage unit a specific image associated with the health condition information, selected by an input unit of the information processing device from among the images of the person receiving assistance acquired by an image acquisition unit of the information processing device.

[0011] An information processing device according to yet another aspect of the present invention is an information processing device that processes information about a person being assisted, comprising: a physical condition information acquisition unit that acquires information about the person being assisted's daily physical condition as physical condition information; an image acquisition unit that acquires images of the person being assisted; an input unit that receives instructions from an external source; and a storage control unit, wherein the storage control unit stores the physical condition information acquired by the physical condition information acquisition unit in a storage unit provided inside or outside the information processing device, and stores in the storage unit an image selected by the input unit from among the images of the person being assisted acquired by the image acquisition unit as a specific image linked to the physical condition information. [Effects of the Invention]

[0012] According to the present invention, when the condition of the assisted person deteriorates, an image can be promptly presented to a doctor together with the condition information at the time when the image was acquired.

Brief Description of the Drawings

[0013] [Figure 1] It is an explanatory diagram showing a schematic configuration of a diagnostic system in an embodiment of the present invention. [Figure 2] It is a block diagram showing a schematic configuration of a personal terminal device. [Figure 3] It is an explanatory diagram schematically showing a home screen of the display unit when an application for executing an information processing program is launched in the personal terminal device. [Figure 4A] It is an explanatory diagram showing an example of a daily record display screen of the display unit. [Figure 4B] It is an explanatory diagram showing an example of a graph display screen of condition information of the display unit. [Figure 4C] It is an explanatory diagram showing an example of a record details screen of the display unit. [Figure 5A] It is an explanatory diagram showing an example of an inspection result display screen of the display unit. [Figure 5B] It is an explanatory diagram showing an example of a graph display screen of inspection results of the display unit. [Figure 5C] It is an explanatory diagram showing an example of an inspection result details screen of the display unit. [Figure 6A] It is an explanatory diagram showing an example of a setting screen of the display unit. [Figure 6B] It is an explanatory diagram showing an example of a customization screen of record items of the display unit. [Figure 7] It is an explanatory diagram showing an example of a data input screen of the display unit. [Figure 8] It is a flowchart showing the flow of processing during data input. [Figure 9] It is an explanatory diagram schematically showing a list of photographed images. [Figure 10] It is an explanatory diagram showing a data input screen displaying a selected specific image. [Figure 11] It is a flowchart showing the processing flow by the information display method included in the information processing method. [Figure 12] It is an explanatory diagram showing a record details screen in which physical condition information and a specific image are displayed together. [Figure 13] It is an explanatory diagram showing other configurations of the above data input screen. [Figure 14] It is an explanatory diagram showing an example of a shooting screen of the above display unit. [Figure 15] It is an explanatory diagram showing other configurations of the above setting screen. [Figure 16] It is an explanatory diagram showing a form in which data is transmitted from the above personal terminal device to the doctor's terminal device. [Figure 17] It is an explanatory diagram showing another display example of the above record details screen.

Embodiments for Carrying Out the Invention

[0014] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In this specification, an assistant refers to a person who assists a person being assisted. A person being assisted refers to a person or animal assisted by an assistant. Therefore, an assistant is different from a person being assisted. That is, an assistant is not the same person as a person being assisted.

[0015] Persons being assisted include, for example, animals such as pets, infants who have difficulty speaking, etc. On the other hand, assistants include owners of animals such as pets, guardians of infants, etc. In this embodiment, a pet (animal) is cited as an example of a person being assisted, and the owner of the pet is cited as an example of an assistant. And, consider the case where a pet becomes a patient in a veterinary hospital and receives diagnosis or treatment by a veterinarian (hereinafter simply referred to as a "doctor").

[0016] The information processing device of this embodiment is a device that processes information about pets as recipients of assistance. Specifically, the information processing device can be configured as a mobile terminal (smartphone, tablet) used by the pet owner. Alternatively, the information processing device may be configured as a notebook-type personal computer used by the pet owner. In other words, the information processing device is a personal terminal device and is distinct from a medical terminal device used by a physician.

[0017] Before describing the information processing device of this embodiment, we will first describe the diagnostic system installed in the animal hospital.

[0018] [1. Configuration of the diagnostic system] Figure 1 is an explanatory diagram showing the schematic configuration of a diagnostic system 1 installed in a veterinary hospital. The diagnostic system 1 is configured by connecting a physician's terminal device 2, a blood cell counter 3, a biochemistry device 4, and a printing device 5 via a communication line NW. The communication line NW may consist of a local area network (LAN) installed within the hospital, or it may consist of an internet line that can communicate both inside and outside the hospital. Furthermore, the communication line NW may be wired or wireless.

[0019] The physician's terminal device 2 is a terminal device operated by a physician who diagnoses or treats animals in an animal hospital. The physician's terminal device 2 is composed of, for example, a personal computer. The physician inputs information such as the results of the patient's interview, diagnosis, and treatment into the electronic medical record stored in the memory of the physician's terminal device 2.

[0020] The blood cell counter 3 is a device that measures predetermined items, such as the count of blood cells contained in the patient's blood. The physician collects blood from the patient as needed, loads the container holding the collected blood into the blood cell counter 3, and has the blood cell counter 3 perform the measurement of the predetermined items.

[0021] Examples of parameters that can be measured by the blood cell counter 3 include WBC (white blood cell count), RBC (red blood cell count), MCV (mean corpuscular volume), Hgb (hemoglobin concentration), MCH (mean corpuscular hemoglobin amount), MCHC (mean corpuscular hemoglobin concentration), RDW (red blood cell volume distribution width), Hct (hematocrit), PLT (platelet count), PCT (platelet criterion), MPV (mean platelet volume), PDW (platelet distribution width), LYM% (lymphocyte percentage), LYM# (lymphocyte count), MON% (mononuclear cell percentage), MON# (mononuclear cell count), GRA% (granulocyte percentage), GRA# (granulocyte count), EOS% (eosinophil percentage), EOS# (eosinophil count), and others.

[0022] The biochemical device 4 is a device that measures specific components contained in blood. The physician collects blood from the patient as needed, loads the container holding the collected blood into the biochemical device 4, and has the biochemical device 4 perform the measurement of the specified items. Examples of items that can be measured by the biochemical device 4 include GLU (blood glucose level), BUN (blood urea nitrogen), CRE (creatinine), TBIL (total bilirubin), TCHO (total cholesterol), TG (triglycerides), and TP (total protein).

[0023] The physician diagnoses the patient's condition based on the animal's state at the time of the examination, subjective information provided by the owner (such as whether the animal is energetic, has a good appetite, drinks water, and has bowel movements), and the measurement results from the blood cell counter 3 and biochemistry instrument 4, and provides treatment such as injections and prescribes medications as needed.

[0024] The printing device 5 is a printer that prints various types of information onto paper P based on print instructions from the physician's terminal device 2. The information printed on paper P includes, for example, the physician's diagnosis results, the measurement results (measurement data) from the blood cell counter 3, and the measurement results (measurement data) from the biochemistry device 4.

[0025] In this embodiment, the printing device 5 outputs the measurement data acquired by the blood cell counter 3 and the biochemistry device 4 as a two-dimensional code such as a QR code (registered trademark) onto a sheet of paper P. The size of the sheet of paper P is arbitrary, but for example, a sheet of paper P with a horizontal length of 210 mm and a vertical length of 297 mm can be used. By using a sheet of paper P of this size, even if the amount of measurement data from the blood cell counter 3 and the biochemistry device 4 is large, a QR code can be generated by arranging black and white dots finely and printed on the sheet of paper P.

[0026] When the two-dimensional code on the paper P output from the printing device 5 is read by the owner's personal terminal device 10 (for example, the imaging unit 12 described later (see Figure 2)), the measurement data contained in the two-dimensional code is stored in the storage unit 14 (see Figure 2) of the personal terminal device 10. The personal terminal device 10 has a predetermined application installed that executes the information processing program of this embodiment. By launching the above application, the owner can view the measurement data on the personal terminal device 10.

[0027] In addition, other testing devices besides the blood cell counter 3 and biochemistry device 4 may be connected to the communication line NW in a communication-enabled manner. Examples of such testing devices include urine testing devices.

[0028] Furthermore, if the blood cell counter 3 has a built-in small printer (receipt printer), the two-dimensional code representing the measurement data obtained by the blood cell counter 3 may be printed on paper using the receipt printer. In this case, the pet owner can read and view the two-dimensional code on the paper printed from the receipt printer using their personal terminal device 10.

[0029] [2. Configuration of Personal Terminal Devices] Figure 2 is a block diagram showing the schematic configuration of the personal terminal device 10. The personal terminal device 10 comprises a display unit 11, an imaging unit 12, an input unit 13, a storage unit 14, a communication unit 15, and a control unit 16.

[0030] The display unit 11 is a display device that displays various information, and is composed of, for example, a liquid crystal display device or an organic EL (electroluminescent) display device. Details of the display content (display screen) in the display unit 11 will be described later.

[0031] The imaging unit 12 consists of a camera that photographs the patient and acquires images. The images may be video or still images. As described above, the imaging unit 12 can also acquire measurement data by reading a two-dimensional code on a sheet of paper P output from a printing device 5 (see Figure 1), etc.

[0032] The input unit 13 is a device that accepts input or selection from the owner, who acts as an assistant. In other words, the input unit 13 accepts external instruction input. The input unit 13 is, for example, a touch panel and is placed on top of the display screen of the display unit 11. By operating the input unit 13, the owner can input information about the daily health condition of the patient animal as health information. Details of the health information will be described later. The input unit 13 may also consist of physical buttons and be placed alongside the display unit 11.

[0033] The storage unit 14 is a memory that stores various types of information. The storage unit 14 is composed of, for example, RAM (Random Access Memory), ROM (Read Only Memory), non-volatile memory, etc. The storage unit 14 includes a program storage unit 14a, an input information storage unit 14b, and an image information storage unit 14c. The program storage unit 14a stores, for example, the operation programs for each part of the personal terminal device 10, and the information processing programs of this embodiment. The input information storage unit 14b stores information input by the input unit 13 (for example, health information), and the measurement data described above. The image information storage unit 14c stores image data acquired by the imaging unit 12, etc.

[0034] The image data stored in the image information storage unit 14c includes image data of a specific image, which will be described later. The specific image is an image associated with the health condition information stored in the input information storage unit 14b. The method for setting (selecting) the specific image will be described later. As a method for linking the health condition information stored in the input information storage unit 14b with the specific image stored in the image information storage unit 14c, for example, the same identification code may be assigned to both the health condition information and the specific image. Alternatively, the health condition information and the specific image may be linked by date. For example, if the date on which the health condition information was entered and the date on which the specific image was selected (set) are the same, the health condition information and the specific image may be linked. The linked health condition information and the specific image may not be stored in separate storage units, but in the same folder within the same storage unit.

[0035] The communication unit 15 is a communication interface capable of communicating with the outside world via wired or wireless connections. For example, the communication unit 15 includes a transmitting and receiving circuit (modulation circuit, demodulation circuit) and an antenna. For example, if patient health information, image data, measurement data, etc., are stored in an external server device 50, the personal terminal device 10 can obtain the health information, etc., from the server device 50 via the communication unit 15. The server device 50 may be a physically existing terminal device (e.g., a personal computer) or a server on the cloud.

[0036] Therefore, at least one of the input unit 13 and the communication unit 15 constitutes a health condition information acquisition unit 21 that acquires information about the patient's (person being assisted's) daily physical condition as health condition information. Also, at least one of the imaging unit 12 and the communication unit 15 constitutes an image acquisition unit 22 that acquires images of the person being assisted. The personal terminal device 10, as an information processing device, includes the health condition information acquisition unit 21 and the image acquisition unit 22.

[0037] The physician's terminal device 2 described above may transmit the patient's measurement data to the personal terminal device 10 via email or the like. In this case, the personal terminal device 10 can receive the measurement data via the communication unit 15. Therefore, it can also be said that the communication unit 15 and the imaging unit 12 constitute an examination information acquisition unit 30 that acquires measurement data (examination information) indicating the examination results of the pet, and the personal terminal device 10 is equipped with the examination information acquisition unit 30.

[0038] The control unit 16 controls the operation of each part of the personal terminal device 10 based on an operation program stored in, for example, the memory unit 14. The control unit 16 is composed of, for example, at least one of a central processing unit called a CPU (Central Processing Unit) and a high-speed processing unit called a GPU (Graphics Processing Unit).

[0039] In particular, the control unit 16 comprises a display control unit 161, a recommended action determination unit 162, and a memory control unit 163. The display control unit 161 controls the display of the display unit 11 based on the input or selection received by the input unit 13. The recommended action determination unit 162 determines the recommended action to present to the owner, the details of which will be described later. The memory control unit 163 controls the storage of various information in the memory unit 14. The details of the control of the memory control unit 163 will be described later.

[0040] [3. Regarding the display screen of the display unit] Figure 3 is a schematic diagram illustrating the display screen (home screen) of the display unit 11 when an application (information processing app) that executes the information processing program of this embodiment is launched on the personal terminal device 10. It is assumed that a touch panel input unit 13 (see Figure 2) is located on the display screen of the display unit 11. Input or selection is performed by the input unit 13 when the owner touches a predetermined area on the display screen with their finger. The display on the display unit 11 in the following description is controlled by the display control unit 161 based on the input or selection by the input unit 13 as described above.

[0041] (3-1. Home screen) On the home screen, the display unit 11 shows pet information P1 and the pet's most recent (most recent recorded) health information P2. Pet information P1 is information specific to the pet whose health is being managed. Specifically, pet information P1 includes information such as the pet's name, age, and sex. Pet information P1 may include an image of the pet's face, but it is not required to include such an image. Pet information P1 can be configured in the settings screen described later.

[0042] Health Information P2 is information about the pet's daily health and includes measured information P21 and activity information P22. Measured information P21 is information that represents the pet's health and can be measured using instruments as needed. Specifically, measured information P21 includes the pet's weight, respiratory rate, body temperature, heart rate, etc. Weight and body temperature are measured using a scale and thermometer, respectively. Respiratory rate can be counted by the owner observing the pet's breathing. Heart rate can be counted, for example, by the owner placing their hand on the pet's chest.

[0043] Activity Information P22 is information that assesses the pet's physical condition based on the owner's subjective perception. For example, Activity Information P22 includes information judged by the owner's five senses. The five senses mentioned above refer to sight, hearing, smell, taste, and touch. In this case, since the owner can subjectively judge the pet's physical condition using their five senses, it becomes easier to obtain Activity Information P22.

[0044] Activity Information P22 specifically includes at least one of the following: the pet's level of energy, water intake, appetite, digestive function, excretory condition, visible mucous membrane condition, and respiratory condition. Any of the above information included in Activity Information P22 can be subjectively judged by the pet owner.

[0045] Here, each of the following can be expressed on multiple levels (for example, 5 levels): energy level, water intake, appetite, digestive function, excretion, visible mucous membrane condition, and respiratory condition. For example, for energy level, the most energetic state of the pet is set at level 5 (normal). As the pet's energy level decreases, the energy level decreases by one level at a time, with the least energetic state being level 1.

[0046] Regarding water intake, the pet's normal water intake is set at level 5. As water intake decreases, the level decreases by one step at a time, with the lowest water intake being level 1. Regarding appetite, the pet's normal appetite is set at level 5. As appetite decreases, the level decreases by one step at a time, with the lowest appetite (absence of appetite) being level 1. Regarding digestive function, the pet's normal digestive state is set at level 5 (e.g., no vomit). As digestive function deteriorates, the level decreases by one step at a time, with the worst digestive state being level 1. The degree of deterioration in digestive function can be judged based on, for example, the condition of the vomit (amount, color, viscosity, etc.).

[0047] Regarding the condition of excrement, the normal condition of a pet's excrement is set as level 5. As the condition of the excrement deteriorates, the level decreases by one step at a time, with the worst condition (e.g., diarrhea) being level 1. The condition of excrement may also be measured by the number of times the pet defecates per day. Regarding the condition of visible mucous membranes, the normal color (e.g., reddish) of the pet's visible mucous membranes (e.g., the mucous membrane on the inside of the upper eyelid (palpebral conjunctiva)) is set as level 5. As the color of the visible mucous membranes becomes lighter (e.g., closer to white), the level decreases by one step at a time, with the worst condition (e.g., pale) being level 1. The visible mucous membranes may also refer to oral mucous membranes (e.g., the mucous membrane on the surface of the gums). Regarding the condition of respiration, the normal condition (calm respiration) is set as level 5. As the condition of respiration deteriorates (e.g., rapid respiration), the level decreases by one step at a time, with the worst condition (e.g., very rapid respiration) being level 1.

[0048] In the example in Figure 3, activity information P22 includes the level of energy, appetite, and frequency of bowel movements. The upper row of each item, such as weight, displays the value entered by the owner (actual value or level), while the lower row displays the difference from the value on the previous entry date.

[0049] When the owner touches the add button B1 on the display screen, the display screen of the display unit 11 transitions to the data input screen shown in Figure 7. Details of data input on the data input screen will be described later.

[0050] (3-2. Daily Record Display Screen) When the owner touches "Daily" at the bottom of the screen, the display screen of the display unit 11 switches to the daily record display screen. Figure 4A is an explanatory diagram showing an example of the daily record display screen. In the example of Figure 4A, the dates for June 2024 are displayed in a calendar format from the center to the top of the display screen. On dates when the owner has entered (entered) the pet's health information P2, an entry mark M1 is displayed. The entry mark M1 is displayed below the date, for example as a dot "·", but it may also be a circle surrounding the date or any other mark. In addition, on dates when the owner has taken the pet to the animal hospital, a hospital visit mark M2 is also displayed. For example, if "Hospital Visit" is recorded in the record details screen described later, as shown in Figure 4C, a hospital visit mark M2 will be displayed below the corresponding date in Figure 4A.

[0051] At the bottom of the display screen, the date on which the owner entered the pet's health information P2, and a portion of the health information P2 for that date, are displayed in reverse chronological order. By scrolling the screen upwards, the dates on which health information P2 was entered in the past, and the health information P2 for that date, will appear sequentially.

[0052] In the display screen of Figure 4A, when the owner touches the forward button B2, the display screen of the display unit 11 transitions to a screen displaying the dates of future months in a calendar format, corresponding to the number of times the forward button B2 was touched. On the other hand, when the owner touches the back button B3, the display screen of the display unit 11 transitions to a screen displaying the dates of past months in a calendar format, corresponding to the number of times the back button B3 was touched. Simultaneously, at the bottom of the display screen, the dates on which the owner entered the pet's health information P2 for the past months, and the health information P2 for those dates, are displayed in reverse chronological order.

[0053] In Figure 4A, the dates for a given month are displayed in a calendar format. At this time, the word "Graph" is displayed on the screen switching button B4. When the owner touches the screen switching button B4, the display screen of the display unit 11 switches to the graph display screen shown in Figure 4B. Then, the word "List" is displayed on the screen switching button B4. When the owner touches the screen switching button B4 again, the display screen of the display unit 11 switches back to the list display screen shown in Figure 4A. In this way, each time the screen switching button B4 is touched, the display screen of the display unit 11 switches between the list display in Figure 4A and the graph display in Figure 4B.

[0054] Figure 4B displays a graph showing the changes in health information P2 entered by the owner. By default, the graph displays the changes in health information P2 over one week. When the owner touches the month button B6, the graph displays the changes in health information P2 over one month. When the owner touches the week button B5, the graph returns to showing the changes in health information P2 over one week. The items of health information P2 to be displayed (weight, respiratory rate, etc.) can be set as appropriate in the settings screen described later. Alternatively, by scrolling the screen left or right, the graph can display the changes in health information P2 over a specified past week or month.

[0055] When the owner touches a designated dot in the graph in Figure 4B, the display screen of the display unit 11 switches to the record details screen shown in Figure 4C. On the record details screen, the details of the health information P2 for the date corresponding to the dot touched on the display screen in Figure 4B are displayed. In the example in Figure 4C, the details of the health information P2 for June 16, 2024 are shown. Alternatively, the display screen of the display unit 11 may be configured to switch to the record details screen shown in Figure 4C when the owner touches a dot assigned to a designated date on the list display screen in Figure 4A.

[0056] On the record details screen, the owner can modify or add information to the specified items in the health information P2 by touching the edit button B7. When the owner touches the screen return button B8, the display screen of the display unit 11 returns to the screen shown in Figure 4A or Figure 4B.

[0057] (3-3. Test Result Display Screen) When the owner touches "Test Results" at the bottom of the screen, the display screen of the display unit 11 switches to the test results display screen, which displays the test results (measurement data). Figure 5A is an explanatory diagram showing an example of the test results display screen. The test results display screen displays a list of dates (which can be considered the same as the measurement date) on which the measurement data was acquired by the imaging unit 12 or communication unit 15 of the personal terminal device 10. On the test results display screen, the owner can add whether the purpose of the visit was a health checkup and add comments by touching the add button B1. If the purpose of the visit was a health checkup, the owner touches the checkbox for the designated date. This checks the checkbox, making it immediately clear that the visit was for a health checkup. In addition, the owner can enter their impressions (for example, that the reason for the visit was poor appetite) in the comments field.

[0058] When the owner touches the screen switching button B4, the display screen of the display unit 11 switches to the graph display screen of the test results shown in Figure 5B. Then, when the owner touches a predetermined dot in the graph in Figure 5B, the display screen of the display unit 11 switches to the detailed test results screen shown in Figure 5C. On the detailed test results screen, the test results (test information, measurement data D) for the date corresponding to the dot touched on the display screen in Figure 5B are displayed for each measurement item. In the example in Figure 5C, the details of the measurement data D for June 16, 2024 are shown. Alternatively, the display screen of the display unit 11 may be configured to switch to the detailed test results screen shown in Figure 5C when the owner touches a predetermined date on the list display screen of the test results in Figure 5A.

[0059] Measurement data D includes at least one of the first measurement data D1 and the second measurement data D2. Here, the first measurement data D1 is the measurement data acquired by the blood cell counter 3 (see Figure 1). The second measurement data D2 is the measurement data acquired by the biochemistry apparatus 4 (see Figure 1). Measurement data D also includes a determination result (flag) indicating whether the numerical value falls within a predetermined range. For example, if the measured numerical value exceeds the predetermined range, the flag "H" is displayed next to the numerical value. If the measured numerical value falls below the predetermined range, the flag "L" is displayed next to the numerical value.

[0060] In the detailed examination results screen shown in Figure 5C, the owner can edit the screen by touching the edit button B7. For example, the owner can enter a comment in the comment field or check the health check checkbox. The owner can also delete an entered comment by touching the delete button B9. When the owner touches the screen return button B8, the display screen of the display unit 11 returns to the screen shown in Figure 5A or Figure 5B.

[0061] (3-4. Settings screen) When the owner touches "Settings" at the bottom of the screen, the display screen of the display unit 11 switches to a settings screen where the owner can input detailed information about their pet. Figure 6A is an explanatory diagram showing an example of the settings screen. On the settings screen, the owner can input and set the pet's name, type (dog, cat, hamster, small bird, etc.), type details (dog breed, cat breed, etc.), birthday, etc. They can also register a picture of their pet if necessary. For example, they can select and register a specific image from a list of images acquired by the imaging unit 12. When the owner touches the screen return button B8, the display screen of the display unit 11 returns to the home screen, for example, as shown in Figure 3.

[0062] Furthermore, when the owner touches the edit button B7, they can edit the pet's detailed information. For example, when the owner touches the name field in Figure 6A, the cursor will appear in the name field, allowing them to edit the pet's name. Also, when the owner touches "Settings" again, a record item edit button (not shown) will appear on the screen. When the owner touches the record item edit button, the display screen of the display unit 11 switches to the record item customization screen shown in Figure 6B. On the customization screen, the owner can change (add or delete) the record items of health information P2 that are displayed on the home screen shown in Figure 3. For example, by checking the checkbox to the left of a specific record item, the owner can display that record item on the home screen. Conversely, by unchecking the checkbox for a specific record item, the owner can hide that record item on the home screen.

[0063] To add record items to be displayed on the home screen, the owner touches the Add Record Item button B10. This allows additional record items other than the health information P2 to be displayed on the customization screen shown in Figure 6B. Therefore, the owner can display the added record items on the home screen by checking the checkboxes for those items.

[0064] The customization of the record items is completed when the owner touches the registration button B11 displayed on the screen. In other words, the settings for the record items to be displayed on the home screen are completed.

[0065] [4. Regarding the data entry screen] Figure 7 is an explanatory diagram showing the data entry screen that appears when, for example, the add button B1 is touched on the home screen in Figure 3. Figure 8 is a flowchart showing the processing flow during data entry. The data entry process will be explained below.

[0066] On the data entry screen, the owner can enter the latest health information P2 and comments using the input unit 13. For example, on the data entry screen, the owner can enter the date to be registered (the date the health information P2 was obtained), the health information P2 on that date (measured information P21 and activity information P22), and any comments the owner noticed.

[0067] When health information P2 and comments are entered via the input unit 13 (S1; health information input step), the setting step (S2) is then executed. In the setting step, first, the owner touches the image selection button B12 on the data input screen of the display unit 11, and an instruction to transition to the image list display screen is received (S2-1; transition instruction reception step). In response to the above screen transition instruction, the display control unit 161 displays the image list shown in Figure 9 on the display unit 11 (S2-2; image list display step). The image list is a list of images taken by the imaging unit 12 of the personal terminal device 10 and stored in the storage unit 14 (particularly the image information storage unit 14c), and is a selection screen for selecting a specific image G.

[0068] The pet owner selects an image from the image list that was taken on the day the pet became ill (October 21, 2024 in the example in Figure 7), particularly an image that accurately represents the pet's condition (S2-3; selection step). As a result, as shown in Figure 10, the selected image is set as specific image G (S2-4; specific image setting step) and displayed on the data input screen.

[0069] On the data entry screen, when the owner touches the registration button B11, the memory control unit 163 stores the health information P2 and comments entered in S1 in the input information storage unit 14b of the memory unit 14 (S3; health information storage process). Simultaneously with S3, the specific image G set in S2 is also stored in the memory unit 14 (particularly the image information storage unit 14c) as an image associated with the health information P2 stored in S3 (S4; specific image storage process). This completes the registration of the specific image G associated with the health information P2. After the registration of the specific image G, the owner can close the data entry screen and display the home screen by touching the × mark in the upper left corner of the screen.

[0070] Furthermore, the timing of S4 (specific image storage process) described above may be different from that of S3 (health information storage process). For example, S4 may be performed before S3 or after S3. Additionally, S3 may be performed between S1 (health information input process) and S2 (setting process).

[0071] Furthermore, in Figure 7, by touching the image selection button B12 multiple times and selecting multiple images as specific images G, it is possible to associate and register multiple specific images G with the health information P2.

[0072] [5. Regarding the method of displaying information] Next, the information display method included in the information processing method of this embodiment will be described. The information display method of this embodiment is executed by the personal terminal device 10 after the registration of a specific image G linked to the health information P2. For example, when a pet owner takes their pet to an animal hospital and explains the pet's condition to the doctor during the consultation, the personal terminal device 10 is made to execute the information display method of this embodiment. A more detailed explanation follows below.

[0073] Figure 11 is a flowchart illustrating the processing flow according to the information display method of this embodiment. First, the owner launches the information processing application installed on the personal terminal device 10 and displays the home screen shown in Figure 3 on the display unit 11 (S11; startup step).

[0074] Next, on the home screen shown in Figure 3, the owner touches "Daily Life" to instruct the system to transition to the daily life record display screen (S12; screen transition instruction step). As a result, the display screen of the display unit 11 transitions from the home screen shown in Figure 3 to the daily life record display screen shown in Figure 4A or Figure 4B.

[0075] Next, the owner selects a date (for example, the date on which the pet's health condition was assessed) or a dot on the daily record display screen by touching it (S13; date selection step). Then, as shown in Figure 12, the record details screen is displayed on the display unit 11. On the record details screen, the health information P2 for the date selected in S13 is displayed in the health information display area R1 (S14; health information display step). Note that in Figure 12, only a portion of the health information P2 is displayed in the health information display area R1, but the remaining health information P2 can be displayed by scrolling the screen upwards.

[0076] Furthermore, on the record details screen, the specific image G, which is pre-registered and linked to the above-mentioned physical condition information P2, is displayed in the specific image display area R2 along with (simultaneously with) the above-mentioned physical condition information P2 (S15; specific image display step). In the example in Figure 12, the specific image display area R2 is located below the physical condition information display area R1, but it may also be located above the physical condition information display area R1. In other words, the physical condition information display area R1 and the specific image display area R2 only need to be arranged side by side.

[0077] The above describes an example in which health condition information P2 and specific image G are stored in the storage unit 14 of the personal terminal device 10, but the example is not limited to this. For example, the storage control unit 163 may transmit the health condition information P2 and specific image G (image data) to an external server device 50 (see Figure 2) via the communication unit 15 and have the server device 50 store them.

[0078] As described above, in the personal terminal device 10 as an information processing device, the memory control unit 163 stores the physical condition information P2 acquired by the physical condition information acquisition unit 21 (for example, the input unit 13) in a memory unit (for example, a memory unit 14, a server device 50) provided inside or outside the personal terminal device 10, and stores the image selected by the input unit 13 from among the images of the pet acquired by the image acquisition unit 22 in the memory unit 14 as a specific image G linked to the physical condition information. Furthermore, the information processing method of this embodiment includes the physical condition information storage step (S3) and the specific image storage step (S4) described above.

[0079] In this way, by linking health information P2 and specific images G and storing them in, for example, the memory unit 14, pet owners can take the following actions. That is, when a pet needs to be diagnosed or treated by a doctor due to a deterioration in its health, the pet owner can simultaneously display the health information P2 and specific images G stored in the memory unit 14 on the display unit 11 and quickly show them to the doctor on the spot. Therefore, the doctor can quickly grasp the state of the pet when it was unwell, and can diagnose or treat the pet efficiently (quickly). This also leads to doctors being able to diagnose or treat multiple patients efficiently. In addition, when pet owners present the specific image G from the day the pet was unwell to the doctor, they do not have to search for the specific image G from the image list in the image folder on the spot during the examination. In this respect as well, it is possible to expedite diagnosis or treatment by the doctor.

[0080] In this embodiment, the personal terminal device 10 can also register health information P2 and specific images G for multiple pets. In this case, the health of multiple pets can be managed. In recent years, the number of pet owners who keep multiple pets has been increasing. For such pet owners, the personal terminal device 10 of this embodiment, which can manage the health of multiple pets with a single device, is extremely useful.

[0081] The data (health information P2, specific image G) registered on one personal terminal device 10 may be shared among multiple devices. For example, the above data may be shared among terminal devices owned by each of the multiple members of a family. In this case, a family member other than the one who took the specific image G can take the pet to the hospital and present both the health information P2 and the specific image G to the doctor at the same time, improving convenience.

[0082] The color of a pet's fur, lips, and mouth varies from individual to individual, and even if you live with your pet every day, it is difficult to notice changes at a glance compared to humans. By using the personal terminal device 10 (information processing method) of this embodiment, it is possible to create an opportunity to observe your pet more carefully and notice changes in its health. In addition, since past information regarding the pet's health can be referenced on the personal terminal device 10, if something happens to the pet, you can quickly review the pet's health. It also becomes possible to easily check changes over time, such as when the condition actually started to deteriorate. Furthermore, even small changes in the pet's health are standardized by recording them from a third-party perspective. This makes it possible for pet owners to objectively understand their pet's health without being influenced by their own emotions.

[0083] Preferably, the storage unit where the health condition information P2 and the specific image G are stored in association is a storage unit 14 located inside the personal terminal device 10. In this case, the personal terminal device 10 can quickly display the health condition information P2 and the specific image G on the display unit 11 and present them to the doctor without communicating with the outside.

[0084] As described above, the display unit 11 of the personal terminal device 10 (information processing device) has a health condition information display area R1 and a specific image display area R2 (see Figure 12). The health condition information display area R1 is an area for displaying the pet's health condition information P2. The specific image display area R2 is an area for displaying a specific image G. The specific image G is an image of the pet that is associated with the health condition information P2 displayed in the health condition information display area R1. Furthermore, the information processing method of this embodiment includes a health condition information display step (S14) in which the pet's health condition information P2 acquired by the health condition information acquisition unit 21 of the personal terminal device 10 is displayed in the health condition information display area R1 of the display unit 11, and a specific image display step (S15) in which the specific image G, which is an image of the pet acquired by the image acquisition unit 22 of the personal terminal device 10 and associated with the health condition information P2, is displayed in the specific image display area R2 of the display unit 11.

[0085] In this case, during the medical interview, the physical condition information P2 is displayed in the physical condition information display area R1 of the display unit 11, and simultaneously, a specific image G associated with the physical condition information P2 is displayed in the specific image display area R2, allowing the doctor to see it immediately. Therefore, it is possible to greatly contribute to speeding up diagnosis or treatment by the doctor.

[0086] Furthermore, the display control unit 161 sets the image selected by the input unit 13 from among the captured images acquired by the image acquisition unit 22 (at least one of the imaging unit 12 and the communication unit 15) and displayed in a list on the display unit 11 as a specific image G associated with the health information P2 (see S2 in Figure 8). Then, it displays the set specific image G in the specific image display area R2 (see S15 in Figure 11 and Figure 12). In this case, the pet owner can operate (input or select) the input unit 13 to select a specific image G associated with the pet's health information P2 and display it in the specific image display area R2 for presentation to the doctor.

[0087] The display unit 11 further displays an image selection button B12 as an instruction area on the data input screen to instruct the user to transition to the screen selection screen (image list) for a specific image G (see Figure 7). When the display control unit 161 receives an instruction to transition to a screen by selecting the image selection button B12 from the input unit 13, it transitions the display screen of the display unit 11 to a selection screen that displays a list of captured images (see Figure 9). In this case, the owner can select the image selection button B12 using the input unit 13, which displays the selection screen shown in Figure 9 on the display unit 11, and then select a specific image G from the list of captured images displayed on the selection screen.

[0088] Incidentally, pet owners interact with and care for their pets on both good and bad days. Therefore, it is possible that owners may have different perceptions of their pets on good and bad days. If the health information P2 presented to the doctor includes activity information P22, the doctor can make a diagnosis of the pet by referring to activity information P22 in addition to objective information measured by instruments such as body temperature (e.g., actual measurement information P21). This makes it possible to make an accurate diagnosis of the pet. In particular, since pets are patients that have difficulty communicating, doctors cannot hear the chief complaint (the main symptoms that the pet is telling the doctor) from the pet. Since the pet's activity information P22 is very effective as information that replaces the pet's chief complaint, it is desirable that health information P2 includes activity information P22.

[0089] The specific image G should preferably include one of the following: (1) a video recording of the pet's walking or vocalizations linked to its level of energy; (2) an image showing the state of the pet's urine or feces linked to its water intake, digestive function, or excretory condition; (3) an image showing the state of the pet's visible mucous membranes (e.g., the mucous membrane on the inside of the upper eyelid); or (4) a video recording of the pet's respiratory condition. Any of the images or videos from (1) to (4) are useful as specific image G linked to the pet's health information P2.

[0090] The personal terminal device 10 of this embodiment includes the inspection information acquisition unit 30 (see Figure 2) described above. The display control unit 161 displays the inspection information (measurement data) acquired by the inspection information acquisition unit 30 on the display unit 11 based on the instruction received by the input unit 13 (for example, touching the date) (inspection information display process, see Figures 5B and 5C). In this case, the pet owner can check the measurement data presented by the doctor on the display screen of the display unit 11.

[0091] [6. Determining Recommended Actions] The recommended action determination unit 162 (see Figure 2) of the control unit 16 executes a recommended action determination process to determine the owner's recommended action based on the physical condition information P2 and a specific image G. For example, if there is physical condition information P2 for a pet that indicates "energy level 1 (not energetic)" on any given date, and the specific image G associated with that physical condition information P2 is an image of a visible mucous membrane (e.g., the conjunctiva of the eyelid), the recommended action determination unit 162 calculates the average value of the brightness value of each pixel in the visible mucous membrane image. If the calculated average value is above a threshold (e.g., if the visible mucous membrane is whitish), the unit determines that the pet is anemic. In this case, the recommended action determination unit 162 can determine that the recommended action is to immediately take the pet to the vet, or to let the pet rest for a while and then take it to the vet if necessary.

[0092] The recommended behavior determined by the recommended behavior determination unit 162 can be presented to the pet owner, for example, through the display unit 11. This allows the pet owner to take appropriate action based on the presented recommended behavior and, if necessary, take their pet to a veterinary hospital.

[0093] The recommended action determination unit 162 may determine the recommended action based on the acquisition date or season of the health information P2 and the specific image G. Here, the acquisition date of health information P2 can be considered as the date the health information P2 was entered (the day the pet's health deteriorated). The acquisition date of the specific image G can be considered as the day the specific image G was taken and acquired.

[0094] The season to which the acquisition date belongs can be determined from the acquisition date of the health information P2 and the specific image G. Therefore, the recommended behavior determination unit 162 can determine a seasonal behavior as a recommended behavior. For example, if dehydration of the pet is suspected based on the health information P2 and the specific image G, it is necessary to have the pet drink more water if it is summer. In this case, the recommended behavior determination unit 162 determines that having the pet drink more water is the recommended behavior and can present the determined recommended behavior to the owner through the display unit 11. On the other hand, if it is winter, it is not necessary to have the pet drink as much water as in summer. In this case, the recommended behavior determination unit 162 determines that having the pet drink an appropriate amount of water is the recommended behavior and can present the determined recommended behavior to the owner through the display unit 11.

[0095] [6. Other configurations of the data entry screen] Figure 13 is an explanatory diagram showing another configuration of the data input screen of the display unit 11. The display unit 11 may also display the capture button B13 on the data input screen. If no images have been taken yet on a day when the pet is unwell, the specific image G can be obtained by transitioning from the data input screen in Figure 13 to the capture screen by the imaging unit 12 and taking a picture of the pet.

[0096] Specifically, on the data input screen in Figure 13, when the owner touches the shutter button B13, the display unit 11 displays the shooting screen shown in Figure 14. By positioning the pet within the frame F displayed on the display unit 11 and touching the shutter button B14, the owner can take a picture of the pet and acquire a specific image G. The specific image G acquired by the imaging unit 12 is stored in the storage unit 14 (for example, the image information storage unit 14c).

[0097] Here, when photographing a pet, the display control unit 161 may display guidance on the display unit 11 indicating how to acquire a specific image G, as shown in Figure 14 (guidance display step). In the example in Figure 14, as an example of photographing the visible mucous membrane of a pet, the message M3 "Lift the pet's upper eyelid upward and take the picture so that the mucous membrane on the underside of the upper eyelid is centered in the frame." is displayed as guidance. In this case, the owner can photograph the visible mucous membrane of the pet according to the guidance and acquire an appropriate specific image G.

[0098] In the guidance display process, it is desirable for the display control unit 161 to display the guidance on the display unit 11, particularly according to the type of image to be acquired (the image to be acquired) or the health condition information. For example, the display control unit 161 displays a type selection button B15 on the display screen of the display unit 11 shown in Figure 14, which allows the user to select the type of image to be acquired, such as face, whole body, or visible mucous membrane. The type of image to be acquired is selected (specified) when the owner touches the predetermined type selection button B15. For example, if visible mucous membrane is selected as the type of image to be acquired, the message M3 described above is displayed as guidance. If face is selected as the type of image to be acquired, for example, the message "Please take the picture so that the center of your pet's face is in the center of the frame." is displayed as guidance. Furthermore, for example, if an item included in the health condition information shown in Figure 7 (for example, the degree of well-being) is level 1, the message "Please take the picture so that the center of your pet's face is in the center of the frame." may be displayed on the display unit 11 as guidance.

[0099] [7. Other configurations of the data entry screen] Figure 15 is an explanatory diagram showing other configurations of the setting screen of the display unit 11. The display control unit 161 may perform a selection candidate display step in which it determines the type of pet by analyzing a pre-registered image and displays the determined type as a selection candidate on the display unit 11. Note that the type of pet also includes detailed type information, which is a subdivision of the type. Figure 15 shows an example in which, based on an image registered in the initial settings, the display control unit 161 analyzes the image and determines that the cat's breed is one of the following: Scottish Fold, Munchkin, Minuet, Ragdoll, or Siberian, and these are displayed on the display unit 11 as selection candidates.

[0100] In the settings screen, if the type of pet (in this case, a cat) is not entered, the owner can register the pet's type by selecting from the candidates displayed on the display unit 11. This makes it easy to set (register) the type of pet.

[0101] Furthermore, the image analysis in the display control unit 161 may be performed using artificial intelligence (AI). In other words, the display control unit 161 may be composed of a pre-trained learning processing unit such as deep learning. When pre-registered image data is input, the display control unit 161 may perform feature extraction and identification from the image data and display the identified candidate cat breeds on the display unit 11.

[0102] [8. Regarding data output from personal terminal devices] As shown in Figure 16, the personal terminal device 10 (particularly the control unit 16) may perform a transmission process in which it directly transmits data of at least one of the pet's health condition information P2 and the specific image G from the communication unit 15 (see Figure 2) to the physician's terminal device 2. In other words, the personal terminal device 10 may be configured to include a communication unit 15 as a transmission unit, and the communication unit 15 transmits data of at least one of the health condition information P2 and the specific image G to the physician's terminal device 2. The form of data transmission from the communication unit 15 to the physician's terminal device 2 could be, for example, sending data such as health condition information P2 as an attachment to an email, but is not limited to this form.

[0103] For example, if data such as health information P2 is transmitted to the doctor's terminal device 2 before the doctor's consultation (examination) of the pet, the doctor can predict the pet's health condition based on the transmitted data before the consultation. This allows for a more efficient consultation and reduces the consultation time. Furthermore, it enables the doctor to efficiently examine multiple patients who have registered on the same day.

[0104] Furthermore, data such as health condition information P2 may be transmitted during or after the medical interview. In these cases, the data such as health condition information P2 can be recorded on the physician's terminal device 2 and used for future examinations or diagnoses.

[0105] [9. Regarding linking data to specific accounts] As shown in Figure 2, in a configuration in which the personal terminal device 10 is connected to an external server device 50 in a communicative manner, the communication unit 15, acting as a transmitting unit, may associate the health information P2 and the data of a specific image G with a specific account and transmit it to the external server device 50.

[0106] For example, consider a personal terminal device 10, which acts as an information processing device, being a mobile communication terminal such as a smartphone (old terminal), and changing this mobile communication terminal to a new model (new terminal). If data such as health information P2 stored in the old terminal is linked to a specific account (for example, an ID unique to the owner) and sent to an external server device 50, the data such as health information P2 will be managed by the server device 50 in association with the specific account. Therefore, even when changing from an old terminal to a new terminal, the owner can access the external server device 50 by entering the specific account on the new terminal and download and obtain the data such as health information P2 linked to the specific account. Thus, even when changing terminals, the data managed on the old terminal can be carried over and managed on the new terminal.

[0107] [10. Other display examples of the record details screen] Figure 17 is an explanatory diagram showing other display examples of the record details screen shown in Figure 12. As shown in Figure 17, the display unit 11 may display the first access destination information A1 in the health information display area R1 instead of the health information P2 shown in Figure 12. Also, the display unit 11 may display the second access destination information A2 in the specific image display area R2 instead of the specific image G shown in Figure 12.

[0108] Here, the first access destination information A1 is a link information (e.g., URL; Uniform Resource Locator) that allows access to a predetermined folder in the memory of an external health information management server, when the pet's health information P2 is stored in that folder. The second access destination information A2 is a link information that allows access to a predetermined folder in the memory of an external specific image management server, when the pet's specific image G is stored in that folder. The health information management server and the specific image management server may be the same server (e.g., server device 50) or different servers. These servers may be configured as personal computers or as servers on the cloud.

[0109] For example, when the owner touches and selects the first access destination information A1 displayed on the display unit 11, the personal terminal device 10 can access the health information management server and download health information P2 from the health information management server. The downloaded health information P2 can then be displayed in the health information display area R1. Therefore, even if health information P2 is not stored in the personal terminal device 10, it can download and display health information P2 from an external health information management server.

[0110] Similarly, when the owner touches and selects the second access destination information A2 displayed on the display unit 11, the personal terminal device 10 can access the specific image management server and download the data (image data) of the specific image G from the specific image management server. Then, based on the downloaded image data, the specific image G can be displayed in the specific image display area R2. Therefore, even if the specific image G is not stored in the personal terminal device 10, the data of the specific image G can be downloaded from an external specific image management server and displayed.

[0111] [11. Recipients of assistance and supplementary information about recipients] As mentioned at the beginning, the person whose health condition is managed by the personal terminal device 10 may be an infant or young child, as well as an animal such as a pet. In other words, the person being assisted may include an animal or an infant or young child.

[0112] Animals and infants cannot speak and have relatively difficult communication with humans through language. When the person being assisted is an animal or infant who has difficulty communicating, the person being assisted (e.g., owner or guardian) can present the physician with the person's health information P2 and specific images G, enabling the physician to make an appropriate diagnosis or treatment. Therefore, the personal terminal device 10 as an information processing device in this embodiment is particularly effective when the person being assisted is an animal or infant.

[0113] Furthermore, in addition to pets and other animals or infants with difficulty speaking, those receiving assistance may also include, for example, bedridden elderly people, patients with dementia or intractable diseases, and physically disabled people with difficulty speaking. Similarly, those providing assistance may also include, in addition to pet owners and guardians of infants, caregivers of bedridden elderly people, guardians or caregivers of patients with dementia or intractable diseases, and guardians or caregivers of physically disabled people with difficulty speaking.

[0114] [12. About Information Processing Programs] As described above, the personal terminal device 10, which serves as an information processing device in this embodiment, can be configured as a computer on which an information processing program (application software) is installed. By having the computer (personal terminal device 10, particularly the control unit 16) execute the above program, the various parts of the personal terminal device 10 can be operated to perform the above-described processes. Such a program can be obtained, for example, by downloading it from an external source via a network and stored in the computer's internal storage unit (for example, the program storage unit 14a). In other words, the program in this embodiment is an information processing program that causes the personal terminal device 10 used by the assistant to execute the information processing method of this embodiment. Furthermore, the above program may be stored on a computer-readable, non-transient recording medium, such as a CD-ROM (Compact Disk-Read Only Memory).

[0115] Each storage step described in this embodiment may be configured to store data on an external server or external device via a network.

[0116] [13. Other] The specific images G of the person being assisted, selected by the input unit 13 of the personal terminal device 10 and stored in the storage unit 14, are not limited to images selected by the input unit 13 from the image list shown in Figure 9. For example, as shown in Figures 13 and 14, images taken on the spot by the imaging unit 12 (without being displayed in the image list) based on a shooting instruction from the input unit 13 (touching the shooting button B13 and shutter button B14) are also included in the specific images G selected by the input unit 13 and stored in the storage unit 14.

[0117] Although embodiments of the present invention have been described above, the scope of the present invention is not limited thereto, and it can be expanded or modified without departing from the spirit of the invention. [Industrial applicability]

[0118] The present invention can be used, for example, in information processing equipment used by assistants. [Explanation of symbols]

[0119] 2. Physician's terminal device 10. Personal terminal devices (information processing devices) 11 Display section 12. Imaging Unit (Image Acquisition Unit, Examination Information Acquisition Unit) 13. Input Unit (Health Information Acquisition Unit) 14 Storage section 14a Program storage 14b Health Information Memory Unit 14c Image information storage unit 15. Communications Unit (Health Information Acquisition Unit, Image Acquisition Unit, Examination Information Acquisition Unit, Transmission Unit) 16 Control Unit 21. Department for Acquiring Health Information 22 Image acquisition unit 30. Inspection Information Acquisition Department 50 Server device (storage unit) 161 Display Control Unit 162 Recommended Action Determination Unit 163 Memory Control Unit D. Measurement data (inspection information) G Specific Image M3 Message (Guidance) P2 Health Information P22 Activity information R1 Health Information Display Area R2 Specific image display area

Claims

1. An information processing program that causes an information processing device to perform information processing on a person receiving assistance, A health condition information storage step involves storing health condition information regarding the daily health condition of the person being assisted, acquired by the health condition information acquisition unit of the information processing device, in a storage unit provided inside or outside the information processing device. A specific image storage step involves storing in the storage unit a specific image associated with the physical condition information an image selected by the input unit of the information processing device from among the images of the person being assisted acquired by the image acquisition unit of the information processing device, An information processing program for causing the information processing device to execute the above.

2. The storage unit is provided inside the information processing device, and is the information processing program according to claim 1.

3. A health condition information display step, which displays the health condition information in the health condition information display area of ​​the display unit of the information processing device, The information processing program according to claim 1 or 2, further comprising causing the information processing device to perform a specific image display step of displaying the specific image in a specific image display area of ​​the display unit.

4. When the captured images are displayed in a list on the display unit, the information processing device is instructed to perform a setting step in which it sets the image selected by the input unit of the information processing device as the specific image associated with the health condition information. The information processing program according to claim 3, wherein in the specified image display step, the specified image set in the setting step is displayed in the specified image display area.

5. The information processing program according to claim 4, wherein in the setting step, when the input unit receives an instruction to transition to the selection screen for the specific image, the display screen of the display unit transitions to the selection screen that displays the captured images in a list.

6. The information processing program according to any one of claims 1 to 5, wherein the aforementioned physical condition information includes activity information in which the physical condition of the person being assisted is judged by the senses of the assistor.

7. The information processing program according to claim 6, wherein the activity information includes information judged by the five senses of the person being assisted.

8. The information processing program according to claim 7, wherein the activity information includes at least one of the following: the degree of well-being of the person being assisted, the amount of water consumed, the state of appetite, the state of digestive function, the state of excretions, the state of visible mucous membranes, and the state of respiration.

9. The aforementioned specific image is A video recording of the person being assisted walking or making noises, linked to the aforementioned level of energy. Images showing the state of urine or stool linked to the amount of water consumed, the state of digestive function, or the state of excrement, An image showing the state of the visible mucosa, A video recording of the aforementioned respiratory state, The information processing program according to claim 8, comprising at least one of the following.

10. The information processing program according to claim 4 or 5, which causes the information processing device to perform an inspection information display step of displaying inspection information indicating the inspection results of the person being assisted on the display unit, based on instructions received by the input unit.

11. The information processing program according to any one of claims 1 to 10, further causing the information processing device to perform a recommended action determination step of determining the recommended action of the caregiver based on the physical condition information and the specific image.

12. The information processing program according to claim 11, wherein in the recommended action determination step, the recommended action is determined based on the physical condition information and the date or season in which the specific image was acquired.

13. The information processing program according to claim 4, 5, or 10, further comprising causing the information processing device to perform a guidance display step of displaying guidance on the display unit indicating how to acquire the specific image, depending on the type of image acquired or the physical condition information.

14. The information processing program according to claim 4, 5, 10, or 13, further comprising causing the information processing device to perform a selection candidate display step, which involves determining the type of person being assisted by analyzing pre-registered images and displaying the determined type as a selection candidate on the display unit.

15. The information processing program according to any one of claims 1 to 14, further causing the information processing device to perform a transmission step of transmitting data of at least one of the physical condition information and the specific image from the transmission unit to a medical terminal device.

16. The information processing program according to claim 15, wherein in the transmission step, the data of the physical condition information and the specific image are linked to a specific account and transmitted from the transmission unit to a server device outside the information processing device.

17. The information processing program according to any one of claims 1 to 16, wherein the recipient of assistance includes an animal or an infant.

18. An information processing method for processing information about recipients of assistance, A health condition information storage step involves storing health condition information regarding the daily health condition of the person being assisted, acquired by the health condition information acquisition unit of the information processing device, in a storage unit provided inside or outside the information processing device; An information processing method comprising: a specific image storage step of storing in the storage unit a specific image linked to the physical condition information an image selected by the input unit of the information processing device from among the images of the person being assisted acquired by the image acquisition unit of the information processing device.

19. An information processing device that processes information about a person receiving assistance, A health information acquisition unit acquires information regarding the daily health condition of the person being assisted as health information, An image acquisition unit that acquires images of the person being assisted, An input unit that accepts instructions from an external source, It comprises a memory control unit, The memory control unit stores the physical condition information acquired by the physical condition information acquisition unit in a memory unit provided inside or outside the information processing device, and stores in the memory unit an image selected by the input unit from among the images of the person being assisted acquired by the image acquisition unit as a specific image linked to the physical condition information.

Images