Information processing device, information processing method, and program

Abstract

This information processing device comprises an image acquisition means, a state estimation means, an information retrieval means and an output means. The image acquisition means acquires an image of a subject organism captured by a terminal device. The state estimation means estimates a state of the subject organism from the image by using a machine learning model that has learned a relationship between an image of a subject organism and a state of a subject organism. The information retrieval means retrieves action information for taking action on the state of the subject organism. The outputs means outputs the action information to the terminal device.

Description

[Technical Field]

[0001] The present disclosure relates to a technology for predicting illness or injury and searching for a treatment method. [Background technology]

[0002] When a pet animal (hereinafter referred to as "pet") becomes sick or injured, the pet owner needs to take appropriate measures. For example, Patent Document 1 describes a health examination device that estimates the illness of a pet from a video taken of the pet. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-223063 Summary of the Invention [Problem to be solved by the invention]

[0004] However, even with Patent Document 1, it is difficult for pet owners to provide appropriate treatment for their pets.

[0005] An object of the present disclosure is to provide an information processing device capable of providing information necessary for a user to take appropriate measures for an illness or injury. [Means for solving the problem]

[0006] In order to solve the above problem, in one aspect of the present disclosure, there is provided an information processing device comprising: an image acquisition means for acquiring an image of the target organism taken by a terminal device; Image and condition of the target organism Attribute information and Using a machine learning model that has learned the relationship between acquired From the image above was photographed the state of the target organism and attribute information a state estimation means for estimating the Based on the estimated state and the attribute information, Action information for dealing with the above condition database or the internet an information retrieval means for searching for Searched an output means for outputting the handling information to the terminal device; Equipped with.

[0007] In another aspect of the present invention, a computer-implemented information processing method includes: Acquire an image of the target organism taken with a terminal device, Image and condition of the target organism Attribute information and Using a machine learning model that has learned the relationship between acquired From the image above was photographed the state of the target organism and attribute information Estimate Based on the estimated state and the attribute information, Action information for dealing with the above condition database or the internet Search for Searched The handling information is output to the terminal device.

[0008] In yet another aspect of the invention, a program includes: Acquire an image of the target organism taken with a terminal device, Image and condition of the target organism Attribute information and Using a machine learning model that has learned the relationship between acquired From the image above was photographed the state of the target organism and attribute information Estimate Based on the estimated state and the attribute information, Action information for dealing with the above condition database or the internet Search for Searched The computer is caused to execute a process of outputting the handling information to the terminal device. [Effects of the Invention]

[0009] According to the present disclosure, users can take appropriate measures against illness or injury. [Brief explanation of the drawings]

[0010] [Figure 1]1 shows the overall configuration of a communication system to which an information processing device according to a first embodiment is applied. [Figure 2] FIG. 2 is a block diagram showing the configuration of a server and a user terminal. [Figure 3] FIG. 2 is a block diagram showing the configuration of a pet terminal. [Figure 4] FIG. 2 is a block diagram showing the functional configuration of a server. [Figure 5] FIG. 2 is a block diagram showing the functional configuration of the learning device. [Figure 6] An example of handling information is shown below. [Figure 7] 10 shows an example of how handling information is displayed. [Figure 8] 10 is a flowchart of a display process performed by the information processing device. [Figure 9] FIG. 10 is a block diagram showing a functional configuration of a first modified example of the first embodiment. [Figure 10] FIG. 10 is a block diagram showing the functional configuration of an information processing apparatus according to a second embodiment. [Figure 11] 10 is a flowchart of a process performed by an information processing apparatus according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] First Embodiment [Overall configuration] 1 shows the overall configuration of a communication system to which an information processing device according to the present disclosure is applied. The communication system 1 includes a server 200 and a user terminal 300 used by a pet owner. A pet P is located within a predetermined range of the pet owner, and a pet terminal 20 is attached to the pet P. The server 200 and the owner's user terminal 300 are capable of wireless communication. The user terminal 300 and the pet terminal 20 are also capable of wireless communication. However, providing the pet terminal 20 is not essential.

[0012] As a basic operation, when pet P shows symptoms of illness or is injured, the owner makes a predetermined statement such as "hospital." When user terminal 300 recognizes the predetermined statement from the owner, it activates the camera and takes a video of pet P. Then, user terminal 300 transmits the taken video (hereinafter also referred to as "taken video") to server 200. Server 200 estimates the condition of pet P from the video taken by user terminal 300 using image analysis by AI (Artificial Intelligence) or the like. Then, server 200 searches for treatment information based on the estimated condition of pet P and transmits the search results to user terminal 300. This allows the owner to know how to treat pet P's illness or injury.

[0013] The condition of pet P refers to the state of illness or injury of pet P. For example, illnesses include coughing and convulsions. Injuries include the size of the wound and the degree of bleeding. The server 200 estimates the condition of pet P from the behavior and appearance of pet P contained in the video captured by the user terminal 300. The treatment information is information related to how to treat illness or injury. The treatment information includes methods for treating illness or injury, hospital information, etc. The server 200 searches for treatment information such as appropriate treatment methods and hospital information according to the condition of pet P.

[0014] [server] 2A is a block diagram showing the configuration of the server 200. The server 200 mainly includes a communication unit 211, a processor 212, a memory 213, a recording medium 214, and a database (DB) 215.

[0015] The communication unit 211 transmits and receives data to and from external devices. Specifically, the communication unit 211 transmits and receives information to and from the user terminal 300 of the owner.

[0016] The processor 212 is a computer such as a CPU (Central Processing Unit), and executes a prepared program to control the entire server 200. The processor 212 may be a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), a DSP (Demand-Side Platform), an ASIC (Application Specific Integrated Circuit), or the like.

[0017] The memory 213 is composed of a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The memory 213 is also used as a working memory while the processor 212 is executing various processes. The memory 213 also temporarily stores a series of videos captured by the user terminal 300 under the control of the processor 212. These videos are stored in the memory 213 in association with, for example, the owner's identification information, timestamp information, etc.

[0018] The recording medium 214 is a non-volatile, non-transitory recording medium such as a disk-shaped recording medium or semiconductor memory, and is configured to be detachable from the server 200. The recording medium 214 stores various programs executed by the processor 212.

[0019] Response information for each state of the pet is stored in database (DB) 215. DB 215 may include an external storage device such as a hard disk connected to or built into server 200, or may include a storage medium such as a removable flash memory. Note that instead of providing DB 215 in server 200, DB 215 may be provided in an external server, and response information may be obtained from the server via communication.

[0020] The server 200 may also include an input unit such as a keyboard and a mouse for an administrator to give instructions and input, and a display unit such as a liquid crystal display.

[0021] [User device] 2(B) is a block diagram showing the internal configuration of a user terminal 300 used by a pet owner. The user terminal 300 is a terminal device such as smart glasses or a smartphone. The user terminal 300 includes a communication unit 311, a processor 312, a memory 313, a display unit 314, a camera 315, a microphone 316, and a GPS receiver 317.

[0022] The communication unit 311 transmits and receives data to and from an external device. Specifically, the communication unit 311 transmits and receives information to and from the server 200.

[0023] The processor 312 is a computer such as a CPU, and executes a program prepared in advance to control the entire user terminal 300. The processor 312 may be a GPU, FPGA, DSP, ASIC, or the like. The processor 312 executes the program prepared in advance to transmit video captured by the camera 315 to the server 200.

[0024] The memory 313 is composed of a ROM, a RAM, etc. The memory 313 stores various programs executed by the processor 312. The memory 313 is also used as a working memory while the processor 312 is executing various processes. The video captured by the camera 315 is stored in the memory 313 and then transmitted to the server 200. The display unit 314 is, for example, a liquid crystal display device, and displays the video captured by the camera 315, handling information received by the user terminal 300, etc.

[0025] The camera 315 is a camera that captures the user's field of view. The camera 315 captures the user's field of view, including subjects such as pets, and transmits the captured images to the server 200. This allows the server 200 to acquire video footage of subjects such as pets. The microphone 316 collects the user's voice and surrounding sounds and transmits the collected audio to the server 200. The server 200 can estimate the state of the pet P based on, for example, the sounds of the pet P running around or the cries of the pet P. The GPS receiver 317 generates location information of latitude and longitude that indicates the current location of the user terminal 300.

[0026] [Pet terminal] 3 is a block diagram showing the configuration of the pet terminal 20 attached to the pet P. The pet terminal 20 is attached to the pet P in place of the collar of the pet P, for example, or is attached to the collar worn by the pet. The pet terminal 20 includes a communication unit 21, a processor 22, a memory 23, a pet camera 24, an acceleration sensor 25, an air pressure sensor 26, a biosensor 27, and a microphone 28.

[0027] The communication unit 21 communicates with an external device. Specifically, the communication unit 21 wirelessly communicates with the user terminal 300 using, for example, Wi-Fi (registered trademark) or Bluetooth (registered trademark).

[0028] The processor 22 is a computer such as a CPU, and executes a program prepared in advance to control the entire pet terminal 20. The processor 22 executes the program prepared in advance to periodically transmit information acquired by each sensor to the user terminal 300.

[0029] The memory 23 is composed of a ROM, a RAM, etc. The memory 23 stores various programs executed by the processor 22. The memory 23 is also used as a working memory while the processor 22 is executing various processes. Furthermore, the memory 23 temporarily stores information detected by each sensor.

[0030] Pet camera 24 is a camera for capturing images from the pet's point of view. Pet camera 24 may be configured to detect the orientation of pet P's neck to determine the capture direction, or may be attached near pet P's head, or may be a camera that captures a wide-angle image in front of pet P. Pet camera 24 captures an area including pet P's line of sight and transmits the captured image to user terminal 300. This allows user terminal 300 to acquire an image from the pet's point of view.

[0031] The acceleration sensor 25 is a three-axis acceleration sensor that measures the movement of the pet P in three axes and transmits the results to the user terminal 300. Based on the output of the acceleration sensor 25, the user terminal 300 can estimate the amount of activity of the pet P, etc. Furthermore, the atmospheric pressure sensor 26 measures the atmospheric pressure at the location of the pet P and transmits the results to the user terminal 300. Based on the output of the atmospheric pressure sensor 26, the user terminal 300 can detect the vertical movement of the pet P, such as jumping. Although not shown in FIG. 3, a gyro sensor may also be used. Alternatively, a six-axis sensor that combines a three-axis acceleration sensor and a three-axis gyro sensor (a three-axis angular velocity sensor) may also be used. Note that the sensor is not limited to the above, as long as it is a sensor that can measure the amount of activity of an animal.

[0032] The biological sensor 27 is a sensor that measures biological information of the pet P, such as the body temperature, heart rate, and respiratory rate of the pet P, and transmits the information to the user terminal 300. The microphone 28 collects sounds around the pet P and transmits the sounds to the user terminal 300.

[0033] [Function Configuration] 4 is a block diagram showing the functional configuration of the server 200. Functionally, the server 200 includes an image acquisition unit 411, a state estimation unit 412, an information search unit 413, and an information transmission unit 414.

[0034] The server 200 receives a captured video from the user terminal 300. The captured video is input to the image acquisition unit 411. The image acquisition unit 411 outputs the captured video to the state estimation unit 412.

[0035] The state estimation unit 412 performs image analysis based on the captured video acquired from the image acquisition unit 411, and estimates the state of the pet P. The state estimation unit 412 recognizes the behavior and appearance of the pet P included in the captured video using a previously prepared image recognition model or the like, and estimates the state of the pet P. This image recognition model is a machine learning model that has been trained in advance to estimate the state of an animal, and will hereinafter also be referred to as a "state estimation model." The state estimation unit 412 estimates the state of the pet P, and outputs the estimated state of the pet P to the information search unit 413.

[0036] The information search unit 413 searches for handling information from the DB 215 based on the condition of the pet P acquired from the condition estimation unit 412. The DB 215 includes a treatment DB 215a and a hospital DB 215b. The treatment DB 215a stores a treatment method for each condition of the pet. The information search unit 413 searches for a treatment method according to the condition of the pet P from the treatment DB 215a. Furthermore, the hospital DB 215b stores hospital information for each condition of the pet. The information search unit 413 searches for hospital information according to the condition of the pet P from the treatment DB 215b. Note that the information search unit 413 searches for handling information from the database 215, but instead, the information search unit 413 may search for handling information from the Internet. The information search unit 413 outputs the condition of the pet P acquired from the condition estimation unit 412 and the handling information to the information transmission unit 414.

[0037] The information transmitting unit 414 outputs the response information acquired from the information searching unit 413 to the user terminal 300. This eliminates the need for the owner of the pet P to investigate the illness or injury of the pet P, and allows the owner to concentrate on treating the pet P. The information transmitting unit 414 may also transmit the condition of the pet P to the hospital in advance. This allows hospital personnel to know in advance the symptoms of the pet P who is expected to visit the hospital soon.

[0038] In addition to the state of pet P, the state estimation unit 412 may estimate attribute information of pet P, which will be described later, and output the information search unit 413. The attribute information includes the type of animal; for example, the state estimation unit 412 estimates the type of animal of pet P, such as whether pet P is a dog or a cat. The information search unit 413 searches for treatment information from the database 215 or the Internet based on the state of pet P and the attribute information of pet P acquired from the state estimation unit 412. This enables the information search unit 413 to search for treatment methods for different types of animals, such as treatment methods for dogs and treatment methods for cats, and information on hospitals for different types of animals, such as specialized hospitals for dogs and specialized hospitals for cats, allowing the owner of pet P to find treatment information that is more suitable for pet P.

[0039] [State estimation model training] Next, an example of learning the state estimation model used by the state estimation unit 412 will be described. The state estimation model is generated by so-called supervised learning. Fig. 5 is a block diagram showing a learning method of the state estimation model, and includes learning data 511 and a learning device 512.

[0040] The training data 511 is pre-labeled still image data or video data (hereinafter also referred to as "training data"). The training data is created by extracting areas in which animals are captured from still image data or video data of animals and assigning labels related to the animal's behavior, appearance, etc. to the extracted areas. The animal's behavior and appearance include symptoms that appear when the animal is sick or injured (hereinafter also referred to as "animal condition"). The learning device 512 generates a state estimation model that learns the relationship between the animal's image and its condition based on the training data 511. The state estimation unit 412 uses the generated state estimation model to estimate the condition of the pet P included in the input video. For example, the state estimation unit 412 outputs an estimation result such as the pet P is coughing or bleeding.

[0041] Furthermore, by using still image data or video data to which labels related to the type of animal, in addition to labels related to the behavior and appearance of the animal, as training data for machine learning, the learning device 512 can generate a state estimation model that has learned the relationship between the image of the animal, the state of the animal, and the type of animal. As a result, the state estimation unit 412 can estimate the type of pet P and the state of the pet P from the input captured video using the generated state estimation model. For example, the state estimation unit 412 can output an estimation result such as "the dog is coughing," "the dog is bleeding," or "the cat is coughing."

[0042] [Example of action information] Next, a description will be given of the countermeasure information searched for by the information search unit 413. Fig. 6 shows an example of treatment methods and hospital information as the countermeasure information.

[0043] FIG. 6(A) shows an example of a treatment method, and includes a treatment method 611 and an explanatory video 612. The treatment method 611 is text information or image information describing a method for treating an illness or injury. Examples of treatment methods for an illness or injury include a method for fixing a broken bone or a method for providing artificial respiration. The information search unit 413 searches for such treatment methods according to the condition of the pet P. The explanatory video 612 is a video about a method for treating an illness or injury, and includes a video demonstrating the treatment. The explanatory video 612 is used when it is difficult to perform treatment using only the information in the treatment method 611, for example, artificial respiration for a dog.

[0044] FIG. 6(B) shows an example of hospital information, which includes basic information 613 and map information 614. The basic information 613 is basic information about the hospital, including the name of the hospital, the animals treated, the medical department, the hospital's address, and the hospital's telephone number. The information search unit 413 searches for hospital information based on the type of pet P and the condition of the pet P. For example, if the pet P is a dog and has an injury, the information search unit 413 searches for hospitals that include dogs as a medical department and surgery as a medical department. The information search unit 413 also searches for hospitals within a predetermined range from the user terminal 300 based on the location information of the user terminal 300 and the hospital's address. The map information 614 is route information from the current location to the hospital. The map information 614 includes information such as a map showing the route from the current location to the hospital and the time required to get from the current location to the hospital.

[0045] [Display example] Next, a display example of the user terminal 300 will be described. Fig. 7 shows a display example of the handling information transmitted by the display processing of the information processing device. In the display example of Fig. 7, the handling information displayed in the user terminal 300 includes the treatment method shown in Fig. 6(A) and the hospital information shown in Fig. 6(B). By using smart glasses as the user terminal 300, the owner of the pet P can treat the pet P with both hands while viewing the handling information. Note that instead of smart glasses, other eyeglass-type wearable terminals such as AR (Augmented Reality) glasses, MR (Mixed Reality) glasses, or VR (Virtual Reality) glasses may be used.

[0046] [Display Processing] Next, the display process for performing the above-described display will be described. Fig. 8 is a flowchart of the display process performed by the information processing device. This process is realized by the processor 212 shown in Fig. 2 executing a program prepared in advance and operating as each element shown in Fig. 4.

[0047] First, when pet P becomes ill or injured, the owner of pet P makes a predetermined statement such as "hospital." The user terminal 300 recognizes the predetermined statement from the owner and starts shooting video. Then, the user terminal 300 transmits the shot video to the server 200. The image acquisition unit 411 of the server 200 acquires the shot video from the user terminal 300 (step S11). The image acquisition unit 411 outputs the shot video to the state estimation unit 412. Next, the state estimation unit 412 estimates the state of pet P based on the shot video acquired from the image acquisition unit 411 using a state estimation model that has been trained in advance (step S12). The state of pet P is the state of illness or injury of pet P. The state estimation unit 412 outputs the estimation result to the information search unit 413.

[0048] Next, the information search unit 413 searches for response information from the database 215 based on the state of the pet P acquired from the state estimation unit 412 (step S13). Response information is stored in the database 215 for each state of the pet. The response information also includes treatment methods for illnesses and injuries, hospital information, and the like. The information search unit 413 may search for response information from the Internet. The information search unit 413 outputs the searched response information to the information transmission unit 414. Next, the information transmission unit 414 transmits the response information acquired from the information search unit 413 to the user terminal 300 (step S14). Then, the processing ends.

[0049] [Variations] Next, a description will be given of modifications of the first embodiment. The following modifications can be applied to the first embodiment in appropriate combinations. (Variation 1) In the first embodiment described above, the server 200 estimates the state of the pet P based on the video captured by the user terminal 300. Alternatively, the server 200 may estimate the state of the pet P using biological information of the pet P in addition to the captured video. FIG. 9 shows the functional configuration of the server 200a of Modification 1. As shown in the figure, in Modification 1, the server 200a is provided with a sensor information acquisition unit 415. The sensor information acquisition unit 415 acquires biological information of the pet P detected by the pet terminal 20 from the user terminal 300. The biological information of the pet P includes body temperature, heart rate, respiratory rate, etc. The sensor information acquisition unit 415 outputs the acquired biological information of the pet P to the state estimation unit 412.

[0050] The state estimation model used by the state estimation unit 412 is a trained model that has been trained in advance to estimate the state of the pet P based on the captured video and biological information. The state estimation unit 412 estimates the behavior and appearance of the pet P based on the captured video. The state estimation unit 412 also estimates whether the body temperature, heart rate, respiratory rate, etc. of the pet P are normal or abnormal based on the biological information of the pet P. For example, if the body temperature of the pet P is equal to or higher than a predetermined threshold TH1 or if the body temperature of the pet P is equal to or lower than a predetermined threshold TH2, the state estimation unit 412 estimates the body temperature of the pet P as "abnormal." On the other hand, if the body temperature of the pet P is lower than the predetermined threshold TH1 and higher than the predetermined threshold TH2, the state estimation unit 412 estimates the body temperature of the pet P as "normal." The state estimation unit 412 then integrates the results of the estimation based on the captured video and the biological information of the pet P and outputs the integrated result to the information search unit 413 as the state of the pet P. The condition estimation unit 412 outputs to the information search unit 413 the condition of pet P, such as, for example, "Pet P is coughing, body temperature is normal, heart rate is normal, and respiratory rate is normal" or "Pet P is coughing, body temperature is abnormal (high), heart rate is abnormal (high), and respiratory rate is abnormal (high)."

[0051] The information search unit 413 searches for handling information from the DB 215 or the Internet based on the state of the pet P acquired from the state estimation unit 412. The DB 215 stores handling information in advance for each state of the pet P. The information search unit 413 outputs the searched handling information to the information transmission unit 414. Then, the information transmission unit 414 transmits the handling information acquired from the information search unit 413 to the user terminal 300.

[0052] As described above, by using the captured video as well as the biological information of the pet P, the server 200 can narrow the search range from among the many pieces of response information contained in the DB 215, and can narrow down the search, thereby making it possible to acquire response information that is more suitable for the pet P. Note that it is not essential to estimate the condition of the pet using the biological information from the pet terminal 20 as described above.

[0053] (Variation 2) In the first embodiment described above, the server 200 estimates the condition of the pet P based on a video of the pet P and transmits handling information to the user terminal 300, but the target living thing (also referred to as the "target living thing") is not limited to a pet. For example, the server 200 may estimate the condition of a human based on a video of a human and transmit handling information to the user terminal 300. This enables the user to obtain appropriate handling information for a person who cannot verbally describe the symptoms of an illness or injury, such as an infant.

[0054] (Variation 3) In the first embodiment described above, the server 200 estimates the condition of the pet P. However, the server 200 may estimate attribute information of the target creature in addition to the condition of the target creature such as the pet P. The attribute information includes the type of creature (e.g., human, dog, cat), age (e.g., infant, toddler, elderly), and gender. The condition estimation unit 412 estimates the condition of the target creature and the attribute information of the target creature from the captured video using a pre-prepared image recognition model or the like. The condition estimation unit 412 outputs the condition of the target creature and the attribute information of the target creature to the information retrieval unit 413. The information retrieval unit 413 then searches for response information from the database 215 or the Internet based on the condition of the target creature and the attribute information of the target creature acquired from the state estimation unit 412. Note that the database 215 stores response information in advance for each condition of the target creature and each attribute information of the target creature. For example, if the condition of the target creature is a burn and the attribute information of the target creature is an infant, the information retrieval unit 413 searches for information such as a method for treating burns on infants and information on pediatric hospitals. This allows the user to understand treatment information that is more suitable for the target organism.

[0055] (Variation 4) In the first embodiment, when the owner of pet P utters a predetermined statement such as "hospital," the server 200 searches for response information corresponding to the pet P's condition at that time and transmits the information to the owner's user terminal 300. In addition to the above, the server 200 may use previously captured videos of pet P to detect behaviors that could lead to pet P's illness or injury (hereinafter also referred to as "risky behaviors") and transmit a warning message to the owner's user terminal 300. The previously captured videos of pet P include videos of pet P's daily life and videos captured when pet P became ill or injured. The server 200 detects risky behaviors of pet P from previously captured videos of pet P using a prepared image recognition model or the like. Risky behaviors of pet P include, for example, pet P engaging in behavior that may lead to accidental ingestion or pet P exhibiting warning behaviors of epilepsy. If the number of times pet P engages in risky behavior exceeds a predetermined number, the server 200 transmits a warning message to the owner's user terminal 300. This allows owners to prevent illness or injury to their pets.

[0056] (Variation 5) In the first embodiment described above, information acquired by the user terminal 300 is basically transmitted as is to the server 200, and the server 200 estimates the state of the pet P based on the received information and transmits handling information to the user terminal 300. Alternatively, the user terminal 300 may estimate the state of the pet P and search for handling information. This reduces the communication load from the user terminal 300 to the server 200. In these cases, the user terminal 300 is an example of an information processing device.

[0057] Furthermore, when the user terminal 300 searches for the response information and the response information includes hospital information, the user terminal 300 may ask the user by voice whether or not to contact a hospital. If the user replies that they will contact a hospital, the user terminal 300 may start a calling application and call the hospital. This allows the user to confirm in advance with the hospital whether they can accept an emergency patient.

[0058] Second Embodiment 10 is a block diagram showing the functional configuration of an information processing device 50 according to the second embodiment. The information processing device 50 according to the second embodiment includes an image acquisition unit 51, a state estimation unit 52, an information search unit 53, and an output unit 54.

[0059] 11 is a flowchart of processing by the information processing device 50. The image acquisition means 51 acquires an image of a target organism photographed by a terminal device (step S51). The state estimation means 52 estimates the state of the target organism from the image using a machine learning model that has learned the relationship between the image of the target organism and the state of the target organism (step S52). The information search means 53 searches for response information for dealing with the state of the target organism (step S53). The output means 54 outputs the response information to the terminal device (step S54).

[0060] According to the information processing device 50 of the second embodiment, the user can take appropriate measures for the illness or injury of the target organism.

[0061] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0062] (Appendix 1) an image acquisition means for acquiring an image of the target organism taken by a terminal device; a state estimation means for estimating the state of the target organism from the image using a machine learning model that has learned the relationship between the image of the target organism and the state of the target organism; an information search means for searching for treatment information for treating the condition of the target organism; an output means for outputting the handling information to the terminal device; An information processing device comprising:

[0063] (Appendix 2) a sensor information acquisition means for acquiring biological information of the target organism; 2. The information processing device according to claim 1, wherein the state estimation means estimates the state of the target organism based on the image and the biological information.

[0064] (Appendix 3) The treatment information includes a method for treating an illness or injury, 3. The information processing device according to claim 1, wherein the output unit transmits handling information including the handling method.

[0065] (Appendix 4) The response information includes hospital information, 4. The information processing device according to claim 1, wherein the output means transmits treatment information including the hospital information.

[0066] (Appendix 5) the state estimation means estimates attribute information of the target organism; 5. The information processing device according to any one of appendices 1 to 4, wherein the information search means searches for treatment information based on the state and attribute information of the target organism.

[0067] (Appendix 6) the target organism is a companion animal, the attribute information is the type of the pet animal; 6. The information processing device according to claim 5, wherein the information search means searches for hospital information related to hospitals that treat the pet based on the type of the pet.

[0068] (Appendix 7) 2. The information processing device according to claim 1, wherein the output means outputs the estimation result of the state estimation means to a terminal of a medical worker.

[0069] (Appendix 8) the state estimation means estimates, from the image, a behavior that may lead to illness or injury of the target organism; 2. The information processing device according to claim 1, wherein the output means outputs an estimation result of the state estimation means to the terminal device.

[0070] (Appendix 9) Acquire an image of the target organism taken with a terminal device, Estimating the state of the target organism from the image using a machine learning model that has learned the relationship between the image of the target organism and the state of the target organism; Searching for treatment information for treating the condition of the target organism; An information processing method for outputting the handling information to the terminal device.

[0071] (Appendix 10) Acquire an image of the target organism taken with a terminal device, Estimating the state of the target organism from the image using a machine learning model that has learned the relationship between the image of the target organism and the state of the target organism; Searching for treatment information for treating the condition of the target organism; A recording medium on which a program for causing a computer to execute a process for outputting the handling information to the terminal device is recorded.

[0072] Although the present disclosure has been described above with reference to the embodiments and examples, the present disclosure is not limited to the above-described embodiments and examples. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. [Explanation of symbols]

[0073] 20 Pet Terminal 200 servers 215 Database (DB) 300 User Terminals 411 Image acquisition unit 412 State Estimation Unit 413 Information Search Department 414 Information Transmission Department 511 training data 512 Learning Device

Claims

1. an image acquisition means for acquiring an image of the target organism taken by a terminal device; a state estimation means for estimating the state and attribute information of the target organism photographed from the acquired image using a machine learning model that has learned the relationship between the image, state, and attribute information of the target organism; an information search means for searching for response information from a database storing response information for dealing with the estimated condition or from the Internet, based on the estimated condition and the attribute information; an output means for outputting the retrieved handling information to the terminal device; An information processing device comprising:

2. A sensor information acquisition means for acquiring biological information of the photographed target organism, The information processing apparatus according to claim 1 , wherein the state estimation means estimates the state of the photographed target organism based on the acquired image and the biological information.

3. The treatment information includes a method for treating an illness or injury, The information processing apparatus according to claim 1 , wherein the output unit transmits handling information including the handling method.

4. The response information includes hospital information, The information processing apparatus according to claim 1 , wherein the output unit transmits the treatment information including the hospital information.

5. The photographed target organism is a pet animal, the estimated attribute information is the type of the pet animal; 2. The information processing apparatus according to claim 1, wherein the information search means searches for hospital information relating to hospitals that treat pets based on the type of pet.

6. The information processing apparatus according to claim 1 , wherein the output means outputs the estimation result of the state estimation means to a terminal of a medical worker.

7. the state estimation means estimates the behavior of the target organism captured from the acquired image using a machine learning model that has learned the relationship between the image of the target organism and behavior that leads to illness or injury; The information processing apparatus according to claim 1 , wherein the output means outputs the estimation result of the state estimation means to the terminal device.

8. The terminal device is a glasses-type wearable terminal equipped with a photographing unit and a display unit, the acquired image is an image captured by the imaging unit, The information processing apparatus according to claim 1 , wherein the outputted handling information is outputted to the display unit.

9. 1. A computer-implemented information processing method, comprising: Acquire an image of the target organism taken with a terminal device, Using a machine learning model that has learned the relationship between the image, state, and attribute information of the target organism, the state and attribute information of the target organism photographed from the acquired image are estimated; searching for response information for dealing with the estimated condition from a database storing response information for dealing with the estimated condition or from the Internet, based on the estimated condition and the attribute information; An information processing method for outputting the retrieved handling information to the terminal device.

10. Acquire an image of the target organism taken with a terminal device, Using a machine learning model that has learned the relationship between the image, state, and attribute information of the target organism, the state and attribute information of the target organism photographed from the acquired image are estimated; searching for response information for dealing with the estimated condition from a database storing response information for dealing with the estimated condition or from the Internet, based on the estimated condition and the attribute information; A program that causes a computer to execute a process of outputting the retrieved handling information to the terminal device.

Images