Pressure ulcer record support system, wearable terminal device, method and program

Abstract

To provide a pressure ulcer recording support system, a wearable terminal device, a method, and a program capable of recording the depth of pressure ulcers. [Solution] The pressure ulcer recording support system includes an image generation unit that generates depth images showing pressure ulcers using distance information of the patient's pressure ulcers calculated by a distance measuring sensor equipped in a wearable terminal device, a pressure ulcer detection unit that detects pressure ulcers from the depth images, a depth calculation unit that calculates depth information indicating the depth of the detected pressure ulcers, and a registration unit that registers the calculated depth information.

Description

Technical Field

[0001] The present disclosure relates to a pressure ulcer record support system, a wearable terminal device, a method, and a program that support recording of information related to a patient's pressure ulcer.

Background Art

[0002] Conventionally, various techniques for estimating the size of pressure ulcers at medical sites have been proposed. As an example of such a technique, Patent Document 1 estimates the area of a pressure ulcer that is an affected region, calculates the size and area of the estimated affected region, and outputs the calculated size and area of the affected region, disclosing an image processing system.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of Invention

Problems to be Solved by the Invention

[0004] However, the image processing system disclosed in Patent Document 1 has a problem that it cannot record the depth of pressure ulcers.

[0005] One of the objectives of the present disclosure is to provide a pressure ulcer record support system, a wearable terminal device, a method, and a program capable of recording the depth of pressure ulcers in view of the above-mentioned problems.

Means for Solving the Problems

[0006] The pressure ulcer record support system according to the present disclosure is an image generation unit that generates a depth image representing a pressure ulcer using distance information of the patient's pressure ulcer calculated by a ranging sensor included in the wearable terminal device, and a pressure ulcer detection unit that detects a pressure ulcer from the depth image. A depth calculation unit that calculates depth information indicating the depth of the detected pressure ulcer, It includes a registration unit for registering the calculated depth information.

[0007] The wearable terminal device related to this disclosure is Distance measuring sensor and An image generation unit generates a depth image showing a pressure ulcer using distance information of the patient's pressure ulcer calculated by a distance measuring sensor. A pressure ulcer detection unit that detects pressure ulcers from depth images, A depth calculation unit that calculates depth information indicating the depth of the detected pressure ulcer, It includes an output unit that outputs the calculated depth information.

[0008] The method relating to this disclosure is: Computers Using distance information of the patient's pressure ulcer calculated by a distance measuring sensor installed in a wearable terminal device, a depth image showing the pressure ulcer is generated. Pressure ulcers are detected from depth images. Depth information indicating the depth of the detected pressure ulcer is calculated, Register the calculated depth information.

[0009] The program related to this disclosure is For computers, Using distance information of the patient's pressure ulcer calculated by a distance measuring sensor in a wearable terminal device, a depth image showing the pressure ulcer is generated. We detect pressure ulcers from depth images. The system calculates depth information indicating the depth of the detected pressure ulcers. Output the calculated depth information. [Effects of the Invention]

[0010] This disclosure provides a pressure ulcer recording support system, a wearable terminal device, a method, and a program capable of recording the depth of pressure ulcers. [Brief explanation of the drawing]

[0011] [Figure 1]This is a diagram showing an example of a pressure ulcer record support system according to the present disclosure. [Figure 2] This is a diagram showing an example of the hardware configuration of a wearable terminal device according to the present disclosure. [Figure 3] This is a diagram showing an example of the hardware configuration of an information processing device according to the present disclosure. [Figure 4] This is a diagram showing an example of the functional configuration of a wearable terminal device according to the present disclosure. [Figure 5] This is a diagram showing an example of the functional configuration of an information processing device according to the present disclosure. [Figure 6] This is a diagram showing an example of a transmission history table. [Figure 7] This is a diagram showing an example of the functional configuration of an electronic medical record management device according to the present disclosure. [Figure 8] This is a diagram showing an example of an electronic medical record information table. [Figure 9] This is a sequence diagram showing an example of processing executed in the pressure ulcer record support system according to the present disclosure. [Figure 10] This is a diagram showing an example of a superimposed image of a pressure ulcer. [Figure 11] This is a diagram showing an example of an image displayed on the display of a wearable terminal device. [Figure 12] This is a diagram showing an example of extraction of character information by a patient information extraction model. [Figure 13] This is a diagram showing the main constituent elements of the pressure ulcer record support system according to the present disclosure. [Mode for Carrying Out the Invention]

[0012] Hereinafter, an exemplary embodiment will be described with reference to the drawings. FIG. 1 is a diagram showing an example of a pressure ulcer record support system 1 according to the present disclosure. The pressure ulcer record support system 1 includes a wearable terminal device 10, an information processing device 20, and an electronic medical record management device 30. Although a single wearable terminal device 10 is shown in FIG. 1, the pressure ulcer record support system 1 may include a plurality of wearable terminal devices 10.

[0013] The information processing device 20 communicates data with the wearable terminal device 10 and the electronic medical record management device 30 via the network 40. The network 40 may include a narrow-area network such as a LAN (Local Area Network) and / or a wide-area network such as the Internet.

[0014] The wearable terminal device 10 is a terminal device worn by medical professionals. Specific examples of the wearable terminal device 10 include smart glasses and other glasses-type wearable terminal devices. The wearable terminal device 10 can send and receive data wirelessly. The wearable terminal device 10 generates images of the patient's pressure ulcers and provides them to the information processing device 20. The wearable terminal device 10 also acquires audio and provides it to the information processing device 20. Details of the configuration of the wearable terminal device 10 will be described later.

[0015] The information processing device 20 calculates the depth and size of a pressure ulcer using images of the pressure ulcer provided by the wearable terminal device 10. The information processing device 20 also analyzes the audio provided by the wearable terminal device 10 to generate text information about the patient. Specific examples of the information processing device 20 include information processing devices such as servers. Details of the configuration of the information processing device 20 will be described later.

[0016] The electronic medical record management device 30 is an information processing device that manages electronic medical records in which patient information is registered. Specific examples of the electronic medical record management device 30 include information processing devices such as servers. The electronic medical record management device 30 registers the patient information provided by the information processing device 20 into the electronic medical record information table. Details of the electronic medical record information table will be described later.

[0017] Figure 2 shows an example of the hardware configuration of a wearable terminal device 10. The wearable terminal device 10 includes a processor 11, a communication interface (I / F) 12, memory 13, a storage device 14, a display 15, a camera 16, a distance sensor 17, and a microphone 18. These devices exchange data via a bus 19.

[0018] The processor 11 is a device that performs overall control of the wearable terminal device 10. Specific examples of the processor 11 include processors such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), and MPU (Micro Processing Unit). The processor 11 executes the method defined by the program by loading the program stored in the storage device 14 into the memory 13 and executing it. In other embodiments, the functions performed by the processor 11 may also be performed by integrated circuits such as FPGAs (Field-Programmable Gate Arrays) and ASICs (Application Specific Integrated Circuits). These devices are equivalent to computers.

[0019] The communication interface 12 is an interface for data communication between the wearable terminal device 10 and other devices. The storage device 14 stores various data, such as programs executed by the processor 11 and data processed by the processor 11. The storage device 14 corresponds to a memory unit.

[0020] The display 15 is a device that displays various images. Various patient information is displayed on the display 15. When a glasses-type wearable terminal device is adopted as the wearable terminal device 10, the transparent display 15 is placed in front of the eyes of the wearer of the wearable terminal device 10. The display 15 corresponds to the display unit.

[0021] Camera 16 is a device that takes images under the control of processor 11. Preferably, camera 16 is positioned to capture the wearer's field of view through a transparent display 15.

[0022] The distance measuring sensor 17 is a device that measures the distance of an object under the control of the processor 11. Specific examples of the distance measuring sensor 17 include a LIDAR (Light Detection And Ranging) sensor. It is preferable that the distance measuring sensor 17 be positioned so as to measure an area included in the wearer's field of view.

[0023] The microphone 18 is a device for collecting the voice of the wearer of the wearable terminal device 10. The microphone 18 corresponds to the sound collection unit.

[0024] Figure 3 shows an example of the hardware configuration of the information processing device 20. The information processing device 20 comprises a processor 21, a communication interface (I / F) 22, memory 23, and a storage device 24. These devices exchange data via a bus 25. The electronic medical record management device 30 has the same hardware configuration as the information processing device 20.

[0025] The processor 21 is a device that performs overall control of the information processing device 20. Specific examples of the processor 21 include CPUs, GPUs, MPUs, and other processors. The processor 21 executes the method defined by the program by loading the program stored in the storage device 24 into the memory 23 and executing it. In other embodiments, the functions performed by the processor 21 may also be performed by integrated circuits such as FPGAs and ASICs. These devices are equivalent to computers.

[0026] The communication interface 22 is an interface for data communication between the information processing device 20 and other devices. The storage device 24 stores various data, such as programs executed by the processor 21 and data processed by the processor 21. The storage device 24 corresponds to a memory unit.

[0027] Figure 4 shows an example of the functional configuration of a wearable terminal device 10 according to this disclosure. The wearable terminal device 10 includes a voice acquisition unit 100, an instruction reception unit 101, an operation mode switching unit 102, an image generation unit 103, a reception unit 104, a display control unit 105, and a transmission unit 106. These functional means can be implemented by a program.

[0028] The voice acquisition unit 100 acquires the surrounding sounds of the wearable terminal device 10 that have been picked up by the microphone 18.

[0029] The instruction receiving unit 101 receives various instructions from the wearer. These instructions include instructions to switch the operating mode of the wearable terminal device 10, instructions to take images of pressure ulcers, and instructions to register information about the patient's pressure ulcers. These instructions can be given by the wearer using voice commands. Alternatively, these instructions can be given using input devices such as buttons provided on the wearable terminal device 10.

[0030] The operation mode switching unit 102 switches the operation mode of the wearable terminal device 10. The wearable terminal device 10 has two operation modes: normal operation mode and automatic shooting mode. In automatic shooting mode, the wearable terminal device 10 generates a 2D image and a depth image.

[0031] The image generation unit 103 generates two-dimensional images and depth images of the pressure ulcer. Specifically, the image generation unit 103 causes the camera 16 to perform an imaging process to generate a two-dimensional image of the pressure ulcer. The image generation unit 103 also causes the distance sensor 17 to perform a measurement process and generates a depth image of the pressure ulcer from the measured value. In automatic imaging mode, the image generation unit 103 repeatedly performs the imaging and measurement processes to generate two-dimensional images and depth images of the pressure ulcer.

[0032] The receiving unit 104 acquires various information from other devices such as the information processing device 20. The information received by the receiving unit 104 includes superimposed images of pressure ulcers, pressure ulcer depth information, and pressure ulcer size information generated by the information processing device 20.

[0033] The display control unit 105 displays various images on the display 15. The images displayed on the display 15 include superimposed images of pressure ulcers, pressure ulcer depth information, and pressure ulcer size information generated by the information processing device 20.

[0034] The transmitting unit 106 transmits various types of information to the information processing device 20. The information transmitted by the transmitting unit 106 includes a two-dimensional captured image generated by the image generation unit 103, a depth image, distance information calculated by the distance measuring sensor 17, and audio information acquired by the microphone 18.

[0035] Figure 5 shows an example of the functional configuration of the information processing device 20 according to this disclosure. The information processing device 20 includes a receiving unit 200, a pressure ulcer detection unit 201, a pressure ulcer detection model 202, a depth calculation unit 203, a depth calculation model 204, a size calculation unit 205, a size calculation model 206, a superimposed image generation unit 207, a voice information analysis unit 208, a voice information analysis model 209, a patient information extraction unit 210, a patient information extraction model 211, and a transmission unit 212.

[0036] The receiving unit 200 receives various information from other devices. The information received by the receiving unit 200 includes 2D captured images, depth images, and measurement information transmitted by the wearable terminal device 10.

[0037] The pressure ulcer detection unit 201 detects pressure ulcers from 2D captured images and depth images using the pressure ulcer detection model 202.

[0038] The pressure ulcer detection model 202 is a machine learning model that detects pressure ulcers contained in 2D captured images and depth images. When a 2D captured image and depth image containing pressure ulcers are input to the pressure ulcer detection model 202, it is trained to output coordinate information that defines the image region of the pressure ulcer in each of these images. The pressure ulcer detection model 202 can be trained using machine learning methods such as deep learning.

[0039] The depth calculation unit 203 uses the depth calculation model 204 to calculate the depth of a pressure ulcer from the depth image in which the pressure ulcer was detected by the pressure ulcer detection unit 201.

[0040] The depth calculation model 204 is a machine learning model that calculates the depth of a pressure ulcer from a depth image in which a pressure ulcer has been detected by the pressure ulcer detection unit 201. The depth calculation model 204 can be trained using machine learning such as deep learning. When the depth calculation model 204 receives a depth image containing a pressure ulcer and coordinate information defining the image region of the pressure ulcer, it is trained to output the depth information of the pressure ulcer contained within the image region of the pressure ulcer. For example, if the image region of the pressure ulcer is displayed as a rectangle, the coordinate information defining the image region of the pressure ulcer can be the coordinates of the edges of that rectangle.

[0041] The size calculation unit 205 uses the size calculation model 206 to calculate the size of a pressure ulcer from a two-dimensional captured image in which a pressure ulcer has been detected by the pressure ulcer detection unit 201. The size of the pressure ulcer is, for example, the longest and shortest diameters of the pressure ulcer.

[0042] The size calculation model 206 is a machine learning model optimized to calculate the size of a pressure ulcer from a two-dimensional captured image in which a pressure ulcer has been detected by the pressure ulcer detection unit 201. The size calculation model 206 can be trained using machine learning such as deep learning. When the size calculation model 206 receives a two-dimensional captured image containing a pressure ulcer, coordinate information defining the image region of the pressure ulcer, the size of the image region of the pressure ulcer, and distance information provided by the wearable terminal device 10 as input, it is trained to output the size of the pressure ulcer contained in the image region. The size of the image region of the pressure ulcer is the size of the image region in which the pressure ulcer is displayed and can be expressed in pixels. The distance information provided by the wearable terminal device 10 represents the distance from the distance measuring sensor 17 to the pressure ulcer. Based on the correspondence between this distance information and the size of the image region in which the pressure ulcer is displayed, the size calculation model 206 can calculate the size of the pressure ulcer contained in the image region.

[0043] The superimposed image generation unit 207 generates a superimposed image 50 by superimposing predetermined image objects 52 and 53 onto the two-dimensional captured image 51. Figure 10 shows an example of a superimposed image 50 of a pressure ulcer generated by the superimposed image generation unit 207. The superimposed image 50 of the pressure ulcer includes an image object 52 indicating focus and an image object 53 indicating scale. The superimposed image generation unit 207 can superimpose an image object 53 corresponding to the size of the pressure ulcer calculated by the size calculation unit 205 onto the two-dimensional captured image 51. The image object 53 indicating scale can represent any unit of length such as millimeters, centimeters, or inches.

[0044] The voice information analysis unit 208 analyzes the voice information provided from the wearable terminal device 10 using the voice information analysis model 209.

[0045] The speech information analysis model 209 is a machine learning model that analyzes speech information provided by the wearable terminal device 10 and outputs text information contained in the speech information. In this embodiment, a pre-trained model capable of speech recognition can be used as the speech information analysis model 209. The speech information analysis model 209 can be trained using training data in which speech information including various human conversations is used as input information and text information representing those conversations in text is used as output information.

[0046] The patient information extraction unit 210 uses the patient information extraction model 211 to extract patient information, which is information about the patient, from the text information output by the voice information analysis unit 208. The patient information includes information about the patient's pressure ulcers.

[0047] The patient information extraction model 211 is a machine learning model that extracts patient information from text information output by the speech information analysis model 209. In this embodiment, a language model such as a Large Language Model (LLM) can be used as the patient information extraction model 211. The patient information extraction model 211 is trained to output text information that summarizes the content of the text information when text information is input. Figure 12 shows an example of text information extraction by the patient information extraction model 211. When text information 60 is input, the patient information extraction model 211 can output text information 61 that summarizes the content of the text information. The text information 61 corresponds to patient information.

[0048] The transmitting unit 212 transmits various information to other devices. The information transmitted by the transmitting unit 212 includes identification information for superimposed images, depth information, size information, and pressure ulcer information, which are sent to the wearable terminal device 10. When the transmitting unit 212 transmits this information to the wearable terminal device 10, it registers predetermined information in the transmission history table where transmission history information is registered. Figure 6 shows an example of the transmission history table. The transmission history table registers the identification information of the wearable terminal device 10 to which the superimposed images etc. are sent (terminal device ID: Identification), the identification information of the pressure ulcer information which is the identification information of the transmitted depth information and size information (pressure ulcer information ID), the identification information of the transmitted superimposed image (image ID), and the transmission date and time in association with each other.

[0049] Furthermore, the information transmitted by the transmission unit 212 includes patient information extracted by the patient information extraction unit 210, which is then sent to the electronic medical record management device 30. Along with the patient information extracted by the patient information extraction unit 210, the transmission unit 212 also transmits patient identification information (patient ID). The patient ID is provided by the wearable terminal device 10.

[0050] Figure 7 shows an example of the functional configuration of the electronic medical record management device 30 according to this disclosure. The electronic medical record management device 30 includes a receiving unit 300, a registration unit 301, and a patient information storage unit 302.

[0051] The receiving unit 300 receives various information from other devices. The information received by the receiving unit 300 includes the patient ID, superimposed image of the pressure ulcer, pressure ulcer depth information, pressure ulcer size information, and patient information transmitted by the information processing device 20.

[0052] The registration unit 301 registers the superimposed image of the pressure ulcer, the depth information of the pressure ulcer, the size information of the pressure ulcer, and the identification information of the patient, transmitted by the information processing device 20, in the electronic medical record information table, associating them with the patient ID.

[0053] The patient information storage unit 302 stores the patient information transmitted by the information processing device 20 in the patient information database. The patient information database can be built on the storage device of the electronic medical record management device 30.

[0054] Figure 8 shows an example of an electronic medical record information table. The electronic medical record information table registers patient ID, patient name, patient admission date, patient hospital room, patient date of birth, patient age, pressure ulcer depth, pressure ulcer long and short diameters, last update date and time, image ID, patient information ID, etc. The last update date and time is the last update date and time of the electronic medical record information table. The image ID is the identification information of the superimposed image. The patient information ID is the identification information of the patient information stored in the patient information database.

[0055] Figure 9 is a sequence diagram showing an example of the process performed in the pressure ulcer recording support system 1. In step S1, the instruction receiving unit 101 of the wearable terminal device 10 receives an instruction from the wearer of the wearable terminal device 10 to switch to automatic shooting mode. In step S2, the operation mode switching unit 102 switches the operation mode of the wearable terminal device 10 to automatic shooting mode. In automatic shooting mode, the wearable terminal device 10 repeatedly performs the processes of steps S3 to S5.

[0056] In step S2, the image generation unit 103 causes the camera 16 to perform an image capture process and generates a two-dimensional captured image. In step S3, the image generation unit 103 causes the distance measuring sensor 17 to perform a measurement process and generates a depth image. In step S4, the transmission unit 106 transmits the generated two-dimensional captured image and depth image, along with the distance information calculated by the distance measuring sensor 17, to the information processing device 20, along with the identification information of the wearable terminal device 10.

[0057] When the information processing device 20 receives the 2D captured image, depth image, distance information, and identification information of the wearable terminal device 10 transmitted by the wearable terminal device 10, in step S6, the pressure ulcer detection unit 201 of the information processing device 20 detects a pressure ulcer from the 2D captured image and depth image. In step S7, the depth calculation unit 203 calculates the depth of the pressure ulcer. In step S8, the size calculation unit 205 calculates the major and minor diameters of the pressure ulcer. In step S9, the superimposed image generation unit 207 generates a superimposed image. In step S10, the transmission unit 212 transmits the superimposed image, depth information, pressure ulcer size information, and identification information of the pressure ulcer to the wearable terminal device 10. Here, the transmission unit 212 can identify the destination wearable terminal device 10 using the identification information of the wearable terminal device 10 received along with the 2D captured image and depth image.

[0058] When the wearable terminal device 10 receives the superimposed image, depth information, and size information transmitted by the information processing device 20, in step S11, the display control unit 105 of the wearable terminal device 10 displays the received superimposed image, depth information, and size information on the display 15. Figure 11 is a diagram showing an example of an image displayed on the display 15 of the wearable terminal device 10. As shown in Figure 11, the display 15 displays the superimposed image 50, depth information, and size information.

[0059] Next, when the wearer of the wearable terminal device 10 instructs the wearable terminal device 10 to register information about pressure ulcers, in step S12 the instruction receiving unit 101 of the wearable terminal device 10 receives the instruction to register information about pressure ulcers. In step S13, the transmission unit 106 transmits the registration instruction, the pressure ulcer information ID, and the patient ID to the information processing device 20. The patient ID can be specified by the wearer of the wearable terminal device 10. In step S14, the operation mode switching unit 102 switches the operation mode of the wearable terminal device 10 to normal operation mode.

[0060] When the information processing device 20 receives the registration instruction, pressure ulcer information ID, and patient ID transmitted by the wearable terminal device 10, in step S14, the transmission unit 212 of the information processing device 20 transmits the superimposed image, depth information, and size information associated with the pressure ulcer information ID in the transmission history table, along with the patient ID, to the electronic medical record management device 30.

[0061] When the electronic medical record management device 30 receives the superimposed image, depth information, size information, and patient ID, in step S15, the registration unit 301 associates the superimposed image, depth information, and size information with the patient ID and saves them in the electronic medical record information table.

[0062] Figure 13 shows the main components of the pressure ulcer recording support system 1. The pressure ulcer recording support system 1 includes an image generation unit 103, a pressure ulcer detection unit 201, a depth calculation unit 203, and a registration unit 301. The image generation unit 103 generates a depth image showing the pressure ulcer using distance information of the patient's pressure ulcer calculated by a distance measuring sensor 17 provided in the wearable terminal device 10. The pressure ulcer detection unit 201 detects the pressure ulcer from the depth image. The depth calculation unit 203 calculates depth information indicating the depth of the detected pressure ulcer. The registration unit 301 registers the calculated depth information. By adopting this configuration, the depth of the pressure ulcer can be recorded.

[0063] Furthermore, in the embodiment described above, the display control unit 105 displays the calculated depth information on the display unit 15 of the wearable terminal device 10. This allows the wearer of the wearable terminal device 10 to check the depth information of the pressure ulcer.

[0064] Furthermore, in the embodiment described above, the instruction receiving unit 101 receives instructions from the wearer wearing the wearable terminal device 10. When the instruction receiving unit 101 receives an instruction to register information about pressure ulcers displayed on the display unit 15 of the wearable terminal device 10, the registration unit 301 registers the depth information as electronic medical record information. By adopting this configuration, the wearer of the wearable terminal device 10 can instruct the registration of pressure ulcer depth information at the timing when the desired pressure ulcer depth information is displayed on the display unit 15, and that depth information can be registered as electronic medical record information.

[0065] Furthermore, in the embodiment described above, the image generation unit 103 generates an image of the pressure ulcer using the imaging device 16 provided by the wearable terminal device 10. When the instruction reception unit 101 receives an instruction to register information about the pressure ulcer displayed on the display unit 15, the registration unit 301 registers the image of the pressure ulcer with an image object indicating scale superimposed as electronic medical record information. By adopting this configuration, it is possible to register an image of a pressure ulcer with an image object indicating scale superimposed as electronic medical record information.

[0066] Furthermore, in the embodiment described above, the voice acquisition unit 100 acquires the voice collected by the sound collection unit 18 of the wearable terminal device 10. The voice information analysis unit 208 analyzes the acquired voice information and outputs character information representing the words contained in the voice information. The patient information extraction unit 210 extracts patient information from the output character information. The patient information storage unit 302 stores the extracted patient information in the storage unit 14. By adopting this configuration, the wearer of the wearable terminal device 10 can register patient information that has been verbally explained.

[0067] In the embodiment described above, the wearable terminal device 10 automatically generates a two-dimensional image and depth image of the pressure ulcer after switching to automatic shooting mode. However, in other embodiments, the wearable terminal device 10 may generate a two-dimensional image and depth image of the pressure ulcer each time it receives an individual shooting instruction from the wearer.

[0068] In the examples described above, the program includes a set of instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disk (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically, or otherwise propagating signals.

[0069] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure can be made as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0070] Each drawing is merely illustrative to illustrate one or more embodiments. Each drawing may be associated with one or more other embodiments rather than with only one specific embodiment. As those skilled in the art will understand, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings, for example, to create embodiments not explicitly shown or described. Not all features or steps shown in any one drawing to illustrate an exemplary embodiment are necessarily required, and some features or steps may be omitted. The order of steps shown in any of the drawings may be changed as appropriate.

[0071] Some or all of the above embodiments may also be described as follows, but are not limited to the following: (Note 1) An image generation unit generates a depth image showing the pressure ulcer using distance information of the patient's pressure ulcer calculated by a distance measuring sensor installed in a wearable terminal device. A pressure ulcer detection unit that detects pressure ulcers from the aforementioned depth image, A depth calculation unit that calculates depth information indicating the depth of the detected pressure ulcer, A registration unit that registers the calculated depth information and A pressure ulcer record support system, including [specific feature]. (Note 2) The pressure ulcer recording support system according to Appendix 1, including a display control unit that displays the calculated depth information on the display unit of the wearable terminal device. (Note 3) Includes an instruction receiving unit that receives instructions from the wearer wearing the wearable terminal device, The pressure ulcer record support system as described in Appendix 2, wherein the registration unit registers the depth information as electronic medical record information when the instruction receiving unit receives an instruction from the display unit to register the pressure ulcer information displayed on the display unit. (Note 4) The image generation unit generates an image of the pressure ulcer using the imaging device provided in the wearable terminal device. The pressure ulcer recording support system as described in Appendix 3, wherein the registration unit registers the captured image of the pressure ulcer with an image object indicating the scale superimposed on it as electronic medical record information when the instruction receiving unit receives an instruction from the display unit to register the information regarding the pressure ulcer displayed on the display unit. (Note 5) The depth calculation unit uses a depth calculation model to calculate depth information indicating the depth of the detected pressure ulcer, The pressure ulcer recording support system described in any one of Appendix 1 to 4, wherein the depth calculation model is a machine learning model optimized to output depth information of a pressure ulcer when a depth image and coordinate information defining the image region of a pressure ulcer included in the depth image are input. (Note 6) The wearable terminal device includes a sound acquisition unit that acquires sound collected by the sound collection unit, A voice information analysis unit analyzes the acquired voice information and outputs character information representing the words contained in the voice information, A patient information extraction unit extracts patient information from the outputted text information, A patient information storage unit that stores extracted patient information in the storage unit. A pressure ulcer record support system, including any one of the items in Appendix 1 to 4. (Note 7) Distance measuring sensor and An image generation unit generates a depth image showing the pressure ulcer using the distance information of the patient's pressure ulcer calculated by the distance measuring sensor, A pressure ulcer detection unit that detects pressure ulcers from the aforementioned depth image, A depth calculation unit that calculates depth information indicating the depth of the detected pressure ulcer, An output unit that outputs the calculated depth information and Wearable terminal devices, including [the specified feature]. (Note 8) The wearable terminal device according to Appendix 7, including a display control unit that displays the calculated depth information on the display unit of the wearable terminal device. (Note 9) Includes an instruction receiving unit that receives instructions from the wearer wearing the wearable terminal device, The wearable terminal device as described in Appendix 8, wherein the registration unit registers the depth information as electronic medical record information when the instruction receiving unit receives an instruction from the display unit to register the information regarding the pressure ulcer displayed on the display unit. (Note 10) The image generation unit generates an image of the pressure ulcer using the imaging device provided in the wearable terminal device. The wearable terminal device as described in Appendix 9, wherein the registration unit registers, when the instruction receiving unit receives an instruction to register the information relating to the pressure ulcer displayed on the display unit, the captured image of the pressure ulcer with an image object indicating the scale superimposed on it as electronic medical record information. (Note 11) The depth calculation unit uses a depth calculation model to calculate depth information indicating the depth of the detected pressure ulcer, The wearable terminal device according to Appendix 7 or 8, wherein the depth calculation model is a machine learning model optimized to output depth information of a pressure ulcer when a depth image and coordinate information defining the image region of a pressure ulcer included in the depth image are input. (Note 12) The wearable terminal device includes a sound acquisition unit that acquires sound collected by the sound collection unit, A voice information analysis unit analyzes the acquired voice information and outputs character information representing the words contained in the voice information, A patient information extraction unit extracts patient information from the outputted text information, A patient information storage unit that stores extracted patient information in the storage unit. A wearable terminal device as described in Appendix 7 or 8, including the following. (Note 13) Computers Using distance information of the patient's pressure ulcer calculated by a distance measuring sensor installed in a wearable terminal device, a depth image showing the pressure ulcer is generated. Pressure ulcers are detected from the aforementioned depth image, Depth information indicating the depth of the detected pressure ulcer is calculated, Register the calculated depth information. method. (Note 14) For computers, Using distance information of the patient's pressure ulcer calculated by a distance measuring sensor installed in a wearable terminal device, a depth image showing the pressure ulcer is generated. Pressure ulcers are detected from the aforementioned depth image. The system calculates depth information indicating the depth of the detected pressure ulcers. Output the calculated depth information. program.

[0072] Some or all of the elements described in Appendices 2 to 6 that are dependent on Appendice 1 may also be dependent on Appendices 13 and 14 in the same manner as those described in Appendices 2 to 6. Some or all of the elements described in any appendice may be applicable to various hardware, software, recording means, systems, and methods for recording software. [Explanation of Symbols]

[0073] 1: Pressure ulcer record support system 10: Wearable terminal device 11: Processor 12: Communication Interface 13: Memory 14: Storage device, memory unit 15: Display 16: Cameras, photographic equipment 17: Distance measuring sensor 18: Microphone, sound collection unit 19: Bus 20: Information Processing Device 21: Processor 22: Communication Interface 23: Memory 24: Storage devices 25: Bus 30: Electronic medical record management system 40: Network 50: Superimposed image 51: 2D photographic image 52: Image object 53: Image object 60: Text information 61: Text Information 100: Voice acquisition unit 101: Instruction Reception Department 102: Operation mode switching unit 103: Image generation unit 104: Receiving unit 105: Display Control Unit 106: Transmitter 200: Receiver 201: Pressure ulcer detection unit 202: Pressure ulcer detection model 203: Depth calculation section 204: Depth calculation model 205: Size calculation section 206: Size Calculation Model 207: Superimposed Image Generation Unit 208: Voice Information Analysis Department 209: Speech Information Analysis Model 210: Patient information extraction section 211: Patient Information Extraction Model 212: Transmitter 300: Receiver 301: Registration Department 302: Patient information storage department

Claims

1. An image generation unit generates a depth image showing the pressure ulcer using distance information of the patient's pressure ulcer calculated by a distance measuring sensor installed in a wearable terminal device. A pressure ulcer detection unit that detects pressure ulcers from the aforementioned depth image, A depth calculation unit that calculates depth information indicating the depth of the detected pressure ulcer, A registration unit that registers the calculated depth information and A pressure ulcer record support system, including [specific feature].

2. The pressure ulcer recording support system according to claim 1, further comprising a display control unit that displays the calculated depth information on the display unit of the wearable terminal device.

3. Includes an instruction receiving unit that receives instructions from the wearer wearing the wearable terminal device, The pressure ulcer recording support system according to claim 2, wherein the registration unit registers the depth information as electronic medical record information when the instruction receiving unit receives an instruction from the display unit to register the pressure ulcer information displayed on the display unit.

4. The image generation unit generates an image of the pressure ulcer using the imaging device provided in the wearable terminal device. The pressure ulcer recording support system according to claim 3, wherein when the instruction receiving unit receives an instruction from the display unit to register the information relating to the pressure ulcer displayed on the display unit, the registration unit registers the captured image of the pressure ulcer with an image object indicating the scale superimposed on it as electronic medical record information.

5. The depth calculation unit uses a depth calculation model to calculate depth information indicating the depth of the detected pressure ulcer, The pressure ulcer recording support system according to any one of claims 1 to 4, wherein the depth calculation model is a machine learning model optimized to output depth information of a pressure ulcer when a depth image and coordinate information defining the image region of a pressure ulcer included in the depth image are input.

6. The wearable terminal device includes a sound acquisition unit that acquires sound collected by the sound collection unit, A voice information analysis unit analyzes the acquired voice information and outputs character information representing the words contained in the voice information, A patient information extraction unit extracts patient information from the outputted text information, A patient information storage unit that stores extracted patient information in the storage unit. A pressure ulcer record support system according to any one of claims 1 to 4, including the following:

7. Distance measuring sensor and An image generation unit generates a depth image showing the pressure ulcer using the distance information of the patient's pressure ulcer calculated by the distance measuring sensor, A pressure ulcer detection unit that detects pressure ulcers from the aforementioned depth image, A depth calculation unit that calculates depth information indicating the depth of the detected pressure ulcer, An output unit that outputs the calculated depth information and Wearable terminal devices, including [the specified feature].

8. The wearable terminal device according to claim 7, further comprising a display control unit that displays the calculated depth information on the display unit of the wearable terminal device.

9. Computers Using distance information of the patient's pressure ulcer calculated by a distance measuring sensor installed in a wearable terminal device, a depth image showing the pressure ulcer is generated. Pressure ulcers are detected from the aforementioned depth image, Depth information indicating the depth of the detected pressure ulcer is calculated, Register the calculated depth information. method.

10. For computers, Using distance information of the patient's pressure ulcer calculated by a distance measuring sensor installed in a wearable terminal device, a depth image showing the pressure ulcer is generated. Pressure ulcers are detected from the aforementioned depth image. The system calculates depth information indicating the depth of the detected pressure ulcers. Output the calculated depth information. program.

Images