Information processing device, information processing method, and information processing program
The information processing device addresses the complexity and cost issues of existing lymphedema monitoring technologies by using image acquisition and three-dimensional shape measurement to generate diagnostic information for lymphedema treatment, thereby supporting effective monitoring and early detection.
Patent Information
- Application Number
- JP2023170463
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-09-29
- Publication Date
- 2025-04-23
- Estimated Expiration
- 2043-09-29
AI Technical Summary
Existing technologies for monitoring lymphedema, such as those described in Patent Document 1, often result in complex and expensive devices due to their reliance on measuring electrical properties.
An information processing device that includes an acquisition unit to capture images of measurement and wear items, a measurement unit to measure the three-dimensional shape of specific body parts, a generation unit to create diagnostic information for lymphedema treatment, and a provision unit to provide this information for medical use.
The proposed solution supports effective monitoring of lymphedema by providing diagnostic information based on three-dimensional shape measurements, thereby enhancing early detection and therapeutic outcomes without the need for complex or expensive devices.
Smart Images

Figure 0007667833000001 
Figure 0007667833000002 
Figure 0007667833000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]
[0002] In patients after cancer surgery or radiation therapy, lymphedema may occur, in which lymphatic flow is impaired, causing lymph fluid to accumulate and resulting in swelling. Primary lymphedema of unknown cause may also occur. If lymphedema is detected early, it can be treated with compression clothing. Early detection is important to improve the effectiveness of lymphedema treatment, and therefore a device for monitoring lymphedema has been proposed (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2017-029487 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, the technology described in Patent Document 1 measures electrical characteristics between multiple electrodes based on the amount of albumin and infers the state of lymphedema based on the measured electrical characteristics, and there is a risk that the device will be complicated and expensive in terms of development, manufacturing, etc.
[0005] The present application has been made in consideration of the above, and aims to provide an information processing device, an information processing method, and an information processing program that can assist in monitoring lymphedema. [Means for solving the problem]
[0006] The information processing device according to the present application includes an acquisition unit, a measurement unit, a generation unit, and a provision unit. The acquisition unit acquires image information of a measurement garment worn by a user. The measurement unit measures a three-dimensional shape of an area including a specific part of the user based on the image information acquired by the acquisition unit. The generation unit generates diagnostic information, which is information used in medical treatment for lymphedema of the user, based on the three-dimensional shape measured by the measurement unit. The provision unit provides the diagnostic information generated by the generation unit. Effect of the Invention
[0007] According to one aspect of the embodiment, it is possible to provide an effect of assisting in monitoring lymphedema. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of information processing according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of the configuration of a terminal device according to the embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a wearable product for measurement according to an embodiment. [Diagram 5] FIG. 5 is a diagram showing an example of a measurement result on a lymphedema patient by a measurement unit of the information processing device according to the embodiment. [Figure 6] FIG. 6 is a diagram showing an example of diagnostic information displayed in the hospital apparatus according to the embodiment. [Figure 7] FIG. 7 is a flowchart illustrating an example of information processing by the processing unit of the terminal device according to the embodiment. [Figure 8] FIG. 8 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the terminal device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, the information processing device, the information processing method, and the information processing program according to the present application (hereinafter, referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to these embodiments. In addition, each embodiment can be appropriately combined as long as the processing contents are not contradictory. In addition, the same parts in each of the following embodiments are given the same reference numerals, and duplicated explanations will be omitted.
[0010] [1. An example of information processing] First, an example of information processing according to the embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of information processing according to the embodiment. Fig. 1 shows an operation example of an information processing system 100 including a terminal device 1 according to the embodiment.
[0011] As shown in Fig. 1, an information processing system 100 according to an embodiment includes a terminal device 1, a wearable item for measurement 2, a hospital device 3, and an information providing device 5. The terminal device 1 is an example of an information processing device. Note that, in the example shown in Fig. 1, only one each of the terminal device 1, the wearable item for measurement 2, and the hospital device 3 is shown, but the information processing system 100 includes multiple terminal devices 1 and multiple wearable items for measurement 2.
[0012] The terminal device 1 is a terminal device operated by a user U, and is, for example, a smart device such as a smartphone or a tablet PC (Personal Computer). The terminal device 1 has an imaging unit and can capture an image of the user U, etc., by using the imaging unit.
[0013] The measurement wearable item 2 is, for example, an item for measurement worn on the body of the user U, and is, for example, a measurement garment such as a body suit that covers the entire body (excluding the face and head) of the user U. The measurement wearable item 2 is, for example, composed of two parts, a top part (upper body part) and a leggings part (lower body part), which are connectable and separable with each other.
[0014] The measurement wearable item 2 is, for example, a stretchy, tight-fitting bodysuit manufactured using standard low-cost clothing printing technology (for example, digital sublimation printing). In the example shown in FIG. 1, the measurement wearable item 2 has a dot pattern that covers most of the surface, and multiple dots are arranged in a dense regular hexagon (honeycomb shape).
[0015] Each dot is either "solid" or "hollow" and is selected using a pseudo-random algorithm. Hollow dots are O-shaped (donut-shaped). For example, the measurement wearable item 2 has an approximately equal number of solid and hollow dots printed across it. By analyzing the pattern of dots on any part of the measurement wearable item 2, it is possible to infer which part of the measurement wearable item 2 is being viewed.
[0016] Instead of circular dots, squares or hexagons can be used, and colors can be used to distinguish between two types of dots. The pattern on the surface of the wearable item 2 for measurement is not limited to a pattern of multiple dots, and any pattern other than dots may be used as long as it allows the user to guess which part of the wearable item 2 for measurement it is. For example, the pattern on the surface of the wearable item 2 for measurement may be a geometric pattern using other than dots, or other patterns.
[0017] The wearable product 2 for measurement may be, for example, a wearable product for measurement dedicated to a specific body part described later. For example, when the specific body part is an arm or a leg, the wearable product 2 for measurement may be a tube-shaped (for example, supporter-shaped) wearable product that is stretchable and tightly fitted to the arm.
[0018] The hospital device 3 is a server device of a hospital that examines the user U or a terminal device used by a medical worker M of the hospital that examines the user U. The medical worker M is, for example, a doctor who examines the user U. The hospital device 3 is an example of a hospital device that provides remote medical care to the user U.
[0019] The information providing device 5 is an information processing device that cooperates with the terminal device 1 and the hospital device 3 to provide various information to the terminal device 1 of the user U and the hospital device 3, and is realized by a server device, a cloud system, or the like. The information providing device 5 can transmit and receive various information to various applications installed in the terminal device 1 and the hospital device 3, for example, via an API (Application Programming Interface).
[0020] 1, the information providing device 5 transmits an application program for lymphedema monitoring to the terminal device 1, thereby providing the application program for lymphedema monitoring to the terminal device 1 (step S1). Hereinafter, the application program for lymphedema monitoring may be referred to as a lymphedema monitor app.
[0021] For example, when the information providing device 5 receives an app transmission request from the terminal device 1, it provides a lymphedema monitor app to the terminal device 1. When the terminal device 1 receives the lymphedema monitor app from the information providing device 5, it installs the lymphedema monitor app received from the information providing device 5.
[0022] Next, the terminal device 1 captures an image of the wearable item for measurement 2 worn by the user U, thereby acquiring information on the measurement image, which is an image of the wearable item for measurement 2 worn by the user U (step S2). The user U starts up the lymphedema monitor app installed on the terminal device 1 to cause the terminal device 1 to execute the process of step S2. The process of the terminal device 1 from step S2 onwards is a process executed by the terminal device 1 by the lymphedema monitor app.
[0023] The user U places the terminal device 1 on a stand or the like, and stands in front of the terminal device 1 while wearing the measurement wearable item 2, and causes the terminal device 1 to capture a series of images while slowly rotating the body. In this way, the terminal device 1 captures measurement images.
[0024] The measurement images include, but are not limited to, a plurality of still images obtained by capturing images of the user U wearing the measurement wearable item 2 from various viewing angles (including the angle of view) using the camera function of the terminal device 1. For example, the measurement images may be moving images captured continuously from various viewing angles (including the angle of view) of the user U wearing the measurement wearable item 2.
[0025] Next, the terminal device 1 measures the three-dimensional shape of the area including the specific part of the user U based on the information of the measurement image acquired in step S2 (step S3). For example, the terminal device 1 detects each dot of the measurement wearable item 2 from the measurement image, and generates a 3D (Dimensions) model that is the three-dimensional shape of the area including the specific part of the user U based on the detection result, thereby measuring the three-dimensional shape of the area including the specific part of the user U. A method for generating the 3D model is, for example, the method described in Japanese Patent No. 7169489, but is not limited to this example.
[0026] Next, the terminal device 1 generates diagnostic information, which is information used in medical treatment for lymphedema of the user U, based on the three-dimensional shape measured in step S3 (step S4).
[0027] The terminal device 1 can generate, as diagnostic information, a result of adjusting the three-dimensional shape by weighting the specific portion of the three-dimensional shape measured in step S3 or information based on the result.
[0028] The weighting of the specific part is, for example, weighting of the displacement of the specific part from the reference shape. The terminal device 1 detects the displacement of the three-dimensional shape measured in step S3 from the reference shape, and weights the specific part by multiplying the displacement of the specific part among the detected displacements by a weight exceeding 1. This allows the terminal device 1 to generate a three-dimensional shape in which the displacement of the specific part is exaggerated.
[0029] The reference shape is, for example, the three-dimensional shape of user U when user U is in a normal state, the three-dimensional shape of user U last measured by a lymphedema monitor app, or a standard shape, but is not limited to such examples.
[0030] The three-dimensional shape of user U when user U is in a normal state is, for example, a three-dimensional shape obtained from an image of the measurement garment 2 being worn by user U in a state in which lymphedema is not occurring, and is a three-dimensional shape obtained by the previous processing of steps S2 and S3.
[0031] The 3D shape of user U previously measured by the lymphedema monitor app is the 3D shape obtained in the previous processing of steps S2 and S3. The standard shape is a 3D shape represented by a body type model in which the shapes of parts other than the specific part are similar to the 3D shape of user U, and is obtained from the measured 3D shapes of multiple users U.
[0032] The terminal device 1 can generate, as diagnostic information, information indicating a three-dimensional shape of a specific part obtained by adjusting the shape of the specific part through weighting, or generate, as diagnostic information, information indicating the shape of a specific part extracted from the three-dimensional shape of a specific part obtained by adjusting the shape of the specific part through weighting.
[0033] Furthermore, the terminal device 1 can generate, as diagnostic information, information in which the three-dimensional shape measured in step S3 is highlighted in accordance with the displacement of a specific portion from a reference shape.
[0034] The terminal device 1 can also generate information indicating a comparison result between the displacement from the reference shape at the specific part and a threshold value as diagnostic information. In this case, the displacement compared with the threshold value is the average displacement from the reference shape at the specific part, but may also be the median of the displacement from the reference shape at the specific part, the maximum of the displacement from the reference shape at the specific part, or the displacement of each part from the reference shape at the specific part.
[0035] The specific parts described above are parts where lymphedema occurs, and are, for example, but not limited to, the arms, hands, legs, and feet of the user U. Note that both arms, both hands, both feet, and both legs of the user U are each an example of a pair of left and right parts of the user U.
[0036] The terminal device 1 can also calculate the volume of a specific part of the user U based on the three-dimensional shape measured in step S3, and generate information on the calculated volume as diagnostic information. For example, the terminal device 1 can generate information on a change in the volume of a specific part of the user U as diagnostic information. The information on the change in volume is information indicating a change in volume from a reference shape (e.g., the amount of change), information showing the change in volume in a graph, etc., but is not limited to such examples.
[0037] Furthermore, the terminal device 1 can also generate information on the difference in three-dimensional shape between a pair of left and right parts as diagnostic information based on the three-dimensional shape measured in step S3, for example. The information on the difference in three-dimensional shape between a pair of left and right parts is, for example, information expressing the difference in three-dimensional shape between a pair of left and right parts in three dimensions, information showing the difference in three-dimensional shape between a pair of left and right parts as a difference in thickness, information showing the difference in three-dimensional shape between a pair of left and right parts as a difference in volume, etc., but is not limited to such examples.
[0038] In the above example, a body suit was used as an example of the measurement wearable item 2, but this is not limited to such an example. If the user U has undergone treatment for breast cancer, the measurement wearable item may be an upper body wearable item, and if the user U has undergone treatment for uterine cancer, the measurement wearable item may be a lower body wearable item.
[0039] The treatment may be, for example, surgery or radiation therapy, but is not limited to these examples. The upper body wear item and the lower body wear item may be, for example, the top part (upper body part) and the leggings part (lower body part) of the above-mentioned body suit, which are wear items that can be connected to and separated from each other, but are not limited to these examples.
[0040] Next, the terminal device 1 transmits the diagnostic information generated in step S4 to the information providing device 5 (step S5). Upon receiving the diagnostic information transmitted from the terminal device 1, the information providing device 5 stores the received diagnostic information in an internal storage unit and transmits the received diagnostic information to the hospital device 3, thereby providing the diagnostic information to a medical worker M of the hospital who examines the user U (step S6).
[0041] When the hospital device 3 receives the diagnostic information transmitted from the information providing device 5, it displays the received diagnostic information (step S7). This allows a medical staff M at the hospital who examines the user U to easily diagnose the occurrence and progression of lymphedema in the user U.
[0042] Instead of or in addition to transmitting the diagnostic information generated in step S4 to the information providing device 5, the terminal device 1 can also transmit the diagnostic information generated in step S4 to the hospital device 3.
[0043] The terminal device 1 can also receive input of the treatment content performed on the user U and select the above-mentioned specific body parts based on the received treatment content. For example, if the received treatment content is treatment for breast cancer, the terminal device 1 selects the arms and hands as the specific body parts, and if the received treatment content is treatment for uterine cancer, the terminal device 1 selects the legs and feet as the specific body parts. The terminal device 1 can generate, for example, information in which the selected specific body parts are weighted as diagnostic information.
[0044] In this manner, the terminal device 1 obtains image information of the measurement garment 2 worn by the user U, measures the three-dimensional shape of an area including a specific part of the user U based on the image information, generates diagnostic information to be used in medical treatment for lymphedema of the user U based on the measured three-dimensional shape, and provides the generated diagnostic information. In this way, the terminal device 1, as an example of an information processing device, can support monitoring for lymphedema.
[0045] The information providing device 5 can also perform some of the above-mentioned functions of the terminal device 1. In this case, an information processing device is configured by the terminal device 1 and the information providing device 5. The information providing device 5 can also execute the processes of steps S2 to S4, and in this case, the information providing device 5 is an example of an information processing device.
[0046] The configuration of the information processing system 100 including the terminal device 1 performing such processing, the wearable item for measurement 2, the hospital device 3, and the information providing device 5 will be described in detail below.
[0047] 2. Configuration of Information Processing System 100 Fig. 2 is a diagram showing an example of the configuration of the information processing system 100 according to the embodiment. As shown in Fig. 2, the information processing system 100 according to the embodiment includes a plurality of terminal devices 1, a plurality of wearable items for measurement 2, a hospital device 3, and an information providing device 5.
[0048] The multiple terminal devices 1 are used by different users U. Each terminal device 1 is, for example, but not limited to, a smartphone, a tablet PC, a notebook PC, a desktop PC, etc. The hospital device 3 is, for example, but not limited to, a server, a notebook PC, a desktop PC, etc.
[0049] The terminal device 1, the hospital device 3, and the information providing device 5 are connected to each other via a network N so as to be able to communicate with each other by wire or wirelessly. Note that the information processing system 100 shown in FIG. 2 may include a plurality of the hospital devices 3 and the information providing devices 5.
[0050] The network N includes, for example, a Wide Area Network (WAN) such as the Internet and mobile communication networks such as Long Term Evolution (LTE), 4G (4th Generation), and 5G (5th Generation: 5th generation mobile communication system).
[0051] Each terminal device 1 and hospital device 3 can connect to the network N and communicate with the information providing device 5 via short-range wireless communication such as a mobile communication network, Bluetooth (registered trademark), or wireless LAN (Local Area Network).
[0052] 3. Configuration of Terminal Device 1 Fig. 3 is a diagram showing an example of the configuration of the terminal device 1 according to the embodiment. As shown in Fig. 3, the terminal device 1 includes a communication unit 10, a display unit 11, an input unit 12, an imaging unit 13, a sensor group 14, a storage unit 15, and a processing unit 16.
[0053] [3.1. Communication unit 10] The communication unit 10 is realized by, for example, a network interface card (NIC). The communication unit 10 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the information providing device 5 via the network N. The communication unit 10 can also transmit and receive information to and from the hospital device 3 via the network N.
[0054] [3.2. Display section 11] The display unit 11 is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display.
[0055] [3.3. Input section 12] The input unit 12 includes, for example, a keyboard including keys for inputting letters, numbers, and spaces, an enter key, arrow keys, etc., a mouse, a power button, etc. When the display unit 11 is a touch panel compatible display, the input unit 12 includes a touch panel.
[0056] [3.4. Imaging unit 13] The imaging unit 13 is an image sensor (camera) that captures an image of a subject. For example, the imaging unit 13 is a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge-Coupled Device) image sensor. The imaging unit 13 is not limited to a built-in camera, and may be an external camera such as a wireless camera or a Web camera that can communicate with the communication unit 10.
[0057] [3.5. Sensor Group 14] The sensor group 14 includes, for example, a positioning sensor, a microphone, an acceleration sensor, and a gyro sensor. The positioning sensor is a position sensor that detects the position of the terminal device 1. The microphone is a sensor that detects sounds around the terminal device 1. The acceleration sensor is a sensor that detects the acceleration of the terminal device 1. The gyro sensor is a sensor that detects the attitude, such as the tilt and rotation, of the terminal device 1.
[0058] [3.6. Storage section 15] The storage unit 15 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.
[0059] The storage unit 15 stores, for example, information transmitted from the information providing device 5 and acquired by the processing unit 16 via the network N and the communication unit 10, detection information which is information detected by the sensor group 14, and the like.
[0060] [3.7. Processing section 16] The processing unit 16 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs stored in a storage device inside the terminal device 1 using the RAM as a working area.
[0061] Processing unit 16 may be realized in part or in whole by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). A lymphedema monitor application is installed in processing unit 16 as a dedicated application program that runs on an OS (Operating System). As a result, processing unit 16 functions as a functional unit including a reception unit 20, an acquisition unit 21, a selection unit 22, a measurement unit 23, a generation unit 24, and a provision unit 25.
[0062] [3.7.1. Reception unit 20] The reception unit 20 receives various inputs from the user U. The inputs by the user U are performed, for example, by the user U operating the input unit 12. For example, the reception unit 20 receives an input of the details of the treatment performed on the user U.
[0063] The treatment contents are, for example, but not limited to, information specifying breast cancer treatment, information specifying uterine cancer treatment, information specifying prostate cancer treatment, information specifying bladder cancer treatment, etc. In addition, the reception unit 20 can also receive the designation of the specific site described above.
[0064] The reception unit 20 can also receive various types of input information transmitted from the information providing device 5. For example, the reception unit 20 can also receive input of the contents of the treatment performed on the user U by receiving treatment content information transmitted from the information providing device 5 as input information.
[0065] The reception unit 20 can also receive the designation of a specific body part by receiving, as input information, designation information transmitted from the information providing device 5 or designation information input by the user U through an operation on the input unit 12. The designation information includes information that identifies the designated specific body part. For example, when the information providing device 5 receives specific body part information transmitted from the hospital device 3, it can transmit, to the terminal device 1, designation information corresponding to the specific body part information.
[0066] [3.7.2. Acquisition part 21] The acquisition unit 21 acquires various types of information. For example, the acquisition unit 21 acquires various types of information from the storage unit 15. The acquisition unit 21 also acquires information detected by the sensor group 14, and stores the acquired information in the storage unit 15.
[0067] In addition, the acquisition unit 21 acquires information on the image captured by the imaging unit 13, and stores the acquired image information in the storage unit 15. For example, the acquisition unit 21 acquires information on a measurement image, which is an image of the measurement garment 2 worn by the user U, from the imaging unit 13, and stores the acquired measurement image information in the storage unit 15.
[0068] The acquisition unit 21 acquires an image obtained by scanning the entire body of the user U wearing the measurement wearable product 2 from the imaging unit 13 as information on the measurement image, but is not limited to this example. For example, the acquisition unit 21 can also acquire an image obtained by scanning a part of an area including a specific part of the user U wearing the measurement wearable product 2 from the imaging unit 13 as information on the measurement image.
[0069] The measurement images include, but are not limited to, a plurality of still images obtained by capturing images of the user U wearing the measurement wearable item 2 from various viewing angles (including the angle of view) by the imaging unit 13. For example, the measurement images may be moving images captured continuously from various viewing angles (including the angle of view) of the user U wearing the measurement wearable item 2.
[0070] Before starting to scan the user U's body by imaging, the acquisition unit 21 can confirm from the image captured by the imaging unit 13 that the user U is wearing the measurement garment 2 correctly, and can provide tutorials, design drawings, interactive checks, and audio guidance to guide the user U to an optimal standing position.
[0071] Then, for example, in a "default" mode for scanning the body of the user U, the acquisition unit 21 guides the user U, who is standing in front of the imaging unit 13 (e.g., rear camera) of the terminal device 1 placed on a cardboard stand placed on a flat desk, to rotate his / her body at various angles. The guidance is audio guidance by audio output, but may also be guidance using a screen display or an optical device of the terminal device 1.
[0072] The user U maintains a consistent body pose throughout the scan and remains still while each image is taken by the imaging unit 13. For example, the acquisition unit 21 can acquire information on the measurement images by controlling the imaging unit 13 to cause the imaging unit 13 to take a predetermined number or more images from various angles.
[0073] [3.7.3. Selection unit 22] The selection unit 22 selects a specific site based on the treatment details input by the reception unit 20.
[0074] For example, when the treatment content inputted and accepted by the accepting unit 20 is treatment for breast cancer, the selecting unit 22 selects the arms or hands as the specific body parts. When the treatment content inputted and accepted by the accepting unit 20 is treatment for uterine cancer, the selecting unit 22 selects the legs or feet as the specific body parts. The selecting unit 22 can also select the compression garment for the specific body parts selected as the compression garment for lymphedema treatment to be worn by the user U.
[0075] Furthermore, the selection unit 22 selects the compression garment corresponding to the diagnostic information as the compression garment for lymphedema treatment to be worn by the user U. The compression garment for lymphedema treatment is, for example, an elastic compression garment or a compression suit, but is not limited to such examples.
[0076] For example, when the diagnostic information is information indicating a three-dimensional shape measured by the measurement unit 23, the selection unit 22 selects elastic clothing in accordance with the three-dimensional shape measured by the measurement unit 23. This allows the selection unit 22 to select elastic clothing that fits the current size of the user U.
[0077] Furthermore, when the diagnostic information is information indicating the result of adjusting the three-dimensional shape by weighting a specific part of the three-dimensional shape measured by the measurement unit 23, the selection unit 22 selects the elastic garment corresponding to the adjusted three-dimensional shape. This enables the selection unit 22 to select elastic garment of a size slightly larger than the current size of the user U.
[0078] [3.7.4. Measurement unit 23] The measurement unit 23 measures the three-dimensional shape of a region including a specific part of the user U based on information of the measurement image, which is information of the image acquired by the acquisition unit 21.
[0079] Based on the information of the measurement image acquired by the acquisition unit 21, the measurement unit 23 measures the three-dimensional shape of an area including a specific part of the user U by analyzing the relative positions of dots, which are measurement markers that expand and contract together with the measurement wearable item 2.
[0080] For example, the measurement unit 23 analyzes the relative positions of the dots that expand and contract together with the measurement wearable item 2 based on the information of the measurement image acquired by the acquisition unit 21, and forms clusters of dots. Then, the measurement unit 23 assigns numbers to the clusters and dots, acquires the assigned numbers, sets them at predetermined coordinate positions, and identifies a silhouette (contour). The measurement unit 23 generates data on the three-dimensional shape of the user U's body based on the identified silhouette.
[0081] Fig. 4 is a diagram showing an example of a wearable product 2 for measurement according to an embodiment. In the wearable product 2 for measurement shown in Fig. 4, dots M1 and M2 and a reference marker RM are recognized. Here, the dot M1 is a "solid" dot, and the dot M2 is a "hollow" dot. The reference marker RM is at least larger in size than the dots M1 and M2.
[0082] A plurality of reference markers RM are arranged on the wearable product for measurement 2. For example, the wearable product for measurement 2 has a total of five reference markers RM: one at the center of the chest, two around the shoulder blades on the back (one on the right side and one on the left side), and two on the outsides of both knees (one on the right leg side and one on the left leg side). The material used for the reference markers RM is non-stretchable plastic.
[0083] The measurement unit 23 detects small circular / elliptical "blobs" that may be dots M1 and M2 of the measurement garment 2 from the captured measurement image, and classifies the detected dots as either "solid," "hollow," or "unknown."
[0084] Next, the measurement unit 23 analyzes the relative positions of the detected dots to form "clusters" of dots that fit an expected honeycomb (regular hexagonal) pattern. For example, the measurement unit 23 creates hexagonal clusters from the dot pattern, and then multiplies the hexagonal clusters to create a unique honeycomb structure.
[0085] The measurement unit 23 then checks whether the formed clusters match, taking into account rotational symmetry, the known pseudo-random pattern used to print the dots on the measurement garment 2. Some clusters are rejected at this stage because they are too small to obtain a match or contain invalid dots and cannot be recognized.
[0086] Next, the measurement unit 23 assigns a numerical identifier, which is a unique number for identifying each dot on the measurement wearable item 2, to each of the formed clusters. Then, the measurement unit 23 determines a size pattern based on the analysis of the honeycomb structure, and applies a measurement algorithm corresponding to the determined size pattern from among the measurement algorithms for each size pattern.
[0087] Next, the measurement unit 23 identifies a silhouette of the body shape of the user U wearing the measurement wear 2 based on the applied measurement algorithm. For example, the measurement unit 23 obtains, as input data, a set of pixel coordinates of each detected dot and a corresponding numerical identifier.
[0088] Next, the measurement unit 23 inputs the acquired input data into the 3D fitting algorithm as data required for fitting the 3D body model. The measurement unit 23 processes each photo based on the algorithm used in addition to the position of the dots to identify the silhouette of the person in the image. Then, the measurement unit 23 generates a 3D body model, which is information (data) of a three-dimensional shape, based on the identified silhouette.
[0089] The method of measuring the three-dimensional shape of the body of the user U by the measurement unit 23 is not limited to the above example. For example, the measurement unit 23 can obtain information on the three-dimensional shape from information on the measurement image acquired by the acquisition unit 21 using a model trained using learning information including a plurality of combinations of information on the measurement image and information on the three-dimensional shape.
[0090] Such models include, for example, Convolutional Neural Networks (CNN), Convolutional Neural Networks-Generative Adversarial Networks (CNN-GAN), etc., but are not limited to such examples.
[0091] 5 is a diagram showing an example of the measurement results for lymphedema patients by the measurement unit 23 of the terminal device 1, which is an example of an information processing device according to the embodiment. The example shown in FIG. 5 shows the results of measurements taken three times for 11 upper limb lymphedema patients and 15 lower limb lymphedema patients using the terminal device 1 of the embodiment. From the results of measurements using the terminal device 1 of the embodiment, the circumferences of the locations that were previously measured using a tape measure were calculated. Regarding the accuracy of repeated measurements, the average error at all measurement points for the upper limb and lower limb lymphedema patients was less than 10 mm, and the range was 2.9 mm to 9.2 mm (see (A) of FIG. 5).
[0092] Comparing the mean absolute error between manual measurement and measurement by this embodiment, the error was 20.9 mm and 22.9 mm at the measurement points of the thigh base and right wrist, respectively, but was less than 20 mm at other measurement points (see FIG. 5B). This result shows that the terminal device 1 of this embodiment can obtain results that are comparable in accuracy to measurements using a conventional tape measure. Furthermore, the measurement time was significantly shorter for the group measured by this embodiment compared to the group measured by a tape measure (86 seconds vs. 235 seconds, p<0.001). This shows that accurate measurement results can be obtained in a short time by using the terminal device 1 of this embodiment.
[0093] [3.7.5. Generation unit 24] The generating unit 24 generates diagnostic information, which is information used in medical treatment for lymphedema of the user U, based on the three-dimensional shape measured by the measuring unit 23.
[0094] For example, the generating unit 24 can generate, as diagnostic information, a result of adjusting a three-dimensional shape by weighting a specific portion of the three-dimensional shape measured by the measuring unit 23, or information based on the result.
[0095] The specific part to which weighting is applied is a specific part selected by the selection unit 22 or a specific part specified by the reception unit 20, but is not limited to such examples and may be, for example, a predetermined part or a part that has previously been displaced in the three-dimensional shape of the user U's body.
[0096] The weighting of the specific part is, for example, weighting of the displacement of the specific part from the reference shape. The generating unit 24 detects the displacement of the three-dimensional shape measured by the measuring unit 23 from the reference shape, and weights the specific part by multiplying the displacement of the specific part among the detected displacements by a weight exceeding 1 or adding a weight according to the displacement. This allows the generating unit 24 to generate a three-dimensional shape in which the displacement of the specific part is exaggerated.
[0097] The reference shape is, for example, the three-dimensional shape of the user U when the user U is in a normal state, the three-dimensional shape of the user U previously measured by the measuring unit 23, or a standard shape, but is not limited to such examples.
[0098] The three-dimensional shape of user U when user U is in a normal state is, for example, a three-dimensional shape obtained from an image of the measurement garment 2 being worn by user U in a state in which lymphedema is not occurring (for example, before cancer surgery or treatment), and is the three-dimensional shape of user U's body measured by the measurement unit 23 in the past (before the last time).
[0099] The standard shape is a three-dimensional shape represented by a body type model in which the shape of a part other than the specific part is similar to the three-dimensional shape of the user U, and is obtained from the measured three-dimensional shapes of multiple users U. Based on the three-dimensional shape measured by the measurement unit 23, the generation unit 24 can select a body type model in which the shape of a part other than the specific part is similar from among multiple types of body type models.
[0100] The generating unit 24 can generate, as diagnostic information, information indicating a three-dimensional shape obtained by adjusting the shape of a specific part by weighting, or information indicating the shape of a specific part extracted from the three-dimensional shape obtained by adjusting the shape of a specific part by weighting. The generating unit 24 can also generate, as diagnostic information, a numerical value indicating a difference from a reference shape (e.g., thickness, volume, or changes therein) using the information indicating the adjusted three-dimensional shape or the information indicating the extracted shape of a specific part.
[0101] Furthermore, the generating unit 24 can generate, as diagnostic information, information in which a specific portion of the three-dimensional shape measured by the measuring unit 23 is highlighted according to its displacement from a reference shape. For example, the generating unit 24 can highlight the specific portion in a darker color as the displacement from the reference shape increases.
[0102] The generating unit 24 can also generate information indicating the comparison result between the displacement from the reference shape in the specific part and the threshold value as diagnostic information. In this case, the displacement compared with the threshold value is the average displacement from the reference shape in the specific part, but may be the median of the displacement from the reference shape in the specific part, the maximum of the displacement from the reference shape in the specific part, or the displacement of each part from the reference shape in the specific part.
[0103] The generating unit 24 can also calculate the volume of a specific part of the user U based on the three-dimensional shape measured by the measuring unit 23, and generate information on the calculated volume as diagnostic information. For example, the generating unit 24 can generate information on a change in the volume of a specific part of the user U as diagnostic information. The information on the change in volume is information indicating a change in volume from a reference shape (for example, the amount of change), information showing the change in volume in a graph, etc., but is not limited to such examples.
[0104] Furthermore, the generating unit 24 can also generate, as diagnostic information, information relating to the difference in three-dimensional shape between a pair of left and right regions, based on the three-dimensional shape measured by the measuring unit 23. The information relating to the difference in three-dimensional shape between a pair of left and right regions is, for example, information expressing the difference in three-dimensional shape between a pair of left and right regions in three dimensions, information showing the difference in three-dimensional shape between a pair of left and right regions by a difference in thickness, information showing the difference in three-dimensional shape between a pair of left and right regions by a difference in volume, and the like, but is not limited to such examples.
[0105] When the user U has undergone treatment for breast cancer, the generation unit 24 can generate, as diagnostic information, for example, information regarding the difference in three-dimensional shape between the right arm and the left arm of the user U or information regarding the difference in three-dimensional shape between the right hand and the left hand of the user U. When the user U has undergone treatment for uterine cancer, the generation unit 24 can generate, as diagnostic information, information regarding the difference in three-dimensional shape between the right leg and the left leg of the user U or information regarding the difference in three-dimensional shape between the right foot and the left foot of the user U.
[0106] The generation unit 24 includes a detection processing unit 30, an adjustment processing unit 31, and a generation processing unit 32. Below, the processes of the detection processing unit 30, the adjustment processing unit 31, and the generation processing unit 32 will be specifically described.
[0107] 3.7.5.1. Detection Processing Unit 30 The detection processing unit 30 detects the displacement of the three-dimensional shape measured by the measurement unit 23 from a reference shape.
[0108] The displacement detected by the detection processing unit 30 is the average displacement from the reference shape in the three-dimensional shape measured by the measurement unit 23, but it may also be the median of the displacement from the reference shape in the three-dimensional shape, the maximum of the displacement from the reference shape in the three-dimensional shape, or the three-dimensional displacement which is the displacement of each part in the three-dimensional shape from the reference shape.
[0109] In addition, the displacement detected by the detection processing unit 30 is not limited to the displacement of the entire three-dimensional shape measured by the measurement unit 23, but may also be the displacement from a reference shape at a specific portion of the three-dimensional shape measured by the measurement unit 23.
[0110] [3.7.5.2. Adjustment Processing Unit 31] The adjustment processing unit 31 sets the threshold value TH for the specific body part to be larger than the threshold value TH for the body part other than the specific body part. For example, when the specific body part is an arm or a hand, the body part other than the specific body part includes the trunk, the legs, the feet, etc., and when the specific body part is a leg or a foot, the body part other than the specific body part includes the trunk, the arms, the hands, etc., but is not limited to such an example. In addition, the threshold value TH for the body part other than the specific body part is, for example, 1, but may be a value less than 1 or may be a value greater than 1.
[0111] Furthermore, the adjustment processing unit 31 can adjust the weights used for weighting the specific parts. For example, the adjustment processing unit 31 can set the weights according to the positions of the specific parts, and can set different weights for the specific parts of the arms, the hands, the legs, and the feet.
[0112] The adjustment processing unit 31 can also set a threshold value TH or weight according to the degree of increase in the displacement. For example, the adjustment processing unit 31 can set a larger threshold value TH or weight as the degree of increase in the displacement increases. The degree of increase in the displacement is, for example, the degree of increase in the volume of a specific part, but may also be the degree of increase in the average displacement, the degree of increase in the median value of the displacement, or the degree of increase in the maximum value of the displacement.
[0113] [3.7.5.3. Generation Processing Unit 32] The generation processing unit 32 generates diagnostic information, which is information used in medical treatment for the user U's lymphedema, based on the three-dimensional shape measured by the measurement unit 23.
[0114] The generation processing unit 32 can generate, as diagnostic information, a result of adjusting the three-dimensional shape by weighting a specific portion of the three-dimensional shape measured by the measurement unit 23, or information based on the result. For example, the generation processing unit 32 can generate, as diagnostic information, a result of adjusting the three-dimensional shape by weighting the displacement detected by the detection processing unit 30, or information based on the result.
[0115] The generation processing unit 32 can generate, as diagnostic information, information indicating a three-dimensional shape of a specific part obtained by adjusting the shape of the specific part through weighting, or generate, as diagnostic information, information indicating the shape of a specific part extracted from the three-dimensional shape of a specific part obtained by adjusting the shape of the specific part through weighting.
[0116] The generation processing unit 32 can also generate, as diagnostic information, information in which a specific portion of the three-dimensional shape measured by the measurement unit 23 is highlighted in accordance with the displacement of the specific portion detected by the detection processing unit 30. For example, the generation processing unit 32 can highlight the specific portion in a darker color as the displacement from the reference shape increases.
[0117] The generation processing unit 32 can also generate information indicating a comparison result between the displacement detected by the detection processing unit 30 and a threshold value TH as diagnostic information. For example, when the displacement detected by the detection processing unit 30 is equal to or greater than the threshold value TH, the generation processing unit 32 generates information indicating that the displacement detected by the detection processing unit 30 is equal to or greater than the threshold value TH as diagnostic information. Note that the threshold value TH is not limited to one, and may include, for example, multiple threshold values according to the degree of progression of lymphedema.
[0118] Furthermore, the generation processing unit 32 can also calculate the volume of a specific part of the user U based on the three-dimensional shape measured by the measurement unit 23, for example, and generate information about the calculated volume as diagnostic information.
[0119] Furthermore, the generation processing unit 32 can also generate, for example, information on the difference in three-dimensional shapes between a pair of left and right regions based on the three-dimensional shapes measured by the measurement unit 23 as diagnostic information.
[0120] [3.7.6.Providing Department 25] The providing unit 25 provides various kinds of information. The providing unit 25 can provide various kinds of information to the user U by displaying the various kinds of information on the display unit 11.
[0121] Moreover, the providing unit 25 can provide various pieces of information to the operator of the information providing device 5 by transmitting various pieces of information to the information providing device 5 via the communication unit 10. Moreover, the providing unit 25 can provide various pieces of information to a medical worker M of the hospital who examines the user U, by transmitting various pieces of information to the hospital device 3 via the communication unit 10.
[0122] For example, the providing unit 25 provides the diagnostic information generated by the generating unit 24. For example, the providing unit 25 provides the diagnostic information to the information providing device 5 by transmitting the diagnostic information generated by the generating unit 24 to the information providing device 5 via the communication unit 10.
[0123] When the information providing device 5 receives the diagnostic information transmitted from the providing unit 25, it stores the received diagnostic information in an internal memory unit and transmits the received diagnostic information to the hospital device 3, thereby providing the diagnostic information to medical staff M at the hospital who examines the user U, etc.
[0124] Moreover, instead of or in addition to transmitting the diagnostic information generated by the generation unit 24 to the information providing device 5, the providing unit 25 can also transmit the diagnostic information generated by the generation unit 24 to the hospital device 3. The providing unit 25 can also provide the diagnostic information to the user U by causing the display unit 11 to display the diagnostic information generated by the generation unit 24.
[0125] Furthermore, the providing unit 25 can provide the diagnostic information generated by the generating unit 24 to the information providing device 5, the medical staff M, the user U, etc., every time the measuring unit 23 measures the three-dimensional shape.
[0126] The providing unit 25 also provides selected elastic clothing information, which is information on the elastic clothing selected by the selecting unit 22. For example, the providing unit 25 provides the selected elastic clothing information to the user U, the information providing device 5, or the medical staff M by displaying the selected elastic clothing information on the display unit 11 or transmitting it to the information providing device 5 or the hospital device 3.
[0127] Fig. 6 is a diagram showing an example of diagnostic information displayed on the hospital device 3 according to the embodiment. The diagnostic information 50 shown in Fig. 6 is information in which a reference shape 51 and a three-dimensional shape 52 of a user U are superimposed on each other, and this allows a medical worker M to easily grasp the difference between the reference shape 51 and the three-dimensional shape 52.
[0128] 6, volume information showing the volume of a pair of arms and the difference therebetween, the volume of a pair of legs and the difference therebetween for each date, and difference information showing the difference between the pair of arms for each date may be displayed as diagnostic information. This allows the medical staff M to easily grasp the displacement of each part of the user U.
[0129] 4. Processing Procedure Next, a procedure of information processing by the processing unit 16 of the terminal device 1 according to the embodiment will be described. Fig. 7 is a flowchart showing an example of information processing by the processing unit 16 of the terminal device 1 according to the embodiment.
[0130] 7, the processing unit 16 determines whether or not the treatment content information transmitted from the information providing device 5 has been accepted as input information (step S10). When the processing unit 16 determines that the treatment content information has been accepted (step S10: Yes), the processing unit 16 selects a specific site based on the treatment content indicated by the treatment content information (step S11).
[0131] When the processing of step S11 is completed or when it is determined that the treatment content information has not been received (step S10: No), the processing unit 16 determines whether or not it is time to measure (step S12). The measurement timing is, for example, the timing when the user U performs a specific operation on the input unit 12, but may be a timing that arrives at a predetermined cycle.
[0132] When the processing unit 16 determines that it is time to measure (step S12: Yes), it acquires information about the measurement image obtained by imaging by the imaging unit 13 (step S13). Then, the processing unit 16 measures the three-dimensional shape of the area including the specific part of the user U based on the information about the measurement image acquired in step S13 (step S14).
[0133] Next, the processing unit 16 generates diagnostic information, which is information used in medical treatment for lymphedema of the user U, based on the three-dimensional shape measured in step S14 (step S15). Then, the processing unit 16 provides the diagnostic information generated in step S16 (step S16).
[0134] When the process of step S16 is completed or when it is determined that the measurement timing has not come (step S12: No), the processing unit 16 determines whether or not the operation end timing has come (step S17). The processing unit 16 determines that the operation end timing has come when, for example, the power supply of the terminal device 1 is turned off.
[0135] If the processing unit 16 determines that the operation end time has not yet arrived (step S17: No), it transitions to step S10, and if the processing unit 16 determines that the operation end time has arrived (step S17: Yes), it terminates the processing shown in FIG. 7.
[0136] 5. Modifications As described above, the information providing device 5 can execute some of the functions of the terminal device 1. For example, the information providing device 5 can execute some or all of the functions of the reception unit 20, the acquisition unit 21, the selection unit 22, the measurement unit 23, the generation unit 24, and the provision unit 25 described above.
[0137] Furthermore, the generating unit 24 calculates the volume of a specific part of the user U, but this volume may be the volume of a part of the specific part that is displaced or the change therein.
[0138] Furthermore, the providing unit 25 determines whether it is time to capture an image for measurement by the imaging unit 13 based on the rate of increase in displacement from a reference shape in a specific part, and when it is determined that it is time to capture an image, it can display that fact on the display unit 11 or output that fact by sound. The greater the rate of increase in displacement, the shorter the interval at which the providing unit 25 determines that it is time to capture an image.
[0139] The providing unit 25 can also provide various types of information detected by the sensor group 14 by including them in the diagnostic information. The information detected by the sensor group 14 is, for example, information indicating the movement history of the user U (e.g., a history of movement distance, movement route, etc.), information indicating the action history of the user U (e.g., a history of actions such as walking, jumping, and gymnastics), information indicating the history of sounds around the user U, and the like, but is not limited to such examples.
[0140] [6. Hardware Configuration] The terminal device 1 according to the embodiment described above is realized by a computer 80 having a configuration as shown in Fig. 8. Fig. 8 is a hardware configuration diagram showing an example of the computer 80 that realizes the functions of the terminal device 1 according to the embodiment. The computer 80 has a CPU 81, a RAM 82, a ROM (Read Only Memory) 83, an HDD (Hard Disk Drive) 84, a communication interface (I / F) 85, an input / output interface (I / F) 86, and a media interface (I / F) 87.
[0141] The CPU 81 operates and controls each part based on a program stored in the ROM 83 or the HDD 84. The ROM 83 stores a boot program executed by the CPU 81 when the computer 80 is started up, and programs that depend on the hardware of the computer 80.
[0142] The HDD 84 stores programs executed by the CPU 81, data used by such programs, etc. The communication interface 85 receives data from other devices via the network N (see FIG. 2) and sends it to the CPU 81, and transmits data generated by the CPU 81 to other devices via the network N.
[0143] The CPU 81 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 86. The CPU 81 acquires data from the input devices via the input / output interface 86. The CPU 81 also outputs data generated via the input / output interface 86 to the output devices.
[0144] The media interface 87 reads a program or data stored in a recording medium 88 and provides it to the CPU 81 via the RAM 82. The CPU 81 loads the program from the recording medium 88 onto the RAM 82 via the media interface 87 and executes the loaded program. The recording medium 88 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.
[0145] The CPU 81 of the computer 80 executes the programs loaded onto the RAM 82 to realize the functions of the processing unit 16. In addition, the data in the storage unit 15 is stored in the HDD 84. The CPU 81 of the computer 80 reads and executes these programs from a recording medium 88, but as another example, these programs may be obtained from another device via the network N.
[0146] [7. Other] In addition, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.
[0147] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.
[0148] For example, the above-mentioned terminal device 1 may be realized by a terminal device and a server computer, or by multiple server computers. Also, depending on the functions, the configuration can be flexibly changed, such as by calling an external platform using an API or network computing.
[0149] Furthermore, the above-described embodiments and modifications can be appropriately combined as long as the processing contents are not contradictory.
[0150] 8. Effects, etc. As described above, the terminal device 1 according to the embodiment is an example of an information processing device, and includes an acquisition unit 21, a measurement unit 23, a generation unit 24, and a provision unit 25. The acquisition unit 21 acquires image information of the measurement wearable item 2 worn by the user U. The measurement unit 23 measures a three-dimensional shape of an area including a specific part of the user U based on the image information acquired by the acquisition unit 21. The generation unit 24 generates diagnostic information, which is information used in medical treatment for lymphedema of the user U, based on the three-dimensional shape measured by the measurement unit 23. The provision unit 25 provides the diagnostic information generated by the generation unit 24. This allows the terminal device 1 to support monitoring for lymphedema.
[0151] Furthermore, the generating unit 24 generates, as diagnostic information, a result of adjusting the three-dimensional shape by weighting a specific portion of the three-dimensional shape measured by the measuring unit 23 or information based on the result. This enables the terminal device 1 to more effectively support monitoring of lymphedema.
[0152] Furthermore, the generating unit 24 generates, as diagnostic information, information in which a specific portion of the three-dimensional shape measured by the measuring unit 23 is highlighted according to a displacement from a reference shape. This enables the terminal device 1 to more effectively support monitoring of lymphedema.
[0153] Moreover, the generating unit 24 includes a detection processing unit 30 that detects a displacement from a reference shape in the three-dimensional shape measured by the measuring unit 23, a generating processing unit 32 that generates information indicating a comparison result between the displacement detected by the detection processing unit 30 and a threshold value as diagnostic information, and an adjustment processing unit 31 that sets the threshold value for a specific part to be larger than the threshold value for parts other than the specific part. This enables the terminal device 1 to more effectively support monitoring of lymphedema.
[0154] The terminal device 1 also includes a reception unit 20 that receives input of the treatment content performed on the user U, and a selection unit 22 that selects a specific site based on the treatment content input received by the reception unit 20. This allows the terminal device 1 to more easily support monitoring of lymphedema.
[0155] Furthermore, the terminal device 1 includes a reception unit 20 that receives the designation of a specific part, which allows the terminal device 1 to more easily support monitoring of lymphedema.
[0156] The specific parts are a pair of left and right parts of the user U, and the generating unit 24 generates information on the difference in three-dimensional shape between the pair of left and right parts as diagnostic information. This enables the terminal device 1 to more effectively support monitoring of lymphedema.
[0157] Furthermore, the generating unit 24 generates information on the volume of the specific part as diagnostic information, which enables the terminal device 1 to more effectively support monitoring of lymphedema.
[0158] Furthermore, the generating unit 24 generates information on the change in the volume of the specific part as diagnostic information, which enables the terminal device 1 to more effectively support monitoring of lymphedema.
[0159] The measurement wearable item 2 is at least one of an upper body wearable item and a lower body wearable item that can be connected to each other. The measurement wearable item is measurement clothing.
[0160] The terminal device 1 also includes a selection unit 22 that selects compression garments according to the diagnostic information as compression garments for treating lymphedema to be worn by the user U. This allows the terminal device 1 to support measures for lymphedema.
[0161] Furthermore, the providing unit 25 provides the diagnostic information generated by the generating unit 24 every time the measuring unit 23 measures the three-dimensional shape. This allows the terminal device 1 to more effectively support monitoring of lymphedema.
[0162] Furthermore, the providing unit 25 provides the diagnostic information to an apparatus in a hospital that performs remote medical treatment for the user U. This allows the terminal device 1 to more effectively support monitoring of lymphedema.
[0163] The above describes the embodiment of the present application in detail based on the drawings, but this is merely an example, and the present invention can be implemented in other forms that include various modifications and improvements based on the knowledge of those skilled in the art, including the forms described in the Disclosure of the Invention section.
[0164] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit", etc. For example, an acquisition section can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]
[0165] 1 Terminal equipment 2. Wearable items for measurement 3 Hospital Equipment 5 Information provision device 10. Communications Department 11 Display section 12 Input section 13 Imaging unit 14 Sensor Group 15 Storage section 16 Processing section 20 Reception 21 Acquisition Department 22 Selection section 23 Measurement section 24 Generation part 25 Providing Department 30 Detection processing section 31 Adjustment processing section 32 Generation processing section 100 Information Processing Systems N Network
Claims
1. A receiving unit that receives information for selecting a specific part of a user to generate diagnostic information, which is information for the purpose of diagnosing lymphedema in the user; an acquisition unit that acquires information on an image of an article of wear that covers at least a specific part of the user and deforms to follow the specific part, selected in accordance with the information received by the reception unit while the user is wearing the article; a measurement unit that measures a three-dimensional shape of a region including the specific portion based on information of the image acquired by the acquisition unit; a generation unit that generates the diagnostic information based on the three-dimensional shape measured by the measurement unit; a providing unit that provides the diagnostic information generated by the generating unit.
23. An information processing apparatus comprising:
2. The generation unit is A result of adjusting the three-dimensional shape by weighting the specific portion of the three-dimensional shape measured by the measurement unit or information based on the result is generated as the diagnostic information.
2. The information processing apparatus according to claim 1,
3. The generation unit is generating, as the diagnostic information, information in which the three-dimensional shape measured by the measuring unit is highlighted in accordance with a displacement of the specific portion from a reference shape; 2. The information processing apparatus according to claim 1,
4. The generation unit is a detection processing unit that detects a displacement of the three-dimensional shape measured by the measurement unit from a reference shape; a generation processing unit that generates, as the diagnostic information, information indicating a comparison result between the displacement detected by the detection processing unit and a threshold value; an adjustment processing unit that sets the threshold value for the specific part to be larger than the threshold value for parts other than the specific part; 2. The information processing apparatus according to claim 1,
5. The reception unit, Accept the designation of the specific part 5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.
6. The specific site is A pair of left and right parts of the user, The generation unit is Information regarding a difference in three-dimensional shape between the pair of left and right regions is generated as the diagnostic information.
5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.
7. The generation unit is Generate information regarding the volume of the specific portion as the diagnostic information.
5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.
8. The generation unit is Generate information regarding the change in volume of the specific portion as the diagnostic information.
8. The information processing apparatus according to claim 7,
9. a selection unit for selecting an elastic garment for lymphedema treatment to be worn by the user in accordance with the diagnostic information; 5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.
10. The providing unit is The diagnostic information generated by the generating unit is provided every time the three-dimensional shape is measured by the measuring unit.
5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.
11. The providing unit is Providing the diagnostic information to a hospital device that performs remote medical treatment for the user 5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.
12. The wearable product is: It is a measurement garment.
5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.
13. 1. A computer-implemented information processing method, comprising: a receiving step of receiving information for selecting a specific site of the user for generating diagnostic information, which is information for the purpose of diagnosing lymphedema of the user; an acquisition step of acquiring information on an image of an article of wear that covers at least a specific part of the user and deforms to follow the specific part, selected in accordance with the information received by the reception step while the user is wearing the article; a measuring step of measuring a three-dimensional shape of a region including the specific portion based on information of the image acquired by the acquiring step; a generating step of generating the diagnostic information based on the three-dimensional shape measured in the measuring step; and providing the diagnostic information generated by the generating step.
23. An information processing method comprising:
14. A receiving step of receiving information for selecting a specific part of a user for generating diagnostic information, which is information for the purpose of diagnosing lymphedema in the user; an acquisition step of acquiring information on an image of an article of wear that covers at least a specific body part of the user and that deforms to follow the specific body part, selected in accordance with the information received in the reception step while the user is wearing the article; a measurement step of measuring a three-dimensional shape of a region including the specific portion based on information of the image acquired by the acquisition step; a generating step of generating the diagnostic information based on the three-dimensional shape measured by the measuring step; a providing step of providing the diagnostic information generated by the generating step, 2. An information processing program comprising:
Citation Information
Patent Citations
Lymphedema monitoring device
JP2017029487A
JPP7169489B
Methods and systems for identifying body part or body area anatomical landmarks from digital imagery for the fitting of compression garments for a person in need thereof
US11211162B1
System and Method For Object Detection Using Structured Light
US20150302594A1
System and Method for Measuring Edema at Home and Measurement Pattern for Use Therewith
US20220270241A1