Information processing device, information processing method, and information processing program
The information processing device addresses the complexity and expense of existing lymphedema monitoring technologies by using image acquisition and three-dimensional shape measurement to generate diagnostic information for lymphedema treatment, thereby enhancing monitoring efficacy and reducing costs.
Patent Information
- Application Number
- PCT/JP2024/033110
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-29
- Filing Date
- 2024-09-17
- Publication Date
- 2025-04-03
AI Technical Summary
Existing technologies for monitoring lymphedema, such as those described in Japanese Patent Application Laid-Open No. 2002-20043, are complex and expensive due to their reliance on measuring electrical properties between electrodes to infer lymphedema states.
An information processing device comprising an acquisition unit, a measurement unit, a generation unit, and a provision unit, which acquires image information of a user wearing specific measurement items, measures the three-dimensional shape of the user's affected area, generates diagnostic information for lymphedema treatment, and provides this information for medical use.
The solution supports effective monitoring of lymphedema by providing accurate three-dimensional shape measurements and diagnostic information, enhancing early detection and therapeutic outcomes while reducing the complexity and cost of device development.
Smart Images

Figure JP2024033110_03042025_PF_FP_ABST
Abstract
Description
Information processing device, information processing method, and information processing program
[0001] The present invention relates to an information processing device, an information processing method, and an information processing program.
[0002] Patients after cancer surgery or radiation therapy may develop lymphedema, a swelling caused by poor lymphatic flow and accumulation of lymph fluid. Primary lymphedema of unknown cause may also occur. Early detection of lymphedema can be treated with compression garments, etc. Early detection is important to improve the effectiveness of lymphedema treatment, and thus a device for monitoring lymphedema has been proposed (see, for example, Patent Document 1).
[0003] Japanese Patent Application Laid-Open No. 2017-029487
[0004] However, the technology described in Patent Document 1 measures electrical characteristics between multiple electrodes based on the amount of albumin and infers the state of lymphedema based on the measured electrical characteristics, and there is a risk that the device will become complicated and expensive in terms of development, manufacturing, etc.
[0005] The present application has been made in view of the above, and aims to provide an information processing device, an information processing method, and an information processing program that can support monitoring related to lymphedema.
[0006] The information processing device according to the present application includes an acquisition unit, a measurement unit, a generation unit, and a provision unit. The acquisition unit acquires image information of a measurement garment worn by a user. The measurement unit measures a three-dimensional shape of a region including a specific part of the user based on the image information acquired by the acquisition unit. The generation unit generates diagnostic information, which is information used in treating lymphedema of the user, based on the three-dimensional shape measured by the measurement unit. The provision unit provides the diagnostic information generated by the generation unit.
[0007] According to one aspect of the embodiment, it is possible to provide an effect of assisting in monitoring lymphedema.
[0008] FIG. 1 is a diagram showing an example of information processing according to the embodiment. FIG. 2 is a diagram showing an example of the configuration of an information processing system according to the embodiment. FIG. 3 is a diagram showing an example of the configuration of a terminal device according to the embodiment. FIG. 4 is a diagram showing an example of a measurement wearable item according to the embodiment. FIG. 5 is a diagram showing an example of measurement results for a lymphedema patient by a measurement unit of an information processing device according to the embodiment. FIG. 6 is a diagram showing an example of diagnostic information displayed on a hospital device according to the embodiment. FIG. 7 is a flowchart showing an example of information processing by a processing unit of a terminal device according to the embodiment. FIG. 8 is a hardware configuration diagram showing an example of a computer that realizes the functions of a terminal device according to the embodiment.
[0009] Hereinafter, a detailed description will be given of an information processing device, an information processing method, and an information processing program (hereinafter referred to as "embodiments") according to the present application, with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to these embodiments. Furthermore, the embodiments can be appropriately combined as long as the processing content is not contradictory. Furthermore, the same components in the following embodiments are denoted by the same reference numerals, and redundant explanations will be omitted.
[0010] 1. Example of Information Processing First, an example of information processing according to the embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of information processing according to the embodiment. Note that Fig. 1 shows an example of operation of an information processing system 100 including a terminal device 1 according to the embodiment.
[0011] As shown in Fig. 1 , an information processing system 100 according to an embodiment includes a terminal device 1, a wearable measurement item 2, a hospital device 3, and an information providing device 5. The terminal device 1 is an example of an information processing device. Note that, although only one terminal device 1, one wearable measurement item 2, and one hospital device 3 are shown in the example shown in Fig. 1 , the information processing system 100 includes multiple terminal devices 1 and multiple wearable measurement items 2.
[0012] The terminal device 1 is a terminal device operated by a user U, and is, for example, a smart device such as a smartphone or a tablet PC (Personal Computer). The terminal device 1 has an imaging unit, and can capture an image of the user U or the like using the imaging unit.
[0013] The measurement wearable item 2 is, for example, an item for measurement worn on the body of the user U, and is, for example, measurement clothing such as a body suit that covers the entire body (excluding the face and head) of the user U. The measurement wearable item 2 is, for example, composed of two parts: a top part (upper body part) and leggings part (lower body part) that are connectable and separable to each other.
[0014] The measurement wearable item 2 is, for example, a stretchy, tight-fitting bodysuit manufactured using standard low-cost clothing printing technology (e.g., digital dye-sublimation printing). In the example shown in Fig. 1, the measurement wearable item 2 has a dotted pattern that covers most of its surface, and the dots are arranged in a dense regular hexagonal pattern (honeycomb shape).
[0015] Each dot is either "solid" or "hollow" and is selected using a pseudo-random algorithm. Hollow dots are O-shaped (donut-shaped). For example, the measurement wearable item 2 is designed so that approximately the same number of solid and hollow dots are printed across the entire item. By analyzing the pattern of dots on any part of the measurement wearable item 2, it is possible to infer which part of the measurement wearable item 2 is being viewed.
[0016] Instead of circular dots, squares or hexagons can be used, or colors can be used to distinguish between two types of dots. Furthermore, the pattern on the surface of the wearable measurement item 2 is not limited to a pattern consisting of multiple dots, and any pattern other than dots may be used as long as it allows identification of which part of the wearable measurement item 2 it is. For example, the pattern on the surface of the wearable measurement item 2 may be a geometric pattern using other than dots, or any other pattern.
[0017] The wearable measurement item 2 may also be a measurement item dedicated to a specific body part, which will be described later. For example, if the specific body part is an arm or a leg, the wearable measurement item 2 may be a tube-shaped (e.g., supporter-shaped) wearable item that is stretchy, tight-fitting, and worn on the arm.
[0018] The hospital device 3 is a server device of a hospital that examines the user U or a terminal device used by a medical professional M at the hospital that examines the user U. The medical professional M is, for example, a doctor who examines the user U. The hospital device 3 is an example of a hospital device that provides remote medical care to the user U.
[0019] The information providing device 5 is an information processing device that cooperates with the terminal device 1 and the hospital device 3 to provide various types of information to the terminal device 1 of the user U and the hospital device 3, and is realized by a server device, a cloud system, etc. The information providing device 5 can transmit and receive various types of information to various applications installed in the terminal device 1 and the hospital device 3, for example, via an API (Application Programming Interface).
[0020] 1 , the information providing device 5 transmits a lymphedema monitoring application program to the terminal device 1, thereby providing the lymphedema monitoring application program to the terminal device 1 (step S1). Hereinafter, the lymphedema monitoring application program may be referred to as a lymphedema monitoring app.
[0021] For example, when the information providing device 5 receives an app transmission request from the terminal device 1, it provides a lymphedema monitor app to the terminal device 1. When the terminal device 1 receives the lymphedema monitor app from the information providing device 5, it installs the lymphedema monitor app received from the information providing device 5.
[0022] Next, the terminal device 1 captures an image of the measurement garment 2 worn by the user U, thereby acquiring information on the measurement image, which is an image of the measurement garment 2 worn by the user U (step S2). The user U launches the lymphedema monitor app installed on the terminal device 1 to cause the terminal device 1 to execute the process of step S2. The process of the terminal device 1 from step S2 onwards is executed on the terminal device 1 by the lymphedema monitor app.
[0023] The user U places the terminal device 1 on a stand or the like, and stands in front of the terminal device 1 while wearing the measurement garment 2, and slowly rotates his or her body to cause the terminal device 1 to capture a series of images. As a result, measurement images are captured by the terminal device 1.
[0024] The measurement images include, but are not limited to, a plurality of still images obtained by capturing images of the user U wearing the measurement garment 2 from various viewing angles (including the angle of view) using the camera function of the terminal device 1. For example, the measurement images may be moving images captured continuously from various viewing angles (including the angle of view) of the user U wearing the measurement garment 2.
[0025] Next, the terminal device 1 measures the three-dimensional shape of the area including the specific part of the user U based on the information of the measurement image acquired in step S2 (step S3). For example, the terminal device 1 detects each dot of the measurement garment 2 from the measurement image, and generates a 3D (Dimensions) model of the three-dimensional shape of the area including the specific part of the user U based on the detection results, thereby measuring the three-dimensional shape of the area including the specific part of the user U. A method for generating the 3D model is, for example, the method described in Japanese Patent No. 7169489, but is not limited to this example.
[0026] Next, the terminal device 1 generates diagnostic information, which is information used in medical treatment for lymphedema of the user U, based on the three-dimensional shape measured in step S3 (step S4).
[0027] The terminal device 1 can generate, as diagnostic information, the result of adjusting the three-dimensional shape by weighting specific parts of the three-dimensional shape measured in step S3 or information based on the result.
[0028] The weighting of the specific part is, for example, a weighting of the displacement of the specific part from the reference shape. The terminal device 1 detects the displacement of the 3D shape measured in step S3 from the reference shape, and weights the specific part by multiplying the displacement of the specific part among the detected displacements by a weight greater than 1. This allows the terminal device 1 to generate a 3D shape in which the displacement of the specific part is exaggerated.
[0029] The reference shape is, for example, the three-dimensional shape of user U when user U is in a normal state, the three-dimensional shape of user U last measured by the lymphedema monitor app, or a standard shape, but is not limited to such examples.
[0030] The three-dimensional shape of user U when user U is in a normal state is, for example, a three-dimensional shape obtained from an image of the measurement garment 2 being worn by user U in a state where lymphedema is not occurring, and is a three-dimensional shape obtained by the previous processing of steps S2 and S3.
[0031] The three-dimensional shape of user U previously measured by the lymphedema monitor app is the three-dimensional shape obtained in the previous processing of steps S2 and S3. The standard shape is a three-dimensional shape represented by a body model in which the shapes of parts other than the specific part are similar to the three-dimensional shape of user U, and is obtained from the measured three-dimensional shapes of multiple users U.
[0032] The terminal device 1 can generate, as diagnostic information, information indicating a three-dimensional shape in which the shape of a specific part has been adjusted by weighting, or can generate, as diagnostic information, information indicating the shape of a specific part extracted from the three-dimensional shape in which the shape of a specific part has been adjusted by weighting.
[0033] The terminal device 1 can also generate, as diagnostic information, information in which the three-dimensional shape measured in step S3 is highlighted in accordance with the displacement of a specific portion from the reference shape.
[0034] The terminal device 1 can also generate, as diagnostic information, information indicating the result of comparing the displacement of a specific part from a reference shape with a threshold value. In this case, the displacement compared with the threshold value is the average displacement from the reference shape of the specific part, but it may also be the median of the displacement from the reference shape of the specific part, the maximum of the displacement from the reference shape of the specific part, or the displacement of each part from the reference shape of the specific part.
[0035] The specific body parts described above are body parts where lymphedema occurs, and are, for example, but not limited to, the arms, hands, legs, and feet of the user U. Note that both arms, both hands, both feet, and both legs of the user U are each an example of a pair of left and right body parts of the user U.
[0036] The terminal device 1 can also calculate the volume of a specific part of the user U based on the three-dimensional shape measured in step S3, and generate information about the calculated volume as diagnostic information. For example, the terminal device 1 can generate information about a change in the volume of a specific part of the user U as diagnostic information. The information about the change in volume is information indicating a change in volume from a reference shape (e.g., the amount of change), information showing the change in volume in a graph, etc., but is not limited to these examples.
[0037] Furthermore, the terminal device 1 can also generate, as diagnostic information, information relating to the difference in three-dimensional shape between a pair of left and right regions, for example, based on the three-dimensional shapes measured in step S3. The information relating to the difference in three-dimensional shape between a pair of left and right regions is, for example, information that three-dimensionally represents the difference in three-dimensional shape between the pair of left and right regions, information that indicates the difference in three-dimensional shape between the pair of left and right regions by a difference in thickness, information that indicates the difference in three-dimensional shape between the pair of left and right regions by a difference in volume, etc., but is not limited to these examples.
[0038] In the above example, a body suit was used as an example of the measurement garment 2, but this is not limited to this example. If the user U has undergone treatment for breast cancer, the garment may be an upper body garment, and if the user U has undergone treatment for uterine cancer, the garment may be a lower body garment.
[0039] The treatment may be, for example, surgery or radiation therapy, but is not limited to these examples. The upper body wearable item and the lower body wearable item may be, for example, the top part (upper body part) and leggings part (lower body part) of the above-mentioned body suit, which are wearable items that can be connected to and separated from each other, but are not limited to these examples.
[0040] Next, the terminal device 1 transmits the diagnostic information generated in step S4 to the information providing device 5 (step S5). Upon receiving the diagnostic information transmitted from the terminal device 1, the information providing device 5 stores the received diagnostic information in an internal storage unit and transmits the received diagnostic information to the hospital device 3, thereby providing the diagnostic information to a medical professional M at the hospital who will examine the user U (step S6).
[0041] When the hospital device 3 receives the diagnostic information transmitted from the information providing device 5, it displays the received diagnostic information (step S7). This allows a medical professional M at the hospital who examines the user U to easily diagnose the occurrence and progression of lymphedema in the user U.
[0042] In addition, instead of or in addition to transmitting the diagnostic information generated in step S4 to the information providing device 5, the terminal device 1 can also transmit the diagnostic information generated in step S4 to the hospital device 3.
[0043] The terminal device 1 can also accept input of the treatment content performed on the user U and select the above-mentioned specific body parts based on the accepted treatment content. For example, if the accepted treatment content is treatment for breast cancer, the terminal device 1 selects the arms and hands as the specific body parts, and if the accepted treatment content is treatment for uterine cancer, the terminal device 1 selects the legs and feet as the specific body parts. The terminal device 1 can generate, for example, information in which the selected specific body parts are weighted as diagnostic information.
[0044] In this way, the terminal device 1 acquires image information of the measurement garment 2 being worn by the user U, measures the three-dimensional shape of an area including a specific part of the user U based on the image information, generates diagnostic information to be used in the treatment of lymphedema of the user U based on the measured three-dimensional shape, and provides the generated diagnostic information. In this way, the terminal device 1, as an example of an information processing device, can support monitoring of lymphedema.
[0045] The information providing device 5 can also perform some of the above-described functions of the terminal device 1. In this case, an information processing device is configured by the terminal device 1 and the information providing device 5. The information providing device 5 can also execute the processes of steps S2 to S4, and in this case, the information providing device 5 is an example of an information processing device.
[0046] The configuration of the information processing system 100, which includes the terminal device 1 that performs such processing, the wearable measurement item 2, the hospital device 3, and the information providing device 5, will be described in detail below.
[0047] 2. Configuration of Information Processing System 100 Fig. 2 is a diagram showing an example of the configuration of the information processing system 100 according to the embodiment. As shown in Fig. 2, the information processing system 100 according to the embodiment includes a plurality of terminal devices 1, a plurality of wearable measurement items 2, a hospital device 3, and an information providing device 5.
[0048] The multiple terminal devices 1 are used by different users U. Each terminal device 1 is, for example, but not limited to, a smartphone, a tablet PC, a notebook PC, a desktop PC, etc. The hospital device 3 is, for example, but not limited to, a server, a notebook PC, a desktop PC, etc.
[0049] The terminal device 1, the hospital device 3, and the information providing device 5 are connected to each other via a network N so as to be able to communicate with each other by wire or wirelessly. Note that the information processing system 100 shown in FIG. 2 may include a plurality of hospital devices 3, information providing devices 5, etc.
[0050] The network N includes, for example, a WAN (Wide Area Network) such as the Internet and mobile communication networks such as LTE (Long Term Evolution), 4G (4th Generation), and 5G (5th Generation: 5th generation mobile communication system).
[0051] Each terminal device 1 and hospital device 3 can connect to the network N via short-range wireless communication such as a mobile communication network, Bluetooth (registered trademark), or wireless LAN (Local Area Network) and communicate with the information providing device 5.
[0052] 3. Configuration of Terminal Device 1] Fig. 3 is a diagram showing an example of the configuration of the terminal device 1 according to the embodiment. As shown in Fig. 3, the terminal device 1 includes a communication unit 10, a display unit 11, an input unit 12, an imaging unit 13, a sensor group 14, a storage unit 15, and a processing unit 16.
[0053] [3.1. Communication Unit 10] The communication unit 10 is realized by, for example, a network interface card (NIC). The communication unit 10 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the information providing device 5 via the network N. The communication unit 10 can also transmit and receive information to and from the hospital device 3 via the network N.
[0054] 3.2. Display Unit 11 The display unit 11 is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display.
[0055] 3.3 Input Unit 12 The input unit 12 includes, for example, a keyboard including keys for inputting letters, numbers, and spaces, an enter key, arrow keys, etc., a mouse, a power button, etc. If the display unit 11 is a touch panel-compatible display, the input unit 12 includes a touch panel.
[0056] [3.4. Imaging Unit 13] The imaging unit 13 is an image sensor (camera) that captures an image of a subject. For example, the imaging unit 13 is a complementary metal oxide semiconductor (CMOS) image sensor or a charge-coupled device (CCD) image sensor. Note that the imaging unit 13 is not limited to a built-in camera, and may be an external camera such as a wireless camera or a web camera that can communicate with the communication unit 10.
[0057] [3.5. Sensor Group 14] The sensor group 14 includes, for example, a positioning sensor, a microphone, an acceleration sensor, and a gyro sensor. The positioning sensor is a position sensor that detects the position of the terminal device 1. The microphone is a sensor that detects sounds around the terminal device 1. The acceleration sensor is a sensor that detects the acceleration of the terminal device 1. The gyro sensor is a sensor that detects the attitude of the terminal device 1, such as tilt and rotation.
[0058] [3.6. Storage Unit 15] The storage unit 15 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.
[0059] The memory unit 15 stores, for example, information transmitted from the information providing device 5 and acquired by the processing unit 16 via the network N and the communication unit 10, and detection information, which is information detected by the sensor group 14, etc.
[0060] 3.7. Processing Unit 16 The processing unit 16 is a controller, and is realized by, for example, a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs stored in a storage device inside the terminal device 1 using RAM as a working area.
[0061] Processing unit 16 may be partially or entirely realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). A lymphedema monitor app is installed in processing unit 16 as a dedicated application program that runs on an OS (Operating System). As a result, processing unit 16 functions as a functional unit including a reception unit 20, an acquisition unit 21, a selection unit 22, a measurement unit 23, a generation unit 24, and a provision unit 25.
[0062] [3.7.1. Reception Unit 20] The reception unit 20 receives various inputs from the user U. The inputs from the user U are performed, for example, by the user U operating the input unit 12. For example, the reception unit 20 receives input of the details of the treatment performed on the user U.
[0063] The treatment details may be, for example, information specifying breast cancer treatment, information specifying uterine cancer treatment, information specifying prostate cancer treatment, information specifying bladder cancer treatment, etc., but are not limited to these examples. The reception unit 20 can also receive the specification of the specific site described above.
[0064] The reception unit 20 can also receive various types of input information transmitted from the information providing device 5. For example, the reception unit 20 can also receive input of the treatment content provided to the user U by receiving treatment content information transmitted from the information providing device 5 as input information.
[0065] The receiving unit 20 can also receive the designation of a specific body part by receiving, as input information, designation information transmitted from the information providing device 5 or designation information input by the user U through operation of the input unit 12. The designation information includes information that identifies the designated specific body part. For example, when the information providing device 5 receives specific body part information transmitted from the hospital device 3, it can transmit designation information corresponding to the specific body part information to the terminal device 1.
[0066] [3.7.2. Acquisition unit 21] The acquisition unit 21 acquires various types of information. For example, the acquisition unit 21 acquires various types of information from the storage unit 15. The acquisition unit 21 also acquires information detected by the sensor group 14 and stores the acquired information in the storage unit 15.
[0067] The acquisition unit 21 also acquires information about the image captured by the imaging unit 13 and stores the acquired image information in the storage unit 15. For example, the acquisition unit 21 acquires information about a measurement image, which is an image of the measurement garment 2 being worn by the user U, from the imaging unit 13 and stores the acquired measurement image information in the storage unit 15.
[0068] The acquiring unit 21 acquires, from the imaging unit 13, an image obtained by scanning the entire body of the user U wearing the measurement garment 2 as information on the measurement image, but is not limited to this example. For example, the acquiring unit 21 can also acquire, from the imaging unit 13, an image obtained by scanning a partial area including a specific part of the user U wearing the measurement garment 2 as information on the measurement image.
[0069] The measurement images include, but are not limited to, a plurality of still images obtained by capturing images of the user U wearing the measurement garment 2 from various viewing angles (including the angle of view) using the imaging unit 13. For example, the measurement images may be moving images captured continuously from various viewing angles (including the angle of view) of the user U wearing the measurement garment 2.
[0070] Before starting to scan the user U's body by imaging, the acquisition unit 21 can confirm from the image captured by the imaging unit 13 that the user U is wearing the measurement garment 2 correctly, and can provide tutorials, design drawings, interactive checks, and audio guidance to guide the user U to an optimal standing position.
[0071] Then, for example, in the "default" mode for scanning the body of the user U, the acquisition unit 21 guides the user U, who is standing in front of the imaging unit 13 (e.g., rear camera) of the terminal device 1 placed on a cardboard stand placed on a flat desk, to rotate his or her body at various angles. The guidance is provided as audio guidance by audio output, but may also be guidance using a screen display or an optical device of the terminal device 1.
[0072] The user U maintains a consistent body pose throughout the entire scan and remains still while each image is taken by the imaging unit 13. For example, the acquisition unit 21 can acquire information about the measurement images by controlling the imaging unit 13 to take a predetermined number of images or more from various angles.
[0073] 3.7.3. Selector 22 The selector 22 selects a specific site based on the treatment content input received by the receiver 20 .
[0074] For example, if the treatment content input received by the receiving unit 20 is treatment for breast cancer, the selection unit 22 selects the arms or hands as the specific body parts. Also, if the treatment content input received by the receiving unit 20 is treatment for uterine cancer, the selection unit 22 selects the legs or feet as the specific body parts. Also, the selection unit 22 can select compression garments for specific body parts selected as compression garments for lymphedema treatment to be worn by the user U.
[0075] Furthermore, the selection unit 22 selects compression clothing according to the diagnostic information as compression clothing for lymphedema treatment to be worn by the user U. The compression clothing for lymphedema treatment is, for example, an elastic compression garment or a compression suit, but is not limited to such examples.
[0076] For example, when the diagnostic information is information indicating a three-dimensional shape measured by the measurement unit 23, the selection unit 22 selects elastic clothing in accordance with the three-dimensional shape measured by the measurement unit 23. This allows the selection unit 22 to select elastic clothing that fits the current size of the user U.
[0077] Furthermore, when the diagnostic information is information indicating the result of adjusting the three-dimensional shape by weighting specific parts of the three-dimensional shape measured by the measurement unit 23, the selection unit 22 selects compression garments that correspond to the adjusted three-dimensional shape. This allows the selection unit 22 to select compression garments that are slightly larger than the current size of the user U.
[0078] [3.7.4. Measuring Unit 23] The measuring unit 23 measures the three-dimensional shape of a region including a specific part of the user U based on information about the measurement image, which is information about the image acquired by the acquiring unit 21.
[0079] The measurement unit 23 measures the three-dimensional shape of an area including a specific part of the user U by analyzing the relative positions of dots, which are measurement markers that expand and contract together with the measurement wearable item 2, based on the information of the measurement image acquired by the acquisition unit 21.
[0080] For example, the measurement unit 23 analyzes the relative positions of dots that expand and contract together with the measurement garment 2 based on the information of the measurement image acquired by the acquisition unit 21, and forms clusters of dots. The measurement unit 23 then assigns numbers to the clusters and dots, acquires the assigned numbers, sets them at predetermined coordinate positions, and identifies a silhouette (outline). The measurement unit 23 generates data on the three-dimensional shape of the user U's body based on the identified silhouette.
[0081] Fig. 4 is a diagram showing an example of a wearable measurement item 2 according to an embodiment. In the wearable measurement item 2 shown in Fig. 4, dots M1 and M2 and a reference marker RM are recognized. Here, the dot M1 is a "solid" dot, and the dot M2 is a "hollow" dot. The reference marker RM is at least larger in size than the dots M1 and M2.
[0082] A plurality of reference markers RM are arranged on the measurement wearable item 2. For example, the measurement wearable item 2 has a total of five reference markers RM: one at the center of the chest, two around the shoulder blades on the back (one on the right side and one on the left side), and two on the outside of each knee (one on the right leg side and one on the left leg side). The reference markers RM are made of non-stretchable plastic.
[0083] The measurement unit 23 detects small circular / elliptical "blobs" (blobs) from the captured measurement image that may be dots M1 and M2 on the measurement wearable item 2, and classifies the detected dots as either "solid," "hollow," or "unknown."
[0084] Next, the measurement unit 23 analyzes the relative positions of the detected dots and forms "clusters" of dots that fit an expected honeycomb (regular hexagonal) pattern. For example, the measurement unit 23 creates hexagonal clusters from the dot pattern and adds more hexagonal clusters to create a unique honeycomb structure.
[0085] The measurement unit 23 then checks whether the formed clusters match, taking into account rotational symmetry, the known pseudo-random pattern used to print the dots on the measurement garment 2. Some clusters are rejected at this stage because they are too small to obtain a match or contain invalid dots that make them unrecognizable.
[0086] Next, the measurement unit 23 assigns a numerical identifier, which is a unique number for identifying each dot on the measurement garment 2, to each of the formed clusters. Then, the measurement unit 23 determines a size pattern based on the analysis of the honeycomb structure, and applies a measurement algorithm corresponding to the determined size pattern from among measurement algorithms for each size pattern.
[0087] Next, based on the applied measurement algorithm, the measurement unit 23 identifies the silhouette of the body shape of the user U wearing the measurement garment 2. For example, the measurement unit 23 acquires, as input data, a set of pixel coordinates of each detected dot and a corresponding numerical identifier.
[0088] Next, the measurement unit 23 inputs the acquired input data into a 3D fitting algorithm as data required for fitting a 3D body model. The measurement unit 23 processes each photo based on the algorithm used, in addition to the positions of the dots, to identify the silhouette of a person in the image. Then, the measurement unit 23 generates a 3D body model, which is information (data) of a three-dimensional shape, based on the identified silhouette.
[0089] Note that the method for measuring the three-dimensional shape of the body of the user U by the measurement unit 23 is not limited to the above-described example. For example, the measurement unit 23 can obtain three-dimensional shape information from the information of the measurement image acquired by the acquisition unit 21 using a model trained using learning information including multiple combinations of information of the measurement image and information of the three-dimensional shape.
[0090] Such models include, but are not limited to, Convolutional Neural Networks (CNNs) and Convolutional Neural Networks-Generative Adversarial Networks (CNN-GANs).
[0091] 5 is a diagram showing an example of measurement results for lymphedema patients by the measurement unit 23 of the terminal device 1, which is an example of an information processing device according to the embodiment. The example shown in FIG. 5 shows the results of measurements taken three times for 11 upper limb lymphedema patients and 15 lower limb lymphedema patients using the terminal device 1 according to the embodiment. From the results of measurements taken using the terminal device 1 according to the embodiment, the circumferences of the locations that were previously measured using a tape measure were calculated. Regarding the accuracy of repeated measurements, the average error across all measurement points for the upper limb and lower limb lymphedema patients was less than 10 mm, ranging from 2.9 mm to 9.2 mm (see (A) of FIG. 5 ).
[0092] Comparing the mean absolute error between manual measurement and measurement using this embodiment, the results were 20.9 mm and 22.9 mm at the measurement points on the groin and right wrist, respectively, but were less than 20 mm at other measurement points (see FIG. 5B). This result indicates that the terminal device 1 of this embodiment provides results comparable in accuracy to measurements using a conventional tape measure. Furthermore, the measurement time for the group measured using this embodiment was significantly shorter than that for the group measured using a tape measure (86 seconds vs. 235 seconds, p<0.001). This indicates that accurate measurement results can be obtained in a short time by using the terminal device 1 of this embodiment.
[0093] [3.7.5. Generator 24] The generator 24 generates diagnostic information, which is information used in medical treatment of lymphedema of the user U, based on the three-dimensional shape measured by the measurement unit 23.
[0094] For example, the generating unit 24 can generate, as diagnostic information, the result of adjusting the three-dimensional shape by weighting specific parts of the three-dimensional shape measured by the measuring unit 23 or information based on the result.
[0095] The specific part to be weighted is a specific part selected by the selection unit 22 or a specific part specified by the reception unit 20, but is not limited to such examples and may be, for example, a predetermined part, or a part that has previously been displaced in the three-dimensional shape of the user U's body.
[0096] The weighting of the specific portion is, for example, weighting of the displacement of the specific portion from the reference shape. The generation unit 24 detects the displacement of the three-dimensional shape measured by the measurement unit 23 from the reference shape, and weights the specific portion by multiplying the displacement of the specific portion among the detected displacements by a weight greater than 1 or adding a weight according to the displacement. This allows the generation unit 24 to generate a three-dimensional shape in which the displacement of the specific portion is exaggerated.
[0097] The reference shape is, for example, the three-dimensional shape of the user U when the user U is in a normal state, the three-dimensional shape of the user U measured last time by the measurement unit 23, or a standard shape, but is not limited to such examples.
[0098] The three-dimensional shape of user U when user U is in a normal state is, for example, a three-dimensional shape obtained from an image of the measurement garment 2 being worn by user U when lymphedema is not occurring (for example, before cancer surgery or treatment), and is the three-dimensional shape of user U's body measured by the measurement unit 23 in the past (before the last time).
[0099] The standard shape is a three-dimensional shape represented by a body model in which the shape of a part other than the specific part is similar to the three-dimensional shape of the user U, and is obtained from the measured three-dimensional shapes of multiple users U. Based on the three-dimensional shape measured by the measurement unit 23, the generation unit 24 can select a body model in which the shape of a part other than the specific part is similar from among multiple types of body models.
[0100] The generator 24 can generate, as diagnostic information, information indicating a three-dimensional shape obtained by adjusting the shape of a specific portion by weighting, or information indicating the shape of a specific portion extracted from the three-dimensional shape obtained by adjusting the shape of a specific portion by weighting. The generator 24 can also generate, as diagnostic information, a numerical value indicating a difference from a reference shape (e.g., thickness, volume, or a change therein) using the information indicating the adjusted three-dimensional shape or the information indicating the extracted shape of a specific portion.
[0101] The generating unit 24 can also generate, as diagnostic information, information in which a specific portion of the three-dimensional shape measured by the measuring unit 23 is highlighted according to its displacement from the reference shape. For example, the generating unit 24 can highlight the specific portion in a darker color as the displacement from the reference shape increases.
[0102] The generator 24 can also generate, as diagnostic information, information indicating the comparison result between the displacement from the reference shape at the specific part and a threshold value. In this case, the displacement compared with the threshold value is the average displacement from the reference shape at the specific part, but may also be the median of the displacement from the reference shape at the specific part, the maximum of the displacement from the reference shape at the specific part, or the displacement of each part from the reference shape at the specific part.
[0103] The generation unit 24 can also calculate the volume of a specific part of the user U based on the three-dimensional shape measured by the measurement unit 23, and generate information about the calculated volume as diagnostic information. For example, the generation unit 24 can generate information about a change in the volume of a specific part of the user U as diagnostic information. The information about the change in volume is information indicating a change in volume from a reference shape (e.g., the amount of change), information showing the change in volume in a graph, etc., but is not limited to such examples.
[0104] Furthermore, the generating unit 24 can also generate, as diagnostic information, information relating to the difference in three-dimensional shape between a pair of left and right regions, for example, based on the three-dimensional shapes measured by the measuring unit 23. The information relating to the difference in three-dimensional shape between a pair of left and right regions is, for example, information that three-dimensionally represents the difference in three-dimensional shape between the pair of left and right regions, information that indicates the difference in three-dimensional shape between the pair of left and right regions by a difference in thickness, information that indicates the difference in three-dimensional shape between the pair of left and right regions by a difference in volume, etc., but is not limited to these examples.
[0105] When the user U has undergone treatment for breast cancer, the generation unit 24 can generate, as diagnostic information, for example, information regarding the difference in three-dimensional shape between the right arm and the left arm of the user U or information regarding the difference in three-dimensional shape between the right hand and the left hand of the user U. Furthermore, when the user U has undergone treatment for uterine cancer, the generation unit 24 can generate, as diagnostic information, information regarding the difference in three-dimensional shape between the right leg and the left leg of the user U or information regarding the difference in three-dimensional shape between the right foot and the left foot of the user U.
[0106] The generation unit 24 includes a detection processing unit 30, an adjustment processing unit 31, and a generation processing unit 32. The processes of the detection processing unit 30, the adjustment processing unit 31, and the generation processing unit 32 will be specifically described below.
[0107] [3.7.5.1. Detection Processing Unit 30] The detection processing unit 30 detects the displacement of the three-dimensional shape measured by the measurement unit 23 from the reference shape.
[0108] The displacement detected by the detection processing unit 30 is the average displacement from the reference shape in the three-dimensional shape measured by the measurement unit 23, but it may also be the median of the displacement from the reference shape in the three-dimensional shape, the maximum value of the displacement from the reference shape in the three-dimensional shape, or the three-dimensional displacement which is the displacement of each part of the three-dimensional shape from the reference shape.
[0109] In addition, the displacement detected by the detection processing unit 30 is not limited to the displacement of the entire three-dimensional shape measured by the measurement unit 23, but may also be the displacement from the reference shape at a specific part of the three-dimensional shape measured by the measurement unit 23.
[0110] [3.7.5.2. Adjustment Processing Unit 31] The adjustment processing unit 31 sets the threshold value TH for the specific body part to be larger than the threshold value TH for the body part other than the specific body part. For example, if the specific body part is an arm or a hand, the body part other than the specific body part includes the torso, legs, feet, etc., and if the specific body part is a leg or a foot, the body part other than the specific body part includes the torso, arms, hands, etc., but is not limited to such examples. Furthermore, the threshold value TH for the body part other than the specific body part is, for example, 1, but may be a value less than 1 or a value greater than 1.
[0111] Furthermore, the adjustment processing unit 31 can adjust the weights used to weight the specific body parts. For example, the adjustment processing unit 31 can set weights according to the position of the specific body part, and can set different weights for the specific body part of the arm, the specific body part of the hand, the specific body part of the leg, and the specific body part of the foot.
[0112] The adjustment processing unit 31 can also set a threshold value TH or weight according to the degree of increase in displacement. For example, the adjustment processing unit 31 can set a larger threshold value TH or weight as the degree of increase in displacement increases. The degree of increase in displacement is, for example, the degree of increase in the volume of a specific part, but it may also be the degree of increase in the average displacement, the degree of increase in the median of the displacement, the degree of increase in the maximum value of the displacement, or the like.
[0113] [3.7.5.3. Generation Processing Unit 32] The generation processing unit 32 generates diagnostic information, which is information used in medical treatment for lymphedema of the user U, based on the three-dimensional shape measured by the measurement unit 23.
[0114] The generation processing unit 32 can generate, as diagnostic information, a result of adjusting the three-dimensional shape by weighting specific portions of the three-dimensional shape measured by the measurement unit 23, or information based on the result. For example, the generation processing unit 32 can generate, as diagnostic information, a result of adjusting the three-dimensional shape by weighting the displacement detected by the detection processing unit 30, or information based on the result.
[0115] The generation processing unit 32 can generate, as diagnostic information, information indicating a three-dimensional shape in which the shape of a specific part has been adjusted by weighting, or can generate, as diagnostic information, information indicating the shape of a specific part extracted from the three-dimensional shape in which the shape of a specific part has been adjusted by weighting.
[0116] The generation processing unit 32 can also generate, as diagnostic information, information in which a specific portion of the three-dimensional shape measured by the measurement unit 23 is highlighted in accordance with the displacement of the specific portion detected by the detection processing unit 30. For example, the generation processing unit 32 can highlight the specific portion in a darker color as the displacement from the reference shape increases.
[0117] The generation processing unit 32 can also generate, as diagnostic information, information indicating a comparison result between the displacement detected by the detection processing unit 30 and the threshold value TH. For example, when the displacement detected by the detection processing unit 30 is equal to or greater than the threshold value TH, the generation processing unit 32 generates, as diagnostic information, information indicating that the displacement detected by the detection processing unit 30 is equal to or greater than the threshold value TH. Note that the threshold value TH is not limited to one, and may include, for example, multiple threshold values according to the degree of progression of lymphedema.
[0118] In addition, the generation processing unit 32 can also calculate the volume of a specific part of the user U based on the three-dimensional shape measured by the measurement unit 23, for example, and generate information regarding the calculated volume as diagnostic information.
[0119] Furthermore, the generation processing unit 32 can also generate, as diagnostic information, information relating to the difference in the three-dimensional shapes of a pair of left and right regions, based on the three-dimensional shapes measured by the measurement unit 23, for example.
[0120] [3.7.6. Providing Unit 25] The providing unit 25 provides various types of information. The providing unit 25 can provide various types of information to the user U by displaying the various types of information on the display unit 11.
[0121] Moreover, the providing unit 25 can provide various information to the operator of the information providing device 5 by transmitting various information to the information providing device 5 via the communication unit 10. Moreover, the providing unit 25 can provide various information to medical staff M at the hospital who examines the user U, by transmitting various information to the hospital device 3 via the communication unit 10.
[0122] For example, the providing unit 25 provides the diagnostic information generated by the generating unit 24. For example, the providing unit 25 provides the diagnostic information to the information providing device 5 by transmitting the diagnostic information generated by the generating unit 24 to the information providing device 5 via the communication unit 10.
[0123] When the information providing device 5 receives the diagnostic information sent from the providing unit 25, it stores the received diagnostic information in an internal memory unit and transmits the received diagnostic information to the hospital device 3, thereby providing the diagnostic information to medical personnel M at the hospital who will be examining the user U, etc.
[0124] Furthermore, instead of or in addition to transmitting the diagnostic information generated by the generation unit 24 to the information providing device 5, the providing unit 25 can also transmit the diagnostic information generated by the generation unit 24 to the hospital device 3. Furthermore, the providing unit 25 can also provide the diagnostic information to the user U by displaying the diagnostic information generated by the generation unit 24 on the display unit 11.
[0125] In addition, the providing unit 25 can provide the diagnostic information generated by the generating unit 24 to the information providing device 5, medical personnel M, user U, etc. every time the measuring unit 23 measures the three-dimensional shape.
[0126] The providing unit 25 also provides selected elastic garment information, which is information about the elastic garment selected by the selecting unit 22. For example, the providing unit 25 provides the selected elastic garment information to the user U, the information providing device 5, or the medical staff M by displaying the selected elastic garment information on the display unit 11 or transmitting it to the information providing device 5 or the hospital device 3.
[0127] 6 is a diagram showing an example of diagnostic information displayed on the hospital device 3 according to the embodiment. The diagnostic information 50 shown in FIG. 6 is information in which a reference shape 51 and a three-dimensional shape 52 of a user U are superimposed, and this allows a medical worker M to easily understand the difference between the reference shape 51 and the three-dimensional shape 52.
[0128] 6, volume information showing the volume of a pair of arms and the difference therebetween, the volume of a pair of legs and the difference therebetween for each date, and difference information showing the difference between the pair of arms for each date may be displayed as diagnostic information. This allows the medical staff M to easily grasp the displacement of each part of the user U.
[0129] 4. Processing Procedure Next, a procedure of information processing by the processing unit 16 of the terminal device 1 according to the embodiment will be described. Fig. 7 is a flowchart showing an example of information processing by the processing unit 16 of the terminal device 1 according to the embodiment.
[0130] 7, the processing unit 16 determines whether or not it has received, as input information, the treatment content information transmitted from the information providing device 5 (step S10). If it determines that it has received the treatment content information (step S10: Yes), the processing unit 16 selects a specific site based on the treatment content indicated by the treatment content information (step S11).
[0131] When the processing of step S11 is completed or when it is determined that the treatment content information has not been received (step S10: No), the processing unit 16 determines whether or not the measurement timing has arrived (step S12). The measurement timing is, for example, the timing when the user U performs a specific operation on the input unit 12, but may also be a timing that arrives at a predetermined cycle.
[0132] When the processing unit 16 determines that it is time to measure (step S12: Yes), it acquires information about the measurement image obtained by imaging by the imaging unit 13 (step S13). Then, the processing unit 16 measures the three-dimensional shape of the area including the specific part of the user U based on the information about the measurement image acquired in step S13 (step S14).
[0133] Next, the processing unit 16 generates diagnostic information, which is information to be used in medical treatment for lymphedema of the user U, based on the three-dimensional shape measured in step S14 (step S15). Then, the processing unit 16 provides the diagnostic information generated in step S16 (step S16).
[0134] When the process of step S16 is completed or when it is determined that the measurement timing has not come (step S12: No), the processing unit 16 determines whether the operation end timing has come (step S17). The processing unit 16 determines that the operation end timing has come when, for example, the power of the terminal device 1 is turned off.
[0135] If the processing unit 16 determines that the operation end time has not yet arrived (step S17: No), it proceeds to step S10, and if it determines that the operation end time has arrived (step S17: Yes), it terminates the processing shown in Figure 7.
[0136] 5. Modifications As described above, the information providing device 5 can execute some of the functions of the terminal device 1. For example, the information providing device 5 can execute some or all of the functions of the reception unit 20, acquisition unit 21, selection unit 22, measurement unit 23, generation unit 24, and provision unit 25 described above.
[0137] Furthermore, the generation unit 24 calculates the volume of a specific part of the user U, but this volume may be the volume of a part of the specific part that has undergone displacement or the change in that volume.
[0138] Furthermore, the providing unit 25 determines whether it is time to capture an image for measurement by the imaging unit 13 based on the rate of increase in displacement from the reference shape at the specific site, and when it determines that it is time to capture an image, it can display that fact on the display unit 11 or output that fact by sound. The greater the rate of increase in displacement, the shorter the interval at which the providing unit 25 determines that it is time to capture an image.
[0139] The providing unit 25 can also provide the diagnostic information including various types of information detected by the sensor group 14. The information detected by the sensor group 14 includes, for example, information indicating the movement history of the user U (e.g., a history of movement distance, movement route, etc.), information indicating the action history of the user U (e.g., a history of actions such as walking, jumping, and gymnastics), information indicating the history of sounds around the user U, and the like, but is not limited to these examples.
[0140] 6. Hardware Configuration The terminal device 1 according to the embodiment described above is realized by a computer 80 configured as shown in Fig. 8. Fig. 8 is a hardware configuration diagram showing an example of the computer 80 that realizes the functions of the terminal device 1 according to the embodiment. The computer 80 has a CPU 81, a RAM 82, a ROM (Read Only Memory) 83, an HDD (Hard Disk Drive) 84, a communication interface (I / F) 85, an input / output interface (I / F) 86, and a media interface (I / F) 87.
[0141] The CPU 81 operates and controls each part based on programs stored in the ROM 83 or the HDD 84. The ROM 83 stores a boot program executed by the CPU 81 when the computer 80 starts up, programs that depend on the hardware of the computer 80, and the like.
[0142] The HDD 84 stores programs executed by the CPU 81, data used by such programs, etc. The communication interface 85 receives data from other devices via the network N (see FIG. 2) and sends it to the CPU 81, and transmits data generated by the CPU 81 to other devices via the network N.
[0143] The CPU 81 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 86. The CPU 81 acquires data from the input devices via the input / output interface 86. The CPU 81 also outputs generated data to the output devices via the input / output interface 86.
[0144] The media interface 87 reads a program or data stored in a recording medium 88 and provides it to the CPU 81 via the RAM 82. The CPU 81 loads the program or data from the recording medium 88 onto the RAM 82 via the media interface 87 and executes the loaded program. The recording medium 88 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.
[0145] The CPU 81 of the computer 80 executes the programs loaded onto the RAM 82 to implement the functions of the processing unit 16. The HDD 84 also stores data in the storage unit 15. The CPU 81 of the computer 80 reads and executes these programs from a recording medium 88, but as another example, the CPU 81 may obtain these programs from another device via the network N.
[0146] [7. Other] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.
[0147] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.
[0148] For example, the above-mentioned terminal device 1 may be realized by a terminal device and a server computer, or by multiple server computers. Furthermore, depending on the function, the configuration can be flexibly changed, such as by calling an external platform using an API or network computing.
[0149] Furthermore, the above-described embodiments and modifications can be combined as appropriate within the scope of not causing any contradiction in the processing content.
[0150] 8. Effects, etc. As described above, the terminal device 1 according to the embodiment is an example of an information processing device, and includes an acquisition unit 21, a measurement unit 23, a generation unit 24, and a provision unit 25. The acquisition unit 21 acquires image information of the measurement garment 2 being worn by the user U. The measurement unit 23 measures the three-dimensional shape of an area including a specific part of the user U based on the image information acquired by the acquisition unit 21. The generation unit 24 generates diagnostic information, which is information used in medical treatment for lymphedema of the user U, based on the three-dimensional shape measured by the measurement unit 23. The provision unit 25 provides the diagnostic information generated by the generation unit 24. This enables the terminal device 1 to support monitoring of lymphedema.
[0151] Furthermore, the generation unit 24 generates, as diagnostic information, the result of adjusting the three-dimensional shape by weighting specific parts of the three-dimensional shape measured by the measurement unit 23, or information based on the result. This allows the terminal device 1 to more effectively support monitoring of lymphedema.
[0152] Furthermore, the generating unit 24 generates, as diagnostic information, information in which the three-dimensional shape measured by the measuring unit 23 is highlighted according to the displacement from the reference shape at a specific site. This enables the terminal device 1 to more effectively support monitoring of lymphedema.
[0153] The generation unit 24 also includes a detection processing unit 30 that detects displacement from a reference shape in the three-dimensional shape measured by the measurement unit 23, a generation processing unit 32 that generates, as diagnostic information, information indicating the result of comparing the displacement detected by the detection processing unit 30 with a threshold, and an adjustment processing unit 31 that sets the threshold for a specific part to be larger than the threshold for parts other than the specific part. This allows the terminal device 1 to more effectively support monitoring of lymphedema.
[0154] The terminal device 1 also includes a reception unit 20 that receives input of the treatment content performed on the user U, and a selection unit 22 that selects a specific site based on the treatment content received by the reception unit 20. This allows the terminal device 1 to more easily support monitoring of lymphedema.
[0155] The terminal device 1 also includes a receiving unit 20 that receives the designation of a specific site, thereby enabling the terminal device 1 to more easily support monitoring of lymphedema.
[0156] The specific regions are a pair of left and right regions of the user U, and the generator 24 generates information relating to the difference in three-dimensional shape between the pair of left and right regions as diagnostic information. This allows the terminal device 1 to more effectively support monitoring of lymphedema.
[0157] Furthermore, the generating unit 24 generates information on the volume of the specific part as diagnostic information, which allows the terminal device 1 to more effectively support monitoring of lymphedema.
[0158] Furthermore, the generating unit 24 generates information relating to changes in the volume of a specific part as diagnostic information, thereby enabling the terminal device 1 to more effectively support monitoring of lymphedema.
[0159] The measurement wearable item 2 is at least one of an upper body wearable item and a lower body wearable item that can be connected to each other. The measurement wearable item is measurement clothing.
[0160] The terminal device 1 also includes a selection unit 22 that selects compression garments according to the diagnostic information as compression garments for treating lymphedema to be worn by the user U. This allows the terminal device 1 to support measures for lymphedema.
[0161] Furthermore, the providing unit 25 provides the diagnostic information generated by the generating unit 24 every time the three-dimensional shape is measured by the measuring unit 23. This allows the terminal device 1 to more effectively support monitoring of lymphedema.
[0162] Furthermore, the providing unit 25 provides the diagnostic information to a device at a hospital that provides remote medical care to the user U. This allows the terminal device 1 to more effectively support monitoring related to lymphedema.
[0163] The above describes the embodiments of the present application in detail based on the drawings, but this is merely an example, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have been modified and improved in various ways based on the knowledge of those skilled in the art.
[0164] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, an acquisition unit can be read as an acquisition means or an acquisition circuit.
[0165] REFERENCE SIGNS LIST 1 Terminal device 2 Wearable item for measurement 3 Hospital device 5 Information providing device 10 Communication unit 11 Display unit 12 Input unit 13 Imaging unit 14 Sensor group 15 Memory unit 16 Processing unit 20 Reception unit 21 Acquisition unit 22 Selection unit 23 Measurement unit 24 Generation unit 25 Provision unit 30 Detection processing unit 31 Adjustment processing unit 32 Generation processing unit 100 Information processing system N Network
Claims
1. An information processing device comprising: an acquisition unit that acquires image information of a measurement garment worn by a user; a measurement unit that measures a three-dimensional shape of an area including a specific part of the user based on the image information acquired by the acquisition unit; a generation unit that generates diagnostic information to be used in medical treatment for lymphedema of the user based on the three-dimensional shape measured by the measurement unit; and a provision unit that provides the diagnostic information generated by the generation unit.
2. The information processing device according to claim 1, characterized in that the generation unit generates, as the diagnostic information, a result of adjusting the three-dimensional shape by weighting the specific part of the three-dimensional shape measured by the measurement unit, or information based on the result.
3. The information processing device according to claim 1, characterized in that the generation unit generates, as the diagnostic information, information in which the three-dimensional shape measured by the measurement unit is highlighted in accordance with the displacement from a reference shape at the specific portion.
4. The information processing device according to claim 1, characterized in that the generation unit comprises: a detection processing unit that detects a displacement from a reference shape in the three-dimensional shape measured by the measurement unit; a generation processing unit that generates information indicating a comparison result between the displacement detected by the detection processing unit and a threshold value as the diagnostic information; and an adjustment processing unit that makes the threshold value for the specific part larger than the threshold value for parts other than the specific part.
5. An information processing device according to any one of claims 2 to 4, characterized in that it comprises: a reception unit that receives input of the treatment content performed on the user; and a selection unit that selects the specific area based on the treatment content input received by the reception unit.
6. The information processing device according to any one of claims 2 to 4, further comprising a reception unit for receiving the designation of the specific portion.
7. An information processing device as described in any one of claims 1 to 4, characterized in that the specific parts are a pair of left and right parts of the user, and the generation unit generates information regarding the difference in three-dimensional shape of the pair of left and right parts as the diagnostic information.
8. An information processing device according to any one of claims 1 to 4, characterized in that the generating unit generates information relating to the volume of the specific portion as the diagnostic information.
9. The information processing device according to claim 8, characterized in that the generating unit generates information relating to a change in the volume of the specific part as the diagnostic information.
10. An information processing device according to any one of claims 1 to 4, further comprising a selection unit that selects, as the compression garment for treating lymphedema to be worn by the user, compression garments in accordance with the diagnostic information.
11. An information processing device according to any one of claims 1 to 4, characterized in that the providing unit provides the diagnostic information generated by the generating unit each time the three-dimensional shape is measured by the measuring unit.
12. An information processing device according to any one of claims 1 to 4, characterized in that the providing unit provides the diagnostic information to a device in a hospital that provides remote medical treatment to the user.
13. The information processing device according to any one of claims 1 to 4, characterized in that the measurement wearable item is measurement clothing.
14. An information processing method executed by a computer, comprising: an acquisition step of acquiring image information of a measurement garment worn by a user; a measurement step of measuring a three-dimensional shape of an area including a specific part of the user based on the image information acquired by the acquisition step; a generation step of generating diagnostic information, which is information used in medical treatment for lymphedema of the user, based on the three-dimensional shape measured by the measurement step; and a provision step of providing the diagnostic information generated by the generation step.
15. An information processing program that causes a computer to execute the following steps: an acquisition step for acquiring image information of a measurement garment worn by a user; a measurement step for measuring a three-dimensional shape of an area including a specific part of the user based on the image information acquired by the acquisition step; a generation step for generating diagnostic information to be used in medical treatment for lymphedema of the user based on the three-dimensional shape measured by the measurement step; and a provision step for providing the diagnostic information generated by the generation step.
Citation Information
Patent Citations
Information processing device, information processing method, and information processing program
JP7169489B1
Methods and systems for identifying body part or body area anatomical landmarks from digital imagery for the fitting of compression garments for a person in need thereof
US11211162B1
System and Method For Object Detection Using Structured Light
US20150302594A1
System and Method for Measuring Edema at Home and Measurement Pattern for Use Therewith
US20220270241A1
Size measuring system
WO2019189846A1