Symptom recording device, symptom recording method, and program
The symptom recording device facilitates accurate jugular vein image capture by users without medical knowledge through guided preview and range indication, enhancing central venous pressure estimation accuracy.
Patent Information
- Application Number
- JP2022578287
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-01-29
- Filing Date
- 2022-01-19
- Publication Date
- 2025-10-03
- Estimated Expiration
- 2042-01-19
AI Technical Summary
Confirming jugular vein distention for assessing intravascular congestion is difficult for users without medical experience or knowledge, especially in telemedicine or telemonitoring scenarios, due to the need for precise image capture conditions.
A symptom recording device with a control unit that assists in capturing images by providing preview images, range indication, and instructions for body position, clothing, and imaging conditions, ensuring accurate capture of the jugular vein area.
Enables users without experience to easily capture images that allow confirmation of jugular vein status, improving the accuracy of central venous pressure estimation.
Smart Images

Figure 0007748976000001 
Figure 0007748976000002 
Figure 0007748976000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a symptom recording device, a symptom recording method, and a program. [Background technology]
[0002] Increased central venous pressure manifests as jugular venous distension. Central venous pressure is used clinically to estimate cardiovascular status, such as cardiac function.
[0003] Patent Document 1 discloses a technique for capturing an image of the right side of the neck in order to determine central venous pressure. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Special Publication No. 2018-514238 Summary of the Invention [Problem to be solved by the invention]
[0005] Confirming jugular vein distention is considered a method for visually determining intravascular congestion due to worsening heart failure, but it requires experience and knowledge. Congestion refers to an increase in volume. When attempting to confirm jugular vein distention through visual inspection or image analysis during telemedicine or telemonitoring, it is necessary to create conditions, such as positioning, that allow for the correct capture of images to confirm jugular vein distention. However, creating such conditions is difficult for users without experience or knowledge.
[0006] In the conventional technology, medical professionals are assumed to be users, and therefore it is difficult for users without experience or knowledge to capture an image that allows confirmation of jugular vein distension.
[0007] An object of the present disclosure is to make it easier for a user with no experience or knowledge to take an image that allows the state of the jugular vein to be confirmed. [Means for solving the problem]
[0008] A symptom recording device according to one aspect of the present disclosure includes a control unit that controls the display of a preview image of an image obtained by an imaging element used for capturing a neck image to check the state of the jugular vein before the image is captured, and controls the output of range indication data that indicates the imaging range including the neck, thereby assisting in the capturing of the image and recording the captured neck image.
[0009] In one embodiment, the range designation data is data designating a range from below the ear to the collarbone as the imaging range.
[0010] In one embodiment, the control unit performs control to output body position instruction data instructing a body position before capturing the cervical image.
[0011] In one embodiment, the control unit performs control to output clothing instruction data instructing an outfit or hairstyle instruction data instructing a hairstyle before capturing the cervical image.
[0012] In one embodiment, the control unit performs control to output condition instruction data that instructs imaging conditions including ambient brightness before capturing the cervical image.
[0013] In one embodiment, the control unit sets imaging conditions including sensitivity of the imaging element before capturing the cervical image.
[0014] In one embodiment, the control unit further records date and time data indicating the date and time when the cervical image was captured.
[0015] In one embodiment, the control unit further records angle data indicating the angle at which the cervical image was taken.
[0016] In one embodiment, the control unit determines whether the imaging range is included in the image obtained by the imaging element, and if it determines that the imaging range is included, controls the display of a figure representing the imaging range superimposed on the preview image.
[0017] In one embodiment, the control unit determines whether the imaging range is included in the image obtained by the imaging element, and if it determines that the imaging range is included, records the image obtained by the imaging element as the cervical image.
[0018] In one embodiment, the control unit controls the display of the captured cervical image and also controls the output of question data asking whether the captured cervical image includes the imaging range, and if an answer is input that the imaging range is not included, supports the re-capture of the cervical image.
[0019] In one embodiment, the control unit controls to display a previously recorded cervical image together with the captured cervical image.
[0020] In one embodiment, the control unit analyzes the captured cervical image and determines whether the captured cervical image includes the imaging range, and if it determines that the imaging range is not included, supports re-capturing the cervical image.
[0021] In one embodiment, the apparatus further includes a communication unit that is controlled by the control unit and transmits the cervical image to a server.
[0022] In one embodiment, the control unit supports re-capturing the cervical image when indication data indicating that the transmitted cervical image does not include the imaging range is transmitted from the server and received by the communication unit.
[0023] In one aspect of the symptom recording method of the present disclosure, a control unit assists in capturing a neck image to check the condition of the jugular vein by controlling the image obtained by the imaging element used for the capture to be displayed as a preview image before the capture, and by controlling the output of range indication data that indicates the imaging range including the neck, and the control unit records the captured neck image.
[0024] A program as one aspect of the present disclosure controls the display of an image obtained by an image sensor used for capturing a neck image as a preview image before capturing the image to check the condition of the jugular vein, and controls the output of range designation data that designates an imaging range including the neck, thereby causing a computer to execute a process of assisting the capturing and a process of recording the captured neck image. [Effects of the Invention]
[0025] According to the present disclosure, even a user with no experience or knowledge can easily capture an image that allows the state of the jugular vein to be confirmed. [Brief explanation of the drawings]
[0026] [Figure 1] FIG. 1 is a diagram illustrating a configuration of a system according to an embodiment of the present disclosure. [Figure 2] FIG. 1 is a block diagram illustrating a configuration of a symptom recording device according to an embodiment of the present disclosure. [Figure 3] FIG. 10 is a diagram illustrating an example of a screen of a symptom recording device according to an embodiment of the present disclosure. [Figure 4] FIG. 10 is a diagram illustrating an example of a screen of a symptom recording device according to an embodiment of the present disclosure. [Figure 5] FIG. 10 is a diagram illustrating an example of a screen of a symptom recording device according to an embodiment of the present disclosure. [Figure 6] FIG. 10 is a diagram illustrating an example of a screen of a symptom recording device according to an embodiment of the present disclosure. [Figure 7] 1 is a flowchart illustrating the operation of a symptom recording device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0027] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.
[0028] In each drawing, the same or corresponding parts are denoted by the same reference numerals. In the description of this embodiment, the description of the same or corresponding parts will be omitted or simplified as appropriate.
[0029] The configuration of a system 10 according to this embodiment will be described with reference to FIG.
[0030] The system 10 according to this embodiment includes a plurality of symptom recording devices 20 and at least one server 30.
[0031] Each of the symptom recording devices 20 is used by a user such as a patient, a patient's family member, a caregiver, or a medical professional. The patient may be, for example, a patient suffering from heart failure.
[0032] The number of symptom recording devices 20 is not limited to a plurality of devices, and may be only one. For convenience of explanation, the following description will be given of one symptom recording device 20.
[0033] The symptom recording device 20 is held by a user. Alternatively, the symptom recording device 20 is installed in the patient's home. The symptom recording device 20 is, for example, a general-purpose terminal such as a mobile phone, smartphone, tablet, or PC, or a dedicated terminal such as a gadget. "PC" is an abbreviation for personal computer.
[0034] The symptom recording device 20 is capable of communicating with the server 30 via a network 40 .
[0035] The server 30 is installed in a facility such as a data center, etc. The server 30 is, for example, a server computer belonging to a cloud computing system or other computing system.
[0036] Network 40 may include the Internet, at least one WAN, at least one MAN, or any combination thereof. "WAN" is an abbreviation for wide area network. "MAN" is an abbreviation for metropolitan area network. Network 40 may include at least one wireless network, at least one optical network, or any combination thereof. A wireless network may be, for example, an ad-hoc network, a cellular network, a wireless LAN, a satellite communication network, or a terrestrial microwave network. "LAN" is an abbreviation for local area network.
[0037] The present embodiment will be outlined with reference to FIGS. 2, 4, and 6. FIG.
[0038] In the symptom recording device 20 according to this embodiment, before capturing a neck image 56 for checking the state of the jugular vein, the control unit 21 controls to display an image obtained by the imaging element used for the capture as a preview image 52, and controls to output range designation data D1 that designates an imaging range including the neck, thereby supporting the capture. The control unit 21 records the captured neck image 56.
[0039] In this embodiment, the user can receive instructions regarding the imaging range for obtaining an image in which the state of the jugular vein can be confirmed while viewing the preview image 52. Therefore, according to this embodiment, even a user with no experience or knowledge can easily capture an image in which the state of the jugular vein can be confirmed.
[0040] The imaging range includes at least a portion of the neck where the state of the jugular vein can be confirmed, and in this embodiment, the range extends from below the ear to the collarbone. That is, the range instruction data D1 is data specifying the imaging range as the range from below the ear to the collarbone. According to this embodiment, by including the collarbone in the imaging range, the accuracy of estimating central venous pressure through height estimation can be improved. As a modification of this embodiment, the imaging range may extend to the sternal angle. Furthermore, the higher the central venous pressure, the higher the pulsation position, and in some patients, the pulsation may appear just below the ear. According to this embodiment, by including the area below the ear in the imaging range, imaging errors for patients with high central venous pressure can be reduced. That is, it becomes easier to avoid situations where the pulsation position of a patient with high central venous pressure is not included in the imaging range. As a modification of this embodiment, the imaging range may extend to the earlobe.
[0041] The configuration of the symptom recording device 20 according to this embodiment will be described with reference to FIG.
[0042] The symptom recording device 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, and an output unit 25.
[0043] The control unit 21 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for specific processing. "CPU" is an abbreviation for central processing unit. "GPU" is an abbreviation for graphics processing unit. An example of the programmable circuit is an FPGA. "FPGA" is an abbreviation for field-programmable gate array. An example of the dedicated circuit is an ASIC. "ASIC" is an abbreviation for application specific integrated circuit. The control unit 21 controls each part of the symptom recording device 20 and executes processing related to the operation of the symptom recording device 20.
[0044] The memory unit 22 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, RAM or ROM. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read only memory. RAM is, for example, SRAM or DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. ROM is, for example, EEPROM. "EEPROM" is an abbreviation for electrically erasable programmable read only memory. The memory unit 22 functions as, for example, a main memory device, an auxiliary memory device, or a cache memory. The memory unit 22 stores data used in the operation of the symptom recording device 20 and data obtained by the operation of the symptom recording device 20.
[0045] The communication unit 23 includes at least one communication interface. The communication interface is, for example, an interface compatible with a mobile communication standard such as LTE, 4G standard, or 5G standard, an interface compatible with a short-range wireless communication standard such as Bluetooth (registered trademark), or a LAN interface. "LTE" is an abbreviation for Long Term Evolution. "4G" is an abbreviation for 4th generation. "5G" is an abbreviation for 5th generation. The communication unit 23 receives data used in the operation of the symptom recording device 20 and transmits data obtained by the operation of the symptom recording device 20.
[0046] The input unit 24 includes at least two input interfaces. One input interface is an imaging device equipped with an imaging element, such as a camera. The other input interface is, for example, a physical key, a capacitive key, a pointing device, a touch screen integrated with a display, or a microphone. The input unit 24 accepts an operation to input data used for the operation of the symptom recording device 20. The input unit 24 may be connected to the symptom recording device 20 as an external input device instead of being provided in the symptom recording device 20. The connection interface may be, for example, an interface compatible with standards such as USB, HDMI (registered trademark), or Bluetooth (registered trademark). "USB" is an abbreviation for Universal Serial Bus. "HDMI (registered trademark)" is an abbreviation for High-Definition Multimedia Interface.
[0047] The output unit 25 includes at least two output interfaces. One output interface is a display such as an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electroluminescence. The other output interface is, for example, a speaker. The output unit 25 outputs data obtained by the operation of the symptom recording device 20. The output unit 25 may be connected to the symptom recording device 20 as an external output device instead of being provided in the symptom recording device 20. The connection interface may be, for example, an interface compatible with standards such as USB, HDMI (registered trademark), or Bluetooth (registered trademark).
[0048] The functions of the symptom recording device 20 are realized by executing a program according to this embodiment on a processor serving as the control unit 21. That is, the functions of the symptom recording device 20 are realized by software. The program causes a computer to execute the operations of the symptom recording device 20, thereby causing the computer to function as the symptom recording device 20. That is, the computer functions as the symptom recording device 20 by executing the operations of the symptom recording device 20 in accordance with the program.
[0049] The program can be stored on a non-transitory computer-readable medium. Examples of non-transitory computer-readable media include flash memory, magnetic recording devices, optical disks, magneto-optical recording media, and ROMs. The program can be distributed by selling, transferring, or lending portable media such as SD cards, DVDs, or CD-ROMs that store the program. "SD" is an abbreviation for Secure Digital. "DVD" is an abbreviation for digital versatile disc. "CD-ROM" is an abbreviation for compact disc read only memory. The program can also be distributed by storing it in the storage of a server and transferring it from the server to another computer. The program can also be provided as a program product.
[0050] A computer temporarily stores a program stored on a portable medium or transferred from a server in its main storage device. The computer then reads the program stored in the main storage device using a processor and executes processing in accordance with the read program. The computer may also read the program directly from a portable medium and execute processing in accordance with the program. The computer may also execute processing in accordance with the received program each time a program is transferred from a server to the computer. Processing may also be executed through a so-called ASP-type service that achieves its functions by issuing execution instructions and obtaining results without transferring the program from the server to the computer. "ASP" is an abbreviation for application service provider. A program is information used for processing by a computer and includes something equivalent to a program. For example, data that is not a direct instruction to a computer but has properties that specify computer processing falls under the category of "something equivalent to a program."
[0051] Some or all of the functions of the symptom recording device 20 may be realized by a programmable circuit or a dedicated circuit as the control unit 21. In other words, some or all of the functions of the symptom recording device 20 may be realized by hardware.
[0052] The operation of the symptom recording device 20 according to this embodiment will be described with reference to Fig. 7, using examples of the screen 50 of the symptom recording device 20 shown in Fig. 3 to Fig. 6. This operation corresponds to the symptom recording method according to this embodiment.
[0053] In step S1, control unit 21 performs control to output body position instruction data D2 that instructs a body position. A display serving as output unit 25 is controlled by control unit 21 to display body position instruction data D2 on screen 50. Alternatively, a speaker serving as output unit 25 is controlled by control unit 21 to output body position instruction data D2 by voice.
[0054] In this embodiment, as shown in FIG. 3, the control unit 21 displays, on the display, an illustration 51 instructing the user to adjust the angle relative to the supine position as the position instruction data D2. The angle indicated by the illustration 51 is between 30° and 45°, and is 45° in the example of FIG. 3. That is, in the example of FIG. 3, the user is instructed to adjust the patient's position so that the patient is raised 45° from the supine position. In the example of FIG. 3, the control unit 21 further displays messages such as "Adjust the position as shown in the illustration below" and "Once the position has been adjusted, prepare for video recording" on the display.
[0055] As a modification of this embodiment, the control unit 21 may assist in capturing images of the patient's body position, such as an image of the entire patient, and record the captured images of the patient's body position. Specifically, the control unit 21 may store images of the patient's body position captured by an imaging element of an imaging device serving as the input unit 24 in the storage unit 22. This modification makes it easier to ensure that the patient is in the correct body position. As a result, the accuracy of estimating the central venous pressure is improved.
[0056] As a further modification, the control unit 21 may display on the display an image of the previously recorded body position together with the image of the captured body position. This modification makes it easier to check whether the patient is in the correct body position.
[0057] As a modification of this embodiment, the mode may be selected to be either a sitting position or a semi-sitting position. According to this modification, the information on which mode is selected can be used as additional information for diagnosis.
[0058] As a variation of this embodiment, control unit 21 may further perform control to output clothing instruction data D3a that instructs the user on how to dress. Control unit 21 may control the display to display clothing instruction data D3a on screen 50. Alternatively, control unit 21 may control the speaker to output clothing instruction data D3a by voice. For example, control unit 21 may cause the display to display a clothing instruction message such as "Wear clothing that shows your body from below your ears to your collarbone" as clothing instruction data D3a, or cause the speaker to output the message by voice.
[0059] As a modified example of this embodiment, control unit 21 may further perform control to output hairstyle instruction data D3b that instructs a hairstyle. The display may be controlled by control unit 21 to display the hairstyle instruction data D3b on screen 50. Alternatively, the speaker may be controlled by control unit 21 to output the hairstyle instruction data D3b by voice. For example, control unit 21 may cause the display to display a hairstyle instruction message such as "If you have long hair, please tie it up" as hairstyle instruction data D3b, or cause the speaker to output it by voice.
[0060] In step S2, the control unit 21 activates the imaging device serving as the input unit 24. Specifically, the control unit 21 activates the camera.
[0061] In step S3, control unit 21 controls the display of the image obtained by the imaging element as preview image 52, and also controls the output of range designation data D1 that designates the imaging range including the cervical region. A display serving as output unit 25 is controlled by control unit 21 to display range designation data D1 on screen 50 together with preview image 52. Alternatively, a speaker serving as output unit 25 is controlled by control unit 21 to output range designation data D1 by voice when preview image 52 is displayed on screen 50.
[0062] In this embodiment, as shown in Fig. 4, the control unit 21 displays a range instruction message 53, such as "Please adjust the camera position so that the area from below the ear to the collarbone is sufficiently captured," on the display as range instruction data D1 together with the preview image 52. That is, in the example of Fig. 4, the user is instructed to adjust the camera position to capture the area from below the ear to the collarbone. The range instruction message 53 may include other messages, such as a message instructing the user to adjust the direction of the patient's face so that it is turned sideways.
[0063] In this embodiment, the control unit 21 determines whether the image obtained by the imaging element includes the imaging range specified by the range specification data D1. As shown in FIG. 4 , if the control unit 21 determines that the image obtained by the imaging element includes the imaging range specified by the range specification data D1, the control unit 21 controls the display to display a graphic 54 representing the imaging range superimposed on the preview image 52. The display is controlled by the control unit 21 to display the graphic 54 superimposed on the preview image 52. The graphic 54 may have any shape, color, and pattern, but in the example of FIG. 4 , it is a rectangular red frame. If the control unit 21 determines that the image obtained by the imaging element does not include the imaging range specified by the range specification data D1, the control unit 21 controls the display to hide the graphic 54. The display is controlled by the control unit 21 to hide the graphic 54.
[0064] In step S4, the control unit 21 performs control to output condition instruction data D4 that indicates imaging conditions including ambient brightness. The display serving as the output unit 25 is controlled by the control unit 21 to display the condition instruction data D4 on the screen 50. Alternatively, the speaker serving as the output unit 25 is controlled by the control unit 21 to output the condition instruction data D4 by voice.
[0065] In this embodiment, as shown in Fig. 5, the control unit 21 causes the display to display a condition instruction message 55 such as "Please brighten the room" as the condition instruction data D4. That is, in the example of Fig. 5, the user is instructed to adjust the darkness or brightness of the room to make it sufficiently bright. The condition instruction message 55 may also include other messages, such as a message instructing the user to eliminate camera shake or a message instructing the user to avoid capturing foreign objects.
[0066] In step S5, the control unit 21 sets imaging conditions including the sensitivity of the imaging element. Specifically, the control unit 21 adjusts the sensitivity in the background. In this embodiment, since a video is taken as the neck image 56 for checking the state of the jugular vein, the control unit 21 may set the imaging time as part of the imaging conditions. The control unit 21 may also set other conditions as part of the imaging conditions.
[0067] The control unit 21 executes the processes from step S3 to step S5 to assist in capturing the cervical image 56.
[0068] In step S6, the control unit 21 records the captured cervical image 56. Specifically, the control unit 21 causes the storage unit 22 to store the captured cervical image 56.
[0069] In this embodiment, the control unit 21 stores, as the cervical image 56, a video including a group of frames of images obtained by the imaging element at a certain time after step S5 in the storage unit 22. The video recording may be started automatically, or may be started in response to a user operation such as tapping a recording button via a touch screen serving as the input unit 24. The video recording may be ended automatically, or may be ended in response to a user operation such as tapping a stop button via the touch screen.
[0070] As a modified example of this embodiment, the control unit 21 may analyze an image obtained by the imaging element to determine whether the image includes the imaging range specified by the range specification data D1. A known method may be used as the image analysis method. Machine learning such as deep learning may also be used. When the control unit 21 determines that the image obtained by the imaging element includes the imaging range specified by the range specification data D1, the control unit 21 may record the image as the cervical image 56. Specifically, the control unit 21 may store, in the storage unit 22, a video including, as a frame group, a group of images obtained by the imaging element that include the imaging range specified by the range specification data D1.
[0071] As a modification of this embodiment, the control unit 21 may further record date and time data D5 indicating the date and time when the neck image 56 was captured. Specifically, the control unit 21 may store the date and time data D5 in the storage unit 22 along with the captured neck image 56. This modification makes it possible to analyze the diurnal variation of central venous pressure. Alternatively, it is possible to know whether the neck image 56 was captured in a warm season or a cold season.
[0072] As a modification of this embodiment, the control unit 21 may further record angle data D6 indicating the angle at which the neck image 56 was captured. Specifically, the control unit 21 may store the angle data D6 in the storage unit 22 together with the captured neck image 56. According to this modification, the body position can be estimated from the camera angle and the neck angle.
[0073] In step S7, the control unit 21 controls the display of the captured cervical image 56, and also controls the output of question data D7 asking whether or not to transmit the captured cervical image 56 to the server 30. The display serving as the output unit 25 is controlled by the control unit 21 to display the question data D7 on the screen 50 together with the cervical image 56. Alternatively, the speaker serving as the output unit 25 is controlled by the control unit 21 to output the question data D7 by voice when the cervical image 56 is displayed on the screen 50.
[0074] In this embodiment, as shown in Fig. 6, the control unit 21 displays a confirmation message 57 such as "Video shooting is complete" and "Do you want to send?" as question data D7 on the display together with a cervical image 56. That is, in the example of Fig. 6, the user is asked whether or not to send the shot video to the server 30.
[0075] If a response that the captured cervical image 56 will not be transmitted to the server 30 is input via the input unit 24, the processes from step S3 onwards are executed again. That is, the control unit 21 supports re-capturing of the cervical image 56. If a response that the captured cervical image 56 will be transmitted to the server 30 is input via the input unit 24, the process of step S8 is executed.
[0076] In this embodiment, as shown in Fig. 6, the control unit 21 displays a re-shoot button 58 labeled "take another photograph" and a send button 59 labeled "send" on the display. When the re-shoot button 58 is tapped via the touch screen serving as the input unit 24, the processing from step S3 onwards is executed again. When the send button 59 is tapped via the touch screen, the processing of step S8 is executed.
[0077] As a modified example of this embodiment, the question data D7 may be data inquiring about whether the captured cervical image 56 includes the imaging range specified by the range specification data D1. For example, the confirmation message 57 may be a message such as, "Does the video capture the area from below the ear to the collarbone?" That is, the user may be asked whether the captured video captures the area from below the ear to the collarbone. The labels of the re-shoot button 58 and the send button 59 may be "No" and "Yes," respectively. In this modified example, when the re-shoot button 58 is tapped via the touch screen, the processing from step S3 onward is executed again. When the send button 59 is tapped via the touch screen, the processing from step S8 onward is executed. That is, when a response is input via the input unit 24 that the captured cervical image 56 does not include the imaging range specified by the range specification data D1, the processing from step S3 onward is executed again. When a response is input via the input unit 24 that the captured cervical image 56 includes the imaging range specified by the range specification data D1, the processing from step S3 onward is executed again.
[0078] As a modification of this embodiment, the control unit 21 may display on the display the previously recorded cervical image 56 together with the captured cervical image 56. This modification makes it easier to check whether the cervical image 56 has been captured correctly.
[0079] As a modified example of this embodiment, the control unit 21 may analyze the captured cervical image 56 to determine whether the captured cervical image 56 includes the imaging range specified by the range specification data D1. That is, whether the area from below the ear to the collarbone is captured in the captured video may be determined automatically, instead of being determined by the user. A known method may be used for image analysis. Machine learning, such as deep learning, may also be used. This modified example eliminates the need to display the confirmation message 57, the re-shoot button 58, and the send button 59. If the control unit 21 determines that the captured cervical image 56 does not include the imaging range specified by the range specification data D1, the process from step S3 onward is executed again. If the control unit 21 determines that the captured cervical image 56 includes the imaging range specified by the range specification data D1, the process of step S8 is executed.
[0080] In step S8, the control unit 21 causes the communication unit 23 to transmit the captured cervical image 56. The communication unit 23 is controlled by the control unit 21 to transmit the cervical image 56 to the server 30.
[0081] As a modified example of this embodiment, the server 30 may analyze the captured neck image 56 to determine whether the captured neck image 56 includes the imaging range specified by the range specification data D1. That is, the server 30 may determine whether the captured video shows the area from below the ear to the collarbone. A known method may be used for image analysis. Machine learning, such as deep learning, may also be used. If the server 30 determines that the captured neck image 56 does not include the imaging range specified by the range specification data D1, the server 30 may transmit indication data D8 indicating that the imaging range is not included in the neck image 56. If the indication data D8 is transmitted from the server 30 and received by the communication unit 23, the processes from step S3 onward may be executed again. That is, the control unit 21 may support recapturing the neck image 56. The indication data D8 may include comments from a medical institution that has reviewed the neck image 56, such as "the image is dark" or "the jugular vein is not visible."
[0082] As described above, in this embodiment, the symptom recording device 20 instructs the subject's posture during jugular vein measurement. The symptom recording device 20 may also instruct the subject's clothing or hairstyle during jugular vein measurement. The symptom recording device 20 acquires and displays a video of the subject's neck area. The symptom recording device 20, in conjunction with the video display, instructs an imaging range that includes the subject's neck area. The symptom recording device 20 instructs or sets imaging conditions that are conditions for capturing a video of the subject's neck area. The symptom recording device 20 records the captured video. Therefore, according to this embodiment, even a user without specialized knowledge can stably, i.e., without failure, capture a video to check for jugular vein distension at home.
[0083] As a variation of this embodiment, a mode may be provided in which the patient takes the neck image 56 themselves. In this variation, the camera is an in-camera. Instructions are provided by sound. Body positioning is not required. Instead of button operations, imaging begins automatically once the imaging range is captured. For example, assume that the symptom recording device 20 is a smartphone. Initially, messages such as "Image capture will begin," "Hold the smartphone in your right hand with the screen facing you," and "Press the start imaging button" are displayed. Next, messages such as "Move the smartphone a little further away," "Move the smartphone a little closer," "More to the right," or "More to the left" are displayed. Next, messages such as "Turn your face to the left to begin imaging," "Taking a picture," and "Image capture completed" are displayed in sequence. Since the body and smartphone are directly facing each other, instructions are provided in text. Messages such as "Move the smartphone closer or farther away so that the frame extends from under your ear to your collarbone within the frame," "Press the start imaging button when adjustments are complete," "Image capture will begin in 3 seconds," and "Turn your face to the left" may be displayed using text or images. After that, voice messages such as "Shooting in progress," "Shooting completed," and "Please check the images captured on your smartphone" may be output.
[0084] The present disclosure is not limited to the above-described embodiments. For example, multiple blocks shown in the block diagrams may be integrated, or a single block may be divided. Instead of executing multiple steps shown in the flowcharts in chronological order as described, steps may be executed in parallel or in a different order depending on the processing capabilities of the device executing each step, or as needed. Other modifications are possible within the scope of the present disclosure.
[0085] For example, the process of step S1 may be omitted, or the process of step S4, the process of step S5, or both may be omitted.
[0086] For example, instead of capturing a video, a still image may be captured as the cervical image 56. When determining whether the cervical image 56 includes the imaging range specified in the range specification data D1, it may further be determined whether the cervical image 56 satisfies the imaging conditions specified in the condition specification data D4. Alternatively, instead of determining whether the cervical image 56 includes the imaging range specified in the range specification data D1, it may be determined whether the cervical image 56 satisfies the imaging conditions specified in the condition specification data D4.
[0087] For example, when assisting in re-photographing of the cervical image 56, the control unit 21 may notify the user of the reason why re-photographing is necessary, such as the imaging range, illuminance, body position, foreign objects such as the user's fingers, or camera shake. [Explanation of symbols]
[0088] 10 Systems 20 Symptom Recorder 21 Control section 22 Memory section 23 Communications Department 24 Input section 25 Output section 30 servers 40 Network 50 screens 51 Illustrations 52 preview images 53 Range instruction message 54 Shapes 55 Conditional Instruction Message 56 Cervical Imaging 57 Confirmation Message 58 Retake button 59 Send button
Claims
1. A symptom recording device that supports the imaging by controlling the display of a preview image of the image obtained by the imaging element used for the imaging before taking a neck image to check the condition of the jugular vein, and by controlling the output of range indication data that indicates the imaging range including the neck, and that is equipped with a control unit that supports the imaging and records the captured neck image.
2. The symptom recording device according to claim 1 , wherein the range designation data designates a range from below the ear to the collarbone as the imaging range.
3. The symptom recording device according to claim 1 or 2, wherein the control unit performs control to output body position instruction data instructing a body position before capturing the cervical image.
4. The symptom recording device according to any one of claims 1 to 3, wherein the control unit controls to output clothing instruction data instructing clothing or hairstyle instruction data instructing hairstyle before taking the cervical image.
5. The symptom recording device according to claim 1 , wherein the control unit performs control to output condition instruction data that instructs imaging conditions including ambient brightness before capturing the cervical image.
6. The symptom recording device according to claim 1 , wherein the control unit sets imaging conditions including a sensitivity of the imaging element before capturing the cervical image.
7. The symptom recording device according to claim 1 , wherein the control unit further records date and time data indicating a date and time when the cervical image was captured.
8. The symptom recording device according to claim 1 , wherein the control unit further records angle data indicating an angle at which the cervical image was captured.
9. The symptom recording device according to any one of claims 1 to 8, wherein the control unit determines whether the imaging range is included in the image obtained by the imaging element, and if it determines that the imaging range is included, controls the display of a graphic representing the imaging range superimposed on the preview image.
10. The symptom recording device according to any one of claims 1 to 8, wherein the control unit determines whether the imaging range is included in the image obtained by the imaging element, and if it determines that the imaging range is included, records the image obtained by the imaging element as the cervical image.
11. The control unit controls the display of the captured cervical image and also controls the output of question data asking whether the captured cervical image includes the imaging range, and if an answer is input that the imaging range is not included, supports the re-capture of the cervical image.
12. The symptom recording device according to claim 1 , wherein the control unit controls to display a previously recorded neck image together with the captured neck image.
13. The symptom recording device according to any one of claims 1 to 8, wherein the control unit analyzes the captured cervical image to determine whether the captured cervical image includes the imaging range, and if it determines that the imaging range is not included, supports re-capturing the cervical image.
14. The symptom recording device according to claim 1 , further comprising a communication unit that is controlled by the control unit to transmit the cervical image to a server.
15. The symptom recording device of claim 14, wherein the control unit supports re-capturing the cervical image when indication data indicating that the transmitted cervical image does not include the imaging range is transmitted from the server and received by the communication unit.
16. the control unit controls the display of an image obtained by the imaging element used for the neck image capture as a preview image before the neck image capture for checking the state of the jugular vein is taken, and also controls the output of range designation data that designates an imaging range including the neck, thereby supporting the neck image capture; A symptom recording method in which the control unit records the captured cervical image.
17. a process of supporting the imaging by controlling the display of a preview image of an image obtained by an imaging element used for the imaging before capturing a neck image for checking the state of the jugular vein, and controlling the output of range designation data that designates an imaging range including the neck; A process of recording the captured cervical image; A program that causes a computer to execute the following.
Citation Information
Patent Citations
Device and method for acquiring vital sign information of a subject
JP2016513517A
Visual central venous pressure measurement
JP2018514238A
Device, system and method for measuring and processing physiological signals of a subject
JP2020510487A