Biological testing device, biological information analysis method, and computer program

The biopsy device integrates laryngeal displacement and swallowing sound detection to generate two- or three-dimensional trajectory data, addressing the challenges of interpreting swallowing dynamics and accurately determining the swallowing sound peak, enhancing the evaluation of swallowing disorders.

JP7785801B2Active Publication Date: 2025-12-15MAXELL LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023564695
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-12-03
Publication Date
2025-12-15
Estimated Expiration
2041-12-03

AI Technical Summary

Technical Problem

Conventional methods for evaluating swallowing dynamics, such as those using a biopsy device, display distance and audio information independently as time-series waveforms, making it difficult to interpret actual swallowing behavior and determine the peak position of the swallowing sound on the thyroid cartilage movement paths during swallowing.

Method used

A biopsy device with a laryngeal displacement detection unit and swallowing sound detection unit that processes detection data to generate two-dimensional or three-dimensional trajectory data, showing the up-down and anterior-posterior movements of the thyroid cartilage, and distinguishes the peak position of the swallowing sound on these paths.

Benefits of technology

Enables non-invasive evaluation of swallowing dynamics by integrating and visualizing thyroid cartilage movements in two or three dimensions, allowing accurate determination of the swallowing sound peak position, thereby facilitating easy and precise assessment of swallowing disorders.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007785801000002
    Figure 0007785801000002
  • Figure 0007785801000003
    Figure 0007785801000003
  • Figure 0007785801000004
    Figure 0007785801000004
Patent Text Reader

Abstract

Provided are a biological examination device, a biological-information analyzing method, and a computer program: that make it possible, by means of a non-invasive examination, to ascertain, at a glance, up-down and front-rear two-dimensional movements of the thyroid cartilage and the hyoid bone accompanied by swallowing sounds as swallowing dynamics; and that make it possible to ascertain, at a glance, a peak position of the swallowing sounds in movement pathways of the thyroid cartilage during swallowing. A biological examination device according to an embodiment of the present invention: identifies, from a fitting result obtained by fitting a model function that models swallowing movements to distance information based on detection data detected by a laryngeal-part displacement detection unit, an up-down movement component associated with an up-down movement of the thyroid cartilage and a front-rear movement component associated with a front-rear movement of the thyroid cartilage; and generates, on the basis of the identified up-down movement component and front-rear movement component, a two-dimensional trajectory data 901 that indicates a behavior trajectory of the thyroid cartilage in an up-down direction and a front-rear direction. In addition, identification display data are generated on the basis of the detection data from a swallowing-sound detection unit, the identification display data making it possible to determine, on the trajectory graph 901, whether the peak of the swallowing sounds is located, in a series of up-down and front-rear movement pathways of the thyroid cartilage during swallowing, in an outward path of the movement pathways, associated with upward and forward movements of the thyroid cartilage, or a return path of the movement pathways, associated with rearward and downward movements of the thyroid cartilage.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a biological testing device for performing an examination related to swallowing of a living body, a biological information analyzing method for analyzing biological information obtained in association with swallowing of a living body, and a computer program. [Background technology]

[0002] Pneumonia is known to be one of the leading causes of death, and aspiration pneumonia caused by dysphagia, a swallowing disorder, accounts for more than 60% of cases.

[0003] The main cause of dysphagia is stroke, and it is known that 80% of acute-stage patients experience dysphagia. It is also known that even without a clear underlying disease such as stroke, the proportion of people with dysphagia increases with age, and in an aging society, aspiration pneumonia and dysphagia are expected to increase in the future.

[0004] For this reason, various diagnostic tests have been attempted to diagnose dysphagia. For example, videofluoroscopic examination of swallowing (VF) is a commonly known method for accurately assessing and understanding dysphagia. In VF, a food bolus containing a contrast agent such as barium sulfate and an X-ray fluoroscopy system are used to monitor the movement of the food bolus and the behavior of the hyoid bone and larynx during swallowing. Because swallowing involves a rapid series of movements, it is generally evaluated by video recording. However, VF requires caution due to the potential risk of aspiration and choking. Furthermore, the need for a large X-ray fluoroscopy system poses problems such as radiation exposure, time constraints, and high costs. Videoendoscopic examination of swallowing (VE), which uses an endoscope to assess dysphagia, also has similar problems as VF. As such, clinical tests such as VF and VE can provide accurate diagnoses because they directly observe throat movements, but they are highly invasive and require specific equipment, so they cannot be easily performed anywhere.

[0005] In response to this, screening tests such as palpation (Repetitive Saliva Swallowing Test (RSST)), auscultation (cervical auscultation), observation (water swallowing test and food test), or subjective assessment using questionnaires are known as simple methods for testing swallowing disorders. However, although these can be performed as routine tests, they have problems such as difficulty in quantitative evaluation and lack of reproducibility and objectivity.

[0006] In light of the above problems, several methods for sharing and recording swallowing status have been proposed in recent years. For example, Patent Document 1 discloses a device that uses a microphone attached to the neck, stores audio data equivalent to auscultation as digital data, and detects swallowing through waveform analysis. Patent Document 2 also discloses a biopsy device that uses a magnetic coil attached to the neck in addition to a microphone, stores audio data and thyroid cartilage movement data during swallowing equivalent to palpation as digital data, and performs a swallowing test on a living subject and displays the results. Specifically, this biopsy device arranges a transmitter coil and a receiver coil to sandwich the thyroid cartilage, thereby measuring the left-right displacement of the thyroid cartilage that occurs in conjunction with the two-dimensional vertical and horizontal movements of the hyoid bone during swallowing as distance information between the coils. This testing method allows distance information equivalent to palpation and auscultation and audio information to be simultaneously and noninvasively acquired, thereby enabling swallowing behavior to be evaluated by combining the distance information and audio information. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2013-017694 A [Patent Document 2] Japanese Patent Application Laid-Open No. 2009-213592 Summary of the Invention [Problem to be solved by the invention]

[0008] The biopsy device of the aforementioned Patent Document 2 displays distance information and audio information independently as time-series waveforms. Therefore, swallowing status is evaluated by comparing two types of waveforms, i.e., a movement waveform based on distance information and a swallowing sound waveform based on audio information, with respect to the timing of temporal changes. However, the movement waveform based on distance information is the result of indirectly observing the behavior of the hyoid bone via the thyroid cartilage. Since the two-dimensional movement of the thyroid cartilage (up, down, front, and back) is indirectly likened to one-dimensional movement (left and right), it is difficult to interpret actual swallowing dynamics from the time-series waveforms. The examiner must infer overall swallowing behavior from the waveform changes of the audio information and distance information. This evaluation format based on the display of two independent time-series waveforms presents a problem in that it is difficult to grasp the specific swallowing behavior at a glance.

[0009] Furthermore, when accurately grasping swallowing behavior, it is also important to determine whether the peak of the swallowing sound occurs on the outward path of the thyroid cartilage, which involves the thyroid cartilage rising and moving forward (the path along which the food bolus, saliva, etc. is swallowed and passes through the esophagus), or on the return path of the thyroid cartilage, which involves the thyroid cartilage moving backward and down (the path along which the food bolus, saliva, etc. passes completely through the esophagus and is sent to the stomach), in the series of paths along which the thyroid cartilage moves up and down and back and forth during swallowing. However, with conventional technologies including Patent Documents 1 and 2, it is not easy to grasp the position of the peak of the swallowing sound on such paths along the thyroid cartilage movement during swallowing.

[0010] The present invention has been made in consideration of the above circumstances, and aims to provide a biopsy device, a bioinformation analysis method, and a computer program that enable a non-invasive examination to grasp at a glance the two-dimensional up-down and back-and-forth movements of the thyroid cartilage and hyoid bone that accompany swallowing sounds as swallowing dynamics, as well as the peak position of the swallowing sound in the path of thyroid cartilage movement during swallowing. [Means for solving the problem]

[0011] In order to solve the above problems, the biopsy device of the present invention comprises a laryngeal displacement detection unit that detects changes in distance between two positions in the larynx of the subject that occur in conjunction with the up-down and front-back movements of the thyroid cartilage during swallowing, a swallowing sound detection unit that detects swallowing sounds when the subject swallows, and a processing unit that processes detection data from the laryngeal displacement detection unit and the swallowing sound detection unit, and the processing unit detects changes in distance between two positions in the larynx that occur in conjunction with the up-down and front-back movements of the thyroid cartilage from a fitting result obtained by fitting a model function that models the swallowing action to distance information based on the detection data detected by the laryngeal displacement detection unit. The swallowing sound detector extracts the anterior-posterior movement components associated with the anterior-posterior movement, and generates two-dimensional or three-dimensional trajectory data that simultaneously shows the up-down and anterior-posterior movement of the thyroid cartilage on a single trajectory graph based on the extracted up-down movement components and anterior-posterior movement components. The swallowing sound detector also generates identification display data that enables the user to determine on the trajectory graph whether the peak of the swallowing sound occurs on the outward path of the movement path that involves the elevation and forward movement of the thyroid cartilage, or on the return path of the movement path that involves the backward movement and downward movement of the thyroid cartilage, in the series of up-down, forward, and backward movement paths of the thyroid cartilage during swallowing.

[0012] The inventors recognized that, with regard to the distance information based on the detection data, i.e., the W-shaped distance waveform 701 (the horizontal axis represents time and the vertical axis represents the distance between the two positions) shown as an example in Figure 11, which indicates the change over time in the distance between two positions in the subject's larynx that occurs in conjunction with the up-down and front-to-back movements of the thyroid cartilage during swallowing, the two-dimensional movements (front-to-back movements and up-down movements) of the thyroid cartilage and hyoid bone are embedded in one-dimensional (left-to-right) space due to the pyramidal shape of the thyroid cartilage, and changed the way the components in the distance waveform 701 were perceived in a unique and different way from conventional methods, thereby discovering an unprecedented, groundbreaking form of information presentation that enables the up-down, front-to-back two-dimensional movements of the thyroid cartilage and hyoid bone that accompany the swallowing sound to be grasped at a glance as swallowing dynamics. Specifically, in the distance waveform 701, a series of movements of the thyroid cartilage from ascent to descent produces a downwardly convex waveform component, while a series of movements of the thyroid cartilage from advance to retreat produces an upwardly convex waveform component. However, unlike the conventional method of regarding this W-shaped distance waveform 701 as a combination of a downwardly convex waveform 710a, an upwardly convex waveform 720, and a downwardly convex waveform 710b as shown in FIG. 11(a), the inventors have recognized this W-shaped distance waveform 701 as a combination of a gentle downwardly convex waveform 710a and a sharp upwardly convex waveform 720 as shown in FIG. 11(b). A fitting result is obtained by fitting a model function that models swallowing behavior to distance waveform 701, regarding it as a superposition with 0, and from this fitting result, an anterior-posterior movement component associated with the anterior-posterior movement of the thyroid cartilage corresponding to the upward convex waveform 720 and an posterior-posterior movement component associated with the up-and-down movement of the thyroid cartilage corresponding to the downward convex waveform 710 are extracted, and a bioinformation analysis form is found that generates two-dimensional trajectory data that shows the behavior trajectories of the thyroid cartilage in the up-and-down and anterior-posterior directions based on these extracted posterior-and-posterior movement components and anterior-and-posterior movement components.

[0013] According to the above-described configuration of the present invention, a model function that models swallowing behavior is fitted to distance information based on detection data detected by a laryngeal displacement detection unit to obtain fitting results. This makes it possible to non-invasively reproduce the movement of the thyroid cartilage (hyoid bone) in two dimensions (modeling of swallowing behavior). In addition, behavior components related to all movement directions of the thyroid cartilage during swallowing, i.e., two anterior-posterior movement components and an axial movement component corresponding to the up-down and posterior-anterior movement, respectively, are extracted from the fitting results, and two-dimensional or three-dimensional trajectory data is generated based on these two components, which simultaneously shows the up-down and posterior-anterior movement of the thyroid cartilage in a single trajectory graph. This makes it possible to grasp at a glance the up-down, posterior-anterior movement of the thyroid cartilage (hyoid bone) as two-dimensional or three-dimensional swallowing dynamics (to grasp at a glance the specific swallowing behavior) without having to infer comprehensive swallowing behavior as in Patent Document 2 mentioned above. That is, according to the present invention, swallowing dynamics consisting of two physical pieces of information (vertical movement information and anterior-posterior movement information of the thyroid cartilage) can be integrated and visualized into a single trajectory graph by modeling and component decomposition of the swallowing movement, and the vertical and posterior movement of the thyroid cartilage (hyoid bone) can be grasped at a glance in two or three dimensions. As a result, evaluation of swallowing disorders can be easily performed without requiring expertise.

[0014] In this case, the two-dimensional trajectory data is preferably generated as coordinate data shown on a coordinate plane defined by two mutually orthogonal coordinate axes, one of which corresponds to the trajectory data values ​​of the anterior-posterior movement component and the other to the trajectory data values ​​of the vertical movement component. Furthermore, the three-dimensional trajectory data is preferably generated as coordinate data shown in a coordinate space defined by three mutually orthogonal coordinate axes, the three of which preferably include a coordinate axis corresponding to the trajectory data values ​​of the anterior-posterior movement component, a coordinate axis corresponding to the trajectory data values ​​of the vertical movement component, and a coordinate axis indicating the swallowing action time. In fact, the present inventors have confirmed that a display form based on such trajectory data values ​​substantially corresponds to the trajectory of hyoid movement in swallowing dynamics analysis, such as hyoid movement, using videofluoroscopic swallowing (VF).

[0015] In addition, the above-described configuration of the present invention allows the user to distinguish, by means of a distinctive display, on a trajectory graph, whether the swallowing sound peak occurs on the outward path of the thyroid cartilage movement, which involves the thyroid cartilage rising and moving forward, or on the inward path of the thyroid cartilage movement, which involves the thyroid cartilage moving backward and down. This allows the user to grasp at a glance the position of the swallowing sound peak on the thyroid cartilage movement path during swallowing, enabling accurate evaluation of swallowing behavior. This distinctive display is particularly useful when, in a two-dimensional trajectory graph display (two-dimensional still image) based on two-dimensional trajectory data, the position of the swallowing sound peak is close to the coordinate origin, making it difficult to determine whether the swallowing sound peak occurs on the outward path or the inward path of the thyroid cartilage movement path. Furthermore, in a two-dimensional trajectory graph display based on two-dimensional trajectory data, it may be difficult to intuitively understand in which direction the trajectory progressed, so it is preferable that the processing unit generates reference display data for displaying reference information indicating the transition direction (progression direction) of the trajectory graph together with the trajectory graph. Examples of such reference display data include data for displaying an icon indicating the transition direction of the trajectory graph, or data for displaying the progress of the trajectory graph as a moving image (animation).

[0016] In the above configuration, the "distinguishing display" may be a display that distinguishes the plot (mark) indicating the swallowing sound peak position from the plots of other data values ​​by color, size, a mark such as an arrow, or letters, or a display that indicates the swallowing sound peak position with a dot on a trajectory graph with colors that differentiate the forward and backward movements of the trajectory graph. In short, any display format may be used as long as it allows a user to instantly determine whether the swallowing sound peak is located on the forward or backward movement of the thyroid cartilage. Furthermore, the laryngeal displacement detection unit may employ any detection format that can detect changes in the distance between two positions on the subject's larynx that occur due to the up-down and down-front and forward-backward movements of the thyroid cartilage during swallowing. For example, the laryngeal displacement detection unit may be configured with a transmitter coil and a receiver coil that are positioned to sandwich the thyroid cartilage from both sides and transmit and receive high-frequency signals. Alternatively, the change in distance may be detected by three-dimensionally capturing an image of the larynx (thyroid cartilage) using a stereo camera or the like and analyzing the image data.

[0017] In the above configuration, the processing unit may generate two-dimensional trajectory data that separately indicates the trajectories of the vertical and anterior-posterior movements of the thyroid cartilage over time, based on the vertical movement component and the anterior-posterior movement component. This makes it possible to separately grasp the trajectories of the vertical and anterior-posterior movements of the thyroid cartilage, which may contribute to a detailed analysis of swallowing movements.

[0018] Furthermore, in the above configuration, the processing unit may generate a swallowing sound waveform that indicates changes in the amplitude of the swallowing sound over time based on the detection data detected by the swallowing sound detection unit, and may also generate distinguishable display data that temporally associates the swallowing sound waveform with the trajectory graph and distinguishably displays the plot of each trajectory data value on the trajectory graph according to the magnitude of the amplitude of the swallowing sound. This allows for visualization of laryngeal behavior and swallowing sound changes in a single trajectory graph based on two pieces of physical information (distance information and audio information) obtained from the laryngeal displacement detection unit and the swallowing sound detection unit, making it possible to non-invasively understand swallowing dynamics, such as the timing of the swallowing action and swallowing sound, at a glance.In addition, the plots of each trajectory data value on the trajectory graph are displayed in a distinctive manner according to the amplitude of the swallowing sound, making it possible to visually see at a glance the timing at which the swallowing sound was emitted and to determine at a glance the timing at which a substance taken into the mouth was sent from the esophagus to the stomach.

[0019] In the above configuration, the "distinguishing display" may be any display format that allows distinguishing between trajectory data values ​​with different swallowing sound amplitudes, such as displaying the plot of each trajectory data value in a different color depending on the amplitude of the swallowing sound, or changing the size or shape of the plot (mark) of each trajectory data value depending on the amplitude of the swallowing sound.

[0020] In the above configuration, the processing unit may generate supplemental display data for superimposing supplemental information on the trajectory graph, including predetermined feature points associated with the fitting results, predetermined feature points associated with the swallowing sound waveform, and the occurrence times of the trajectory data values ​​plotted on the trajectory graph. This allows the trajectory graph display to be supplemented with supplemental information related to laryngeal behavior and swallowing sound changes, thereby increasing the amount of information that can be read from the trajectory graph. This allows for more accurate and rapid evaluation of swallowing disorders. Note that "feature points" may also include singular points and inflection points in the waveform, including the upper and lower peak values ​​of the fitting results (e.g., the fitted movement waveform) and the swallowing sound waveform or a waveform related thereto.

[0021] In the above configuration, the processing unit may generate reference display data for displaying reference information including predetermined feature values ​​calculated from the trajectory graph together with the trajectory graph. This allows information that is difficult to grasp from the trajectory graph alone to be displayed together with the trajectory graph, thereby increasing the understandability of the trajectory graph and contributing to accurate and rapid evaluation of swallowing disorders. Examples of the "feature value" include the maximum amount of anterior-posterior displacement of the thyroid cartilage, the maximum amount of vertical displacement, the time difference between the time when the movement waveform and the swallowing sound waveform reach their respective maximum values, and the ratio of the time difference to the variance of the anterior-posterior displacement of the thyroid cartilage.

[0022] The present invention also provides a biological information analysis method and a computer program having the above-mentioned features. Such a biological information analysis method and computer program can provide the same effects as the above-mentioned biological testing device. [Effects of the Invention]

[0023] According to the present invention, a model function that models swallowing behavior is fitted to distance information based on detection data detected by a laryngeal displacement detection unit, and from the fitting results, vertical movement components associated with the vertical movement of the thyroid cartilage and anterior-posterior movement components associated with the anterior-posterior movement of the thyroid cartilage are extracted, and two-dimensional trajectory data indicating the vertical and posterior movement trajectories of the thyroid cartilage are generated based on these extracted vertical movement components and anterior-posterior movement components. This makes it possible to grasp at a glance the two-dimensional vertical and posterior movements of the thyroid cartilage and hyoid bone accompanying swallowing sounds as swallowing dynamics through a non-invasive test. Furthermore, in the series of vertical and posterior movement paths of the thyroid cartilage during swallowing, it is possible to distinguish on a trajectory graph whether the swallowing sound peak occurs on the outgoing path involving the elevation and forward movement of the thyroid cartilage or the returning path involving the backward and downward movement of the thyroid cartilage, by a distinctive display. This makes it possible to grasp at a glance the position of the swallowing sound peak along the thyroid cartilage movement path during swallowing, enabling accurate evaluation of swallowing behavior. [Brief explanation of the drawings]

[0024] [Figure 1] 1 is a functional block diagram of a biological testing device according to an embodiment of the present invention. [Figure 2] 2 is a schematic perspective view of a flexible holder for holding a laryngeal displacement detection unit of the biological testing device of FIG. 1. FIG. [Figure 3] FIG. 2 is a functional block diagram of a computer of the biological testing device of FIG. 1. [Figure 4] 4 is a flowchart showing the flow of processing by a motion analysis unit of the processing unit of the computer in FIG. 3. [Figure 5] 4 is a flowchart showing the flow of processing by a voice analysis unit of the processing unit of the computer in FIG. 3. [Figure 6] 4 is a flowchart showing the flow of processing by an analysis unit of the processing unit of the computer in FIG. 3. [Figure 7] 2 is a distance waveform diagram based on typical distance information detected by a laryngeal displacement detection unit of the biological testing device of FIG. 1. FIG. [Figure 8] (a) is distance information based on detection data detected by the laryngeal displacement detection unit of the biopsy device of Figure 1 and a fitted motion waveform (fitted waveform) obtained from the distance information, and (b) is a component waveform that individually shows the behavior trajectories of the thyroid cartilage over time in the up-down and anterior-posterior directions. [Figure 9] 2 is a swallowing sound waveform diagram including an envelope based on typical audio information detected by the swallowing sound detection unit of the biological testing device of FIG. 1. FIG. [Figure 10] 2 shows an example of a trajectory graph displayed based on two-dimensional trajectory data obtained by the processing unit of the biological testing device of FIG. 1. [Figure 11] 1A is a waveform diagram showing a conventional method of capturing components in a distance waveform, and FIG. 1B is a waveform diagram showing a method of capturing components in a distance waveform according to the present invention. [Figure 12] FIG. 10 is a schematic diagram showing an example of an identification display that enables one to determine on a trajectory graph whether the peak of the swallowing sound is on the outward or inward path of the thyroid cartilage movement path. [Figure 13]FIG. 10 is a schematic diagram showing another example of an identification display that enables one to determine on a trajectory graph whether the peak of the swallowing sound is on the outward or inward path of the thyroid cartilage movement path. [Figure 14] FIG. 10 is a diagram showing another example of reference information indicating the transition direction of the trajectory graph. DETAILED DESCRIPTION OF THE INVENTION

[0025] An embodiment of the present invention will be described below with reference to the drawings. This embodiment provides the following technologies, contributing to the development of medical care and the realization of a healthy society through highly advanced technology. The realization of this testing device and analysis method will contribute to "9. Build resilient infrastructure, promote inclusive and sustainable industrialization, innovate and foster innovation," one of the Sustainable Development Goals (SDGs) advocated by the United Nations. 1 is a functional block diagram showing an example of the configuration of a biological testing device 100 according to an embodiment of the present invention. As shown in the figure, the biological testing device 100 has a transmitter coil 102 and a receiver coil 103 as a laryngeal displacement detector that detects a change in distance between two positions in the larynx (a biological part surrounding the thyroid cartilage) of a subject (subject) 101 that occurs in conjunction with the up-down and front-back movement of the thyroid cartilage (commonly known as the Adam's apple) when the subject (subject) 101 swallows, and a microphone 106 as a swallowing sound detector that detects swallowing sounds when the subject 101 swallows. These coils 102, 103 and microphone 106 are held by a flexible holder 113, which will be described later in relation to FIG. 2.

[0026] The transmitting coil 102 and the receiving coil 103 are arranged facing each other so as to sandwich the thyroid cartilage from both sides, with the transmitting coil 102 connected to a transmitter 104 and the receiving coil 103 connected to a receiver 105. The microphone 106 is arranged near the thyroid cartilage of the subject 101, electrically connected to a detection circuit 107 that detects swallowing sounds picked up by the microphone 106 during swallowing, and operates by receiving power supply, etc. from the detection circuit 107. The microphone 106 is preferably a microphone that uses, for example, a piezoelectric element so as to pick up as little ambient sound as possible other than swallowing sounds, but may also be a condenser microphone, etc.

[0027] The biological testing device 100 also includes a control device 108, a computer 109, a display device 110, an external storage device 111, and an input device 112. The control device 108 controls the operation of the transmitter 104, the receiver 105, the detection circuit 107, the computer 109, and the external storage device 111, and controls the power supply and the timing of signal transmission and reception. The computer 109 is an information processing device equipped with a CPU, memory, an internal storage device, etc., and performs various arithmetic processing. The control and arithmetic processing performed by the computer 109 are realized by the CPU executing a predetermined program. However, some of the arithmetic processing can also be realized by hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The display device 110, the external storage device 111, and the input device 112 are electrically connected to the computer 109.

[0028] The display device 110 is an interface that displays measurement waveforms, analysis information generated by the computer 109, and the like. The display device 110 may be, for example, a liquid crystal display, an EL display, a plasma display, a CRT display, or a projector, but is not limited to these. The display device 110 may also be mounted on a tablet terminal, a head-mounted display, a wearable device, or the like. A specific function may be notified by an LED, a sound, or the like. The external storage device 111, together with the internal storage device, stores data used in various arithmetic processing operations performed by the computer 109, data obtained by the arithmetic processing, and conditions and parameters input via the input device 112. The input device 112 is an interface through which an operator inputs conditions and the like required for the measurements and arithmetic processing operations performed in this embodiment.

[0029] In this configuration, a high-frequency signal generated by transmitter 104 is transmitted to transmitting coil 102, causing transmitting coil 102 to radiate a high-frequency magnetic field, and the signal received by receiving coil 103 is then received by receiver 105. The signal received by receiver 105 is sent to computer 109 as a measured output voltage value of the voltage between the coils. Meanwhile, swallowing sounds captured by microphone 106 are detected by detection circuit 107 and converted into a voltage signal, which is input from detection circuit 107 to computer 109 as a measured output voltage value.

[0030] 2 shows the flexible holder 113 that holds the transmit / receive coils 102, 103 and the microphone 106. This flexible holder 113 is made of any flexible material such as various resins, and as shown in the figure, is composed of a substantially annular neck attachment member 202 that is adapted to be attached to the neck of the subject 101 using its open end, and a pair of arc-shaped sensor holding members 203a, 203b that are positioned along substantially the same arc inside the neck attachment member 202, with the neck attachment member 202 integrally joined to hold one end of the pair of sensor holding members 203a, 203b on both sides inside the neck attachment member 202, and the other ends of the sensor holding members 203a, 203b are open so that they can be positioned near the larynx of the subject 101. Sensor units 204a and 204b are arranged at the other end of each of the pair of sensor holding members 203a and 203b, and these sensor units 204a and 204b are abutted against the larynx of the subject 101, and together with each sensor holding member 203a and 203b, which is positioned without coming into contact with the neck of the subject 101, can follow the swallowing movement (movement of the thyroid cartilage, etc.) independently of the neck-attached member 202.

[0031] A transmitter coil 102 is fixedly disposed inside one of the sensor units 204a and 204b, and a receiver coil 103 is fixedly disposed inside the other of the sensor units 204a and 204b. In particular, in this embodiment, the transmitter coil 102 and the receiver coil 103 are attached to the sensor units 204a and 204b so as to be oriented so as to face each other easily (close to the vertical direction of the neck surface of the subject 101), thereby enabling detection with a high signal-to-noise (SN) ratio. Therefore, the microphone 106 can be positioned approximately perpendicular to the transmitter coil 102 or the receiver coil 103, thereby reducing the magnetic field noise generated by the microphone 106 from being mixed into the transmitter and / or receiver coils 102 and 103. However, the corresponding positions of the transmitter coil 102 and the receiver coil 103 and the position perpendicular to the microphone are not limited to the above-described positions, and may be positioned so as to achieve detection with a sufficiently high SN ratio.

[0032] Furthermore, at the opposing end portions (portions of the neck attachment member 202 positioned on the back of the neck of the subject 101) that form the open end of the neck attachment member 202, pressing portions 205a and 205b that are to be placed against the neck of the subject 101 are formed in a shape suitable for pressing, such as a cylindrical or spherical shape. These two pressing portions 205a and 205b and the two sensor units 204a and 204b provided at the other ends of the sensor holding members 203a and 203b provide four pressing points, allowing the flexible holder 113 to be easily attached to the neck of the subject 101 regardless of the size of the neck. Electrical wiring 201a and 201b extending from the transmitting and receiving coils 102 and 103 and the microphone 106 built into the sensor units 204a and 204b are electrically connected to the transmitter 104, receiver 105, and detection circuit 107 shown in FIG. 1, respectively.

[0033] 3 shows a functional block diagram of the computer 109. As shown in the figure, the computer 109 includes a swallowing measurement unit 410, a processing unit 420, and a display unit 430. The swallowing measurement unit 410 measures swallowing movements and swallowing sounds using the transmitting coil 102, receiving coil 103, transmitter 104, receiver 105, microphone 106, detection circuit 107, and control device 108 described in relation to FIG. 1 (a laryngeal displacement detection step and a swallowing sound detection step). The processing unit 420 also includes a movement analysis unit 421 that analyzes distance information, a voice analysis unit 422 that analyzes swallowing sounds, which are voice information, and an analysis unit 423 that combines and analyzes the distance information and the swallowing sounds, and processes the data measured by the swallowing measurement unit 410 using these units (a processing step). Specifically, as will be described later, the processing unit 420 obtains a fitting result (in this embodiment, a fitted waveform 1103 shown in (a) of FIG. 8 to be described later) by fitting a model function (in this embodiment, equation (1) to be described later) that models the swallowing action to distance information (in this embodiment, data showing a change over time in the distance between the coils 102 and 103 that are arranged so as to sandwich the thyroid cartilage of the subject 101 therebetween (distance waveform 701 shown in FIG. 7 to be described later) based on detection data detected by the transmitting and receiving coils 102 and 103, and calculates from this fitting result a forward-backward movement component (in this embodiment, a fitted waveform 1103 shown in (a) of FIG. 8 to be described later) that accompanies the forward-backward movement of the thyroid cartilage. In this embodiment, a front-to-back movement component waveform 1105 shown in (b) of Figure 8 described later or the data values ​​forming it) and an up-and-down movement component associated with the up-and-down movement of the thyroid cartilage (in this embodiment, a up-and-down movement component waveform 1106 shown in (b) of Figure 8 described later or the data values ​​forming it) are extracted, and two-dimensional trajectory data (in this embodiment, data for forming trajectory graph 901 shown in (b) of Figure 8 described later) and three-dimensional trajectory data (in this embodiment, data for forming trajectory graph 901A shown in Figure 13 described later) showing the behavior trajectory of the thyroid cartilage in the up-and-down and front-to-back directions are generated based on these extracted up-and-down movement components and front-to-back movement components.Furthermore, as will be described later, the processing unit 420 generates distinguishable display data that enables the determination on the trajectory graph 901 of whether the peak of the swallowing sound exists in the outward movement path involving the elevation and forward movement of the thyroid cartilage, or the return movement path involving the backward movement and downward movement of the thyroid cartilage (see FIG. 7 ), in the series of up-down and back-and-forth movement paths of the thyroid cartilage during swallowing, based on the detection data from the microphone 106. Furthermore, the processing unit 420 generates a swallowing sound waveform (in this embodiment, the swallowing sound waveform 801 shown in FIG. 9 , which will be described later) that indicates the change in the amplitude of the swallowing sound over time based on the detection data detected by the microphone 106, and also generates distinguishable display data for temporally associating the swallowing sound waveform with the trajectory graph and distinguishably displaying plots of each trajectory data value on the trajectory graph according to the magnitude of the amplitude of the swallowing sound. Furthermore, the display unit 430 displays the information (data) measured and processed by the swallowing measurement unit 410 and the processing unit 420 on the display device 110 (display step). The swallowing measurement unit 410, the processing unit 420, and the display unit 430 operate independently.

[0034] 4 shows the processing flow of the motion analysis unit 421 of the processing unit 420 of the computer 109 in FIG. 3. The motion analysis unit 421 processes detection data detected by the transmit / receive coils 102 and 103. Specifically, first, in step S501, smoothing is performed on the data measured by the swallowing measurement unit 410. In particular, in this embodiment, smoothing is performed using piecewise polynomial approximation with a Savitzky-Golay filter. In this case, smoothing is performed by setting the number of windows and the degree of the polynomial to, for example, 5 and 51, respectively. Note that the smoothing method may be, for example, a simple moving average, and the present invention is not limited thereto.

[0035] Next, in step S502, fitting is performed on the measurement signal smoothed in step S501. In relation to this, FIG. 7 shows a typical example of a distance waveform 701 indicating a change over time in the distance between the transmit / receive coils 102 and 103, which is the distance between two positions in the larynx of the subject 101. The measured distance waveform 701 is the result of observing two-dimensional movements (front-back movement and up-down movement) of the thyroid cartilage (hyoid bone) in one dimension (left-right). Because the thyroid cartilage has a cone-like shape, the waveform exhibits a W-shaped shape as shown in the figure. Specifically, from the start point (time T0) 702 when the subject 101 starts swallowing a bolus of food, the thyroid cartilage rises as the bolus is sent into the esophagus. This causes the distance between the transmit / receive coils 102 and 103 to narrow from D0 to D1, and the distance waveform 701 reaches a first valley (first lower limit peak value; time T1) 703. During this bolus delivery process, the epiglottis of the subject 101 moves downward, blocking the path from the nasal cavity to the airway. Thereafter, as the bolus passes through the esophagus, the thyroid cartilage moves forward (in the direction the subject's face is facing) to open the esophagus, causing the distance between the transmit / receive coils 102 and 103 to increase from D1 to D2, and the distance waveform 701 transitions from a first valley 703 to a peak (upper limit peak value; time T2) 704. Thus, the movement path (the section of the distance waveform 701 from time T0 to time T2) accompanied by the elevation and forward movement of the thyroid cartilage as the bolus (or saliva) is swallowed and passes through the esophagus forms the outward movement of the swallowing motion. Then, when the bolus has completely passed through the esophagus (epiglottis) and been sent to the stomach, the thyroid cartilage moves backward as the epiglottis moves upward, causing the distance between the transmit / receive coils 102 and 103 to narrow from D2 to D3, and the distance waveform 701 transitions from the peak 704 to the second valley (second lower limit peak value; time T3) 705. Thereafter, the thyroid cartilage descends to return the epiglottis and thyroid cartilage to their original positions, causing the distance between the transmit / receive coils 102 and 103 to widen from D3 to D4, and the distance waveform 701 transitions from the second valley 705 to the end point (time T4) 706.In this way, the movement path (the section of distance waveform 701 from time T2 to time T4) that involves the backward movement and downward movement of the thyroid cartilage when the food bolus (or saliva, etc.) passes completely through the esophagus and is sent to the stomach forms the return path of the swallowing movement.

[0036] As can be seen from the above, such distance waveform 701 produces a downwardly convex waveform component during a series of movements of the thyroid cartilage from ascending to descending, while producing an upwardly convex waveform component during a series of movements of the thyroid cartilage from advancing to retreating. Therefore, in this embodiment, the W-shaped distance waveform 701 is considered to be a superposition of a gently downwardly convex waveform 710 (corresponding to the vertical movement component waveform 1106 shown in FIG. 8(b)) and a sharply upwardly convex waveform 720 (corresponding to the anterior-posterior movement component waveform 1105 shown in FIG. 8(b)), as distinguished by the short-dashed line and the long-dashed line in FIG. 7, and is modeled as shown in the following equation (1):

number

[0037] In this embodiment, the longitudinal and vertical components rAP and rHF are modeled using a normal distribution, and the trend component d(t) is modeled using a linear equation. However, these models may be autoregressive models or nonlinear models, and the present invention is not limited by these. In this modeling of the present embodiment, each component is found by parameter fitting using a mathematical optimization method. In this embodiment, parameter fitting is performed using a nonlinear least squares method, but the present invention is not limited by this. In addition, when performing parameter fitting, a constraint may be imposed, for example, that the variance value of rAP is smaller than the variance value of rHF.

[0038] The results of fitting a model function (Equation (1)) using such a normal distribution are shown in Figure 8(a). In the figure, waveform 1102 formed by data values ​​represented by dots corresponds to distance waveform 701 shown in Figure 7, and waveform 1103 represented by a solid line is an operating waveform (fitted waveform) obtained by fitting a model function to the distance information forming waveform 1102. Here, the horizontal axis represents time, and the vertical axis represents normalized amplitude based on the distance between the coils shown in Figure 7.

[0039] After the signal fitting step S502 is completed, parameters are extracted from the fitted model function in step S503. In this embodiment, the behavior of the thyroid cartilage in the anterior-posterior direction and the posterior-posterior direction is modeled using independent normal distributions, so in step S503, the "amplitude," "mean value," and "variance" of each of these behaviors are extracted. The "amplitude" corresponds to the magnitude of the thyroid cartilage movement, the "mean value" corresponds to the time when the movement occurred, and the "variance" corresponds to the duration of the movement.

[0040] In relation to this, Fig. 8(b) shows waveforms (anterior-posterior motion component waveform 1105 with an upward convexity and anterior-posterior motion component waveform 1106 with a downward convexity) in which only the anterior-posterior and posterior-vertical components of the thyroid cartilage are individually extracted and displayed from the motion waveform (fitted waveform) 1103 shown in Fig. 8(a). In this way, the processing unit 420 including the motion analysis unit 421 of the biological testing device 100 of this embodiment is capable of generating two-dimensional trajectory data that individually show the behavior trajectories of the thyroid cartilage over time in the vertical and posterior directions, based on the vertical and posterior motion components.

[0041] After the component extraction step S503 is completed, in step S504, feature points of the W-shaped waveform, i.e., feature points corresponding to peak points 702-706 (data values ​​D0-D4 and T0-T4) on the distance waveform 701 in FIG. 7, are extracted from the waveform reconstructed using the parameters extracted in step S503. Specifically, in this embodiment, the measurement signal is modeled and separated into components as shown in Equation (1), so feature points can be easily extracted without taking noise and trend components into account. More specifically, as an example, T2 is acquired as the average value of rAP, T1 and T3 are acquired as the times showing the minimum values ​​before and after T2, respectively, and T0 and T4 are acquired as the times of points advanced by the variance value in the negative and positive directions from the average value of rHF, respectively. Then, D0-D4 are acquired as values ​​corresponding to times T0-T4, respectively.

[0042] After the peak value detection step S504 is completed, in step S505, the waveform, parameters, feature points, etc. calculated in the above-described steps S501 to S504 are stored in the internal storage device of the computer 109 and / or the external storage device 111. Note that the above-described steps S501 to S505 may be performed while the swallowing action and swallowing sound are being measured by the swallowing measurement unit 410, or may be performed multiple times.

[0043] 5 shows the processing flow of the voice analysis unit 422 of the processing unit 420 of the computer 109 in FIG. 3. As shown in the figure, in step S601, a rectification process is performed on the voice information (a voice signal that generally includes both positive and negative values) measured from the microphone 106 through the swallowing measurement unit 410. Here, the rectification process refers to a process of taking the absolute value and converting negative values ​​to positive values. FIG. 9 shows a swallowing sound waveform 801 obtained by rectifying typical voice information.

[0044] In step S602, the rectified signal obtained in step S601 is logarithmically transformed. This process reduces the influence of spike-like signals mixed into swallowing sounds.

[0045] In step S603, the logarithmically transformed signal obtained in step S602 is smoothed. In particular, in this embodiment, the smoothing process is performed using a moving average, and the window width of the moving average is set to 400 points. Note that the present invention is not limited to this smoothing method.

[0046] In step S604, the smoothed signal obtained in step S603 is subjected to exponential transformation. This allows a waveform representing the envelope of the originally measured speech information to be obtained. In Figure 9, the dashed line shows an envelope 802 obtained from such typical speech information (swallowing sound waveform 801).

[0047] In step S605, the envelope signal obtained in step S604 is resampled. Specifically, in this embodiment, since the sampling frequencies of the voice information and the distance information in the swallowing measurement unit 410 shown in Fig. 3 are 4000 Hz and 100 Hz, respectively, the envelope signal is resampled to 1 / 40 to match the sampling frequency of the distance information.

[0048] In step S606, a maximum value is found as a feature point for the resampled envelope signal obtained in step S605. This is because the section where the maximum amplitude is obtained in the swallowing sound signal (swallowing sound waveform 801) is thought to indicate the flow of ingested material and is an important feature of the swallowing sound. Therefore, in step S606, time S2 corresponding to peak point 803 showing the maximum amplitude for envelope 802 shown in FIG. 9 is obtained.

[0049] In step S607, the swallowing sound section of the resampled envelope signal obtained in step S605 is determined. That is, to obtain the time section Ts in envelope 802 where swallowing sounds occur, the times at both ends of the swallowing sound section are acquired. Specifically, an amplitude threshold 804, indicated by a dashed line in FIG. 9, is set, and points crossing the threshold 804 below the maximum value (peak point 803) obtained in step S606, i.e., times S1 and S3 corresponding to an earlier start point 805 and a later end point 806, respectively, are acquired as feature points. In this embodiment, the threshold 804 is calculated by adding the median value to the normalized median absolute deviation. Note that the present invention is not limited by the method for setting the threshold 804; for example, a value obtained by adding the standard deviation to the mean value may be used.

[0050] Finally, in step S608, the waveforms, feature quantities, etc. calculated in the above-described steps S601 to S607 are stored in the internal storage device of the computer 109 and / or the external storage device 111. Note that the above-described steps S601 to S608 may be performed while the swallowing measurement unit 410 is measuring the swallowing action and swallowing sound, or may be performed multiple times.

[0051] Fig. 6 shows the flow of processing by the analysis unit 423 of the processing unit 420 of the computer 109 in Fig. 3. As shown in the figure, in step S1001, the maximum displacement (maximum value) in the forward / backward and upward directions of the motion waveform 1103 (or the distance waveform 701), which is the fitted waveform, is calculated.

[0052] In step S1002, the signed curvature is calculated for each point on the trajectory graph 901, which will be described in detail below with reference to Fig. 10. In this step S1002, the time progression direction (transition direction) of the trajectory graph 901 is extracted, and the signed curvature for each point on the trajectory graph 901 is calculated in order to extract the point at which the maximum displacement occurs.

[0053] In step S1003, the sign of the signed curvature obtained in step S1002 is acquired. Specifically, since the amplitude of the curvature is greatest at the point farthest from the coordinate origin in the trajectory graph 901, the curvature of each point on the trajectory graph 901 is calculated, and then the sign of the point with the greatest curvature is acquired. By determining the sign such that counterclockwise rotation is positive and clockwise rotation is negative in the coordinate system, the time progression direction can be uniquely determined. Note that the factor determining whether the sign is positive or negative is the magnitude of the average values ​​of the forward-backward component rAP and the upward-downward component rHF. In the trajectory graph 901 in FIG. 10 (described later) where the time progression direction is counterclockwise, this indicates that the average value of the displacement in the forward-backward direction (i.e., the time at which it reaches its maximum value) is earlier than that in the upward-downward direction.

[0054] In step S1004, the geometric distance from the origin of coordinates to the point where the maximum value of the signed curvature calculated in step S1002 is obtained is obtained. In the trajectory graph 901, the amplitude of the curvature is maximum at the point farthest from the origin of coordinates, so the geometric distance from the point where the amplitude of the curvature is maximum to the origin of coordinates is calculated. This makes it possible to obtain the point (time) at which the displacement is greatest when the components of the thyroid cartilage in the up-down direction and the anterior-posterior direction are combined.

[0055] In step S1005, the time difference between the time when the voice information reaches its maximum value and the time when the distance information reaches its maximum value in the forward and backward directions is obtained. This is because the time difference when the maximum value is reached is an important parameter in characterizing the swallowing state. In this embodiment, as can be seen from the display format of the trajectory graph 901 described below, this parameter can not only be visually grasped, but can also be displayed as a quantitative value. Note that the present invention is not limited to these quantitative values; for example, the area of ​​the region surrounded by the trajectory graph may be displayed as a feature.

[0056] In step S1006, the ratio (ratio of time difference to variance) of the time difference obtained in step S1005 is obtained based on the variance of the model showing the anterior-posterior component of the distance information (anterior-posterior dynamic component waveform 1105 shown in FIG. 8(b)). In the healthy subject model, swallowing sounds occur at the timing when the thyroid cartilage advances, so in step S1006, the ratio is calculated to indicate the degree of deviation in swallowing sound occurrence within an individual.

[0057] Finally, in step S1007, the waveforms, features, etc. calculated in the above-mentioned steps S1001 to S1006 are stored in the internal storage device of the computer 109 and / or the external storage device 111. Note that the above-mentioned steps S1001 to S1007 may be performed while the swallowing action and swallowing sound are being measured by the swallowing measurement unit 410, or may be performed multiple times.

[0058] Based on the above processing steps, the processing unit 420 is further configured to, for example, generate two-dimensional trajectory data that simultaneously shows the behavior of the thyroid cartilage in the up-down direction and the front-back direction in one trajectory graph 901 (see FIG. 10 ) based on the above-mentioned vertical movement component and front-back movement component. Specifically, such two-dimensional trajectory data is generated as coordinate data shown on a coordinate plane defined by two coordinate axes that are orthogonal to each other, one coordinate axis corresponding to the trajectory data values ​​of the front-back movement component, and the other coordinate axis corresponding to the trajectory data values ​​of the up-down movement component. 10, based on the signal fitting (step S502 in FIG. 4) and component extraction (step S503 in FIG. 4) by the motion analysis unit 421, the data values ​​on the vertical motion component waveform 1106 and the data values ​​on the longitudinal motion component waveform 1105 are associated with each other over time, and the horizontal axis represents the trajectory data values ​​of the longitudinal motion component (displacement in the longitudinal direction; normalized amplitude in the longitudinal motion component waveform 1105), while the vertical axis represents the trajectory data values ​​of the vertical motion component (displacement in the vertical direction; normalized amplitude in the vertical motion component waveform 1106). That is, the horizontal axis represents the value of a normal distribution having parameters extracted for the rAP of equation (1) in step S503 in FIG. 4, and the vertical axis represents the value of a normal distribution having parameters extracted for the rHF of equation (1).

[0059] 10 is displayed on the display device 110 via the display unit 430 of the computer 109. In particular, in this embodiment, the plots of each trajectory data value on the trajectory graph 901 are displayed in a distinctive manner, for example, in different colors, depending on the amplitude of the swallowing sound. To achieve this distinctive display, the processing unit 420 generates a swallowing sound waveform 801 and an envelope 802 that indicate changes in the amplitude of the swallowing sound over time based on the detection data detected through the microphone 106, as described above, and generates distinctive display data for temporally associating the swallowing sound waveform 801 or the envelope 802 with the trajectory graph 901 to distinctively display each plot of the trajectory data value on the trajectory graph 901 depending on the amplitude of the swallowing sound. In connection with this distinctive display, in this embodiment, which uses color-coded display, a reference bar graph 909 is displayed adjacent to the trajectory graph 901, indicating how the color changes depending on the magnitude of the swallowing sound amplitude value along the vertical axis. For example, in this example, the greater the amplitude of the swallowing sound, the more yellow the color, and the smaller the amplitude, the more blue the color. Alternatively, the distinguishable display may be in black and white, with the color becoming lighter as the amplitude increases. Note that the distinguishable display is not limited to this, and any display form may be used as long as it allows distinguishing between trajectory data values ​​with different swallowing sound amplitudes, such as by changing the size or shape of the plot (mark) of each trajectory data value depending on the amplitude of the swallowing sound.

[0060] Trajectory graph 901, which plots trajectory data values ​​as a time-series scatter diagram, displays the behavior of the thyroid cartilage in the anterior-posterior direction and the posterior-posterior direction on two coordinate axes, allowing the behavior of the thyroid cartilage during swallowing to be understood at a glance. Also, by displaying the characteristics of swallowing sound information in addition to the behavior of the swallowing action on a single trajectory graph 901, it is possible to visually confirm the point in time at which the swallowing sound occurred relative to the behavior of the thyroid cartilage, allowing not only a quantitative understanding of the swallowing action but also a glance at the deviation of the swallowing sound from the normal state and the power of the swallowing sound.

[0061] Moreover, various auxiliary information is added and displayed on this trajectory graph 901. For this purpose, in this embodiment, the processing unit 420 generates supplemental display data for superimposing supplemental information on the trajectory graph 901, including predetermined feature points associated with the movement waveform 1103 (or distance waveform 701), predetermined feature points associated with the swallowing sound waveform 801 (or envelope 802), and the occurrence times of the trajectory data values ​​plotted on the trajectory graph 901, and also generates reference display data for displaying reference information, including the movement direction of the trajectory graph 901 and predetermined feature amounts calculated from the trajectory graph 901, together with the trajectory graph 901.

[0062] Specifically, regarding such auxiliary display, in FIG. 10 , 902 is an arrow indicating the direction in which the trajectory progresses (the direction of movement of the trajectory graph 901). In this embodiment, this indicates that the trajectory starts from the coordinate origin, rotates counterclockwise, and then returns to the coordinate origin. Also, 903 indicates feature quantities calculated from the trajectory graph 901. Specifically, the feature quantities include the maximum amount of displacement in the forward / backward direction, the maximum amount of displacement in the upward / downward direction, the maximum displacement from the coordinate origin indicated by 904, the time difference (σ) between the time when the movement information and the voice information each reach their maximum value, and the ratio of this time difference based on the variance of the forward / backward displacement (rAP). This information is obtained by processing by the analysis unit 423 described above. Note that, as a method of displaying these feature quantities, instead of displaying them above the coordinate region of the trajectory graph 901 as in this embodiment, they may be displayed within the coordinate region of the trajectory graph 901 or on a separate diagram; however, the present invention is not limited to these.

[0063] 10, 905 indicates the time at which the trajectory data values ​​plotted on the trajectory graph 901 occurred, and in this embodiment, this is displayed every 0.1 seconds. 906 indicates the peak point in the distance information obtained in step S504 of FIG. 4. 907 indicates the time point at which the audio information obtained in step S606 of FIG. 5 takes its maximum value. This display makes it possible to confirm in the figure the time difference between the time point at which the audio information takes its maximum value and the time point at which the anterior-posterior component of the thyroid cartilage in the distance information takes its maximum value. 908 indicates the start point 805 and end point 806 (see FIG. 9) of the audio information obtained in step S607 of FIG. 5.

[0064] 10 , in this embodiment, in the series of up-down, back-and-forth movement paths of the thyroid cartilage during swallowing, it is possible to determine on the trajectory graph 901 whether the peak of the swallowing sound 907 exists on the outgoing path of the movement path accompanied by the elevation and forward movement of the thyroid cartilage (see FIG. 7 ) or the returning path of the movement path accompanied by the posterior and descending movement of the thyroid cartilage (see FIG. 7 ). For this purpose, the processing unit (processing step) 420 generates, based on the detection data from the microphone 106, identification display data that enables determination on the trajectory graph 901 of whether the peak of the swallowing sound exists on the outgoing path of the movement path accompanied by the elevation and forward movement of the thyroid cartilage or the returning path of the movement path accompanied by the posterior and descending movement of the thyroid cartilage during swallowing. Specifically, for example, when a signal requesting such a display format is input via input device 112, an upward arrow indicating the outward path (for example, a downward arrow in the case of the return path) is displayed adjacent to the position of peak 907 of the swallowing sound, as shown in (a) of Fig. 12. In this case, an explanatory display of the arrow relating to the outward path / return path is displayed adjacent to trajectory graph 901. Of course, icons or the like may be used instead of arrows. Alternatively, the display format of Fig. 12 may be automatically displayed instead of the display format of Fig. 10 without requiring external input.

[0065] 12(b), text (characters) indicating the outward path / return path may be displayed adjacent to the position of the swallowing sound peak 907. Furthermore, the trajectory graph 901 may be displayed in different colors for the outward path and the return path (the plot of the trajectory data values ​​of the distance information may be displayed in different colors), so that it is possible to grasp at a glance whether the swallowing sound peak 907 is located on the outward path or the return path of the thyroid cartilage movement path. In this case, for example, the color-coded display of the swallowing sound amplitude and the color-coded display of the outward path / return path may be switched by a switching signal input via the input device 112, for example, so as not to overlap with the color-coded display of the swallowing sound amplitude. Furthermore, by such switching, a reference display (not shown) clearly indicating the color-coded state of the outward path / return path may be displayed adjacent to the trajectory graph 901, instead of or in addition to the reference bar graph 909 indicating the magnitude of the swallowing sound amplitude value.

[0066] 10 and 12, a three-dimensional trajectory graph 901A as shown in Fig. 13 may be displayed on the display device 110 via the display unit 430. For this purpose, the processing unit (processing step) 420 extracts an up-and-down movement component associated with the up-and-down movement of the thyroid cartilage and an anterior-posterior movement component associated with the anterior-posterior movement of the thyroid cartilage from a fitting result obtained by fitting a model function that models the swallowing movement to distance information based on detection data detected by the transmit-receive coils 102, 103, and generates three-dimensional trajectory data that simultaneously shows the behavior of the thyroid cartilage in the up-and-down direction and the anterior-posterior direction in a single trajectory graph based on these extracted up-and-down movement components and anterior-posterior movement components. In this case, the three-dimensional trajectory data is generated as coordinate data shown in a coordinate space defined by three mutually orthogonal coordinate axes, as shown in Fig. 13, and the three coordinate axes include coordinate axis X corresponding to the trajectory data values ​​of the front-to-back movement component, coordinate axis Y corresponding to the trajectory data values ​​of the up-to-down movement component, and coordinate axis Z indicating the swallowing action time. Note that, to simplify the drawing, supplementary and reference displays such as feature points are omitted in Fig. 13, but it goes without saying that displays of various feature points and reference displays are added in Fig. 13 as shown in Figs. 10 and 12.

[0067] By displaying trajectory data based on distance information in three dimensions, it is possible to avoid overlapping dots of data values, and for example, the position of the peak of the swallowing sound in the thyroid cartilage movement path during swallowing can be clearly understood at a glance. In this case, too, text or a symbol indicating the outward or return path may be displayed adjacent to the position of the peak 907 of the swallowing sound, or the trajectory graph 901 may be displayed in different colors for the outward and return paths.

[0068] 12 and 13, the position of the swallowing sound peak along the thyroid cartilage movement path during swallowing can be grasped at a glance, enabling accurate evaluation of swallowing behavior. Furthermore, such distinguishable display is particularly useful when, in a two-dimensional trajectory graph display based on two-dimensional trajectory data (display format of FIG. 10), the position of the swallowing sound peak is close to the coordinate origin, making it difficult to grasp whether the swallowing sound peak is on the outward or inward path along the thyroid cartilage movement path because the dots of the data plotted on the graph overlap.

[0069] 14 shows a two-dimensional trajectory graph 901 similar to that shown in FIG. 10, but here, instead of the arrow 902 of FIG. 10, reference information indicating the direction of movement of the trajectory graph 901 is displayed as an icon 980 together with the trajectory graph 901. Therefore, the processing unit 420 generates reference display data for displaying such an icon 980 together with the trajectory graph 901. In this case, S1 and S3 on the trajectory graph 901 correspond to the times (see FIG. 9 ) corresponding to the earlier start point 805 and the later end point 806 of the swallowing sound, respectively, and P2 corresponds to the upper peak value of the swallowing sound, N1 corresponds to the start point of the upward movement of the thyroid cartilage in the swallowing action, and N2 corresponds to the start point of the backward movement of the thyroid cartilage in the swallowing action. Alternatively, the direction of movement of the trajectory graph 901 may be displayed as a moving image (animation) rather than by an arrow or an icon, so that the direction of movement can be understood.

[0070] The present invention is not limited to the above-described embodiments and can be modified in various ways without departing from the spirit and scope of the present invention. For example, in the above-described embodiments, the present invention is applied to the behavior of thyroid cartilage, but the present invention can also be applied to examining the movements of biological parts other than thyroid cartilage. That is, the present invention can also be applied to analyzing the movements of parts other than the larynx, as long as the body part moves (forward and backward, up and down) in the same way as the thyroid cartilage (hyoid bone). Specifically, the present invention can be applied to any body part that can be analyzed by decomposing changes in distance detected by a predetermined detection unit into movements in multiple directions. Furthermore, the biopsy device of the present invention does not need to include the laryngeal displacement detection unit, swallowing sound detection unit, and display device as described above. That is, the biopsy device, the laryngeal displacement detection unit, the swallowing sound detection unit, and the display device may be configured as separate systems. Furthermore, the processing by each device described in the present embodiments may be realized by software, hardware, or a combination of software and hardware. The program constituting the software may be stored, for example, on a non-transitory computer-readable medium (non-transitory computer-readable storage medium). The program may be stored in a computer readable medium. The program may also be distributed, for example, via a network. Furthermore, some or all of the above-described embodiments may be combined, or part of the configuration may be omitted from one of the above-described embodiments, without departing from the spirit of the present invention. [Explanation of symbols]

[0071] 100 Biometric testing device 102 Transmitting coil (larynx displacement detection unit) 103 Examination coil (larynx displacement detection unit) 106 Microphone (swallowing sound detector) 420 Processing Section 430 Display section

Claims

1. a laryngeal displacement detection unit that detects a change in the distance between two positions on both sides of the thyroid cartilage in the larynx of the subject that occurs in accordance with the up-down and back-and-forth movements of the thyroid cartilage during swallowing; a swallowing sound detection unit that detects swallowing sounds when a subject swallows; a processing unit that processes detection data from the laryngeal displacement detection unit and the swallowing sound detection unit; Equipped with The processing unit A model function that models swallowing movements is fitted to distance information based on the detection data detected by the laryngeal displacement detection unit, and from the fitting results, a vertical movement component associated with the vertical movement of the thyroid cartilage and a front-to-back movement component associated with the front-to-back movement of the thyroid cartilage are extracted, and three-dimensional trajectory data is generated that simultaneously shows the vertical and front-to-back behavior of the thyroid cartilage in a single trajectory graph based on these extracted vertical movement components and front-to-back movement components; based on the detection data from the swallowing sound detection unit, generate identification display data that enables the user to determine on the trajectory graph whether the peak of the swallowing sound occurs on the outward path of the movement path accompanied by the elevation and forward movement of the thyroid cartilage, or on the return path of the movement path accompanied by the backward movement and downward movement of the thyroid cartilage, in the series of up-down, back-and-forth movement paths of the thyroid cartilage during swallowing; The three-dimensional trajectory data is generated as coordinate data shown in a coordinate space defined by three mutually orthogonal coordinate axes, and the three coordinate axes include a coordinate axis corresponding to the trajectory data value of the front-to-back movement component, a coordinate axis corresponding to the trajectory data value of the up-to-down movement component, and a coordinate axis indicating a swallowing movement time. A biological testing device characterized by:

2. 2. The biological testing device according to claim 1, wherein the processing unit generates reference display data for displaying reference information indicating a direction of movement of the trajectory graph together with the trajectory graph.

3. The biopsy device according to claim 1 or 2, characterized in that the processing unit generates a swallowing sound waveform that indicates a change in the amplitude of the swallowing sound over time based on the detection data from the swallowing sound detection unit, and generates distinguishable display data that temporally associates the swallowing sound waveform with the trajectory graph and distinguishably displays plots of each trajectory data value on the trajectory graph according to the magnitude of the amplitude of the swallowing sound.

4. The biopsy device according to claim 3, wherein the processing unit generates supplemental display data for superimposing supplemental information on the trajectory graph, the supplemental information including at least one of predetermined feature points associated with the fitting result, predetermined feature points associated with the swallowing sound waveform, and occurrence times of trajectory data values ​​plotted on the trajectory graph.

5. 5. The biological testing device according to claim 1, wherein the processing unit generates reference display data for displaying reference information indicating a predetermined feature calculated from the trajectory graph together with the trajectory graph.

6. The biological testing device according to any one of claims 1 to 5, wherein the laryngeal displacement detection unit is composed of a transmitter coil and a receiver coil arranged to sandwich the thyroid cartilage laterally from both the left and right sides and to transmit and receive high-frequency signals.

7. a laryngeal displacement detection step of detecting, as biological information, a change in the distance between two positions on both sides of the thyroid cartilage in the larynx of the subject, which occurs in association with the up-down and back-and-forth movements of the thyroid cartilage during swallowing; a swallowing sound detection step of detecting swallowing sounds made by the subject when swallowing as biological information; a processing step of processing detection data detected in the laryngeal displacement detection step and the swallowing sound detection step; a display step for displaying the data processed in the processing step; Including, The processing step includes: A model function that models swallowing movements is fitted to distance information based on the detection data detected in the laryngeal displacement detection step, and from the fitting results, a vertical movement component associated with the vertical movement of the thyroid cartilage and a front-to-back movement component associated with the front-to-back movement of the thyroid cartilage are extracted, and three-dimensional trajectory data is generated that simultaneously shows the vertical and front-to-back behavior of the thyroid cartilage in a single trajectory graph based on these extracted vertical movement components and front-to-back movement components; based on the detection data from the swallowing sound detection step, generating identification display data that enables the user to determine on the trajectory graph whether the peak of the swallowing sound occurs on the outward path of the movement path accompanied by the elevation and forward movement of the thyroid cartilage, or on the return path of the movement path accompanied by the backward movement and downward movement of the thyroid cartilage, in the series of up-down, back-and-forth movement paths of the thyroid cartilage during swallowing; The three-dimensional trajectory data is generated as coordinate data shown in a coordinate space defined by three mutually orthogonal coordinate axes, and the three coordinate axes include a coordinate axis corresponding to the trajectory data value of the front-to-back movement component, a coordinate axis corresponding to the trajectory data value of the up-to-down movement component, and a coordinate axis indicating a swallowing movement time. A biological information analysis method characterized by:

8. 8. The biological information analysis method according to claim 7, wherein the processing step generates reference display data for displaying reference information indicating a direction of movement of the trajectory graph together with the trajectory graph.

9. a laryngeal displacement detection step of detecting, as biological information, a change in the distance between two positions on both sides of the thyroid cartilage in the larynx of the subject, which occurs in association with the up-down and back-and-forth movements of the thyroid cartilage during swallowing; a swallowing sound detection step of detecting swallowing sounds made by the subject when swallowing as biological information; a processing step of processing detection data detected in the laryngeal displacement detection step and the swallowing sound detection step; a display step for displaying the data processed in the processing step; A computer program that causes a computer to execute the following: The processing step includes: A model function that models swallowing movements is fitted to distance information based on the detection data detected in the laryngeal displacement detection step, and from the fitting results, a vertical movement component associated with the vertical movement of the thyroid cartilage and a front-to-back movement component associated with the front-to-back movement of the thyroid cartilage are extracted, and three-dimensional trajectory data is generated that simultaneously shows the vertical and front-to-back behavior of the thyroid cartilage in a single trajectory graph based on these extracted vertical movement components and front-to-back movement components; based on the detection data from the swallowing sound detection step, generating identification display data that enables the user to determine on the trajectory graph whether the peak of the swallowing sound occurs on the outward path of the movement path accompanied by the elevation and forward movement of the thyroid cartilage, or on the return path of the movement path accompanied by the backward movement and downward movement of the thyroid cartilage, in the series of up-down, back-and-forth movement paths of the thyroid cartilage during swallowing; The three-dimensional trajectory data is generated as coordinate data shown in a coordinate space defined by three mutually orthogonal coordinate axes, and the three coordinate axes include a coordinate axis corresponding to the trajectory data value of the front-to-back movement component, a coordinate axis corresponding to the trajectory data value of the up-to-down movement component, and a coordinate axis indicating a swallowing movement time. A computer program characterized by:

10. 10. The computer program according to claim 9, wherein the processing step generates reference display data for displaying reference information indicating a transition direction of the trajectory graph together with the trajectory graph.

Citation Information

Patent Citations

  • Method and apparatus for connecting both surfaces of printed circuit board

    JP1989007694A

  • Information processing method about body motion signal, information processing system about body motion signal, information processor about body motion signal, recording medium recording program therein, and program

    JP2011251167A

  • Ruminant behavior analysis method and ruminant behavior analysis apparatus

    JP2017051146A

  • Swallowing simulation apparatus and swallowing simulation method

    JP2021112557A

  • Biological examination apparatus and biological information analysis method

    JP2021176428A