Method and system for obtaining vocal cord medical detection image information
By acquiring and processing vocal cord vibration signals, controlling CMOS lens exposure to obtain clear images, the problem of unclear images in laryngoscopy is solved, and stable image display and lesion diagnosis are achieved. It has important application value in the fields of laryngeal science and voice medicine .
Patent Information
- Application Number
- CN202111524676.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-14
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2041-12-14
AI Technical Summary
During laryngoscopy, due to the high frequency of vocal cord vibration, there is no fixed phase relationship between the frequency of image acquisition and the frequency of vocal cord vibration, which makes the collected images unclear and it is difficult to detect and diagnose lesions.
By obtaining the mechanical signal when the vocal cord vibrates and converting it into an electrical signal, selecting the rising edge of the electrical signal as a trigger signal, controlling the exposure of the CMOS lens to obtain clear medical detection images, and setting the exposure time is proportional to the vocal cord vibration period and vibration amplitude. Adapt and perform fill light operations when acquiring images.
It realizes the acquisition of stable vocal cord images during laryngoscopy, which facilitates medical staff to check vocal cord diseases, can clearly observe the morphology of the vocal cords at any position, and eliminates subjective factors through later software analysis, and has the characteristics of adaptive vocal cord vibration frequency.
Smart Images

Figure CN114145718B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of medical imaging technology, and more specifically, to a method for acquiring vocal cord medical detection image information and a system for acquiring vocal cord medical detection image information. Background Art
[0002] Laryngoscopy is a medical examination that allows direct observation of diseases of the nose and throat.
[0003] When performing a laryngeal examination on a person, since the vibration frequency of the human vocal cords is very high, usually between 65Hz and 1KHz, during a conventional laryngoscopy examination, there is no fixed phase relationship between the vibration of the vocal cords (the vocal cords are always vibrating during the examination) and the frequency of image acquisition (the number of frames of image acquisition). Therefore, the acquired image is constantly changing, and it is impossible to clearly see the image of the vocal cords during the vibration process, which is not conducive to the discovery and diagnosis of lesions. Summary of the invention
[0004] 1. Technical issues
[0005] In summary, how to solve the problem of unclear detection images caused by vocal cord vibration during laryngoscopy in the prior art has become an urgent problem to be solved by those skilled in the art.
[0006] (II) Technical solution
[0007] The present invention provides a method for obtaining vocal cord medical detection image information. In the present invention, the method for obtaining vocal cord medical detection image information comprises the following steps:
[0008] Step 1, obtaining a mechanical signal when the vocal cords vibrate and converting the mechanical signal into a vocal cord vibration electrical signal, wherein the vocal cord vibration electrical signal is a square wave signal or a sine wave signal;
[0009] Step 2: Select the rising edge of the vocal cord vibration electrical signal as a trigger signal to obtain a vocal cord medical detection image according to a set method.
[0010] Preferably, in the method for acquiring vocal cord medical detection image information provided by the present invention, a CMOS lens is used to acquire the vocal cord medical detection image.
[0011] Preferably, in the method for obtaining vocal cord medical detection image information provided by the present invention, the maximum exposure time of the CMOS lens is directly proportional to the pixel size, directly proportional to the vibration period of the vocal cords, and inversely proportional to the vibration amplitude of the vocal cords.
[0012] Preferably, in the method for acquiring vocal cord medical detection image information provided by the present invention, the exposure time of the CMOS lens is no more than 1 millisecond.
[0013] Preferably, in the method for acquiring vocal cord medical detection image information provided by the present invention, a fill light operation is performed when acquiring the vocal cord medical detection image.
[0014] The present invention also provides a system for obtaining vocal cord medical detection image information, and the system for obtaining vocal cord medical detection image information includes the following components:
[0015] A vibration sensor for obtaining a mechanical signal when the vocal cords vibrate and capable of converting the mechanical signal into an electrical signal of vocal cord vibration, wherein the electrical signal of vocal cord vibration generated by the vibration sensor is a square wave signal;
[0016] A laryngoscope lens for obtaining medical detection images of the vocal cords, wherein the laryngoscope lens is equipped with an image sensor;
[0017] An endoscope host connected to the vibration sensor and the image sensor, wherein the endoscope host is provided with a processor, wherein the processor is used to receive the vocal cord vibration electrical signal and can select the rising edge of the vocal cord vibration electrical signal in a set manner to send a trigger signal, and the image sensor receives the trigger signal to perform exposure to obtain the vocal cord medical detection image.
[0018] Preferably, in the system for acquiring vocal cord medical detection image information provided by the present invention, the processor has a built-in FPGA chip, and the FPGA chip is connected to the vibration sensor and the image sensor.
[0019] Preferably, in the system for acquiring vocal cord medical detection image information provided by the present invention, the image sensor is a COMS lens.
[0020] Preferably, the system for acquiring vocal cord medical detection image information provided by the present invention further includes a display for displaying the vocal cord medical detection image, and the display is connected to the endoscope host.
[0021] Preferably, in the system for acquiring vocal cord medical detection image information provided by the present invention, a fill light is integrated in the laryngoscope lens, the fill light is connected to the endoscope host control, and can perform a flash operation synchronously with the exposure action of the image sensor under the control of the endoscope host.
[0022] (III) Beneficial effects
[0023] The present invention provides a method for obtaining vocal cord medical detection image information, and the method for obtaining vocal cord medical detection image information includes: step 1, obtaining a mechanical signal when the vocal cord vibrates and converting the mechanical signal into a vocal cord vibration electric signal, wherein the vocal cord vibration electric signal is a square wave signal; step 2, selecting the rising edge of the vocal cord vibration electric signal as a trigger signal according to a set method to obtain a vocal cord medical detection image. Based on the above method, the present invention also provides a system for obtaining vocal cord medical detection image information. Specifically, the system for obtaining vocal cord medical detection image information includes: a vibration sensor for obtaining a mechanical signal when the vocal cord vibrates and capable of converting the mechanical signal into a vocal cord vibration electric signal, wherein the vocal cord vibration electric signal generated by the vibration sensor is a square wave signal; a laryngoscope lens for obtaining a vocal cord medical detection image, wherein the laryngoscope lens is equipped with an image sensor; an endoscope host connected to the vibration sensor and the image sensor, wherein the endoscope host is provided with a processor, wherein the processor is used to receive the vocal cord vibration electric signal and can select the rising edge of the vocal cord vibration electric signal according to a set method to send a trigger signal, and the image sensor receives the trigger signal for exposure to obtain the vocal cord medical detection image.
[0024] Through the above design, the present invention has the characteristics of adaptive vocal cord vibration frequency, and by controlling the image exposure timing, it is possible to observe the video image of the vocal cord in a fixed position, and the stable image display is convenient for medical staff to examine vocal cord diseases. The application of the present invention solves the problem of unclear detection images due to vocal cord vibration during laryngoscope examination in the prior art.
[0025] In addition, the shape of the vocal cords at any position can be clearly observed by adjusting the phase. After recording or capturing pictures, the characteristics of the vocal cords can be analyzed by later computer software to achieve quantitative analysis and eliminate the influence of subjective factors. In summary, the system for obtaining vocal cord medical detection image information provided by the present invention has the characteristics of adaptive function and is of great significance in the fields of laryngology, voice medicine and artistic noise medicine. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1 A corresponding diagram of a signal and a waveform when processing signal information in a method for obtaining vocal cord medical detection image information in an embodiment of the present invention;
[0027] Figure 2 The present invention is a block diagram showing the structure of a system for acquiring vocal cord medical detection image information in an embodiment of the present invention.
[0028] exist Figure 1 and Figure 2 In the figure, the corresponding relationship between the component names and the figure numbers is as follows:
[0029] Vibration sensor 1, image sensor 2, FPGA chip 3, display 4, fill light 5;
[0030] Mechanical signal a, vocal cord vibration electrical signal b, trigger signal c. DETAILED DESCRIPTION
[0031] The following embodiments of the present invention are described in further detail in conjunction with the accompanying drawings and examples. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.
[0032] In the description of the present invention, unless otherwise specified, "plurality" means two or more than two; the orientations or positional relationships indicated by the terms "upper", "lower", "left", "right", "inner", "outer", "front end", "rear end", "head", "tail", etc. are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", "third", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.
[0033] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "connected" and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0034] Please refer to Figure 1 and Figure 2 ,in, Figure 1 A corresponding diagram of a signal and a waveform when processing signal information in a method for obtaining vocal cord medical detection image information in an embodiment of the present invention; Figure 2 The present invention is a block diagram showing the structure of a system for acquiring vocal cord medical detection image information in an embodiment of the present invention.
[0035] The present invention provides a method for obtaining vocal cord medical detection image information. Different from the traditional detection method of directly collecting image information using a laryngoscope, the present invention is based on vocal cord vibration signals and achieves the purpose of obtaining clear images by controlling the exposure time of the sensor when collecting images.
[0036] Specifically, the method for obtaining vocal cord medical detection image information provided by the present invention comprises the following steps:
[0037] Step 1: obtain the mechanical signal a when the vocal cords vibrate and convert the mechanical signal a into a vocal cord vibration electrical signal b, where the vocal cord vibration electrical signal b is a square wave signal; Step 2: after obtaining the vocal cord vibration electrical signal b, according to the set working mode or set cycle (the working mode or cycle can be set manually, for example, for the working mode, set how to perform exposure and data transmission, and for the cycle, it must be an integer multiple of the cycle of the vocal cord vibration electrical signal b), select the rising edge of the vocal cord vibration electrical signal b as the trigger signal c (a trigger signal for controlling the exposure of the CMOS lens) to obtain a vocal cord medical detection image.
[0038] In step 2, there is a logical relationship in the setting of the working mode, that is, the complete working cycle of CMOS is divided into two stages: exposure and transmission. After CMOS completes the transmission of a frame of data, the rising edge of the next vocal cord vibration electrical signal triggers CMOS to start the exposure of the next frame. After the exposure is completed, it enters the data transmission process. After the transmission is completed, it waits for the next rising edge of the vocal cord vibration signal to trigger the exposure, and the cycle continues.
[0039] Specifically, the present invention adopts a CMOS lens to acquire vocal cord medical detection images.
[0040] The exposure action, signal processing and exposure reaction of the COMS lens will take a certain amount of time (this time is very short). In order to avoid the above reasons affecting the imaging effect (the clarity of the vocal cord medical detection image needs to be improved), the present invention limits the maximum exposure time of the CMOS lens. That is: the maximum exposure time of the CMOS lens is directly proportional to the pixel size, directly proportional to the vibration period of the vocal cords, and inversely proportional to the vibration amplitude of the vocal cords. In addition, the magnification and object distance jointly determine the distance of imaging movement per unit time.
[0041] The method for obtaining vocal cord medical detection image information provided by the present invention relies on a complete set of hardware systems (i.e., the system for obtaining vocal cord medical detection image information provided by the present invention) to operate. In order to ensure the working effect of the system, the present invention must limit some parameters, especially the exposure time of CMOS (which directly affects the clarity of vocal cord medical detection image information). Therefore, the present invention describes the setting of the exposure time parameters in detail as follows: Let the vibration period of the vocal cords be T1, and the vibration amplitude of the vocal cords be A1; let the frame period of CMOS be T2, and the size of a single pixel of the CMOS sensor be d; and let the magnification of the optical lens of the endoscope be β. According to the working principle of the CMOS sensor, if a clear image needs to be obtained, then the distance moved by the target object (the object being photographed) within one exposure period corresponds to the distance to the image side (i.e., the image of the target object in a stationary state) should be less than the size of 2 pixels. Let the distance of the vocal cord movement within one exposure period be D, then:
[0042] D < 2 x d x β Formula 1
[0043] Assume the exposure time of the CMOS sensor is T, then there is:
[0044] D = 2 * A1 * T / T1 Formula 2
[0045] Combining and simplifying the two formulas, the following formula is obtained:
[0046] T < d x β x T1 / A1 Formula 3
[0047] The frequency range of human vocal cord vibration is between 65 Hz and 1 KHz, and the typical value is about 100 Hz, and the amplitude is less than 10 mm (the extreme value taken in this invention is 10 mm). The sampling frequency of the CMOS image sensor used in the laryngoscope is usually 30 Hz, and the pixel size is about 1 us. The optical magnification of the lens used by the CMOS sensor is calculated according to the typical value of 50 times. Substituting the typical values of the above parameters into Formula 3, T < 50 us is obtained. Therefore, the exposure time of the CMOS lens is not greater than 1 millisecond.
[0048] Since the exposure time is very short, the system needs to fill light. In this invention, a fill light operation is performed when obtaining the medical detection image of the vocal cords, so as to ensure that the collected image has normal brightness. When a person makes a sound, the vocal cords are in a vibrating state. When the pitch and tone of the person's voice remain stable, the vibration frequency and amplitude of the vocal cords are basically unchanged. Therefore, when a person makes a sound, the vibration of the vocal cords can be regarded as a sine wave (cosine wave), and its amplitude and period (wavelength) remain unchanged. This invention is provided with a vibration sensor 1. The mechanical signal a of the vocal cord vibration when a person makes a sound is obtained by the vibration sensor 1, and then the mechanical signal a is converted into an electrical signal b of the vocal cord vibration. The electrical signal b of the vocal cord vibration is a group of square wave signals.
[0049] This invention is provided with a vibration sensor 1 (the composition structure of the vocal cord signal detection device). The vibration sensor 1 can convert the mechanical signal of the vocal cord vibration into an electrical signal (that is, the above-mentioned electrical signal of the vocal cord vibration). The electrical signal of the vocal cord vibration output by the vibration sensor 1 is input into the endoscope host through a signal line (the endoscope host is provided with an endoscope processor, and the endoscope processor integrates an FPGA chip 3). The endoscope host issues a control signal (trigger signal) according to the electrical signal of the vocal cord vibration. Specifically, after receiving the electrical signal of the vocal cord vibration, the FPGA chip 3 uses the rising edge of the electrical signal of the vocal cord vibration as the trigger signal of the CMOS lens (it can be understood that the exposure moment of the CMOS lens starts from the rising edge of the electrical signal of the vocal cord vibration), so that the COMS lens is exposed to obtain the required medical detection image information.
[0050] In the present invention, since the tone and pitch of a person's voice can be kept stable, the vocal cords vibrate steadily, and the vocal cord vibration electrical signal is also a "stable" square wave signal. Then, the rising edge of the vocal cord vibration electrical signal corresponds to the fixed phase of the vocal cord vibration. After the exposure time of the CMOS lens is fixed, the vocal cord vibration corresponding to the vocal cord medical detection image information obtained by the CMOS lens is at a fixed position, so that the image captured by the CMOS can be guaranteed to be an image of the vocal cords in the same position.
[0051] like Figure 1 The waveform of vocal cord vibration is an analog signal, which can be represented by a sine wave. After sampling and conversion by the vibration sensor 1, the waveform becomes a digital square wave signal (vocal cord vibration electrical signal), which is transmitted to the FPGA chip 3. The built-in program of the FPGA chip 3 outputs the exposure control signal (i.e., trigger signal) of the CMOS sensor, which is a control signal synchronized with the vibration signal.
[0052] The present invention also provides a system for obtaining medical detection image information of the vocal cords. Specifically, the system for obtaining medical detection image information of the vocal cords includes: a vibration sensor 1 for obtaining a mechanical signal when the vocal cords vibrate and capable of converting the mechanical signal into a vocal cord vibration electrical signal, the vocal cord vibration electrical signal generated by the vibration sensor 1 is a square wave signal; a laryngoscope lens for obtaining a vocal cord medical detection image, the laryngoscope lens having an image sensor 2 built therein; an endoscope host connected to the vibration sensor 1 and the image sensor 2, the endoscope host being provided with a processor, the processor being used to receive the vocal cord vibration electrical signal and being able to select the rising edge of the vocal cord vibration electrical signal in a set manner (or in a set period) to send a trigger signal, and the image sensor 2 receives the trigger signal for exposure to obtain the vocal cord medical detection image.
[0053] The processor has a built-in FPGA chip 3 , and the FPGA chip 3 is connected to the vibration sensor 1 and the image sensor 2 .
[0054] Specifically, the image sensor 2 is a COMS lens.
[0055] In order to facilitate on-site observation by medical staff, the present invention further provides a display 4 for displaying vocal cord medical detection images, and the display 4 is connected to the endoscope host.
[0056] As can be seen from the above, in the present invention, since the exposure time of the COMS lens is very short, in order to ensure the image acquisition effect, the present invention integrates a fill light 5 in the laryngoscope lens. The fill light 5 is connected to the endoscope host control and can perform a flash operation synchronously with the exposure action of the image sensor 2 under the control of the endoscope host.
[0057] The whole system consists of two parts: one is the vocal cord signal detection device, and the other is the image acquisition and display device. The main function of the vocal cord signal detection device is to convert the vibration signal of the vocal cord into an electrical signal with the same frequency. The image acquisition and display device consists of three parts: the front-end part with the imaging sensor CMOS as the core, the image processing host with the FPGA chip 3 as the core, and the display system with the monitor as the core.
[0058] The system for obtaining medical detection image information of vocal cords provided by the present invention is a dynamic laryngoscope system, which has the characteristics of adaptive vocal cord vibration frequency. By controlling the image exposure timing, it is possible to observe the video image (or image information) when the vocal cords are in a fixed position, and the stable image display is convenient for medical staff to check vocal cord diseases. In addition, the morphology of the vocal cords at any position can be clearly observed by adjusting the phase (control of the exposure timing, such as moving the position of the vocal cord vibration electrical signal corresponding to the trigger signal, such as moving to the peak position, or the lower edge). After recording or capturing pictures, the characteristics of the vocal cords can also be analyzed by later computer software, and quantitative analysis can be achieved to eliminate the influence of subjective factors. In summary, the system for obtaining medical detection image information of vocal cords provided by the present invention has the characteristics of adaptive function, and its application in the fields of laryngology, voice medicine and art noise medicine has very important significance.
[0059] The embodiments of the present invention are given for the purpose of illustration and description, and are not intended to be exhaustive or to limit the invention to the disclosed forms. Many modifications and variations will be apparent to those of ordinary skill in the art. The embodiments are selected and described in order to better illustrate the principles and practical applications of the present invention and to enable those of ordinary skill in the art to understand the present invention and thereby design various embodiments with various modifications suitable for specific uses.
Claims
1. A method for obtaining vocal cord medical detection image information, characterized in that: include: Step 1: obtaining a mechanical signal when the vocal cords vibrate (a) and converting the mechanical signal into a vocal cord vibration electrical signal (b), wherein the vocal cord vibration electrical signal is a square wave signal; Step 2: Select the rising edge of the vocal cord vibration electrical signal as a trigger signal (c) to obtain a vocal cord medical detection image according to a set method or a set period; Using a CMOS lens to acquire the vocal cord medical detection image; The maximum exposure time of the CMOS lens is directly proportional to the pixel size, directly proportional to the vibration period of the vocal cords, and inversely proportional to the vibration amplitude of the vocal cords; Assume that the vibration period of the vocal cords is T1, the vibration amplitude of the vocal cords is A1; the frame period of CMOS is T2, the size of a single pixel of the CMOS sensor is d; the magnification of the optical lens of the endoscope is β. According to the working principle of the CMOS sensor, if a clear image needs to be obtained, the distance moved by the target object in one exposure cycle should correspond to the distance to the image side that is less than the size of 2 pixels. Assume that the distance moved by the vocal cords in one exposure cycle is D, then: D < 2 xd xβ Formula 1 Assuming the exposure time of the CMOS sensor is T, we have: D = 2 * A1 * T / T1 Formula 2 Combining and simplifying the two formulas, we get the following formula: T < d xβx T1 / A1 Formula 3 The frequency range of human vocal cord vibration is between 65Hz and 1KHz, with a typical value of about 100Hz and an amplitude of less than 10mm. The sampling frequency of the CMOS image sensor used in the laryngoscope is 30Hz, and the pixel size is 1us. The optical magnification of the lens used in the CMOS sensor is calculated according to the typical value of 50 times. Substituting the typical values of the above parameters into Formula 3, we get T<50us.
2. The method for obtaining vocal cord medical detection image information according to claim 1, characterized in that: The exposure time of the CMOS lens is no more than 1 millisecond.
3. The method for obtaining vocal cord medical detection image information according to claim 1 or 2, characterized in that: A fill light operation is performed when acquiring the vocal cord medical detection image.
4. A system for obtaining vocal cord medical detection image information, characterized in that: The method for obtaining vocal cord medical detection image information according to any one of claims 1 to 3 is used for detection, and the system for obtaining vocal cord medical detection image information comprises: A vibration sensor (1) for acquiring a mechanical signal when the vocal cords vibrate and capable of converting the mechanical signal into an electrical signal of vocal cord vibration, wherein the electrical signal of vocal cord vibration generated by the vibration sensor is a square wave signal; A laryngoscope lens for obtaining medical detection images of the vocal cords, wherein the laryngoscope lens has an image sensor (2) built into it; An endoscope host connected to the vibration sensor and the image sensor, wherein the endoscope host is provided with a processor, wherein the processor is used to receive the vocal cord vibration electrical signal and can select the rising edge of the vocal cord vibration electrical signal in a set manner to send a trigger signal, and the image sensor receives the trigger signal to perform exposure to obtain the vocal cord medical detection image.
5. The system for obtaining vocal cord medical detection image information according to claim 4, characterized in that: The processor has a built-in FPGA chip (3), and the FPGA chip is connected to the vibration sensor and the image sensor.
6. The system for obtaining vocal cord medical detection image information according to claim 4, characterized in that: The image sensor is a COMS lens.
7. The system for obtaining vocal cord medical detection image information according to claim 4, characterized in that: It also includes a display (4) for displaying the vocal cord medical detection image, and the display is connected to the endoscope host.
8. The system for acquiring vocal cord medical detection image information according to any one of claims 4 to 7, characterized in that: A fill light (5) is integrated in the laryngoscope lens, the fill light is control-connected to the endoscope host, and can perform a flash operation synchronously with the exposure action of the image sensor under the control of the endoscope host.
Citation Information
Cited By
Detection system and method for judging singing sound part
CN118078212A
