Laryngoscope system, control method, electronic equipment and storage medium

Abstract

The invention provides a laryngoscope system, a control method, electronic equipment and a storage medium. The laryngoscope system comprises an image processing chip, a normally-on light source, an image sensor, a shutter control unit, a sound sampling unit and a display unit. The image processing chip sends a frame indication signal to the shutter control unit; the sound sampling unit samples and analyzes the audio signal of the patient, and determines a collection indication signal according to the vocal cord vibration condition of the patient; the shutter control unit generates a shutter control signal according to the frame indication signal and the acquisition indication signal; under the control of the shutter control signal, the image sensor collects a frame of image signal of the vocal cord which is continuously illuminated by the normally-on light source, and the frame of image signal is sent to the display unit by the image processing chip to be displayed. In this way, the vocal cord is continuously illuminated through the normally-on light source, and light noise can be avoided; the electronic shutter control unit controls the image sensor to perform exposure shooting once in each frame of image so as to generate the image signal, the control is simple and convenient, and the implementation cost is low.

Description

Technical Field

[0001] The present application relates to the field of medical technology, and in particular to a laryngoscope system, a control method, an electronic device and a storage medium. Background Art

[0002] In order to observe the vibration characteristics of the vocal cords during phonation and study the subtle changes of the vocal cords, dynamic laryngoscope (also known as stroboscopic laryngoscope) is currently a commonly used examination method. Existing stroboscopic laryngoscopes are usually implemented in the following ways: First, using a stroboscopic light source to slow down or "freeze" the vibration of the vocal cords, so that doctors can observe the structure and function of the vocal cords more clearly. Second, using an ultra-high-speed camera to capture images of the vocal cords at extremely high speeds of hundreds to thousands of frames per second.

[0003] However, the first method based on stroboscopic light sources has poor image quality due to the complicated control method of dedicated stroboscopic light sources and large optical noise when the stroboscopic light sources are turned on and off. The second method based on ultra-high-speed cameras has high implementation costs, high power consumption, and is not conducive to miniaturization of the equipment. Summary of the invention

[0004] In view of this, the purpose of the present application is to provide a laryngoscope system, a control method, an electronic device and a storage medium to solve the problems in the prior art that the stroboscopic laryngoscope uses a stroboscopic light source, the light noise when it is turned on and off is large, resulting in poor image quality, and the use of an ultra-high-speed camera leads to high cost and high power consumption, which is not conducive to miniaturization of the equipment.

[0005] The embodiment of the present application provides a laryngoscope system, comprising: an image processing chip, a constant light source, an image sensor, a shutter control unit, a sound sampling unit and a display unit; during the operation of the laryngoscope system, the constant light source continuously illuminates the vocal cords in response to a start signal sent by the image processing chip;

[0006] The image processing chip is used to send a frame indication signal to the shutter control unit; wherein the frame indication signal is used to indicate whether to collect an image signal;

[0007] The sound sampling unit is used to sample and analyze the patient's audio signal, determine a collection indication signal according to the patient's vocal cord vibration, and send the collection indication signal to the shutter control unit; wherein the collection indication signal is used to indicate the collection position of the image signal;

[0008] The shutter control unit is used to generate a shutter control signal according to the frame indication signal and the acquisition indication signal and send the shutter control signal to the image sensor;

[0009] The image sensor is used to collect a frame of image signal of the vocal cords being continuously illuminated by the constant light source under the control of the shutter control signal, and send the frame of image signal to the image processing chip;

[0010] The image processing chip is used to send the frame image signal to the display unit for display.

[0011] Furthermore, when the sound sampling unit is used to perform sampling analysis on the patient's audio signal and determine the acquisition indication signal according to the patient's vocal cord vibration, the sound sampling unit is specifically used to:

[0012] collecting the patient audio signal;

[0013] Performing vibration analysis on the patient's audio signal to determine the maximum amplitude position of vocal cord vibration;

[0014] The maximum amplitude position of the vocal cord vibration is determined as the acquisition position of the image signal, and the acquisition indication signal is generated.

[0015] Furthermore, when the sound sampling unit is used to analyze the patient's audio signal to determine the maximum amplitude position of the vocal cord vibration, the sound sampling unit is specifically used to:

[0016] Performing spectrum analysis on the patient audio signal to extract a baseband signal;

[0017] The maximum amplitude position of the fundamental frequency signal is determined as the maximum amplitude position of the vocal cord vibration.

[0018] Further, when the shutter control unit is used to generate the shutter control signal according to the frame indication signal and the acquisition indication signal, the shutter control unit is specifically used to:

[0019] After the frame indication signal indicates to collect a frame of image signal, when the first collection position in the collection indication signal is received, the shutter control signal for controlling the image sensor to take pictures is generated.

[0020] Furthermore, the sound sampling unit is further used to perform sampling analysis on the patient audio signal, extract audio parameters of the patient audio signal, and send the audio parameters to the image processing chip;

[0021] The image processing chip is further used to perform display superposition processing on the audio parameters and the frame image signal, and send the frame image signal after the display superposition processing to the display unit for display.

[0022] Furthermore, the laryngoscope system further comprises: a video recording module;

[0023] The sound sampling unit is further used to send the patient audio signal to the video recording module;

[0024] The image processing chip is further used to send the frame image signal to the video recording module;

[0025] The video recording module is used to synthesize the frame image signal and the patient audio signal to obtain a synthesized video recording.

[0026] Furthermore, the image processing chip is further configured to send a brightness adjustment signal to the permanent light source according to the received brightness adjustment instruction, so as to adjust the brightness of the permanent light source.

[0027] The embodiment of the present application also provides a control method of a laryngoscope system, the laryngoscope system comprising: an image processing chip, a constant light source, an image sensor, a shutter control unit, a sound sampling unit and a display unit; during the operation of the laryngoscope system, the constant light source continuously illuminates the vocal cords in response to a start signal sent by the image processing chip; the control method comprises:

[0028] The image processing chip sends a frame indication signal to the shutter control unit; wherein the frame indication signal is used to indicate whether to collect an image signal;

[0029] The sound sampling unit samples and analyzes the patient's audio signal, determines a collection indication signal according to the patient's vocal cord vibration, and sends the collection indication signal to the shutter control unit; wherein the collection indication signal is used to indicate the collection position of the image signal;

[0030] The shutter control unit generates a shutter control signal according to the frame indication signal and the acquisition indication signal and sends the shutter control signal to the image sensor;

[0031] The image sensor, under the control of the shutter control signal, collects a frame of image signal of the vocal cords continuously illuminated by the constant light source, and sends the frame of image signal to the image processing chip;

[0032] The image processing chip sends the frame image signal to the display unit for display.

[0033] An embodiment of the present application also provides an electronic device, comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the steps of the control method of the laryngoscope system as described above are performed.

[0034] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the control method of the laryngoscope system as described above are executed.

[0035] The embodiment of the present application provides a laryngoscope system, a control method, an electronic device and a storage medium. The laryngoscope system includes: an image processing chip, a constant light source, an image sensor, a shutter control unit, a sound sampling unit and a display unit; the image processing chip is used to send a frame indication signal to the shutter control unit; wherein the frame indication signal is used to indicate whether to collect an image signal; the sound sampling unit is used to sample and analyze the patient's audio signal, determine a collection indication signal according to the vibration of the patient's vocal cords, and send the collection indication signal to the shutter control unit; wherein the collection indication signal is used to indicate the position of collecting the image signal; the shutter control unit is used to generate a shutter control signal according to the frame indication signal and the collection indication signal and send the shutter control signal to the image sensor; the image sensor is used to collect a frame of image signal whose vocal cords have been continuously illuminated by the constant light source under the control of the shutter control signal, and send the frame of image signal to the image processing chip; the image processing chip is used to send the frame of image signal to the display unit for display.

[0036] In this way, by continuously illuminating the vocal cords with a constant light source, light noise can be avoided and image quality can be guaranteed; through the frame indication signal and the acquisition indication signal, the electronic shutter control unit controls the image sensor to perform an exposure shot in each frame image to generate an image signal of the vocal cords, which is simple to control and low in cost. The function of the stroboscopic laryngoscope is realized without the need for a stroboscopic light source or an ultra-high-speed camera.

[0037] The acquisition indication signal can be determined according to the maximum amplitude position of the vocal cord vibration, so that in one frame of the image, the image sensor is exposed only once at the maximum amplitude position of the vocal cord, and the generated image is clear and stable.

[0038] Furthermore, the audio parameters can be superimposed on the image through the image processing chip, and the image signal and the audio signal can be synthesized through the video recording module to obtain a synthesized video recording, thereby more clearly and comprehensively recording the vocal cord image acquisition process and providing better medical reference.

[0039] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0041] Figure 1 A schematic structural diagram of a laryngoscope system provided in an embodiment of the present application is shown;

[0042] Figure 2 A timing relationship diagram of a shutter control signal provided in an embodiment of the present application is shown;

[0043] Figure 3 A flow chart showing a method for controlling a laryngoscope system provided in an embodiment of the present application is shown;

[0044] Figure 4 A schematic structural diagram of an electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0045] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, each other embodiment obtained by those skilled in the art without making creative work belongs to the scope of protection of the present application.

[0046] First, the application scenarios to which the present application is applicable are introduced. The present application can be applied to the field of medical technology, and in particular to endoscope devices.

[0047] Research has found that in order to observe the vibration characteristics of the vocal cords during phonation and study the subtle changes in the vocal cords, dynamic laryngoscope (also known as stroboscopic laryngoscope) is currently a commonly used examination method. Existing stroboscopic laryngoscopes are usually implemented in the following ways: First, using a stroboscopic light source to slow down or "freeze" the vibration of the vocal cords, so that doctors can observe the structure and function of the vocal cords more clearly. Second, using an ultra-high-speed camera to capture images of the vocal cords at extremely high speeds of hundreds to thousands of frames per second.

[0048] However, the first method based on stroboscopic light sources has poor image quality due to the complicated control method of dedicated stroboscopic light sources and large optical noise when the stroboscopic light sources are turned on and off. The second method based on ultra-high-speed cameras has high implementation costs, high power consumption, and is not conducive to miniaturization of the equipment.

[0049] Based on this, an embodiment of the present application provides a laryngoscope system to avoid optical noise, ensure image quality and ensure low implementation cost.

[0050] See also Figure 1 , Figure 1 This is a schematic diagram of the structure of a laryngoscope system provided in an embodiment of the present application. Figure 1 As shown in the figure, the laryngoscope system 100 provided in the embodiment of the present application includes: an image processing chip 1, a constant light source 2, an image sensor 3, a shutter control unit 4, a sound sampling unit 5 and a display unit 6. The image processing chip 1 is connected to the constant light source 2, the image sensor 3, the shutter control unit 4, the sound sampling unit 5 and the display unit 6; the sound sampling unit 5 is connected to the shutter control unit 4; the shutter control unit 4 is connected to the image sensor 3.

[0051] During the operation of the laryngoscope system 100, the permanent light source 2 lights up in response to the start signal sent by the image processing chip 1, thereby continuously illuminating the vocal cords; the permanent light source 2 irradiates light into the patient's throat, and the reflected light enters the image sensor 3 (for example, CMOS and CCD, etc.) through the lens. The image sensor 3 is exposed under the control of the shutter control signal sent by the shutter control unit 4, and can collect the patient's throat image. The collected throat image is sent to the display unit 6 through the image processing chip 1 for display.

[0052] The functions of the various components in the laryngoscope system 100 will be described in detail below in conjunction with specific embodiments.

[0053] The image processing chip is used to send a frame indication signal to the shutter control unit.

[0054] Here, the image processing chip (ASIC, Application-Specific Integrated Circuit) can generate a frame indication signal according to the image sampling frame rate pre-configured by the system, such as 30ms per frame, and the frame indication signal is used to indicate whether to collect image signals. Exemplarily, when the frame indication signal is at a high level, it indicates that the image signal is collected; when the frame indication signal is at a low level, it indicates that the image signal is not collected. Therefore, whenever the image processing chip determines that a frame of image signal needs to be collected, the frame indication signal changes from a low level to a high level and is sent to the shutter control unit.

[0055] The sound sampling unit is used to sample and analyze the patient's audio signal, determine a collection indication signal according to the patient's vocal cord vibration, and send the collection indication signal to the shutter control unit.

[0056] Here, the sound sampling unit may be a DSP unit built into the controller of an audio device (such as a microphone). In a specific implementation, during the operation of the laryngoscope system, the doctor usually guides the patient to make a sound so that the vocal cords vibrate. At this time, the sound sampling unit may sample and analyze the patient's audio signal collected by the audio device to determine the vibration of the patient's vocal cords, and then generate a collection indication signal based on the vibration of the vocal cords to indicate the collection position of the image signal. Exemplarily, the collection position may be represented by a vibration phase; at a certain phase, when the collection indication signal is at a high level, it indicates that the image signal can be collected at this position; when the collection indication signal is at a low level, it indicates that the image signal is not collected at this position.

[0057] Furthermore, the sound sampling unit may be specifically configured to determine the acquisition indication signal in the following manner:

[0058] Collect the patient's audio signal; perform vibration analysis on the patient's audio signal to determine the maximum amplitude position of the vocal cord vibration; determine the maximum amplitude position of the vocal cord vibration as the acquisition position of the image signal, and generate the acquisition indication signal. In this way, in one frame of the image, the image sensor is exposed only once at the maximum amplitude position of the vocal cord, and the generated image is clear and stable.

[0059] It is worth noting that the frequency components of the patient's audio signal can be divided into fundamental frequency and multiple frequency. The fundamental frequency is the most basic frequency component in the sound, which directly determines the pitch of the sound. For the human voice, it is caused by the opening and closing of the vocal cords. Multiple frequency components are integer multiples of the fundamental frequency. They are the harmonic components of the sound and together with the fundamental frequency, they constitute the spectrum of the sound. For the human voice, they are caused by the tiny vibrations of the vocal cords' own tissues. Therefore, in laryngoscopy, the fundamental frequency is the frequency component of concern.

[0060] Correspondingly, the sound sampling unit can perform spectral analysis on the patient's audio signal to extract the fundamental frequency signal; determine the maximum amplitude position of the fundamental frequency signal as the maximum amplitude position of the vocal cord vibration; thereby, the maximum amplitude position of the vocal cord vibration can be determined more accurately.

[0061] The shutter control unit is used to generate a shutter control signal according to the frame indication signal and the acquisition indication signal and send the shutter control signal to the image sensor.

[0062] Here, the shutter control unit determines the shutter control signal based on the received frame indication signal and the acquisition indication signal. Figure 2 , Figure 2A timing relationship diagram of a shutter control signal provided in an embodiment of the present application.

[0063] In a possible implementation, Figure 2 As shown in , when the shutter control unit receives a high-level frame indication signal, that is, a valid frame indication signal indicating the acquisition of a frame of image signal, when the received acquisition indication signal appears the first high level indicating the acquisition position, a high-level pulse shutter control signal is generated, thereby controlling the image sensor to shoot and acquire the first frame of image signal. Afterwards, in the frame indication signal corresponding to this frame, even if a high level indicating the acquisition position appears again, a high-level pulse shutter control signal is no longer generated; until the frame indication signal becomes a low level, and in the sampling period corresponding to the next frame of image, the frame indication signal becomes a high level again, at this time, a similar method can be used to acquire the second frame of image signal, and by analogy, multiple frames of image signals can be obtained, thereby forming a video.

[0064] The image sensor is used to collect a frame of image signals of the vocal cords continuously illuminated by the ever-bright light source under the control of the shutter control signal, and send the frame of image signals to the image processing chip.

[0065] Here, the image processing chip has pre-started the constant light source through the start signal, that is, the vocal cords have been continuously illuminated by the constant light source. After the shutter control signal is valid, such as a high level, the image sensor turns on the incident light exposure sampling; after the shutter control signal is invalid, such as a low level, the incident light exposure sampling is turned off, thereby collecting a frame of image signals of the vocal cords. The image sensor can convert the collected image signal into a digital image signal through analog-to-digital conversion, and send the frame of image signal collected in this exposure to the image processing chip through a suitable data format.

[0066] The image processing chip is used to send the frame image signal to the display unit for display. Here, the image processing chip can also perform image processing on the frame image signal, such as denoising, improving clarity, etc., and then send the frame image signal to the display unit, which can display the frame image signal on the screen. The display of multiple frames of image signals can help doctors intuitively understand the vibration of the vocal cords.

[0067] Furthermore, the sound sampling unit is also used to sample and analyze the patient's audio signal, extract audio parameters of the patient's audio signal, and send the audio parameters to the image processing chip. The audio parameters may include at least one of the following: frequency, amplitude, dynamic range, and sound pressure intensity.

[0068] The image processing chip is also used to perform display superposition processing on the audio parameters and the frame image signal, and send the frame image signal after display superposition processing to the display unit for display. In this way, the acquisition parameters of the vocal cord image can be recorded more comprehensively, and better medical reference can be provided.

[0069] For further information, refer back to Figure 1 The laryngoscope system 100 also includes: a video recording module 7.

[0070] The sound sampling unit is also used to send the patient audio signal to the video recording module; the image processing chip is also used to send the frame image signal to the video recording module; the video recording module is used to synthesize the frame image signal and the patient audio signal to generate a synthesized video recording, so that the sound of the patient at the time of examination can be heard during subsequent video playback, thereby more clearly and comprehensively recording the vocal cord image acquisition process and providing better medical reference.

[0071] Furthermore, taking into account the physiological structure differences among different patients, such as the smaller laryngeal volume of young patients, the image processing chip is also used to send a brightness adjustment signal to the ever-bright light source according to the received brightness adjustment instruction to adjust the brightness of the ever-bright light source, thereby avoiding overexposure of the vocal cord image of young patients due to excessive brightness, or underexposure of the vocal cord image of adult patients, thereby achieving the purpose of improving image quality.

[0072] Among them, the brightness adjustment instruction can be manually triggered by the doctor through software and hardware means (such as a physical button or software program on the laryngoscope), or it can be automatically triggered by the image processing chip according to the acquired image signal; for example, when it is determined that the image is overexposed based on the pixel value of each pixel point in the acquired image, the image processing chip generates a brightness adjustment instruction to reduce the brightness; and when it is determined that the image is underexposed based on the pixel value of each pixel point in the acquired image, the image processing chip generates a brightness adjustment instruction to increase the brightness.

[0073] A laryngoscope system provided in an embodiment of the present application includes: an image processing chip, a constant light source, an image sensor, a shutter control unit, a sound sampling unit and a display unit; the image processing chip is used to send a frame indication signal to the shutter control unit; wherein the frame indication signal is used to indicate whether to collect an image signal; the sound sampling unit is used to sample and analyze the patient's audio signal, determine the collection indication signal according to the vibration of the patient's vocal cords, and send the collection indication signal to the shutter control unit; wherein the collection indication signal is used to indicate the position of collecting the image signal; the shutter control unit is used to generate a shutter control signal according to the frame indication signal and the collection indication signal and send the shutter control signal to the image sensor; the image sensor is used to collect a frame of image signals of the vocal cords that have been continuously illuminated by the constant light source under the control of the shutter control signal, and send the frame of image signals to the image processing chip; the image processing chip is used to send the frame of image signals to the display unit for display.

[0074] In this way, by continuously illuminating the vocal cords with a constant light source, light noise can be avoided and image quality can be guaranteed; through the frame indication signal and the acquisition indication signal, the electronic shutter control unit controls the image sensor to perform an exposure shot in each frame image to generate an image signal, which is simple to control and low in cost.

[0075] The acquisition indication signal can be determined according to the maximum amplitude position of the vocal cord vibration, so that in one frame of the image, the image sensor is exposed only once at the maximum amplitude position of the vocal cord, and the generated image is clear and stable.

[0076] Furthermore, the audio parameters can be superimposed on the image through the image processing chip, and the image signal and audio signal can be synthesized through the video recording module, so as to record the vocal cord image acquisition process more clearly and comprehensively and provide better medical reference.

[0077] See also Figure 3 , Figure 3 This is a flow chart of a control method of a laryngoscope system provided in another embodiment of the present application. Figure 3 As shown in, the control method provided by the embodiment of the present application includes:

[0078] S301. The image processing chip sends a frame indication signal to the shutter control unit.

[0079] The frame indication signal is used to indicate whether to collect an image signal.

[0080] S302: The sound sampling unit samples and analyzes the patient's audio signal, determines a collection indication signal according to the patient's vocal cord vibration, and sends the collection indication signal to the shutter control unit.

[0081] The acquisition indication signal is used to indicate the acquisition position of the image signal.

[0082] S303: The shutter control unit generates a shutter control signal according to the frame indication signal and the acquisition indication signal, and sends the shutter control signal to the image sensor.

[0083] S304: Under the control of the shutter control signal, the image sensor collects a frame of image signals of the vocal cords continuously illuminated by the ever-bright light source, and sends the frame of image signals to the image processing chip.

[0084] S305: The image processing chip sends the frame image signal to the display unit for display.

[0085] Furthermore, the sound sampling unit samples and analyzes the patient's audio signal through the following steps, and determines the acquisition indication signal according to the patient's vocal cord vibration:

[0086] collecting the patient audio signal;

[0087] Performing vibration analysis on the patient's audio signal to determine the maximum amplitude position of vocal cord vibration;

[0088] The maximum amplitude position of the vocal cord vibration is determined as the acquisition position of the image signal, and the acquisition indication signal is generated.

[0089] Furthermore, the sound sampling unit analyzes the patient audio signal through the following steps to determine the maximum amplitude position of vocal cord vibration:

[0090] Performing spectrum analysis on the patient audio signal to extract a baseband signal;

[0091] The maximum amplitude position of the fundamental frequency signal is determined as the maximum amplitude position of the vocal cord vibration.

[0092] Further, the shutter control unit generates the shutter control signal according to the frame indication signal and the acquisition indication signal through the following steps:

[0093] After the frame indication signal indicates to collect a frame of image signal, when the first collection position in the collection indication signal is received, the shutter control signal for controlling the image sensor to take pictures is generated.

[0094] Furthermore, the control method further includes:

[0095] The sound sampling unit performs sampling and analysis on the patient audio signal, extracts audio parameters of the patient audio signal, and sends the audio parameters to the image processing chip;

[0096] The image processing chip performs display superposition processing on the audio parameters and the frame image signal, and sends the frame image signal after the display superposition processing to the display unit for display.

[0097] Furthermore, the laryngoscope system further comprises: a video recording module; and the control method further comprises:

[0098] The sound sampling unit sends the patient audio signal to the video recording module;

[0099] The image processing chip sends the frame image signal to the video recording module;

[0100] The video recording module synthesizes the frame image signal and the patient audio signal to obtain a synthesized video recording.

[0101] Furthermore, the control method further includes:

[0102] The image processing chip sends a brightness adjustment signal to the permanent light source according to the received brightness adjustment instruction, so as to adjust the brightness of the permanent light source.

[0103] See also Figure 4 , Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 4 As shown in , the electronic device 400 includes a processor 410 , a memory 420 and a bus 430 .

[0104] The memory 420 stores machine-readable instructions executable by the processor 410. When the electronic device 400 is running, the processor 410 communicates with the memory 420 via the bus 430. When the machine-readable instructions are executed by the processor 410, the above-mentioned Figure 3 The steps of the method for controlling the laryngoscope system in the method embodiment shown and the specific implementation thereof can be found in the method embodiment, which will not be described in detail here.

[0105] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program can execute the above-mentioned Figure 3 The steps of the method for controlling the laryngoscope system in the method embodiment shown and the specific implementation thereof can be found in the method embodiment, which will not be described in detail here.

[0106] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0107] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0108] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0109] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0110] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application can essentially be embodied in the form of a software product, or in other words, the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0111] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the above-mentioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-mentioned embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A laryngoscope system, characterized in that: include: Image processing chip, constant light source, image sensor, shutter control unit, sound sampling unit and display unit; During operation of the laryngoscope system, the ever-bright light source continuously illuminates the vocal cords in response to a start signal sent by the image processing chip; The image processing chip is used to send a frame indication signal to the shutter control unit; wherein the frame indication signal is used to indicate whether to collect an image signal; The sound sampling unit is used to sample and analyze the patient's audio signal, determine a collection indication signal according to the patient's vocal cord vibration, and send the collection indication signal to the shutter control unit; wherein the collection indication signal is used to indicate the collection position of the image signal; The shutter control unit is used to generate a shutter control signal according to the frame indication signal and the acquisition indication signal and send the shutter control signal to the image sensor; The image sensor is used to collect a frame of image signal of the vocal cords being continuously illuminated by the constant light source under the control of the shutter control signal, and send the frame of image signal to the image processing chip; The image processing chip is used to send the frame image signal to the display unit for display.

2. The laryngoscope system according to claim 1, characterized in that: The sound sampling unit, when used to perform sampling and analysis on the patient's audio signal and determine the acquisition indication signal according to the patient's vocal cord vibration, is specifically used to: collecting the patient audio signal; Performing vibration analysis on the patient's audio signal to determine the maximum amplitude position of vocal cord vibration; The maximum amplitude position of the vocal cord vibration is determined as the acquisition position of the image signal, and the acquisition indication signal is generated.

3. The laryngoscope system according to claim 2, characterized in that: When the sound sampling unit is used to analyze the patient audio signal to determine the maximum amplitude position of the vocal cord vibration, the sound sampling unit is specifically used to: Performing spectrum analysis on the patient audio signal to extract a baseband signal; The maximum amplitude position of the fundamental frequency signal is determined as the maximum amplitude position of the vocal cord vibration.

4. The laryngoscope system according to claim 1, characterized in that: When the shutter control unit is used to generate the shutter control signal according to the frame indication signal and the acquisition indication signal, the shutter control unit is specifically used to: After the frame indication signal indicates to collect a frame of image signal, when the first collection position in the collection indication signal is received, the shutter control signal for controlling the image sensor to take pictures is generated.

5. The laryngoscope system according to claim 1, characterized in that: The sound sampling unit is further used to sample and analyze the patient audio signal, extract audio parameters of the patient audio signal, and send the audio parameters to the image processing chip; The image processing chip is further used to perform display superposition processing on the audio parameters and the frame image signal, and send the frame image signal after the display superposition processing to the display unit for display.

6. The laryngoscope system according to claim 1, characterized in that: The laryngoscope system further comprises: a video recording module; The sound sampling unit is further used to send the patient audio signal to the video recording module; The image processing chip is further used to send the frame image signal to the video recording module; The video recording module is used to synthesize the frame image signal and the patient audio signal to obtain a synthesized video recording.

7. The laryngoscope system according to claim 1, characterized in that: The image processing chip is further used to send a brightness adjustment signal to the permanent light source according to the received brightness adjustment instruction, so as to adjust the brightness of the permanent light source.

8. A method for controlling a laryngoscope system, characterized in that: The laryngoscope system comprises: an image processing chip, a constant light source, an image sensor, a shutter control unit, a sound sampling unit and a display unit; during the operation of the laryngoscope system, the constant light source continuously illuminates the vocal cords in response to a start signal sent by the image processing chip; the control method comprises: The image processing chip sends a frame indication signal to the shutter control unit; wherein the frame indication signal is used to indicate whether to collect an image signal; The sound sampling unit samples and analyzes the patient's audio signal, determines a collection indication signal according to the patient's vocal cord vibration, and sends the collection indication signal to the shutter control unit; wherein the collection indication signal is used to indicate the collection position of the image signal; The shutter control unit generates a shutter control signal according to the frame indication signal and the acquisition indication signal and sends the shutter control signal to the image sensor; The image sensor, under the control of the shutter control signal, collects a frame of image signal of the vocal cords continuously illuminated by the constant light source, and sends the frame of image signal to the image processing chip; The image processing chip sends the frame image signal to the display unit for display.

9. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate through the bus, and the machine-readable instructions are executed by the processor to execute the steps of the control method of the laryngoscope system as claimed in claim 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method for controlling a laryngoscope system according to claim 8 are executed.

Images