Acoustic imaging method and device

Through the cooperation of the acoustic imaging device and the mobile smart terminal, the problem of inconvenient portability and inconvenient use of the acoustic imaging device in the prior art is solved, portability and simplicity of use are realized, and the cost and size are reduced. Users can flexibly choose the screen size. And directly store and send imaging results.

CN118938132APending Publication Date: 2024-11-12BEIJING INST OF TECH
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202410972741.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The existing acoustic imaging devices are not portable enough and are not easy to use. Especially since hand-held acoustic imager is limited by the display size, fixed acoustic imager is not suitable for hand-held use.

Method used

Through the cooperation of the acoustic imaging device and the mobile smart terminal, data is collected using a microphone array, and transmitted to the mobile smart terminal for processing and display. The data transmission and power supply are realized by combining the data acquisition and processing circuit and connector. Users can display and save through the mobile smart terminal Imaging results.

Benefits of technology

The portability and simplicity of use of the acoustic imaging device are realized, the device size is reduced, and the cost is reduced. Users can flexibly select the screen size, and the imaging results can be directly stored and sent, making it more convenient to use.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118938132A_ABST
    Figure CN118938132A_ABST
Patent Text Reader

Abstract

The invention discloses an acoustic imaging method and device, and belongs to the field of acoustic imaging. The acoustic imaging method is realized through cooperation of the acoustic imaging device and the mobile intelligent terminal. The acoustic imaging method comprises the following steps: acquiring first data through a microphone array; obtaining second data based on the first data; transmitting the second data to the mobile intelligent terminal; obtaining an acoustic imaging result according to the second data; and displaying the acoustic imaging result. The acoustic imaging device comprises a microphone array, a data acquisition and processing circuit and a connector; the microphone array is connected with the data acquisition and processing circuit, the data acquisition and processing circuit is connected with the connector, and the connector is connected with the mobile intelligent terminal directly or through a data line; the mobile intelligent terminal comprises but is not limited to an intelligent mobile phone and a tablet personal computer. Compared with an existing acoustic imager, the detection result can be displayed through the mobile intelligent terminal, the system can be conveniently combined with the mobile intelligent terminal to form a rigid whole, and the system is more portable, easier to use and lower in cost.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of acoustic imaging, and in particular to an acoustic imaging method and device. Background Art

[0002] Acoustic imaging technology collects multi-channel sound wave (including ultrasonic) signals through a microphone array, reconstructs them using imaging algorithms such as beamforming, and displays the spatial distribution of the sound source in the form of an image. The image can also be superimposed with the visible light image obtained by the camera to more intuitively show the location of the sound source. It can be used to detect and locate anomalies such as gas leaks, mechanical failures, and partial discharges.

[0003] Most existing acoustic imaging devices are integrated structures that include microphone arrays, cameras, processors, memory, display screens, batteries and other components. They are called handheld acoustic imagers, which can independently realize signal acquisition, reconstruction processing and result display. However, this also means that their overall size is limited by the size of the display screen, that is, it is difficult to improve portability without reducing the size of the display screen; and if you want to send the imaging results to others or view them outside the acoustic imager, you must first export them from the acoustic imager, which is not easy to use. In addition, there is also a fixed acoustic imager on the market, which does not have a display screen itself, but connects to a computer through a network cable to achieve user interaction. As the name suggests, fixed acoustic imagers are mainly used for long-term monitoring of fixed locations. Although their own size is not limited by the display screen and can be miniaturized, their combination with a computer is not suitable for handheld use. Summary of the invention

[0004] In order to solve the technical problems that existing acoustic imaging devices are not portable enough and not easy to use, the present invention provides a method for realizing acoustic imaging by cooperating with an acoustic imaging device and a mobile intelligent terminal, and an acoustic imaging device suitable for use with a mobile intelligent terminal.

[0005] The purpose of the present invention is achieved through the following technical solutions.

[0006] In a first aspect, the present invention discloses an acoustic imaging method, which is implemented by cooperating with an acoustic imaging device and a mobile intelligent terminal, comprising:

[0007] Acquire first data through a microphone array;

[0008] obtaining second data based on the first data;

[0009] Transmitting the second data to the mobile smart terminal;

[0010] Obtaining an acoustic imaging result according to the second data;

[0011] The acoustic imaging result is displayed.

[0012] In some embodiments, an acoustic imaging algorithm is used to obtain an acoustic imaging result according to the second data; the acoustic imaging algorithm is DAS, MVDR or MUSIC.

[0013] In some embodiments, an acoustic imaging algorithm is used to obtain the second data based on the first data; the acoustic imaging algorithm is DAS, MVDR or MUSIC.

[0014] In some embodiments, when the data saving function is triggered, the acoustic imaging results and / or original data are saved in the mobile smart terminal.

[0015] In a second aspect, the present invention further discloses an acoustic imaging device suitable for use with a mobile intelligent terminal. The acoustic imaging device comprises a microphone array, a data acquisition and processing circuit, and a connector;

[0016] The microphone array is connected to the data acquisition and processing circuit, the data acquisition and processing circuit is connected to the connector, and the connector is connected to the mobile intelligent terminal directly or through a data line;

[0017] The mobile intelligent terminal includes but is not limited to smart phones and tablet computers.

[0018] In some embodiments, the connector is a USB Type-C plug or receptacle.

[0019] In some embodiments, after the connector is connected to the mobile smart terminal, the acoustic imaging device and the mobile smart terminal are combined into a rigid whole.

[0020] In some embodiments, the acoustic imaging device further includes a clamp for fixing the mobile smart terminal so that the acoustic imaging device and the mobile smart terminal are combined into a rigid whole.

[0021] In some embodiments, an external power supply interface is also included, which is connected to the data acquisition and processing circuit. When an adapted power supply is inserted, the power supply is used to power the acoustic imaging device and the mobile intelligent terminal.

[0022] Beneficial effects:

[0023] 1. Compared with the existing handheld acoustic imagers, since the present invention is easy to use with a mobile smart terminal and can display the detection results through the mobile smart terminal, it does not need to include components such as a display screen, thereby further reducing the size, being more portable, and reducing the cost; the user can flexibly choose a mobile smart terminal with different screen sizes to use with the acoustic imager according to the needs; and the imaging results can be directly stored in the mobile smart terminal, and can be viewed anytime and anywhere without being exported separately, and can also be sent to others through a variety of communication applications on the mobile smart terminal, which is easier to use.

[0024] 2. Compared with the existing fixed acoustic imagers, since the present invention can be easily combined with a mobile smart terminal into a rigid whole, the user does not need to hold the mobile smart terminal and the acoustic imaging device separately when using it by hand, which is more convenient to use; and since the acoustic imaging device, which is the source of the original data of the acoustic imaging results, and the mobile smart terminal used to display the acoustic imaging results are combined into a rigid whole, the movement of the display screen is synchronized with the movement of the picture on the display screen when the user uses it by hand, which is more intuitive. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 This is a flowchart of the steps of an acoustic imaging method according to Embodiment 1 of the present invention;

[0026] Figure 2 This is a flowchart of the steps of an acoustic imaging method according to Embodiment 2 of the present invention;

[0027] Figure 3 This is a structural block diagram of an acoustic imaging device according to Embodiment 3 of the present invention;

[0028] Figure 4 This is a schematic diagram of the structure of an acoustic imaging device according to Embodiment 3 of the present invention;

[0029] Figure 5 This is a schematic diagram of the structure of an acoustic imaging device according to Embodiment 4 of the present invention;

[0030] Among them: 1—microphone array, 2—data acquisition and processing circuit, 3—connector, 4—camera, 501—fixed fixture, 502—movable fixture, 6—tripod connection hole, 7—external power supply interface, 8—connecting line, 9—mobile intelligent terminal. DETAILED DESCRIPTION

[0031] The present invention will be described in detail below with reference to the accompanying drawings and embodiments. The technical problems solved by the technical solution of the present invention and the beneficial effects are also described. It should be noted that the described examples are only intended to facilitate the understanding of the present invention and do not have any limiting effect on it.

[0032] [Example 1]

[0033] like Figure 1 As shown, an acoustic imaging method comprises:

[0034] Acquiring the acoustic wave data of each microphone through the microphone array;

[0035] Combining the acoustic wave data of each microphone into microphone array data;

[0036] Visible light image data is obtained by collecting through a camera;

[0037] Transmitting microphone array data and visible light image data to a mobile smart terminal;

[0038] Obtaining acoustic imaging results based on microphone array data using an acoustic imaging algorithm;

[0039] The acoustic imaging results are superimposed on the visible light images.

[0040] In this embodiment, the sound wave data of each microphone corresponds to the first data in the summary of the invention, and the microphone array data corresponds to the second data in the summary of the invention.

[0041] The microphone array may be 16 digital microphones arranged in a spiral shape; the sound wave data of each microphone may be a PDM (pulse density modulation) signal output by each digital microphone; the method of combining the sound wave data of each microphone into microphone array data may be combining each 1-bit binary PDM signal output by the 16 digital microphones in each sampling into 2 bytes; the method of transmitting data to the mobile smart terminal may be USB bulk or isochronous mode transmission; the acoustic imaging algorithm may be a DAS, MVDR or MUSIC algorithm, etc.

[0042] When the acoustic imaging device is connected to a mobile smart terminal, a matching program installed in the mobile smart terminal can be automatically started.

[0043] The user can control the supporting program through the touch screen or remote control of the mobile smart terminal to save the imaging results and / or original data, and can also adjust the parameters related to the imaging algorithm.

[0044] [Example 2]

[0045] like Figure 2 As shown, an acoustic imaging method comprises:

[0046] Acquiring the acoustic wave data of each microphone through the microphone array;

[0047] Obtaining acoustic imaging results according to the acoustic wave data of each microphone using an acoustic imaging algorithm;

[0048] Visible light image data is obtained by collecting through a camera;

[0049] Transmit the acoustic imaging results and visible light image data to a mobile smart terminal;

[0050] The imaging results are superimposed on the visible light image.

[0051] The acoustic wave data of each microphone described in this embodiment corresponds to the first data in the summary of the invention, and the acoustic imaging result corresponds to the second data in the summary of the invention, that is, "obtaining the acoustic imaging result according to the second data" in the summary of the invention is an empty operation in this embodiment.

[0052] The specific implementation of the microphone array, the sound wave data of each microphone, the acoustic imaging algorithm and the data transmission method can be found in the description of Example 1, and will not be described again here to avoid repetition.

[0053] When the acoustic imaging device is connected to a mobile smart terminal, a matching program installed in the mobile smart terminal can be automatically started.

[0054] The user can control the supporting program through the touch screen or remote control of the mobile smart terminal to save the imaging results. The supporting program can also send a control signal to enable the acoustic imaging device to transmit raw data for the mobile smart terminal to save or adjust the imaging algorithm related parameters.

[0055] Compared with Example 1, the acoustic imaging algorithm in this embodiment runs in the acoustic imaging device rather than the mobile smart terminal. Therefore, the processing performance requirements of the mobile smart terminal used are relatively low, and it can run smoothly with more mobile smart terminals. However, the processing performance requirements of the acoustic imaging device are relatively high, which may increase the cost of the acoustic imaging device to a certain extent.

[0056] [Example 3]

[0057] like Figure 3 , Figure 4 As shown, an acoustic imaging device includes a microphone array 1, a data acquisition and processing circuit 2, a connector 3 and a camera 4.

[0058] The data acquisition and processing circuit 2 acquires the acoustic wave data of each microphone through the microphone array 1 and acquires the visible light image data through the camera 4, processes the acoustic wave data of each microphone and the visible light image data, and transmits them to the mobile intelligent terminal through the connector 3. The mobile intelligent terminal includes but is not limited to a smart phone and a tablet computer.

[0059] In this embodiment, connector 3 is a USB Type-C plug. After it is inserted into the USB Type-C socket of the mobile smart terminal, in addition to the above-mentioned data transmission, the mobile smart terminal can also supply power to the acoustic imaging device through connector 3, and the mobile smart terminal and the acoustic imaging device are combined into a rigid whole. When using it, the user can hold the mobile smart terminal in hand or use a selfie stick, mobile phone holder or other device on the market to clamp the mobile smart terminal without having to hold the acoustic imaging device separately.

[0060] Furthermore, a telescopic or rotating mechanism may be provided between the connector 3 and other parts of the acoustic imaging device so that the connector can be stored in the housing to avoid damage when not in use.

[0061] [Example 4]

[0062] like Figure 5 As shown, an acoustic imaging device includes a microphone array 1, a data acquisition and processing circuit, a connector 3, a camera 4, a clamp (including a fixed clamp 501 and a movable clamp 502), a tripod connection hole 6 and an external power supply interface 7.

[0063] The data acquisition and processing circuit acquires the acoustic wave data of each microphone through the microphone array 1 and acquires the visible light image data through the camera 4, processes the acoustic wave data of each microphone and the visible light image data, and transmits them to the mobile intelligent terminal 9 through the connector 3 and the connecting line 8. The mobile intelligent terminal includes but is not limited to a smart phone and a tablet computer.

[0064] The fixture (including the fixed fixture 501 and the movable fixture 502) is used to fix the mobile intelligent terminal 9, and combine the acoustic imaging device and the mobile intelligent terminal into a rigid whole.

[0065] The tripod connection hole 6 can be used for connecting an external tripod, monopod, etc.

[0066] When the external power supply interface 7 is not plugged into a power source, the mobile intelligent terminal 9 supplies power to the acoustic imaging device through the connecting line 8 and the connector 3; when the external power supply interface 7 is plugged into an adapted power source, the power source supplies power to the acoustic imaging device, and at the same time supplies power to the mobile intelligent terminal 9 through the connector 3 and the connecting line 8.

[0067] Compared with Example 3, this embodiment uses a clamp to fix the mobile smart terminal, which can reduce the accidental separation or damage of the connector caused by the gravity of the acoustic imaging device itself, but it also means that the size of the mobile smart terminal used must be within the adjustable range of the clamp; this embodiment is provided with an external power supply interface, which solves the problem that the acoustic imaging device occupies the charging port of the mobile smart terminal, resulting in the inability to connect to the external power supply during use, and can be used continuously for a long time.

[0068] The specific description above further illustrates the purpose, technical solutions and beneficial effects of the invention in detail. It should be understood that the above is only a specific embodiment of the present invention and does not limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. An acoustic imaging method, characterized in that: include: Acquire first data through a microphone array; obtaining second data based on the first data; Transmitting the second data to the mobile smart terminal; Obtaining an acoustic imaging result according to the second data; The acoustic imaging result is displayed.

2. The acoustic imaging method according to claim 1, characterized in that: An acoustic imaging algorithm is used to obtain an acoustic imaging result according to the second data; the acoustic imaging algorithm is DAS, MVDR or MUSIC.

3. The acoustic imaging method according to claim 1, characterized in that: An acoustic imaging algorithm is used to obtain second data based on the first data; the acoustic imaging algorithm is DAS, MVDR or MUSIC.

4. The acoustic imaging method according to claim 1, characterized in that: Also includes: When the data saving function is triggered, the acoustic imaging result and the second data are saved in the mobile smart terminal.

5. The acoustic imaging method according to claim 1 or 4, characterized in that: Also includes: When the data saving function is triggered, obtaining third data based on the first data; Transmitting the third data to the mobile intelligent terminal; The third data is stored in the mobile intelligent terminal.

6. An acoustic imaging device, characterized in that: It includes a microphone array, a data acquisition and processing circuit, and a connector; The microphone array is connected to the data acquisition and processing circuit, the data acquisition and processing circuit is connected to the connector, and the connector is connected to the mobile intelligent terminal directly or through a data line.

7. The acoustic imaging device according to claim 6, characterized in that: The connector is a USB Type-C plug or socket; After the connector is connected to the mobile intelligent terminal, the acoustic imaging device and the mobile intelligent terminal are combined into a rigid whole.

8. The acoustic imaging device according to claim 6, characterized in that: It also includes a clamp for fixing the mobile intelligent terminal so that the acoustic imaging device and the mobile intelligent terminal are combined into a rigid whole.

9. The acoustic imaging device according to claim 6, characterized in that: A telescopic or rotating mechanism is provided between the connector and other parts of the acoustic imaging device.

10. The acoustic imaging device according to claim 6, characterized in that: The device also includes an external power supply interface, which is connected to the data acquisition and processing circuit. When the external power supply interface is not plugged into a power source, the mobile intelligent terminal supplies power to the acoustic imaging device through the connector; when the external power supply interface is plugged into an adapted power source, the power source supplies power to the acoustic imaging device and supplies power to the mobile intelligent terminal through the connector.

Citation Information

Patent Citations

  • Acoustic imaging apparatus, method, device and system for detecting abnormal sound of transformer

    CN111308395A

  • Pipeline multi-dimensional visual inspection system and use method

    CN116989278A

  • Acoustic imaging apparatus

    CN217717975U

  • Acoustic imaging device

    CN223582131U

  • Passive devices for broadband acoustic acquisition and passive systems for broadband acoustic imagery

    US20140192201A1