Methods and apparatus for acquiring visual signals

Abstract

This invention discloses a method and apparatus for acquiring visual signals. The method includes: receiving raw visual signals through an audio interface to obtain an audio format signal; converting the audio format signal into an image format signal; and performing image processing on the image format signal to obtain a target visual signal corresponding to the raw visual signal. By acquiring camera-related visual signals using a common audio interface in the application processor, the need for replacing or updating the application processor is avoided, effectively improving product compatibility with the application processor and reducing the cost of visual signal acquisition.

Description

Technical Field

[0001] This invention relates to the field of image processing technology, and in particular to methods and apparatus for acquiring visual signals. Background Technology

[0002] Currently, mainstream embedded products increasingly require data acquisition from low-resolution cameras to supplement visual perception. However, some mass-produced application processors, while initially configured with audio data acquisition interfaces, often lack commonly used camera acquisition control interfaces such as MIPI (Mobile Industry Processor Interface) or DVP (Digital Video Port). For such application processors, achieving visual signal acquisition via a low-resolution camera requires either replacing the application processor or reconfiguring the corresponding camera acquisition control interface. This approach results in high costs for visual signal acquisition and limits compatibility to application processors equipped with camera acquisition control interfaces. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a method and apparatus for acquiring visual signals, which can acquire visual signals based on the audio interface of the application processor, improve the compatibility of the product with the application processor, and reduce the cost of visual signal acquisition.

[0004] In one aspect of the present invention, a method for acquiring visual signals is provided. The method includes: receiving a raw visual signal via an audio interface to obtain an audio format signal; converting the audio format signal into an image format signal; and performing image processing on the image format signal to obtain a target visual signal corresponding to the raw visual signal.

[0005] In another aspect of the invention, an apparatus for acquiring visual signals is provided. The apparatus includes: an interface module configured to receive raw visual signals via an audio interface to obtain an audio format signal; a conversion module configured to convert the audio format signal into an image format signal; and an image processing module configured to perform image processing on the image format signal to obtain a target visual signal corresponding to the raw visual signal.

[0006] According to the technical solution of this invention, raw visual signals are received based on the pre-configured audio interface of the application processor, thereby obtaining an audio format signal corresponding to the audio interface. This solves the problem that the application processor cannot receive visual signals because it is not equipped with a camera acquisition interface. Simultaneously, the audio format signal is converted to an image format signal, and then image processing is performed on the image format signal to obtain the target visual signal. This solves the data processing problem when the application processor is not equipped with a camera controller. The audio format signal acquired through the audio format is converted back to the image format signal, thus meeting the data format requirements of user development. In this way, camera-related visual signals are acquired based on the universal audio interface in the application processor, avoiding the need to replace or update the application processor, effectively improving product compatibility with the application processor, and reducing the cost of visual signal acquisition. Attached Figure Description

[0007] Figure 1 A flowchart illustrating a method for acquiring visual signals according to an embodiment of the present invention;

[0008] Figure 2 This is a schematic diagram of a circuit for connecting an I2S control interface to a DVP camera module according to an embodiment of the present invention;

[0009] Figure 3 This is a flowchart of an audio format signal conversion method according to an embodiment of the present invention;

[0010] Figure 4 This is a schematic diagram of an audio format signal conversion method according to an embodiment of the present invention;

[0011] Figure 5 This is a block diagram of a device for acquiring visual signals according to an embodiment of the present invention;

[0012] Figure 6 This is a schematic diagram of a module for connecting a device for acquiring visual signals to a DVP camera, according to an embodiment of the present invention. Detailed Implementation

[0013] To explain in detail the technical content, objectives, and effects of the present invention, the following description is provided in conjunction with the embodiments and accompanying drawings.

[0014] In existing technologies, some mass-produced application processors are typically equipped with audio data acquisition interfaces during the initial production stage, but lack commonly used camera acquisition control interfaces, such as MIPI (Mobile Industry Processor Interface) or DVP (Digital Video Port). For such application processors, if visual signal acquisition via a low-resolution camera is required, the visual signal acquisition function can only be achieved by replacing the application processor or reconfiguring the corresponding camera acquisition control interface. This approach results in high costs for visual signal acquisition, and the range of application processors configured in the product is limited to those equipped with camera acquisition control interfaces, leading to low compatibility.

[0015] To address at least the aforementioned technical problems, this disclosure provides a method for acquiring visual signals. According to this disclosure, raw visual signals are received based on an audio interface pre-configured in the application processor, thereby obtaining an audio format signal corresponding to the audio interface. This solves the problem that the application processor cannot receive visual signals because it lacks a camera acquisition interface. Simultaneously, the audio format signal is converted to an image format signal, and then image processing is performed on the image format signal to obtain the target visual signal. This solves the data processing problem when the application processor is not configured with a camera controller, and the audio format acquired via audio is converted back to an image format signal, thus meeting the data format requirements of user development. In this way, embodiments of this disclosure can acquire camera-related visual signals based on a common audio interface in the application processor, avoiding the need to replace or update the application processor, effectively improving product compatibility with the application processor, and reducing the cost of visual signal acquisition.

[0016] In the following, the technical solutions according to this disclosure will be described with reference to specific embodiments and in conjunction with the accompanying drawings.

[0017] Figure 1 This is a flowchart illustrating a method 100 for acquiring visual signals according to an embodiment of the present disclosure. (Refer to...) Figure 1 The method 100 includes the following steps 102 to 106.

[0018] In step 102, the raw visual signal is received through the audio interface to obtain the audio format signal.

[0019] In some embodiments, receiving the raw visual signal through an audio interface to obtain an audio format signal includes: acquiring the standard clock signal of the camera module that captures the raw visual signal; setting the standard clock signal as the reference clock signal of the audio interface; receiving the raw visual signal through the audio interface according to the most significant bit, and storing the raw visual signal based on little-endian byte order to obtain an audio format signal corresponding to the reference clock signal. In this way, the audio interface uses the standard clock signal of the camera module as the reference clock signal to ensure that the clocks of the camera module and the audio interface are from the same source. Simultaneously, receiving and storing the raw visual signal according to the most significant bit and little-endian byte order ensures that the audio interface can accurately acquire the corresponding amount of data within the sampling period, thereby ensuring that the audio interface can accurately and in real-time receive the raw visual signal.

[0020] In step 104, the audio format signal is converted into an image format signal.

[0021] In some embodiments, converting the audio format signal into an image format signal includes: acquiring an identifier signal in the audio format signal corresponding to a preset target data bit; determining the image frame state in the audio format signal based on the identifier signal; acquiring valid frame data in the audio format signal based on the image frame state; parsing the valid frame data and converting it into an image format signal. In this way, images are distinguished from each other, avoiding the conversion of non-image data and ensuring the accuracy of the image format signal.

[0022] In some embodiments, determining the image frame state in the audio format signal based on the identification signal includes: determining whether the identification signal is in a low-level state; if so, determining that the image frame state of the audio format signal is in a blanking state; otherwise, determining that the image frame state in the audio format signal is in a scanning state. In this way, during the scanning process of converting optical signals into electrical signals, scanning always starts from the upper left corner of the image and moves horizontally forward, while the scan point also moves downwards at a relatively slow rate. When the scan point reaches the end point of the image scan, it quickly returns to the starting point to continue scanning. Therefore, since blanking data exists in the image, by determining the level state of the identification signal in the current audio format signal, it is determined whether it is in a blanking state, thereby distinguishing between valid and invalid data, solving the problem that the audio interface cannot distinguish the starting position of the image frame and different image data.

[0023] In some embodiments, the type of blanking state includes field blanking state and line blanking state. Determining the image frame state of the audio format signal as a blanking state includes: obtaining the data width of the low-level state in the identifier signal; if the data width is greater than a preset width threshold, then determining the image frame state in the audio format signal as a field blanking state; if the data width is less than or equal to the width threshold, then determining the video state in the audio format signal as a line blanking state. In this way, since the scan point returns from the end of the previous line to the beginning of the next line when the image is scanned line by line, the return process between lines is line blanking. The image frame is composed of a sequence of line signals separated by line blanking intervals. When the scan point finishes scanning a frame, it returns from the lower right corner of the image to the upper left corner to start scanning a new frame, which forms field blanking. Since the blanking state in audio format signals can be either line blanking or field blanking, the time interval of the current blanking state is determined based on the data width when the indicator signal is in a low-level state. If the time interval is short, it is determined to be line blanking; if the time interval is long, it is determined to be field blanking. This ensures the distinction and data conversion between different image frames and avoids data mixing between different image frames, which could cause visual signal reception errors.

[0024] In some embodiments, obtaining valid frame data in the audio format signal based on the image frame state includes: if the image frame state is in a field blanking state, then marking the data in the audio format signal that was received before the data in the low-level state of the identifier signal and that was in the high-level state of the identifier signal as the current valid frame data; resetting the preset valid frame length and the data width to 0; and marking the data in the audio format signal that was received after the data in the low-level state of the identifier signal and that was in the high-level state of the identifier signal as the next valid frame data. In this way, different image frames in the same audio format signal are effectively distinguished and statistically analyzed, ensuring data alignment between the audio format signal and the original visual signal.

[0025] In some embodiments, obtaining valid data from the audio format signal based on the image frame state includes: if the image frame state is a scanning state or a line blanking state, then marking the data in the audio format signal where the identifier signal is high as the current valid frame data, and calculating the length of the valid frame. In this way, a high-level identifier signal indicates that the camera module is sending valid image data. Furthermore, the absence of a line blanking state indicates that the currently sent image data is from the same image frame, which can be merged and converted, thus ensuring the accuracy of the image data conversion.

[0026] In some embodiments, parsing and converting the valid frame data into an image format signal includes: parsing the valid frame data bit by bit based on a single instruction multiple data stream to obtain multiple pixel data; storing the multiple pixel data in a target storage block and incrementing the preset valid frame length by 1; if the valid frame length is greater than or equal to a preset image resolution, then acquiring all the pixel data in the target storage block as an image format signal. In this way, all pixel data of the same image frame are stored in the target storage block, avoiding data mixing between different frame image data. Simultaneously, when the pixel data of an image meets the image resolution, it is directly processed as an image format signal to obtain the target visual signal, thereby achieving real-time data conversion and processing.

[0027] In some embodiments, parsing the valid frame data bit by bit based on Single Instruction Multiple Data Stream (SMD) to obtain multiple pixel data includes: obtaining the data connection order of the camera module that captured the original visual signal; shifting and performing a logical OR operation on the valid frame data according to the data connection order to form new byte data based on SMD, and marking the byte data as pixel data. In this manner, since the audio interface receives and stores the original visual signal using the most significant bit and little-endian byte order, it is necessary to shift and perform a logical OR operation on the audio format signal according to the data connection order of the camera module to form new byte data, thereby restoring the original visual signal to obtain an image format signal for subsequent image processing.

[0028] In step 106, the image format signal is processed to obtain a target visual signal corresponding to the original visual signal.

[0029] Figure 2 This is a schematic diagram illustrating an I2S control interface connection to a DVP camera module according to an embodiment of the present invention. (Refer to...) Figure 2 The method 200 includes the following steps 202 to 206.

[0030] In step 202, a camera module is connected to the audio interface, the original visual signal is received according to the most significant bit, and the original visual signal is stored based on little-endian byte order to obtain an audio format signal corresponding to the reference clock signal.

[0031] In some embodiments, the audio interface can be an I2S control interface, and the camera module can be a DVP camera module. In this case, the original visual signal is a raw grayscale image format signal, and the audio format signal is PCM (Pulse Code Modulation) audio data. Specifically, when the DVP camera module is connected to the I2S control interface, it needs to be configured with a signal line corresponding to the target data bit (HSYNC signal terminal) as the discrimination signal for the start of each frame. The data terminals (D1 to D(N-1) signal terminals) of the DVP camera module are connected to the serial data input port (SDI_0 to SDI_N-1 ports) of each bit (byte) corresponding to the I2S control interface. The standard clock signal terminal (PCLK signal) configured on the DVP camera module is connected to the reference clock signal terminal (MCLK signal) corresponding to the I2S control interface. Thus, the PCLK signal of the DVP camera module is referenced based on the MCLK signal of the I2S control interface to ensure clock consistency. Because the BCLK signal and MCLK signal of the I2S control interface are divided in a 1:1 ratio, while the sampling frequency (LRCLK signal) of the I2S control interface is divided by the BCLK signal by 64, and because the original visual signal is received and stored according to MSB (Most Significant Bit) and little-endian byte order, 64-bit PCM audio data can be accurately acquired within one sampling cycle of the I2S control interface. Based on the characteristics of the I2S control interface, each bit is automatically arranged in PCM format in memory distribution, requiring no conversion.

[0032] In some embodiments, the number of I2S control interfaces is expanded according to the number of connected camera modules.

[0033] In some embodiments, the I2S control interface is set to Master mode. Even without BCLK and LRCLK outputs from the I2S control interface, it can continuously and accurately acquire data input from the DVP camera module on the SDI bus. BCLK and LRCLK are the bit clock and synchronization clock in the I2S protocol, respectively.

[0034] In some embodiments, the bit clock BCLK in the I2S control interface is kept the same as its MCLK signal, and because the effective bits of I2S stereo are 64 bits, LRCLK needs to be 1 / 64 of the PCLK signal configured for the DVP camera module.

[0035] In some embodiments, for the I2S control interface, it can receive 2*32bit=64bit data at a time within one sampling period (i.e., one LRCLK period). Therefore, the I2S control interface can convert and output 64 image pixel data within one period.

[0036] In some embodiments, the more data channels the I2S control interface connects to, the more bits can be quantized, and the more detailed the image displayed by the final image format signal.

[0037] In step 204, each time a complete audio format signal is received, the audio format signal is converted into an image format signal.

[0038] Figure 3 This is a flowchart illustrating an audio format signal conversion method according to an embodiment of the present invention. (Refer to...) Figure 3 In some embodiments, the audio interface is an I2S control interface, and the camera module is an 8x DVP camera module (where 1x is the HSYNC signal terminal and 7x is the DATA signal terminal). The conversion method includes steps 2042 to 2044.

[0039] In step 2042, for each audio format signal acquired, it is determined whether the identifier signal (HSYNC signal) is all 0 (low level state). If so, step 2044 is executed; otherwise, step 2050 is executed.

[0040] In some embodiments, each audio format signal is the data acquired by the I2S control interface within one sampling period, and each audio format signal includes 64 bits of data.

[0041] In step 2044, the image frame state of data with a flag signal of 0 is marked as blanking state, and the data width in the blanking state is calculated. It is determined whether the data width in the blanking state exceeds a preset width threshold. If it does, step 2046 is executed; otherwise, step 2048 is executed. The width threshold is determined according to the type of camera module. Different camera modules have different width thresholds. For example, if the camera module is SC031IOT, the width threshold for the current camera module is 3ms.

[0042] In some embodiments, if the HSYNC state is 0, it indicates that the camera module is operating in blanking mode and is counting blankings. If the accumulated blankings exceed the number of VBlank-SLICE_SIZE (a preset width threshold), it indicates that the blanking signal is a field blanking signal, and the valid signal of the next frame is the beginning of the entire frame; otherwise, it is a line blanking signal. Furthermore, the PCM to image conversion must be performed when HSYNC is 1, indicating that the camera module is sending valid image data at this moment.

[0043] In step 2046, the current image frame state is marked as blanking state, and the data in the audio format signal that is received before the data in the low-level state of the identification signal and is in the high-level state of the identification signal is marked as the current valid frame data; the preset valid frame length and data width are reset to 0; and the data in the audio format signal that is received after the data in the low-level state of the identification signal and is in the high-level state of the identification signal is marked as the next valid frame data.

[0044] In step 2048, the current image frame state is marked as line blanking state, the data in the audio format signal whose identifier signal is in a high-level state is marked as the current valid frame data, and the length of the valid frame is counted.

[0045] In step 2050, the current image frame state is marked as a scan state. Based on Single Instruction Multiple Data (SIMD), the valid frame data is shifted and logically ORed according to the data connection order of the camera module to form new byte data, and the byte data is marked as pixel data. In some embodiments, each audio format signal can be parsed into 64 pixel data.

[0046] In some embodiments, after parsing the pixel data, it is determined whether the identifier signal corresponding to each pixel data is high. If so, the pixel data is stored in the target storage block and the preset effective frame length is incremented by 1; otherwise, the parsing of the pixel data is stopped.

[0047] In some embodiments, an out-of-bounds redundancy for the size of an audio format signal is provided in the target storage block.

[0048] In step 2052, it is determined whether the effective frame length is greater than or equal to the preset image resolution. If so, all pixel data in the target storage block is acquired as an image format signal, and the effective frame length exceeding the image resolution size is copied to the new target storage block. At the same time, the effective frame length is set to 0, and the image frame status is marked as scan state.

[0049] In this way, each audio format signal received by the I2S control interface is converted in real time.

[0050] In step 206, the image format signal is input into the Video4Linux2 framework for image processing to obtain the target visual signal.

[0051] In some embodiments, the Video4Linux2 framework is a driver framework for real-time video capture on a Linux system. After processing by the Video4Linux2 framework, the image format signals can be transmitted to developers for use.

[0052] Figure 4 This is a schematic diagram illustrating an audio format signal conversion method according to an embodiment of the present invention. (Refer to...) Figure 4 The LRCLK signal in the I2S control interface is used to characterize the sampling frequency of the left and right channels. The HSYNC signal of the DVP camera module is connected to SDI_0 in the I2S control interface, and the DATA signal (data terminal) of the DVP camera module is connected to SDI_1 to SDI_N in the I2S control interface. Each channel transmits 32 bits of data, therefore a total of 64 bits of data are acquired per sampling cycle. With 2N+1 channels, the PCM memory distribution is represented by alternating storage of the left and right channels as CH0, CH1, CH2, ..., CH(2N), CH(2N+1). Therefore, the most significant bit data of the PCM corresponding to the left channel in the time axis direction is represented as CH0, CH2, CH4...CH(2N), and the most significant bit data of the PCM corresponding to the right channel is represented as CH1, CH3, CH5...CH(2N+1). Therefore, within one LRCLK signal sampling cycle of the I2S control interface, 64 pixel data points can be converted as Pixel0, Pixel1, Pixel2, ..., Pixel63.

[0053] In some embodiments, when the number of controllers configured for the camera module is insufficient in a mass-produced SoC main controller, but there are surplus audio interfaces, the relevant data of the low-resolution camera module can be input through a method for acquiring visual signals according to the present invention, thereby maximizing the saving of design costs.

[0054] According to another aspect of the invention, Figure 5 This is a block diagram illustrating a device 300 for acquiring visual signals according to an embodiment of the present invention. (Refer to...) Figure 5 The device 300 includes an interface module 302, a conversion module 304, and an image processing module 306. The interface module 302 is configured to receive the original visual signal through an audio interface to obtain an audio format signal. The conversion module 304 is configured to convert the audio format signal into an image format signal. The image processing module 306 is configured to perform image processing on the image format signal to obtain a target visual signal corresponding to the original visual signal.

[0055] In some embodiments, the interface module is configured to: acquire a standard clock signal of a camera module that captures the original visual signal; set the standard clock signal as a reference clock signal of a preset audio interface; and receive the original visual signal through the audio interface according to the most significant bit and store the original visual signal based on little-endian byte order to obtain an audio format signal based on the reference clock signal.

[0056] In some embodiments, the conversion module is configured to: acquire an identifier signal corresponding to a preset target data bit in the audio format signal; determine the image frame state in the audio format signal according to the identifier signal; acquire valid frame data in the audio format signal according to the image frame state; and parse the valid frame data and convert it into the image format signal.

[0057] In some embodiments, the audio interface includes an I2S interface or a PCM interface, and the raw visual signal includes a signal output via a MIPI interface or a DVP interface.

[0058] In some embodiments, the audio format signal includes a PCM format signal, and the image format signal includes a RAW GREY or RGB image format signal.

[0059] Reference Figure 6 This is a schematic diagram illustrating a device for acquiring visual signals according to an embodiment of the present invention connected to a DVP camera. In some embodiments, the DVP interface (DVP camera) inputs the raw visual signal to the application processor via the I2S interface (I2S controller). Simultaneously, the data input via the I2S interface (I2S controller) is first stored in the DMA module. Then, the data in the DMA module is converted in real time from PCM audio format signal to RAW GREY or RGB image format signal via the conversion module 304. After the image format signal is input into the Video4Linux2 framework for image processing, it is then input into the application for user use.

[0060] In summary, the present invention provides a method and apparatus for acquiring visual signals. Based on an application processor's pre-configured audio interface, it receives the raw visual signals from a camera module, thereby obtaining an audio format signal corresponding to the audio interface. This solves the problem of the application processor being unable to receive visual signals when it lacks a camera acquisition interface. The audio format signal is received and stored using MSB and little-endian byte order. When the identifier signal of the audio format signal is high, the corresponding bit data on the audio format signal is shifted according to the connection order of the camera module's DATA signal and subjected to a logical OR operation to form a new byte data. This data is the converted image format signal. The image format signal is then processed to obtain the target visual signal. This solves the data processing problem when the application processor lacks a camera controller, converting the visual signal acquired via audio format back into image data to meet the data format requirements of user development. Acquiring camera-related visual signals based on a common audio interface in the application processor avoids the need to replace or update the application processor, effectively improving product compatibility with the application processor and reducing the cost of visual signal acquisition.

[0061] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent modifications made based on the content of the present invention specification and drawings, or direct or indirect applications in related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A method of acquiring a visual signal, characterized by, The method comprises: receiving an original visual signal through an audio interface to obtain an audio format signal; converting the audio format signal into an image format signal, comprising obtaining an identification signal corresponding to a preset target data bit in the audio format signal, determining an image frame state in the audio format signal according to the identification signal, obtaining valid frame data in the audio format signal according to the image frame state, and performing parsing processing on the valid frame data and converting it into the image format signal; and performing image processing on the image format signal to obtain a target visual signal corresponding to the original visual signal, wherein determining the image frame state in the audio format signal according to the identification signal comprises: judging whether the identification signal is in a low level state; if yes, determining that the image frame state in the audio format signal is a blanking state; otherwise, determining that the image frame state in the audio format signal is a scanning state, wherein the type of the blanking state comprises a field blanking state and a line blanking state, and wherein determining that the image frame state in the audio format signal is a blanking state comprises: obtaining the data width of the low level state in the identification signal; if the data width is greater than a preset width threshold, determining that the image frame state in the audio format signal is a field blanking state; and if the data width is less than or equal to the width threshold, determining that the video state in the audio format signal is a line blanking state.

2. The method of claim 1, wherein, Receiving an original visual signal through an audio interface to obtain an audio format signal comprises: obtaining a standard clock signal of a camera module that captures the original visual signal; setting the standard clock signal as a reference clock signal of the audio interface; and receiving the original visual signal through the audio interface according to the most significant bit, and storing the original visual signal based on the little-endian byte order, to obtain an audio format signal based on the reference clock signal.

3. The method of claim 1, wherein, According to the image frame state, obtaining valid frame data in the audio format signal comprises: if the image frame state is a field blanking state, marking the data in the audio format signal, which is located before the data whose identification signal is in a low level state and whose identification signal is in a high level state in the receiving order, as current valid frame data; resetting a preset valid frame length and the data width to 0; and marking the data in the audio format signal, which is located after the data whose identification signal is in a low level state and whose identification signal is in a high level state in the receiving order, as next valid frame data.

4. The method of claim 1, wherein, According to the image frame state, obtaining valid frame data in the audio format signal comprises: if the image frame state is a scanning state or a line blanking state, marking the data in the audio format signal whose identification signal is in a high level state as current valid frame data, and counting the valid frame length.

5. The method of claim 1, wherein, Performing parsing processing on the valid frame data and converting it into an image format signal comprises: performing bit-by-bit parsing processing on the valid frame data based on single instruction multiple data streams to obtain a plurality of pixel point data; storing the plurality of pixel point data into a target storage block, and adding 1 to a preset valid frame length; and If the effective frame length is greater than or equal to a preset image resolution, all pixel point data in the target storage block is obtained as an image format signal.

6. The method of claim 5, wherein, The single instruction multiple data stream is used to process the effective frame data bit by bit to obtain a plurality of pixel point data, including: Obtaining a data connection sequence of a camera module that captures the original visual signal; Based on the single instruction multiple data stream, the effective frame data is shifted and logically ORed according to the data connection sequence to form new byte data, and the byte data is marked as pixel point data.

7. An apparatus for acquiring a visual signal, characterized by Including: An interface module configured to receive an original visual signal through an audio interface to obtain an audio format signal; A conversion module configured to convert the audio format signal into an image format signal; And An image processing module configured to perform image processing on the image format signal to obtain a target visual signal corresponding to the original visual signal, Wherein the conversion module is configured to: obtain an identification signal corresponding to a preset target data bit in the audio format signal; determine the image frame state in the audio format signal according to the identification signal; obtain the effective frame data in the audio format signal according to the image frame state; and perform analysis processing on the effective frame data and convert it into the image format signal, Wherein the conversion module is configured to: determine whether the identification signal is in a low state; if yes, determine that the image frame state in the audio format signal is a blanking state; otherwise, determine that the image frame state in the audio format signal is a scanning state, Wherein the type of the blanking state includes field blanking state and line blanking state, and wherein the conversion module is configured to: obtain the data width of the low state in the identification signal; if the data width is greater than a preset width threshold, determine that the image frame state in the audio format signal is a field blanking state; and if the data width is less than or equal to the width threshold, determine that the video state in the audio format signal is a line blanking state.

8. The apparatus of claim 7, wherein, The interface module is configured to: Obtain a standard clock signal of a camera module that captures an original visual signal; Set the standard clock signal as a reference clock signal of a preset audio interface; And Receive the original visual signal through the audio interface according to the most significant bit and store the original visual signal based on the little-endian byte sequence, to obtain an audio format signal based on the reference clock signal.

9. The apparatus of claim 7, wherein, The audio interface includes an I2S interface or a PCM interface, and the original visual signal includes a signal output via an MIPI interface or a DVP interface.

10. The apparatus of claim 7, wherein, The audio format signal includes a PCM format signal, and the image format signal includes a RAW GREY or RGB image format signal.

Images