Video processing device

Abstract

The embodiment of the present application provides a video processing device, which relates to the field of data transmission technology. The video processing device includes a control unit and multiple analog-to-digital conversion units. The multiple analog-to-digital conversion units belong to a serial structure, and an I2S bus is connected between the first analog-to-digital conversion unit at the end of the serial structure and the control unit; each analog-to-digital conversion unit is connected to the control unit via an I2C bus; the control unit transmits audio to the first analog-to-digital conversion unit; configures the corresponding conversion unit; the first analog-to-digital conversion unit outputs the received audio to the connected conversion unit; in response to the execution of the above configuration, the audio is subjected to predetermined transmission processing; each other conversion unit transmits audio when there is a next-level analog-to-digital conversion unit in a predetermined direction; in response to the execution of the above configuration, the audio is subjected to predetermined transmission processing. Through the present application, the audio of the user end can be transmitted to the analog camera to realize a call with the analog camera side.

Description

Technical Field

[0001] The present application relates to the technical field of data transmission, and in particular to a video processing device. Background Art

[0002] Video processing devices such as DVR (Digital Video Recorder) can be connected to analog cameras and output the video data collected by the analog cameras through corresponding user terminals, for example, outputting the video data through a remote client corresponding to the video processing device, or outputting the video data through a display device locally connected to the video processing device.

[0003] Related technology: Analog cameras can have an audio acquisition function, so that the analog camera can transmit the acquired audio to the video processing device, so that the user end corresponding to the video processing device can output the audio. However, the user end has a call requirement with the acquisition scene corresponding to the analog camera. For example, the user on the user end has a need to talk with the people in the acquisition scene corresponding to the analog camera, that is, the user on the user end has a call with the analog camera. In addition, the access capacity of a single analog-to-digital conversion unit is limited. For video processing devices that need to connect to multiple analog cameras, multiple analog-to-digital conversion units are usually required. However, the number of I2S (integrated circuit built-in audio bus) peripherals of the control unit of the video processing device is limited, which makes it impossible to connect to each analog-to-digital conversion unit.

[0004] Therefore, for a video processing device that needs to use multiple analog-to-digital conversion units to access multiple analog cameras, how to transmit the audio of the user end to the analog camera to realize a call with the analog camera side is an urgent problem to be solved. Summary of the invention

[0005] The purpose of the embodiment of the present application is to provide a video processing device to transmit the audio of the user end to the analog camera in the case where multiple analog-to-digital conversion units are required to access the video processing device of multiple analog cameras, so as to realize the call with the analog camera side. The specific technical solution is as follows:

[0006] The embodiment of the present application provides a video processing device, comprising a control unit and a plurality of analog-to-digital conversion units, wherein the plurality of analog-to-digital conversion units are in a serial structure, and an I2S bus is connected between a first analog-to-digital conversion unit at the end of the serial structure and the control unit; each analog-to-digital conversion unit is connected to the control unit via an I2C bus;

[0007] The control unit is used to obtain first audio data, transmit the first audio data to the first analog-to-digital conversion unit through the I2S bus, and perform a specified configuration on the analog-to-digital conversion unit corresponding to the target analog camera through the I2C bus; wherein the first audio data is audio data acquired by the user end corresponding to the video processing device calling the first audio acquisition module, with the target analog camera as the playback end; and the specified configuration is a configuration for instructing audio data processing;

[0008] The first analog-to-digital conversion unit is configured to transmit the first audio data to a connected analog-to-digital conversion unit in response to receiving the first audio data; and perform predetermined transmission processing on the received first audio data in response to executing the specified configuration;

[0009] Each analog-to-digital conversion unit except the first analog-to-digital conversion unit is used to output the received first audio data to the next-stage analog-to-digital conversion unit in response to the existence of a next-stage analog-to-digital conversion unit in a predetermined direction of the analog-to-digital conversion unit, and to perform the predetermined transmission processing on the received first audio data in response to the execution of the specified configuration; wherein the predetermined transmission processing is used to transmit the audio represented by the received first audio data to the target analog camera, so that the target analog camera calls the first audio output module to perform audio output processing; the predetermined direction is the direction from the end to the source end in the serial structure.

[0010] Beneficial effects of the embodiments of the present application:

[0011] A video processing device provided in an embodiment of the present application includes a control unit and multiple analog-to-digital conversion units, the multiple analog-to-digital conversion units belong to a serial structure, and an I2S bus is connected between the first analog-to-digital conversion unit at the end of the serial structure and the control unit; each analog-to-digital conversion unit is connected to the control unit through an I2C bus, and the control unit can perform a specified configuration for instructing the analog-to-digital conversion unit corresponding to the analog camera to process audio data through the I2C bus, so that if any analog-to-digital conversion unit is executed with the above-mentioned specified configuration, it indicates that the analog-to-digital conversion unit is to process the received audio data.

[0012] Based on this, when there is a need for a user on the user side to talk to the analog camera side, the control unit of the video processing device can obtain the first audio data sent by the user side, and transmit the first audio data to the first analog-to-digital conversion unit located at the end in the serial structure, so that, through each analog-to-digital conversion unit in the serial structure, the first audio data is transmitted to the next analog-to-digital conversion unit in the direction from the end to the source end, so that each analog-to-digital conversion unit in the serial structure can receive the first audio data. And, each analog-to-digital conversion unit transmits the audio represented by the received first audio data to the target analog camera in response to executing the specified configuration, so that the target analog camera calls the first audio output module for audio output processing, and the target analog camera side can hear the audio data sent by the user side. It can be seen that through the solution of the present application, it is possible to transmit the audio of the user side to the analog camera in the case of a video processing device that needs to use multiple analog-to-digital conversion units to access multiple analog cameras, so as to realize a call with the analog camera side. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other embodiments can also be obtained based on these drawings.

[0014] Figure 1 A schematic diagram of an image data area and a blanking area included in a video signal;

[0015] Figure 2 A schematic diagram of the structure of a single analog-to-digital conversion unit connected to a processor;

[0016] Figure 3 A schematic diagram of the structure of a video processing device provided in an embodiment of the present application;

[0017] Figure 4 A schematic diagram of modulation position of first audio data provided in an embodiment of the present application,

[0018] Figure 5 for Figure 4 A schematic diagram of a corresponding modulation position waveform of the first audio data.

[0019] Figure 6 A schematic diagram of the structure of another video processing device provided in an embodiment of the present application;

[0020] Figure 7 A schematic diagram of the connection between the camera, DVR and remote end provided in the embodiment of the present application;

[0021] Figure 8 A structural schematic diagram of a hard disk video recorder provided in an embodiment of the present application;

[0022] Fig. 9 A schematic diagram of the connection between a cascade structure of a video processing device and a processor is provided for an embodiment of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field based on the present application belong to the scope of protection of the present application.

[0024] For ease of understanding, the professional terms involved in this application are first introduced below.

[0025] BNC (Bayonet Nut Connector, coaxial cable): coaxial cable used to connect analog cameras and DVRs;

[0026] Coaxial audio: The audio that the analog camera sends to the DVR via the coaxial line. In specific applications, the analog camera can use a microphone to collect coaxial audio. If it can be collected, it can be modulated into the line blanking area of ​​the analog video signal. It is understandable that if there is audio data, it will be modulated, and in the end, there may not be coaxial audio data on every line.

[0027] Uplink audio: The audio that the DVR sends to the analog camera through the coaxial BNC cable; similar to coaxial audio, if there is audio data, it will be modulated into the field blanking area of ​​the analog video signal. Since the uplink audio is modulated into the field blanking area, and the field blanking area of ​​a frame of analog video signal has limited storage space, combined with actual measurement conditions, when modulating the uplink audio, usually each frame of analog video signal can be modulated with uplink audio data;

[0028] AD: analog-to-digital converter;

[0029] DVR: A device that can receive audio and video from analog cameras, as well as store, preview, and play back;

[0030] I2S (Inter-IC Sound) bus: integrated circuit built-in audio bus, a bus standard for transmitting audio data;

[0031] I2C (Inter-Integrated Circuit) bus: a bidirectional two-wire synchronous serial bus;

[0032] Voice intercom: A conversation between two people who are not in the same space. In the embodiment of the present application, it refers to the voice intercom between the camera end and the user end, for example, the voice intercom between the analog camera and the computer end.

[0033] In addition, in order to facilitate the understanding of field blanking and line blanking, the following introduction is made:

[0034] Each frame of video image may correspond to an analog video signal, and in this application, the analog video signal may also be referred to as a video signal. The video signal corresponding to each frame of video image includes valid data and invalid data, namely, an image data area and a blanking area. The image data area is used to store a frame of valid image data, and the blanking area is used to store invalid data, wherein the invalid data includes signals such as field synchronization, line synchronization, field blanking, and line blanking. In other words, a frame of analog video signal may include an image data area and a blanking area; exemplarily, Figure 1 Schematic diagram of the image data area and blanking area included in the video signal, wherein the white area 102 is the image data area, the dark areas 101 and 103 are blanking areas, and the area 101 is field blanking (field blanking area), and the area 103 is line blanking (line blanking area).

[0035] Line blanking: In the scanning process of converting optical signals into electrical signals, the scanning point always starts from the upper left corner of an image and moves forward horizontally, while the scanning point also moves downward at a slower rate; when the scanning point reaches the right edge of the image, the scanning point quickly returns to the left and restarts the second line scanning below the starting point of the first line. The return process between lines is called line blanking. Among them, the signal in the line blanking period can be called the line blanking signal.

[0036] Field blanking: A complete image scanning signal, which is composed of a sequence of line signals separated by line blanking intervals, is called a frame; after the scanning point scans a frame, it needs to return from the lower right corner of the image to the upper left corner of the image to start scanning a new frame. This process is called field blanking. Among them, the signal within the field blanking period can be called the field blanking signal.

[0037] Related technology: An analog camera may have an audio acquisition function and transmit the acquired audio to a video processing device, so that a user terminal corresponding to the video processing device may output the audio.

[0038] However, the user side has a need to communicate with the collection scene of the analog camera side, for example, the user side has a need to talk with the people in the collection scene corresponding to the analog camera. Figure 2As shown, it is a schematic diagram of the structure of a single analog-to-digital conversion unit connected to a processor. Among them, the analog-to-digital converter AD is the analog-to-digital conversion unit provided in the embodiment of the present application, and the processor is the control unit provided in the embodiment of the present application. The AD is hung on the I2C bus and has an independent I2C address. The processor finds the corresponding AD through I2C addressing and configures the register to ensure the normal operation of the AD.

[0039] However, the access capacity of a single analog-to-digital conversion unit is limited. For video processing equipment that needs to connect to multiple analog cameras, multiple analog-to-digital conversion units are usually required. However, the number of I2S (integrated circuit internal audio bus) peripherals of the control unit of the video processing equipment is limited, resulting in the inability to connect to each analog-to-digital conversion unit.

[0040] Therefore, for a video processing device that needs to use multiple analog-to-digital conversion units to access multiple analog cameras, how to transmit the audio from the user end to the analog camera and communicate with the analog camera side is an urgent problem to be solved.

[0041] Based on this, an embodiment of the present application provides a video processing device that transmits the audio of the user end to the analog camera to realize a call with the analog camera side when a video processing device that needs to use multiple analog-to-digital conversion units to access multiple analog cameras is required.

[0042] The following is an introduction to a video processing device provided in an embodiment of the present application.

[0043] Among them, a video processing device provided by an embodiment of the present application includes a control unit and multiple analog-to-digital conversion units, the multiple analog-to-digital conversion units belong to a serial structure, and an I2S bus is connected between the first analog-to-digital conversion unit at the end of the serial structure and the control unit; each analog-to-digital conversion unit is connected to the control unit via an I2C bus. The control unit can perform encoding and decoding processing, transmission and other operations on the received audio data, and configure the analog-to-digital conversion unit to process the audio data, so as to indicate whether the analog-to-digital conversion unit needs to process the received audio data through the configuration; the analog-to-digital conversion unit can perform analog-to-digital conversion, transmission and other operations on the audio data.

[0044] Specifically, the control unit is used to obtain the first audio data, transmit the first audio data to the first analog-to-digital conversion unit through the I2S bus, and perform a specified configuration on the analog-to-digital conversion unit corresponding to the target analog camera through the I2C bus; wherein the first audio data is the audio data acquired by the user end corresponding to the video processing device calling the first audio acquisition module, with the target analog camera as the playback end; the specified configuration is a configuration for instructing audio data processing;

[0045] The first analog-to-digital conversion unit is configured to, in response to receiving the first audio data, output the first audio data to a connected analog-to-digital conversion unit; and in response to executing the specified configuration, perform a predetermined transmission process on the received first audio data;

[0046] Each analog-to-digital conversion unit except the first analog-to-digital conversion unit is used to output the received first audio data to the next-stage analog-to-digital conversion unit in response to the existence of a next-stage analog-to-digital conversion unit in a predetermined direction of the analog-to-digital conversion unit, and to perform the predetermined transmission processing on the received first audio data in response to the execution of the specified configuration; wherein the predetermined transmission processing is used to transmit the audio represented by the received first audio data to the target analog camera, so that the target analog camera calls the first audio output module to perform audio output processing; the predetermined direction is the direction from the end to the source end in the serial structure.

[0047] As can be seen from the above, a video processing device provided in an embodiment of the present application includes a control unit and multiple analog-to-digital conversion units, the multiple analog-to-digital conversion units belong to a serial structure, and an I2S bus is connected between the first analog-to-digital conversion unit at the end of the serial structure and the control unit; each analog-to-digital conversion unit is connected to the control unit through an I2C bus, and the control unit can perform a specified configuration for indicating audio data processing for the analog-to-digital conversion unit corresponding to the analog camera through the I2C bus, so that if any analog-to-digital conversion unit is executed with the above-mentioned specified configuration, it indicates that the analog-to-digital conversion unit is to process the received audio data.

[0048] Based on this, when there is a need for a user on the user side to talk to the analog camera side, the control unit of the video processing device can obtain the first audio data sent by the user side, and transmit the first audio data to the first analog-to-digital conversion unit located at the end in the serial structure, so that, through each analog-to-digital conversion unit in the serial structure, the first audio data is transmitted to the next analog-to-digital conversion unit in the direction from the end to the source end, so that each analog-to-digital conversion unit in the serial structure can receive the first audio data. And, each analog-to-digital conversion unit transmits the audio represented by the received first audio data to the target analog camera in response to executing the specified configuration, so that the target analog camera calls the first audio output module for audio output processing, and the target analog camera side can hear the audio data sent by the user side. It can be seen that through the solution of the present application, it is possible to transmit the audio of the user side to the analog camera in the case of a video processing device that needs to use multiple analog-to-digital conversion units to access multiple analog cameras, so as to realize a call with the analog camera side.

[0049] The following is an introduction to a video processing device provided in an embodiment of the present application.

[0050] like Figure 3 As shown, a video processing device provided in an embodiment of the present application includes: a control unit 310 and multiple analog-to-digital conversion units 320, wherein the multiple analog-to-digital conversion units 320 belong to a serial structure, and an I2S bus is connected between the first analog-to-digital conversion unit at the end of the serial structure and the control unit; each analog-to-digital conversion unit 320 is connected to the control unit 310 via an I2C bus.

[0051] Combination Figure 3 It can be seen that the first analog-to-digital conversion unit is an analog-to-digital conversion unit connected to the control unit through the I2S bus, and the analog-to-digital conversion unit at the source end in the serial structure is the analog-to-digital conversion unit farthest from the first analog-to-digital conversion unit, that is, Figure 3 The analog-to-digital conversion unit at the bottom layer is the first analog-to-digital conversion unit, and the analog-to-digital conversion unit at the top layer is the analog-to-digital conversion unit at the source end. Then, the analog-to-digital conversion unit connected to the analog-to-digital conversion unit at the bottom layer is the next-level analog-to-digital conversion unit of the first analog-to-digital conversion unit; similarly, for each analog-to-digital conversion unit at the middle layer, in the direction from the end to the source end (direction 300), the analog-to-digital conversion unit at the previous level of the analog-to-digital conversion unit is Figure 3 The analog-to-digital conversion unit of the next layer connected to the analog-to-digital conversion unit in the serial structure shown; correspondingly, the analog-to-digital conversion unit of the next level of the analog-to-digital conversion unit is Figure 3 The analog-to-digital conversion unit of the upper layer connected to the analog-to-digital conversion unit in the serial structure shown. That is to say, for each analog-to-digital conversion unit located in the middle layer, the input interface of the analog-to-digital conversion unit is connected to the output interface of the upper layer to receive the data transmitted by the analog-to-digital conversion unit of the upper layer, and the output interface of the analog-to-digital conversion unit is connected to the input interface of the lower layer to transmit data to the analog-to-digital conversion unit of the lower layer; and the direction from the end to the source end can also be called the direction from the upper analog-to-digital conversion unit to the lower analog-to-digital conversion unit. It should be emphasized that the above Figure 3 The various analog-to-digital conversion units shown are only for illustrating the serial structural form and do not represent the setting position in the physical space. The control unit 310 is used to obtain the first audio data, transmit the first audio data to the first analog-to-digital conversion unit through the I2S bus, and specify the configuration of the analog-to-digital conversion unit 320 corresponding to the target analog camera through the I2C bus; wherein, the first audio data is the audio data acquired by the user end corresponding to the video processing device calling the first audio acquisition module, with the target analog camera as the playback end; the specified configuration is the configuration for indicating the processing of audio data;

[0052] The first analog-to-digital conversion unit is configured to, in response to receiving the first audio data, output the first audio data to a connected analog-to-digital conversion unit; and in response to executing the specified configuration, perform a predetermined transmission process on the received first audio data;

[0053] Each analog-to-digital conversion unit 320 except the first analog-to-digital conversion unit is configured to output the received first audio data to the next-stage analog-to-digital conversion unit in response to the existence of a next-stage analog-to-digital conversion unit in a predetermined direction of the analog-to-digital conversion unit, and perform the predetermined transmission processing on the received first audio data in response to the execution of the specified configuration;

[0054] The predetermined transmission process is used to transmit the audio represented by the received first audio data to the target analog camera, so that the target analog camera calls the first audio output module to perform audio output processing; the predetermined direction is the direction from the end to the source in the serial structure; Figure 3 The direction 300 in FIG. 1 is the predetermined direction.

[0055] Normally, each analog-to-digital conversion unit has an I2S peripheral for connecting the analog-to-digital conversion unit to a control unit to achieve audio transmission. However, considering that the number of I2S peripherals of the control unit is limited, it is not possible to connect to each analog-to-digital conversion unit. Therefore, in the case of a video processing device that requires multiple analog-to-digital conversion units to access multiple analog cameras, in order to transmit the audio of the user end to the analog camera, an embodiment of the present application provides a video processing device that serially connects multiple analog-to-digital conversion units included in the device through a serial structure, and an I2S bus is connected between the first analog-to-digital conversion unit at the end of the serial structure and the control unit.

[0056] In this way, the audio data received by the first analog-to-digital conversion unit from the control unit through the above-mentioned I2S bus can be transmitted to each analog-to-digital conversion unit in the serial structure. In other words, each analog-to-digital conversion unit in the serial structure can read the audio data sent by the control unit, thereby achieving the expansion of the number of analog-to-digital conversion units that can be connected to the control unit when multiple analog-to-digital conversion units are used to access multiple analog cameras. Among them, the above-mentioned serial structure refers to a multi-layer structure formed by multiple analog-to-digital conversion units connected in series, and the serial structure can also be called a cascade structure, which is not specifically limited in this application.

[0057] Optionally, before the control unit of the video processing device is connected to the serial structure through the I2S bus, it can define the data transmission type of the pins included in each analog-to-digital conversion unit to represent the input and output of audio in the serial structure; wherein, the analog-to-digital conversion unit that has only an audio output pin and no audio input pin is the first analog-to-digital conversion unit at the end of the serial structure; in this way, the control unit realizes connection with multiple analog-to-digital conversion units of the entire serial structure through the connection with the first analog-to-digital unit.

[0058] Optionally, in one implementation, considering that the multiple analog-to-digital conversion units of the video processing device belong to a serial structure, in order to ensure normal transmission of the transmitted audio data in the above serial structure, the clock sources of the above multiple analog-to-digital conversion units are the same.

[0059] Furthermore, each analog-to-digital conversion unit is connected to the control unit via an I2C bus. The control unit can, through the I2C bus, perform a specified configuration for instructing the analog-to-digital conversion unit corresponding to the analog camera to perform audio data processing. Thus, if the analog-to-digital conversion unit is configured as described above, it indicates that the analog-to-digital conversion unit needs to process the received audio data.

[0060] When there is a need for a user on the user side to communicate with the analog camera side, the control unit obtains the audio data of the audio with the target analog camera as the playback end, which is collected by the user side corresponding to the video processing device by calling the first audio collection module, as the audio data for talking with the target analog camera side. The first audio data itself can be digital signal data or analog signal data, which is not specifically limited in the embodiment of the present application.

[0061] Optionally, the user end corresponding to the video processing device responds to the intercom instruction triggered by the target intercom operation, and calls the first audio acquisition module to acquire audio data with the target simulated camera as the playback end as the first audio data; the target intercom operation is an operation issued in the user end to instruct to conduct an intercom on the acquisition scene of the target simulated camera. The first audio acquisition module can be an acquisition module in the device to which the user end belongs, or it can be an acquisition module that can be called by the user end through the network or other communication methods and is not set on the device to which the user end belongs. This embodiment of the application does not make specific limitations on this.

[0062] Optionally, the user end corresponding to the video processing device responds to the instruction for representing speaking to the target simulated camera side, calls the first audio acquisition module to acquire audio data of the audio with the target simulated camera as the playback end, as the first audio data.

[0063] Optionally, the user end corresponding to the video processing device is a remote client running on a mobile phone, a computer, etc. In this case, the user end can communicate with the video processing device through a network, but is certainly not limited to this.

[0064] Optionally, the user end corresponding to the video processing device is the video processing device itself, that is, the video processing device itself can realize the functions of the user end. For example, the video processing device can be connected to a display to perform operations such as screen display and configuration. The video processing device itself can realize the functions of the user end.

[0065] After acquiring the first audio data, the control unit transmits the first audio data to the first analog-to-digital conversion unit via the I2S bus. Then, the analog-to-digital conversion unit corresponding to the target analog camera is configured to instruct the processing of the audio data via the I2C bus.

[0066] Then, after receiving the first audio data transmitted by the control unit, the first analog-to-digital conversion unit outputs the first audio data to the connected analog-to-digital conversion unit in response to the received first audio data. At the same time, it identifies whether the specified configuration is executed by itself, that is, determines whether it needs to process the received first audio data. If so, the first analog-to-digital conversion unit transmits the audio represented by the received first audio data to the target analog camera in response to the execution of the above-mentioned specified configuration, so that the target analog camera calls the first audio output module for audio output processing.

[0067] Each analog-to-digital conversion unit except the first analog-to-digital conversion unit, after receiving the first audio data transmitted by the upper-level analog-to-digital conversion unit in the predetermined direction, determines whether there is a next-level analog-to-digital conversion unit in the predetermined direction. If so, the analog-to-digital conversion unit can respond to the existence of the next-level analog-to-digital conversion unit in the predetermined direction and continue to transmit the received first audio data to the next-level analog-to-digital conversion unit in the above-mentioned predetermined direction. At the same time, the analog-to-digital conversion unit also needs to identify whether it is executed with a specified configuration, that is, to determine whether it needs to process the received first audio data. If so, the analog-to-digital conversion unit responds to the execution of the above-mentioned specified configuration and transmits the audio represented by the received first audio data to the target analog camera, so that the target analog camera calls the first audio output module for audio output processing.

[0068] Optionally, the number of the above-mentioned target simulation cameras can be one or more, that is, the user terminal corresponding to the video processing device can speak to one acquisition scene or multiple acquisition scenes. This embodiment of the present application does not make any specific limitation on this.

[0069] In the case where multiple analog-to-digital conversion units are required to access multiple analog cameras, in order to improve the accuracy of audio transmission, optionally, a correspondence between analog cameras and analog-to-digital conversion units is pre-established. When each analog camera is used as a playback end, that is, when speaking with the acquisition scene of each analog camera, through the above correspondence, when it is determined that the corresponding analog-to-digital conversion unit is executed with the specified configuration, the first audio data can be sent to the analog camera corresponding to the analog-to-digital conversion unit. For example, when there are multiple target analog cameras, there can be multiple analog-to-digital conversion units that are executed with the specified configuration, so that each analog-to-digital conversion unit that is executed with the specified configuration can send the first audio data to the corresponding target analog camera.

[0070] As can be seen from the above, a video processing device provided in an embodiment of the present application includes a control unit and multiple analog-to-digital conversion units, the multiple analog-to-digital conversion units belong to a serial structure, and an I2S bus is connected between the first analog-to-digital conversion unit at the end of the serial structure and the control unit; each analog-to-digital conversion unit is connected to the control unit through an I2C bus, and the control unit can perform a specified configuration for indicating audio data processing for the analog-to-digital conversion unit corresponding to the analog camera through the I2C bus, so that if any analog-to-digital conversion unit is executed with the above-mentioned specified configuration, it indicates that the analog-to-digital conversion unit is to process the received audio data.

[0071] Based on this, when there is a need for a user on the user side to talk to the analog camera side, the control unit of the video processing device can obtain the first audio data sent by the user side, and transmit the first audio data to the first analog-to-digital conversion unit located at the end in the serial structure, so that, through each analog-to-digital conversion unit in the serial structure, the first audio data is transmitted to the next analog-to-digital conversion unit in the direction from the end to the source end, so that each analog-to-digital conversion unit in the serial structure can receive the first audio data. And, each analog-to-digital conversion unit transmits the audio represented by the received first audio data to the target analog camera in response to executing the specified configuration, so that the target analog camera calls the first audio output module for audio output processing, and the target analog camera side can hear the audio data sent by the user side. It can be seen that through the solution of the present application, it is possible to transmit the audio of the user side to the analog camera in the case of a video processing device that needs to use multiple analog-to-digital conversion units to access multiple analog cameras, so as to realize a call with the analog camera side.

[0072] Optionally, in an implementation, the first analog-to-digital conversion unit outputs the first audio data to a connected analog-to-digital conversion unit, including:

[0073] According to a predetermined transmission protocol between analog-to-digital conversion units, construct a message carrying target information and the first audio data, and transmit the message to an analog-to-digital conversion unit connected to the first analog-to-digital conversion unit;

[0074] The target information includes a target unit identifier of the first analog-to-digital conversion unit.

[0075] Accordingly, in response to the existence of a next-stage analog-to-digital conversion unit in the predetermined direction, each analog-to-digital conversion unit except the first analog-to-digital conversion unit outputs the received first audio data to the next-stage analog-to-digital conversion unit, and in response to the execution of the specified configuration, performs the predetermined transmission processing on the received first audio data, including:

[0076] When it is detected that the received message carries the target unit identifier, in response to the existence of a next-level analog-to-digital conversion unit in the predetermined direction of the analog-to-digital conversion unit, the message is sent to the next-level analog-to-digital conversion unit, and in response to the execution of the specified configuration, the first audio data in the received message is subjected to the predetermined transmission processing.

[0077] In this implementation, in order to ensure the normal transmission of audio between multiple analog-to-digital conversion units, a predetermined transmission protocol between the analog-to-digital conversion units is pre-set, so that the first analog-to-digital conversion unit can construct a message carrying the above-mentioned target unit identifier and the first audio data based on its own target unit identifier and the acquired first audio data in accordance with the above-mentioned transmission protocol, and then transmit the constructed message to the next-level analog-to-digital conversion unit in the predetermined direction to realize audio transmission.

[0078] Correspondingly, for each analog-to-digital conversion unit except the first analog-to-digital conversion unit, after receiving the message transmitted by the analog-to-digital conversion unit of the previous level in the predetermined direction of the analog-to-digital conversion unit, first, it is identified whether the received message carries a target unit identifier; if the above-mentioned target unit identifier is identified, it indicates that the audio data carried by the message is obtained by the first analog-to-digital conversion unit from the control unit, and the analog-to-digital conversion unit can continue to transmit the message to the next level analog-to-digital conversion unit in the predetermined direction.

[0079] Therefore, the analog-to-digital conversion unit can determine whether there is a next-stage analog-to-digital conversion unit in the predetermined direction, thereby determining whether to continue transmitting the message.

[0080] If there is no next-level analog-to-digital conversion unit, it indicates that the analog-to-digital conversion unit is the last analog-to-digital conversion unit in the entire serial structure. At this time, the analog-to-digital conversion unit can stop transmitting the message; if there is a next-level analog-to-digital conversion unit, the analog-to-digital conversion unit can continue to transmit the above message to the next-level analog-to-digital conversion unit to achieve step-by-step transmission of audio, so that each analog-to-digital conversion unit in the serial structure can read the first audio data.

[0081] Furthermore, the analog-to-digital conversion unit needs to identify whether it is being executed with a specified configuration, that is, whether it needs to process the first audio data in the received message. If so, the analog-to-digital conversion unit transmits the audio represented by the first audio data in the message to the target analog camera in response to being executed with the specified configuration, so that the target analog camera calls the first audio output module for audio output processing.

[0082] In this implementation, the process of audio transmission between analog-to-digital conversion units is standardized by presetting the transmission protocol between multiple analog-to-digital conversion units. That is, the message carrying the target unit identifier of the first analog-to-digital conversion unit is transmitted step by step, and in the message transmitted step by step, in addition to the target unit identifier carried, it also carries the first audio data obtained by the first analog-to-digital conversion unit from the control unit. In this way, each analog-to-digital conversion unit can directly determine whether it needs to continue to transmit the audio data of the message by determining whether it carries the target unit identifier, so as to improve the efficiency of data transmission.

[0083] Optionally, in an implementation manner, in the message, the first audio data is located in a payload portion, and the target information is located in a protocol header.

[0084] In this implementation, the above-mentioned predetermined transmission protocol specifies the positions of the first audio data and the target information in the message, that is, the first audio data is located in the payload part, and the target information is located in the protocol header. In this way, after receiving the message transmitted by the previous analog-to-digital conversion unit in the predetermined direction, each analog-to-digital conversion unit can directly determine from the position occupied by the protocol header whether the message carries the target unit identifier of the first analog-to-digital conversion unit, thereby determining whether to transmit the message to the next analog-to-digital conversion unit in the predetermined direction; if not, then directly terminate the subsequent processing of the message; if so, then when there is a next analog-to-digital conversion unit in the predetermined direction, the first audio data in the message is transmitted to the next analog-to-digital conversion unit.

[0085] In this implementation, by standardizing the positions of the first audio data and the target information in the message, each analog-to-digital conversion unit can directly obtain the target information from the position occupied by the protocol header and obtain the first audio data from the payload part after receiving the message transmitted by the previous analog-to-digital conversion unit in a predetermined direction, so as to improve the transmission efficiency of the audio data.

[0086] Optionally, in an implementation, the way in which the first analog-to-digital conversion unit receives the first audio data includes:

[0087] According to predetermined sampling information, the audio data transmitted through the I2S bus is sampled to obtain the first audio data; wherein the sampling information includes a sampling frequency and / or a sampling bit width;

[0088] Each analog-to-digital conversion unit except the first analog-to-digital conversion unit, in response to the existence of a next-stage analog-to-digital conversion unit in the predetermined direction, outputs the received first audio data to the next-stage analog-to-digital conversion unit, and in response to the execution of the specified configuration, performs the predetermined transmission processing on the received first audio data, before further being used to:

[0089] Determining the predetermined sampling information;

[0090] Identify whether the first audio data in the received message satisfies the determined predetermined sampling information; if so, trigger the step of outputting the received first audio data to the next-level analog-to-digital conversion unit in response to the existence of the next-level analog-to-digital conversion unit in the predetermined direction of the analog-to-digital conversion unit, and performing the predetermined transmission processing on the received first audio data in response to the execution of the specified configuration.

[0091] In this implementation, considering that the sampling frequency and the sampling bit width are important factors affecting the audio transmission quality, a higher sampling frequency and sampling bit width can provide higher sound quality and richer audio details, but it will also increase the amount of data and storage / transmission requirements. Therefore, in order to improve the quality and efficiency of audio data during transmission, the first analog-to-digital conversion unit can sample the audio data transmitted by the control unit through the I2S bus according to the predetermined sampling information, that is, the predetermined sampling frequency and / or sampling bit width, to obtain the first audio data.

[0092] Correspondingly, each analog-to-digital conversion unit except the first analog-to-digital conversion unit is also used to determine the predetermined sampling information, thereby identifying whether the first audio data in the received message satisfies the determined predetermined sampling information, that is, determining whether the sampling information corresponding to the first audio data is consistent with the predetermined sampling information.

[0093] If it is satisfied, the sound quality and audio details of the first audio data in the characterization message are sufficient to support subsequent audio transmission and will not affect the quality of the audio transmission. The first audio data is valid data. At this time, the analog-to-digital conversion unit can be triggered to respond to the existence of the next-level analog-to-digital conversion unit in a predetermined direction, output the received first audio data to the next-level analog-to-digital conversion unit, and perform predetermined transmission processing on the received first audio data in response to the execution of the specified configuration.

[0094] If not satisfied, the sound quality and audio details of the first audio data in the representation message are insufficient to support subsequent audio transmission, which will affect the quality of subsequent audio transmission. The first audio data is invalid data. For example, there is data loss in the first audio data. At this time, the transmission of the first audio data is terminated.

[0095] In this implementation, the sampling information / sampling frequency of the audio data transmitted by the serial structure is limited by pre-set sampling information, thereby identifying whether the transmitted audio data is valid data, for example, identifying whether the data is lost, so as to improve the sound quality and audio details of the transmitted audio data, as well as the quality of the audio data output after transmission to the target analog camera.

[0096] Optionally, in one implementation, each analog-to-digital conversion unit corresponds to a plurality of second registers, each second register corresponds to a type of sampling information, and the second register corresponding to each analog-to-digital conversion unit and used to represent the predetermined sampling information is in an enabled state;

[0097] The determining of the predetermined sampling information comprises:

[0098] detecting a register in an enabled state among the second registers;

[0099] The sampling information corresponding to the register in the enabled state is determined to obtain the predetermined sampling information.

[0100] The same register may correspond to an enabled state and a disabled state. At the same time, there may be multiple types of sampling information. The sampling information required for use in different scenarios may be different. Therefore, for each analog-to-digital conversion unit, there may be multiple second registers corresponding to each second register, each of which corresponds to a type of sampling information, and when a second register is in an enabled state, the sampling information corresponding to the second register is the sampling information currently required to be used. In order to perform data transmission, the corresponding second register can be determined based on the predetermined sampling information currently required to be used, and the determined second register can be set to an enabled state, so that in the subsequent data transmission process, based on the second register in the enabled state, the predetermined sampling information is obtained to identify whether the first audio data is valid. Among them, for the setting of the enabled state / disabled state of the second register corresponding to each analog-to-digital conversion unit, the control unit can be set through the I2C bus, of course, it is not limited to this; in addition, for the enabling of the second register, please refer to the description of the enabling of the first register below.

[0101] In this implementation, multiple registers corresponding to different sampling information are set, and an analysis benchmark for identifying whether the received first audio data is valid can be obtained only by the enable state of the register, thereby quickly identifying whether the first audio data is valid data.

[0102] Optionally, in one implementation, the processing method of performing a specified configuration on the analog-to-digital conversion unit corresponding to the target analog camera through the I2C bus includes:

[0103] Enable a first register of an analog-to-digital conversion unit corresponding to the target analog camera through an I2C bus; wherein the first register is a register for indicating whether to perform audio data processing;

[0104] The method for any analog-to-digital conversion unit to identify whether it is executing a specified configuration includes:

[0105] Check whether the first register of the analog-to-digital conversion unit is enabled. If enabled, determine whether the analog-to-digital conversion unit is configured to execute the specified configuration.

[0106] In this implementation, after acquiring the first audio data, the control unit enables the first register of the analog-to-digital conversion unit corresponding to the target analog camera through the I2C bus. In this way, when the first audio data is transmitted between the analog-to-digital conversion units in the serial structure, any analog-to-digital conversion unit can determine whether the analog-to-digital conversion unit is executed in the specified configuration by detecting whether its first register is enabled.

[0107] That is, before the first audio data is transmitted between the analog-to-digital conversion units in the serial structure, the control unit enables the first register of the analog-to-digital conversion unit corresponding to the target analog camera, which is used to indicate whether to process the audio data, so that after the corresponding analog-to-digital conversion unit receives the first audio data, the first register can process the first audio data. That is, after the corresponding analog-to-digital conversion unit detects that its first register is enabled, it can be determined that the analog-to-digital conversion unit is executed in the specified configuration.

[0108] Enabling a register means controlling the register to be in an active state to perform functions such as data storage, calculation operation, addressing, program counting or data transmission.

[0109] For example, the control unit sends an enable signal to the first register of the analog-to-digital conversion unit corresponding to the target analog camera, so that the state of the first register is "0001", which is in an active state to execute the specified configuration. Correspondingly, when the enable signal is not sent, the first register can stop working, or enter a low power consumption mode.

[0110] In this implementation, any analog-to-digital conversion unit determines whether it is executed in the specified configuration by detecting whether its first register is enabled. That is, the first register of the analog-to-digital conversion unit corresponding to the target analog camera is enabled by the control unit, so that after receiving the first audio data for sending to the target analog camera, the analog-to-digital conversion unit can directly process the first audio data, thereby transmitting the audio represented by the processed first audio data to the target analog camera, so as to improve the transmission efficiency of the video processing device for the first audio data and ensure that the first audio data can be accurately transmitted to the corresponding target analog camera.

[0111] Optionally, in one embodiment, the predetermined transmission process includes:

[0112] Modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; wherein the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera;

[0113] The target data signal is sent to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of ​​the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal.

[0114] In this embodiment, since the data transmission between the video processing device and the analog camera is carried out using the video signal as a carrier, for the video signal to be sent to the analog camera, the first audio data is additional audio data that needs to be transmitted. When the first audio data is transmitted, the content of the video signal itself as its carrier signal is not concerned. In order not to interfere with the data contained in the video signal itself, the analog audio signal corresponding to the first audio data can be inserted into the field blanking area of ​​the video signal. For example, for coaxial audio, the video processing device can insert the analog audio signal corresponding to the first audio data into the field blanking area of ​​the video signal.

[0115] It should be noted that the field blanking area of ​​the video signal is located between two video frames. Therefore, whether the analog audio signal is modulated to the field blanking area or the analog audio signal is parsed from the field blanking area, it can be quickly positioned based on the particularity of the position of the field blanking area to improve the efficiency of audio writing and audio parsing.

[0116] Therefore, after each analog-to-digital conversion unit recognizes that it is being executed with the specified configuration, it can determine the analog audio signal corresponding to the received first audio data, and modulate the determined analog audio signal to the field blanking area corresponding to the first video signal to obtain the target data signal, thereby sending the obtained target data signal to the target analog camera, so that after receiving the above-mentioned target data signal, the target analog camera can parse the analog audio signal from the field blanking area of ​​the above-mentioned target data signal, and call the first audio data module to perform audio output processing on the audio represented by the parsed analog audio signal, so that the user on the target analog camera side, or the person in the acquisition scene corresponding to the target analog camera, can hear the audio sent by the user on the user side, so as to realize the transmission of the audio on the user side to the analog camera, thereby meeting the user side's need to communicate with the analog camera side.

[0117] In the case where there are multiple target analog cameras, the analog-to-digital conversion unit corresponding to each target analog camera can modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal corresponding to the target analog camera to obtain a target data signal; then, the obtained target data signal is sent to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of ​​the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal.

[0118] In this embodiment, the analog audio signal corresponding to the first audio data is modulated into the field blanking area of ​​the first video signal through signal modulation of the analog-to-digital conversion unit, and the first video signal is used as the carrier signal for transmission to realize transmission of the audio of the user end to the analog camera, thereby achieving the purpose of communicating with the analog camera side.

[0119] Optionally, in one implementation, the first video signal is an analog video signal sent by the target analog camera to the video processing device and meets a predetermined filtering condition; wherein the predetermined filtering condition includes a filtering condition set based on a signal reception time.

[0120] In this implementation, the first audio data transmitted from the video processing device to the target analog camera is carried by the analog video signal sent from the target analog camera to the video processing device; and for the real-time nature of audio and video transmission, the audio and video data or video data collected by the target analog camera is synchronously transmitted to the video processing device in real time. That is to say, the video processing device will receive the analog video signal sent in real time by the target analog camera, and the analog video signal sent in real time may be multiple analog video signals received successively.

[0121] Therefore, a predetermined screening condition may be pre-set to help the video processing device screen out the analog video signal satisfying the predetermined screening condition from the analog video signal sent from the target analog camera to the video processing device as the first video signal.

[0122] Considering the real-time nature of the analog video signal, the predetermined screening condition includes a screening condition set based on the signal receiving time. Exemplarily, the analog video signal with the latest signal receiving time can be used as the first video signal.

[0123] Optionally, when the user needs to intercom with the target analog camera's acquisition scene, the user terminal corresponding to the video processing device will issue a target intercom operation for instructing the target analog camera's acquisition scene, so that the user terminal responds to the intercom instruction triggered by the target intercom operation and starts audio transmission. Therefore, the above-mentioned predetermined screening condition includes receiving the analog video signal received by the video processing device as the first video signal after receiving the specified time length of the intercom instruction triggered by the target intercom operation in response to the user terminal.

[0124] Optionally, in an implementation manner, modulating the analog audio signal corresponding to the first audio data to a field blanking region corresponding to the first video signal includes:

[0125] The analog audio signal corresponding to the first audio data is modulated to the idle position of the field blanking area corresponding to the first video signal; wherein the idle position is: the position in the field blanking area excluding the position occupied by the communication data of the predetermined communication protocol; wherein the predetermined communication protocol is the communication protocol between the video processing device and the target analog camera.

[0126] In this implementation, audio transmission between the video processing device and the analog camera can be performed only if the analog camera complies with the predetermined communication protocol. That is, only when the analog camera supports the predetermined communication protocol can the analog camera complete the reception and processing of the target data signal sent by the video processing device.

[0127] The above-mentioned predetermined communication protocol is the basis for ensuring effective collaboration between the video processing device and the analog camera. Through the predetermined communication protocol, the video processing device can send control instructions to the analog camera, for example, to adjust parameters such as focus, exposure, and white balance. This allows the user to remotely control the analog camera through the video processing device. Usually, the predetermined communication protocol is inserted into the field blanking area of ​​the first video signal sent by the target analog camera to the video processing device, thereby occupying part of the position in the above-mentioned field blanking area. In this way, the vacant position in the above-mentioned field blanking area can be used to insert the analog audio signal corresponding to the first audio data that needs to be transmitted additionally, so as to ensure that the analog audio signal corresponding to the inserted first audio data will not affect the predetermined communication protocol inserted in the field blanking area without interfering with the audio data contained in the video signal itself, thereby improving the stability of the video processing device remotely controlling the analog camera.

[0128] The predetermined communication protocol may be a protocol for coaxial communication, that is, a coaxial cable is used as a communication medium to transmit and control a video stream to a front-end device such as an analog camera, etc. This application does not make any specific limitation on this.

[0129] Considering that the video signal is obtained by modulating the analog signal after the analog camera collects the video data, there are many types of analog cameras, and each analog camera has different acquisition parameters for collecting video data, such as different resolutions and frame rates, resulting in different signal formats of the obtained video signal. However, the signals of different signal formats have different positions in the blanking area of ​​the video signal, and thus, the positions used to modulate the audio data are also different.

[0130] For example, when the signal format is 1080P25, the first audio data starts from the 11th line of the field blanking area after field synchronization, with a total of 25 lines; when the signal format is 3K20, the first audio data starts from the 11th line of the field blanking area after field synchronization, with a total of 35 lines; when the signal format is 3K10, the first audio data starts from the 11th line of the field blanking area after field synchronization, with a total of 35 lines; when the signal format is 1080P30, the first audio data starts from the 11th line of the field blanking area after field synchronization, with a total of 20 lines.

[0131] The signal format of the video signal may include but is not limited to: 1080P25 and 1080P30. The signal format 1080P25 indicates that the resolution of the video signal is 1920 1080, frame rate is 25 frames per second; signal format 1080P30 means the resolution of the video signal is 1920 1080, frame rate is 30 frames per second.

[0132] At the same time, considering that part of the position in the field blanking area has been occupied by the predetermined communication protocol, therefore, optionally, signals of different signal formats correspond to different positions in the free position of the field blanking area. In this way, after acquiring the first audio data, the video processing device can determine the signal format of the first video signal, and then, based on the determined signal format, determine the position of the signal format in the free position of the field blanking area corresponding to the first video signal, which corresponds to the determined signal format, and then modulate the analog audio signal corresponding to the first audio data to the determined position in the field blanking area to achieve the insertion of the first audio data.

[0133] In addition, the method in which the analog-to-digital conversion unit modulates the analog audio signal corresponding to the first audio data to be transmitted to the target analog camera into the field blanking area of ​​the first video signal through signal modulation can be called a coaxial coding method.

[0134] In addition, exemplary, Figure 4 A schematic diagram of modulation position of a first audio data provided in an embodiment of the present application, Figure 5 for Figure 4 A schematic diagram of a modulation position waveform of a corresponding first audio data. Figure 4 The uplink audio in is the first audio data in the embodiment of the present application. Figure 5 The coaxial communication in is the predetermined communication protocol provided in the embodiment of the present application.

[0135] The analog-to-digital conversion unit of the video processing device modulates the uplink audio into the field blanking area of ​​the first video signal through field synchronization. Specifically, the uplink audio is modulated after the check bit of the coaxial communication protocol information, thereby obtaining the first video signal.

[0136] Optionally, in another embodiment of the present application, there is also provided Figure 6 A structural diagram of a video processing device is shown in FIG. Figure 6 An I2S bus is connected between the second analog-to-digital conversion unit at the source end and the control unit 310 in the serial structure in the video processing device shown.

[0137] Combination Figure 6 It can be seen that the second analog-to-digital conversion unit is an analog-to-digital conversion unit connected to the control unit through the I2S bus, and the terminal analog-to-digital conversion unit in the serial structure is the analog-to-digital conversion unit farthest from the second analog-to-digital conversion unit, that is, Figure 6 The analog-to-digital conversion unit at the top layer is the second analog-to-digital conversion unit, and the analog-to-digital conversion unit at the bottom layer is the terminal analog-to-digital conversion unit. Then, the analog-to-digital conversion unit connected to the analog-to-digital conversion unit at the top layer is the analog-to-digital conversion unit at the previous level of the second analog-to-digital conversion unit; similarly, for each analog-to-digital conversion unit at the middle layer, in the direction from the terminal to the source end (direction 600), the analog-to-digital conversion unit at the previous level of the analog-to-digital conversion unit is Figure 6 The analog-to-digital conversion unit of the next layer connected to the analog-to-digital conversion unit in the serial structure shown in FIG. 1 is, accordingly, the analog-to-digital conversion unit of the next level of the analog-to-digital conversion unit, that is, Figure 6 The analog-to-digital conversion unit of the upper layer connected to the analog-to-digital conversion unit in the serial structure shown. That is, for each analog-to-digital conversion unit located in the middle layer, the input interface of the analog-to-digital conversion unit is connected to the output interface of the upper layer, and the output interface of the analog-to-digital conversion unit is connected to the input interface of the lower layer.

[0138] Each of the plurality of analog-to-digital conversion units 320 is further configured to receive a second video signal sent by the target analog camera when the specified configuration is executed; perform a predetermined audio analysis process on the received second video signal to obtain a target digital signal;

[0139] Each analog-to-digital conversion unit among the plurality of analog-to-digital conversion units 320, except the second analog-to-digital conversion unit, is further configured to transmit the target digital signal to the analog-to-digital conversion unit of the next stage in the predetermined direction of the analog-to-digital conversion unit when the specified configuration is executed; and is further configured to upload the received target digital signal to the analog-to-digital conversion unit of the next stage in the predetermined direction of the analog-to-digital conversion unit after receiving the target digital signal uploaded by the analog-to-digital conversion unit of the previous stage in the predetermined direction of the analog-to-digital conversion unit;

[0140] The second analog-to-digital conversion unit is further configured to send the target digital signal to the control unit 310 via the I2S bus after obtaining the target digital signal;

[0141] The control unit 310 is further configured to receive the target digital signal, and call the second audio output module through the user terminal to perform audio output processing on the audio represented by the target digital signal.

[0142] In this embodiment, each of the multiple analog-to-digital conversion units of the video processing device, when executed in a specified configuration, receives a second video signal sent by a target analog camera, and performs predetermined audio analysis processing on the received second video signal to obtain a target digital signal.

[0143] Optionally, in one implementation, the second video signal sent by the target analog camera is a video signal obtained by the target analog camera performing a modulation process on the target video signal to be sent to the video processing device; the modulation process is used to modulate an analog audio signal of the audio acquired in the acquisition scene of the target analog camera to a line blanking area of ​​the target video signal;

[0144] The predetermined audio analysis process includes:

[0145] An analog audio signal is parsed from a line blanking region of the received second video signal, and the analog audio signal is converted into a digital audio signal to obtain a target digital signal.

[0146] In this implementation, while inserting the audio data sent by the video processing device to the target analog camera into the field blanking area of ​​the video signal, the audio data sent by the target analog camera to the video processing device can be inserted into the line blanking area of ​​the video signal in consideration of the stability of the transmitted audio data. In this way, the audio data sent by the analog camera and the video processing device to each other will not interfere with each other. Moreover, after receiving the second video signal sent by the target analog camera, the analog-to-digital conversion unit of the video processing device can directly parse the line blanking area of ​​the second video signal to obtain an analog audio signal while parsing each frame signal of the second video signal, and convert the analog audio signal into a digital audio signal to obtain a target digital signal, so as to improve the efficiency of audio parsing processing.

[0147] Optionally, in one implementation, the second video signal is specifically a video signal obtained by modulating the target video signal to be sent to the video processing device in response to an intercom instruction triggered by the target intercom operation; the target intercom operation is an operation issued in the user terminal to instruct intercom on the capture scene of the target analog camera.

[0148] In this implementation, the user can issue a target intercom operation for instructing to intercom the acquisition scene of the target analog camera through the user terminal corresponding to the video processing device. In this way, after receiving the above target intercom operation, the video processing device can trigger the formation of an intercom instruction through the above target intercom operation, and send the formed instruction to the target analog camera, so that after receiving the above intercom instruction, the target analog camera responds to the intercom instruction and modulates the target video signal for sending to the video processing device to obtain a second video signal. Among them, through the above modulation processing, the target analog camera can modulate the audio signal of the audio obtained from the acquisition scene to the line blanking area of ​​the target video signal. It should be noted that the above target video signal can be an analog video signal.

[0149] For each analog-to-digital conversion unit among the multiple analog-to-digital conversion units except the second analog-to-digital conversion unit, the analog-to-digital conversion unit transmits the target digital signal to the next-level analog-to-digital conversion unit in a predetermined direction of the analog-to-digital conversion unit when the specified configuration is executed, and, after receiving the target digital signal uploaded by the previous-level analog-to-digital conversion unit in the predetermined direction of the analog-to-digital conversion unit, uploads the received target digital signal to the next-level analog-to-digital conversion unit in the predetermined direction of the analog-to-digital conversion unit.

[0150] After obtaining the target digital signal, the second analog-to-digital conversion unit sends the obtained target digital signal to the control unit through the I2S bus. In this way, after receiving the target digital signal, the control unit can call the second audio output module through the user end to perform audio output processing on the audio represented by the target digital signal, so that the user on the user end side can hear the audio in the acquisition scene on the target analog camera side. Among them, the audio data of the audio represented by the target digital signal itself can be digital signal data or analog signal data, which is not specifically limited in the embodiments of the present application.

[0151] In this embodiment, when multiple analog-to-digital conversion units are required to access multiple analog cameras, the video processing device can send multiple target analog cameras to the corresponding user terminals through the included serial structure, and the audio data sent by the user terminal to the corresponding target analog camera can be transmitted to each other to meet the needs of communication between the user terminal and the target analog camera.

[0152] The video processing device provided in the above-mentioned embodiment of the present application is exemplarily introduced below in conjunction with specific embodiments.

[0153] Figure 7 A schematic diagram of the connection between the camera, DVR and remote end provided in an embodiment of the present application. Figure 7 The camera is the target analog camera provided in this application, the DVR is the video processing device provided in the embodiment of this application, and the remote end is the user end corresponding to the video processing device provided in the embodiment of this application. The camera and the DVR are transmitted via a coaxial line, and the DVR and the remote end are transmitted via a network cable (network), and the network cable can be called a return link.

[0154] Figure 8 A structural diagram of a hard disk video recorder provided in an embodiment of the present application is shown in FIG. Figure 8 The analog-to-digital converter AD is the analog-to-digital conversion unit in the embodiment of the present application, and the system-level processor is the control unit in the embodiment of the present application. Among them, the role of AD is analog-to-digital conversion, which is convenient for the subsequent processor processing in the DVR. Generally, the DVR can connect the camera via a coaxial line to receive the audio and video data of the camera, and the received audio and video data can be stored, played or remotely transmitted to a computer or mobile phone.

[0155] After the camera collects the audio and video signals, it can modulate the audio into the line blanking area of ​​the video signal and transmit it to the AD of the DVR through the coaxial cable. The AD obtains the audio data by sampling the specific position (line blanking area) of the video signal. After the DVR obtains the audio data through the AD, it encodes the audio data and transmits the encoded audio data to the remote end through the network, such as a computer or a personal mobile phone. Therefore, after the computer or mobile phone decodes the received audio data, it outputs it through the corresponding speaker, so that the user on the remote side can hear the intercom sound on the camera side.

[0156] In addition, a computer or mobile phone can be used as an intercom input source to record sound, and after encoding the recorded audio data, the encoded audio data is transmitted to the DVR through the network; after the DVR decodes the audio data, the AD modulates the audio data into the field blanking area of ​​the video signal and transmits it to the camera end through the coaxial line, so that the camera end can parse and output the parsed audio data through the speaker. In this way, the user on the camera side can also hear the intercom sound at the far end.

[0157] In addition, a microphone can also be connected to the DVR, so the DVR itself can also be used as an intercom input source, that is, the camera can intercom with the DVR.

[0158] The following describes the specific processes of audio transmission between an analog camera and a remote end, and between a remote end and an analog camera.

[0159] 1. The audio transmission process between the analog camera and the remote end is as follows: the DVR receives the intercom sound sent by the analog camera, that is, the coaxial audio. The coaxial audio is transmitted to the AD of the DVR through the coaxial line, and then sent to the system-level processor of the DVR through the I2S bus, and then sent to the remote end by the system-level processor of the DVR. Specifically including:

[0160] The analog camera modulates the video data onto the analog signal to obtain the video signal. If the analog camera is a coaxial audio camera, the analog camera can modulate the coaxial audio onto the video signal. That is, the coaxial audio is inserted into the line blanking area of ​​the video signal. In this way, the AD can obtain the audio signal transmitted by the coaxial line by sampling the data at a specific position (line blanking area) of the coaxial line, and send the audio signal to the DVR through the I2S bus to achieve sound access. In this way, the DVR side can hear the intercom sound of the analog camera.

[0161] Among them, after AD collects the coaxial audio, it transmits it to the DVR processor through the I2S bus for reception. If it is a large-number cascade device, the master / slave processor is also required to exchange data through the PCIE bus (PCI-Express, peripheral component interconnect express, a high-speed serial computer expansion bus standard) to send the coaxial audio received from the processor to the main processor. After receiving the coaxial audio, the main processor performs G711 encoding (an audio encoding method developed by the International Telecommunication Union (ITU-T), also known as ITU-TG.711), and transmits the encoded coaxial audio to the remote computer or mobile phone through the network, so that the remote computer or mobile phone can decode and output the coaxial audio.

[0162] 2. The audio transmission process between the remote end and the analog camera is as follows: the DVR processor decodes the uplink audio, sends it to the AD through the I2S bus, then modulates it into the field blanking area of ​​the video signal, and then transmits it to the analog camera through the coaxial cable. The analog camera's AD then analyzes it, and the analog camera can hear the intercom sound of the remote computer or mobile phone.

[0163] Since the transmission between the DVR and the analog camera is through the coaxial line, and the upstream audio transmitted by the remote end is additional audio data for the coaxial line, in order to transmit additional audio data on the coaxial line without affecting the coaxial audio, the upstream audio can be inserted into the field blanking area of ​​a frame of video signal in the form of insertion code.

[0164] Since the positions of the field blanking areas of video signals of different signal formats are different, when AD modulates the uplink audio to the field blanking area of ​​the video signal, it can modulate the uplink audio to the corresponding position of the field blanking area according to the signal format of the video signal.

[0165] In the above Figure 2 In the case where a single analog-to-digital conversion unit is connected to the processor, if the video processing device only has voice communication with a certain analog camera at the same time, the processor needs to send the audio data (uplink audio data) to the analog camera to the corresponding AD, and then the AD modulates the audio data to the blanking area of ​​the video signal and transmits the resulting video signal to the analog camera via the coaxial cable. However, the access capacity of a single analog-to-digital conversion unit is limited. For video processing devices that need to connect to multiple analog cameras, multiple analog-to-digital conversion units are usually required. However, the number of I2S (integrated circuit internal audio bus) peripherals of the control unit of the video processing device is limited, making it impossible to connect to each analog-to-digital conversion unit.

[0166] Based on this, the embodiments of the present application provide Fig. 9 A schematic diagram of the connection between the cascade structure of a video processing device and a processor is shown, so as to realize the connection between the I2S bus of the control unit and multiple analog-to-digital conversion units through the cascade structure. The following is a detailed introduction to the connection process between the cascade structure of the video processing device and the processor; wherein the above-mentioned cascade structure is the serial structure in the embodiment of the present application.

[0167] Step 1: AD defines pins ALINKI (input pin) and ALINKO (output pin), indicating cascaded audio input and output. Multiple AD chips are as follows: Fig. 9 The connection method shown is used to connect, that is, for each AD in the middle layer, its ALINKI input is connected to the ALINKO output of the previous AD in the specified direction, and its ALINKO output is connected to the ALINKI input of the next AD in the specified direction; the above specified direction is Fig. 9 The direction is 900, that is, the parent AD of this AD is Fig. 9 The next level AD of this AD in the structure shown is Fig. 9 In addition, to ensure the normal transmission of cascaded audio data, all ADs share a clock source.

[0168] Step 2: The AD with only ALINKI input and no ALINKO output is called the first AD; the AD with only ALINKO output and no ALINKI input is called the last AD. The processor initializes each AD through the I2C bus, assigns a unique AD serial number to each AD, and uses the AD serial number of the last AD as the target unit identifier in the embodiment of the present application. Among them, the first AD is the analog-to-digital conversion unit (second analog-to-digital conversion unit) at the source end of the serial structure in the embodiment of the present application, and the last AD is the analog-to-digital conversion unit (first analog-to-digital conversion unit) at the end of the serial structure in the embodiment of the present application.

[0169] Step 3: The processor is connected to the last AD through the I2S bus, and the uplink audio data is transmitted forward from the last AD in the specified direction, that is, according to the above Fig. 9 The uplink audio data is transmitted forward in the direction 900, Fig. 9 The direction 900 and the specified direction are the predetermined directions in the embodiment of the present application. Here, a transmission protocol between multiple ADs is customized, and the transmission protocol consists of a transmission header and a payload. The transmission header includes an AD sequence number, a sampling rate, and a sampling bit width. The payload includes the uplink audio data sent by the processor through the I2S bus, and the uplink audio data is the first audio data provided in the embodiment of the present application.

[0170] Step 4: Any AD can read the uplink audio data on the audio cascade line. When the AD serial number is verified to be the last AD and the sampling rate and sampling bit width are met, the uplink audio control register is enabled, and the uplink audio data is modulated into the video signal blanking area and transmitted to the camera end through the coaxial line.

[0171] In this embodiment, each analog-to-digital conversion unit in the cascade structure of the video processing device transmits the first audio data to the analog-to-digital conversion unit of the next level in the specified direction, so that each analog-to-digital unit in the cascade structure can receive the first audio data. In this way, through the multiple analog-to-digital conversion units in the cascade structure, the first audio data corresponding to each can be transmitted to the corresponding target analog camera at the same time, so that the corresponding target analog camera calls the first audio output module for audio output processing, and each target analog camera side can hear the audio data sent by the corresponding user side. Therefore, in the case where multiple analog-to-digital conversion units are needed to access multiple analog cameras, the user side can meet the need to communicate with the acquisition scene of the analog camera side.

[0172] In addition, a video processing device provided in an embodiment of the present application transmits uplink audio data through a cascade structure between analog-to-digital conversion units, and transmits the audio of the user end to the analog camera, so as to achieve the purpose of communicating between the user end and the analog camera in the acquisition scene, thereby filling the gap of realizing intercom between the user end and the analog camera with the help of multiple analog-to-digital conversion units.

[0173] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a solid-state hard disk (SSD), etc.

[0174] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0175] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.

[0176] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims

1. A video processing device, characterized in that: It comprises a control unit and a plurality of analog-to-digital conversion units, wherein the plurality of analog-to-digital conversion units are in a serial structure, and an I2S bus is connected between the first analog-to-digital conversion unit at the end of the serial structure and the control unit; and each analog-to-digital conversion unit is connected to the control unit via an I2C bus; The control unit is used to obtain the first audio data, transmit the first audio data to the first analog-to-digital conversion unit through the I2S bus, and perform a specified configuration on the analog-to-digital conversion unit corresponding to the target analog camera through the I2C bus; wherein the first audio data is the audio data acquired by the user end corresponding to the video processing device calling the first audio acquisition module, with the target analog camera as the playback end; the specified configuration is a configuration for instructing audio data processing; The first analog-to-digital conversion unit is configured to, in response to receiving the first audio data, output the first audio data to a connected analog-to-digital conversion unit; and in response to executing the specified configuration, perform a predetermined transmission process on the received first audio data; Each analog-to-digital conversion unit except the first analog-to-digital conversion unit is configured to output the received first audio data to the next-stage analog-to-digital conversion unit in response to the existence of a next-stage analog-to-digital conversion unit in a predetermined direction of the analog-to-digital conversion unit, and perform the predetermined transmission processing on the received first audio data in response to the execution of the specified configuration; Among them, the predetermined transmission processing is used to transmit the audio represented by the received first audio data to the target analog camera, so that the target analog camera calls the first audio output module to perform audio output processing; the predetermined direction is the direction from the end to the source end in the serial structure.

2. The video processing device according to claim 1, characterized in that The first analog-to-digital conversion unit outputs the first audio data to a connected analog-to-digital conversion unit, including: According to a predetermined transmission protocol between analog-to-digital conversion units, a message carrying target information and the first audio data is constructed, and the message is transmitted to an analog-to-digital conversion unit connected to the first analog-to-digital conversion unit; wherein the target information includes a target unit identifier of the first analog-to-digital conversion unit; Each analog-to-digital conversion unit except the first analog-to-digital conversion unit outputs the received first audio data to the next-stage analog-to-digital conversion unit in response to the existence of a next-stage analog-to-digital conversion unit in the predetermined direction, and performs the predetermined transmission processing on the received first audio data in response to the execution of the specified configuration, including: When it is detected that the received message carries the target unit identifier, in response to the existence of a next-level analog-to-digital conversion unit in the predetermined direction of the analog-to-digital conversion unit, the message is sent to the next-level analog-to-digital conversion unit, and in response to the execution of the specified configuration, the first audio data in the received message is subjected to the predetermined transmission processing.

3. The video processing device according to claim 1, characterized in that The predetermined transmission process includes: Modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; wherein the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera; The target data signal is sent to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of ​​the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal.

4. The video processing device according to claim 3, characterized in that: The step of modulating the analog audio signal corresponding to the first audio data to the field blanking region corresponding to the first video signal includes: The analog audio signal corresponding to the first audio data is modulated to the idle position of the field blanking area corresponding to the first video signal; wherein the idle position is: the position in the field blanking area excluding the position occupied by the communication data of the predetermined communication protocol; wherein the predetermined communication protocol is the communication protocol between the video processing device and the target analog camera.

5. The video processing device according to claim 3, characterized in that: The first video signal is an analog video signal sent by the target analog camera to the video processing device and meets a predetermined filtering condition; wherein the predetermined filtering condition includes a filtering condition set based on a signal receiving time.

6. The video processing device according to any one of claims 1 to 3, characterized in that: The processing method of performing a specified configuration on the analog-to-digital conversion unit corresponding to the target analog camera through the I2C bus includes: Enable a first register of an analog-to-digital conversion unit corresponding to the target analog camera through an I2C bus; wherein the first register is a register for indicating whether to perform audio data processing; The method for any analog-to-digital conversion unit to identify whether it is executing a specified configuration includes: Check whether the first register of the analog-to-digital conversion unit is enabled. If enabled, determine whether the analog-to-digital conversion unit is configured to execute the specified configuration.

7. The video processing device according to claim 2, characterized in that: In the message, the first audio data is located in the payload part, and the target information is located in the protocol header.

8. The video processing device according to claim 1, characterized in that The manner in which the first analog-to-digital conversion unit receives the first audio data includes: According to predetermined sampling information, the audio data transmitted through the I2S bus is sampled to obtain the first audio data; wherein the sampling information includes a sampling frequency and / or a sampling bit width; Each analog-to-digital conversion unit except the first analog-to-digital conversion unit, in response to the existence of a next-stage analog-to-digital conversion unit in the predetermined direction, outputs the received first audio data to the next-stage analog-to-digital conversion unit, and in response to the execution of the specified configuration, performs the predetermined transmission processing on the received first audio data, before further being used to: Determining the predetermined sampling information; Identify whether the first audio data in the received message satisfies the determined predetermined sampling information; if so, trigger the step of outputting the received first audio data to the next-level analog-to-digital conversion unit in response to the existence of the next-level analog-to-digital conversion unit in the predetermined direction of the analog-to-digital conversion unit, and performing the predetermined transmission processing on the received first audio data in response to the execution of the specified configuration.

9. The video processing device according to claim 8, characterized in that: Each analog-to-digital conversion unit corresponds to a plurality of second registers, each second register corresponds to a type of sampling information, and the second register corresponding to each analog-to-digital conversion unit and used to represent the predetermined sampling information is in an enabled state; The determining of the predetermined sampling information comprises: detecting a register in an enabled state among the second registers; The sampling information corresponding to the register in the enabled state is determined to obtain the predetermined sampling information.

10. The video processing device according to any one of claims 1 to 3, characterized in that: An I2S bus is connected between the second analog-to-digital conversion unit at the source end in the serial structure and the control unit; Each of the plurality of analog-to-digital conversion units is further configured to, when the specified configuration is executed, receive a second video signal sent by the target analog camera; perform a predetermined audio analysis process on the received second video signal to obtain a target digital signal; Each analog-to-digital conversion unit among the plurality of analog-to-digital conversion units, except the second analog-to-digital conversion unit, is further configured to output the target digital signal to the analog-to-digital conversion unit of the next stage in the predetermined direction of the analog-to-digital conversion unit when the specified configuration is executed; and is further configured to upload the received target digital signal to the analog-to-digital conversion unit of the next stage in the predetermined direction of the analog-to-digital conversion unit after receiving the target digital signal uploaded by the analog-to-digital conversion unit of the previous stage in the predetermined direction of the analog-to-digital conversion unit; The second analog-to-digital conversion unit is further configured to send the target digital signal to the control unit via an I2S bus after obtaining the target digital signal; The control unit is further used to receive the target digital signal, and call the second audio output module through the user terminal to perform audio output processing on the audio represented by the target digital signal.

11. The video processing device according to claim 10, characterized in that: The second video signal sent by the target analog camera is a video signal obtained by the target analog camera performing a modulation process on the target video signal to be sent to the video processing device; The modulation process is used to modulate the analog audio signal of the audio acquired in the acquisition scene of the target analog camera to the line blanking area of ​​the target video signal; The predetermined audio analysis process includes: An analog audio signal is parsed from a line blanking region of the received second video signal, and the analog audio signal is converted into a digital audio signal to obtain a target digital signal.

12. The video processing device according to claim 11, characterized in that: The first audio data is specifically audio data of the audio with the target simulated camera as the playback end, which is collected by the first audio collection module in response to the intercom instruction triggered by the target intercom operation; the target intercom operation is an operation issued in the user terminal to instruct to intercom the collection scene of the target simulated camera; The second video signal is specifically a video signal obtained by the target analog camera performing modulation processing on the target video signal to be sent to the video processing device in response to the intercom instruction triggered by the target intercom operation.

Images