Audio transmission method, video processing device and data transmission system
By using signal modulation technology in the video processing device, the audio data on the user side and the audio data on the analog camera side are transmitted in two-way, which solves the problem of difficult to achieve two-way audio mutual transmission in the prior art, realizes the call needs between the user side and the analog camera side, and improves the stability and efficiency of audio transmission.
Patent Information
- Application Number
- CN202411853952.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-16
- Publication Date
- 2025-04-01
- Estimated Expiration
- 2044-12-16
AI Technical Summary
The prior art is difficult to realize two-way audio transmission between the user side and the analog camera side, and cannot meet the call needs between the user side and the acquisition scenarios between the analog camera side.
By using signal modulation technology in the video processing device, the analog audio signal corresponding to the audio data on the user side is modulated to the field blanking area of the analog video signal and sent to the analog camera; at the same time, in response to receiving the video signal sent by the analog camera, the analog audio signal is parsed from the row blanking area of the video signal, and the two-way mutual transmission of audio is realized.
It realizes two-way audio communication between the user side and the analog camera side, meets the call needs between the user side and the analog camera side, and improves the stability and efficiency of audio transmission.
Smart Images

Figure CN119316549B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of audio data transmission, and in particular to an audio transmission method, a video processing device and a data transmission system. Background Art
[0002] Video processing devices such as DVR (Digital Video Recorder) can be connected to analog cameras and output the video data collected by the analog cameras through corresponding user terminals, for example, outputting the video data through a remote client corresponding to the video processing device, or outputting the video data through a display device locally connected to the video processing device.
[0003] In the related technology, the analog camera can have an audio acquisition function, so that the analog camera can transmit the acquired audio to the video processing device, so that the user end corresponding to the video processing device can output the audio. However, the user end has a need to communicate with the acquisition scene on the analog camera side, for example: the user on the user end has a need to talk with the people in the acquisition scene corresponding to the analog camera, that is, the user on the user end communicates with the analog camera side.
[0004] Therefore, how to bidirectionally transmit the audio on the user side and the audio on the analog camera side to realize a call with the analog camera side is an urgent problem to be solved. Summary of the invention
[0005] The purpose of the embodiments of the present application is to provide an audio transmission method, a video processing device and a data transmission system, which can bidirectionally transmit the audio of the user side and the audio of the analog camera side, thereby realizing a call with the analog camera side. The specific technical solution is as follows:
[0006] In a first aspect, an embodiment of the present application provides an audio transmission method, which is applied to a video processing device, and the method includes:
[0007] Acquire first audio data; wherein the first audio data is audio data acquired by calling a first audio acquisition module and using a target simulated camera as a playback end;
[0008] Modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; wherein the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera;
[0009] Sending the target data signal to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calling the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal;
[0010] In response to receiving a second video signal sent by the target analog camera, an analog audio signal is parsed from a line blanking region of the second video signal to obtain a target analog signal; wherein the second video signal is a video signal obtained by the target analog camera performing a modulation process on the target analog video signal to be sent to the video processing device; the modulation process is used to modulate the analog audio signal of the audio acquired within the acquisition scene of the target analog camera to the line blanking region of the target analog video signal;
[0011] The second audio output module is called to perform audio output processing on the audio represented by the target analog signal.
[0012] In a second aspect, an embodiment of the present application provides a video processing device, including: a control unit and an analog-to-digital conversion unit;
[0013] The control unit is used to obtain first audio data; wherein the first audio data is audio data acquired by calling the first audio acquisition module and using the target simulated camera as the playback end;
[0014] The analog-to-digital conversion unit is used to modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; wherein the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera;
[0015] The analog-to-digital conversion unit is further used to send the target data signal to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal;
[0016] The analog-to-digital conversion unit is further used for, in response to receiving a second video signal sent by the target analog camera, parsing an analog audio signal from a line blanking region of the second video signal to obtain a target analog signal, and sending the target analog signal to the control unit; wherein the second video signal is a video signal obtained by the target analog camera performing a modulation process on the target analog video signal to be sent to the video processing device; the modulation process is used to modulate the analog audio signal of the audio acquired in the acquisition scene of the target analog camera to the line blanking region of the target analog video signal;
[0017] The control unit is further used to receive the target analog signal and perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
[0018] In a third aspect, an embodiment of the present application provides a data transmission system, the data transmission system comprising: a video processing device and a target simulation camera;
[0019] The video processing device is used to obtain first audio data; modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; send the target data signal to the target analog camera; wherein the first audio data is audio data obtained by calling the first audio acquisition module and using the target analog camera as the playback end; the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera;
[0020] The target analog camera is used to receive the target data signal; parse the analog audio signal from the field blanking area of the target data signal, and call the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal; the target analog camera is also used to send a second video signal to the video processing device; wherein the second video signal is a video signal obtained by the target analog camera performing modulation processing on the target analog video signal to be sent to the video processing device; the modulation processing is used to modulate the analog audio signal of the audio collected in the collection scene of the target analog camera to the line blanking area of the target analog video signal;
[0021] The video processing device is also used to receive the second video signal; parse the analog audio signal from the line blanking area of the second video signal to obtain a target analog signal; and perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
[0022] Beneficial effects of the embodiments of the present application:
[0023] As can be seen from the above, the solution provided by the embodiment of the present application is applied to a video processing device. When there is a need to talk with the acquisition scene on the target analog camera side, after acquiring the first audio data, the video processing device modulates the analog audio signal corresponding to the acquired first audio data to the field blanking area corresponding to the first video signal to obtain the target data signal; then, the obtained target data signal is sent to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal. In addition, in response to receiving the second video signal sent by the target analog camera, the analog audio signal is parsed from the line blanking area of the second video signal to obtain the target analog signal, and the second audio output module is called to perform audio output processing on the audio represented by the target analog signal.
[0024] Based on this, the solution provided by the embodiment of the present application is applied, and the video processing device modulates the analog audio signal corresponding to the audio data to be transmitted to the target analog camera into the field blanking area of the first video signal through signal modulation, so as to transmit the audio represented by the above analog audio signal to the target analog camera through the first video signal. In addition, the target analog camera modulates the analog audio signal corresponding to the audio data to be transmitted to the video processing device into the line blanking area of the second video signal through signal modulation, so as to transmit the audio represented by the analog audio signal through the above second video signal. It can be seen that through the solution of the present application, the audio on the user side and the audio on the analog camera side can be transmitted bidirectionally to each other to realize a call with the analog camera side. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other embodiments can also be obtained based on these drawings.
[0026] Figure 1 A schematic diagram of an image data area and a blanking area included in a video signal;
[0027] Figure 2 A flowchart of an audio transmission method provided in an embodiment of the present application;
[0028] Figure 3 A schematic diagram of modulation position of first audio data provided in an embodiment of the present application;
[0029] Figure 4 for Figure 3A corresponding schematic diagram of a modulation position waveform of the first audio data;
[0030] Figure 5 is a schematic diagram of an uplink audio waveform;
[0031] Figure 6 A schematic diagram of modulation position of second audio data provided in an embodiment of the present application;
[0032] Figure 7 for Figure 6 A corresponding schematic diagram of a modulation position waveform of second audio data;
[0033] Figure 8 It is a schematic diagram of a coaxial audio waveform;
[0034] Fig. 9 A waveform diagram of two-channel audio data;
[0035] Fig.10 A schematic diagram of the structure of a video processing device provided in an embodiment of the present application;
[0036] Fig.11 A schematic diagram of the structure of a data transmission system provided in an embodiment of the present application;
[0037] Fig.12 A schematic diagram of the structure of another data transmission system provided in an embodiment of the present application;
[0038] Fig.13 A structural schematic diagram of a hard disk video recorder provided in an embodiment of the present application;
[0039] Fig.14 A schematic diagram of dual-channel data transmission provided in an embodiment of the present application. DETAILED DESCRIPTION
[0040] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field based on the present application belong to the scope of protection of the present application.
[0041] To facilitate understanding, the professional terms involved in this application are first introduced below.
[0042] BNC (Bayonet Nut Connector, coaxial cable): coaxial cable used to connect analog cameras and DVRs;
[0043] Coaxial audio: The audio sent by the analog camera to the DVR via the coaxial line. In specific applications, the analog camera can use the pickup to collect coaxial audio. If it can be collected, it can be modulated into the line blanking area of the analog video signal; it is understandable that if there is audio data, it will be modulated, and in the end, there may not be a situation where every line has coaxial audio data;
[0044] Uplink audio: The audio that the DVR sends to the analog camera through the coaxial BNC cable; similar to coaxial audio, if there is audio data, it will be modulated into the field blanking area of the analog video signal. Since the uplink audio is modulated into the field blanking area, and the field blanking area of a frame of analog video signal has limited storage space, combined with actual measurement conditions, when modulating the uplink audio, usually each frame of analog video signal can be modulated with uplink audio data;
[0045] AD: analog-to-digital converter;
[0046] DVR: A device that can receive audio and video from analog cameras, as well as store, preview, and play back;
[0047] I2S (Inter-IC Sound) bus: a bus standard for transmitting audio data;
[0048] Voice intercom: A conversation between two people who are not in the same space. In the embodiment of the present application, it refers to the voice intercom between the camera end and the user end, for example, the voice intercom between the analog camera and the computer end.
[0049] In addition, in order to facilitate the understanding of field blanking and line blanking, the following introduction is made:
[0050] Each frame of video image may correspond to an analog video signal. In the present application, the analog video signal may also be referred to as a video signal. The video signal corresponding to each frame of video image includes valid data and invalid data, namely, an image data area and a blanking area. The image data area is used to store a frame of valid image data, and the blanking area is used to store invalid data, wherein the invalid data includes signals such as field synchronization, line synchronization, field blanking, and line blanking. In other words, a frame of analog video signal may include an image data area and a blanking area. For example, Figure 1 Schematic diagram of the image data area and blanking area included in the video signal, wherein the white area 102 is the image data area, the dark areas 101 and 103 are blanking areas, and the area 101 is field blanking (field blanking area), and the area 103 is line blanking (line blanking area).
[0051] Line blanking: In the scanning process of converting optical signals into electrical signals, the scanning point always starts from the upper left corner of an image and moves forward horizontally, while the scanning point also moves downward at a slower rate; when the scanning point reaches the right edge of the image, the scanning point quickly returns to the left and restarts the second line scanning below the starting point of the first line. The return process between lines is called line blanking. Among them, the signal in the period of line blanking can be called line blanking signal.
[0052] Field blanking: A complete image scanning signal, which is composed of a sequence of line signals separated by line blanking intervals, is called a frame; after the scanning point scans a frame, it needs to return from the lower right corner of the image to the upper left corner of the image to start scanning a new frame. This process is called field blanking. Among them, the signal within the field blanking period can be called the field blanking signal.
[0053] In order to bidirectionally transmit the audio on the user side and the audio on the analog camera side to each other so as to realize a call with the analog camera side, thereby meeting the call requirements between the user side and the acquisition scene on the analog camera side, the present application provides an audio transmission method, a video processing device and a data transmission system.
[0054] The following first introduces an audio transmission method provided by the present application.
[0055] Among them, the audio transmission method can be applied to a video processing device connected to an analog camera. Exemplarily, the video processing device can be a DVR, a recording and broadcasting host that can be connected to an analog camera, other devices with encoding and recording functions, etc. In addition, the method is applicable to various application scenarios in which intercom is performed between the analog camera side and the video processing device side. For example, the monitoring personnel conduct voice intercom with the personnel in the collection scene on the analog camera side through the supervision system. For another example, the user conducts voice intercom with the personnel in the collection scene on the analog camera side through a mobile phone. In this regard, the embodiments of the present application do not specifically limit the application scenarios of the method.
[0056] An audio transmission method provided in an embodiment of the present application is applied to a video processing device, and the method may include the following steps:
[0057] Acquire first audio data; wherein the first audio data is audio data acquired by calling a first audio acquisition module and using a target simulated camera as a playback end;
[0058] Modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; wherein the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera;
[0059] Sending the target data signal to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calling the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal;
[0060] In response to receiving a second video signal sent by the target analog camera, an analog audio signal is parsed from a line blanking region of the second video signal to obtain a target analog signal; wherein the second video signal is a video signal obtained by the target analog camera performing a modulation process on the target analog video signal to be sent to the video processing device; the modulation process is used to modulate the analog audio signal of the audio acquired within the acquisition scene of the target analog camera to the line blanking region of the target analog video signal;
[0061] The second audio output module is called to perform audio output processing on the audio represented by the target analog signal.
[0062] As can be seen from the above, the solution provided by the embodiment of the present application is applied to a video processing device. When there is a need to talk with the acquisition scene on the target analog camera side, after acquiring the first audio data, the video processing device modulates the analog audio signal corresponding to the acquired first audio data to the field blanking area corresponding to the first video signal to obtain the target data signal; then, the obtained target data signal is sent to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal. In addition, in response to receiving the second video signal sent by the target analog camera, the analog audio signal is parsed from the line blanking area of the second video signal to obtain the target analog signal, and the second audio output module is called to perform audio output processing on the audio represented by the target analog signal.
[0063] Based on this, the solution provided by the embodiment of the present application is applied, and the video processing device modulates the analog audio signal corresponding to the audio data to be transmitted to the target analog camera into the field blanking area of the first video signal through signal modulation, so as to transmit the audio represented by the above analog audio signal to the target analog camera through the first video signal. In addition, the target analog camera modulates the analog audio signal corresponding to the audio data to be transmitted to the video processing device into the line blanking area of the second video signal through signal modulation, so as to transmit the audio represented by the analog audio signal through the above second video signal. It can be seen that through the solution of the present application, the audio on the user side and the audio on the analog camera side can be transmitted bidirectionally to each other to realize a call with the analog camera side.
[0064] Below, in conjunction with the accompanying drawings, an audio transmission method provided in an embodiment of the present application is exemplarily introduced.
[0065] like Figure 2 As shown, an audio transmission method provided in an embodiment of the present application is applied to a video processing device, and the method may include the following steps:
[0066] S201: Acquire first audio data.
[0067] The first audio data is audio data acquired by calling the first audio acquisition module and using the target simulated camera as the playback end.
[0068] In the present application, when a user has a need to speak with the target simulated camera side of the capture scene, or the user in the capture scene, the audio data of the audio captured by calling the first audio capture module and using the target simulated camera as the playback end can be used as the first audio data.
[0069] Among them, the first audio acquisition module can be an acquisition module possessed by the device to which the user terminal corresponding to the video processing device belongs, so that the user terminal corresponding to the video processing device can call the first audio acquisition module to collect the first audio data; the above-mentioned first audio acquisition module can also be an acquisition module that can be called by the above-mentioned user terminal through the network, so that the user terminal corresponding to the video processing device calls the first audio acquisition module through the network to collect the first audio data, which is all reasonable. Of course, the above-mentioned first audio acquisition module can also be an audio acquisition module that can be called by the video processing device itself, which is also reasonable. The present application does not limit the specific calling method of the first audio acquisition module. Any implementation method that can enable the first audio acquisition module to collect audio data with the target simulated camera as the playback end can be applied to the present application.
[0070] Optionally, the user end corresponding to the video processing device is a remote client running on a mobile phone, a computer, etc.
[0071] Optionally, the user end corresponding to the video processing device is the video processing device itself, that is, the video processing device itself can realize the functions of the user end. For example, the video processing device can be connected to a display to perform operations such as screen display and configuration. The video processing device itself can realize the functions of the user end.
[0072] In addition, the number of analog cameras connected to the video processing device can be one or more, and the embodiment of the present application does not specifically limit this. That is to say, the audio transmission method provided in the embodiment of the present application can only intercom with the acquisition scene on the side of an analog camera. In this case, the analog camera is the target analog camera in the embodiment of the present application; the audio transmission method provided in the embodiment of the present application can also intercom with the acquisition scenes on the sides of multiple analog cameras. In this case, each of the above multiple analog cameras can be used as the target analog camera in the embodiment of the present application.
[0073] Optionally, in one implementation, the first audio data is specifically audio data of the audio with the target simulation camera as the playback end, which is obtained by calling the first audio acquisition module to collect the audio data obtained by the user end corresponding to the video processing device in response to an intercom instruction triggered by a target intercom operation; the target intercom operation is an operation issued in the user end to instruct intercom on the capture scene of the target simulation camera.
[0074] In this implementation, when the user needs to talk to the target analog camera side of the acquisition scene, the user end corresponding to the video processing device can issue a target intercom operation for instructing to talk to the target analog camera's acquisition scene. In this way, the user end can respond to the intercom instruction triggered by the above target intercom operation and call the audio data collected by the first audio acquisition module with the target analog camera as the playback end as the first audio data. The first audio data itself can be digital signal data or analog signal data, which is reasonable.
[0075] Optionally, the intercom instruction triggered by the target intercom operation may be triggered by clicking an audio button preset on the display interface of the user terminal. In other words, the user terminal generates the intercom instruction by triggering the audio button, so that the user terminal calls the first audio acquisition module to acquire the audio data that the user wants to transmit to the target analog camera.
[0076] The audio button can be a button for intercom settings or a button for unidirectional audio transmission, that is, when the audio button is a button for unidirectional audio transmission, the user at the user end does not need to get a response from the staff in the acquisition scene of the target simulated camera side, such as voice broadcast. When the audio button is a button for intercom settings, the user at the user end needs to get a response from the staff in the acquisition scene of the target simulated camera side, such as voice intercom.
[0077] Optionally, two buttons for audio calls are pre-set on the display interface of the user end: an audio intercom button and a first audio play button, and the two buttons correspond to different voice transmission functions. Among them, the audio intercom button is used to trigger the intercom instruction. At this time, the target simulation camera side and the user end side can talk to each other; the first audio play button is used to trigger the instruction of a one-way speech with the acquisition scene on the target simulation camera side. At this time, the target simulation camera side does not need to make an audio reply. Of course, the display interface of the user end can also be provided with: a second audio play button that only outputs the audio on the target simulation camera side.
[0078] Optionally, the user end corresponding to the video processing device responds to the instruction for representing speaking to the target simulated camera side by calling the first audio acquisition module to acquire audio data with the target simulated camera as the playback end as the first audio data. The above-mentioned method of triggering the user end to call the first audio acquisition module to acquire audio with the target simulated camera as the playback end is only an example and should not constitute a limitation of the present application.
[0079] S202: modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; wherein the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to a target analog camera.
[0080] In the present application, since the data transmission between the video processing device and the analog camera is carried out using the video signal as a carrier, for the video signal to be sent to the analog camera, the first audio data is additional audio data that needs to be transmitted. When the first audio data is transmitted, it does not pay attention to the content of the video signal itself as its carrier signal. In order not to interfere with the data contained in the video signal itself, the video processing device can insert the analog audio signal corresponding to the first audio data into the field blanking area of the video signal.
[0081] It should be noted that the field blanking area of the video signal is located between two video frames. Therefore, whether the analog audio signal is modulated to the field blanking area or the analog audio signal is parsed from the field blanking area, the field blanking area can be quickly located based on the particularity of its location to improve the efficiency of audio writing and audio parsing. After acquiring the first audio data, the video processing device can determine the analog audio signal corresponding to the first audio data, thereby modulating the determined analog audio signal to the field blanking area corresponding to the first video signal to obtain the target data signal.
[0082] Optionally, in one implementation, the first video signal is an analog video signal that is sent by a target analog camera to a video processing device and that satisfies a predetermined filtering condition; wherein the predetermined filtering condition includes a filtering condition set based on a signal reception time.
[0083] In this implementation, the first audio data transmitted from the video processing device to the target analog camera is carried by the analog video signal sent from the target analog camera to the video processing device; and for the real-time nature of audio and video transmission, the audio and video data or video data collected by the target analog camera is synchronously transmitted to the video processing device in real time. That is to say, the video processing device will receive the analog video signal sent in real time by the target analog camera, and the analog video signal sent in real time may be multiple analog video signals received successively.
[0084] Therefore, a predetermined screening condition may be pre-set to help the video processing device screen the analog video signal satisfying the predetermined screening condition from the analog video signal sent from the target analog camera as the first video signal.
[0085] Considering the real-time nature of the analog video signal, the predetermined screening condition includes a screening condition set based on the signal receiving time. Exemplarily, the analog video signal with the latest signal receiving time can be used as the first video signal.
[0086] Optionally, considering that when the user has a need to intercom with the acquisition scene on the target analog camera side, a target intercom operation for instructing to intercom the acquisition scene of the target analog camera will be issued through the user terminal corresponding to the video processing device, so that the user terminal responds to the intercom instruction triggered by the target intercom operation and starts audio transmission. Therefore, the above-mentioned predetermined screening condition includes receiving the analog video signal received by the video processing device as the first video signal after receiving the specified time length of the intercom instruction triggered by the user terminal in response to the target intercom operation.
[0087] Optionally, in one implementation, the above step S202, modulating the analog audio signal corresponding to the first audio data to the field blanking region corresponding to the first video signal to obtain the target data signal, may include the following steps:
[0088] Step A1: determining a first signal format of a first video signal;
[0089] Step A2: modulate the analog audio signal corresponding to the first audio data to a position corresponding to the first signal format in an idle position of the field blanking area corresponding to the first video signal.
[0090] Among them, different signal formats correspond to different positions in the idle positions.
[0091] Optionally, in one implementation, the idle position is: a position in the field blanking area except a position occupied by communication data of a predetermined communication protocol; wherein the predetermined communication protocol is a communication protocol between a video processing device and an analog camera.
[0092] In this implementation, audio transmission between the video processing device and the analog camera can be performed only if the analog camera complies with the predetermined communication protocol. That is, only if the analog camera supports the predetermined communication protocol can the analog camera complete the reception and processing of the target data signal sent by the video processing device.
[0093] The above-mentioned predetermined communication protocol is the basis for ensuring effective collaboration between the video processing device and the analog camera. Through the predetermined communication protocol, the video processing device can send control instructions to the analog camera, for example, to adjust parameters such as focus, exposure, and white balance. This allows the user to remotely control the analog camera through the video processing device. Normally, the predetermined communication protocol is inserted into the field blanking area of the first video signal sent by the target analog camera to the video processing device, thereby occupying part of the position in the above-mentioned field blanking area. In this way, the idle position in the above-mentioned field blanking area can be used to insert the first audio data that needs to be transmitted additionally, so as to ensure that the inserted first audio data will not affect the predetermined communication protocol inserted in the field blanking area without interfering with the audio data contained in the video signal itself, thereby improving the stability of the video processing device's remote control of the analog camera.
[0094] The predetermined communication protocol may be a protocol for coaxial communication, that is, a coaxial cable is used as a communication medium to transmit and control a video stream to a front-end device such as an analog camera, etc. This application does not make any specific limitation on this.
[0095] In the implementation of the above steps A1-A2, it is considered that the video signal is obtained by modulating the analog signal after the analog camera collects the video data. Since there are many types of analog cameras, each analog camera has different acquisition parameters for collecting video data, such as different resolutions and frame rates, so the signal formats of the video signals finally obtained are different. The positions of signals of different signal formats in the blanking area of the video signal are different, and thus the positions used to modulate the audio data are also different.
[0096] For example, when the signal format is 1080P25, the first audio data starts from the 11th line of the field blanking area after field synchronization, with a total of 25 lines; when the signal format is 3K20, the first audio data starts from the 11th line of the field blanking area after field synchronization, with a total of 35 lines; when the signal format is 3K10, the first audio data starts from the 11th line of the field blanking area after field synchronization, with a total of 35 lines; when the signal format is 1080P30, the first audio data starts from the 11th line of the field blanking area after field synchronization, with a total of 20 lines.
[0097] The signal format of the video signal may include but is not limited to: 1080P25 and 1080P30. The signal format 1080P25 indicates that the resolution of the video signal is 1920×1080 and the frame rate is 25 frames per second. The signal format 1080P30 indicates that the resolution of the video signal is 1920×1080 and the frame rate is 30 frames per second.
[0098] Meanwhile, considering that part of the vertical blanking area has been occupied by a predetermined communication protocol, different signal formats correspond to different positions in the free space of the vertical blanking area.
[0099] In this way, after the video processing device obtains the first audio data, it can determine the first signal format of the first audio data, and then, based on the determined first signal format, determine the position of the first signal format in the idle position of the field blanking area corresponding to the first video signal that corresponds to the first signal format, and then, modulate the analog audio signal corresponding to the first audio data to the position determined in the above-mentioned field blanking area to realize the insertion of the first audio data.
[0100] In addition, the method in which the video processing device modulates the analog audio signal corresponding to the first audio data to be transmitted to the target analog camera into the field blanking area of the first video signal through signal modulation can be called a coaxial coding method.
[0101] In addition, exemplary, Figure 3 A schematic diagram of modulation position of a first audio data provided in an embodiment of the present application, Figure 4 for Figure 3 A schematic diagram of a modulation position waveform of a corresponding first audio data. Figure 3 The uplink audio in is the first audio data in the embodiment of the present application. Figure 4 The coaxial communication in is the predetermined communication protocol provided in the embodiment of the present application.
[0102] The video processing device modulates the uplink audio to the field blanking area of the first video signal through field synchronization, specifically, modulates the uplink audio to the check bit of the coaxial communication protocol information, thereby obtaining the first video signal. Exemplarily, Figure 5 is a schematic diagram of an uplink audio waveform, which is a display interface diagram in an actual scenario, wherein: Figure 5 The waveform in the dense area on the right is the 1080P25 uplink audio.
[0103] S203: Sending a target data signal to a target analog camera, so that the target analog camera parses an analog audio signal from a field blanking region of the target data signal, and calling a first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal.
[0104] In the present application, the video processing device sends a target data signal to the target analog camera, so that after receiving the above target data signal, the target analog camera can parse the analog audio signal from the field blanking area of the above target data signal, thereby calling the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal, so that the user on the target analog camera side, or the person in the acquisition scene on the target analog camera side, can hear the audio transmitted by the video processing device, so as to achieve the purpose of transmitting the audio that the analog camera side wants to play to the analog camera side and communicating with the analog camera side.
[0105] S204: In response to receiving a second video signal sent by a target analog camera, parsing an analog audio signal from a line blanking area of the second video signal to obtain a target analog signal;
[0106] Among them, the second video signal is a video signal obtained by modulating the target analog video signal that the target analog camera will use to send to the video processing device; the modulation processing is used to modulate the analog audio signal of the audio collected in the collection scene of the target analog camera to the line blanking area of the target analog video signal.
[0107] S205: Perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
[0108] In the present application, while inserting the audio data into the field blanking area of the video signal, the audio data sent from the target analog camera to the video processing device can be inserted into the line blanking area of the video signal in consideration of the stability of the transmitted audio data. In this way, the audio data sent to each other by the two will not interfere with each other, and after receiving the second video signal sent by the target analog camera, the video processing device can directly parse the analog audio signal from the second video signal to obtain the target analog signal, so as to improve the efficiency of audio parsing and processing. Moreover, in the present application, the uplink transmission (i.e., the video processing device transmits audio data to the target analog camera) uses the field blanking area, while the downlink transmission (i.e., the target analog camera transmits audio data to the video processing device) uses the line blanking area. This combination can avoid the disadvantages of other combinations:
[0109] For the combination mode that both uplink transmission and downlink transmission rely on the line blanking area, the video processing device itself has different functions from the target analog camera, and there is a problem of difficulty in parsing and locating the line blanking area of the video signal, which affects the parsing efficiency; at the same time, if both uplink transmission and downlink transmission rely on the line blanking area, then in order to ensure that the uplink and downlink do not interfere with each other and the transmission is stable, different positions of the line blanking area need to be occupied, and the data storage space of the line blanking area is limited, which will lead to the problem of insufficient data storage space;
[0110] For the combination method in which both uplink transmission and downlink transmission use the field blanking area, in some scenarios, in order to be able to uniformly transmit audio to the receiver (the receiver of the target analog camera is the video processing device, and the receiver corresponding to the video processing device is the target analog camera), the analog-to-digital conversion unit (the analog-to-digital conversion unit in the video processing device, and the analog-to-digital conversion unit in the target analog camera) can usually use the memory area to uniformly control the audio data (for example, first copy the audio data to the memory area, and then use a predetermined control algorithm to perform uniform speed control processing, and then perform subsequent audio signal modulation processing). Therefore, if the downlink transmission also uses the field blanking area, and the memory space required to be allocated for the field blanking area is large, it will undoubtedly be necessary to expand the memory area of the target analog camera, and the cost for each target analog camera will also be greatly increased. In addition, the number of target analog cameras involved is usually multiple. Therefore, if the memory area of each target analog camera needs to be expanded, the problem of high cost for the target analog camera will be more serious;
[0111] With respect to the combination method in which the uplink transmission relies on the line blanking area and the downlink transmission relies on the field blanking area, based on the above description of the other two combinations, it can be seen that there will be the problem that the video processing equipment itself has difficulty in parsing the line blanking area, and the cost of the target analog camera will be greatly increased. If the number of target analog cameras is large, the cost problem will be more serious.
[0112] In summary, the combination of uplink transmission with the help of field blanking area and downlink transmission with the help of row blanking area in the present application has at least the following combined advantages: the video processing device can quickly locate and analyze the data in the field blanking area, greatly improving the processing efficiency. At the same time, uplink and downlink modulation to different blanking areas can ensure that the spatial position of the modulation is sufficient, and the cost of the target analog camera can be well controlled. Afterwards, the video processing device calls the second audio output module to perform audio output processing on the audio represented by the above-mentioned target analog signal, so that the user on the user side can hear the audio collected by the collection scene on the target analog camera side. Among them, the above-mentioned audio output processing may include processing algorithms such as noise reduction and volume adjustment, which are not specifically limited in the embodiments of the present application.
[0113] In addition, illustratively, in one implementation, the second audio output module may be an audio output module that can be called by the video processing device; in other implementations, the second audio output module may be an audio output module that can be called by the user end corresponding to the video processing device. The present application does not impose any limitation on the specific calling method of the second audio output module.
[0114] Optionally, in one implementation, the second video signal is specifically a video signal obtained by modulating the target analog video signal for sending to the video processing device in response to an intercom instruction triggered by a target intercom operation; the target intercom operation is an operation issued in the user terminal corresponding to the video processing device, for instructing to intercom the capture scene of the target analog camera.
[0115] In this implementation, a user can issue a target intercom operation for instructing intercom with a target analog camera through a user terminal corresponding to the video processing device. In this way, after receiving the target intercom operation, the video processing device can trigger the intercom instruction through the target intercom operation, and send the formed instruction to the target analog camera, so that after receiving the intercom instruction, the target analog camera responds to the intercom instruction and modulates the target analog video signal sent to the video processing device to obtain a second video signal. Among them, through the above modulation processing, the target analog camera can modulate the analog audio signal of the audio collected from the collection scene to the line blanking area of the target analog video signal. Among them, the above target analog video signal can be an analog video signal, which is not specifically limited in this application.
[0116] Optionally, the video processing device parses the analog audio signal from the line blanking area of the second video signal, and determines the digital audio signal corresponding to the parsed analog audio signal, thereby calling the second audio output module of the user terminal to perform audio output processing on the audio represented by the digital audio signal. The second audio data itself can be digital signal data or analog signal data, which is not specifically limited in the embodiments of the present application.
[0117] It should be understood that the video processing device and the corresponding user end can be two devices, considering that the audio transmission between the two devices may be transmitted through analog signals. Therefore, after the video processing device parses the analog audio signal from the line blanking area of the second video signal and obtains the target analog signal, the target analog signal can be sent to the corresponding user end, thereby calling the second audio output module through the user end to perform audio output processing for the audio represented by the target analog signal. Correspondingly, considering that the video processing device can be connected to a microphone and a player, the video processing device can be used as an intercom input source and an intercom output source, that is, the video processing device and the corresponding user end are the same device, and the user end corresponding to the video processing device is the video processing device itself. At this time, after obtaining the target analog signal, the video processing device can directly call the second audio output module associated with the video processing device itself to perform audio output processing for the audio represented by the target analog signal.
[0118] As can be seen from the above, the solution provided by the embodiment of the present application is applied to a video processing device. When there is a need to talk with the acquisition scene on the target analog camera side, after acquiring the first audio data, the video processing device modulates the analog audio signal corresponding to the acquired first audio data to the field blanking area corresponding to the first video signal to obtain the target data signal; then, the obtained target data signal is sent to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal. In addition, in response to receiving the second video signal sent by the target analog camera, the analog audio signal is parsed from the line blanking area of the second video signal to obtain the target analog signal, and the second audio output module is called to perform audio output processing on the audio represented by the target analog signal.
[0119] Based on this, the solution provided by the embodiment of the present application is applied, and the video processing device modulates the analog audio signal corresponding to the audio data to be transmitted to the target analog camera into the field blanking area of the first video signal through signal modulation, so as to transmit the audio represented by the above analog audio signal to the target analog camera through the first video signal. In addition, the target analog camera modulates the analog audio signal corresponding to the audio data to be transmitted to the video processing device into the line blanking area of the second video signal through signal modulation, so as to transmit the audio represented by the analog audio signal through the above second video signal. It can be seen that through the solution of the present application, the audio on the user side and the audio on the analog camera side can be transmitted bidirectionally to each other to realize a call with the analog camera side.
[0120] For example, Figure 6 A schematic diagram of modulation position of second audio data provided in an embodiment of the present application, Figure 7 for Figure 6 A schematic diagram of a modulation position waveform of a corresponding second audio data. Figure 6 The coaxial audio in is the second audio data in the embodiment of the present application, and may also be referred to as downlink audio.
[0121] The target analog camera modulates the coaxial audio into the line blanking area of the second video signal after adding the color carrier synchronization signal applied to the image data through line synchronization for the target analog video signal. Specifically, the downlink audio is modulated into the audio synchronization signal used to identify the start mark of the coaxial audio to obtain the second video signal. Exemplarily, Figure 8 This is a schematic diagram of a coaxial audio waveform, which is a display interface diagram in an actual scenario. Figure 8 The waveform in the denser area of the higher part is the coaxial audio of 1080P25.
[0122] In this embodiment, the audio data sent by the target analog camera to the video processing device is inserted into the line blanking area of the video signal, and the audio data sent by the video processing device to the target analog camera is inserted into the field blanking area of the video signal. Therefore, the audio data sent to each other by the two will not interfere with each other, thereby improving the stability of the transmitted audio data.
[0123] Optionally, in another embodiment of the present application, an audio transmission method provided in the embodiment of the present application may further include the following steps:
[0124] Step B1: in response to acquiring the first audio data and the obtained target analog signal, performing predetermined processing on the acquired first audio data and the second audio data corresponding to the obtained target analog signal to obtain a processing result;
[0125] wherein the predetermined processing is used to indicate the recipient of the acquired first audio data as the target analog camera, and in response to the second audio output module being a module associated with the video processing device itself, to indicate the recipient of the second audio data corresponding to the acquired target analog signal as the video processing device itself;
[0126] The above step S202, modulating the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain the target data signal, may include the following steps:
[0127] Step B2: determining the audio data of the target analog camera corresponding to the receiver indicated by the processing result, and obtaining the first audio data;
[0128] Step B3: modulating the analog audio signal corresponding to the obtained first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal;
[0129] When the second audio output module is a module associated with the video processing device itself, the above step S205, by calling the second audio output module to perform audio output processing on the audio represented by the target analog signal, may include the following steps:
[0130] Step B41: In response to the second audio output module being a module associated with the video processing device itself, determine the audio data indicated by the processing result and the corresponding recipient is the video processing device itself to obtain second audio data; and call the second audio output module associated with the video processing device itself to perform audio output processing on the audio represented by the second audio data.
[0131] In this embodiment, when the second audio output module is a module associated with the video processing device itself, that is, when the user end corresponding to the video processing device is the video processing device itself, after the video processing device obtains the first audio data and the obtained target analog signal, it considers that the first audio data needs to be transmitted to the target analog camera for parsing and playback, and the second audio data corresponding to the target analog signal needs to be transmitted to the video processing device itself for parsing and playback. Therefore, the video processing device performs predetermined processing on the obtained first audio data and the obtained second audio data corresponding to the target analog signal to obtain the processing result, and indicates the recipient of the obtained first audio data as the target analog camera, and in response to the second audio output module being the module associated with the video processing device itself, indicates the recipient of the second audio data corresponding to the obtained target analog signal as the video processing device itself. Among them, the second audio data corresponding to the target analog signal can be obtained after analog-to-digital conversion.
[0132] It should be noted that the module associated with the above-mentioned video processing device itself can be a module embedded in the video processing device, such as a speaker carried by the video processing device itself; it can also be a module that communicates with the video processing device over a network and can be directly called by the video processing device, such as a Bluetooth speaker, etc., which are all reasonable.
[0133] In summary, when the first audio data is obtained by the user terminal corresponding to the video processing device by calling the first audio acquisition module, when performing audio output, the above-mentioned user terminal can also call its own audio output module to play it. Therefore, the above-mentioned second audio output module is a module associated with the video processing device itself, which can be understood as the case where the video processing device itself is the user terminal corresponding to the video processing device, that is, the case where the video processing device is integrated with the user terminal function.
[0134] In this way, the video processing device can determine the audio data of the target analog camera indicated by the above processing results and the corresponding recipient based on the above processing results, obtain the first audio data, and modulate the analog audio signal corresponding to the obtained first audio data to the field blanking area corresponding to the first video signal to obtain the target data signal.
[0135] Furthermore, in response to the fact that the second audio output module is a module associated with the video processing device itself, that is, when the user end corresponding to the video processing device is the video processing device itself, it is possible to determine, based on the above processing result, the audio data indicated by the above processing result and the corresponding recipient being the video processing device itself, and obtain the second audio data, thereby calling the second audio output module associated with the video processing device itself to perform audio output processing on the audio represented by the second audio data.
[0136] In this embodiment, considering that the user end corresponding to the video processing device is the video processing device itself, that is, the second audio output module for playing the second audio data is a module associated with the video processing device itself, at this time, during the audio transmission process, there will be two kinds of audio data in the video processing device, one is the first audio data that needs to be modulated, and the other is the second audio data that needs to be played locally. In order to facilitate the distinction between the two kinds of data, after obtaining the two kinds of data, the video processing device distinguishes the two kinds of audio data based on different receivers through predetermined processing, so as to facilitate the execution of the subsequent audio transmission method.
[0137] Optionally, based on different receivers, the audio data is marked with corresponding receiver tags. When processing the audio data, the video processing device determines how to process the audio data by identifying the receiver tags carried by the audio data.
[0138] If the receiver tag carried by the audio data indicates that the receiver is a target analog camera, the audio data is first audio data. At this time, the video processing device can modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain the target data signal; if the receiver tag indicates that the receiver is the video processing device itself, the audio data is second audio data. At this time, the video processing device can call the second audio output module associated with the video processing device itself to perform audio output processing on the audio represented by the second audio data.
[0139] When the second audio output module is not a module associated with the video processing device itself, the above step S205, by calling the second audio output module to perform audio output processing on the audio represented by the target analog signal, may include the following steps:
[0140] Step B42: In response to the second audio output module not being a module associated with the video processing device itself, based on the target analog signal, audio is transmitted to the second audio output module so as to perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
[0141] In this embodiment, when the second audio output module is not a module associated with the video processing device itself, that is, when the user terminal corresponding to the video processing device is not the video processing device itself, after the video processing device obtains the first audio data and the obtained target analog signal, it considers that the first audio data needs to be transmitted to the target analog camera for parsing and playback, and the second audio data corresponding to the target analog signal needs to be transmitted to the above-mentioned second audio output module for parsing and playback. Therefore, the video processing device performs predetermined processing on the obtained first audio data and the obtained second audio data corresponding to the target analog signal to obtain the processing result, and indicates the recipient of the obtained first audio data as the target analog camera, and in response to the second audio output module not being a module associated with the video processing device itself, indicates the recipient of the second audio data corresponding to the obtained target analog signal as the user terminal equipped with the second audio output module.
[0142] It should be noted that the above-mentioned module not associated with the video processing device itself refers to a module that the video processing device cannot directly call, that is, if the module is used for audio output, the video processing device needs to first transmit the audio data to the user terminal equipped with the module, and then call the module for audio output through the user terminal equipped with the module. Therefore, the case where the above-mentioned second audio output module is not a module associated with the video processing device itself can be understood as the user terminal corresponding to the video processing device is equipped with the second audio output module and is not the user terminal of the video processing device itself; wherein, the user terminal can be an electronic device such as a mobile phone or a computer, which is all reasonable.
[0143] In this way, the video processing device can determine the audio data of the target analog camera indicated by the above processing results and the corresponding recipient based on the above processing results, obtain the first audio data, and modulate the analog audio signal corresponding to the obtained first audio data to the field blanking area corresponding to the first video signal to obtain the target data signal.
[0144] Furthermore, in response to the second audio output module not being a module associated with the video processing device itself, based on the target analog signal, audio is transmitted to the second audio output module, so as to perform audio output processing on the audio represented by the target analog signal by calling the second audio output module. The above process can be understood as, when the user end corresponding to the video processing device is not the video processing device itself, based on the above processing result, determining the audio data of the user end corresponding to the video processing device indicated by the above processing result and corresponding to the receiving party, obtaining the second audio data, thereby transmitting audio to the user end, so that the user end calls the second audio output module for audio output processing.
[0145] For example, if the user terminal equipped with the second audio output module is a mobile phone, in response to the fact that the second audio output module is not a module associated with the video processing device itself, audio is transmitted to the mobile phone based on the target analog signal, so that the mobile phone calls the second audio output module to perform audio output processing on the audio represented by the target analog signal.
[0146] That is to say, when the second audio output module is not a module associated with the video processing device itself, the video processing device acts as a transit station in the entire audio transmission process, that is, after obtaining the first audio data and the target analog signal, the video processing device sends the first audio data to the target analog camera, and sends the target analog signal to the corresponding user end equipped with the second audio output module.
[0147] Optionally, in one implementation, the above step B1, performing predetermined processing on the acquired first audio data and the obtained second audio data corresponding to the target analog signal to obtain a processing result, may include the following steps:
[0148] Step C1: Generate multi-channel data and obtain processing results;
[0149] The data of the first designated channel in the multi-channel data is the acquired first audio data, and when the second audio output module is a module associated with the video processing device itself, the data of the second designated channel in the multi-channel data is the second audio data corresponding to the obtained target analog signal; when the second audio output module is not a module associated with the video processing device itself, the data of the second designated channel is predetermined data representing a null value;
[0150] The above step B2, determining the audio data of the target analog camera corresponding to the receiver indicated by the processing result, and obtaining the first audio data, may include the following steps:
[0151] Step C2: acquiring data of the first designated channel in the processing result to obtain first audio data;
[0152] The above step B41, determining the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, and obtaining the second audio data, may include the following steps:
[0153] Step C3: Acquire the data of the second designated channel in the processing result to obtain the second audio data.
[0154] In this implementation, when the second audio output module is a module associated with the video processing device itself, or is not a module associated with the video processing device itself, that is, when the user end corresponding to the video processing device is the video processing device itself, or is another electronic device, during the entire audio transmission process, there will always be two kinds of audio data in the video processing device, one is the first audio data that needs to be modulated, and the other is the second audio data transmitted to the second audio output module for playback. In order to facilitate subsequent processing by the video processing device, the video processing device can combine the two kinds of audio data to generate multi-channel data to obtain a processing result. Among them, in the above-mentioned multi-channel data, the data of the first designated channel is the acquired first audio data, and the data of the second designated channel is the second audio data corresponding to the obtained target analog signal.
[0155] In this way, when the video processing device processes audio data that needs to be modulated, it directly determines the data of the first designated channel of the processing result as the first audio data; correspondingly, when the video processing device processes audio data that needs to be played locally, that is, when the second audio output module is a module associated with the video processing device itself, it directly determines the data of the second designated channel of the processing result as the second audio data.
[0156] If the second audio output module is not a module associated with the video processing device itself, it indicates that the video processing device needs to transmit audio to the second audio output module based on the target analog signal, and at this time, the data of the second designated channel is the predetermined data indicating a null value. When the data of the second designated channel is the predetermined data, the video processing device does not need to process the data in the second designated channel.
[0157] Optionally, the multi-channel data may be dual-channel data, wherein the data of the left channel may be the first audio data, and the data of the right channel may be the second audio data. Correspondingly, the data of the left channel may also be the second audio data, and the data of the right channel may be the first audio data, which is reasonable.
[0158] Optionally, the video processing device transmits the first audio data and the second audio data according to a predetermined clock cycle to combine the first audio data and the second audio data into dual-channel data, that is, the first audio data and the second audio data are combined into dual-channel data through time division multiplexing, so that the video processing device can directly distinguish different audio data through the preset clock cycle.
[0159] For example, the audio data transmitted in the first preset clock cycle is set as the data transmitted by the left channel, and correspondingly, the audio data transmitted in the second preset clock cycle is set as the data transmitted by the right channel.
[0160] Among them, the above-mentioned predetermined clock period can be 0.5 period, or can be 1 period, 2 periods, etc., and this embodiment of the present application does not make any specific limitation on this.
[0161] For example, Fig. 9 The figure shows a waveform diagram of dual-channel audio data, which is a display interface diagram in an actual scene. The waveform on the higher left side of the figure is the first audio data, and the waveform on the lower right side of the figure is the second audio data. Each vertical line at the beginning of the waveform on this side represents the second audio data.
[0162] Corresponding to the above method embodiment, the embodiment of the present application also provides a video processing device. Fig.10 A schematic diagram of the structure of a video processing device provided in an embodiment of the present application is shown in FIG. Fig.10As shown, a video processing device provided in an embodiment of the present application includes a control unit 1001 and an analog-to-digital conversion unit 1002;
[0163] The control unit 1001 is used to obtain first audio data;
[0164] The first audio data is audio data acquired by calling the first audio acquisition module and using the target simulated camera as the playback end;
[0165] The analog-to-digital conversion unit 1002 is used to modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal;
[0166] Wherein, the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera;
[0167] The analog-to-digital conversion unit 1002 is further configured to send the target data signal to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking region of the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal;
[0168] The analog-to-digital conversion unit 1002 is further used for, in response to receiving a second video signal sent by the target analog camera, parsing an analog audio signal from a line blanking region of the second video signal to obtain a target analog signal, and sending the target analog signal to the control unit 1001; wherein, the second video signal is a video signal obtained by the target analog camera performing a modulation process on the target analog video signal to be sent to the video processing device; the modulation process is used to modulate the analog audio signal of the audio acquired in the acquisition scene of the target analog camera to the line blanking region of the target analog video signal;
[0169] The control unit 1001 is further configured to receive the target analog signal, and perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
[0170] In this embodiment, when there is a need to talk with the target analog camera side of the acquisition scene, that is, when the control unit 1001 of the video processing device obtains the first audio data of the audio obtained by calling the first audio acquisition module and using the target analog camera as the playback end, the analog-to-digital conversion unit 1002 of the video processing device can modulate the analog audio signal corresponding to the acquired first audio data to the field blanking area corresponding to the first video signal to obtain the target data signal; then, send the obtained target data signal to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal. At this point, the audio on the user side is sent to the analog camera side, meeting the call needs between the user side and the analog camera side.
[0171] Among them, the first audio acquisition module can be an acquisition module possessed by a device belonging to the user terminal corresponding to the video processing device. In this way, the user terminal corresponding to the video processing device can call the first audio acquisition module to collect the first audio data; the above-mentioned first audio acquisition module can also be an acquisition module that can be called by the above-mentioned user terminal through the network. In this way, the user terminal corresponding to the video processing device calls the first audio acquisition module through the network to collect the first audio data, which is all reasonable.
[0172] In addition, the target analog camera can also modulate the target analog video signal used to be sent to the analog-to-digital conversion unit 1002 of the video processing device, and modulate the analog audio signal of the audio collected within the collection scene of the target analog camera to the line blanking area of the target analog video signal to obtain a second video signal, and send the second video signal to the analog-to-digital conversion unit 1002.
[0173] The analog-to-digital conversion unit 1002 can also parse the analog audio signal from the line blanking area of the second video signal in response to receiving the second video signal, obtain the target analog signal, and send the target analog signal to the control unit 1001, so that the control unit 1001 can call the second audio output module to perform audio output processing on the audio represented by the received target analog signal. At this point, the audio on the analog camera side is sent to the user side to meet the call requirements between the analog camera side and the user side, thereby realizing two-way mutual transmission of audio between the user side and the analog camera side.
[0174] Based on this, by applying the solution provided in the embodiment of the present application, the analog-to-digital conversion unit of the video processing device modulates the analog audio signal corresponding to the audio data to be transmitted to the target analog camera into the field blanking area of the first video signal through signal modulation, so as to transmit the audio represented by the above analog audio signal to the target analog camera through the first video signal. In addition, the target analog camera modulates the analog audio signal corresponding to the audio data to be transmitted to the video processing device into the line blanking area of the second video signal through signal modulation, so as to transmit the audio represented by the analog audio signal through the above second video signal. It can be seen that through the solution of the present application, the audio on the user side and the audio on the analog camera side can be transmitted bidirectionally to each other to realize a call with the analog camera side.
[0175] Optionally, in one implementation,
[0176] The control unit 1001 is also used to perform predetermined processing on the acquired first audio data and the second audio data corresponding to the acquired target analog signal in response to the acquired first audio data and the obtained target analog signal to obtain a processing result; wherein the predetermined processing is used to indicate the recipient of the acquired first audio data as the target analog camera, and in response to the second audio output module being a module associated with the video processing device itself, indicate the recipient of the second audio data corresponding to the obtained target analog signal as the video processing device itself; wherein the second audio data corresponding to the target analog signal can be obtained after analog-to-digital conversion.
[0177] The analog-to-digital conversion unit 1002 modulates the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal, including:
[0178] Determine the audio data indicated by the processing result and corresponding to the target analog camera as the receiver, and obtain the first audio data;
[0179] Modulating the analog audio signal corresponding to the obtained first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal;
[0180] The analog-to-digital conversion unit 1002 is further configured to, in response to the second audio output module being a module associated with the video processing device itself, determine the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, obtain the second audio data, and call the second audio output module associated with the video processing device itself to perform audio output processing on the audio represented by the second audio data;
[0181] The control unit 1001 performs audio output processing on the audio represented by the target analog signal by calling the second audio output module, including:
[0182] In response to the second audio output module not being a module associated with the video processing device itself, audio is transmitted to the second audio output module based on the target analog signal, so as to perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
[0183] Optionally, in an implementation, the control unit 1001 performs predetermined processing on the acquired first audio data and the obtained second audio data corresponding to the target analog signal to obtain a processing result, including:
[0184] Generate multi-channel data and obtain a processing result; wherein the data of a first designated channel in the multi-channel data is the acquired first audio data, and when the second audio output module is a module associated with the video processing device itself, the data of a second designated channel in the multi-channel data is the second audio data corresponding to the acquired target analog signal; when the second audio output module is not a module associated with the video processing device itself, the data of the second designated channel is predetermined data representing a null value;
[0185] The analog-to-digital conversion unit 1002 determines the audio data indicated by the processing result and corresponding to the target analog camera as the receiving party, and obtains the first audio data, including:
[0186] Acquire data of a first specified channel in the processing result to obtain the first audio data;
[0187] The analog-to-digital conversion unit 1002 determines the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, and obtains the second audio data, including:
[0188] The data of the second designated channel in the processing result is obtained to obtain the second audio data.
[0189] Optionally, in an implementation, the analog-to-digital conversion unit 1002 modulates the analog audio signal corresponding to the first audio data to a field blanking region corresponding to the first video signal to obtain a target data signal, including:
[0190] Determining a first signal format of the first video signal;
[0191] The analog audio signal corresponding to the first audio data is modulated to a position corresponding to the first signal format in an idle position of a field blanking area corresponding to the first video signal; wherein different signal formats correspond to different positions in the idle positions.
[0192] Optionally, in one implementation, the idle position is: a position in the field blanking area excluding a position occupied by communication data of a predetermined communication protocol; wherein the predetermined communication protocol is a communication protocol between the video processing device and the target analog camera.
[0193] Optionally, in one implementation, the first video signal is an analog video signal sent by the target analog camera to the control unit 1001 of the video processing device and meets predetermined filtering conditions; wherein the predetermined filtering conditions include filtering conditions set based on signal reception time.
[0194] Corresponding to the above method embodiment, the present application embodiment also provides a data transmission system. Fig.11 As shown, a structural schematic diagram of a data transmission system provided in an embodiment of the present application is provided, wherein a data transmission system provided in an embodiment of the present application includes a video processing device 1101 and a target simulation camera 1102.
[0195] The video processing device 1101 is used to obtain first audio data; modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; send the target data signal to the target analog camera 1102; wherein the first audio data is audio data obtained by calling the first audio acquisition module and using the target analog camera 1102 as the playback end; the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera 1102;
[0196] The target analog camera 1102 is used to receive the target data signal; parse the analog audio signal from the field blanking area of the target data signal, and call the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal;
[0197] The target analog camera 1102 is further used to send a second video signal to the video processing device 1101; wherein the second video signal is a video signal obtained by the target analog camera 1102 performing a modulation process on the target analog video signal to be sent to the video processing device 1101; the modulation process is used to modulate the analog audio signal of the audio collected in the collection scene of the target analog camera 1102 to the line blanking area of the target analog video signal;
[0198] The video processing device 1101 is also used to receive the second video signal; parse the analog audio signal from the line blanking area of the second video signal to obtain a target analog signal; and perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
[0199] Based on this, the scheme provided by the embodiment of the present application is applied. When audio transmission is performed, the video processing device in the data transmission system modulates the signal of the analog audio signal corresponding to the audio data to be transmitted to the target analog camera, and modulates the above analog signal into the field blanking area of the first video signal, so as to transmit the audio represented by the above analog audio signal to the target analog camera through the first video signal. In addition, the target analog camera modulates the analog audio signal corresponding to the audio data to be transmitted to the video processing device into the line blanking area of the second video signal, so as to transmit the audio represented by the analog audio signal through the above second video signal. It can be seen that through the scheme of the present application, the audio on the user side and the audio on the analog camera side can be transmitted bidirectionally to each other, so as to realize a call with the analog camera side.
[0200] Optionally, in one implementation,
[0201] The video processing device 1101 is further used to perform predetermined processing on the first audio data obtained and the second audio data corresponding to the target analog signal obtained in response to the first audio data obtained and the target analog signal obtained to obtain a processing result; wherein the predetermined processing is used to indicate the recipient of the first audio data obtained as the target analog camera 1102, and in response to the second audio output module being a module associated with the video processing device 1101 itself, indicate the recipient of the second audio data corresponding to the target analog signal obtained as the video processing device 1101 itself;
[0202] The video processing device 1101 modulates the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal, including:
[0203] Determine the audio data indicated by the processing result and corresponding to the target analog camera 1102, and obtain the first audio data; modulate the analog audio signal corresponding to the obtained first audio data to the field blanking area corresponding to the first video signal, and obtain the target data signal;
[0204] The video processing device 1101 performs audio output processing on the audio represented by the target analog signal by calling the second audio output module, including:
[0205] In response to the second audio output module being a module associated with the video processing device itself 1101, determine that the audio data indicated by the processing result and the corresponding recipient is the video processing device 1101 itself, obtain the second audio data, and call the second audio output module associated with the video processing device 1101 itself to perform audio output processing on the audio represented by the second audio data; or, in response to the second audio output module not being a module associated with the video processing device itself 1101, based on the target analog signal, perform audio transmission to the second audio output module, so as to perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
[0206] Optionally, in one implementation,
[0207] The video processing device 1101 performs predetermined processing on the acquired first audio data and the obtained second audio data corresponding to the target analog signal to obtain a processing result, including:
[0208] Generate multi-channel data and obtain a processing result; wherein the data of a first designated channel in the multi-channel data is the acquired first audio data, and when the second audio output module is a module associated with the video processing device 1101 itself, the data of a second designated channel in the multi-channel data is the second audio data corresponding to the obtained target analog signal; when the second audio output module is not a module associated with the video processing device 1101 itself, the data of the second designated channel is predetermined data representing a null value;
[0209] The video processing device 1101 determines the audio data indicated by the processing result and corresponding to the target analog camera 1102 as the receiving party, and obtains the first audio data, including:
[0210] Acquire data of a first specified channel in the processing result to obtain the first audio data;
[0211] The video processing device 1101 determines the audio data indicated by the processing result and corresponding to the receiving party being the video processing device 1101 itself, and obtains the second audio data, including:
[0212] The data of the second designated channel in the processing result is obtained to obtain the second audio data.
[0213] Optionally, in an implementation, the video processing device 1101 modulates the analog audio signal corresponding to the first audio data to a field blanking region corresponding to the first video signal to obtain a target data signal, including:
[0214] Determining a first signal format of the first video signal;
[0215] The analog audio signal corresponding to the first audio data is modulated to a position corresponding to the first signal format in an idle position of a field blanking area corresponding to the first video signal; wherein different signal formats correspond to different positions in the idle positions.
[0216] Optionally, in one implementation, the idle position is: a position in the field blanking area excluding a position occupied by communication data of a predetermined communication protocol; wherein the predetermined communication protocol is a communication protocol between the video processing device 1101 and the target analog camera 1102 .
[0217] Optionally, in one implementation, the first video signal is an analog video signal sent by the target analog camera 1102 to the video processing device 1101 and meets a predetermined filtering condition; wherein the predetermined filtering condition includes a filtering condition set based on a signal reception time.
[0218] The solution provided in the above-mentioned embodiment of the present application is exemplarily introduced below in conjunction with specific embodiments.
[0219] Fig.12 A schematic diagram of the structure of another data transmission system provided in an embodiment of the present application. Fig.12 The camera in is the target simulation camera provided in the embodiment of the present application, the DVR is the video processing device provided in the embodiment of the present application, and the remote end is the user end corresponding to the video processing device provided in the embodiment of the present application.
[0220] The camera and the DVR are connected via a coaxial cable for data transmission, and the DVR and the remote end are connected via a network cable (network). The network cable can be called a return link.
[0221] Fig.13 A structural schematic diagram of a hard disk video recorder provided in an embodiment of the present application. Fig.13 The analog-to-digital converter AD in the embodiment of the present application is the analog-to-digital conversion unit, and the system-level processor is the control unit in the embodiment of the present application. Among them, the role of AD is analog-to-digital conversion, which is convenient for the subsequent processor processing in the DVR. Generally, the DVR can connect the camera via a coaxial line to receive the audio and video data of the camera, and the received audio and video data can be stored, played or remotely transmitted to a computer or mobile phone.
[0222] After the camera collects the audio and video signals, it can modulate the audio into the line blanking area of the video signal and transmit it to the AD at the DVR end through the coaxial cable. The AD obtains the audio data by sampling the specific position (line blanking area) of the video signal. After receiving the audio data obtained by the AD, the system-level processor of the DVR performs audio encoding on the audio data and transmits it to the remote end, such as a computer or a personal mobile phone, through the network. Thus, after the computer or mobile phone decodes the received audio data, it outputs it through the corresponding speaker, so that the user at the remote end can hear the intercom sound at the camera end. Among them, the audio data transmitted from the camera to the remote end is the second audio data in the embodiment of the present application.
[0223] In addition, a computer or mobile phone can be used as an intercom input source to record sound, and after encoding, it can be transmitted to the DVR through the network; after the DVR decodes and obtains the audio data, the AD can modulate the audio data into the field blanking area of the video signal, and transmit it to the camera end through the coaxial cable, so that the camera end can parse and output the parsed audio data through the speaker. In this way, the user on the camera side can also hear the intercom sound at the far end. Among them, the audio data transmitted from the far end to the camera is the first audio data in the embodiment of the present application. In addition, a microphone can also be connected to the DVR, so the DVR itself can also be used as an intercom input source, that is, the camera end can intercom with the DVR.
[0224] The following describes the specific processes of audio transmission between an analog camera and a remote end, and between a remote end and an analog camera.
[0225] 1. The audio transmission process between the analog camera and the remote end is as follows: the DVR receives the intercom sound sent by the analog camera, namely the coaxial audio (second audio data). The coaxial audio is transmitted to the AD of the DVR through the coaxial line, and then sent to the processor of the DVR through the I2S bus, and then sent to the remote end by the processor of the DVR. Specifically including:
[0226] The analog camera can get the video signal by modulating the video data onto the analog signal. If the analog camera is a coaxial audio camera, the analog camera can modulate the coaxial audio onto the video signal. That is, the coaxial audio is inserted into the line blanking area. In this way, the AD can obtain the audio signal transmitted by the coaxial line by sampling the data at a specific position (line blanking area) of the coaxial line, and send it to the DVR through the I2S bus to achieve sound access. In this way, the DVR side can hear the intercom sound on the analog camera side.
[0227] Among them, after AD collects the coaxial audio, it transmits it to the processor of the DVR device through the I2S bus, and the processor of the DVR device receives it. If it is a large-number cascaded device, the master / slave processor is also required to exchange data through the PCIE bus (PCI-Express, peripheral component interconnect express, a high-speed serial computer expansion bus standard) to send the coaxial audio received from the processor to the main processor. After receiving it, the main processor performs G711 encoding (an audio encoding method developed by the International Telecommunication Union (ITU-T), also known as ITU-TG.711), and transmits it to the remote computer or mobile phone through the network, so that the remote computer or mobile phone can decode and output it.
[0228] 2. The audio transmission process between the remote end and the analog camera is as follows: the DVR processor decodes the uplink audio (first audio data) and sends it to the DVR's AD through the I2S bus. Then, the DVR's AD modulates the uplink audio into the field blanking area of the video signal, and then transmits it to the analog camera through the coaxial cable. The analog camera's AD then parses it, and the analog camera can hear the intercom sound from the remote computer or mobile phone.
[0229] Since the transmission between the DVR and the analog camera is through the coaxial line, the upstream audio transmitted by the remote end is additional audio data for the coaxial line. Therefore, in order to transmit additional audio data on the coaxial line without affecting the coaxial audio, the upstream audio can be inserted into the field blanking area of a frame of video signal in the form of insertion code. Since the positions of signals of different signal formats in the field blanking area of the video signal are different, when AD modulates the upstream audio into the field blanking area of the video signal, it can modulate the upstream audio to the corresponding position of the field blanking area according to the signal format of the video signal.
[0230] Considering that the audio transmission between the DVR and the analog camera can only be performed if the analog camera complies with the coaxial communication protocol information, that is, only when the analog camera supports the above coaxial communication protocol information can the analog camera complete the reception and processing of the signal sent by the DVR.
[0231] Among them, the above-mentioned coaxial communication protocol information is also modulated into the field blanking area of the video signal by means of coaxial insertion. Specifically: the analog camera inserts the coaxial communication protocol information into the blanking area of the video signal, and transmits it to the AD of the DVR through the coaxial line. After the AD samples at a specific position (row blanking area), it transmits the protocol information to the processor of the DVR, so that the DVR and the analog camera complete the communication according to the coaxial communication protocol information. When the DVR sends the coaxial communication protocol information to the analog camera, it modulates the protocol information into the field blanking area of the video signal through the AD, and transmits it to the analog camera through the coaxial line. In this way, through the above process for the coaxial communication protocol information, the DVR and the analog camera communicate according to the protocol.
[0232] In addition, when performing audio transmission, the DVR sends a request for intercom information to the analog camera. If the feedback information from the analog camera indicates that the analog camera can complete the reception and processing of the signal sent by the DVR, the DVR continues to execute an audio transmission method provided in an embodiment of the present application.
[0233] In this embodiment, by inserting the uplink audio into the field blanking area of the video signal and inserting the coaxial audio into the line blanking area of the video signal for audio transmission, the two types of audio data to be transmitted will not interfere with each other, so as to improve the stability of the transmitted audio data; and, by collecting coaxial audio and sending uplink audio, the DVR can send the coaxial audio sent by the analog camera to the remote device, and send the uplink audio sent by the remote end to the analog camera, thereby achieving the purpose of the remote device and the analog camera speaking in the corresponding collection scene, filling the gap of intercom between the remote device and the analog camera during audio transmission.
[0234] Since the DVR itself can also be used as an intercom input source, that is, the above-mentioned remote device, that is, the camera end can intercom with the DVR. At this time, in the intercom process between the analog camera and the DVR, the AD of the DVR must not only send the intercom sound to the analog camera, but also output the sound of the analog camera locally. At this time, the processor can combine the two types of audio data into two-channel data and send them together to the AD of the DVR, where the left channel data is the intercom sound to be sent to the analog camera, and the right channel data is the sound to be output locally. In this way, after receiving the two-channel data, the AD can send the left channel data as the intercom sound to the analog camera, and send the right channel data as the device output data to the device audio output port of the DVR.
[0235] For example, Fig.14 FIG. 1 is a schematic diagram of a dual-channel data transmission provided in an embodiment of the present application. Wherein, I2S is the I2S bus in the embodiment of the present application.
[0236] In this embodiment, when the remote device is the DVR itself, two different audio data, namely the intercom sound to be sent to the analog camera and the sound of the analog camera output locally, are uploaded through dual-channel audio transmission, thereby achieving simultaneous transmission of audio upload and local output to improve the efficiency of audio transmission.
[0237] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application are included in the protection scope of the present application.
Claims
1. An audio transmission method, characterized in that: Applied to a video processing device, the method comprises: Acquire first audio data; wherein the first audio data is audio data acquired by calling a first audio acquisition module and using a target simulated camera as a playback end; Modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; wherein the first video signal is an analog video signal sent by the target analog camera to the video processing device and the first video signal serves as a carrier signal corresponding to the target analog camera; Sending the target data signal to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calling the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal; In response to receiving a second video signal sent by the target analog camera, an analog audio signal is parsed from a line blanking region of the second video signal to obtain a target analog signal; wherein the second video signal is a video signal obtained by the target analog camera performing a modulation process on the target analog video signal to be sent to the video processing device; the modulation process is used to modulate the analog audio signal of the audio acquired within the acquisition scene of the target analog camera to the line blanking region of the target analog video signal; Calling a second audio output module to perform audio output processing on the audio represented by the target analog signal; Wherein, the method further comprises: In response to acquiring the first audio data and the obtained target analog signal, performing predetermined processing on the acquired first audio data and the second audio data corresponding to the obtained target analog signal to obtain a processing result; wherein the predetermined processing is used to indicate the recipient of the acquired first audio data as the target analog camera, and in response to the second audio output module being a module associated with the video processing device itself, indicating the recipient of the second audio data corresponding to the obtained target analog signal as the video processing device itself; Modulating the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal includes: Determine the audio data indicated by the processing result and corresponding to the target analog camera as the receiver, and obtain the first audio data; Modulating the analog audio signal corresponding to the obtained first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; The step of calling the second audio output module to perform audio output processing on the audio represented by the target analog signal includes: In response to the fact that the second audio output module is a module associated with the video processing device itself, the audio data indicated by the processing result and the corresponding recipient of which is the video processing device itself is determined to obtain the second audio data; and the second audio output module associated with the video processing device itself is called to perform audio output processing on the audio represented by the second audio data.
2. The method according to claim 1, characterized in that: The step of modulating the analog audio signal corresponding to the first audio data to the field blanking region corresponding to the first video signal to obtain the target data signal includes: Determining a first signal format of the first video signal; The analog audio signal corresponding to the first audio data is modulated to a position corresponding to the first signal format in an idle position of a field blanking area corresponding to the first video signal; wherein different signal formats correspond to different positions in the idle positions.
3. The method according to claim 2, characterized in that The idle position is: a position in the field blanking area except a position occupied by communication data of a predetermined communication protocol; wherein the predetermined communication protocol is a communication protocol between the video processing device and the target analog camera.
4. The method according to claim 1, characterized in that: The first video signal is an analog video signal sent by the target analog camera to the video processing device and meets a predetermined filtering condition; wherein the predetermined filtering condition includes a filtering condition set based on a signal receiving time.
5. The method according to claim 1, characterized in that The first audio data is specifically audio data of the audio with the target simulated camera as the playback end, obtained by calling the first audio acquisition module to acquire the audio in response to the intercom instruction triggered by the target intercom operation, which is generated by the user end corresponding to the video processing device; the target intercom operation is an operation issued in the user end to instruct to conduct an intercom on the acquisition scene of the target simulated camera; The second video signal is specifically a video signal obtained by the target analog camera performing modulation processing on the target analog video signal to be sent to the video processing device in response to the intercom instruction triggered by the target intercom operation.
6. The method according to claim 1, characterized in that When the second audio output module is not a module associated with the video processing device itself, calling the second audio output module to perform audio output processing on the audio represented by the target analog signal includes: In response to the second audio output module not being a module associated with the video processing device itself, audio is transmitted to the second audio output module based on the target analog signal, so as to perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
7. The method according to claim 6, characterized in that The step of performing predetermined processing on the acquired first audio data and the obtained second audio data corresponding to the target analog signal to obtain a processing result includes: Generate multi-channel data and obtain a processing result; wherein the data of a first designated channel in the multi-channel data is the acquired first audio data, and when the second audio output module is a module associated with the video processing device itself, the data of a second designated channel in the multi-channel data is the second audio data corresponding to the acquired target analog signal; when the second audio output module is not a module associated with the video processing device itself, the data of the second designated channel is predetermined data representing a null value; The step of determining the audio data indicated by the processing result and corresponding to the target analog camera as the receiver to obtain the first audio data includes: Acquire data of a first specified channel in the processing result to obtain the first audio data; The step of determining the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, and obtaining the second audio data comprises: The data of the second designated channel in the processing result is obtained to obtain the second audio data.
8. A video processing device, characterized in that: include: A control unit and an analog-to-digital conversion unit; The control unit is used to obtain first audio data; wherein the first audio data is audio data acquired by calling the first audio acquisition module and using the target simulated camera as the playback end; The analog-to-digital conversion unit is used to modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; wherein the first video signal is an analog video signal sent by the target analog camera to the video processing device and the first video signal serves as a carrier signal corresponding to the target analog camera; The analog-to-digital conversion unit is further used to send the target data signal to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal; The analog-to-digital conversion unit is further used for, in response to receiving a second video signal sent by the target analog camera, parsing an analog audio signal from a line blanking region of the second video signal to obtain a target analog signal, and sending the target analog signal to the control unit; wherein the second video signal is a video signal obtained by the target analog camera performing a modulation process on the target analog video signal to be sent to the video processing device; the modulation process is used to modulate the analog audio signal of the audio acquired in the acquisition scene of the target analog camera to the line blanking region of the target analog video signal; The control unit is further configured to receive the target analog signal and perform audio output processing on the audio represented by the target analog signal by calling the second audio output module; The control unit is further used to, in response to the acquisition of the first audio data and the obtained target analog signal, perform predetermined processing on the acquired first audio data and the second audio data corresponding to the obtained target analog signal to obtain a processing result; wherein the predetermined processing is used to indicate the recipient of the acquired first audio data as the target analog camera, and in response to the second audio output module being a module associated with the video processing device itself, indicate the recipient of the second audio data corresponding to the obtained target analog signal as the video processing device itself; The analog-to-digital conversion unit modulates the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal, including: Determine the audio data indicated by the processing result and corresponding to the target analog camera as the receiver, and obtain the first audio data; Modulating the analog audio signal corresponding to the obtained first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; The analog-to-digital conversion unit is also used to determine, in response to the second audio output module being a module associated with the video processing device itself, the audio data indicated by the processing result and corresponding to the recipient being the video processing device itself, obtain the second audio data, and call the second audio output module associated with the video processing device itself to perform audio output processing on the audio represented by the second audio data.
9. The video processing device according to claim 8, characterized in that: The control unit is also used to, when the second audio output module is not a module associated with the video processing device itself, in response to the second audio output module not being a module associated with the video processing device itself, transmit audio to the second audio output module based on the target analog signal, so as to perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
10. The video processing device according to claim 9, characterized in that: The control unit performs predetermined processing on the acquired first audio data and the obtained second audio data corresponding to the target analog signal to obtain a processing result, including: Generate multi-channel data and obtain a processing result; wherein the data of a first designated channel in the multi-channel data is the acquired first audio data, and when the second audio output module is a module associated with the video processing device itself, the data of a second designated channel in the multi-channel data is the second audio data corresponding to the acquired target analog signal; when the second audio output module is not a module associated with the video processing device itself, the data of the second designated channel is predetermined data representing a null value; The analog-to-digital conversion unit determines the audio data indicated by the processing result and corresponding to the target analog camera as the receiving party, and obtains the first audio data, including: Acquire data of a first specified channel in the processing result to obtain the first audio data; The analog-to-digital conversion unit determines the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, and obtains the second audio data, including: The data of the second designated channel in the processing result is obtained to obtain the second audio data.
11. A data transmission system, characterized in that: The data transmission system comprises: a video processing device and a target simulation camera; The video processing device is used to obtain first audio data; modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; send the target data signal to the target analog camera; wherein the first audio data is audio data obtained by calling the first audio acquisition module and using the target analog camera as the playback end; the first video signal is an analog video signal sent by the target analog camera to the video processing device and the first video signal serves as a carrier signal corresponding to the target analog camera; The target analog camera is used to receive the target data signal; parse the analog audio signal from the field blanking area of the target data signal, and call the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal; The target analog camera is further used to send a second video signal to the video processing device; wherein the second video signal is a video signal obtained by the target analog camera performing a modulation process on the target analog video signal to be sent to the video processing device; the modulation process is used to modulate the analog audio signal of the audio collected in the collection scene of the target analog camera to the line blanking area of the target analog video signal; The video processing device is further used to receive the second video signal; parse the analog audio signal from the line blanking area of the second video signal to obtain a target analog signal; and perform audio output processing on the audio represented by the target analog signal by calling the second audio output module; The video processing device is further used to, in response to the acquisition of the first audio data and the obtained target analog signal, perform predetermined processing on the acquired first audio data and the second audio data corresponding to the obtained target analog signal to obtain a processing result; wherein the predetermined processing is used to indicate the recipient of the acquired first audio data as the target analog camera, and in response to the second audio output module being the module associated with the video processing device itself, indicate the recipient of the second audio data corresponding to the obtained target analog signal as the video processing device itself; The video processing device modulates the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal, including: Determine the audio data indicated by the processing result and corresponding to the target analog camera as the receiver, and obtain the first audio data; Modulating the analog audio signal corresponding to the obtained first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; The step of calling the second audio output module to perform audio output processing on the audio represented by the target analog signal includes: In response to the fact that the second audio output module is a module associated with the video processing device itself, it is determined that the audio data indicated by the processing result and the corresponding recipient is the video processing device itself, the second audio data is obtained, and the second audio output module associated with the video processing device itself is called to perform audio output processing on the audio represented by the second audio data.
12. The data transmission system according to claim 11, characterized in that: The video processing device is also used to, when the second audio output module is not a module associated with the video processing device itself, in response to the second audio output module not being a module associated with the video processing device itself, transmit audio to the second audio output module based on the target analog signal, so as to perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.
13. The data transmission system according to claim 12, characterized in that: The video processing device performs predetermined processing on the acquired first audio data and the obtained second audio data corresponding to the target analog signal to obtain a processing result, including: Generate multi-channel data and obtain a processing result; wherein the data of a first designated channel in the multi-channel data is the acquired first audio data, and when the second audio output module is a module associated with the video processing device itself, the data of a second designated channel in the multi-channel data is the second audio data corresponding to the acquired target analog signal; when the second audio output module is not a module associated with the video processing device itself, the data of the second designated channel is predetermined data representing a null value; The video processing device determines the audio data indicated by the processing result and corresponding to the target analog camera as the receiver, and obtains the first audio data, including: Acquire data of a first specified channel in the processing result to obtain the first audio data; The video processing device determines the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, and obtains the second audio data, including: The data of the second designated channel in the processing result is obtained to obtain the second audio data.
Citation Information
Patent Citations
Audio data transmission method, device, system and equipment
CN111836004A
Hard disk video recorder and coaxial audio data detection method
CN113691755A
Audio interaction method and device
CN114584717A