Audio and video signal processing method and device and electronic equipment

Abstract

The invention is suitable for the technical field of LED display screens, and provides an audio and video signal processing method and device and electronic equipment, and the method comprises the steps: obtaining a target audio signal and a target video signal; obtaining an immersive audio bit stream IAB of the audio data block according to the target audio signal; performing rendering processing on the audio data block IAB to obtain PCM audio data corresponding to the sound production device; pCM audio data corresponding to the sound production device are written into a memory; mapping a pixel value corresponding to the target video signal into a relative brightness digital value corresponding to the LED display screen according to a preset gamma table and the video field synchronization signal; writing the relative brightness digital value corresponding to the LED display screen into a memory; reading PCM audio data corresponding to the sound production device from the memory, and sending the PCM audio data to the sound production device; and reading the relative brightness digital value corresponding to the LED display screen from the memory, and sending the relative brightness digital value to the LED display screen through the receiving card. Through the method, the wiring complexity can be reduced.

Description

Technical Field

[0001] This application belongs to the field of LED display technology, and particularly relates to audio and video signal processing methods, devices, electronic devices, computer-readable storage media, and computer program products. Background Technology

[0002] LED cinema screens are movie projection screens made using light-emitting diode (LED) technology, primarily used in cinema projection systems. The audio and video control system of this LED cinema screen employs a separate processing method for audio and video signals, which increases the number of audio devices in the control room and the complexity of their connections.

[0003] Figure 1 A schematic diagram illustrating a process for processing audio and video signals separately is shown. Figure 1 In this system, the video signal output from the cinema server enters the Integrated Board (IB), where it is processed and sent to the receiver card string (which is obtained by cascading receiver cards). The signal is then output to the LED display screen. Meanwhile, the audio signal output from the cinema server is processed by the audio processor, then output to the power amplifier, and finally to the speakers.

[0004] Because cinemas have a large number of speakers, especially those required for immersive scenes (potentially over 40 speakers), and a large number of speaker cables, the audio-visual control system for the cinema's LED display screen requires... Figure 1 When audio and video signals are processed separately, the number of audio devices in the computer room and the complexity of their connections will increase, thereby increasing the construction complexity of the cinema. Summary of the Invention

[0005] This application provides audio and video signal processing methods, apparatus, and electronic devices, which can solve the problem of complex and high construction complexity in existing cinemas.

[0006] In a first aspect, embodiments of this application provide an audio / video signal processing method applied to an interface board, comprising:

[0007] Acquire a target audio signal and a target video signal, wherein the target audio signal is an audio signal including an audio field synchronization signal, and the target video signal is a video signal including a video field synchronization signal;

[0008] The target audio signal is analyzed to obtain the audio encoded signal and the audio field synchronization signal;

[0009] decoding the audio coded signal according to the audio field synchronization signal to obtain an audio data block immersive audio bitstream IAB;

[0010] rendering processing the audio data block IAB to obtain the corresponding PCM audio data of the sound emitting device;

[0011] writing the corresponding PCM audio data of the sound emitting device into the memory;

[0012] mapping the pixel value corresponding to the target video signal into the relative luminance digital value corresponding to the LED display screen according to a preset gamma table and the video field synchronization signal;

[0013] writing the relative luminance digital value corresponding to the LED display screen into the memory;

[0014] reading the corresponding PCM audio data of the sound emitting device from the memory and sending to the sound emitting device;

[0015] reading the relative luminance digital value corresponding to the LED display screen from the memory and sending to the LED display screen through a receiving card.

[0016] Compared with the prior art, the embodiment of the present application has the beneficial effects that:

[0017] In the embodiment of the present application, after the interface board obtains the target audio signal and the target video signal, the target audio signal and the target video signal are processed respectively. Specifically, the target audio signal is analyzed to obtain an audio coded signal and an audio field synchronization signal, the audio coded signal is decoded according to the audio field synchronization signal to obtain an audio data block IAB, the audio data block IAB is rendered to obtain the corresponding PCM audio data of the sound emitting device, and finally the corresponding PCM audio data of the sound emitting device is written into the memory, and the PCM audio data is read from the memory and sent to the corresponding sound emitting device. Since the interface board can process the target audio signal and the target video signal at the same time, it is not necessary to access an audio processor, thereby reducing the construction complexity and cost of the playing site (such as a cinema). At the same time, since the PCM audio data corresponding to the sound emitting device is determined by rendering the audio data block IAB, different sound emitting devices have corresponding PCM audio data, and when each sound emitting device has corresponding PCM audio data, it is beneficial to improve the auditory experience of the user. In addition, since the audio data block IAB is decoded according to the audio field synchronization signal, and the audio field synchronization signal and the video field synchronization signal are used to synchronize the sound and the picture, when the subsequent sound emitting device plays the corresponding PCM audio data and the LED display screen displays the corresponding picture according to the relative luminance digital value determined by the video field synchronization signal, it is also beneficial to improve the immersive experience of the user.

[0018] In a second aspect, the embodiments of the present application provide an audio and video signal processing device applied to an interface board, comprising:

[0019] a target audio signal acquisition module, configured to acquire a target audio signal and a target video signal, the target audio signal being an audio signal comprising an audio field synchronization signal, and the target video signal being a video signal comprising a video field synchronization signal;

[0020] a target audio signal analysis module, configured to analyze the target audio signal to obtain an audio encoding signal and an audio field synchronization signal;

[0021] an audio encoding signal decoding module, configured to decode the audio encoding signal according to the audio field synchronization signal to obtain an audio data block immersive audio bitstream IAB;

[0022] a rendering module, configured to perform rendering processing on the audio data block IAB to obtain PCM audio data corresponding to a sound emitting device;

[0023] a PCM audio data storage module, configured to write the PCM audio data corresponding to the sound emitting device into a memory;

[0024] a gamma table lookup module, configured to map pixel values corresponding to the target video signal into relative luminance digital values corresponding to an LED display screen according to a preset gamma table and the video field synchronization signal;

[0025] a relative luminance digital value storage module, configured to write the relative luminance digital values corresponding to the LED display screen into the memory;

[0026] a PCM audio data sending module, configured to read the PCM audio data corresponding to the sound emitting device from the memory and send the PCM audio data to the sound emitting device;

[0027] a relative luminance digital value sending module, configured to read the relative luminance digital values corresponding to the LED display screen from the memory and send the relative luminance digital values to the LED display screen through a receiving card.

[0028] In a third aspect, the embodiments of the present application provide an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor executes the computer program to implement the method in the first aspect.

[0029] In a fourth aspect, the embodiments of the present application provide a computer readable storage medium, and the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the method in the first aspect.

[0030] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when running on an electronic device, causes the electronic device to perform the method of the first aspect.

[0031] It can be understood that the beneficial effects of the second aspect to the fifth aspect can be referred to the related description in the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows.

[0033] Figure 1 is a flowchart of a prior art process of separately processing audio and video signals;

[0034] Figure 2 is a flowchart of an audio and video signal processing method provided by an embodiment of the present application;

[0035] Figure 3 is a semantic diagram of a sound bed and an object provided by an embodiment of the present application;

[0036] Figure 4 is a framework diagram of a rendering process of an audio data block IAB provided by an embodiment of the present application;

[0037] Figure 5 is a distribution diagram of a first sound emitting device in a cinema provided by another embodiment of the present application;

[0038] Figure 6 is an architecture diagram of an audio and video integrated processing scheme provided by an embodiment of the present application;

[0039] Figure 7 is a flowchart of another audio and video signal processing method provided by another embodiment of the present application;

[0040] Figure 8 is a structural block diagram of an audio and video signal processing device provided by an embodiment of the present application;

[0041] Figure 9 is a structural diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0042] In the following description, for purposes of explanation and not limitation, specific details are set forth such as particular architectures, technologies, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application can be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

[0043] It is to be understood that the terminology "includes", "has", "holds", "contains" and / or "comprising", when used in this specification and in the following claims, indicates the presence of the described features, integers, steps, operations, elements, and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0044] It is also to be understood that the terminology "and / or" when used in this specification and in the following claims, refers to at least one of the items, or any combination of the items, and includes all possible combinations when used in the description of the application.

[0045] In addition, in the description of the application and in the following claims, the terms "first", "second", etc. are used only for distinguishing between similar elements and do not imply a relative importance.

[0046] The description of the application uses the term "one embodiment" or "some embodiments" etc. to mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. The appearances of the phrases "in one embodiment" or "in some embodiments" in various places in the specification are not necessarily all referring to the same embodiment, although it can be. Furthermore, the terms "comprises", "comprising", "has", "having", "includes", "including", "contains", "containing" or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises, has, includes, contains a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus.

[0047] Currently, a cinema usually places several sound speakers at different positions in a playing hall to make the audience have an immersive experience through the sound played by different sound speakers. However, since each sound speaker needs to be arranged with an independent audio line and power line, the more the number of sound speakers, the greater the wiring length, the volume of the wire pipe, the number of bridge frames, and the workload of later maintenance, thereby greatly increasing the construction complexity and cost of the cinema.

[0048] In order to reduce the construction complexity and cost of the cinema, an audio and video signal processing method is provided in the embodiments of the present application. In the audio and video signal processing method, the audio signal and the video signal are processed through an interface board, and then the processed audio signal and the processed video signal are output.

[0049] The audio and video signal processing method provided by the embodiments of the present application is described below in conjunction with the accompanying drawings.

[0050] Figure 2 A flowchart of an audio and video signal processing method provided by an embodiment of the present application is shown, which is applied to an interface board, and is described in detail as follows.

[0051] S21, obtaining a target audio signal and a target video signal, the target audio signal being an audio signal including an audio field synchronization signal, and the target video signal being a video signal including a video field synchronization signal.

[0052] The video field synchronization signal is used to indicate a flyback of a new picture, and the audio field synchronization signal is used to align an audio sampling clock with a video field frequency, so as to ensure that a picture and sound are always synchronized.

[0053] In the embodiment of the present application, the interface board can communicate with a server of a cinema. The audio and video signals stored in the server of the cinema are usually audio and video information played in the cinema. In order to synchronize the picture and sound of the played audio and video information, the audio and video signals stored in the server of the cinema usually include an audio field synchronization signal and a video field synchronization signal.

[0054] In the embodiment of the present application, after the interface board obtains the target audio signal and the target video signal from the server of the cinema, the target audio signal and the target video signal can be processed subsequently, that is, the target video signal is processed and the target audio signal is processed through the same interface board.

[0055] S22, analyzing the target audio signal to obtain an audio encoding signal and an audio field synchronization signal.

[0056] Specifically, a time marker in the target audio signal can be found first, and a stable clock pulse can be determined according to the found time marker to obtain the audio field synchronization signal, and then the remaining audio data of the target audio signal can be unpacked into a playable compressed stream to obtain the audio encoding signal.

[0057] S23, decoding the audio encoding signal according to the audio field synchronization signal to obtain an audio data block immersive audio bitstream (IAB).

[0058] In the embodiment of the present application, according to the audio field synchronization signal, an identification code used to mark a starting position of an immersive audio bitstream frame is found in the audio encoding signal, and data of a preset length (such as 1024 bytes) after the identification code is taken as a complete audio data block IAB of a frame. When all the audio data blocks IAB of the audio encoding signal are found, it indicates that the decoding of the audio encoding signal is completed.

[0059] S24, performing rendering processing on the audio data block IAB to obtain pulse code modulation (PCM) audio data corresponding to the sound emitting device.

[0060] In the embodiments of the present application, the sound emitting device refers to a device capable of converting an electrical signal into an acoustic signal, which includes a digital-to-analog (DA) module, a power amplifier and a loudspeaker. Of course, the sound emitting device can also include a cabinet and the like, which is not limited here.

[0061] In the embodiments of the present application, the interface board can perform rendering processing on the audio data block IAB through a built-in renderer. In the rendering process, the position of each sound emitting device in a playing site (such as a cinema) can be combined to make the rendered PCM audio data related to the position of the sound emitting device, thereby improving the audio-visual experience of users in the playing site. When the position of the sound emitting device is combined for rendering, the step S24 of performing rendering processing on the audio data block IAB to obtain pulse code modulation audio data corresponding to the sound emitting device includes:

[0062] A1, obtaining the position of each sound emitting device in the playing site.

[0063] In the embodiments of the present application, the position of the sound emitting device can be represented by three-dimensional coordinate information. The sound emitting device can be installed behind or around the LED display screen, of course, it can also be arranged on the wall of the playing site, which is not limited here.

[0064] In the embodiments of the present application, a coordinate system can be established at one position of the playing site after the arrangement of each sound emitting device is completed, and the position of each sound emitting device can be determined according to the coordinate system. Of course, if the sound emitting devices of the playing site have changed, the interface board needs to reacquire the position of the changed sound emitting device, such as deleting the position of the invalid sound emitting device, and for example, adding the position of the newly added sound emitting device, and the like.

[0065] A2, performing rendering processing on the audio data block IAB according to the position of each sound emitting device to obtain PCM audio data corresponding to the sound emitting device.

[0066] In the embodiments of the present application, the actual position of the sound emitting device in the playing site determines the time difference, intensity difference and frequency spectrum difference of the sound wave reaching the human ear. Therefore, the audio data block IAB is rendered according to the position of each sound emitting device, which means that the renderer considers these physical differences in the rendering process. After considering these physical differences, the gain and delay of the rendered PCM audio data are consistent with the actual position of the sound emitting device, and the PCM audio data consistent with the actual position of the sound emitting device can restore the correct spatial illusion in the listener's brain. For example, when the plane in the picture is from the left rear upper side, the sound is also from the left rear upper side, and the listener's brain has a more immersive feeling.

[0067] Specifically, when the playing site has multiple sound emitting devices, the following is performed for each sound emitting device:

[0068] According to the preset mapping relationship between the sound emitting device and the sound channel and the position of the sound emitting device, the sound bed of the audio data block IAB including the sound channel is rendered to obtain first rendering data corresponding to the sound bed and the sound emitting device; the object of the audio data block IAB is rendered according to the position of the sound emitting device to obtain second rendering data corresponding to the sound emitting device; and the PCM audio data corresponding to the sound emitting device is determined according to the first rendering data and the second rendering data.

[0069] In the embodiments of the present application, the audio data block IAB includes a sound bed and an object, and the sound bed includes one or more sound channels. The sound bed corresponds to background sound, and the object corresponds to the sound of the sound emitting body of interest. Referring to Figure 3 , Figure 3 A relationship diagram of the sound bed and the object is shown. The sound bed 31 includes two sound emitting bodies of butterfly and flower, and the object 32 includes one sound emitting body of interest of tree. The sound bed 31 and the object 32 constitute the audio data block IAB 33.

[0070] In the embodiments of the present application, the sound bed and the object of the audio data block IAB are rendered respectively, that is, the rendering of the sound bed and the rendering of the object are performed independently. Alternatively, in order to improve the rendering efficiency, the sound bed and the object of the audio data block IAB can be rendered simultaneously.

[0071] In the rendering process of the sound bed, the sound emitting device to which the sound bed is rendered can be specified according to the sound channel included in the sound bed, i.e., the mapping relationship between the sound emitting device and the sound channel can be preset. For example, assuming that there are sound emitting device 1, sound emitting device 2, sound emitting device 3 and sound emitting device 4, the sound bed includes sound channel 1 and sound channel 2, and sound channel 1 corresponds to sound emitting device 1 and sound channel 2 corresponds to sound emitting device 2, then the sound emitting device to which the sound bed is rendered is specified as sound emitting device 1 and sound emitting device 2, and from the preset mapping relationship between the sound emitting device and the sound channel, the sound emitting device determined by the sound bed is sound emitting device 1 and sound emitting device 2. Of course, in actual situations, if each sound channel included in the sound bed corresponds to a sound emitting device, then all sound emitting devices can also be set to have a mapping relationship with the sound bed, which is not limited here. After determining the sound emitting device corresponding to the sound bed from the preset mapping relationship between the sound emitting device and the sound channel, the sound bed is rendered according to the position of the determined sound emitting device. Specifically, for any sound channel of the sound bed, in the name of the sound emitting device in the playing site, the name of the sound emitting device identical to the name of the sound channel is searched, if the name of the sound emitting device identical to the name of the sound channel is found, the found sound emitting device is taken as the sound emitting device corresponding to the sound channel. If the name of the sound emitting device identical to the name of the sound channel is not found, the sound emitting device closest to the sound channel is calculated, and the closest sound emitting device is taken as the sound emitting device corresponding to the sound channel. After determining the sound emitting device corresponding to each sound channel of the sound bed, the delay and gain attenuation between each sound channel and the sound emitting device are calculated, and then the signal output by the sound channel is processed according to the calculated delay and gain attenuation, so that the sound pressure level reaching the listening point is consistent with the standard monitoring. The data obtained after processing the signal output by the sound channel is the first rendering data mentioned above.

[0072] Optionally, in the rendering of the sound channels of the sound bed, the maximum number of sound channels that can be processed simultaneously by the system at a time can be used. For example, if the system can only process the rendering task of 10 sound channels of the sound bed at a time, then 10 sound channels can be selected for rendering at a time. When the rendering is performed according to the maximum number of sound channels that can be processed by the system at a time, the rendering efficiency of the sound channels is improved. It should be noted that when the number of sound channels of the sound bed exceeds the maximum number of sound channels, the remaining sound channels will be folded or waited.

[0073] When rendering the object, the object can be rendered to all sound emitting devices. Specifically, in the audio data block IAB, each object is accompanied by Cartesian coordinates (x, y, z) (or accompanied by azimuth, elevation, distance) and a time-varying motion trajectory. These Cartesian coordinates are generally taken as the origin at the center of the playing field, with a normalized unit of 1.0 of the screen width (or a metric unit). After the renderer reads the Cartesian coordinates of the object, the renderer converts the Cartesian coordinates of the object into a unit directional vector from the listening point, and uses the unit directional vector to determine three real sound emitting devices on the spherical surface (the spherical surface is the spherical surface of a sphere with the listening point as the center and a radius of 1) that enclose the unit directional vector, which is equivalent to constructing a spherical triangle on the spherical surface. The gain of the three real sound emitting devices is calculated according to the barycentric coordinates of the unit directional vector in the spherical triangle. When the number of sound emitting devices of the playing field is greater than 3, the gain of the remaining sound emitting devices can be set to 0. When rendering the object, in addition to considering the gain of the sound emitting device, it is also necessary to consider whether to delay the output signal. Specifically, the corresponding delay can be calculated according to the distance between the object and the sound emitting device, and finally the output signal is delayed and multiplied by the corresponding gain to obtain the second rendering data described above.

[0074] After obtaining the first rendering data and the second rendering data of the same sound emitting device, the PCM audio data corresponding to the sound emitting device is determined according to the first rendering data and the second rendering data.

[0075] Optionally, when determining the PCM audio data corresponding to the sound emitting device, the first rendering data and the second rendering data can be processed accordingly, and then the processed data is taken as the PCM audio data corresponding to the sound emitting device. These processing includes but is not limited to one or more of the following: superposition, bass management, distance compensation, level management, global limiting, array correction, B-chain processing.

[0076] The superposition described above refers to adding the first rendering data corresponding to the sound bed of each sound emitting device and the second rendering data corresponding to the object to form the total PCM of the sound emitting device.

[0077] The bass management described above refers to routing low-frequency energy to sound emitting devices with bass capabilities at a set crossover point and performing phase alignment processing.

[0078] The distance compensation described above refers to using FIR (Finite Impulse Response) / IIR (Infinite Impulse Response) filters to perform spatial response correction on each sound emitting device to ensure that the frequency response curve is consistent with the standard listening.

[0079] The level management refers to keeping each channel at a safe range at any time in the rendering chain to avoid clipping as much as possible, which is equivalent to process control. At this time, the PCM audio data corresponding to the sound production device is determined according to the first rendering data and the second rendering data, and specifically includes: performing level management on the first rendering data and the second rendering data to determine the PCM audio data corresponding to the sound production device.

[0080] The global limiting refers to reducing the instantaneous peak before output to the power amplifier to prevent the sound production device from being burned out or hard clipping, which is equivalent to the control of the last gate.

[0081] The array correction refers to measuring the frequency response amplitude and phase response of all sound production devices in the real space, calculating the amplitude error according to the frequency response amplitude, calculating the phase error according to the phase response, generating a compensation filter, a delay and a gain parameter according to the amplitude error and the phase error, and applying the compensation filter, the delay and the gain parameter to the data to be output to obtain the PCM audio data corresponding to the sound production device, so that the whole set of sound production devices presents a sound field consistent with the standard monitoring environment after playing the corresponding PCM audio data.

[0082] The B-chain processing refers to performing a unified processing of the data after rendering and array correction to ensure that the processed data is safe, standard and controllable at the physical power amplifier and speaker end.

[0083] In order to more clearly describe the process of rendering the audio data block IAB, the following will be described in combination with Figure 4 .

[0084] Suppose that the parallel operation resources inside the renderer are 128 rendering units, the rendering task of the audio data block IAB can be divided into several independent sub-tasks, when the number of these sub-tasks is less than or equal to 128, these sub-tasks can be processed in parallel at one time, and when the number of these sub-tasks is greater than 128, these sub-tasks need to be processed in batches.

[0085] Suppose that the number of sound production devices is 64. In Figure 4 , the audio data block IAB is rendered based on the sound bed and the object respectively, after obtaining the corresponding first rendering data and second rendering data, the first rendering data and the second rendering data are subjected to level management, and then the data after level management is subjected to array correction and B-chain processing, and finally the PCM audio data corresponding to 64 sound production devices is output. It should be pointed out that in actual situation, if the number of sound production devices is not 64, the PCM audio data corresponding to the number of sound production devices is output, which is not limited here.

[0086] S25, write the PCM audio data corresponding to the sound device into the memory.

[0087] In the embodiment, the channel corresponding to the PCM audio data is determined, and the PCM audio data is written into the corresponding memory according to the channel corresponding to the PCM audio data. Specifically, the starting position of the PCM audio data corresponding to different channels in the memory can be preset, and then the PCM audio data of the channel is written into the corresponding address according to the starting position.

[0088] S26, according to the preset gamma table and the video field synchronization signal, the pixel value corresponding to the target video signal is mapped into the relative luminance digital value corresponding to the LED display screen.

[0089] In the embodiment, the preset gamma table can be one-dimensional or three-dimensional. The one-dimensional gamma table records a mapping curve of a digital code value to a relative light intensity (or normalized brightness), which is usually used for non-linear correction of a single channel (R, G, B each one). After inputting the digital pixel value, the one-dimensional gamma table is corrected to obtain a digital value proportional to the expected light intensity of the channel. The three-dimensional gamma table is a three-channel input and three-channel output lookup table, which records the complete three-dimensional mapping relationship between the input RGB triple and the output RGB triple, and can convert a given (R, G, B) pixel value into a new (R', G', B') value.

[0090] In the embodiment, the target video signal is analyzed to obtain the video field synchronization signal and the video analysis signal. Optionally, the video analysis signal can be a video analysis signal in XYZ color space, which is a standard color space based on the visual characteristics of the human eye proposed by the International Commission on Illumination in 1931.

[0091] After obtaining the video analysis signal, each pixel value in each frame of the video analysis signal is non-linearly corrected according to the preset gamma table to obtain the expected relative luminance digital value.

[0092] S27, write the relative luminance digital value corresponding to the LED display screen into the memory.

[0093] Specifically, according to the new display frame marked by the video field synchronization signal, the corresponding light flux is written into the memory in units of the entire display frame.

[0094] S28, read the PCM audio data corresponding to the sound device from the memory and send it to the sound device.

[0095] In the embodiments of the present application, the PCM audio data can be read from the memory according to the audio field synchronization signal, and the sound emitting device corresponding to the read PCM audio data can be determined according to the sound channel corresponding to the position of the stored PCM audio data and the mapping relationship between the sound channel and the sound emitting device, and the read PCM audio data can be sent to the determined sound emitting device. Since the PCM audio data is read according to the audio field synchronization signal, the sound emitted by the sound emitting device playing the PCM audio data is consistent with the picture. Of course, if there is no audio field synchronization signal, the PCM audio data corresponding to the sound emitting device can be directly read from the memory, which is not limited here.

[0096] In some embodiments, the sound emitting device can include a first sound emitting device and a second sound emitting device, and the first sound emitting device includes an analog-to-digital converter, a power amplifier and a loudspeaker, and the second sound emitting device includes the first sound emitting device and a cabinet. Since the second sound emitting device further includes a cabinet, the volume of the second sound emitting device will be greater than that of the first sound emitting device.

[0097] When the sound emitting device includes a first sound emitting device and a second sound emitting device, the step S28 of reading the PCM audio data corresponding to the sound emitting device from the memory and sending it to the corresponding sound emitting device includes:

[0098] If the sound emitting device is the first sound emitting device, the PCM audio data corresponding to the first sound emitting device is read from the memory and sent to the corresponding first sound emitting device through the receiving card; if the sound emitting device is the second sound emitting device, the PCM audio data corresponding to the second sound emitting device is read from the memory and sent to the corresponding second sound emitting device.

[0099] In the embodiments of the present application, the read PCM audio data corresponding to the first sound emitting device is sent to the first sound emitting device through the receiving card (or receiving card string). Further, considering that the receiving card is usually arranged inside or at the back of the LED display screen cabinet, and the first sound emitting device includes an analog-to-digital converter, a power amplifier and a loudspeaker, and does not include a cabinet, i.e. the volume of the first sound emitting device is small, therefore, when sending to the first sound emitting device through the receiving card, the small volume first sound emitting device can be installed on the back of the LED display screen, or installed near the LED display screen (the near can be a range within a preset distance from the LED display screen, and the preset distance can be a small value, such as 1 meter, 2 meters, etc.), as shown in Figure 5 . Figure 5 is a schematic diagram of the distribution of a first sound emitting device in a cinema provided by the embodiments of the present application. In Figure 5 , the first sound emitting device is mainly distributed on the back of the LED display screen.

[0100] In the embodiment of the present application, since the second sound device further comprises the box, the second sound device can be installed in a place far away from the LED display screen, for example, installed on the corridor wall of the playing site. When reading the corresponding PCM audio data of the second sound device from the memory, the second sound device is no longer sent through the receiving card.

[0101] S29, reading the corresponding relative brightness digital value of the LED display screen from the memory, and sending the LED display screen through the receiving card.

[0102] In the embodiment of the present application, according to the new display frame marked by the video field synchronization signal, the expected relative brightness digital value of the entire display frame is output to the receiving card in the subsequent refresh cycle according to the set timing, and then output to each LED driving chip through the receiving card, and then converted into pulse width modulation (PWM) duty cycle by the driving chip to control the LED lamp bead chip to emit corresponding luminous flux.

[0103] In the embodiment of the present application, after the interface board obtains the target audio signal and the target video signal, the target audio signal and the target video signal are processed respectively. Specifically, the target audio signal is analyzed to obtain an audio encoding signal and an audio field synchronization signal, the audio encoding signal is decoded according to the audio field synchronization signal to obtain an audio data block IAB, the audio data block IAB is rendered to obtain the corresponding PCM audio data of the sound device, and finally the corresponding PCM audio data of the sound device is written into the memory, and the PCM audio data is read from the memory and sent to the corresponding sound device. Since the interface board can process the target audio signal and the target video signal at the same time, it is not necessary to connect an audio processor, thereby reducing the construction complexity and cost of the playing site (such as a cinema). At the same time, since the PCM audio data of the sound device is determined by rendering the audio data block IAB, different sound devices have corresponding PCM audio data, and when each sound device has corresponding PCM audio data, it is beneficial to improve the auditory experience of the user. In addition, since the audio data block IAB is decoded according to the audio field synchronization signal, and the audio field synchronization signal and the video field synchronization signal are used to synchronize the sound and the picture, when the subsequent sound device plays the corresponding PCM audio data and the LED display screen displays the corresponding picture according to the relative brightness digital value determined by the video field synchronization signal, it is also beneficial to improve the immersive experience of the user.

[0104] In the above description, the interface board of the embodiments of the present application can process the target audio signal and the target video signal. In some embodiments, the interface board provided by the embodiments of the present application can also process a non-target audio signal, which does not contain an audio field synchronization signal. At this time, the audio and video signal processing method provided by the embodiments of the present application further comprises:

[0105] If the non-target audio signal is obtained, the non-target audio signal is written into the memory, and the non-target audio signal is an audio signal that does not contain an audio field synchronization signal. The non-target audio signal is read from the memory and sent to the sound emitting device.

[0106] The non-target audio signal described above is usually a customized audio signal, for example, an audio signal recorded by a user through a mobile phone or other smart devices. The initial purpose of recording these audio signals is usually not for playing in a cinema.

[0107] In the embodiments of the present application, considering that the number of sound channels contained in the non-target audio signal is usually small, the non-target audio signal can be directly written into the memory without rendering processing. After the non-target audio signal is read from the memory, the read non-target audio signal is sent to the sound emitting device according to the audio synchronization signal of the non-target audio signal. Alternatively, the read non-target audio signal is sent to each sound emitting device.

[0108] Since the non-target audio signal can be processed through the interface board, the sound emitting device in the playing site can also play the sound corresponding to the non-target audio signal according to the output of the interface board.

[0109] In the above description, the interface board of the embodiments of the present application can process the target audio signal and the target video signal. In some embodiments, the interface board provided by the embodiments of the present application can also process a non-target video signal, which does not contain a video field synchronization signal. At this time, the audio and video signal processing method provided by the embodiments of the present application further comprises:

[0110] If the non-target video signal is obtained, the pixel value corresponding to the non-target video signal is mapped to the relative luminance digital value corresponding to the LED display screen according to the preset gamma table; the relative luminance digital value corresponding to the LED display screen is written into the memory; the relative luminance digital value corresponding to the LED display screen is read from the memory and sent to the LED display screen through the receiving card.

[0111] In this embodiment, considering that the RGB bit width of the non-target video signal may differ from that of the LED display screen when the non-target video signal is in RGB format, after acquiring the non-target video signal, it is necessary to convert the RGB bit width of the non-target video signal to be consistent with the RGB bit width of the LED display screen. When the non-target video signal is in YUV format, it is necessary to convert it from YUV to RGB format. Then, according to a preset gamma table, the pixel values ​​corresponding to the format-converted non-target video signal are mapped to the relative brightness digital values ​​corresponding to the LED display screen, and the relative brightness digital values ​​corresponding to the LED display screen are stored in the corresponding memory.

[0112] Since non-target video signals can be processed through the interface board, the LED display screen at the playback venue can also display the image corresponding to the non-target video signal based on the output of the interface board.

[0113] To more clearly describe the audio and video signal processing method provided in the embodiments of this application, the following is combined with... Figure 6 and Figure 7 Describe it.

[0114] Figure 6 This illustration shows a schematic diagram of the architecture of an integrated audio and video processing solution provided in an embodiment of this application;

[0115] Figure 7 A flowchart illustrating another audio / video signal processing method provided in an embodiment of this application is shown.

[0116] exist Figure 6 In this system, the video obtained by the IB board from the cinema server is the target video signal, the audio obtained from the cinema server is the target audio signal, the customized audio obtained from other places is the non-target audio signal, and the customized video obtained from other places is the non-target video signal.

[0117] Whether it is a target audio signal, a non-target audio signal, a target video signal, or a non-target video signal, all are processed through the IB board.

[0118] For the target audio signal, the IB board will parse the target audio signal to obtain the audio field synchronization signal. Figure 7 The audio field synchronization signal (As) and the audio encoding signal are used. The audio encoding signal is decoded based on the audio field synchronization signal to obtain the immersive audio bitstream (IAB). This IAB is then rendered to obtain the PCM audio data corresponding to the sound-generating device, which is then written into memory. For non-target audio signals, they are directly written into memory.

[0119] For the target video signal, the IB board parses the target video signal to obtain a video field synchronization signal and a video parsing signal. According to a preset gamma table, each pixel value in each frame image of the video parsing signal is nonlinearly corrected to obtain a desired relative luminance digital value, and the relative luminance digital value corresponding to the LED display is written into the memory. If the non-target video signal is needed, the non-target video signal is converted in RGB bit width, or the non-target video signal is converted from YUV format to RGB format. Then, according to the preset gamma table, the pixel value corresponding to the converted non-target video signal is mapped to the relative luminance digital value corresponding to the LED display, and the relative luminance digital value corresponding to the LED display is stored in the corresponding memory.

[0120] After the target audio signal (or the non-target audio signal) and the target video signal (or the non-target video signal) are written into the memory, the corresponding audio signal or video signal is read according to the corresponding synchronization signal. The read video signal is sent to the LED display through the receiving card for display. The read audio signal can be sent to the first sound generating device (such as a digital power amplifier sound in the same side of the LED display) or the second sound generating device (such as a multi-channel DA and power amplifier and multi-channel sound in the same side of the LED display). Figure 6 Figure 6

[0121] It should be understood that the size of the serial number of each step in the above embodiment does not mean the order of execution, and the execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

[0122] According to the audio and video signal processing method described in the above embodiment, Figure 8 a structure block diagram of an audio and video signal processing device provided by an embodiment of the present application is shown, only the part related to the embodiment of the present application is shown for the convenience of description.

[0123] Referring to Figure 8 , the audio and video signal processing device 8 is applied to an interface board, and includes:

[0124] a target audio and video signal acquisition module 81, configured to acquire a target audio signal and a target video signal, the target audio signal being an audio signal including an audio field synchronization signal, and the target video signal being a video signal including a video field synchronization signal;

[0125] a target audio signal parsing module 82, configured to parse the target audio signal to obtain an audio encoding signal and an audio field synchronization signal;

[0126] ​​An audio encoding signal decoding module 83 is configured to decode the audio encoding signal according to the audio field synchronization signal to obtain an audio data block immersive audio bitstream IAB;

[0127] A rendering module 84 is configured to perform rendering processing on the audio data block IAB to obtain PCM audio data corresponding to the sound emitting device;

[0128] A PCM audio data storage module 85 is configured to write the PCM audio data corresponding to the sound emitting device into the memory;

[0129] A gamma table lookup module 86 is configured to map the pixel value corresponding to the target video signal to a relative luminance digital value corresponding to the LED display screen according to a preset gamma table and the video field synchronization signal;

[0130] A relative luminance digital value storage module 87 is configured to write the relative luminance digital value corresponding to the LED display screen into the memory;

[0131] A PCM audio data sending module 88 is configured to read the PCM audio data corresponding to the sound emitting device from the memory and send the PCM audio data to the sound emitting device;

[0132] A relative luminance digital value sending module 89 is configured to read the relative luminance digital value corresponding to the LED display screen from the memory and send the relative luminance digital value to the LED display screen through the receiving card.

[0133] In the embodiments of the present application, after the interface board obtains the target audio signal and the target video signal, the target audio signal and the target video signal are processed respectively. Specifically, the target audio signal is analyzed to obtain an audio encoding signal and an audio field synchronization signal, the audio encoding signal is decoded according to the audio field synchronization signal to obtain an audio data block IAB, the audio data block IAB is rendered to obtain PCM audio data corresponding to the sound device, the PCM audio data corresponding to the sound device is finally written into the memory, and the PCM audio data is read from the memory and sent to the corresponding sound device. Since the interface board can process the target audio signal and the target video signal at the same time, it is not necessary to connect an audio processor, thereby reducing the construction complexity and cost of the playing site (such as a cinema). At the same time, since the PCM audio data corresponding to the sound device is determined by rendering the audio data block IAB, different sound devices have corresponding PCM audio data, and when each sound device has corresponding PCM audio data, it is beneficial to improve the auditory experience of the user. In addition, since the audio data block IAB is decoded according to the audio field synchronization signal, and the audio field synchronization signal and the video field synchronization signal are used to synchronize the sound and the picture, when the subsequent sound device plays the corresponding PCM audio data and the LED display screen displays the corresponding picture according to the relative brightness digital value determined by the video field synchronization signal, it is also beneficial to improve the immersive experience of the user.

[0134] Optionally, the rendering module 84 is specifically used for:

[0135] obtaining the positions of each sound device of the playing site; and rendering the audio data block IAB according to the positions of each sound device to obtain the PCM audio data corresponding to the sound device.

[0136] Optionally, the audio data block IAB includes a sound bed and an object, and the rendering of the audio data block IAB according to the positions of each sound device to obtain the PCM audio data corresponding to each sound device includes:

[0137] for each sound device:

[0138] rendering the sound bed of the audio data block IAB including the sound channel according to a preset mapping relationship between the sound device and the sound channel and the position of the sound device to obtain first rendering data corresponding to the sound device corresponding to the sound bed;

[0139] rendering the object of the audio data block IAB according to the position of the sound device to obtain second rendering data corresponding to the sound device;

[0140] The PCM audio data corresponding to the sound production device is determined according to the first rendering data and the second rendering data.

[0141] Optionally, the PCM audio data corresponding to the sound production device is determined according to the first rendering data and the second rendering data, including:

[0142] The first rendering data and the second rendering data are subjected to level management to determine the PCM audio data corresponding to the sound production device.

[0143] Optionally, the sound production device includes a first sound production device and a second sound production device, the first sound production device includes an analog-to-digital converter, a power amplifier and a loudspeaker, and the second sound production device includes the first sound production device and a cabinet, and the PCM audio data sending module 88 is specifically configured to:

[0144] If the sound production device is the first sound production device, the PCM audio data corresponding to the first sound production device is read from the memory and sent to the corresponding first sound production device through the receiving card.

[0145] If the sound production device is the second sound production device, the PCM audio data corresponding to the second sound production device is read from the memory and sent to the corresponding second sound production device.

[0146] Optionally, the audio and video signal processing device 8 further includes:

[0147] A non-target audio signal obtaining module is configured to, if a non-target audio signal is obtained, write the non-target audio signal into a memory, the non-target audio signal being an audio signal not containing an audio field synchronization signal.

[0148] A non-target audio signal sending module is configured to read the non-target audio signal from the memory and send the non-target audio signal to the sound production device.

[0149] Optionally, the audio and video signal processing device 8 further includes:

[0150] A non-target video signal obtaining module is configured to, if a non-target video signal is obtained, map pixel values corresponding to the non-target video signal into relative luminance digital values corresponding to an LED display screen according to a preset gamma table.

[0151] A non-target video signal corresponding relative luminance digital value storage module is configured to write the relative luminance digital values corresponding to the LED display screen into the memory.

[0152] A non-target video signal corresponding relative luminance digital value sending module is configured to read the relative luminance digital values corresponding to the LED display screen from the memory and send the relative luminance digital values to the LED display screen through the receiving card.

[0153] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0154] Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 9 As shown, the electronic device 9 of this embodiment includes: at least one processor 90 ( Figure 9 The diagram shows only one processor, a memory 91, and a computer program 92 stored in the memory 91 and executable on at least one processor 90. When the processor 90 executes the computer program 92, it implements the steps in any of the above method embodiments.

[0155] The aforementioned electronic device 9 can be a desktop computer, laptop, handheld computer, cloud server, or other computing device. This electronic device may include, but is not limited to, a processor 90 and a memory 91. Those skilled in the art will understand that... Figure 9 This is merely an example of electronic device 9 and does not constitute a limitation on electronic device 9. It may include more or fewer components than shown, or combine certain components, or different components, such as input / output devices, network access devices, etc.

[0156] The processor 90 may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0157] The memory 91 can be an internal storage unit of the electronic device 9 in some embodiments, such as a hard disk or a memory of the electronic device 9. The memory 91 can also be an external storage device of the electronic device 9 in other embodiments, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, and the like. Further, the memory 91 can include both an internal storage unit and an external storage device of the electronic device 9. The memory 91 is used to store an operating system, an application program, a boot loader, data, and other programs, such as program codes of the computer program. The memory 91 can also be used to temporarily store data that has been output or is to be output.

[0158] It should be clearly understood by those skilled in the art that, for the convenience and brevity of description, only the division of the above functional units and modules is exemplified, and in actual application, the above functions can be completed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to complete all or part of the above-described functions. Each functional unit and module in the embodiment can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit, and the integrated unit can be realized in the form of hardware or software. In addition, the specific names of the functional units and modules are only for mutual distinction, and do not limit the protection scope of the present application. The specific working process of the units and modules in the system can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0159] The embodiments of the present application also provide a network device, which comprises at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor executes the computer program to implement the steps in any of the method embodiments.

[0160] The embodiments of the present application also provide a computer readable storage medium, which stores a computer program, wherein the computer program is executable by a processor to implement the steps in any of the method embodiments.

[0161] The embodiments of the present application provide a computer program product, which, when executed on an electronic device, enables the electronic device to implement the steps in any of the method embodiments.

[0162] The integrated units described above, if implemented in the form of software function units and sold or used as independent products, can be stored in a computer readable storage medium. Based on such understanding, the present application implements all or part of the processes in the above-described embodiment methods, which can be completed by instructing relevant hardware through a computer program. The above computer program can be stored in a computer readable storage medium, and the computer program can implement the steps of the above various method embodiments when executed by a processor. The computer program includes computer program code, which can be in the form of source code, object code, executable files or some intermediate forms. The computer readable medium can at least include any entity or device capable of carrying the computer program code to the photographing device / electronic device, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium. For example, U disk, mobile hard disk, magnetic disk or optical disk, etc. In some jurisdictions, according to legislation and patent practice, the computer readable medium can not be an electrical carrier signal and a telecommunication signal.

[0163] In the above embodiments, the description of each embodiment has its own focus, and the parts not described or recorded in detail in a certain embodiment can be referred to the relevant description of other embodiments.

[0164] Those skilled in the art can appreciate that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Professionals can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0165] In the embodiments provided in the present application, it should be understood that the disclosed apparatus / network device and method can be implemented in other ways. For example, the apparatus / network device embodiments described above are only schematic. For example, the division of the above modules or units is only a logical function division, and there can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection between each shown or discussed technical feature can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or in other forms.

[0166] The units described as separate parts above can or can not be physically separate, and the parts shown as units can or can not be physical units, that is, can be located in one place, or can be distributed to multiple network units. Part or all of the units can be selected to achieve the purpose of the embodiment scheme according to actual needs.

[0167] The above embodiments are only used to illustrate the technical solutions of the present application, but not limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can still be modified, or some technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. An audio video signal processing method, characterized by, The application is applied to an interface board, comprising: obtaining a target audio signal and a target video signal, the target audio signal being an audio signal comprising an audio field synchronization signal, and the target video signal being a video signal comprising a video field synchronization signal; parsing the target audio signal to obtain an audio encoding signal and an audio field synchronization signal; decoding the audio encoding signal according to the audio field synchronization signal to obtain an audio data block immersive audio bitstream IAB; rendering processing the audio data block IAB to obtain PCM audio data corresponding to a sound emitting device; writing the PCM audio data corresponding to the sound emitting device into a memory; mapping pixel values corresponding to the target video signal into relative luminance digital values corresponding to an LED display screen according to a preset gamma table and the video field synchronization signal; writing the relative luminance digital values corresponding to the LED display screen into the memory; reading the PCM audio data corresponding to the sound emitting device from the memory and sending to the sound emitting device; reading the relative luminance digital values corresponding to the LED display screen from the memory and sending to the LED display screen through a receiving card.

2. The audio-video signal processing method of claim 1, wherein, The rendering processing of the audio data block IAB to obtain the PCM audio data corresponding to the sound emitting device comprises: obtaining positions of each sound emitting device in a playing site; rendering processing the audio data block IAB according to the positions of each sound emitting device to obtain the PCM audio data corresponding to the sound emitting device.

3. The audio-video signal processing method according to claim 2, wherein, The audio data block IAB comprises a sound bed and an object, and the rendering processing of the audio data block IAB according to the positions of each sound emitting device to obtain the PCM audio data corresponding to each sound emitting device comprises: for each sound emitting device: rendering processing the sound bed of the audio data block IAB comprising a sound channel according to a preset mapping relationship between the sound emitting device and the sound channel and the position of the sound emitting device to obtain first rendering data corresponding to the sound bed corresponding to the sound emitting device; rendering processing the object of the audio data block IAB according to the position of the sound emitting device to obtain second rendering data corresponding to the sound emitting device; determining the PCM audio data corresponding to the sound emitting device according to the first rendering data and the second rendering data.

4. The audio-video signal processing method according to claim 3, wherein, The determining of the PCM audio data corresponding to the sound emitting device according to the first rendering data and the second rendering data comprises: level management of the first rendering data and the second rendering data to determine the PCM audio data corresponding to the sound emitting device.

5. The audio-video signal processing method according to any one of claims 1 to 4, wherein, The sound emitting device comprises a first sound emitting device and a second sound emitting device, the first sound emitting device comprises an analog-to-digital converter, a power amplifier and a loudspeaker, and the second sound emitting device comprises the first sound emitting device and a cabinet, and the reading of the PCM audio data corresponding to the sound emitting device from the memory and the sending to the corresponding sound emitting device comprises: if the sound emitting device is the first sound emitting device, reading the PCM audio data corresponding to the first sound emitting device from the memory and sending to the corresponding first sound emitting device through a receiving card. If the sound device is the second sound device, the PCM audio data corresponding to the second sound device is read from the memory and sent to the corresponding second sound device.

6. The audio-video signal processing method according to any one of claims 1 to 4, wherein, Further comprising: If a non-target audio signal is obtained, the non-target audio signal is written into the memory, and the non-target audio signal is an audio signal not containing an audio field synchronization signal; The non-target audio signal is read from the memory and sent to the sound device.

7. The audio-video signal processing method according to any one of claims 1 to 4, wherein, Further comprising: If a non-target video signal is obtained, the pixel value corresponding to the non-target video signal is mapped to the relative luminance digital value corresponding to the LED display screen according to a preset gamma table; The relative luminance digital value corresponding to the LED display screen is written into the memory; The relative luminance digital value corresponding to the LED display screen is read from the memory and sent to the LED display screen through the receiving card.

8. An audio video signal processing apparatus, characterized by comprising: Applied to an interface board, comprising: A target audio and video signal acquisition module is configured to acquire a target audio signal and a target video signal, the target audio signal being an audio signal containing an audio field synchronization signal, and the target video signal being a video signal containing a video field synchronization signal; A target audio signal analysis module is configured to analyze the target audio signal to obtain an audio encoding signal and an audio field synchronization signal; An audio encoding signal decoding module is configured to decode the audio encoding signal according to the audio field synchronization signal to obtain an audio data block immersive audio bitstream IAB; A rendering module is configured to render the audio data block IAB to obtain PCM audio data corresponding to a sound device; A PCM audio data storage module is configured to write the PCM audio data corresponding to the sound device into a memory; A gamma table lookup module is configured to map the pixel value corresponding to the target video signal to the relative luminance digital value corresponding to the LED display screen according to a preset gamma table and the video field synchronization signal; A relative luminance digital value storage module is configured to write the relative luminance digital value corresponding to the LED display screen into the memory; A PCM audio data sending module is configured to read the PCM audio data corresponding to the sound device from the memory and send it to the sound device; A relative luminance digital value sending module is configured to read the relative luminance digital value corresponding to the LED display screen from the memory and send it to the LED display screen through a receiving card.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the method of any one of claims 1-7.

10. A computer-readable storage medium storing a computer program, the computer program comprising instructions that, when executed by a computer, cause the computer to perform the method of any one of claims 1 to 9. The computer program is executed by the processor to implement the method of any one of claims 1-7.

11. A computer program product, characterised in that, The computer program is executed by the processor to implement the method of any one of claims 1-7.

Images