Device and equipment for audio data transmission

Abstract

The invention provides a device and equipment for audio data transmission. The device comprises an interface, a decoding module, a control module and a signal processing module. The decoding module is used for responding to multimedia data sent by terminal equipment and received through the interface, decoding the multimedia data, separating first audio data from the obtained decoded multimedia data and sending the first audio data to the control module. The control module is used for sending first audio data to the signal processing module; and the processor is also used for sending second audio data of the terminal equipment obtained through the interface to the signal processing module. The signal processing module is used for processing the received output audio data and sending the obtained first processed audio data to the audio playing equipment for playing; and the processing module is also used for processing the received input audio data sent by the audio acquisition equipment and sending the obtained second processed audio data to the control module so as to transmit the second processed audio data to the terminal equipment through the control module.

Description

Technical Field

[0001] The present disclosure relates to the technical field of data transmission, and in particular to a device and apparatus for audio data transmission. Background Art

[0002] The Universal Serial Bus (USB) Type-C interface has become the mainstream USB interface due to its high operating speed, support for DisplayPort (DP), high power supply, etc. For example, AR glasses often use the Type-C interface to transmit audio and video data. Summary of the invention

[0003] In a first aspect, an embodiment of the present disclosure provides a device for audio data transmission, comprising: an interface for connecting to a terminal device; a decoding module connected to the interface; a control module connected to the interface and the decoding module respectively; a signal processing module connected to the control module, and the signal processing module is also used to connect to an audio playback device and an audio acquisition device; the decoding module is configured to: in response to receiving multimedia data sent by the terminal device through the interface, decode the multimedia data to obtain decoded multimedia data; separate first audio data from the decoded multimedia data; send the first audio data to the control module; the control module is configured to: in response to receiving the first audio data, send the first audio data to the signal processing module ; In response to obtaining the second audio data of the terminal device through the interface, sending the second audio data to the signal processing module; the signal processing module is configured to: in response to receiving the output audio data, process the output audio data to obtain the first processed audio data, wherein the output audio data is any one of the first audio data and the second audio data; send the first processed audio data to the audio playback device to play the first processed audio data through the audio playback device; in response to receiving the input audio data sent by the audio acquisition device, process the input audio data to obtain the second processed audio data; send the second processed audio data to the control module to transmit the second processed audio data to the terminal device through the control module.

[0004] In a second aspect, an embodiment of the present disclosure provides an electronic device, which includes: a device for audio data transmission as provided in any of the above embodiments; an audio playback device connected to the device for audio data transmission; and an audio acquisition device connected to the device for audio data transmission.

[0005] In a third aspect, an embodiment of the present disclosure provides a head-mounted display device, which includes: a display component; a device for audio data transmission as provided in any of the above embodiments; an audio playback device connected to the device for audio data transmission; and an audio acquisition device connected to the device for audio data transmission.

[0006] In a fourth aspect, an embodiment of the present disclosure provides an electronic device, comprising: a processor; a memory for storing processor executable instructions; a processor, for reading executable instructions from the memory, and executing the instructions to implement the functions of any one of the decoding module, control module, and signal processing module provided in any of the above embodiments of the present disclosure.

[0007] The technical solution of the present disclosure is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other purposes, features and advantages of the present disclosure will become more apparent by describing the embodiments of the present disclosure in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present disclosure and constitute a part of the specification. Together with the embodiments of the present disclosure, they are used to explain the present disclosure and do not constitute a limitation of the present disclosure. In the drawings, the same reference numerals generally represent the same components or steps.

[0009] Figure 1 is a structural schematic diagram of an apparatus for audio data transmission provided by an exemplary embodiment of the present disclosure;

[0010] Figure 2 is a structural schematic diagram of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure;

[0011] Figure 3 is a structural schematic diagram of an apparatus for audio data transmission provided by yet another exemplary embodiment of the present disclosure;

[0012] Figure 4 is a structural schematic diagram of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure;

[0013] Figure 5 is a structural schematic diagram of an apparatus for audio data transmission provided by yet another exemplary embodiment of the present disclosure;

[0014] Figure 6 is a structural schematic diagram of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure;

[0015] Figure 7 is a structural schematic diagram of an apparatus for audio data transmission provided by yet another exemplary embodiment of the present disclosure;

[0016] Figure 8 is a structural schematic diagram of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure;

[0017] Fig. 9 is a structural schematic diagram of an apparatus for audio data transmission provided by yet another exemplary embodiment of the present disclosure;

[0018] Fig.10 is a structural schematic diagram of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure;

[0019] Fig.11 is a structural schematic diagram of an apparatus for audio data transmission provided by yet another exemplary embodiment of the present disclosure;

[0020] Fig.12 is a schematic structural diagram of an electronic device provided by an exemplary embodiment of the present disclosure;

[0021] Fig.13 is a structural schematic diagram of a head mounted display device provided by an exemplary embodiment of the present disclosure;

[0022] Fig.14 It is a schematic diagram of the structure of an application embodiment of the electronic device disclosed in the present invention. DETAILED DESCRIPTION

[0023] Below, the exemplary embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments of the present disclosure, and it should be understood that the present disclosure is not limited to the exemplary embodiments described here.

[0024] It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0025] In the description of the present disclosure, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present disclosure can be understood according to specific circumstances.

[0026] Those skilled in the art can understand that the terms "first" and "second" in the embodiments of the present disclosure are only used to distinguish different steps, devices or modules, etc., and neither represent any specific technical meaning nor indicate the necessary logical order between them.

[0027] It should also be understood that in the embodiments of the present disclosure, “plurality” may refer to two or more than two, and “at least one” may refer to one, two, or more than two.

[0028] It should also be understood that any component, data or structure mentioned in the embodiments of the present disclosure can generally be understood as one or more, unless explicitly limited or otherwise indicated in the context.

[0029] It should also be understood that the description of the various embodiments in the present disclosure focuses on the differences between the various embodiments, and the same or similar aspects thereof can be referenced to each other, and for the sake of brevity, they will not be described one by one.

[0030] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0031] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0032] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0033] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0034] The specific implementation of the present disclosure is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described herein is only used to illustrate and explain the present disclosure, and is not used to limit the present disclosure.

[0035] like Figure 1 FIG. 1 is a schematic diagram of a device for audio data transmission provided by an exemplary embodiment of the present disclosure. The device for audio data transmission (hereinafter referred to as the device) 10 may include: an interface 11, a decoding module 12, a control module 13 and a signal processing module 14.

[0036] In some optional embodiments of the present disclosure, the interface 11 is used to connect to the terminal device 20. The decoding module 12 is connected to the interface 11. The control module 13 is connected to the interface 11 and the decoding module 12 respectively. The signal processing module 14 is connected to the control module 13. The signal processing module 14 is also used to connect to the audio playback device 30 and the audio acquisition device 40.

[0037] In some optional embodiments of the present disclosure, the decoding module 12 is configured to: in response to receiving multimedia data sent by the terminal device 20 through the interface 11, decode the multimedia data to obtain decoded multimedia data, separate the first audio data from the decoded multimedia data, and send the first audio data to the control module 13.

[0038] In some optional embodiments of the present disclosure, the control module 13 is configured to: in response to receiving the first audio data, send the first audio data to the signal processing module 14. In response to acquiring the second audio data of the terminal device 20 through the interface 11, send the second audio data to the signal processing module 14.

[0039] In some optional embodiments of the present disclosure, the signal processing module 14 is configured to: in response to receiving the output audio data, process the output audio data to obtain the first processed audio data. Wherein, the output audio data is any one of the first audio data and the second audio data. Send the first processed audio data to the audio playback device 30 to play the first processed audio data through the audio playback device 30. In response to receiving the input audio data sent by the audio acquisition device 40, process the input audio data to obtain the second processed audio data. Send the second processed audio data to the control module 13 to transfer the second processed audio data to the terminal device 20 through the control module 13.

[0040] In some optional embodiments of the present disclosure, the terminal device 20 may be a device with multimedia functions such as a mobile phone, a tablet, or a computer.

[0041] In some optional embodiments of the present disclosure, the interface 11 may be any implementable interface, such as a Type-C interface or other interface that can be connected to the terminal device 20 , and may be specifically set according to actual needs.

[0042] In some optional embodiments of the present disclosure, when the apparatus 10 of the present disclosure is connected to the terminal device 20 via the interface 11, the terminal device 20 can detect the access of the apparatus 10 and can select any audio data output mode of the present disclosure for transmission.

[0043] In some optional embodiments of the present disclosure, the audio data output mode of the present disclosure includes: Mode 1, receiving multimedia data sent by the terminal device 20 through the decoding module 12, decoding the multimedia data to obtain decoded multimedia data, separating the first audio data from the decoded multimedia data, and sending the first audio data to the control module 13. After receiving the first audio data, the control module 13 sends the first audio data to the signal processing module 14. After receiving the first audio data (i.e., the output audio data), the signal processing module 14 processes the first audio data to obtain the first processed audio data, sends the first processed audio data to the audio playback device 30, and plays the first processed audio data through the audio playback device 30. Mode 2, obtaining the second audio data of the terminal device 20 through the control module 13, and after the control module 13 obtains the second audio data, it sends the second audio data to the signal processing module 14. After receiving the second audio data (i.e., the output audio data), the signal processing module 14 processes the second audio data to obtain the first processed audio data. The signal processing module 14 sends the first processed audio data to the audio playback device 30, and the first processed audio data is played by the audio playback device 30. The selection of the audio data transmission mode can be determined by the configuration of the terminal device 20. For example, after the interface 11 is connected to the terminal device 20, the terminal device 20 can display two audio data output device options, each audio data output device option corresponds to an audio data output mode, which is selected by the user. Alternatively, according to the default configuration of the terminal device 20, one of the output modes is used as the default output mode.

[0044] In some optional embodiments of the present disclosure, the multimedia data received by the decoding module 12 may include audio data and video data encoded according to the data transmission protocol, and the decoding module 12 decodes the multimedia data to obtain decoded multimedia data, and then separates the audio data from the decoded multimedia data to obtain the first audio data. The data transmission protocol may be any implementable protocol, such as a display interface (DisplayPort, referred to as: DP) protocol. The display interface protocol may be used to transmit audio data and video data simultaneously. The audio path in the display interface protocol may transmit 8-channel 24-bit 192kHz uncompressed pulse code modulation (Pulse Code Modulation, referred to as: PCM) audio. Compressed audio may also be encapsulated in an audio data stream. In the case of audio output through the decoding module 12, after the device 10 is connected to the terminal device 20 and powered on, the device 10 communicates with the terminal device 20 as a slave device. The decoding module 12 sets the audio format supported by the decoding module 12 to the PCM audio format through initialization configuration. After the device 10 completes communication with the terminal device 20, the terminal device 20 recognizes the device 10 and regards the device 10 as a slave device supporting the PCM audio format. The multimedia data of the terminal device 20 is sent to the decoding module 12 through the interface 11. The decoding module 12 performs subsequent processing.

[0045] In some optional embodiments of the present disclosure, when the terminal device 20 selects mode 2 to output audio data, the data output to the device 10 may be packaged audio data (referred to as first packaged audio data). The control module 13 receives the first packaged audio data sent by the terminal device 20 through the interface 11, unpacks the first packaged audio data, and obtains second audio data.

[0046] In some optional embodiments of the present disclosure, the audio data output of mode 2 can adopt any feasible transmission protocol, such as USB Audio Class (UAC) protocol. UAC defines the control functions of audio devices implemented under the USB specification. These functions may include an audio digital part and an analog part. It may also include functions for directly controlling the audio environment, such as volume and tone control. The audio data transmission between the terminal device 20 and the device 10 can be realized through the USB2.0 interface of the control module 13.

[0047] In some optional embodiments of the present disclosure, in any of the above audio data output modes, the audio input function of the device 10 can be used. If the audio acquisition device 40 acquires input audio data, the input audio data can be sent to the signal processing module 14. After receiving the input audio data sent by the audio acquisition device 40, the signal processing module 14 can process the input audio data to obtain second processed audio data. The signal processing module 14 sends the second processed audio data to the control module 13, so as to transmit the second processed audio data to the terminal device 20 through the control module 13.

[0048] In some optional embodiments of the present disclosure, after receiving the second processed audio data, the control module 13 can package the second processed audio data to obtain packaged audio data (which can be called second packaged audio data), and send the packaged audio data to the terminal device 20 through the interface 11.

[0049] In some optional embodiments of the present disclosure, the hardware of the decoding module 12 can be implemented by any implementable hardware with corresponding decoding functions, such as any implementable audio and video decoding chip. The corresponding functions of the present disclosure are implemented by configuring the decoding module 12 with software.

[0050] In some optional embodiments of the present disclosure, the hardware of the control module 13 can be implemented by any implementable hardware with corresponding control functions, such as any implementable system on chip (System on Chip, referred to as: SOC), microcontroller unit (Microcontroller Unit, referred to as: MCU), etc. The corresponding functions of the present disclosure are realized by configuring the control module 13 with software.

[0051] In some optional embodiments of the present disclosure, the hardware of the signal processing module 14 can be implemented by any implementable hardware with corresponding signal processing functions, such as any implementable signal processing chip (Digital Signal Processing, referred to as DSP). The corresponding functions of the present disclosure are implemented by configuring the signal processing module 14 with software.

[0052] In some optional embodiments of the present disclosure, the decoding module 12, the control module 13 and the signal processing module 14 may include a central processing unit (CPU) core, and may also include peripheral devices such as registers that cooperate with the CPU core to complete the functions of the corresponding modules. In the same module, the CPU core communicates with the peripheral devices through a bus and controls the peripheral devices to complete the transmission of audio data.

[0053] In some optional embodiments of the present disclosure, the processing of the output audio data by the signal processing module 14 may include processing of relevant signal processing algorithms such as noise reduction and bass enhancement.

[0054] In some optional embodiments of the present disclosure, the processing of the input audio data by the signal processing module 14 may include converting the encoding format of the audio data, performing noise reduction, performing microphone directional acquisition, and other processing. For example, the input audio data collected by the audio acquisition device 40 is a digital signal in a pulse density modulation (Pulse Density Modulation, referred to as: PDM) encoding format, and the input audio data is transmitted to the signal processing module 14 through the PDM interface. The signal processing module 14 converts the input audio data in the PDM encoding format into audio data in the PCM encoding format, and performs noise reduction, microphone directional acquisition, and other processing on the audio data in the PCM encoding format to obtain the second processed audio data.

[0055] In some optional embodiments of the present disclosure, the audio playback device 30 may be any implementable playback device, such as a speaker, or a smart power amplifier (smart PA) and a speaker.

[0056] In some optional embodiments of the present disclosure, a digital-to-analog converter (DAC) may be integrated in the audio playback device 30. The first processed audio data may be played through a speaker after being subjected to digital-to-analog conversion.

[0057] In some optional embodiments of the present disclosure, the audio acquisition device 40 may be any practicable acquisition device, such as any practicable microphone.

[0058] In some optional embodiments of the present disclosure, an analog-to-digital converter (ADC) may be integrated in the audio acquisition device 40, and the input audio data obtained may be a digital signal in a preset coding format (e.g., PDM). The collected input audio data is sent to the signal processing module 14 through a corresponding interface (e.g., a PDM interface).

[0059] In some optional embodiments of the present disclosure, the device 10 of the embodiment of the present disclosure can be set in any implementable electronic device with an audio playback function or capable of connecting to an audio playback device. For example, a head-mounted display device or other possible electronic devices. The head-mounted display device includes but is not limited to AR (Augmented Reality) smart glasses, VR (Virtual Reality) smart glasses, and the like.

[0060] The device provided in this embodiment is connected to the decoding module 12 and the signal processing module 14 respectively through the control module 13, so that when the terminal device 20 outputs audio data to the audio playback device 30 through the decoding module 12, the decoding module 12 can transmit the first audio data separated by decoding to the audio playback device 30 through the control module 13 and the signal processing module 14, so that the first audio data can be processed by the signal processing module 14 to obtain the first processed audio data, and the first processed audio data can be played through the audio playback device 30, which can improve the quality of the audio data, thereby improving the playback effect of the audio data, and helping to improve the user experience. And whether the audio data is output through the transmission path of the decoding module 12→control module 13→signal processing module 14, or the audio data is output through the transmission path of the control module 13→signal processing module 14, the availability of the audio input function of the device 10 can be maintained, and the signal processing module 14 can receive the input audio data sent by the audio acquisition device 40, process the input audio data to obtain the second processed audio data, and transmit the second processed audio data to the terminal device 20 through the control module 13.

[0061] In the audio data transmission device of the related art, when the terminal device outputs multimedia data through the DP interface, the decoding chip obtains audio data from the multimedia data and sends the audio data to the audio playback device for playback. In this case, the audio input function will be suspended. Compared with the related art, the device of the embodiment of the present disclosure can process the first audio data through the signal processing module 14 to obtain the first processed audio data with better sound effect, and play it through the audio playback device, and on the other hand, it can maintain the continuous availability of the audio input function.

[0062] In some optional embodiments of the present disclosure, the control module 13 is configured to: in response to receiving the first packaged audio data sent by the terminal device 20 through the interface 11, unpack the first packaged audio data to obtain the unpacked second audio data, and send the second audio data to the signal processing module 14.

[0063] In some optional embodiments of the present disclosure, the first packaged audio data can be the terminal device 20 packaging the audio data to be output according to the rules of the data transmission protocol to obtain the first packaged audio data. For example, the terminal device 20 packages the audio data in the PCM encoding format through the USB2.0 protocol to obtain the first packaged audio data. Packaging refers to synthesizing one or more audio data or audio data segments into a complete package according to a certain format. Packaging can include encoding, encapsulation, embedding metadata, etc. The encoding format of the audio data is not limited to the PCM encoding format. The terminal device 20 sends the first packaged audio data to the control module 13 through the interface 11. The control module 13 unpacks the first packaged audio data according to the unpacking rules of the data transmission protocol to obtain the unpacked second audio data. For example, the control module 13 unpacks the first packaged audio data to obtain the second audio data in the PCM encoding format. The control module 13 sends the second audio data to the signal processing module 14. The audio data output method corresponding to the second method is described here.

[0064] The apparatus of this embodiment configures the control module 13 to obtain the second audio data by unpacking the first packaged audio data, so that the audio data transmitted between the terminal device 20 and the apparatus 10 can be packaged before transmission, which can improve the transmission efficiency.

[0065] In some optional embodiments of the present disclosure, the control module 13 is configured to: in response to receiving the second processed audio data, package the second processed audio data to obtain second packaged audio data, and send the second packaged audio data to the terminal device 20 through the interface 11 .

[0066] In some optional embodiments of the present disclosure, the second packaged audio data is similar to the first packaged audio data and will not be described in detail here.

[0067] The apparatus of this embodiment configures the control module 13 to package the second processed audio data after receiving the second processed audio data to obtain second packaged audio data, and sends the second packaged audio data to the terminal device 20 through the interface 11, which helps to realize the audio input function.

[0068] like Figure 2 , which is a schematic diagram of the structure of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure.

[0069] In some optional embodiments of the present disclosure, the control module 13 includes: a first audio transmission unit 131 , a second audio transmission unit 132 , a processor 133 and a data transmission unit 134 .

[0070] The first audio transmission unit 131 is connected to the decoding module 12. The second audio transmission unit 132 is connected to the first audio transmission unit 131 and the signal processing module 14 respectively. The processor 133 is connected to the second audio transmission unit 132. The data transmission unit 134 is connected to the processor 133 and the interface 11 respectively.

[0071] In some optional embodiments of the present disclosure, the first audio transmission unit 131 is configured to: receive the first audio data sent by the decoding module 12 .

[0072] In some optional embodiments of the present disclosure, the second audio transmission unit 132 is configured to: obtain the first audio data from the first audio transmission unit 131, receive the second audio data sent by the processor 133, send the output audio data to the signal processing module 14, and receive the second processed audio data sent by the signal processing module 14.

[0073] In some optional embodiments of the present disclosure, the processor 133 is configured to: obtain the second processed audio data in the second audio transmission unit 132. Pack the second processed audio data to obtain second packaged audio data. Send the second packaged audio data to the data transmission unit 134. Obtain the first packaged audio data in the data transmission unit 134. Unpack the first packaged audio data to obtain unpacked second audio data. Send the second audio data to the second audio transmission unit 132.

[0074] In some optional embodiments of the present disclosure, the data transmission unit 134 is configured to: send the second packaged audio data to the terminal device 20 through the interface 11 ; and receive the first packaged audio data sent by the terminal device 20 through the interface 11 .

[0075] In some optional embodiments of the present disclosure, the first audio transmission unit 131 can be connected to the decoding module 12 through any bus that can transmit audio data. For example, it is connected to the decoding module 12 through an I2S bus. The second audio transmission unit 132 can be connected to the signal processing module 14 through any bus that can transmit audio data. For example, it is connected to the signal processing module 14 through an I2S bus.

[0076] In some optional embodiments of the present disclosure, the data transmission unit 134 may be connected to the interface 11 via a bus interface corresponding to the above-mentioned method 2, for example, via a UAC interface.

[0077] In some optional embodiments of the present disclosure, the first audio transmission unit 131, the second audio transmission unit 132, the processor 133 and the data transmission unit 134 may be connected via any implementable on-chip bus. The on-chip bus may be, for example, a direct memory access (DMA) bus.

[0078] In some optional embodiments of the present disclosure, after the decoding module 12 separates the first audio data, the first audio data is sent to the first audio transmission unit 131. The first audio transmission unit 131 receives the first audio data sent by the decoding module 12. The first audio transmission unit 131 can store the first audio data, for example, in a register. The second audio transmission unit 132 can obtain the first audio data from the first audio transmission unit 131. The second audio transmission unit 132 can store the first audio data, for example, in a register. The second audio transmission unit 132 sends the first audio data as output audio data to the signal processing module 14. The signal processing module 14 processes the first audio data to obtain first processed audio data, and plays the first processed audio data through the audio playback device 30.

[0079] In some optional embodiments of the present disclosure, the data transmission unit 134 may receive the first packaged audio data sent by the terminal device 20 through the interface 11. The processor 133 obtains the first packaged audio data in the data transmission unit 134, unpacks the first packaged audio data, and obtains the unpacked second audio data. The processor 133 sends the second audio data to the second audio transmission unit 132. The second audio transmission unit 132 receives the second audio data sent by the processor 133, and sends the second audio data as output audio data to the signal processing module 14. The signal processing module 14 processes the second audio data to obtain the first processed audio data, and plays the first processed audio data through the audio playback device 30.

[0080] In some optional embodiments of the present disclosure, the audio acquisition device 40 collects input audio data and sends the input audio data to the signal processing module 14. The signal processing module 14 receives the input audio data, processes the input audio data, and obtains second processed audio data. The signal processing module 14 sends the second processed audio data to the second audio transmission unit 132. The second audio transmission unit 132 receives the second processed audio data sent by the signal processing module 14. The second audio transmission unit 132 can store the second processed audio data, for example, in a register. The processor 133 can obtain the second processed audio data in the second audio transmission unit 132, package the second processed audio data, and obtain second packaged audio data. The processor 133 sends the second packaged audio data to the data transmission unit 134. The data transmission unit 134 can store the second packaged audio data, for example, in a register. The data transmission unit 134 sends the second packaged audio data to the terminal device 20 through the interface 11 to realize the audio input function.

[0081] The device of this embodiment is connected to the decoding module 12 through the first audio transmission unit 131 in the control module 13, and is connected to the first audio transmission unit 131 and the signal processing module 14 through the second audio transmission unit 131, so that the first audio data obtained by the decoding module 12 can be transmitted to the second audio transmission unit 132 through the first audio transmission unit 131, and then transmitted to the signal processing unit 14 through the second audio transmission unit 132. The second audio data obtained by the processor 133 from the terminal device through the data transmission unit 134 and the interface 11 can be transmitted to the signal processing unit 14 through the second audio transmission unit 132. The signal processing unit 14 processes the obtained input audio data to obtain the corresponding second processed audio data, which can be sent to the processor 133 through the second audio transmission unit 132, and then the second processed audio data is packaged and sent to the terminal device 20 through the processor 133, the data transmission unit 134 and the interface 11. The parallel availability of audio data output and input functions is realized. No matter which audio data output mode is adopted, it does not affect the use of the audio input function.

[0082] In some optional embodiments of the present disclosure, for the case where the terminal device 20 directly sends the second audio data to the control module 13, and the control module 13 directly sends the second processed audio data to the terminal device, the processor 133 may also be configured to: obtain the second processed audio data in the second audio transmission unit 132, and send the second processed audio data to the data transmission unit 134. Obtain the second audio data in the data transmission unit 134, and send the second audio data to the second audio transmission unit 132.

[0083] In some optional embodiments of the present disclosure, the data transmission unit 134 is configured to: send the second processed audio data to the terminal device 20 through the interface 11 ; and receive the second audio data sent by the terminal device 20 through the interface 11 .

[0084] In the device of this embodiment, the control module does not need to perform packaging and unpacking operations on the audio data interacting with the terminal device, and the processor therein transfers the audio data between the data transmission unit and the second audio transmission unit.

[0085] like Figure 3 , which is a schematic diagram of the structure of an apparatus for audio data transmission provided by yet another exemplary embodiment of the present disclosure.

[0086] In some optional embodiments of the present disclosure, the first audio transmission unit 131 includes: a first receiving register 1311. The first receiving register 1311 is configured to: buffer the first audio data received by the first audio transmission unit 131 from the decoding module 12.

[0087] In some optional embodiments of the present disclosure, the second audio transmission unit 132 includes: a second sending register 1321 and a second receiving register 1322 .

[0088] In some optional embodiments of the present disclosure, the second receiving register 1322 is configured to: cache the second processed audio data received by the second audio transmission unit 132 from the signal processing module 14. The second sending register 1321 is configured to: cache the first audio data from the first audio transmission unit 131 acquired by the second audio transmission unit 132. Cache the second audio data received by the second audio transmission unit 132 from the processor 133.

[0089] In some optional embodiments of the present disclosure, the data transmission unit 134 includes: a data sending register 1341 and a data receiving register 1342 .

[0090] In some optional embodiments of the present disclosure, the data receiving register 1342 is configured to: buffer the first packaged audio data received by the data transmission unit 134 from the terminal device 20. The data sending register 1341 is configured to: buffer the second packaged audio data received by the data transmission unit 134 from the processor 133.

[0091] In some optional embodiments of the present disclosure, the first receiving register 1311 can be implemented by any implementable register, and can be specifically set according to actual needs. For example, the first receiving register 1311 can adopt a first-in first-out (FIFO) register. The first receiving register 1311 is used to cache the first audio data from the decoding module 12 received by the first audio transmission unit 131. That is, the first audio data from the decoding module 12 received by the first audio transmission unit 131 is cached in the first receiving register 1311.

[0092] In some optional embodiments of the present disclosure, the second receiving register 1322 can be implemented by any implementable register. The second receiving register 1322 can be used to cache the second processed audio data from the signal processing module 14 received by the second audio transmission unit 132. That is, the second processed audio data from the signal processing module 14 received by the second audio transmission unit 132 is cached in the second receiving register 1322. The processor 133 can read the second processed audio data from the second receiving register 1322, and after packaging the second processed audio data, send the second packaged audio data to the data transmission register 1341 in the data transmission unit 134, so that the data transmission unit 134 sends the second packaged audio data to the terminal device 20.

[0093] In some optional embodiments of the present disclosure, the second sending register 1321 can be implemented by any implementable register. The second sending register 1321 can be used to cache the first audio data from the first audio transmission unit 131 acquired by the second audio transmission unit 132. That is, the first audio data from the first audio transmission unit 131 acquired by the second audio transmission unit 132 is cached in the second sending register 1321. The second audio transmission unit 132 sends the first audio data in the second sending register 1321 to the signal processing module 14 through the communication interface with the signal processing module 14.

[0094] In some optional embodiments of the present disclosure, the second audio transmission unit 132 can access the first receiving register 1311 in the first audio transmission unit 131 through direct memory access (DMA), read the first audio data from the first receiving register 1311, and write the first audio data into the second sending register 1321.

[0095] In some optional embodiments of the present disclosure, the second sending register 1321 may also be used to cache the second audio data received by the second audio transmission unit 132 from the processor 133. That is, the second audio data received by the second audio transmission unit 132 from the processor 133 is cached in the second sending register 1321. The second audio transmission unit 132 sends the second audio data in the second sending register 1321 to the signal processing module 14 through the communication interface with the signal processing module 14.

[0096] In some optional embodiments of the present disclosure, the data sending register 1341 and the data receiving register 1342 may be implemented using any implementable registers.

[0097] In some optional embodiments of the present disclosure, the data receiving register 1342 can be used to cache the first packaged audio data from the terminal device 20 received by the data transmission unit 134. That is, the first packaged audio data from the terminal device 20 received by the data transmission unit 134 is cached in the data receiving register 1342. The processor 133 can access the data receiving register 1342 through a bus (e.g., a DMA bus), read the first packaged audio data, unpack the first packaged audio data, and obtain the unpacked second audio data. The processor 133 sends the second audio data to the second audio transmission unit 132 through the bus, and caches it in the second sending register 1321. The second audio transmission unit 132 sends the second audio data in the second sending register 1321 to the signal processing module 14 through the communication interface with the signal processing module 14.

[0098] In some optional embodiments of the present disclosure, the data transmission register 1341 may be used to cache the second packaged audio data received by the data transmission unit 134 from the processor 133. That is, the second packaged audio data received by the data transmission unit 134 from the processor 133 is cached in the data transmission register 1341. The data transmission unit 134 sends the second packaged audio data in the data transmission register 1341 to the terminal device 20 through the interface 11.

[0099] In some optional embodiments of the present disclosure, the first audio transmission unit 131 may further include a first sending register, and the first sending register may cooperate with the first audio transmission unit 131 to complete the caching and sending functions of other corresponding data.

[0100] In some optional embodiments of the present disclosure, each of the above-mentioned registers has a storage function, and the data transmission needs to be completed under the control of the processor 133. For example, for any receiving register, after the receiving register is full (for example, 8 bits), its flag position is 1. When the processor 133 polls the flag position of the peripheral, it will be found that the receiving register is full, and then send a control instruction to the DMA controller to control the DMA controller to connect the receiving register and the corresponding other peripherals, and the sending register of the other peripheral obtains the data in the receiving register. After the acquisition process is completed, the receiving register flag position is 0, and the sending register flag position of the other peripheral is 1. The processor 133 polls the sending register flag position of the other peripheral and finds that it is 1, and then sends a command to the sending register to control the data in the sending register to be sent.

[0101] In some optional embodiments of the present disclosure, the acquisition method may include any one of the following: the processor 133 reads the data in the receiving register into the register of the processor 133, and then writes it into the sending register of the other peripheral. The DMA controller reads the data in the receiving register into the register in the DMA controller and then writes it into the sending register of the other peripheral. The processor 133 reads the data in the receiving register into the memory, the processor 133 executes relevant instructions, performs corresponding operations on the data, and writes the data after the operation is performed into the sending register of the other peripheral.

[0102] In some optional embodiments of the present disclosure, the process of the second sending register 1321 acquiring the first audio data in the first receiving register 1311 may be: the processor 133 controls the DMA bus to connect the first receiving register 1311 of the first audio transmission unit 131 with the second sending register 1321 in the second audio transmission unit 132, and determines that the data transmission direction is from the first receiving register 1311 to the second sending register 1321, so that the first audio data cached in the first receiving register 1311 can be read in parallel to the second sending register 1321. After the acquisition is completed, it may also include: the flag position of the first receiving register 1311 is 0, and the flag position of the second sending register 1321 becomes 1. The processor 133 polls the flag position of the second sending register 1321 to be 1, and controls the first audio data cached in the second sending register 1321 to be sent to the signal processing module 14.

[0103] In some optional embodiments of the present disclosure, the process of the second sending register 1321 obtaining the first audio data in the first receiving register 1311 can also be: after the DMA controller reads the first audio data in the first receiving register 1311 into the register in the DMA controller, the DMA controller writes the first audio data into the second sending register 1321.

[0104] In some optional embodiments of the present disclosure, the process of the second sending register 1321 acquiring the first audio data in the first receiving register 1311 may also be: the processor 133 reads the first audio data in the first receiving register 1311 into the memory, and if the processor 133 has no relevant instructions to be executed, the processor 133 writes the first audio data in the memory into the second sending register 1321. If the processor 133 still has relevant instructions to be executed, the processor 133 performs a corresponding operation on the first audio data in the memory to obtain the first audio data after the operation is performed, and the processor 133 takes the first audio data after the operation is performed from the memory and writes it into the second sending register 1321.

[0105] The working principle of obtaining data from other registers is similar to the above process and will not be repeated here.

[0106] The device of this embodiment helps to achieve normal operation of the audio output function and the audio input function in two audio data output modes by setting a receiving register and a sending register in each unit in the control module 13.

[0107] like Figure 4 , which is a schematic diagram of the structure of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure.

[0108] In some optional embodiments of the present disclosure, the control module 13 includes: a first audio transmission unit 131 , a second audio transmission unit 132 and a data transmission unit 134 .

[0109] In some optional embodiments of the present disclosure, the first audio transmission unit 131 is connected to the decoding module 12. The second audio transmission unit 132 is respectively connected to the first audio transmission unit 131 and the signal processing module 14. The data transmission unit 134 is respectively connected to the second audio transmission unit 132 and the interface 11.

[0110] In some optional embodiments of the present disclosure, the first audio transmission unit 131 is configured to: receive the first audio data sent by the decoding module 12 .

[0111] In some optional embodiments of the present disclosure, the second audio transmission unit 132 is configured to: obtain the first audio data from the first audio transmission unit 131, obtain the second audio data from the data transmission unit 134, send the output audio data to the signal processing module 14, and receive the second processed audio data sent by the signal processing module 14.

[0112] In some optional embodiments of the present disclosure, the data transmission unit 134 is configured to: obtain the second processed audio data in the second audio transmission unit 132, transmit the second processed audio data to the terminal device 20 through the interface 11, and obtain the second audio data of the terminal device 20 through the interface 11.

[0113] In some optional embodiments of the present disclosure, after the decoding module 12 obtains the first audio data, the first audio data is sent to the first audio transmission unit 131. After the first audio transmission unit 131 receives the first audio data sent by the decoding module 12, the first audio transmission unit 131 can store the first audio data, for example, in a register. The second audio transmission unit 132 obtains the first audio data from the first audio transmission unit 131. Any of the above-mentioned acquisition methods can be adopted. For example, the sending register of the second audio transmission unit 132 is connected to the receiving register of the first audio transmission unit 131 through the DMA bus, and under the control of the processor, the first audio data stored in the first audio transmission unit 131 is read in parallel to the sending register of the second audio transmission unit 132. After that, the first audio data is sent from the sending register of the second audio transmission unit 132 to the signal processing module 14. The signal processing module 14 processes the output audio data to obtain the first processed audio data, and plays the first processed audio data through the audio playback device 30. The data transmission principle between each transmission unit can refer to the above-mentioned embodiment, which is not repeated here.

[0114] In some optional embodiments of the present disclosure, the terminal device 20 directly sends the second audio data to the control module 13, and the control module 13 directly sends the second processed audio data to the terminal device 20. That is, the audio data transmitted between the terminal device 20 and the control module 13 are all unpackaged audio data. After the data transmission unit 134 receives the second audio data of the terminal device 20 through the interface 11, the second audio data can be stored, for example, in a register. The second audio transmission unit 132 obtains the second audio data from the data transmission unit 134, and the second audio transmission unit 132 uses the second audio data as output audio data and sends the second audio data to the signal processing module 14. The signal processing module 14 processes the output audio data, obtains the first processed audio data, and plays the first processed audio data through the audio playback device 30.

[0115] In some optional embodiments of the present disclosure, after the audio acquisition device 40 acquires the input audio data, it sends it to the signal processing module 14. The signal processing module 14 processes the input audio data to obtain second processed audio data. The signal processing module 14 sends the second processed audio data to the second audio transmission unit 132. The second audio transmission unit 132 can store the second processed audio data. The data transmission unit 134 obtains the second processed audio data in the second audio transmission unit 132. The data transmission unit 134 sends the second processed audio data to the terminal device 20 through the interface 11.

[0116] The data acquisition method between the transmission units can refer to the aforementioned introduction to the principle of register acquisition of data, and the details will not be repeated here.

[0117] The device of this embodiment is connected to the second audio transmission unit through a data transmission unit, and the second audio transmission unit is connected to the signal processing module, so as to transmit the unpackaged second audio data of the terminal device to the signal processing module, and transmit the unpackaged second processed audio data obtained by the signal processing module to the terminal device.

[0118] like Figure 5 , which is a schematic diagram of the structure of an apparatus for audio data transmission provided by yet another exemplary embodiment of the present disclosure.

[0119] In some optional embodiments of the present disclosure, the first audio transmission unit 131 includes: a first receiving register 1311. The first receiving register 1311 is configured to: buffer the first audio data received by the first audio transmission unit 131 from the decoding module 12.

[0120] In some optional embodiments of the present disclosure, the second audio transmission unit 132 includes: a second sending register 1321 and a second receiving register 1322. The second receiving register 1322 is configured to: cache the second processed audio data received by the second audio transmission unit 132 from the signal processing module 14. The second sending register 1321 is configured to: cache the first audio data from the first audio transmission unit 131 acquired by the second audio transmission unit 132. Cache the second audio data from the data transmission unit 134 acquired by the second audio transmission unit 132.

[0121] In some optional embodiments of the present disclosure, the data transmission unit 134 includes: a data transmission register 1341 and a data reception register 1342. The data reception register 1342 is configured to: cache the second audio data from the terminal device 20 acquired by the data transmission unit 134. The data transmission register 1341 is configured to: cache the second processed audio data from the second audio transmission unit 132 acquired by the data transmission unit 134.

[0122] In some optional embodiments of the present disclosure, the specific working principle of the first receiving register 1311 can refer to the aforementioned embodiments and will not be elaborated here.

[0123] In some optional embodiments of the present disclosure, the specific working principles of the second sending register 1321 and the second receiving register 1322 are similar to those of the aforementioned embodiments, except that the second audio data cached by the second sending register 1321 comes from the data transmission unit 134 instead of from the processor 133 of the aforementioned embodiment.

[0124] In some optional embodiments of the present disclosure, the data transmission register 1341 is used to cache the second processed audio data from the second audio transmission unit 132 acquired by the data transmission unit 134. The data reception register 1342 is used to cache the second audio data from the terminal device 20 received by the data transmission unit 134.

[0125] The device of this embodiment realizes the parallel availability of the audio output function and the audio input function in two audio data output modes by coordinating the receiving register and the sending register of each unit in the control module.

[0126] like Figure 6 , which is a schematic diagram of the structure of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure.

[0127] In some optional embodiments of the present disclosure, the decoding module 12 includes: a decoding unit 121 , a separation unit 122 and a third audio transmission unit 123 .

[0128] In some optional embodiments of the present disclosure, the decoding unit 121 is connected to the interface 11. The separation unit 122 is connected to the decoding unit 121. The third audio transmission unit 123 is connected to the separation unit 122 and the control module 13 respectively.

[0129] In some optional embodiments of the present disclosure, the decoding unit 121 is configured to: when multimedia data sent by the terminal device 20 is received through the interface 11, decode the multimedia data to obtain decoded multimedia data.

[0130] In some optional embodiments of the present disclosure, the separation unit 122 is configured to: obtain decoded multimedia data and separate the first audio data from the decoded multimedia data.

[0131] In some optional embodiments of the present disclosure, the third audio transmission unit 123 is configured to: obtain the first audio data and send the first audio data to the control module 13 .

[0132] In some optional embodiments of the present disclosure, the decoding unit 121, the separation unit 122 and the third audio transmission unit 123 may adopt any implementable hardware combined with software configuration to implement the corresponding functions in the present disclosure.

[0133] In some optional embodiments of the present disclosure, the decoding unit 121 decodes the multimedia data to obtain decoded multimedia data when receiving multimedia data sent by the terminal device 20 through the interface 11. The decoding unit 121 can store the decoded multimedia data (for example, in a register of the decoding unit 121), or directly send the decoded multimedia data to the separation unit 122, or store the decoded multimedia data in the memory of the decoding module 12. The separation unit 122 obtains the decoded multimedia data and separates the first audio data from the decoded multimedia data. The separation unit 122 can store the first audio data, for example, in a register, in the memory of the decoding module 12, etc. The separation unit 122 can also send the first audio data to the third audio transmission unit 123. The third audio transmission unit 123 obtains the first audio data and sends the first audio data to the control module 13.

[0134] In some optional embodiments of the present disclosure, if the decoding unit 121 stores the decoded multimedia data, the separation unit 122 obtains the decoded multimedia data from the decoding unit 121 , for example, obtains the decoded multimedia data from a register of the decoding unit 121 .

[0135] In some optional embodiments of the present disclosure, if the decoding unit 121 sends the decoded multimedia data to the memory of the decoding module 12 for storage, the separation unit 122 reads the decoded multimedia data from the memory of the decoding module 12 .

[0136] In some optional embodiments of the present disclosure, if the decoding unit 121 sends the decoded multimedia data to the separation unit 122 , the separation unit 122 receives the decoded multimedia data sent by the decoding unit 121 .

[0137] In some optional embodiments of the present disclosure, if the separation unit 122 sends the first audio data to the memory of the decoding module 12 , the third audio transmission unit 123 reads the first audio data from the memory of the decoding module 12 .

[0138] In some optional embodiments of the present disclosure, if the separation unit 122 sends the first audio data to the third audio transmission unit 123 , the third audio transmission unit 123 receives the first audio data sent by the separation unit 122 .

[0139] In some optional embodiments of the present disclosure, if the separation unit 122 stores the first audio data, the third audio transmission unit 123 obtains the first audio data from the separation unit 122 , for example, obtains the first audio data from a register of the separation unit 122 .

[0140] In some optional embodiments of the present disclosure, the decoding unit 121 and the separation unit 122 in the decoding module 12 may be located in the CPU core of the decoding module, and the registers of the decoding unit 121 and the separation unit 122 are both registers of the CPU core. The method of acquiring data between the registers of the CPU core and other peripheral registers in the decoding module 12 and the method of acquiring data between the peripheral registers are similar to the method of acquiring data between the processor register in the aforementioned control module and other peripheral registers in the control module and the method of acquiring data between the peripheral registers, and will not be repeated here.

[0141] In some optional embodiments of the present disclosure, Figure 6 Based on the device shown in the figure, the control module 13 can be the aforementioned Figures 2 to 5 The third audio transmission unit 123 sends the first audio data to the first audio transmission unit 131 in the control module.

[0142] The device of this embodiment, through the decoding unit 121, the separation unit 122 and the third audio transmission unit 123, effectively realizes the decoding of multimedia data of the terminal device, the separation of audio and video, obtains the first audio data, and transmits the first audio data to the control module 13, which facilitates the accurate transmission of audio data in method one.

[0143] like Figure 7 , which is a schematic diagram of the structure of an apparatus for audio data transmission provided by yet another exemplary embodiment of the present disclosure.

[0144] In some optional embodiments of the present disclosure, the third audio transmission unit 123 includes: a third sending register 1231. The third sending register 1231 is configured to: buffer the first audio data acquired by the third audio transmission unit.

[0145] In some optional embodiments of the present disclosure, the third sending register 1231 is similar to the aforementioned sending register (e.g., the second sending register), and will not be described in detail herein. The first audio data acquired by the third audio transmission unit 123 is cached in the third sending register 1231. Then, the CPU core in the decoding module 12 can send a command to the third sending register, so that the third sending register sends the first audio data to the control module 13.

[0146] In some optional embodiments of the present disclosure, Figure 7Based on the device shown in the figure, the control module 13 can be the aforementioned Figures 2 to 5 The third audio transmission unit 123 sends the first audio data to the first audio transmission unit 131 in the control module.

[0147] In some optional embodiments of the present disclosure, the third audio transmission unit 123 can be connected to the first audio transmission unit 131 through any implementable bus interface, for example, connected to the first audio transmission unit 131 through an I2S interface and an I2S bus, so as to send the first audio data to the first audio transmission unit 131 of the control module 13.

[0148] like Figure 8 , which is a schematic diagram of the structure of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure.

[0149] In some optional embodiments of the present disclosure, the signal processing module 14 includes: a fourth audio transmission unit 141 , a sound effect processing unit 142 and a fifth audio transmission unit 143 .

[0150] In some optional embodiments of the present disclosure, the fourth audio transmission unit 141 is connected to the control module 13. The sound effect processing unit 142 is connected to the fourth audio transmission unit 141 and is also used to connect to the audio acquisition device 40. The fifth audio transmission unit 143 is connected to the sound effect processing unit 142 and is also used to connect to the audio playback device 30.

[0151] In some optional embodiments of the present disclosure, the fourth audio transmission unit 141 is configured to: receive the output audio data sent by the control module 13 , receive the second processed audio data sent by the sound effect processing unit 142 , and send the second processed audio data to the control module 13 .

[0152] In some optional embodiments of the present disclosure, the sound effect processing unit 142 is configured to: obtain output audio data from the fourth audio transmission unit 141. Perform sound effect processing on the output audio data to obtain first processed audio data. Send the first processed audio data to the fifth audio transmission unit 143. Receive input audio data sent by the audio acquisition device 40. Process the input audio data to obtain second processed audio data. Send the second processed audio data to the fourth audio transmission unit 141.

[0153] In some optional embodiments of the present disclosure, the fifth audio transmission unit 143 is configured to: send the first processed audio data to the audio playback device 30 so that the first processed audio data is played through the audio playback device 30.

[0154] In some optional embodiments of the present disclosure, the specific implementation of the fourth audio transmission unit 141 and the fifth audio transmission unit 143 can refer to the transmission unit (such as the second audio transmission unit 132) of the aforementioned embodiment, and will not be repeated here.

[0155] In some optional embodiments of the present disclosure, the sound effect processing unit 142 can be used to perform sound effect processing on output audio data and input audio data to improve the quality of the audio data and help improve the user experience.

[0156] In some optional embodiments of the present disclosure, the fourth audio transmission unit 141 receives the output audio data sent by the control module 13. The fourth audio transmission unit 141 can store the output audio data, for example, in a register. Then the sound effect processing unit 142 can obtain the output audio data from the fourth audio transmission unit. The fourth audio transmission unit 141 can also send the output audio data to the memory of the signal processing module 14, and the sound effect processing unit 142 can read the output audio data from the memory. The sound effect processing unit 142 performs sound effect processing on the output audio data to obtain first processed audio data. The sound effect processing unit 142 sends the first processed audio data to the fifth audio transmission unit 143. The fifth audio transmission unit 143 sends the first processed audio data to the audio playback device 30 to play the first processed audio data through the audio playback device 30.

[0157] In some optional embodiments of the present disclosure, the sound effect processing unit 142 receives the input audio data sent by the audio acquisition device 40, performs sound effect processing on the input audio data, and obtains second processed audio data. The sound effect processing unit 142 sends the second processed audio data to the fourth audio transmission unit 141. The fourth audio transmission unit 141 sends the second processed audio data to the control module 13, and transmits the second processed audio data to the terminal device 20 through the control module 13. For example, the control module 13 sends the second processed audio data to the terminal device 20. The control module 13 can also package the second processed audio data to obtain second packaged audio data, and send the second packaged audio data to the terminal device 20 through the interface 11.

[0158] In some optional embodiments of the present disclosure, the sound effect processing performed by the sound effect processing unit 142 on the output audio data and the input audio data may be implemented based on a corresponding sound effect processing algorithm, such as a noise reduction algorithm, a bass algorithm, and the like.

[0159] In some optional embodiments of the present disclosure, the sound effect processing unit 142 in the signal processing module 14 may be located in the CPU core of the signal processing module 14, and the registers of the sound effect processing unit 142 are the registers of the CPU core. The method of acquiring data between the registers of the CPU core and other peripheral registers in the signal processing module 14 and the method of acquiring data between the peripheral registers are similar to the method of acquiring data between the processor registers in the aforementioned control module and other peripheral registers in the control module and the method of acquiring data between the peripheral registers, and will not be repeated here.

[0160] The device of this embodiment can realize the transmission of audio data between the signal processing module and the control module, the audio acquisition device and the audio playback device through the fourth audio transmission unit, the sound effect processing unit and the fifth audio transmission unit, and then perform sound effect processing on the output audio data and the input audio data in combination with the sound effect processing unit, which helps to improve the quality of the output audio data and the input audio data, thereby improving the user's auditory experience.

[0161] In some optional embodiments of the present disclosure, Figure 8 Based on the device shown in FIG. 1 , at least one of the decoding module 12 and the control module 13 can adopt the structure provided by any of the above embodiments. For example, the decoding module 12 can adopt Figure 6 to Figure 7 The control module 13 can adopt any structure. Figures 2 to 5 Any structure in .

[0162] like Fig. 9 , which is a schematic diagram of the structure of an apparatus for audio data transmission provided by yet another exemplary embodiment of the present disclosure.

[0163] In some optional embodiments of the present disclosure, the fourth audio transmission unit 141 includes: a fourth sending register 1411 and a fourth receiving register 1412 .

[0164] In some optional embodiments of the present disclosure, the fourth receiving register 1412 is configured to cache the output audio data from the control module 13 received by the fourth audio transmission unit 141 .

[0165] In some optional embodiments of the present disclosure, the fourth sending register 1411 is configured to: buffer the second processed audio data received by the fourth audio transmission unit 141 from the sound effect processing unit 142 .

[0166] In some optional embodiments of the present disclosure, the fifth audio transmission unit 143 includes a fifth sending register 1431. The fifth sending register 1431 is configured to cache the first processed audio data received by the fifth audio transmission unit 143 from the sound effect processing unit 142.

[0167] In some optional embodiments of the present disclosure, the specific working principles of the receiving register and the sending register in the fourth audio transmission unit 141 and the fifth audio transmission unit 143 can be found in the aforementioned embodiments and will not be elaborated here.

[0168] In some optional embodiments of the present disclosure, after receiving the output audio data from the control module 13, the fourth audio transmission unit 141 caches the output audio data in the fourth receiving register 1412. The sound effect processing unit 142 can read the output audio data from the fourth receiving register 1412 through the DMA bus. It is also possible that the CPU core in the signal processing module 14 reads the output audio data in the fourth receiving register 1412 into the memory of the signal processing module 14, and the sound effect processing unit 142 searches the memory for the output audio data. It is also possible that the DMA controller reads the output audio data in the fourth receiving register 1412 into the register of the DMA controller, and the sound effect processing unit 142 obtains the output audio data from the register of the DMA controller. The sound effect processing unit 142 performs sound effect processing on the output audio data to obtain the first processed audio data, and sends the first processed audio data to the fifth audio transmission unit 143. After receiving the first processed audio data, the fifth audio transmission unit 143 caches the first processed audio data to the fifth sending register 1431. The fifth sending register 1431 sends the first processed audio data to the audio playing device 30 for playing under the control of the CPU core of the signal processing module 14 .

[0169] In some optional embodiments of the present disclosure, after receiving the input audio data sent by the audio acquisition device 40, the sound effect processing unit 142 processes the input audio data to obtain second processed audio data. The sound effect processing unit 142 sends the second processed audio data to the fourth audio transmission unit 141. After receiving the second processed audio data, the fourth audio transmission unit 141 caches the second processed audio data in the fourth sending register 1411. The fourth sending register 1411 sends the second processed audio data to the control module 13 via the bus.

[0170] In some optional embodiments of the present disclosure, the fifth audio transmission unit 143 may further include a fifth receiving register for cooperating with the fifth audio transmission unit to complete the reception and caching of other related data, which may be specifically set according to actual needs.

[0171] In some optional embodiments of the present disclosure, Fig. 9 Based on the device shown in FIG. 1 , at least one of the decoding module 12 and the control module 13 can adopt the structure provided by any of the above embodiments. For example, the decoding module 12 can adopt Figure 6 to Figure 7 The control module 13 can adopt any structure. Figures 2 to 5 Any structure in .

[0172] In some optional embodiments of the present disclosure, Fig.10 FIG. 1 is a schematic diagram of a structure of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure. Fig.10 As shown, the decoding module 12 includes a decoding unit 121, a separation unit 122 and a third audio transmission unit 123. The third audio transmission unit 123 includes a third sending register 1231. The control module 13 includes a data transmission unit 134, a processor 133, a first audio transmission unit 131 and a second audio transmission unit 132. The first audio transmission unit 131 includes a first receiving register 1311. The second audio transmission unit 132 includes a second sending register 1321 and a second receiving register 1322. The data transmission unit 134 includes a data sending register 1341 and a data receiving register 1342. The signal processing module 14 includes a fourth audio transmission unit 141, a sound effect processing unit 142 and a fifth audio transmission unit 143. The fourth audio transmission unit 141 includes a fourth sending register 1411 and a fourth receiving register 1412. The fifth audio transmission unit 143 includes a fifth sending register 1431. For the multimedia data from the terminal device 20, the first processed audio data corresponding to the multimedia data is sent to the audio playback device 30 for playback through the transmission path of the interface 11→decoding unit 121→separation unit 122→third audio transmission unit 123→first audio transmission unit 131→second audio transmission unit 132→fourth audio transmission unit 141→sound effect processing unit 142→fifth audio transmission unit 143. For the first packaged audio data from the terminal device, the first processed audio data corresponding to the first packaged audio data is sent to the audio playback device 30 for playback through the transmission path of the interface 11→data transmission unit 134→processor 135→second audio transmission unit 132→fourth audio transmission unit 141→sound effect processing unit 142→fifth audio transmission unit 143. For the input audio data collected by the audio collection device 40, the second packaged audio data corresponding to the input audio data is sent to the terminal device 20 through the transmission path of the sound effect processing unit 142→the fourth audio transmission unit 141→the second audio transmission unit 132→the processor 135→the data transmission unit 134→the interface 11. Among them, the working principle of each unit and register in each module can refer to the above embodiment, which will not be repeated here.

[0173] In some optional embodiments of the present disclosure, Fig.10 Based on the device shown in the figure, the control module 13 can also be replaced by Figure 4 , Figure 5The structure of the control module 13 shown in any one of the above is completed. The output transmission of the second audio data from the terminal 20 and the input transmission of the input audio data from the audio acquisition device 40 are completed, and the specific details are not repeated.

[0174] In some optional embodiments of the present disclosure, the apparatus of the embodiments of the present disclosure further includes at least one of the following: an audio playback device 30 , an audio acquisition device 40 .

[0175] The audio playing device 30 is connected to the signal processing module 14. The audio collecting device 40 is connected to the signal processing module 14.

[0176] The device of this embodiment includes at least one of the audio playback device 30 and the audio acquisition device 40, so that the device of the present invention can have corresponding audio playback and audio acquisition functions, which helps to improve the versatility of the device of the present invention, so that the device of the present invention can realize audio data acquisition and playback even when no external audio playback device and audio acquisition device can be provided.

[0177] In some optional embodiments of the present disclosure, Fig.11 FIG. 1 is a schematic diagram of a structure of an apparatus for audio data transmission provided by another exemplary embodiment of the present disclosure. Fig.11 As shown, the interface 11 adopts a Type-C interface, the audio data transmission mode 1 is DP transmission, and the mode 2 is UAC transmission. The decoding module 12 is connected to the control module 13 through a unidirectional I2S bus. The control module 13 is connected to the Type-C interface through the UAC bus, and the control module 13 is also connected to the signal processing module 14 through a bidirectional I2S bus. Fig.11 The device shown is only an exemplary implementation. In actual applications, the interface 11 is not limited to the Type-C interface, the audio data transmission method 1 is not limited to the DP transmission method, and the method 2 is not limited to the UAC transmission method. The connection bus between the modules is not limited to the I2S bus.

[0178] The above optional embodiments of the present disclosure may be implemented separately or in any combination without conflict. The specific configuration may be based on actual needs and the present disclosure does not limit this.

[0179] Fig.12 is a schematic diagram of the structure of an electronic device provided by an exemplary embodiment of the present disclosure. Fig.12 As shown, the electronic device includes the apparatus 10 for audio data transmission provided by any of the above embodiments, and also includes an audio playback device 30 and an audio acquisition device 40.

[0180] The audio playing device 30 is connected to the device 10 for audio data transmission. The audio collecting device 40 is connected to the device 10 for audio data transmission.

[0181] In some optional embodiments of the present disclosure, the apparatus 10 for audio data transmission is also used to connect to a terminal device 20 to implement audio data transmission between the terminal device 20 and the audio playback device 30 , and to implement audio data transmission between the audio acquisition device 40 and the terminal device 20 .

[0182] The specific implementation of the electronic device of the embodiment of the present disclosure is similar or partially similar to the specific implementation of the device 10 for audio data transmission of the embodiment of the present disclosure. Please refer to the part of the device 10 for audio data transmission for details. In order to reduce redundancy, it will not be repeated here.

[0183] The various optional embodiments, optional implementation methods and optional examples disclosed in the embodiments of the present disclosure may be flexibly selected and combined as needed without conflict, so as to achieve corresponding functions and effects, and the present disclosure does not list them one by one.

[0184] The present disclosure also provides a head mounted display device, such as Fig.13 As shown in FIG. 1 , it is a schematic diagram of the structure of a head mounted display device provided by an exemplary embodiment of the present disclosure. Fig.13 As shown, the head mounted display device includes: a display component 50, an apparatus 10 for audio data transmission provided in any of the above embodiments, an audio playback device 30 and an audio acquisition device 40.

[0185] The audio playing device 30 is connected to the device 10 for audio data transmission. The audio collecting device 40 is connected to the device 10 for audio data transmission.

[0186] In some optional embodiments of the present disclosure, the apparatus 10 for audio data transmission is also used to connect to a terminal device 20 to implement audio data transmission between the terminal device 20 and the audio playback device 30 , and to implement audio data transmission between the audio acquisition device 40 and the terminal device 20 .

[0187] In some optional embodiments of the present disclosure, the display component 50 can be connected to the device 10 for audio data transmission, for example, connected to the decoding module 12 in the device 10, and the decoding module 12 can also separate the video data (or image data) from the unpacked multimedia data, and send the video data to the display component 50 so as to display the video data through the display component 50.

[0188] The specific implementation of the head-mounted display device of the embodiment of the present disclosure is similar or partially similar to the specific implementation of the device 10 for audio data transmission of the embodiment of the present disclosure. Please refer to the part of the device 10 for audio data transmission for details. In order to reduce redundancy, it will not be repeated here.

[0189] An embodiment of the present disclosure further provides an electronic device, including: a processor, and a memory for storing instructions executable by the processor.

[0190] The processor is used to read the executable instructions from the memory and execute the executable instructions to implement the functions of any one of the decoding module 12, the control module 13, and the signal processing module 14 provided in any of the above embodiments of the present disclosure.

[0191] Fig.14 The electronic device 100 includes one or more processors 110 and a memory 120 .

[0192] The processor 110 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 100 to perform desired functions.

[0193] The memory 120 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 110 may run the program instructions to implement the methods of the various embodiments of the present disclosure described above and / or other desired functions. Various contents such as input signals, signal components, noise components, etc. may also be stored in the computer-readable storage medium.

[0194] In one example, the electronic device 100 may further include: an input device 130 and an output device 140 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0195] For example, the input device 130 may be the microphone or microphone array mentioned above, which is used to capture the input signal of the sound source as the input audio data, or obtain the input audio data after performing signal processing on the input signal.

[0196] In addition, the input device 130 may also include, for example, a keyboard, a mouse, and the like.

[0197] The output device 140 can output various information to the outside, including the determined distance information, direction information, etc. The output device 140 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0198] Of course, to simplify, Fig.14 Only some of the components related to the present disclosure in the electronic device 100 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 100 may also include any other appropriate components.

[0199] In addition to the above methods and devices, the embodiments of the present disclosure may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to perform the functions described in the above controller part of this specification according to various embodiments of the present disclosure.

[0200] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0201] In addition, the embodiments of the present disclosure may also be a computer-readable storage medium on which a computer program is stored. The computer program is used to execute the functions of the controller according to various embodiments of the present disclosure described above in this specification.

[0202] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0203] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, and are not limitations. The above details do not limit the present disclosure to the necessity of adopting the above specific details to be implemented.

[0204] Each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the electronic device embodiment, since it basically corresponds to the connector embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the connector embodiment.

[0205] The block diagrams of the devices and equipment involved in this disclosure are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, devices, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The word "such as" used here refers to the phrase "such as but not limited to", and can be used interchangeably with it.

[0206] The connector and electronic device of the present disclosure may be implemented in many ways. For example, the connector and electronic device of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. In addition, in some embodiments, the present disclosure may also be implemented as a program recorded in a recording medium, which includes machine-readable instructions for implementing a controller according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the functions of a controller according to the present disclosure.

[0207] It should also be pointed out that in the connector and electronic device of the present disclosure, each component can be decomposed and / or reassembled, and these decompositions and / or reassemblies should be regarded as equivalent solutions of the present disclosure.

[0208] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0209] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present disclosure to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A device for audio data transmission, comprising: Interface, used for connecting with terminal equipment; A decoding module connected to the interface; A control module, connected to the interface and the decoding module respectively; A signal processing module connected to the control module, the signal processing module is also used to connect to an audio playback device and an audio acquisition device; The decoding module is configured to: in response to receiving multimedia data sent by the terminal device through the interface, decode the multimedia data to obtain decoded multimedia data; separate the first audio data from the decoded multimedia data; sending the first audio data to the control module; The control module is configured to: in response to receiving the first audio data, send the first audio data to the signal processing module; In response to acquiring second audio data of the terminal device through the interface, sending the second audio data to the signal processing module; The signal processing module is configured as follows: In response to receiving the output audio data, processing the output audio data to obtain first processed audio data, wherein the output audio data is any one of the first audio data and the second audio data; sending the first processed audio data to the audio playback device so as to play the first processed audio data through the audio playback device; In response to receiving the input audio data sent by the audio acquisition device, the input audio data is processed to obtain second processed audio data; and the second processed audio data is sent to the control module so as to transmit the second processed audio data to the terminal device through the control module.

2. The device according to claim 1, wherein: The control module is configured to: in response to receiving first packaged audio data sent by the terminal device through the interface, unpack the first packaged audio data to obtain the unpacked second audio data; and send the second audio data to the signal processing module.

3. The device according to claim 2, wherein: The control module is configured to: in response to receiving the second processed audio data, package the second processed audio data to obtain second packaged audio data; and send the second packaged audio data to the terminal device through the interface.

4. The device according to claim 1, wherein: The control module comprises: A first audio transmission unit, connected to the decoding module; A second audio transmission unit, connected to the first audio transmission unit and the signal processing module respectively; A data transmission unit connected to the second audio transmission unit and the interface respectively; The first audio transmission unit is configured to: receive the first audio data sent by the decoding module; The second audio transmission unit is configured to: obtain the first audio data from the first audio transmission unit; obtain the second audio data from the data transmission unit; send the output audio data to the signal processing module; receive the second processed audio data sent by the signal processing module; The data transmission unit is configured to: obtain the second processed audio data in the second audio transmission unit; transmit the second processed audio data to the terminal device through the interface; and obtain the second audio data of the terminal device through the interface.

5. The device according to claim 3, wherein: The control module comprises: A first audio transmission unit, connected to the decoding module; A second audio transmission unit, connected to the first audio transmission unit and the signal processing module respectively; a processor, connected to the second audio transmission unit; a data transmission unit, connected to the processor and the interface respectively; The first audio transmission unit is configured to: receive the first audio data sent by the decoding module; The second audio transmission unit is configured to: obtain the first audio data from the first audio transmission unit; receive the second audio data sent by the processor; send the output audio data to the signal processing module; receive the second processed audio data sent by the signal processing module; The processor is configured to: obtain the second processed audio data in the second audio transmission unit; package the second processed audio data to obtain the second packaged audio data; send the second packaged audio data to the data transmission unit; obtain the first packaged audio data in the data transmission unit; unpack the first packaged audio data to obtain the unpacked second audio data; send the second audio data to the second audio transmission unit; The data transmission unit is configured to: send the second packaged audio data to the terminal device through the interface; and receive the first packaged audio data sent by the terminal device through the interface.

6. The device according to claim 4, wherein: The first audio transmission unit includes: a first receiving register; The first receiving register is configured to: buffer the first audio data received by the first audio transmission unit from the decoding module; The second audio transmission unit includes: a second receiving register and a second sending register; The second receiving register is configured to: buffer the second processed audio data received by the second audio transmission unit from the signal processing module; The second sending register is configured to: cache the first audio data from the first audio transmission unit acquired by the second audio transmission unit; cache the second audio data from the data transmission unit acquired by the second audio transmission unit; The data transmission unit comprises: a data receiving register and a data sending register; The data receiving register is configured to: buffer the second audio data from the terminal device acquired by the data transmission unit; The data sending register is configured to: buffer the second processed audio data from the second audio transmission unit obtained by the data transmission unit.

7. The device according to claim 5, wherein: The first audio transmission unit includes: a first receiving register; The first receiving register is configured to: buffer the first audio data received by the first audio transmission unit from the decoding module; The second audio transmission unit includes: a second receiving register and a second sending register; The second receiving register is configured to: buffer the second processed audio data received by the second audio transmission unit from the signal processing module; The second sending register is configured to: cache the first audio data from the first audio transmission unit acquired by the second audio transmission unit; cache the second audio data from the processor received by the second audio transmission unit; The data transmission unit comprises: a data receiving register and a data sending register; The data receiving register is configured to: buffer the first packaged audio data received by the data transmission unit from the terminal device; The data sending register is configured to: buffer the second packaged audio data received by the data transmission unit from the processor.

8. The device according to any one of claims 1 to 7, wherein: The decoding module comprises: A decoding unit connected to the interface; A separation unit connected to the decoding unit; A third audio transmission unit, connected to the separation unit and the control module respectively; The decoding unit is configured to: when receiving multimedia data sent by the terminal device through the interface, decode the multimedia data to obtain the decoded multimedia data; The separation unit is configured to: obtain the decoded multimedia data; separate the first audio data from the decoded multimedia data; The third audio transmission unit is configured to: obtain the first audio data; and send the first audio data to the control module.

9. The device according to claim 8, wherein: The third audio transmission unit includes: a third sending register; The third sending register is configured to: buffer the first audio data acquired by the third audio transmission unit.

10. The device according to any one of claims 1 to 7, wherein: The signal processing module comprises: a fourth audio transmission unit connected to the control module; A sound effect processing unit, connected to the fourth audio transmission unit, and also used to connect to the audio acquisition device; a fifth audio transmission unit, connected to the sound effect processing unit, and also used to connect to the audio playback device; The fourth audio transmission unit is configured to: receive the output audio data sent by the control module; receive the second processed audio data sent by the sound effect processing unit; and send the second processed audio data to the control module; The sound effect processing unit is configured to: obtain the output audio data from the fourth audio transmission unit; perform sound effect processing on the output audio data to obtain first processed audio data; send the first processed audio data to the fifth audio transmission unit; receive the input audio data sent by the audio acquisition device; process the input audio data to obtain the second processed audio data; send the second processed audio data to the fourth audio transmission unit; The fifth audio transmission unit is configured to: send the first processed audio data to the audio playback device so that the first processed audio data is played through the audio playback device.

11. The device according to claim 10, wherein: The fourth audio transmission unit includes: a fourth sending register and a fourth receiving register; The fourth receiving register is configured to: buffer the output audio data received by the fourth audio transmission unit from the control module; The fourth sending register is configured to: buffer the second processed audio data received by the fourth audio transmission unit from the sound effect processing unit; The fifth audio transmission unit includes: a fifth sending register; The fifth sending register is configured to: buffer the first processed audio data received by the fifth audio transmission unit from the sound effect processing unit.

12. The device according to any one of claims 1 to 7, wherein: Also includes at least one of the following: An audio playback device connected to the signal processing module; The audio acquisition device is connected to the signal processing module.

13. An electronic device, comprising: The device for transmitting audio data as claimed in any one of claims 1 to 11; an audio playback device connected to the device for audio data transmission; The audio acquisition device is connected to the device for audio data transmission.

14. A head mounted display device, comprising: Display components; The device for transmitting audio data as claimed in any one of claims 1 to 11; an audio playback device connected to the device for audio data transmission; The audio acquisition device is connected to the device for audio data transmission.

Images