Audio transmission method and apparatus based on visible light

Abstract

The application discloses a visible light-based audio transmission method and device. The method comprises the following steps: sending a check value to a receiving end, wherein the check value is used to determine whether the to-be-transmitted audio signal needs to be compensated at the receiving end; when a response value of the receiving end is received, a compensation code is generated based on the response value, wherein the response value is generated by the receiving end when it is determined that the to-be-transmitted audio signal needs to be compensated according to the check value; the to-be-transmitted audio signal is compensated by using the compensation code to obtain a compensated audio signal; the compensated audio signal is carrier-modulated to output a driving signal to drive the visible light emitter to emit visible light carrying the compensated audio signal to the receiving end, and the compensated audio signal is played at the receiving end. The application solves the technical problem that the communication stability is reduced due to the fact that the visible light is easily disturbed by ambient light in the communication process in the related art.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of visible light communication, in particular to a visible light-based audio transmission method and device. BACKGROUND

[0002] Visible light communication is a new wireless transmission technology, which has the advantages of rich spectrum resources, large transmission bandwidth and high speed, low construction cost, energy saving and environmental protection, good information transmission security, no electromagnetic radiation in transmission and strong anti-interference ability, and can be widely applied in television terminals, sound boxes, home furnishing and other fields. At present, visible light communication technology research and application has been widely valued.

[0003] However, at present, visible light communication has begun to be studied in the application of audio transmission. Due to the existence of environmental light interference to the communication visible light and the interference in the process of visible light emission and reception, the communication stability is reduced and the transmission audio signal is distorted due to the error code, which further leads to the decline of audio quality, affecting the reliability of visible light transmission audio signal and the audio user experience.

[0004] In view of the problem that the communication stability is reduced due to the interference of environmental light to the communication visible light in the related technology, at present, no effective solution has been proposed. SUMMARY

[0005] The embodiments of the present application provide a visible light-based audio transmission method and device to at least solve the technical problem that the communication stability is reduced due to the interference of environmental light to the communication visible light in the related technology.

[0006] According to an aspect of an embodiment of the present application, a visible light-based audio transmission method is provided, comprising: sending a check value to a receiving end, wherein the check value is used to determine whether the to-be-transmitted audio signal needs to be compensated at the receiving end; when a response value of the receiving end is received, generating a compensation code based on the response value, wherein the response value is generated by the receiving end when it is determined that the to-be-transmitted audio signal needs to be compensated according to the check value; compensating the to-be-transmitted audio signal by using the compensation code to obtain a compensated audio signal; carrier modulating the compensated audio signal to output a driving signal to drive the visible light emitter to emit visible light carrying the compensated audio signal to the receiving end, wherein the compensated audio signal is played at the receiving end.

[0007] Optionally, the visible light-based audio transmission method further comprises: decoding an initial audio signal to obtain a decoded audio signal; segmenting the decoded audio signal to obtain a plurality of audio segments; and synthesizing a plurality of audio blocks composed of the plurality of audio segments to obtain the to-be-transmitted audio signal.

[0008] Optionally, after segmenting the decoded audio signal to obtain a plurality of audio segments, the visible light based audio transmission method further comprises: grouping each predetermined number of audio segments in the plurality of audio segments into an audio block to obtain a plurality of audio blocks; and storing the plurality of audio blocks in a block manner.

[0009] Optionally, synthesizing the plurality of audio blocks to obtain the audio signal to be transmitted comprises: comparing audio signal values of audio segments in each of the plurality of audio blocks with an audio reference value to obtain comparison results; determining one or more audio blocks in which audio signal values of a continuous predetermined number of audio segments are all less than or equal to the audio reference value as marked audio blocks to obtain one or more marked audio blocks; and synthesizing the one or more marked audio blocks to obtain the audio signal to be transmitted.

[0010] Optionally, synthesizing the one or more marked audio blocks to obtain the audio signal to be transmitted comprises: obtaining audio signal values of audio segments in the one or more marked audio blocks; replacing audio signal values of a first audio segment in the marked audio block with a preset marker and replacing audio signal values of a second audio segment in the marked audio block with the check value to obtain a marked audio segment, wherein the first audio segment is a starting audio segment of the marked audio segment, and the second audio segment is an ending audio segment of the marked audio segment and a predetermined number of audio segments adjacent to the ending audio segment; and synthesizing the marked audio segment to obtain the audio signal to be transmitted.

[0011] Optionally, generating the compensation code based on the response value comprises: taking a response reference value and the response value as parameters of a compensation curve, and obtaining the compensation code by using the compensation curve, wherein the response reference value is pre-set according to ambient light.

[0012] Optionally, compensating the audio signal to be transmitted by using the compensation code to obtain a compensated audio signal comprises: compensating audio signal values of each segment in the audio signal to be transmitted and check values of each segment in the audio signal to be transmitted by using the compensation code to obtain the compensated audio signal.

[0013] Optionally, carrier modulating the compensated audio signal to output a driving signal to drive a visible light emitter to emit visible light carrying the compensated audio signal to the receiving end comprises: modulating the compensated audio signal to obtain the driving signal; converting the driving signal into an electrical signal; converting the electrical signal into visible light carrying the compensated audio signal by using the visible light emitter, and transmitting the visible light to the receiving end, so that the receiving end analyzes and plays the visible light.

[0014] According to another aspect of the embodiments of the present application, there is also provided a visible light based audio transmission method, comprising: receiving a check value sent by a transmitting end, wherein the check value is used to determine whether compensation is needed for a to-be-transmitted audio signal; generating a response value when it is determined according to the check value that the to-be-transmitted audio signal needs to be compensated; sending the response value to the transmitting end, wherein the response value is used to generate a compensation code in the transmitting end, the compensation code is used to compensate the to-be-transmitted audio signal to obtain a compensated audio signal, and the compensated audio signal is used to modulate a carrier wave in the transmitting end to output a driving signal to drive a visible light transmitter to emit visible light carrying the compensated audio signal; and after receiving the visible light, parsing the visible light to obtain the compensated audio signal and playing the compensated audio signal.

[0015] According to another aspect of the embodiments of the present application, there is also provided a visible light based audio transmission apparatus, comprising: a first sending unit configured to send a check value to a receiving end, wherein the check value is used to determine whether compensation is needed for a to-be-transmitted audio signal in the receiving end; a first generating unit configured to generate a compensation code based on a response value received from the receiving end, wherein the response value is generated by the receiving end when it is determined according to the check value that the to-be-transmitted audio signal needs to be compensated; a compensation unit configured to compensate the to-be-transmitted audio signal by using the compensation code to obtain a compensated audio signal; and a transmitting unit configured to modulate a carrier wave of the compensated audio signal to output a driving signal to drive a visible light transmitter to emit visible light carrying the compensated audio signal to the receiving end, wherein the compensated audio signal is used to be played in the receiving end.

[0016] Optionally, the visible light based audio transmission apparatus further comprises: a decoding unit configured to decode an initial audio signal to obtain a decoded audio signal; a segmenting unit configured to segment the decoded audio signal to obtain a plurality of audio segments; and a synthesizing unit configured to synthesize a plurality of audio blocks composed of the plurality of audio segments to obtain the to-be-transmitted audio signal.

[0017] Optionally, the visible light based audio transmission apparatus further comprises: a blocking unit configured to, after the plurality of audio segments are obtained by segmenting the decoded audio signal, group every predetermined number of the plurality of audio segments into an audio block to obtain the plurality of audio blocks; and a storage unit configured to block store the plurality of audio blocks.

[0018] Optionally, the synthesizing unit comprises: a comparing module configured to compare the audio signal value of each audio segment in the plurality of audio blocks with an audio reference value to obtain a comparison result; a first obtaining module configured to determine one or more audio blocks in which a continuous predetermined number of audio signal values are less than or equal to the audio reference value as marked audio blocks to obtain one or more marked audio blocks; and a synthesizing module configured to synthesize the one or more marked audio blocks to obtain the to-be-transmitted audio signal.

[0019] Optionally, the synthesizing unit comprises: a second obtaining module configured to obtain the audio signal value of an audio segment in the one or more marked audio blocks; a replacing module configured to replace the audio signal value of a first audio segment in the marked audio block with a preset marker and replace the audio signal value of a second audio segment in the marked audio block with the check value to obtain a marked audio segment, wherein the first audio segment is a starting audio segment of the marked audio segment and the second audio segment is an ending audio segment of the marked audio segment and a predetermined number of audio segments adjacent to the ending audio segment; and a synthesizing module configured to synthesize the marked audio segment to obtain the to-be-transmitted audio signal.

[0020] Optionally, the first generating unit comprises: a third obtaining module configured to use the response reference value and the response value as parameters of a compensation curve to obtain the compensation code by using the compensation curve, wherein the response reference value is pre-set according to ambient light.

[0021] Optionally, the compensating unit comprises: a compensating module configured to compensate the audio signal value of each segment in the to-be-transmitted audio and the check value of each segment in the to-be-transmitted audio by using the compensation code to obtain the compensated audio signal.

[0022] Optionally, the transmitting unit comprises: a modulating module configured to modulate the compensated audio signal to obtain the driving signal; a converting module configured to convert the driving signal into an electric signal; and a transmitting module configured to convert the electric signal into visible light carrying the compensated audio signal by using the visible light transmitter and transmit the visible light to the receiving end, so that the receiving end analyzes the visible light and plays it.

[0023] According to another aspect of the embodiments of the present application, there is further provided a visible light based audio transmission device, comprising: a receiving unit configured to receive a check value sent by a transmitting end, wherein the check value is used to determine whether compensation needs to be performed on a to-be-transmitted audio signal; a second generating unit configured to generate a response value when it is determined according to the check value that the compensation needs to be performed on the to-be-transmitted audio signal; a second sending unit configured to send the response value to the transmitting end, wherein the response value is used to generate a compensation code in the transmitting end, the compensation code is used to compensate the to-be-transmitted audio signal to obtain a compensated audio signal, and the compensated audio signal is used to modulate a carrier wave in the transmitting end to output a driving signal to drive a visible light transmitter to emit visible light carrying the compensated audio signal; and a processing unit configured to parse the visible light to obtain the compensated audio signal after receiving the visible light, and play the compensated audio signal.

[0024] According to another aspect of the embodiments of the present application, there is further provided a visible light based audio transmission system, comprising: a transmitting end comprising the visible light based audio transmission device in the above embodiment, and a receiving end comprising the visible light based audio transmission device in the above embodiment; the transmitting end communicates with the receiving end; wherein the transmitting end is configured to modulate a carrier wave of the compensated audio signal to output a driving signal to drive a visible light transmitter to emit visible light carrying the compensated audio signal to the receiving end, wherein the compensated audio signal is used to play in the receiving end; and the receiving end is configured to parse the visible light to obtain the compensated audio signal after receiving the visible light, and play the compensated audio signal.

[0025] Optionally, the transmitting end comprises: an audio decoding module configured to receive an initial audio signal, and decode the initial audio signal to obtain a decoded audio signal; a block storage module configured to segment the decoded audio signal, group each predetermined number of audio segments in the obtained multiple audio segments into an audio block to obtain multiple audio blocks, and store the multiple audio blocks in a block manner; and an audio synthesizing module configured to synthesize the multiple audio blocks to obtain the to-be-transmitted audio signal.

[0026] Optionally, the transmitting end further comprises: an audio identifying module configured to compare an audio signal value of each audio segment in the multiple audio blocks with an audio reference value to obtain a comparison result; and an audio marking module configured to determine one or more audio blocks in which there are continuous predetermined number of audio segments whose audio signal values are all less than or equal to the audio reference value as marked audio blocks, replace an audio signal value of a first audio segment in the marked audio blocks with a preset marker, and replace an audio signal value of a second audio segment in the marked audio blocks with the check value to obtain a marked audio segment.

[0027] Optionally, the audio synthesizing module comprises: an audio reading submodule, configured to read audio signal values of each audio segment in the plurality of audio blocks; a mark reading submodule, configured to read audio signal values of each audio segment in the mark audio block and audio signal values of the plurality of mark audio segments; and a synthesizing control submodule, configured to output the to-be-transmitted audio signal when it is determined that the addresses of the plurality of audio blocks and the mark audio block are consistent.

[0028] Optionally, the transmitting end further comprises an audio compensation module, configured to use the response reference value and the response value as parameters of a compensation curve, obtain the compensation code by using the compensation curve, and compensate the audio signal value of each segment in the to-be-transmitted audio and the check value of each segment in the to-be-transmitted audio by using the compensation code to obtain the compensated audio signal, wherein the response reference value is pre-set according to ambient light.

[0029] Optionally, the transmitting end further comprises an audio modulation module, configured to modulate the compensated audio signal to obtain the driving signal; and a driving module, configured to convert the driving signal into an electric signal after receiving the driving signal, convert the electric signal into visible light carrying the compensated audio signal by using the visible light transmitter, and transmit the visible light to the receiving end.

[0030] Optionally, the transmitting end further comprises a response receiving module, configured to receive a response value, wherein the response value is generated by the receiving end when it is determined that the to-be-transmitted audio signal needs to be compensated according to a check value, and the check value is used to determine whether the to-be-transmitted audio signal needs to be compensated at the receiving end.

[0031] Optionally, the receiving end comprises a visible light receiving module, configured to receive the visible light and convert the visible light into an electric signal; a preprocessing module, configured to preprocess the electric signal to obtain a to-be-demodulated signal after receiving the electric signal, wherein the preprocessing comprises at least one of the following operations: filtering processing and amplification processing; and an audio demodulation module, configured to demodulate the to-be-demodulated signal to obtain the compensated audio signal.

[0032] According to another aspect of the embodiments of the present application, a computer readable storage medium is provided, which comprises a stored program, wherein the program performs the visible light based audio transmission method in any of the above embodiments.

[0033] According to another aspect of the embodiments of the present application, a processor is provided, which is used to run a program, wherein the program performs the visible light based audio transmission method in any of the above embodiments when running.

[0034] In the embodiment of the present application, the check value is sent to the receiving end, wherein the check value is used to determine whether the to-be-transmitted audio signal needs to be compensated at the receiving end; when the response value of the receiving end is received, the compensation code is generated based on the response value, wherein the response value is generated by the receiving end when it is determined that the to-be-transmitted audio signal needs to be compensated according to the check value; the to-be-transmitted audio signal is compensated by using the compensation code to obtain a compensated audio signal; the compensated audio signal is carrier-modulated to output a driving signal to drive the visible light emitter to emit visible light carrying the compensated audio signal to the receiving end, wherein the compensated audio signal is played at the receiving end. Through the visible light-based audio transmission method provided by the embodiment of the present application, the to-be-transmitted audio signal can be compensated and corrected to offset the distortion of the audio signal in the process of visible light modulation, emission, propagation, reception and demodulation, thereby improving the quality of the audio signal transmitted by the visible light; meanwhile, the method is simple and easy to use, and the cost is low, thereby solving the technical problem that the communication stability is reduced due to the interference of ambient light on the visible light in the communication process in the related art. BRIEF DESCRIPTION OF DRAWINGS

[0035] The accompanying drawings, which are included to provide a further understanding of the present application and are incorporated in and constitute a part of this application, illustrate embodiments of the present application and serve to explain the present application. In the drawings:

[0036] Figure 1 FIG. 1 is a schematic diagram of a television structure according to a hardware running environment related to an embodiment of the present application;

[0037] Figure 2 FIG. 2 is a flowchart of a visible light-based audio transmission method according to an embodiment of the present application;

[0038] Figure 3 FIG. 3 is a schematic diagram of an audio signal in different forms according to an embodiment of the present application;

[0039] Figure 4 FIG. 4 is a structural diagram of a block storage part according to an embodiment of the present application;

[0040] Figure 5 FIG. 5 is a flowchart of an optional visible light-based audio transmission method according to an embodiment of the present application;

[0041] Figure 6 FIG. 6 is a schematic diagram of a visible light-based audio transmission device according to an embodiment of the present application;

[0042] Figure 7 FIG. 7 is a schematic diagram of an optional visible light-based audio transmission device according to an embodiment of the present application;

[0043] Figure 8is a schematic diagram of a visible light based audio transmission system according to an embodiment of the present invention;

[0044] Figure 9 is an architectural diagram of a visible light based audio transmission system according to an embodiment of the present invention;

[0045] Figure 10 is a schematic diagram of an audio decoding and mixing module according to an embodiment of the present invention;

[0046] Figure 11 is a schematic diagram of an audio encoding and mixing module according to an embodiment of the present invention; Figure 10 is a structural diagram of a block storage section in the audio encoding and mixing module;

[0047] Figure 12 is a structural diagram of a block storage section in the audio decoding and mixing module; Figure 10 is a structural diagram of an identification marker section in the audio encoding and mixing module;

[0048] Figure 13 is a structural diagram of an identification marker section in the audio decoding and mixing module; Figure 10 is a structural diagram of an audio synthesis section in the audio encoding and mixing module;

[0049] Figure 14 is a structural diagram of an audio synthesis section in the audio decoding and mixing module; Figure 10 is a structural diagram of an audio compensation and visible light emission module in the audio encoding and mixing module;

[0050] Figure 15 is a structural diagram of an audio compensation section in the audio encoding and mixing module; Figure 14

[0051] is a structural diagram of a carrier modulation section in the audio encoding and mixing module; Figure 16 Figure 14 is a structural diagram of a carrier modulation section in the audio decoding and mixing module;

[0052] Figure 17 Figure 14 is a structural diagram of an optional carrier modulation section in the audio decoding and mixing module;

[0053] Figure 18 is a structural diagram of an audio decoding and mixing module according to an embodiment of the present invention;

[0054] Figure 19 is a structural diagram of a visible light receiving section in the audio decoding and mixing module; Figure 18

[0055] is a structural diagram of a carrier demodulation section in the audio decoding and mixing module; Figure 20 Figure 18 is a structural diagram of an audio decomposition and verification response module in the audio decoding and mixing module;

[0056] Figure 21 Figure 9 is a structural diagram of an audio decomposition and verification response module in the audio decoding and mixing module;

[0057] ​​​​Figure 22 is a television according to an embodiment of the application Figure 21 a structural diagram of a mid audio decomposition part;

[0058] Figure 23 is a television according to an embodiment of the application Figure 21 a structural diagram of a mid verification response part. DETAILED DESCRIPTION

[0059] In order to make the personnel in the technical field better understand the application scheme, the technical scheme in the embodiments of the application will be clearly and completely described below in combination with the drawings in the embodiments of the application. Obviously, the described embodiments are only a part of the embodiments of the application, not all the embodiments. Based on the embodiments in the application, all other embodiments obtained by those of ordinary skill in the art without creative labor should belong to the protection scope of the application.

[0060] It should be noted that the terms "first", "second" and the like in the specification and claims of the application and the above-described drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0061] Embodiment 1

[0062] The visible light-based audio transmission method provided in this embodiment can be applied to smart home appliances such as televisions, smart screens, projection system terminals, wireless sound boxes, and smart lighting. Figure 1 is a structural schematic diagram of a television according to a hardware running environment related to the embodiment scheme of the application.

[0063] As shown in Figure 1 , the television comprises at least one processor 101, a memory 102, and a visible light-based audio transmission program stored in the memory and executable on the processor, the audio transmission program being configured to implement the steps of the visible light-based audio transmission method as described above.

[0064] The processor 101 can include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 101 can be implemented in at least one of a hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), a PLA (Programmable Logic Array). The processor 101 can also include a main processor and a coprocessor, the main processor being a processor for processing data in an awake state, also known as a CPU (Central Processing Unit), and the coprocessor being a low-power processor for processing data in a standby state. In some embodiments, the processor 101 can be integrated with a GPU (Graphics Processing Unit) that is responsible for rendering and drawing the content required to be displayed on the screen. The processor 101 can also include an AI (Artificial Intelligence) processor for processing operations related to the visible light-based audio transmission method, simplifying the audio signal transmission method, facilitating user operation, and improving the transmission quality of the audio signal.

[0065] The memory 102 can include one or more computer-readable storage media, which can be non-transitory. The memory 102 can also include a high-speed random access memory, and a non-volatile memory such as one or more disk storage devices, flash storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 102 is used to store at least one instruction for being executed by the processor 101 to implement the visible light-based audio transmission method provided by the method embodiments in the present application.

[0066] In some embodiments, the television set can also include a communication interface 103 and at least one peripheral device. The processor 101, the memory 102, and the communication interface 103 can be connected through a bus or a signal line. Each peripheral device can be connected to the communication interface 103 through a bus, a signal line, or a circuit board. Specifically, the peripheral device can include at least one of a radio frequency circuit 104, a screen 105, and a power supply 106, and the peripheral device can also include a camera 107.

[0067] The communication interface 103 can be used to connect at least one I / O (Input / Output) related peripheral device to the processor 101 and the memory 102. In some embodiments, the processor 101, the memory 102 and the communication interface 103 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 101, the memory 102 and the communication interface 103 can be implemented on a separate chip or circuit board, and the present embodiments are not limited in this regard.

[0068] The radio frequency circuit 104 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 104 communicates with communication networks and other communication devices through electromagnetic signals. The radio frequency circuit 104 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 104 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and the like. The radio frequency circuit 104 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to metropolitan area networks, various generations of mobile communication networks (2G, 3G, 4G and 5G), wireless local area networks and / or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 104 can also include NFC (Near Field Communication) related circuitry, and the present embodiments are not limited in this regard.

[0069] The screen 105 is used to display a UI (User Interface). The UI can include graphics, text, icons, video and any combination thereof. When the screen 105 is a touch screen, the screen 105 also has the ability to collect touch signals on or above the surface of the screen 105. The touch signals can be input as control signals to the processor 101 for processing. At this time, the screen 105 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards.

[0070] In some embodiments, the screen 105 can be one, i.e. the front panel of a television set; in other embodiments, the screen 105 can be at least two, arranged on different surfaces of the television set or in a folding design; in still other embodiments, the screen 105 can be a flexible screen arranged on a curved surface or a folding surface of the television set. Even, the screen 105 can also be arranged in an irregular shape other than a rectangle, i.e. a special-shaped screen. The screen 105 can be made of materials such as LCD (Liquid Crystal Display).

[0071] The power supply 106 is configured to supply power to various components in the television. The power supply 106 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 106 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be configured to support fast charging technology. Those skilled in the art understand that Figure 1 The structure shown in the figure is not intended to limit the television, and can include more or fewer components than shown, or combine certain components, or different component arrangements.

[0072] The camera 107 is configured to help the television to capture video and images. The camera 107 is usually integrated in a certain area of the front of the television.

[0073] According to an embodiment of the present application, a method for transmitting audio based on visible light is provided. It should be noted that the method for transmitting audio based on visible light in this embodiment is applied to a transmitting end. The steps shown in the flowchart can be executed in a computer system such as a set of computer executable instructions. Although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order.

[0074] Figure 2 is a flowchart of a method for transmitting audio based on visible light according to an embodiment of the present application, as Figure 2 shown, the method comprises the following steps:

[0075] Step S202, sending a check value to the receiving end, wherein the check value is used to determine whether the to-be-transmitted audio signal needs to be compensated at the receiving end.

[0076] Optionally, in the embodiment of the present application, the check value can be sent from the transmitting end to the receiving end, and the check value is used to determine whether the to-be-transmitted audio signal needs to be compensated at the receiving end.

[0077] For example, when audio signal transmission is needed, the check value can be sent to the receiving end through visible light. When the receiving end receives the check value, it compares the check value with the reference value stored by itself. When the difference between the check value and the reference value is greater than a certain threshold, it is determined that there is a greater influence of ambient light during the current audio signal transmission, and the to-be-transmitted audio signal needs to be compensated to offset the influence of ambient light on the to-be-transmitted audio signal during the transmission process.

[0078] Step S204, generating a compensation code based on the response value when the response value of the receiving end is received, wherein the response value is generated by the receiving end when it is determined that the to-be-transmitted audio signal needs to be compensated according to the check value.

[0079] As described above, when the receiving end determines that the to-be-transmitted audio needs to be compensated based on the check value, a response value is generated and sent to the transmitting end through wired or wireless means, so that the transmitting end compensates the to-be-transmitted audio signal by using the response value.

[0080] In step S206, the to-be-transmitted audio signal is compensated by using the compensation code to obtain a compensated audio signal.

[0081] In step S208, the compensated audio signal is carrier-modulated to output a driving signal to drive the visible light transmitter to transmit visible light carrying the compensated audio signal to the receiving end, wherein the compensated audio signal is played at the receiving end.

[0082] As can be seen from the above analysis, in the scheme described in Embodiment 1 of the present application, when audio signal transmission is needed, the transmitting end can first send a check code to the receiving end through visible light, so that the receiving end determines whether the to-be-transmitted audio signal needs to be compensated based on the check code, and generates a response value and sends it to the transmitting end when it is determined that compensation is needed; the transmitting end generates a compensation code based on the response value when it receives the response value, and compensates the to-be-transmitted audio signal by using the compensation code, so as to offset the influence of ambient light on the audio signal during transmission, effectively avoiding the distortion of the audio signal in the process of visible light modulation, transmission, propagation, reception, demodulation, etc., improving the quality of the audio signal transmitted by visible light and improving the user experience.

[0083] It is easy to note that, since the influence of ambient light on the transmission of audio signal is detected before the transmission of audio signal, and when the detection result indicates that the audio signal transmitted by visible light is easy to be distorted due to the influence of ambient light, a compensation code is generated to compensate the to-be-transmitted audio signal to obtain a compensated audio signal, which is used as the final to-be-transmitted audio signal and transmitted through visible light, thereby improving the transmission quality of the audio signal and effectively avoiding the influence of ambient light during the transmission of the audio signal. Therefore, by using the scheme provided in the present application, the to-be-transmitted audio signal can be compensated and corrected to offset the distortion of the audio signal in the process of visible light modulation, transmission, propagation, reception, demodulation, etc., thereby improving the quality of the audio signal transmitted by visible light; at the same time, the method is simple and easy to use, and the cost is low.

[0084] Therefore, the scheme provided in Embodiment 1 of the present application solves the technical problem that the communication stability is reduced due to the interference of ambient light on the communication process of visible light in the related art.

[0085] According to the above embodiment of the present application, since the audio signal to be transmitted is generally continuous and has a large capacity, segmentation processing is needed for better transmission. Therefore, the visible light based audio transmission method can further include: decoding the initial audio signal to obtain a decoded audio signal; segmenting the decoded audio signal to obtain a plurality of audio segments; and synthesizing a plurality of audio blocks composed of the plurality of audio segments to obtain the audio signal to be transmitted.

[0086] In this embodiment, the sound signal of the received sound source (i.e., the initial audio signal in the context) can be pre-processed. For example, after receiving the initial audio signal at the transmitting end, the initial audio signal is decoded to obtain a decoded audio signal, and the decoded audio signal is segmented to obtain a plurality of audio segments, and the plurality of audio segments are then block-processed to obtain a plurality of audio blocks, so that the audio signal to be transmitted is obtained according to the synthesis result of the plurality of audio blocks.

[0087] For example, the sound decoding part can receive the sound source signal and decode it to obtain a decoded audio signal in digital format, as shown in Figure 3 Figure 3 which is a schematic diagram of the audio signal in different forms according to the embodiment of the present application.

[0088] According to the above embodiment of the present application, after the decoded audio signal is segmented to obtain a plurality of audio segments, the visible light based audio transmission method can further include: grouping each predetermined number of audio segments in the plurality of audio segments into an audio block to obtain a plurality of audio blocks; and block-storing the plurality of audio blocks.

[0089] That is, in the embodiment of the present application, the plurality of audio segments can be block-processed, for example, each 6 audio segments in the plurality of audio segments can be divided into an audio block, so that a plurality of audio blocks can be obtained, and the plurality of audio blocks can be block-stored.

[0090] wherein, Figure 4 is a block storage part according to the embodiment of the present application, as shown in Figure 4 The block storage part includes an audio segmenting unit and a block storage unit, and can decompose the decoded audio signal in digital format into continuous audio segments, and block-store a plurality of continuous audio segments after grouping them into an audio block. Specifically, the block storage process is as follows: the audio segmenting unit segments the decoded audio to obtain a plurality of audio segments. The segmenting time t is set, and the decoded audio is decomposed into continuous audio segments ti, and the length of each audio segment t is t, and the value of the audio signal of each audio segment tj is Aj, as shown in Figure 3 ​The block storage unit stores the audio segments in blocks. The length of the block storage space is set as n, and the audio segments t1, t2,..., ti,..., tn are stored in blocks in sequence, and one audio block signal, such as audio block K, is stored in each block storage space. Figure 3 As shown in FIG. 3.

[0091] According to the above embodiment of the present application, not every audio block in the plurality of audio blocks meets the transmission condition, and selection is required before transmission. Therefore, the synthesizing processing of the plurality of audio blocks composed of the plurality of audio segments to obtain the to-be-transmitted audio signal can include: comparing the audio signal value of each audio segment in each audio block in the plurality of audio blocks with the audio reference value to obtain a comparison result; determining one or more audio blocks in which the audio signal values of the continuous predetermined number of audio segments are all less than or equal to the audio reference value as marked audio blocks to obtain one or more marked audio blocks; and performing synthesizing processing on the one or more marked audio blocks to obtain the to-be-transmitted audio signal.

[0092] In this embodiment, the audio reference value needs to be set first, and specifically, the audio reference value can be determined according to the type of the to-be-transmitted audio signal; then, the audio signal value of each audio segment in each audio block in the plurality of audio blocks is compared with the audio reference value, so as to select one or more audio blocks in which the audio signal values of the continuous predetermined number of audio segments are all less than or equal to the audio reference value as the qualified audio blocks.

[0093] For example, the marking condition is set first, and the audio segments in the block-stored audio blocks are compared and identified to obtain the audio blocks and the audio segments therein that meet the marking condition. Specifically: 1) first, audio comparison is performed: a comparison reference value Vr (i.e., the audio reference value in the context) is set; then, the audio signal value Ai of the audio segment ti of the audio block K is obtained, and the size of Ai and Vr is compared; 2) if Ai is less than or equal to Vr, and the audio signal values of the continuous multiple audio segments are less than the reference value Vr, then the audio block K is the audio block that meets the marking condition (for example, the audio signal values Ai, Ai+1, Ai+2 of the continuous four audio segments ti, ti+1, ti+2, ti+3 are all less than the reference value Vr, and then the audio block K is the audio block that meets the marking condition, K is the marked block address, and ti, ti+1, ti+2, ti+3 are the marked segment addresses); otherwise, the next audio block is continuously queried and identified; 3) the audio block address K and the continuous multiple audio segment addresses (such as ti, ti+1, ti+2, ti+3) that meet the marking condition are transmitted to the audio marking unit, that is, the marked block and the marked segment address are transmitted to the audio marking unit.

[0094] According to the above embodiment of the present application, the synthesis processing is performed on one or more marked audio blocks to obtain the audio signal to be transmitted, comprising: obtaining the audio signal value of the audio segment in the one or more marked audio blocks; replacing the audio signal value of the first audio segment in the marked audio block with the preset marker, and replacing the audio signal value of the second audio segment in the marked audio block with the check value to obtain the marked audio segment, wherein the first audio segment is the starting audio segment of the marked audio segment, and the second audio segment is the ending audio segment of the marked audio segment and the predetermined number of audio segments adjacent to the ending audio segment; and performing the synthesis processing on the marked audio segment to obtain the audio signal to be transmitted.

[0095] For example, the marked block address K and the continuous multiple marked segment addresses (such as ti, ti+1, ti+2, ti+3) can be received, and then the audio signal values of the multiple audio segment addresses of the block address K (such as the signal values Ai, Ai+1, Ai+2, Ai+3 of the ti, ti+1, ti+2, ti+3 audio segments) are obtained, the audio marking processing is performed, and the marked block is converted; specifically, the value Ai of the starting audio segment ti is replaced with the marker MKV, the value Ai+1 of the next audio segment ti+1 remains unchanged, and the values Ai+2, Ai+3 of the subsequent audio segments are replaced with the check value CKV, and the values of the other audio segments remain unchanged, to form the marked block; the signals of the various audio segments and the marked segments in the marked block constitute the marked block audio. The marked block audio is as shown in Figure 3 .

[0096] In the embodiment of the present application, the audio synthesis process is as follows: the audio signals of the audio segments in the audio blocks in the above-mentioned block storage part are sequentially read and output in order, and the audio block addresses are output to the synthesis control part; the signals of the various audio segments and the marked segments in the marked blocks in the above-mentioned identification marker part are sequentially read and output by the marked reading part, that is, the marked block audio is read and output; and the marked block addresses are output to the synthesis control part.

[0097] The synthesis control part receives the audio block addresses and the marked block addresses, generates a control signal by judging the compliance of the audio block addresses and the marked block addresses, and controls the conduction direction of the guide switch. If the audio block addresses and the marked block addresses do not comply (that is, are not the same), the guide switch conducts the audio reading unit to output the audio signal Aj; if the audio block addresses and the marked block addresses comply, the guide switch conducts the marked reading unit to output the signals in the marked block.

[0098] In the embodiment of the present application, the guide switch is controlled by the control signal to conduct the audio reading part or the marked reading part, and outputs the synthesized audio signal composed of the audio signal Aj, the marker MKV, and the check value CKV. The synthesized audio signal is as shown in Figure 3 .

[0099] According to the above embodiment of the present application, the compensation code is generated based on the response value, which comprises: taking the response reference value and the response value as parameters of a compensation curve, and obtaining the compensation code by using the compensation curve, wherein the response reference value is preset according to the ambient light.

[0100] In this embodiment, the response reference value CKr (i.e. the response reference value in the context) is first set, the response value RSD is received, the difference between the response reference value CKr and the response value RSD is analyzed, and the compensation code CMk is generated according to the compensation curve; it should be noted that in the embodiment of the present application, the compensation curve can be a linear curve or a nonlinear curve, which can be selected according to the specific use. For example, the linear curve CMK = h*(RSD-CKr) + d, wherein h and d are constants.

[0101] The response reference value can be set according to the range of ambient light before leaving the factory, and can be a default value.

[0102] According to the above embodiment of the present application, the compensation code is used to compensate the audio signal to be transmitted, and the compensated audio signal is obtained, which comprises: using the compensation code to compensate the audio signal value of each segment in the audio to be transmitted and the check value of each segment in the audio to be transmitted, and obtaining the compensated audio signal.

[0103] In this embodiment, the audio signal of the audio segment in the audio block stored in the above-mentioned block storage part is sequentially read and output in order, and the signal of each audio segment and the mark segment in the mark block in the above-mentioned identification mark part is sequentially read and output in order; then the address compliance of the audio block and the mark block is judged, if the address is not compliant, the audio signal of the audio segment in the audio block is output by the control of the guide switch, otherwise the signal of the audio segment and the mark segment in the mark block is output by the control of the guide switch, and the guide switch outputs the synthesized audio, which is composed of the audio signal Aj, the mark MKV and the check value CKV.

[0104] The audio correction part receives the synthesized audio and the compensation code CMk, uses the compensation code CMk to correct the value of each audio segment in the synthesized audio, outputs the compensated audio signal, and uses the compensation code CMk to correct the audio segment signal value Aj and the check value CKV in the synthesized audio, the correction is in the form of summation, and the corrected audio segment signal value and the check value are Aj+CMk and CKV+CMk; the mark MKV is a fixed match and remains unchanged. The compensated audio signal is as shown in Figure 3 .

[0105] According to the embodiment of the present application, the carrier modulation is performed on the compensation audio signal to output the driving signal to drive the visible light transmitter to transmit the visible light carrying the compensation audio signal to the receiving end.

[0106] In the embodiment, the modulator can be used to generate the modulation signal used for audio modulation; then the audio modulation part modulates the compensation audio signal under the action of the modulation signal, converts the compensation audio signal into the driving signal, and outputs the driving signal. The driving circuit unit receives the driving signal, converts the driving signal into the transmission electrical signal, the visible light transmitter converts the transmission electrical signal into the visible light and transmits the visible light, and the visible light audio receiving and sounding device propagates the visible light, so that the compensation audio signal can be played at the receiving end.

[0107] It should be noted that the scheme provided in the embodiment of the present application can be used for transmission of the video signal, and the specific mode will not be described again.

[0108] Through the technical scheme provided in the embodiment of the present application, after the initial audio signal is decoded to obtain the decoded audio signal at the transmitting end, the decoded audio signal is stored in blocks and segments; the audio blocks stored in blocks and segments are identified and marked, and when the audio segments meeting the set conditions are queried, the marker MKV and the check value CKV used for detection and correction are inserted into the audio segments to form the marked audio; then the audio blocks stored in blocks and the marked audio are synthesized to obtain the synthesized audio signal, which is compensated and then transmitted to the receiving end through the visible light, so that after the receiving end receives the visible light carrying the compensation audio signal, the mixed audio is obtained after demodulation; then the detection check value R_CKV used for detection and correction is decomposed from the mixed audio, and the response value RSD is obtained by analysis and processing; the RSD is encapsulated and converted into a message, which is sent to the transmitting end through wireless or limited mode; at the same time, the compensation audio signal demodulated by the sounding device of the receiving end is played, so that the transmitting end generates the compensation code according to the value of RSD to compensate and correct the frequency signal, so as to offset the distortion of the audio signal in the process of visible light modulation, transmission, propagation, reception, demodulation, etc., and improve the quality of the audio signal transmitted by the visible light.

[0109] It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all described as a combination of a series of actions, but those skilled in the art should know that the present application is not limited to the action sequence described, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the present application.

[0110] Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be realized by means of software and a necessary general hardware platform, and of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product in essence or the part that contributes to the prior art, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a plurality of instructions to make a terminal device (which can be a mobile phone, computer, server, or network device, etc.) execute the method described in each embodiment of the present application.

[0111] Embodiment 2

[0112] According to the embodiment of the present application, a method embodiment of a visible light-based audio transmission method is provided. It should be noted that the visible light-based audio transmission method in this embodiment is applied to a receiving end, and the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical sequence is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that here.

[0113] Figure 5 is a flowchart of an optional visible light-based audio transmission method according to the embodiment of the present application, as shown in Figure 5 the method comprises the following steps:

[0114] Step S502, receiving a check value sent by a transmitting end, wherein the check value is used to determine whether compensation needs to be performed on the audio signal to be transmitted.

[0115] Step S504, generating a response value when it is determined according to the check value that compensation needs to be performed on the audio signal to be transmitted.

[0116] In this embodiment, when the transmitting end sends the check value CKV through a wired or wireless manner, the receiving end receives the check value and judges whether compensation needs to be performed on the audio signal to be transmitted according to the check value, and generates a response value RSD when compensation needs to be performed on the audio signal to be transmitted.

[0117] Step S506, the response value is sent to the transmitting end, wherein the response value is used to generate a compensation code in the transmitting end, the compensation code is used to compensate the audio signal to be transmitted to obtain a compensated audio signal, and the compensated audio signal is used to modulate a carrier wave in the transmitting end to output a driving signal to drive the visible light transmitter to transmit the visible light carrying the compensated audio signal.

[0118] In this embodiment, after the response value RSD is generated through the above step S502, the response value RSD is sent to the transmitting end, so that the transmitting end generates a compensation code based on the response value after receiving the response value, to compensate the audio signal to be transmitted to obtain a compensated audio signal.

[0119] Step S508, after receiving the visible light, the visible light is parsed to obtain the compensated audio signal, and the compensated audio signal is played.

[0120] From the above analysis, after the receiving end receives the check value sent by the transmitting end, if it is determined that the audio signal to be transmitted needs to be compensated, a response value is generated and sent to the transmitting end, so that the transmitting end compensates the audio signal to be transmitted by using a compensation code before transmitting the audio signal to be transmitted, so as to offset the distortion of the audio signal in the process of visible light modulation, transmission, propagation, reception, demodulation and the like, and improve the quality of the audio signal transmitted by the visible light.

[0121] It is easy to note that, since the influence of ambient light on the transmission of audio signal is detected before the transmission of audio signal, and when the detection result indicates that the audio signal transmitted by the visible light is easy to be distorted due to the influence of ambient light, a compensation code is generated to compensate the audio signal to be transmitted to obtain a compensated audio signal, and the compensated audio signal is used as the final audio signal to be transmitted and transmitted through the visible light, thereby improving the transmission quality of the audio signal and effectively avoiding the influence of ambient light in the process of audio signal transmission. Therefore, through the scheme provided in the embodiment of the present application, the audio signal to be transmitted can be compensated and corrected to offset the distortion of the audio signal in the process of visible light modulation, transmission, propagation, reception, demodulation and the like, and improve the quality of the audio signal transmitted by the visible light. At the same time, the method is simple and easy to use, and the cost is low.

[0122] Therefore, the scheme provided in Embodiment 2 of the present application solves the technical problem that the communication stability is reduced due to the interference of ambient light on the communication process of visible light in the related art.

[0123] In the embodiment of the present application, the receiving end can receive the visible light propagated from the transmitting end, and perform photoelectric conversion on the visible light to obtain an induced electric signal. Then, the induced electric signal is preprocessed, such as filtering and amplification, to obtain a to-be-demodulated signal and perform demodulation processing to obtain a mixed audio. Then, the mixed audio is decomposed to obtain a generated audio signal and a detection check value. The detection check value is analyzed and processed to output a response value RSD. The response value RSD is encapsulated and converted into a message, which is sent through a wired or wireless manner. For example, the response value RSD is encapsulated into an infrared format message and sent through infrared, or the response value RSD is encapsulated into a network packet format message and sent through a network. Meanwhile, the generated audio signal is processed to drive a loudspeaker to emit sound. Since the transmitting end generates a compensation code according to the value of the RSD to compensate and correct the frequency signal, the distortion of the audio signal in the process of visible light modulation, transmission, propagation, reception, demodulation and the like is offset, and the quality of the audio signal transmitted by the visible light is improved. The method is simple to implement and low in cost.

[0124] It should be noted that, for the foregoing method embodiments, in order to simply describe, they are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited to the action sequence described, because according to the present application, certain steps can be performed in other sequences or at the same time. Secondly, those skilled in the art should know that the embodiments described in the specification all belong to preferred embodiments, and the actions and modules involved are not necessarily essential to the present application.

[0125] From the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be realized by means of software and a necessary general hardware platform, and of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as a ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions to make a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) execute the methods described in the embodiments of the present application.

[0126] Embodiment 3

[0127] According to the embodiments of the present application, a visible light-based audio transmission device for implementing the above-mentioned visible light-based audio transmission method is also provided, Figure 6 is a schematic diagram of the visible light-based audio transmission device according to the embodiments of the present application, as Figure 6 shown, the device includes a first sending unit 61, a first generating unit 63, a compensation unit 65, and a transmitting unit 67.

[0128] The first sending unit 61 is configured to send a check value to the receiving end, and the check value is used to determine whether the to-be-transmitted audio signal needs to be compensated at the receiving end.

[0129] The first generating unit 63 is configured to generate a compensation code based on a response value when the response value is received from the receiving end, and the response value is generated by the receiving end when it is determined that the to-be-transmitted audio signal needs to be compensated according to the check value.

[0130] The compensation unit 65 is configured to compensate the to-be-transmitted audio signal by using the compensation code to obtain a compensated audio signal.

[0131] The transmitting unit 67 is configured to carrier-modulate the compensated audio signal to output a driving signal to drive the visible light transmitter to emit visible light carrying the compensated audio signal to the receiving end, and the compensated audio signal is played at the receiving end.

[0132] It should be noted that the first sending unit 61, the first generating unit 63, the compensation unit 65, and the transmitting unit 67 correspond to steps S202 to S208 in Embodiment 1, and the three modules have the same instances and application scenarios as the corresponding steps, but are not limited to the content disclosed in Embodiment 1.

[0133] As can be seen from the above, in the scheme described in Embodiment 2, the first sending unit is used to send a check value to the receiving end, then the first generating unit is used to generate a compensation code based on a response value when the response value is received from the receiving end, the compensation unit is configured to compensate the to-be-transmitted audio signal by using the compensation code to obtain a compensated audio signal, and the transmitting unit is configured to carrier-modulate the compensated audio signal to output a driving signal to drive the visible light transmitter to emit visible light carrying the compensated audio signal to the receiving end, which effectively avoids the distortion of the audio signal in the process of visible light modulation, emission, propagation, reception, demodulation, and the like, improves the quality of the audio signal transmitted by the visible light, and improves the user experience.

[0134] It is easily noticed that, since the influence of ambient light on the transmission of audio signals is detected before the transmission of audio signals, and when the detection result indicates that the visible light transmitted audio signals are easily distorted by the influence of ambient light, the compensation code is generated to compensate the to-be-transmitted audio signals, so as to obtain the compensated audio signals, the compensated audio signals are taken as the final to-be-transmitted audio signals, and the transmission quality of the audio signals is improved through the visible light transmission, and the influence of ambient light on the transmission of audio signals is effectively avoided. Therefore, through the scheme provided in the embodiment of the application, the to-be-sent audio signals can be compensated and corrected to offset the distortion of audio signals in the process of visible light modulation, emission, propagation, reception, demodulation and the like, and the quality of the audio signals transmitted by the visible light is improved. Meanwhile, the method is simple and easy to use, and the cost is low.

[0135] Therefore, the scheme provided in the embodiment 3 of the application solves the technical problem that the communication stability is reduced due to the interference of ambient light on the communication of visible light in the related art.

[0136] Optionally, the visible light-based audio transmission device further comprises: a decoding unit, configured to decode the initial audio signals to obtain decoded audio signals; a segmentation unit, configured to perform segmentation processing on the decoded audio signals to obtain a plurality of audio segments; and a synthesis unit, configured to perform synthesis processing on a plurality of audio blocks composed of the plurality of audio segments to obtain the to-be-transmitted audio signals.

[0137] Optionally, the visible light-based audio transmission device further comprises: a segmentation unit, configured to perform segmentation processing on the decoded audio signals to obtain a plurality of audio segments; and a synthesis unit, configured to perform synthesis processing on a plurality of audio blocks composed of the plurality of audio segments to obtain the to-be-transmitted audio signals.

[0138] Optionally, the synthesis unit comprises: a comparison module, configured to compare the audio signal values of the audio segments in each of the plurality of audio blocks with an audio reference value to obtain a comparison result; a first acquisition module, configured to determine one or more audio blocks in which a continuous predetermined number of audio signal values are all less than or equal to the audio reference value as marked audio blocks to obtain one or more marked audio blocks; and a synthesis module, configured to perform synthesis processing on the one or more marked audio blocks to obtain the to-be-transmitted audio signals.

[0139] Optionally, the synthesizing unit comprises: a second obtaining module, configured to obtain audio signal values of the audio segments in the one or more marked audio blocks; a replacing module, configured to replace the audio signal values of a first audio segment in the marked audio block with a preset marker, and replace the audio signal values of a second audio segment in the marked audio block with a check value, to obtain a marked audio segment, wherein the first audio segment is a starting audio segment of the marked audio segment, and the second audio segment is an ending audio segment of the marked audio segment and a predetermined number of audio segments adjacent to the ending audio segment; and a synthesizing module, configured to perform synthesizing processing on the marked audio segment to obtain the audio signal to be transmitted.

[0140] Optionally, the first generating unit comprises: a third obtaining module, configured to use the response reference value and the response value as parameters of a compensation curve, and use the compensation curve to obtain the compensation code, wherein the response reference value is preset according to the ambient light.

[0141] Optionally, the compensating unit comprises: a compensating module, configured to compensate the audio signal value of each segment in the audio to be transmitted and the check value of each segment in the audio to be transmitted by using the compensation code, to obtain a compensated audio signal.

[0142] Optionally, the transmitting unit comprises: a modulating module, configured to modulate the compensated audio signal to obtain a driving signal; a converting module, configured to convert the driving signal into an electrical signal; and a transmitting module, configured to convert the electrical signal into visible light carrying the compensated audio signal by using a visible light transmitter, and transmit the visible light to the receiving end, so that the receiving end analyzes the visible light and plays it.

[0143] Embodiment 4

[0144] According to the embodiments of the present application, a visible light-based audio transmission device for implementing the above-mentioned visible light-based audio transmission method is further provided, Figure 7 is a schematic diagram of an optional visible light-based audio transmission device according to the embodiments of the present application, as Figure 7 shown, the device comprises a receiving unit 71, a second generating unit 73, a second sending unit 75, and a processing unit 77.

[0145] The receiving unit 71 is configured to receive the check value sent by the transmitting end, wherein the check value is used to determine whether the audio signal to be transmitted needs to be compensated.

[0146] The second generating unit 73 is configured to generate the response value when it is determined according to the check value that the audio signal to be transmitted needs to be compensated.

[0147] The second sending unit 75 is configured to send the response value to the transmitting end, wherein the response value is used to generate a compensation code in the transmitting end, the compensation code is used to compensate the audio signal to be transmitted to obtain a compensated audio signal, and the compensated audio signal is used to modulate a carrier wave in the transmitting end to output a driving signal to drive the visible light transmitter to emit the visible light carrying the compensated audio signal.

[0148] The processing unit 77 is configured to parse the visible light to obtain the compensated audio signal after receiving the visible light, and play the compensated audio signal.

[0149] It should be noted that the receiving unit 71, the second generating unit 73, the second sending unit 75 and the processing unit 77 correspond to steps S502 to S508 in Embodiment 2, and the three modules have the same instances and application scenarios as the corresponding steps, but are not limited to the content disclosed in Embodiment 2.

[0150] As can be seen from the above, in the scheme disclosed in Embodiment 4, the receiving unit is used to receive the check value sent by the transmitting end, wherein the check value is used to determine whether the audio signal to be transmitted needs to be compensated; the second generating unit is used to generate a response value when it is determined that the audio signal to be transmitted needs to be compensated according to the check value; the second sending unit is used to send the response value to the transmitting end, wherein the response value is used to generate a compensation code in the transmitting end, the compensation code is used to compensate the audio signal to be transmitted to obtain a compensated audio signal, and the compensated audio signal is used to modulate a carrier wave in the transmitting end to output a driving signal to drive the visible light transmitter to emit the visible light carrying the compensated audio signal; and the processing unit is used to parse the visible light to obtain the compensated audio signal after receiving the visible light, and play the compensated audio signal. Therefore, through the scheme provided in the embodiments of the present application, the audio signal to be transmitted can be compensated and corrected to offset the distortion of the audio signal in the process of visible light modulation, emission, propagation, reception and demodulation, thereby improving the quality of the audio signal transmitted by the visible light. Meanwhile, the method is simple and easy to use, and has low cost.

[0151] Therefore, the scheme provided in Embodiment 4 of the present application solves the technical problem that the communication stability is reduced due to the interference of ambient light on the visible light in the communication process in the related art.

[0152] Embodiment 5

[0153] According to another aspect of the embodiments of the present application, there is also provided an audio transmission system based on visible light, Figure 8 is a schematic diagram of an audio transmission system based on visible light according to the embodiments of the present application, like Figure 8As shown, the visible light-based audio transmission system may include: a transmitter including the aforementioned visible light-based audio transmission device, and a receiver including the aforementioned visible light-based audio transmission device; the transmitter and receiver communicate with each other; wherein the transmitter is used to perform carrier modulation on the compensation audio signal to output a driving signal to drive the visible light transmitter to transmit visible light carrying the compensation audio signal to the receiver, wherein the compensation audio signal is used for playback at the receiver; the receiver is used to analyze the visible light after receiving it to obtain the compensation audio signal, and then play the compensation audio signal.

[0154] This visible light-based audio transmission system can compensate and correct the audio signal to be transmitted, thereby offsetting audio signal distortion during visible light modulation, transmission, propagation, reception, and demodulation, and improving the audio signal quality of visible light transmission. At the same time, the implementation method is simple to use and low in cost, thus solving the technical problem in related technologies where visible light is easily interfered with by ambient light during communication, leading to a decrease in communication stability.

[0155] The transmitting end and the receiving end will be described in detail below.

[0156] Figure 9 This is an architectural diagram of a visible light-based audio transmission system according to an embodiment of the present invention, such as... Figure 9 As shown, the visible light-based audio transmission system may include: a visible light audio processing and transmitting device (i.e., a transmitter) and a visible light audio receiving and sound-emitting device (i.e., a receiver); wherein, as Figure 9 As shown, the visible light audio processing and transmitting device includes: a sound decoding and audio mixing module, an audio compensation and visible light transmitting module, and a response receiving module; the visible light audio receiving and sound transmitting device may include: a visible light receiving and audio acquisition module, an audio decomposition and verification response module, a response sending module, and a sound transmitting device module. The aforementioned visible light audio processing and transmitting device receives the sound signal from the sound source, decodes it to obtain a digitally formatted decoded audio signal, and then performs block storage processing, decomposing the decoded audio signal into audio segments and audio blocks composed of several audio segments for block storage. Next, it performs identification and marking processing on the stored audio blocks, replacing the signal value of the audio segment with a marker MKV and a check value CKV for audio segments that meet the marking conditions, forming marked block audio. It then synthesizes the stored audio block audio and the marked block audio to obtain a synthesized audio signal output. Finally, it receives the response value RSD and generates a compensation code CMk based on the RSD value. The compensation code CMk is used to compensate and correct the synthesized audio signal, and the corrected compensated audio signal is output. Finally, the compensated audio signal is carrier modulated, and a driving signal is output to drive the visible light transmitter to transmit visible light carrying the compensated audio signal.

[0157] The visible light audio receiving and sounding device receives visible light, converts the visible light into an induced electric signal, and then performs filtering, amplification and other preprocessing on the induced electric signal to obtain a mixed audio signal. After audio decomposition processing is performed on the mixed audio signal, a sounding audio signal and a detection check value are obtained. After sound effects, digital-to-analog conversion and other processing are performed on the sounding audio, a loudspeaker is driven to emit sound. The detection check value is analyzed and checked in response processing, and a response value RSD is output.

[0158] It should be noted that the visible light audio receiving and sounding device encapsulates and converts the response value RSD into a message, which is sent in a wired or wireless manner. For example, the response value RSD is encapsulated into an infrared format message and sent through infrared, or the response value RSD is encapsulated into a network packet format message and sent through a network. The visible light audio processing and transmitting device receives the response value RSD, generates a compensation code CMk according to the value of RSD to compensate and correct the frequency signal, so as to offset the distortion of the audio signal in the process of visible light modulation, transmission, propagation, reception and demodulation, and improve the quality of the audio signal transmitted by visible light.

[0159] The main principle is as follows: first, after receiving the sound signal of the sound source, a decoded audio signal in a digital format is obtained after decoding processing, and then the decoded audio signal is stored in blocks, and the decoded audio signal is decomposed into audio segments and audio blocks composed of a plurality of audio segments for block storage. Then, the block-stored audio blocks are identified and marked, the audio segments meeting the marking conditions are replaced by a marker MKV and a check value CKV, and a marked block audio is formed. The block-stored audio blocks and the marked block audio are synthesized to obtain a synthesized audio signal output. The response value RSD is received, and a compensation code CMk is generated according to the value of RSD. The synthesized audio signal is compensated and corrected by using the compensation code CMk, and a compensated audio signal after correction is output. Then, the compensated audio signal is carrier-modulated, and a driving signal is output to drive a visible light emitter to emit visible light carrying the compensated audio signal.

[0160] According to the embodiment of the present application, the transmitting end can include: an audio decoding module, configured to receive an initial audio signal and decode the initial audio signal to obtain a decoded audio signal; a block storage module, configured to segment the decoded audio signal, group a predetermined number of audio segments in the obtained plurality of audio segments into an audio block, obtain a plurality of audio blocks, and store the plurality of audio blocks in blocks; and an audio synthesis module, configured to synthesize the plurality of audio blocks to obtain a to-be-transmitted audio signal.

[0161] Figure 10 is a schematic diagram of an audio decoding and mixing module according to the embodiment of the present application, as Figure 10As shown, the audio decoding and mixing module includes: a sound decoding part (i.e., an audio decoding module), a block storage part (a block storage module), an identification marking part (i.e., an audio identification module), an audio synthesis part (i.e., an audio synthesis module); wherein the sound decoding part receives a sound source signal (i.e., an initial audio signal), decodes and processes to obtain a decoded audio signal in digital format, as shown in Embodiment 1 above Figure 3 As shown; then performs block storage processing, decomposes the decoded audio signal into audio segments and block stores the audio blocks composed of a plurality of audio segments; then performs identification marking processing on the block stored audio blocks, replaces the signal values of the audio segments that meet the marking conditions with a marker MKV and a check value CKV to form a marked block audio; and performs synthesis processing on the block stored audio blocks and the marked block audio to obtain a synthesized audio signal output.

[0162] Figure 11 According to the embodiment of the present application Figure 10 The block storage part in Embodiment 1 is shown in the structural diagram as Figure 11 As shown, the block storage part can include an audio segmenting unit and a block storage unit; the audio segmenting unit decomposes the decoded audio signal in digital format into continuous audio segments, and block stores an audio block composed of a plurality of continuous audio segments.

[0163] The block storage process is as follows: the audio segmenting unit segments the decoded audio. Set the segment time t, decompose the decoded audio into continuous audio segments ti, and the length of each audio segment tj is t, and the value of the audio signal of each audio segment tj is Aj, as shown in Embodiment 1 above Figure 3 The block storage unit block stores the audio segments. Set the block storage space length to n, and block store the audio segments t1, t2,..., ti,..., tn in order, and each block storage space stores an audio block signal, such as audio block K, as shown in Embodiment 1 above Figure 3

[0164] According to the above embodiment of the present application, the transmitting end further includes: an audio identification module for comparing the audio signal values of the audio segments in each of the plurality of audio blocks with an audio reference value to obtain a comparison result; an audio marking module for determining one or more audio blocks in which there are a continuous predetermined number of audio segments whose audio signal values are all less than or equal to the audio reference value as marked audio blocks, replacing the audio signal values of the first audio segments in the marked audio blocks with a preset marker, and replacing the audio signal values of the second audio segments in the marked audio blocks with a check value to obtain marked audio segments.

[0165] In this embodiment, the structure of the identification marking part in the transmitting end is shown in Figure 12 Figure 12 ​​According to an embodiment of the present invention Figure 10 The structure diagram of the identification and marking section includes an audio recognition unit and an audio marking unit. Marking conditions are set, and audio segments within the segmented audio blocks are compared and identified to obtain audio blocks and their corresponding audio segments that meet the marking conditions. Marking processing is then performed on the audio blocks and segments that meet the marking conditions, i.e., the signal value of the audio segment is replaced by the marker MKV and the check value CKV to obtain the marked block and marked segment.

[0166] The identification and marking process is as follows: The audio recognition unit sets marking conditions and compares and identifies audio segments within the segmented audio blocks to obtain audio blocks and their audio segments that meet the marking conditions. First, an audio comparison is performed: a comparison reference value Vr is set; the audio signal value Ai of audio segment ti of audio block K is obtained from the segmented storage unit, and Ai is compared with Vr. If Ai is less than or equal to Vr, and the audio signal values ​​of multiple consecutive audio segments are less than the reference value Vr, then audio block K meets the marking conditions (for example, if the audio signal values ​​Ai, Ai+1, Ai+2, and Ai+3 of four consecutive audio segments ti, ti+1, ti+2, and ti+3 are all less than the reference value Vr, then audio block K meets the marking conditions; K is the address of the marked block, and ti, ti+1, ti+2, and ti+3 are the addresses of the marked segments); otherwise, the process continues to query and identify the next audio block. The address K of the audio block that meets the marking conditions and the addresses of multiple consecutive audio segments (such as ti, ti+1, ti+2, ti+3) are transmitted to the audio marking unit, that is, the address of the marking block and the address of the marking segment are transmitted to the audio marking unit.

[0167] Next, the audio tagging unit receives the tag block address K and multiple consecutive tag segment addresses (e.g., ti, ti+1, ti+2, ti+3), and retrieves the audio signal values ​​(e.g., the signal values ​​Ai, Ai+1, Ai+2, Ai+3 of audio segments ti, ti+1, ti+2, ti+3) of the multiple audio segment addresses at block address K from the block storage unit. It then performs audio tagging processing to convert these values ​​into tag blocks. Specifically, the value Ai of the starting audio segment ti is replaced with the tag symbol MKV; the value Ai+1 of the subsequent audio segment ti+1 remains unchanged; and the values ​​Ai+2 and Ai+3 of the subsequent audio segments are replaced with the check value CKV. The values ​​of other audio segments remain unchanged, forming a tag block. The signals of each audio segment and the tag segment in the tag block constitute the tag block audio. The tag block audio is as described in Example 1 above. Figure 3 As shown.

[0168] According to the above embodiments of the present invention, an audio synthesis module includes: an audio reading submodule, configured to read the audio signal value of an audio segment of each of a plurality of audio blocks; an identification reading submodule, configured to read the audio signal values ​​of each audio segment in a marked audio block and the audio signal values ​​of a plurality of marked audio segments; and a synthesis control submodule, configured to output the audio signal to be transmitted when it is determined that the addresses of the plurality of audio blocks and the marked audio blocks are consistent.

[0169] In this embodiment, such as Figure 13 As shown ( Figure 13 According to an embodiment of the present invention Figure 10 The audio synthesis section (see structural diagram) may include an audio reading unit, a tag reading unit, a synthesis control unit, and a guide switch. The audio reading unit sequentially reads and outputs the audio signals of the audio segments in the audio blocks of the segmented storage section. The tag reading unit sequentially reads and outputs the signals of each audio segment and tag segment in the tag block of the identification tag section. The synthesis control unit determines the address compatibility of the audio block and the tag block. If the address does not match, it controls the guide switch to output the audio signals of the audio segments in the audio block. Otherwise, it controls the guide switch to output the signals of the audio segments and tag segments in the tag block. The guide switch outputs the synthesized audio, which consists of an audio signal Aj, a tag MKV, and a check value CKV.

[0170] The audio synthesis process is as follows: the audio reading unit sequentially reads and outputs the audio signals of the audio segments in the aforementioned segmented storage audio block, and simultaneously outputs the audio block address to the synthesis control unit; the marker reading unit sequentially reads the signals of each audio segment and marker segment in the aforementioned marker block, i.e., reads the marker block audio, and then outputs it; simultaneously, it outputs the marker block address to the synthesis control unit; the synthesis control unit receives the audio block address and the marker block address, and generates a control signal to control the conduction direction of the guide switch by judging the conformity between the audio block address and the marker block address. If the audio block address and the marker block address do not conform (i.e., they are not the same), the guide switch turns on the audio reading unit and outputs the audio signal Aj; if the audio block address and the marker block address conform, the guide switch turns on the marker reading unit and outputs the signal within the marker block; the guide switch: under the control of the control signal, turns on the audio reading unit or turns on the marker reading unit, and outputs a synthesized audio signal composed of the audio signal Aj, the marker MKV, and the check value CKV; the synthesized audio signal is as described in Example 1 above. Figure 3 As shown.

[0171] According to an embodiment of the present invention, the transmitting end may further include: an audio compensation module, used to use the response reference value and the response value as parameters of the compensation curve, to obtain a compensation code using the compensation curve, and to use the compensation code to compensate for the audio signal value of each segment of the audio to be transmitted and the check value of each segment of the audio to be transmitted, thereby obtaining a compensated audio signal, wherein the response reference value is preset according to the ambient light.

[0172] In this embodiment, the structure of the audio compensation and visible light emission module in the transmitting end is as follows: Figure 14 As shown ( Figure 14 According to an embodiment of the present invention Figure 10 (Structure diagram of the audio compensation and visible light emission module) The audio compensation and visible light emission module receives the synthesized audio signal and the response value RSD, and generates the compensation code CMk based on the value of RSD; the compensation code CMk is used to compensate and correct the synthesized audio signal, and the corrected compensated audio signal is output; then the compensated audio signal is carrier modulated, and the output driving signal drives the visible light transmitter to emit visible light carrying the compensated audio signal.

[0173] in, Figure 15 According to an embodiment of the present invention Figure 14 The structural diagram of the mid-frequency compensation section is as follows: Figure 15 As shown, it includes an audio correction unit and a compensation code generation unit. Specifically, the compensation code generation unit sets a reference value CKr for the response and a received response value RSD, analyzes the difference between the reference value CKr and the response value RSD, generates a compensation code CMk based on the compensation curve, and then uses the compensation code CMk to correct the audio segment signal value Aj and the check value CKV in the synthesized audio. The corrected audio segment signal value and check value are Aj+CMk and CKV+CMk, respectively, and the marker MKV is a fixed symbol that remains unchanged; the corrected compensated audio is then output.

[0174] The audio compensation process is as follows: The compensation code generation unit sets the reference value CKr of the response and receives the response value RSD. It analyzes the difference between the reference value CKr and the response value RSD and generates the compensation code CMk based on the compensation curve. The compensation curve can be a linear or non-linear curve, such as the linear curve CMK = h*(RSD-CKr)+d, where h and d are constants. The audio correction unit receives the synthesized audio and the compensation code CMk, uses the compensation code CMk to correct the value of each audio segment in the synthesized audio, and outputs the compensated audio signal. The compensation code CMk is used to correct the audio segment signal value Aj and the check value CKV in the synthesized audio. The correction is performed by summation, and the corrected audio segment signal value and check value are Aj+CMk and CKV+CMk, respectively. The marker MKV is a fixed symbol and remains unchanged. The compensated audio signal is as shown in Example 1. Figure 3 As shown.

[0175] According to the embodiment of the present application, the transmitting end can further comprise an audio modulation module, configured to modulate the compensation audio signal to obtain a driving signal; and a driving module, configured to convert the driving signal into an electric signal after receiving the driving signal, convert the electric signal into visible light carrying the compensation audio signal by using a visible light transmitter, and transmit the visible light to the receiving end.

[0176] Figure 16 is a carrier modulation part according to the embodiment of the present application Figure 14 The structure diagram of the carrier modulation part in the Figure 16 is shown in the figure Figure 14 The carrier modulation part of the audio compensation and visible light transmitting module shown in the figure can comprise an audio modulation unit and a modulator unit. The modulator unit generates a modulation signal used for audio modulation, modulates the compensation audio signal, and outputs the driving signal after converting the compensation audio signal into the driving signal.

[0177] Specifically, the carrier modulation process is as follows: the modulator unit generates a modulation signal used for audio modulation; and the audio modulation unit modulates the compensation audio signal under the action of the modulation signal, converts the compensation audio signal into the driving signal, and outputs the driving signal.

[0178] Figure 17 is an optional Figure 14 The structure diagram of the carrier modulation part in the Figure 17 is shown in the figure, which comprises a driving circuit unit and a visible light transmitter unit. The driving circuit unit receives the driving signal, converts the driving signal into a transmitting electric signal, and the visible light transmitter unit converts the transmitting electric signal into visible light and transmits the visible light to the visible light audio receiving and sounding device.

[0179] According to the above embodiment of the present application, the transmitting end further comprises a response receiving module, configured to receive a response value. The response value is generated by the receiving end when it is determined that the to-be-transmitted audio signal needs to be compensated according to the check value, and the check value is used to determine whether the to-be-transmitted audio signal needs to be compensated at the receiving end.

[0180] In this embodiment, the response receiving module receives the feedback message of the visible light audio receiving and sounding part, extracts the response value RSD from the message, and outputs the response value RSD to the audio compensation and visible light transmitting module.

[0181] The receiving end will be described in detail below. According to the above Figure 9It can be known that the receiving end can include a visible light receiving and audio acquisition module, an audio decomposition and check response module, a sounding device module and a response sending module. The main working principle is that: first, visible light is received, photoelectric conversion is performed to obtain a sensing electric signal, then the sensing electric signal is preprocessed such as filtering and amplification, and demodulation processing is performed to obtain a mixed audio signal; the mixed audio signal is processed by audio decomposition to obtain a sounding audio signal and a detection check value; the sounding audio signal is processed by audio effect, digital-to-analog conversion and the like, and a loudspeaker is driven to sound; the detection check value is analyzed and processed by check response to output a response value RSD; the response value RSD is packaged and converted into a message, and is sent in a wired or wireless manner; for example, the response value RSD is packaged into an infrared format message and is sent by infrared, or the response value RSD is packaged into a network packet format message and is sent by network.

[0182] The receiving end is described in detail in the following modules: a visible light receiving module, configured to receive visible light and convert the visible light into an electric signal; a preprocessing module, configured to preprocess the electric signal to obtain a to-be-demodulated signal after receiving the electric signal, wherein the preprocessing includes at least one of the following operations: filtering processing, amplification processing; and an audio demodulation module, configured to demodulate the to-be-demodulated signal to obtain a compensation audio signal.

[0183] In the embodiment, the visible light receiving and audio acquisition module receives visible light propagated from the visible light audio processing and emitting end, performs photoelectric conversion to obtain a sensing electric signal, then performs preprocessing such as filtering and amplification on the sensing electric signal to obtain a to-be-demodulated signal and performs demodulation processing to obtain a mixed audio.

[0184] Figure 18 is a structure diagram of a sound decoding and audio synthesizing module according to the embodiment of the present application, as shown in Figure 18 , including a visible light receiving part and a carrier demodulation part.

[0185] Figure 19 is a structure diagram of the visible light receiving part in Figure 18 according to the embodiment of the present application, as shown in Figure 19 , including a visible light receiver and a preprocessing circuit. The visible light receiver receives visible light, performs photoelectric conversion to obtain a sensing electric signal; the preprocessing circuit performs preprocessing such as filtering and amplification on the sensing electric signal to obtain a to-be-demodulated signal.

[0186] Figure 20 is a structure diagram of the carrier demodulation part in Figure 18 according to the embodiment of the present application, as shown in Figure 20As shown, it includes audio demodulation and a demodulator. The demodulator generates a demodulated signal for audio demodulation; the audio demodulator, under the action of the demodulated signal, demodulates the audio signal to be demodulated, extracting the mixed audio signal, as in Example 1 above. Figure 3 As shown. The mixed audio has the same segmented form as the compensated audio from the aforementioned visible light audio processing and transmission device, with the audio segment value denoted as R_Aj; ideally, Aj + CMk = R_Aj. However, in practice, due to interference in the visible light modulation, transmission, propagation, reception, and demodulation processes, the audio segment value of the mixed audio signal will change, i.e., the compensated audio Aj + CMk ≠ R_Aj.

[0187] Figure 21 According to an embodiment of the present invention Figure 9 The structure diagram of the mid-frequency audio decomposition and verification response module is as follows: Figure 21 As shown, it includes an audio decomposition section and a verification response section; the audio decomposition and verification response module receives a mixed audio signal, performs audio decomposition processing to obtain the emitted audio signal and the detection verification value; and analyzes and performs verification response processing on the detection verification value, outputting the response value RSD.

[0188] Figure 22 According to an embodiment of the present invention Figure 21 The structural diagram of the mid-frequency decomposition section, as shown below. Figure 22 As shown, it includes a delay unit, a detection unit, an extraction unit, and a guide switch. Specifically, a delay tr can be set first. The mixed audio signal is output to the guide switch after the delay tr. At the same time, it is detected whether the mixed audio signal has a marker MKV. If there is no MKV, the guide switch outputs the audio segment of the mixed audio signal. If there is MKV, the next audio segment signal of the marker MKV is extracted and output through the guide switch, and the value of the extracted verification audio segment is used as the detection verification value output. The guide switch outputs the sound audio signal.

[0189] The audio decomposition process is as follows: the delay unit sets a delay tr, and the mixed audio signal is output to the guide switch after passing through the delay tr; the detection unit detects the mixed audio signal, and if the marker MKV is not detected, the guide switch is connected to the delay unit; if the marker MKV is detected, the guide switch is connected to the extraction unit, and the extraction unit is driven to work until the verification audio segment ends; the extraction unit extracts the next audio segment signal R_Ai+1 from the mixed audio after the marker MKV, and outputs it to the guide switch; and extracts the values ​​R_CKV1 and R_CKV2 of the verification audio segment as detection verification values, and outputs them to the verification response part; the guide switch outputs a sound audio signal, as shown in Example 1. Figure 3 As shown.

[0190] Figure 23 According to an embodiment of the present inventionFigure 21 The structure diagram of the check response part is shown in the figure Figure 23 The mean value calculating unit calculates the mean value of the check values and outputs the check mean value. The check reference value is set. The response value RSD is calculated by using the response function with the check mean value and the check reference value as parameters.

[0191] Specifically, the check response process is as follows: the mean value calculating unit receives the check values R_CKV1 and R_CKV2, calculates the mean value of the check values, and outputs the check mean value R_CKV, i.e. R_CKV=(R_CKV1+R_CKV2) / 2. The response calculating unit sets the check reference value CKV_Vrr, receives the check mean value R_CKV, and calculates the response value RSD by using the audio response function f(R_CKV, CKV_Vrr), i.e. RSD=f(R_CKV, CKV_Vrr).

[0192] In addition, in the embodiment of the present application, the sound generating device can receive the sound generating audio, perform sound effect, digital-to-analog conversion and other processing on the sound generating audio, and drive the loudspeaker to generate sound. The response sending module encapsulates and converts the response value RSD into a processing message, and sends the processing message through wired or wireless mode. For example, the response value RSD is encapsulated into an infrared format message, and is sent through infrared, or the response value RSD is encapsulated into a network packet format message, and is sent through network.

[0193] The transmitting end of the visible light-based audio transmission system inserts the check value for detection and correction into the audio signal, and transmits the audio signal through visible light. The receiving end obtains the audio signal from the visible light, decomposes the detection check value for detection and correction from the audio signal, analyzes and processes the detection check value into the response value RSD, and sends the response value RSD to the transmitting end through wired or wireless mode. The transmitting end generates a compensation code according to the value of RSD to compensate and correct the audio signal. The receiving end obtains the audio signal after compensation and correction, drives the loudspeaker to generate sound after processing, effectively offsets the distortion of the audio signal in the process of visible light modulation, transmission, propagation, reception and demodulation, and improves the quality of the audio signal transmitted by visible light. The implementation method is simple and easy to use, and the cost is low.

[0194] The visible light-based audio transmission system provided by the embodiment of the present application comprises a transmitting end and a receiving end. The transmitting end stores the decoded audio signal in blocks and segments, and then performs identification and marking processing on the audio blocks stored in blocks. The audio segments meeting the set marking conditions are queried, and a marker MKV and a check value CKV used for detection and correction are inserted into the audio segments to form a marked block audio. The audio blocks stored in blocks and the marked block audio are synthesized to obtain a synthesized audio signal, which is compensated and then transmitted through visible light. The receiving end obtains the mixed audio after demodulation and other processing of the visible light. The detection and correction check value R_CKV used for detection and correction is then decomposed from the mixed audio, and a response value RSD is obtained after analysis and processing. The RSD is packaged and converted into a message, which is sent to the transmitting end through a wired or wireless manner. The sound audio signal is obtained and processed to drive the loudspeaker to emit sound. Moreover, the transmitting end generates a compensation code according to the value of the RSD to compensate and correct the audio signal, so as to offset the distortion of the audio signal in the process of visible light modulation, transmission, propagation, reception, demodulation and the like, and improve the quality of the audio signal transmitted through visible light. Moreover, the implementation method is simple and easy to use, and the cost is low.

[0195] Embodiment 6

[0196] According to another aspect of the embodiment of the present application, a computer readable storage medium is also provided, which comprises a stored program. The program performs the visible light-based audio transmission method of any one of the above embodiments.

[0197] Optionally, in the embodiment, the computer readable storage medium can be located in any one of the computer terminals in the computer terminal group in the computer network, or in any one of the communication devices in the communication device group.

[0198] Optionally, in the embodiment, the computer readable storage medium is configured to store program code for performing the following steps: sending the check value to the receiving end, wherein the check value is used to determine whether the to-be-transmitted audio signal needs to be compensated at the receiving end; when the response value of the receiving end is received, generating a compensation code based on the response value, wherein the response value is generated by the receiving end when it is determined that the to-be-transmitted audio signal needs to be compensated according to the check value; compensating the to-be-transmitted audio signal by using the compensation code to obtain a compensated audio signal; and performing carrier modulation on the compensated audio signal to output a driving signal to drive the visible light transmitter to emit visible light carrying the compensated audio signal to the receiving end, wherein the compensated audio signal is played at the receiving end.

[0199] Optionally, in the embodiment, the computer readable storage medium is configured to store program code for performing the following steps: decoding the initial audio signal to obtain a decoded audio signal; segmenting the decoded audio signal to obtain a plurality of audio segments; and synthesizing a plurality of audio blocks composed of the plurality of audio segments to obtain the audio signal to be transmitted.

[0200] Optionally, in the embodiment, the computer readable storage medium is configured to store program code for performing the following steps: after segmenting the decoded audio signal to obtain a plurality of audio segments, grouping a predetermined number of audio segments in the plurality of audio segments into an audio block to obtain a plurality of audio blocks; and storing the plurality of audio blocks in blocks.

[0201] Optionally, in the embodiment, the computer readable storage medium is configured to store program code for performing the following steps: comparing audio signal values of audio segments in each of the plurality of audio blocks with an audio reference value to obtain comparison results; determining one or more audio blocks in which audio signal values of a continuous predetermined number of audio segments are all less than or equal to the audio reference value as marked audio blocks to obtain one or more marked audio blocks; and synthesizing the one or more marked audio blocks to obtain the audio signal to be transmitted.

[0202] Optionally, in the embodiment, the computer readable storage medium is configured to store program code for performing the following steps: obtaining audio signal values of audio segments in the one or more marked audio blocks; replacing an audio signal value of a first audio segment in the marked audio block with a preset marker and replacing an audio signal value of a second audio segment in the marked audio block with a check value to obtain marked audio segments, wherein the first audio segment is a starting audio segment of the marked audio segments and the second audio segment is an ending audio segment of the marked audio segments and a predetermined number of audio segments adjacent to the ending audio segment; and synthesizing the marked audio segments to obtain the audio signal to be transmitted.

[0203] Optionally, in the embodiment, the computer readable storage medium is configured to store program code for performing the following steps: taking a response reference value and a response value as parameters of a compensation curve, and obtaining a compensation code by using the compensation curve, wherein the response reference value is preset according to ambient light.

[0204] Optionally, in the embodiment, the computer readable storage medium is configured to store program code for performing the following steps: compensating, by using the compensation code, an audio signal value of each segment in the audio signal to be transmitted and a check value of each segment in the audio signal to be transmitted to obtain a compensated audio signal.

[0205] Optionally, in the embodiment, the computer readable storage medium is configured to store program code for performing the following steps: modulating the compensation audio signal to obtain a drive signal; converting the drive signal into an electrical signal; converting the electrical signal into visible light carrying the compensation audio signal by using the visible light emitter, and transmitting the visible light to the receiving end, so that the receiving end analyzes the visible light and plays the compensation audio signal.

[0206] Optionally, in the embodiment, the computer readable storage medium is configured to store program code for performing the following steps: receiving the check value sent by the transmitting end, wherein the check value is used to determine whether the to-be-transmitted audio signal needs to be compensated; generating a response value when it is determined according to the check value that the to-be-transmitted audio signal needs to be compensated; sending the response value to the transmitting end, wherein the response value is used to generate a compensation code in the transmitting end, the compensation code is used to compensate the to-be-transmitted audio signal to obtain a compensation audio signal, and the compensation audio signal is used to perform carrier modulation in the transmitting end to output a drive signal to drive the visible light emitter to emit visible light carrying the compensation audio signal; after receiving the visible light, analyzing the visible light to obtain the compensation audio signal, and playing the compensation audio signal.

[0207] Embodiment 7

[0208] According to another aspect of the embodiments of the present application, a processor is also provided, the processor is used to run a program, wherein the program performs the visible light based audio transmission method of any one of the above embodiments when running.

[0209] The above-mentioned embodiment numbers of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0210] In the above-mentioned embodiments of the present application, the description of each embodiment has its own emphasis, and the parts not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0211] In several embodiments provided in the present application, it should be understood that the disclosed technical contents can be implemented by other means. Among them, the above-mentioned device embodiments are only schematic, for example, the division of the units can be a logical function division, and actual implementation can have another division way, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed each other can be through some interface, indirect coupling or communication connection between units or modules, which can be electrical or other forms.

[0212] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0213] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0214] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application, essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, including a number of instructions to make a computer device (which can be a personal computer, a server or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application. The foregoing storage medium includes: a U disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a mobile hard disk, a magnetic disk or an optical disk, and various program code storage media.

[0215] The above is only the preferred embodiment of the present application, it should be noted that for those skilled in the art, without departing from the principles of the present application, can make a number of improvements and refinements, these improvements and refinements should also be considered as the protection scope of the present application.

Claims

1. An audio transmission method based on visible light, characterized in that, include: Send a verification value to the receiving end, wherein the verification value is used to determine at the receiving end whether the audio signal to be transmitted needs to be compensated; Upon receiving the response value from the receiving end, a compensation code is generated based on the response value, wherein the response value is generated by the receiving end when it determines that the audio signal to be transmitted needs to be compensated according to the check value; The compensation code is used to compensate the audio signal to be transmitted to obtain a compensated audio signal; The compensated audio signal is carrier modulated to output a driving signal to drive a visible light transmitter to transmit visible light carrying the compensated audio signal to the receiving end, wherein the compensated audio signal is played at the receiving end; It also includes: decoding the initial audio signal to obtain a decoded audio signal; segmenting the decoded audio signal to obtain multiple audio segments; and combining multiple audio blocks composed of the multiple audio segments to obtain the audio signal to be transmitted. Generating a compensation code based on the response value includes: using a response reference value and the response value as parameters of a compensation curve, and obtaining the compensation code using the compensation curve, wherein the response reference value is preset according to ambient light.

2. The audio transmission method based on visible light according to claim 1, characterized in that, After segmenting the decoded audio signal to obtain multiple audio segments, the process further includes: Each predetermined number of audio segments from the plurality of audio segments is grouped into an audio block to obtain the plurality of audio blocks; The multiple audio blocks are stored in blocks.

3. The visible light-based audio transmission method according to claim 1, characterized in that, The audio signal to be transmitted is obtained by synthesizing multiple audio blocks composed of the multiple audio segments, including: The audio signal value of each audio segment in the plurality of audio blocks is compared with the audio reference value to obtain the comparison result; One or more audio blocks in the comparison results whose audio signal values ​​of a predetermined number of consecutive audio segments are all less than or equal to the audio reference value are identified as marked audio blocks, thus obtaining one or more marked audio blocks; The one or more marked audio blocks are synthesized to obtain the audio signal to be transmitted.

4. The visible light-based audio transmission method according to claim 3, characterized in that, The one or more marked audio blocks are synthesized to obtain the audio signal to be transmitted, including: Obtain the audio signal values ​​of audio segments in one or more of the marked audio blocks; The audio signal value of the first audio segment in the marked audio block is replaced with a preset marker, and the audio signal value of the second audio segment in the marked audio block is replaced with the check value to obtain the marked audio segment. The first audio segment is the starting audio segment of the marked audio segment, and the second audio segment is the ending audio segment of the marked audio segment and a predetermined number of audio segments adjacent to the ending audio segment. The marked audio segments are synthesized to obtain the audio signal to be transmitted.

5. The visible light-based audio transmission method according to claim 1, characterized in that, The audio signal to be transmitted is compensated using the compensation code to obtain a compensated audio signal, including: The compensation code is used to compensate for the audio signal value of each segment of the audio signal to be transmitted and the check value of each segment of the audio signal to be transmitted, so as to obtain the compensated audio signal.

6. The visible light-based audio transmission method according to any one of claims 1 to 5, characterized in that, Carrier modulation of the compensated audio signal to drive a visible light transmitter to transmit visible light carrying the compensated audio signal to the receiver via an output driving signal, including: The compensation audio signal is modulated to obtain the driving signal; The driving signal is converted into an electrical signal; The visible light transmitter converts the electrical signal into visible light carrying the compensated audio signal, and transmits the visible light to the receiving end so that the receiving end can analyze and play the visible light.

7. An audio transmission method based on visible light, characterized in that, include: The receiver sends a verification value, which is used to determine whether the audio signal to be transmitted needs to be compensated. When it is determined from the verification value that compensation is needed for the audio signal to be transmitted, a response value is generated; The response value is sent to the transmitting end, wherein the response value is used to generate a compensation code at the transmitting end, the compensation code is used to compensate the audio signal to be transmitted to obtain a compensated audio signal, and the compensated audio signal is used to perform carrier modulation at the transmitting end to output a driving signal to drive a visible light transmitter to transmit visible light carrying the compensated audio signal. After receiving the visible light, the visible light is analyzed to obtain the compensated audio signal, and the compensated audio signal is played. The transmitter is also used to perform the following steps: The initial audio signal is decoded to obtain a decoded audio signal; the decoded audio signal is segmented to obtain multiple audio segments; multiple audio blocks composed of the multiple audio segments are synthesized to obtain the audio signal to be transmitted. The response reference value and the response value are used as parameters of the compensation curve, and the compensation code is obtained using the compensation curve, wherein the response reference value is preset according to the ambient light.

8. An audio transmission device based on visible light, characterized in that, include: The first transmitting unit is used to transmit a verification value to the receiving end, wherein the verification value is used to determine at the receiving end whether the audio signal to be transmitted needs to be compensated. The first generation unit is configured to generate a compensation code based on the response value received from the receiving end, wherein the response value is generated by the receiving end when it determines that the audio signal to be transmitted needs to be compensated according to the check value. The compensation unit is used to compensate the audio signal to be transmitted using the compensation code to obtain a compensated audio signal; The transmitting unit is used to perform carrier modulation on the compensated audio signal to output a driving signal to drive a visible light transmitter to transmit visible light carrying the compensated audio signal to the receiving end, wherein the compensated audio signal is used to play at the receiving end; The audio transmission device further includes: a decoding unit for decoding an initial audio signal to obtain a decoded audio signal; a segmentation unit for segmenting the decoded audio signal to obtain multiple audio segments; and a synthesis unit for synthesizing multiple audio blocks composed of the multiple audio segments to obtain the audio signal to be transmitted. The first generation unit includes: a third acquisition module, used to use the response reference value and the response value as parameters of the compensation curve, and to obtain the compensation code using the compensation curve, wherein the response reference value is preset according to the ambient light.

9. An audio transmission device based on visible light, characterized in that, include: A receiving unit is used to receive a verification value sent by the transmitting end, wherein the verification value is used to determine whether compensation is needed for the audio signal to be transmitted; The second generation unit is used to generate a response value when it is determined from the verification value that the audio signal to be transmitted needs to be compensated. The second transmitting unit is used to send the response value to the transmitting end, wherein the response value is used to generate a compensation code at the transmitting end, the compensation code is used to compensate the audio signal to be transmitted to obtain a compensated audio signal, and the compensated audio signal is used to perform carrier modulation at the transmitting end to output a driving signal to drive a visible light transmitter to transmit visible light carrying the compensated audio signal. The processing unit is configured to, upon receiving the visible light, analyze the visible light to obtain the compensated audio signal and play the compensated audio signal. The transmitting end is also used to perform the following steps: The initial audio signal is decoded to obtain a decoded audio signal; the decoded audio signal is segmented to obtain multiple audio segments; multiple audio blocks composed of the multiple audio segments are synthesized to obtain the audio signal to be transmitted. The response reference value and the response value are used as parameters of the compensation curve, and the compensation code is obtained using the compensation curve, wherein the response reference value is preset according to the ambient light.

10. An audio transmission system based on visible light, characterized in that, include: It includes a transmitter of the visible light-based audio transmission device as described in claim 8, and a receiver of the visible light-based audio transmission device as described in claim 9; the transmitter and the receiver communicate with each other; wherein, The transmitting end is used to perform carrier modulation on the compensated audio signal to output a driving signal to drive a visible light transmitter to transmit visible light carrying the compensated audio signal to the receiving end, wherein the compensated audio signal is used to play at the receiving end; The receiving end is used to analyze the visible light after receiving it to obtain the compensated audio signal, and then play the compensated audio signal.

11. The visible light-based audio transmission system according to claim 10, characterized in that, The transmitting end includes: An audio decoding module is used to receive an initial audio signal and decode the initial audio signal to obtain a decoded audio signal; The block storage module is used to segment the decoded audio signal, combine a predetermined number of audio segments from the multiple audio segments into an audio block, obtain the multiple audio blocks, and store the multiple audio blocks in blocks. An audio synthesis module is used to synthesize the multiple audio blocks to obtain the audio signal to be transmitted.

12. The visible light-based audio transmission system according to claim 11, characterized in that, The transmitter also includes: An audio recognition module is used to compare the audio signal value of each audio segment in the plurality of audio blocks with an audio reference value to obtain a comparison result; An audio tagging module is used to identify one or more audio blocks in the comparison result where the audio signal values ​​of a predetermined number of consecutive audio segments are all less than or equal to the audio reference value as tagged audio blocks, replace the audio signal value of the first audio segment in the tagged audio block with a preset tag, and replace the audio signal value of the second audio segment in the tagged audio block with the check value to obtain tagged audio segments.

13. The visible light-based audio transmission system according to claim 12, characterized in that, The audio synthesis module includes: An audio reading submodule is used to read the audio signal value of the audio segment of each of the one or more audio blocks; The identification reading submodule is used to read the audio signal values ​​of each audio segment in the marked audio block and the audio signal values ​​of multiple marked audio segments; The synthesis control submodule is used to output the audio signal to be transmitted when it is determined that the address of one or more audio blocks matches that of the marked audio block.

14. The visible light-based audio transmission system according to claim 11, characterized in that, The transmitter also includes: An audio compensation module is used to take the response reference value and the response value as parameters of a compensation curve, obtain the compensation code using the compensation curve, and use the compensation code to compensate the audio signal value of each segment of the audio signal to be transmitted and the check value of each segment of the audio signal to be transmitted, thereby obtaining the compensated audio signal. The response reference value is preset according to the ambient light.

15. The visible light-based audio transmission system according to claim 11, characterized in that, The transmitter also includes: An audio modulation module is used to modulate the compensated audio signal to obtain the driving signal; The driving module is used to convert the driving signal into an electrical signal after receiving the driving signal, convert the electrical signal into visible light carrying the compensated audio signal using the visible light transmitter, and transmit the visible light to the receiving end.

16. The visible light-based audio transmission system according to any one of claims 11 to 15, characterized in that, The transmitter also includes: A response receiving module is used to receive a response value, wherein the response value is generated by the receiving end when it determines that the audio signal to be transmitted needs to be compensated based on a check value, and the check value is used by the receiving end to determine whether the audio signal to be transmitted needs to be compensated.

17. The visible light-based audio transmission system according to claim 11, characterized in that, The receiving end includes: Visible light receiving module, used to receive the visible light and convert the visible light into an electrical signal; A preprocessing module is used to preprocess the electrical signal after receiving it to obtain a signal to be demodulated, wherein the preprocessing includes at least one of the following operations: filtering and amplification. The audio demodulation module is used to demodulate the signal to be demodulated to obtain a compensated audio signal.

18. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program executes the visible light-based audio transmission method according to any one of claims 1 to 7.

19. A processor, characterized in that, The processor is used to run a program, wherein the program executes the visible light-based audio transmission method according to any one of claims 1 to 7.

Images