Method, device, system, equipment and medium for simultaneous transmission of different types of audio
By using simultaneous transmission methods of different types of audio in the conference room audio and video system, the problems of many devices, cumbersome wiring and difficult maintenance are solved, and efficient transmission and cost reduction are achieved.
Patent Information
- Application Number
- CN202210404418.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-18
- Publication Date
- 2025-03-14
- Estimated Expiration
- 2042-04-18
AI Technical Summary
Due to the many equipment, cumbersome wiring and difficult maintenance, the existing conference room audio and video systems have high costs, insufficient control and safety, and difficulty in expansion.
Through a simultaneous transmission method of different types of audio, raw audio data is collected, processed into different types of audio signals, and transmitted to the corresponding signal processing device through a single device, reducing the complexity of device stacking and wiring.
It realizes efficient transmission of audio signals, reduces the complexity of equipment and wiring, improves the stability and maintenance simplicity of the system, and reduces costs and failure rates.
Smart Images

Figure CN114845209B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of audio transmission, and in particular to a method, device, computer equipment and computer-readable storage medium for simultaneously transmitting different types of audio. Background Art
[0002] The existing conference room audio and video systems on the market mainly realize the functional application of two signals by stacking many devices. The functions are realized through two independent subsystems. The two subsystems are the same type of audio systems and are controlled separately. The final effect of the system is that the audio system is two independent operating systems, with many devices, it is difficult to find problems, and the system is cumbersome.
[0003] The existing conference system is mainly a traditional audio and video system, which has the following disadvantages:
[0004] 1) Multiple devices and complex maintenance: Since the system is an independently operated system, it requires different types of devices. The more devices there are, the more faults there are, and the higher the technical requirements for the users. If a system fails, professionals are required to troubleshoot the system, which increases the time and cost of solving the problem. In addition, the traditional audio and video system is a stack of multiple devices, which are connected by various wiring harnesses, and then other devices are controlled by a professional central control system. The large number of equipment types invisibly increases the variables of system stability.
[0005] 2) Complicated wiring: The system requires professional cables (due to the large number of audio devices, more wiring, and high maintenance costs), which increases the difficulty of construction; the large number of equipment types means a large number of wire types, and debugging and subsequent maintenance require professional personnel to be competent for system debugging, and subsequent use also requires professional training before use;
[0006] 3) Difficulty in expansion: Since the construction of the conference room is based on the needs at the time of the initial design, the number of audio and video interfaces is planned. Therefore, in the later use process, if you want to increase the interface, you need to replace more interface devices and rearrange various types of wires, which will invisibly repeat the cost and waste resources.
[0007] At present, there is no effective solution to the problems existing in related technologies, such as equipment stacking, complicated wiring, difficult maintenance, high cost, controllability and security in conference rooms. Summary of the invention
[0008] The purpose of this application is to address the deficiencies in the prior art and to provide a method, device, system, computer equipment and computer-readable storage medium for simultaneous transmission of different types of audio, so as to at least solve the problems existing in the related art such as equipment stacking in conference rooms, cumbersome wiring, difficult maintenance, high cost, controllability and security.
[0009] To achieve the above purpose, the technical solution adopted by this application is:
[0010] In a first aspect, the present invention provides a method for simultaneously transmitting different types of audio, comprising:
[0011] Collect raw audio data;
[0012] Processing the original audio data to obtain a first audio signal and a second audio signal, wherein a type of the first audio signal is different from a type of the second audio signal;
[0013] The first audio signal is transmitted to a first signal processing device, and the second audio signal is transmitted to a second signal processing device, wherein the first signal processing device is different from the second signal processing device, and the first signal processing device transmits the first audio signal to the second signal processing device.
[0014] In some of the embodiments, it also includes:
[0015] Get signal transmission instructions;
[0016] transmitting at least one of the first audio signal and the second audio signal according to the signal transmission instruction, or not transmitting the first audio signal and the second audio signal;
[0017] Wherein, in the case where only one of the first audio signal and the second audio signal is transmitted, the transmitted audio signal is enhanced and transmitted, and the non-transmitted audio signal is stored.
[0018] In some of the embodiments, it also includes:
[0019] Obtaining a first signal transmission instruction;
[0020] performing enhancement processing on the first audio signal corresponding to the first signal transmission instruction, and performing storage processing on the second audio signal not corresponding to the first signal transmission instruction;
[0021] According to the first signal transmission instruction, the enhanced first audio signal is transmitted to the first signal processing device.
[0022] In some of the embodiments, it also includes:
[0023] Obtaining a second signal transmission instruction;
[0024] performing enhancement processing on the second audio signal corresponding to the second signal transmission instruction, and performing storage processing on the first audio signal not corresponding to the second signal transmission instruction;
[0025] According to the second signal transmission instruction, the enhanced second audio signal is transmitted to the second signal processing device.
[0026] In some of the embodiments, it also includes:
[0027] Obtaining a third signal transmission instruction;
[0028] The first audio signal is transmitted to the first signal processing device and the second audio signal is transmitted to the second signal processing device according to the third signal transmission instruction.
[0029] In some of the embodiments, it also includes:
[0030] Obtaining a fourth signal transmission instruction;
[0031] not transmitting the first audio signal and the second audio signal according to the fourth signal transmission instruction;
[0032] The first audio signal and the second audio signal are stored and processed.
[0033] In some embodiments, storing the audio signal not to be transmitted includes:
[0034] Obtaining current time information and preset time threshold of the audio signal;
[0035] An audio signal with the current time information as an end point and the preset time threshold as a time length is stored.
[0036] In some embodiments, storing the audio signal not to be transmitted includes:
[0037] Get the current time information and start time information of the audio signal;
[0038] Calculate a first time difference between the current time information and the start time information;
[0039] Determining whether the first time difference matches a preset time threshold;
[0040] When the first time difference matches the preset time threshold, the audio signal is stored.
[0041] In some embodiments, after determining whether the first time difference matches a preset time threshold, the method further includes:
[0042] When the first time difference does not match the preset time threshold, calculating a second time difference between the first time difference and the preset time threshold;
[0043] storing an audio signal with the current time information as an end point and the preset time threshold as a time length;
[0044] The audio signal starting from the start time information and having the second time difference as the time length is deleted.
[0045] In a second aspect, the present invention provides a device for simultaneously transmitting different types of audio, comprising:
[0046] A collection unit, used for collecting original audio data;
[0047] A first processing unit, configured to process the original audio data to obtain a first audio signal;
[0048] a second processing unit, configured to process the original audio data to obtain a second audio signal, wherein a type of the second audio signal is different from a type of the first audio signal;
[0049] A first transmission unit, configured to transmit the first audio signal to a first signal processing device;
[0050] a second transmission unit, configured to transmit the second audio signal to a second signal processing device, wherein the second signal processing device is different from the first signal processing device;
[0051] The first signal processing device transmits the first audio signal to the second signal processing device.
[0052] In some of the embodiments, it also includes:
[0053] An instruction acquisition unit, used for acquiring a signal transmission instruction;
[0054] a third processing unit, configured to, when only one of the first audio signal and the second audio signal is transmitted, perform enhancement processing on the transmitted audio signal;
[0055] a storage unit, configured to store the audio signal that is not transmitted when only one of the first audio signal and the second audio signal is transmitted;
[0056] The first transmission unit is further configured to transmit or not transmit the first audio signal according to the signal transmission instruction and / or the second transmission unit is configured to transmit or not transmit the second audio signal according to the signal transmission instruction.
[0057] In some embodiments, the instruction acquisition unit includes:
[0058] A first instruction acquisition module, used to acquire a first signal transmission instruction;
[0059] The third processing unit is used to perform enhancement processing on the first audio signal corresponding to the first signal transmission instruction;
[0060] The storage unit is used for storing the second audio signal which does not correspond to the first signal transmission instruction;
[0061] The first transmission unit is used for transmitting the enhanced first audio signal to the first signal processing device according to the first signal transmission instruction.
[0062] In some embodiments, the instruction acquisition unit includes:
[0063] A second instruction acquisition module, used to acquire a second signal transmission instruction;
[0064] The third processing unit is used to perform enhancement processing on the second audio signal corresponding to the second signal transmission instruction;
[0065] The storage unit is used for storing the first audio signal which does not correspond to the second signal transmission instruction;
[0066] The second transmission unit is used for transmitting the enhanced second audio signal to the second signal processing device according to the second signal transmission instruction.
[0067] In some embodiments, the instruction acquisition unit includes:
[0068] A third instruction acquisition module, used to acquire a third signal transmission instruction;
[0069] Wherein, the first transmission unit is used to transmit the first audio signal to the first signal processing device according to the third signal transmission instruction;
[0070] The second transmission unit is used for transmitting the second audio signal to a second signal processing device according to the third signal transmission instruction.
[0071] In some embodiments, the instruction acquisition unit includes:
[0072] A fourth instruction acquisition module, used to acquire a fourth signal transmission instruction;
[0073] Wherein, the first transmission unit is used for not transmitting the first audio signal to the first signal processing device according to the fourth signal transmission instruction;
[0074] The second transmission unit is used for not transmitting the second audio signal to the second signal processing device according to the fourth signal transmission instruction;
[0075] The storage unit is used to store the first audio signal and the second audio signal.
[0076] In some of the embodiments, it also includes:
[0077] A time acquisition unit, used to acquire current time information and a preset time threshold of an audio signal;
[0078] The storage unit is further used to store an audio signal with the current time information as an end point and the preset time threshold as a time length.
[0079] In some of the embodiments, it also includes:
[0080] A time acquisition unit, used to acquire current time information and start time information of an audio signal;
[0081] A first calculation unit, used to calculate a first time difference between the current time information and the start time information;
[0082] A judging unit, configured to judge whether the first time difference matches a preset time threshold;
[0083] The storage unit is further configured to store the audio signal when the first time difference matches the preset time threshold.
[0084] In some of the embodiments, it also includes:
[0085] A second calculation unit, configured to calculate a second time difference between the first time difference and the preset time threshold when the first time difference does not match the preset time threshold;
[0086] a deleting unit, configured to delete an audio signal starting from the start time information and having a time length equal to the second time difference;
[0087] The storage unit is further configured to store an audio signal with the current time information as an end point and the preset time threshold as a time length when the first time difference does not match the preset time threshold.
[0088] In a third aspect, the present invention provides a system for simultaneously transmitting different types of audio, comprising:
[0089] A simultaneous transmission device, for collecting original audio data and processing the original audio to obtain a first audio signal and a second audio signal, wherein the type of the first audio signal is different from the type of the second audio signal;
[0090] A first signal processing device, used for acquiring the first audio signal transmitted by the simultaneous transmission device;
[0091] The second signal processing device is used to obtain the second audio signal transmitted by the simultaneous transmission device and the first audio signal transmitted by the first signal processing device, wherein the second signal processing device is different from the first signal processing device.
[0092] In some of the embodiments, it also includes:
[0093] a power amplifying device, configured to obtain the first audio signal or the second audio signal transmitted by the second signal processing device;
[0094] The first playing device is used to play the first audio signal or the second audio signal transmitted by the power amplifying device.
[0095] In some of the embodiments, further comprising:
[0096] The second playing device is used to play the first audio signal or the second audio signal transmitted by the second signal processing device.
[0097] In a fourth aspect, the present invention provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the simultaneous transmission method as described above when executing the computer program.
[0098] In a fifth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the simultaneous transmission method as described above.
[0099] Compared with the related art, the embodiments of the present application provide a method, apparatus, system, device and medium for simultaneous transmission of different types of audio, which sends dual signals to a mixing device through a single device, reduces equipment stacking, improves stability, reduces failure rate, reduces maintenance and operation difficulty, and reduces purchase cost and usage cost; the dual signals do not affect each other, achieving the effect of efficient transmission; on-site wiring is simple, with fewer types of cables, making the site more concise. BRIEF DESCRIPTION OF THE DRAWINGS
[0100] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0101] Figure 1 is a flowchart of a simultaneous transmission method according to an embodiment of the present application (I);
[0102] Figure 2a is a flowchart (II) of a simultaneous transmission method according to an embodiment of the present application;
[0103] Figure 2b is a flowchart of a simultaneous transmission method according to an embodiment of the present application (III);
[0104] Figure 2c is a flowchart of a simultaneous transmission method according to an embodiment of the present application (IV);
[0105] Figure 2d is a flowchart of a simultaneous transmission method according to an embodiment of the present application (V);
[0106] Figure 2e is a flowchart of a simultaneous transmission method according to an embodiment of the present application (six);
[0107] Figure 3 is a flowchart of a simultaneous transmission method according to an embodiment of the present application (VII);
[0108] Figure 4 is a flowchart of a simultaneous transmission method according to an embodiment of the present application (eight);
[0109] Figure 5 is a flowchart of a simultaneous transmission method according to an embodiment of the present application (IX);
[0110] Figure 6 is a framework diagram (I) of a simultaneous transmission device according to an embodiment of the present application;
[0111] Figure 7 is a framework diagram (II) of a simultaneous transmission device according to an embodiment of the present application;
[0112] Figure 8 is a framework diagram (III) of a simultaneous transmission device according to an embodiment of the present application;
[0113] Fig. 9 is a framework diagram of a simultaneous transmission device according to an embodiment of the present application (IV);
[0114] Fig.10 is a framework diagram of a simultaneous transmission system according to an embodiment of the present application;
[0115] Fig.11 It is a specific implementation framework diagram of the simultaneous transmission system according to an embodiment of the present application.
[0116] The accompanying drawings are marked as follows: 60, simultaneous transmission device; 601, acquisition unit; 602, first processing unit; 603, second processing unit; 604, first transmission unit; 605, second transmission unit; 606, instruction acquisition unit; 606a, first instruction acquisition module; 606b, second instruction acquisition module; 606c, third instruction acquisition module; 606d, fourth instruction acquisition module; 607, third processing unit; 608, storage unit; 609, time acquisition unit; 610, first calculation unit; 611, judgment unit; 612, second calculation unit; 613, deletion unit;
[0117] 70. A first signal processing device; 80. A second signal processing device; 90. A power amplifying device; 100. A first playback device; 110. A second playback device. DETAILED DESCRIPTION
[0118] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments provided in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.
[0119] Obviously, the drawings described below are only some examples or embodiments of the present application. For ordinary technicians in this field, the present application can also be applied to other similar scenarios based on these drawings without creative work. In addition, it can also be understood that although the efforts made in this development process may be complicated and lengthy, for ordinary technicians in this field related to the content disclosed in this application, some changes in design, manufacturing or production based on the technical content disclosed in this application are just conventional technical means, and should not be understood as insufficient content disclosed in this application.
[0120] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those of ordinary skill in the art that the embodiments described in this application may be combined with other embodiments without conflict.
[0121] Unless otherwise defined, the technical terms or scientific terms involved in this application should be understood by people with ordinary skills in the technical field to which this application belongs. The words "one", "a", "a", "the" and the like involved in this application do not indicate a quantitative limitation, and may represent the singular or plural. The terms "include", "comprise", "have" and any of their variations involved in this application are intended to cover non-exclusive inclusions; for example, a process, method, system, product or device that includes a series of steps or units (units) is not limited to the listed steps or units, but may also include steps or units that are not listed, or may also include other steps or units inherent to these processes, methods, products or devices. The words "connect", "connected", "coupled" and the like involved in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "multiple" involved in this application refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships, for example, "A and / or B" can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects before and after are in an "or" relationship. The terms "first", "second", "third", etc. involved in this application are only used to distinguish similar objects and do not represent a specific ordering of the objects.
[0122] Example 1
[0123] Figure 1 1 is a flowchart of a simultaneous transmission method according to an embodiment of the present invention (I). Figure 1 A method for simultaneously transmitting different types of audio, comprising:
[0124] Step S102, collecting original audio data;
[0125] Step S104: Process the original audio data to obtain a first audio signal and a second audio signal, wherein the type of the first audio signal is different from the type of the second audio signal;
[0126] Step S106: transmitting the first audio signal to a first signal processing device, and transmitting the second audio signal to a second signal processing device, wherein the first signal processing device is different from the second signal processing device, and the first signal processing device transmits the first audio signal to the second signal processing device.
[0127] In some of the embodiments, steps S102 to S106 are performed by a conference microphone.
[0128] In some embodiments, the first audio signal is a digital signal, and the second audio signal is an analog signal.
[0129] In some of the embodiments, the first signal processing device is a conference host, and the second signal processing device is a mixing device, including but not limited to an audio processor and a mixing console.
[0130] Through the above steps, dual signals are sent to the mixing device through a single device, which reduces equipment stacking, improves stability, reduces failure rate, reduces maintenance and operation difficulty, and reduces purchase cost and use cost; the dual signals do not affect each other, achieving the effect of efficient transmission; on-site wiring is simple, with fewer types of cables, making the site more concise.
[0131] Figure 2a 1 is a flowchart of a simultaneous transmission method according to an embodiment of the present invention (II). Figure 2a As shown, it also includes:
[0132] Step S202, obtaining a signal transmission instruction;
[0133] Step S204: transmitting at least one of the first audio signal and the second audio signal according to the signal transmission instruction, or not transmitting the first audio signal and the second audio signal;
[0134] In the case where only one of the first audio signal and the second audio signal is transmitted, the transmitted audio signal is enhanced and transmitted, and the non-transmitted audio signal is stored.
[0135] Specifically, in step S204, it includes:
[0136] 1) Only transmit the first audio signal;
[0137] 2) Transmitting only the second audio signal;
[0138] 3) transmitting the first audio signal and the second audio signal simultaneously;
[0139] 4) The first audio signal and the second audio signal are not transmitted.
[0140] Among them, enhancement processing refers to enhancing the quality of the transmitted audio signal to make the transmitted audio signal clearer.
[0141] Furthermore, the enhancement processing is real-time enhancement processing.
[0142] The storage processing refers to temporarily storing, pre-storing or caching the audio signal that is not to be transmitted, so that when the audio signal needs to be transmitted, it can be transmitted in real time.
[0143] Further, in the case where only the first audio signal (or the second audio signal) is transmitted, if the second audio signal (or the first audio signal) needs to be transmitted simultaneously, the first audio signal (or the second audio signal) is no longer enhanced.
[0144] Figure 2b Flowchart (III) of the simultaneous transmission method according to an embodiment of the present invention. Figure 2b As shown, steps S202 to S204 specifically include:
[0145] Step S202a, obtaining a first signal transmission instruction;
[0146] Step S204a, performing enhancement processing on the first audio signal corresponding to the first signal transmission instruction;
[0147] Step S206a, storing the second audio signal that does not correspond to the first signal transmission instruction;
[0148] Step S208a: Transmit the enhanced first audio signal to the first signal processing device according to the first signal transmission instruction.
[0149] Figure 2c 4 is a flowchart of a simultaneous transmission method according to an embodiment of the present invention. Figure 2c As shown, steps S202 to S204 specifically include:
[0150] Step S202b, obtaining a second signal transmission instruction;
[0151] Step S204b, performing enhancement processing on the second audio signal corresponding to the second signal transmission instruction;
[0152] Step S206b, storing the first audio signal that does not correspond to the second signal transmission instruction;
[0153] Step S208b: Transmit the enhanced second audio signal to the second signal processing device according to the second signal transmission instruction.
[0154] Figure 2d FIG. 5 is a flowchart of a simultaneous transmission method according to an embodiment of the present invention. Figure 2d As shown, steps S202 to S204 specifically include:
[0155] Step S202c, obtaining a third signal transmission instruction;
[0156] Step S204c: transmitting the first audio signal to the first signal processing device and transmitting the second audio signal to the second signal processing device according to the third signal transmission instruction.
[0157] Figure 2e 6 is a flowchart of a simultaneous transmission method according to an embodiment of the present invention. Figure 2eAs shown, steps S202 to S204 specifically include:
[0158] Step S202d, obtaining a fourth signal transmission instruction;
[0159] Step S204d: not transmitting the first audio signal and the second audio signal according to the fourth signal transmission instruction;
[0160] Step S206d: store the first audio signal and the second audio signal.
[0161] Through the above steps, when only the first audio signal or the second audio signal is transmitted, the transmitted audio signal is enhanced to improve the quality of the audio signal; the audio signal that is not transmitted is stored and processed to reduce the pressure of real-time processing when transmission is required, avoiding delays and other problems.
[0162] Figure 3 7 is a flowchart of a simultaneous transmission method according to an embodiment of the present invention. Figure 3 As shown, the storage process of the audio signal not to be transmitted includes:
[0163] Step S302: obtaining current time information and a preset time threshold of the audio signal;
[0164] Step S304: storing an audio signal with the current time information as the end point and the preset time threshold as the time length.
[0165] In step S302, the current time information refers to the latest time of the audio signal, and the preset time threshold is the length of time for temporary storage, pre-storage or cache.
[0166] In some embodiments, the preset time threshold is 5s to 30s. Preferably, the preset time threshold is 5s to 15s. More preferably, the preset time threshold is 10s.
[0167] In step S302 to step S304, the applicable scenario is generally that the original audio data has been collected for a long time.
[0168] Through the above steps, only part of the audio signal is stored and processed, which reduces bandwidth occupancy and improves work efficiency.
[0169] Figure 4 8 is a flowchart of a simultaneous transmission method according to an embodiment of the present invention. Figure 4 As shown, the storage process of the audio signal not to be transmitted includes:
[0170] Step S402: obtaining current time information and start time information of the audio signal;
[0171] Step S404, calculating a first time difference between the current time information and the start time information;
[0172] Step S406: determining whether the first time difference matches a preset time threshold;
[0173] Step S408: When the first time difference matches a preset time threshold, the audio signal is stored.
[0174] In step S402, the current time information refers to the latest time of the audio signal, and the start time information refers to the start time of the unstored audio signal or the start time of the stored audio signal, wherein the start time of the stored audio signal refers to the start time of the stored part of the audio signal.
[0175] In step S406, the preset time threshold is 5s to 30s. Preferably, the preset time threshold is 5s to 15s. More preferably, the preset time threshold is 10s.
[0176] In step S408, the first time difference matches the preset time threshold, which means that the first time difference is less than or equal to the preset time threshold.
[0177] In step S402 to step S408, the applicable scenario is generally when the original audio data has just started to be collected, or the original audio data has been collected for a short period of time, or the original audio data has been collected for a period of time but has not yet been stored and processed.
[0178] Figure 5 9 is a flowchart of a simultaneous transmission method according to an embodiment of the present invention. Figure 5 As shown, after determining whether the first time difference matches the preset time threshold, it also includes:
[0179] Step S502: when the first time difference does not match the preset time threshold, calculate a second time difference between the first time difference and the preset time threshold;
[0180] Step S504, storing an audio signal with the current time information as the end point and the preset time threshold as the time length;
[0181] Step S506: Delete the audio signal starting from the start time information and having the second time difference as the time length.
[0182] In step S502, the first time difference value does not match the preset time threshold value, which means that the first time difference value is greater than the preset time threshold value.
[0183] In step S504 and step S506, the audio signal is trimmed and divided into two audio signals. The first audio signal takes the start information as the starting point and the second time difference as the time length, and the second audio signal takes the current time information as the end point and the preset time threshold as the time length.
[0184] There is no specific order for executing step S504 and step S506. Step S504 may be executed first and then step S506, or step S506 may be executed first and then step S504.
[0185] In some embodiments, the second time difference is 1s to 5s. Preferably, the second time difference is 1s to 3s. More preferably, the second time difference is 2s.
[0186] Through the above steps, the audio signal can be stored and deleted in real time when the audio signal is processed and generated, so as to avoid occupying too much bandwidth, improve work processing efficiency, and transmit it at any time.
[0187] Figure 6 1 is a schematic diagram of a simultaneous transmission device according to an embodiment of the present invention (I). Figure 6 As shown, the device 60 for simultaneously transmitting different types of audio includes a collection unit 601, a first processing unit 602, a second processing unit 603, a first transmission unit 604, and a second transmission unit 605. The collection unit 601 is used to collect original audio data; the first processing unit 602 is used to process the original audio data to obtain a first audio signal; the second processing unit 603 is used to process the original audio data to obtain a second audio signal, wherein the type of the second audio signal is different from the type of the first audio signal; the first transmission unit 604 is used to transmit the first audio signal to a first signal processing device; the second transmission unit 605 is used to transmit the second audio signal to a second signal processing device, the second signal processing device is different from the first signal processing device, and the first signal processing device transmits the first audio signal to the second signal processing device.
[0188] Among them, the acquisition unit 601 is communicated with the first processing unit 602 and the second processing unit 603 respectively (wired connection or wireless connection), the first processing unit 602 is communicated with the first transmission unit 604 (wired connection or wireless connection), and the second processing unit 603 is communicated with the second transmission unit 605 (wired connection or wireless connection).
[0189] The simultaneous transmission device 60 is a conference microphone.
[0190] Figure 7 2 is a schematic diagram of a simultaneous transmission device according to an embodiment of the present invention. Figure 7As shown, the transmission device 60 also includes an instruction acquisition unit 606, a third processing unit 607 and a storage unit 608. The instruction acquisition unit 606 is used to acquire a signal transmission instruction; the first transmission unit 604 is also used to transmit the first audio signal according to the signal transmission instruction and / or the second transmission unit 605 is used to transmit the second audio signal according to the signal transmission instruction; the third processing unit 607 is used to enhance the transmitted audio signal when only one of the first audio signal and the second audio signal is transmitted; the storage unit 608 is used to store the audio signal that is not transmitted when only one of the first audio signal and the second audio signal is transmitted.
[0191] The instruction acquisition unit 606 is respectively connected to the first processing unit 602 , the second processing unit 603 , the third processing unit 607 , and the storage unit 608 , and the third processing unit 607 is respectively connected to the first transmission unit 604 and the second transmission unit 605 .
[0192] Furthermore, the instruction acquisition unit 606 includes a first instruction acquisition module 606a. The first instruction acquisition module 606a is used to acquire a first signal transmission instruction; the third processing unit 607 is used to enhance the first audio signal corresponding to the first signal transmission instruction; the storage unit 608 is used to store the second audio signal that does not correspond to the first signal transmission instruction; and the first transmission unit 604 is used to transmit the enhanced first audio signal to the first signal processing device according to the first signal transmission instruction.
[0193] Furthermore, the instruction acquisition unit 606 includes a second instruction acquisition module 606b. The second instruction acquisition module 606b is used to acquire a second signal transmission instruction; the third processing unit 607 is used to enhance the second audio signal corresponding to the second signal transmission instruction; the storage unit 608 is used to store the first audio signal that does not correspond to the second signal transmission instruction; and the second transmission unit 605 is used to transmit the enhanced second audio signal to the second signal processing device according to the second signal transmission instruction.
[0194] Furthermore, the instruction acquisition unit 606 includes a third instruction acquisition module 606c. The third instruction acquisition module 606c is used to acquire a third signal transmission instruction; the first transmission unit 604 is used to transmit the first audio signal to the first signal processing device according to the third signal transmission instruction; and the second transmission unit 605 is used to transmit the second audio signal to the second signal processing device according to the third signal transmission instruction.
[0195] Furthermore, the instruction acquisition unit 606 includes a fourth instruction acquisition module 606d. The fourth instruction acquisition module 606d is used to acquire a fourth signal transmission instruction; the first transmission unit 604 is used to not transmit the first audio signal to the first signal processing device according to the fourth signal transmission instruction; the second transmission unit 605 is used to not transmit the second audio signal to the second signal processing device according to the fourth signal transmission instruction; and the storage unit 608 is used to store the first audio signal and the second audio signal.
[0196] Figure 8 3 is a framework diagram of a simultaneous transmission device according to an embodiment of the present invention. Figure 8 As shown, the transmission device 60 also includes a time acquisition unit 609. The time acquisition unit 609 is used to acquire the current time information and the preset time threshold of the audio signal; the storage unit 608 is also used to store the audio signal with the current time information as the end point and the preset time threshold as the time length.
[0197] The time acquisition unit 609 is respectively connected to the first processing unit 602 , the second processing unit 603 , the instruction acquisition unit 606 , and the storage unit 608 in communication.
[0198] Fig. 9 4 is a schematic diagram of a simultaneous transmission device according to an embodiment of the present invention. Fig. 9 As shown, the transmission device 60 also includes a time acquisition unit 609, a first calculation unit 610 and a judgment unit 611. The time acquisition unit 609 is used to acquire the current time information and the start time information of the audio signal; the first calculation unit 610 is used to calculate the first time difference between the current time information and the start time information; the judgment unit 611 is used to judge whether the first time difference matches the preset time threshold; the storage unit 608 is also used to store the audio signal when the first time difference matches the preset time threshold.
[0199] The time acquisition unit 609 is respectively connected to the first processing unit 602 , the second processing unit 603 , the instruction acquisition unit 606 , and the first calculation unit 610 , and the judgment unit 611 is respectively connected to the first calculation unit 610 and the storage unit 608 .
[0200] Furthermore, the simultaneous transmission device 60 also includes a second calculation unit 612 and a deletion unit 613. The second calculation unit 612 is used to calculate the second time difference between the first time difference and the preset time threshold when the first time difference does not match the preset time threshold; the deletion unit 613 is used to delete the audio signal with the start time information as the starting point and the second time difference as the time length; the storage unit 608 is also used to store the audio signal with the current time information as the end point and the preset time threshold as the time length when the first time difference does not match the preset time threshold.
[0201] Fig.10 is a framework diagram of a simultaneous transmission system according to an embodiment of the present invention. Fig.10 As shown, the simultaneous transmission system includes a simultaneous transmission device 60, a first signal processing device 70, and a second signal processing device 80. The simultaneous transmission device 60 is used to collect original audio data and process the original audio to obtain a first audio signal and a second audio signal, wherein the type of the first audio signal is different from the type of the second audio signal; the first signal processing device 70 is used to obtain the first audio signal transmitted by the simultaneous transmission device 60; the second signal processing device 80 is used to obtain the second audio signal transmitted by the simultaneous transmission device 60 and the first audio signal transmitted by the first signal processing device 70, wherein the second signal processing device 80 is different from the first signal processing device 70.
[0202] The simultaneous transmission device 60 is a conference microphone, the first signal processing device 70 is a conference host, and the second signal processing device 80 is a mixing device, including but not limited to an audio processor or a mixing console.
[0203] Furthermore, the simultaneous transmission system also includes a power amplifier 90 and a first playback device 100. The power amplifier 90 is used to obtain the first audio signal or the second audio signal transmitted by the second signal processing device 80; the first playback device 100 is used to play the first audio signal or the second audio signal transmitted by the power amplifier 90.
[0204] The power amplifying device 90 is a power amplifier, and the first playing device 100 is a speaker.
[0205] Furthermore, the simultaneous transmission system further includes a second playback device 110 , wherein the second playback device 110 is used to play the first audio signal or the second audio signal transmitted by the second signal processing device 80 .
[0206] The second playing device 110 is a speaker.
[0207] In addition, the simultaneous transmission method of the embodiment of the present application can be implemented by a computer device. The components of the computer device may include but are not limited to a processor and a memory storing computer program instructions.
[0208] In some embodiments, the processor may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.
[0209] In some embodiments, the memory may include a large capacity memory for data or instructions. By way of example and not limitation, the memory may include a hard disk drive (HDD), a floppy disk drive, a solid state drive (SSD), a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. Where appropriate, the memory may include a removable or non-removable (or fixed) medium. Where appropriate, the memory may be inside or outside a data processing device. In a specific embodiment, the memory is a non-volatile memory. In a specific embodiment, the memory includes a read-only memory (ROM) and a random access memory (RAM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (Programmable Read-Only Memory, PROM for short), an erasable PROM (Erasable ProgrammableRead-Only Memory, EPROM for short), an electrically erasable PROM (Electrically Erasable ProgrammableRead-Only Memory, EEPROM for short), an electrically alterable ROM (Electrically Alterable Read-Only Memory, EAROM for short) or a flash memory (FLASH) or a combination of two or more of these. Under appropriate circumstances, the RAM can be a static random access memory (SRAM) or a dynamic random access memory (DRAM), wherein the DRAM can be a fast page mode dynamic random access memory (FPMDRAM), an extended data output dynamic random access memory (EDODRAM), a synchronous dynamic random access memory (SDRAM), etc.
[0210] The memory may be used to store or cache various data files required for processing and / or communication, as well as possible computer program instructions executed by the processor.
[0211] The processor implements any one of the simultaneous transmission methods in the above embodiments by reading and executing computer program instructions stored in the memory.
[0212] In some embodiments, the computer device may further include a communication interface and a bus, wherein the processor, the memory, and the communication interface are connected via the bus and communicate with each other.
[0213] The communication interface is used to realize the communication between each unit, device, unit and / or device in the embodiment of the present application. The communication interface can also realize data communication with other components such as: external devices, image / data acquisition equipment, databases, external storage, and image / data processing workstations.
[0214] The bus includes hardware, software or both, and couples the components of the computer device to each other. The bus includes but is not limited to at least one of the following: data bus, address bus, control bus, expansion bus, and local bus. By way of example and not limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VLB) bus, or other suitable buses or a combination of two or more of these. Where appropriate, the bus may include one or more buses. Although embodiments of the present application describe and illustrate a particular bus, the present application contemplates any suitable bus or interconnect.
[0215] The computer device can execute the simultaneous transmission method in the embodiment of the present application.
[0216] In addition, in combination with the simultaneous transmission method in the above embodiment, the embodiment of the present application can provide a computer-readable storage medium for implementation. The computer-readable storage medium stores computer program instructions; when the computer program instructions are executed by the processor, any one of the simultaneous transmission methods for blockchain in the above embodiment is implemented.
[0217] Example 2
[0218] This embodiment is a specific embodiment of the present invention.
[0219] Fig.11 is a specific implementation framework diagram of the simultaneous transmission system according to an embodiment of the present application. Fig.11 As shown, the simultaneous transmission system includes a signal acquisition device (i.e., a simultaneous transmission device), a post-stage signal processing device (i.e., a first signal processing device and a second signal processing device), and a power amplifier / speaker (i.e., a power amplifying device, a first playback device and a second playback device).
[0220] Specifically, after the device collects the audio signal, it can output two groups of different types of signals at the same time through internal algorithm routing. Signal A can be sent to the conference host through the audio cable, and the conference host then sends it to the audio processor or mixer. Signal B can be given to the audio processor or mixer through the audio cable, achieving the effect of providing different types of dual signals on the same device, and the two groups of signals of different types do not affect each other.
[0221] The advantages of the above system are that the device supports receiving one group of signals while sending out two groups of different types of signals; dual signals are sent to the mixing device through the device itself, reducing the stacking of devices to achieve the same effect. Fewer devices also means a lower failure rate, and it is easier to find problems in post-processing; wiring is convenient, and the same device can be wired; reducing equipment: one microphone can be used instead of two microphones.
[0222] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0223] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.
Claims
1. A method for simultaneously transmitting different types of audio, characterized in that: include: Collect raw audio data; Processing the original audio data to obtain a first audio signal and a second audio signal, wherein the type of the first audio signal is different from the type of the second audio signal, the first audio signal is a digital signal, and the second audio signal is an analog signal; The first audio signal is transmitted to a first signal processing device, and the second audio signal is transmitted to a second signal processing device, wherein the first signal processing device is different from the second signal processing device, and the first signal processing device transmits the first audio signal to the second signal processing device, the first signal processing device is a conference host, and the second signal processing device is a mixing device.
2. The simultaneous transmission method according to claim 1, characterized in that: Also includes: Get signal transmission instructions; transmitting at least one of the first audio signal and the second audio signal according to the signal transmission instruction, or not transmitting the first audio signal and the second audio signal; Wherein, in the case where only one of the first audio signal and the second audio signal is transmitted, the transmitted audio signal is enhanced and transmitted, and the non-transmitted audio signal is stored.
3. The simultaneous transmission method according to claim 2, characterized in that: The storage process of the audio signal not to be transmitted includes: Obtaining current time information and preset time threshold of the audio signal; An audio signal with the current time information as an end point and the preset time threshold as a time length is stored.
4. The simultaneous transmission method according to claim 2, characterized in that: The storage process of the audio signal not to be transmitted includes: Get the current time information and start time information of the audio signal; Calculate a first time difference between the current time information and the start time information; Determining whether the first time difference matches a preset time threshold; When the first time difference matches the preset time threshold, storing the audio signal; When the first time difference does not match the preset time threshold, a second time difference between the first time difference and the preset time threshold is calculated, an audio signal with the current time information as the end point and the preset time threshold as the time length is stored, and an audio signal with the start time information as the start point and the second time difference as the time length is deleted.
5. A device for simultaneously transmitting different types of audio, used to execute the simultaneous transmission method according to any one of claims 1 to 4, characterized in that: include: A collection unit, used for collecting original audio data; A first processing unit, configured to process the original audio data to obtain a first audio signal, wherein the first audio signal is a digital signal; A second processing unit, configured to process the original audio data to obtain a second audio signal, wherein the type of the second audio signal is different from the type of the first audio signal, and the second audio signal is an analog signal; A first transmission unit, used for transmitting the first audio signal to a first signal processing device, where the first signal processing device is a conference host; A second transmission unit, configured to transmit the second audio signal to a second signal processing device, wherein the second signal processing device is different from the first signal processing device and is a mixing device; The first signal processing device transmits the first audio signal to the second signal processing device.
6. The simultaneous transmission device according to claim 5, characterized in that: Also includes: An instruction acquisition unit, used for acquiring a signal transmission instruction; a third processing unit, configured to, when only one of the first audio signal and the second audio signal is transmitted, perform enhancement processing on the transmitted audio signal; a storage unit, configured to store the audio signal that is not transmitted when only one of the first audio signal and the second audio signal is transmitted; The first transmission unit is further configured to transmit or not transmit the first audio signal according to the signal transmission instruction and / or the second transmission unit is configured to transmit or not transmit the second audio signal according to the signal transmission instruction.
7. The simultaneous transmission device according to claim 6, characterized in that: Also includes: A time acquisition unit, used to acquire current time information and a preset time threshold of an audio signal; The storage unit is further used to store an audio signal with the current time information as an end point and the preset time threshold as a time length.
8. The simultaneous transmission device according to claim 6, characterized in that: Also includes: A time acquisition unit, used to acquire current time information and start time information of an audio signal; A first calculation unit, used to calculate a first time difference between the current time information and the start time information; A judging unit, configured to judge whether the first time difference matches a preset time threshold; A second calculation unit, configured to calculate a second time difference between the first time difference and the preset time threshold when the first time difference does not match the preset time threshold; a deleting unit, configured to delete an audio signal starting from the start time information and having a time length equal to the second time difference; The storage unit is further configured to store the audio signal when the first time difference matches the preset time threshold; And it is also used to store an audio signal with the current time information as the end point and the preset time threshold as the time length when the first time difference does not match the preset time threshold.
9. A system for simultaneously transmitting different types of audio, used to execute the simultaneous transmission method according to any one of claims 1 to 4, characterized in that: include: A simultaneous transmission device, for collecting original audio data and processing the original audio to obtain a first audio signal and a second audio signal, wherein the type of the first audio signal is different from the type of the second audio signal, the first audio signal is a digital signal, and the second audio signal is an analog signal; A first signal processing device, used for acquiring the first audio signal transmitted by the simultaneous transmission device, wherein the first signal processing device is a conference host; The second signal processing device is used to obtain the second audio signal transmitted by the simultaneous transmission device and the first audio signal transmitted by the first signal processing device, wherein the second signal processing device is different from the first signal processing device and is a mixing device.
10. The simultaneous transmission system according to claim 9, characterized in that: Also includes: a power amplifying device, configured to obtain the first audio signal or the second audio signal transmitted by the second signal processing device; The first playing device is used to play the first audio signal or the second audio signal transmitted by the power amplifying device.
11. The simultaneous transmission system according to claim 9 or 10, characterized in that: Also includes: The second playing device is used to play the first audio signal or the second audio signal transmitted by the second signal processing device.
12. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the simultaneous transmission method according to any one of claims 1 to 4 is implemented.
13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the simultaneous transmission method according to any one of claims 1 to 4 is implemented.
Citation Information
Patent Citations
Processing method and device of call record
CN104902087A
Conference system, teleconference platform and audio processing method
CN113556503A