Conference data processing system, method, device and related equipment

Abstract

The present application discloses a conference data processing system, method, and device. The system transmits conference voice streams and conference auxiliary information streams in separate channels at the wireless pickup device end, and transmits these two types of data to a local conference processing device via a wireless receiving device using a common protocol, such as using the USB Audio Class protocol to transmit audio and other protocols (such as the Human Interface Device (HID) protocol and the Communication Device Class (CDC) protocol) to transmit control information. This ensures that the two types of data do not affect each other, and the local conference processing device can directly recognize the voice stream transmitted using the audio transmission protocol as standard sound card data. The voice recognition device of the local conference processing device can use the data of the conference auxiliary information stream to implement local role-based voice transcription and other functions. This solves the problem that the conference software cannot use standard sound card data when the conference processing device implements the role-based voice recognition function locally.

Description

Technical Field

[0001] The present application relates to the field of voice processing technology, and in particular to conference data processing systems, methods and devices, and electronic equipment. Background Art

[0002] An audio and video conferencing system is a system that enables two or more individuals or groups in different locations to exchange audio, video, and file information through transmission lines and conference terminals, achieving instant and interactive communication and holding meetings simultaneously.

[0003] Typically, the system uses wireless audio pickup devices (receiver and player devices) to capture conference audio and transmit it to a local computer. The wireless audio pickup device is recognized by the computer as a standard sound card and connected to the conferencing software (such as DingTalk). In practice, to enable local role-based voice recognition, the wireless audio pickup device must not only transmit the collected conference audio to the local computer, but also simultaneously transmit auxiliary information such as the speaker's role at the conference.

[0004] Currently, a typical method of synchronously transmitting conference voice and conference auxiliary information is to package the audio stream and conference auxiliary information together for transmission, and unpack the data through separately developed computer software. When the voice and auxiliary information are superimposed on the same data stream, the wireless pickup device cannot be identified as a general sound card device on the computer side. Instead, a virtual sound card must be generated by the computer software for use by conference software such as DingTalk.

[0005] However, in the process of implementing the present invention, the inventors found that the above technical solution has at least the following problems: when the computer side implements the role-based voice recognition function locally, the conference software cannot use the standard sound card data and needs to develop software separately, so it is not easy to use and universal. Summary of the Invention

[0006] The present application provides a conference data processing system to solve the problem in the prior art that conference software cannot use standard sound card data when the conference processing device locally implements the role-based voice recognition function. The present application also provides a conference data processing method and device, as well as an electronic device.

[0007] This application provides a conference data processing system, including:

[0008] A wireless sound pickup device is used to collect conference voice data and obtain conference auxiliary information; transmit the conference voice data to the wireless receiving device through a first data channel, and transmit the conference user role information to the wireless receiving device through a second data channel;

[0009] A wireless receiving device is used to connect the first data channel and the second data channel; transmit the conference voice data and conference auxiliary information to the conference processing device;

[0010] The conference processing device is used to transmit the conference voice data as sound card data to the conference call device, and realize remote conference calls through the conference call device; perform voice recognition processing based on the conference voice data and conference auxiliary information.

[0011] Optionally, the wireless receiving device includes a USB device.

[0012] Optionally, the wireless receiving device is specifically configured to transmit the conference voice data to the conference processing device via the first data channel, and transmit the conference auxiliary information to the conference processing device via the second data channel.

[0013] Optionally, a wireless receiving device is specifically used to transmit conference voice data to the conference processing device using the USB audio class UAC protocol; and to transmit conference auxiliary information to the conference processing device using the human interface device HID protocol or the communication device class CDC protocol.

[0014] Optionally, the first data channel is a radio frequency transceiver system based on a wireless private protocol, and the second data channel is a radio frequency transceiver system based on a wireless WIFI protocol; the wireless receiving device is specifically used to transmit the conference voice data to the conference processing device through the radio frequency transceiver system based on the wireless private protocol, using the USB audio class UAC protocol; and transmit the conference auxiliary information to the conference processing device through the radio frequency transceiver system based on the wireless WIFI protocol, using the human-machine interface device HID protocol or the communication device class CDC protocol.

[0015] This application also provides a conference data processing method, including:

[0016] Collect conference voice data and obtain conference auxiliary information;

[0017] The voice data is transmitted to the wireless receiving device through the first data channel, and the conference auxiliary information is transmitted to the wireless receiving device through the second data channel, so that the wireless receiving device can transmit the conference voice data and conference auxiliary information to the conference processing device; the conference processing device transmits the conference voice data as sound card data to the conference call device, and realizes remote conference call through the conference call device; and voice recognition processing is performed based on the conference voice data and conference auxiliary information.

[0018] Optionally, the first data channel adopts a wireless private protocol.

[0019] Optionally, the second data channel adopts a wireless mobile hotspot protocol.

[0020] Optionally, the conference auxiliary information includes conference user role information;

[0021] The performing of speech recognition processing according to the conference speech data and the conference auxiliary information includes:

[0022] Generate role-specific transcription text based on conference voice data and conference user role information.

[0023] This application also provides a conference data processing method, including:

[0024] Acquire conference voice data transmitted by the wireless sound pickup device through the first data channel, and acquire conference auxiliary information transmitted by the wireless sound pickup device through the second data channel;

[0025] The conference voice data and conference auxiliary information are transmitted to the conference processing device so that the conference processing device can transmit the conference voice data as sound card data to the conference call device, and realize remote conference calls through the conference call device; based on the conference voice data and conference auxiliary information, voice recognition processing is performed.

[0026] Optionally, the conference voice data is transmitted to the conference processing device through the first data channel, and the conference auxiliary information is transmitted to the conference processing device through the second data channel.

[0027] Optionally, the USB audio class UAC protocol is used to transmit conference voice data to the conference processing device; the human interface device HID protocol or the communication device class CDC protocol is used to transmit conference auxiliary information to the conference processing device.

[0028] Optionally, the first data channel is a radio frequency transceiver system based on a wireless private protocol, and the first data channel uses the USB audio class UAC protocol to transmit the conference voice data to the conference processing device; the second data channel is a radio frequency transceiver system based on a wireless WIFI protocol, and the second data channel uses the human interface device HID protocol or the communication device class CDC protocol to transmit the conference auxiliary information to the conference processing device.

[0029] Optionally, also include:

[0030] The wireless connection device connects the first data channel and the second data channel when started.

[0031] This application also provides a conference data processing method, including:

[0032] Acquire conference voice data and conference auxiliary information transmitted by the wireless receiving device; the wireless receiving device acquires the conference voice data transmitted by the wireless sound pickup device through a first data channel, and acquires the conference auxiliary information transmitted by the wireless sound pickup device through a second data channel;

[0033] Transmitting conference voice data as sound card data to a conference call device, and implementing remote conference calls through the conference call device;

[0034] Based on the conference voice data and the conference auxiliary information, a voice recognition process is performed.

[0035] The present application also provides a conference data processing device, comprising:

[0036] A data acquisition unit is used to collect conference voice data and obtain conference auxiliary information;

[0037] A voice data transmission unit, configured to transmit voice data to a wireless receiving device via a first data channel;

[0038] The auxiliary information transmission unit is used to transmit the conference auxiliary information to the wireless receiving device through the second data channel, so that the wireless receiving device can transmit the conference voice data and conference auxiliary information to the conference processing device; the conference processing device transmits the conference voice data as sound card data to the conference call device, and realizes remote conference calls through the conference call device; and performs voice recognition processing based on the conference voice data and conference auxiliary information.

[0039] The present application also provides a conference data processing device, comprising:

[0040] A voice data acquisition unit, configured to acquire conference voice data transmitted by the wireless sound pickup device through the first data channel;

[0041] an auxiliary information acquisition unit, configured to acquire conference auxiliary information transmitted by the wireless sound pickup device through the second data channel;

[0042] The data transmission unit is used to transmit conference voice data and conference auxiliary information to the conference processing device, so that the conference processing device can transmit the conference voice data as sound card data to the conference call device, and realize remote conference calls through the conference call device; perform voice recognition processing based on the conference voice data and conference auxiliary information.

[0043] The present application also provides a conference data processing device, comprising:

[0044] A data acquisition unit, configured to acquire conference voice data and conference auxiliary information transmitted by a wireless receiving device; the wireless receiving device acquires conference voice data transmitted by a wireless sound pickup device through a first data channel, and acquires conference auxiliary information transmitted by the wireless sound pickup device through a second data channel;

[0045] A voice data transmission unit, used to transmit conference voice data as sound card data to a conference call device, thereby realizing a remote conference call through the conference call device;

[0046] The speech recognition unit is used to perform speech recognition processing based on the conference speech data and the conference auxiliary information.

[0047] The present application also provides a wireless sound pickup device, comprising:

[0048] Sound collection device, processor, memory;

[0049] The memory is used to store a program for implementing the above-mentioned conference data processing method. After the device is powered on and runs the program of the method through the processor, the following steps are performed: collecting conference voice data and obtaining conference auxiliary information; transmitting the voice data to the wireless receiving device through the first data channel, and transmitting the conference auxiliary information to the wireless receiving device through the second data channel, so that the wireless receiving device can transmit the conference voice data and conference auxiliary information to the conference processing device; the conference processing device transmits the conference voice data as sound card data to the conference call device, and realizes a remote conference call through the conference call device; and performing voice recognition processing based on the conference voice data and conference auxiliary information.

[0050] The present application also provides a wireless receiving device, comprising:

[0051] a first communication device, a second communication device, a processor, and a memory;

[0052] The memory is used to store a program for implementing the above-mentioned conference data processing method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: conference voice data transmitted by the wireless sound pickup device is obtained through the first data channel, and conference auxiliary information transmitted by the wireless sound pickup device is obtained through the second data channel; the conference voice data and conference auxiliary information are transmitted to the conference processing device, so that the conference processing device can transmit the conference voice data as sound card data to the conference call device, and realize a remote conference call through the conference call device; and voice recognition processing is performed based on the conference voice data and the conference auxiliary information.

[0053] The present application also provides an electronic device, comprising:

[0054] processor and memory;

[0055] The memory is used to store a program for implementing the above-mentioned conference data processing method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: obtaining conference voice data and conference auxiliary information transmitted by the wireless receiving device; the wireless receiving device obtains the conference voice data transmitted by the wireless sound pickup device through the first data channel and obtains the conference auxiliary information transmitted by the wireless sound pickup device through the second data channel; the conference voice data is transmitted to the conference call device as sound card data, and a remote conference call is realized through the conference call device; and voice recognition processing is performed based on the conference voice data and the conference auxiliary information.

[0056] The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the above-mentioned various methods.

[0057] The present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to perform the above methods.

[0058] Compared with the prior art, this application has the following advantages:

[0059] The conference data processing system provided in the embodiment of the present application transmits the conference voice stream and the conference auxiliary information stream in different channels at the wireless pickup device end, and transmits these two types of data to the local conference processing device through the wireless receiving device using a common protocol, such as using the USB audio class protocol (USB Audio Class) to transmit audio, and using other protocols (such as the human-machine interface device HID protocol and the communication device class CDC protocol) to transmit control information, so that the two types of data do not affect each other. The local conference processing device can directly recognize the voice stream transmitted using the audio transmission protocol as standard sound card data, and the voice recognition device of the local conference processing device can use the data of the conference auxiliary information stream to realize local role-based voice transcription and other functions. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Figure 1 A schematic diagram of the structure of an embodiment of a conference data processing system provided by this application;

[0061] Figure 2 A schematic diagram of device interaction in an embodiment of a conference data processing system provided by this application;

[0062] Figure 3 Schematic diagram of application scenarios of an embodiment of the conference data processing system provided by this application;

[0063] Figure 4 A flowchart of an embodiment of a conference data processing method applied on a wireless sound pickup device provided by the present application;

[0064] Figure 5 A flowchart of an embodiment of a conference data processing method applied on a wireless receiving device provided by the present application;

[0065] Figure 6 The present application provides a flowchart of an embodiment of a conference data processing method applied on a conference processing device. DETAILED DESCRIPTION

[0066] The following description sets forth many specific details to facilitate a thorough understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the scope of the present application. Therefore, the present application is not limited to the specific implementations disclosed below.

[0067] In this application, a conference data processing system, method, apparatus, and electronic device are provided. Various solutions are described in detail one by one in the following embodiments.

[0068] First embodiment

[0069] Please refer to Figure 1 , which is a structural flow chart of the conference data processing system of the present application. In this embodiment, the system may include: a wireless sound pickup device 1, a wireless receiving device 2, and a conference processing device 3. The wireless sound pickup device 1 is wirelessly connected to the wireless receiving device 2, and the wireless receiving device 2 is connected to the conference processing device 3 via a universal serial bus (USB).

[0070] like Figure 2 As shown, the wireless pickup device is used to collect conference voice data and obtain conference auxiliary information; the conference voice data is transmitted to the wireless receiving device through the first data channel, and the conference auxiliary information is transmitted to the wireless receiving device through the second data channel; the wireless receiving device is used to connect the first data channel and the second data channel; the conference voice data and conference auxiliary information are transmitted to the conference processing device; the conference processing device is used to transmit the conference voice data as sound card data to the conference call device, and realize remote conference calls through the conference call device; voice recognition processing is performed based on the conference voice data and conference auxiliary information.

[0071] It should be noted that the wireless sound pickup device transmits the conference voice data to the wireless receiving device through the first data channel, and transmits the conference auxiliary information to the wireless receiving device through the second data channel. There is no order of execution. The wireless sound pickup device can send conference voice data and conference auxiliary information simultaneously through different channels.

[0072] The wireless sound pickup device 1 is also called a microphone, a sound receiving and playback device, or a conference terminal. It can be a speakerphone or a video conferencing terminal including a display and a camera. The speakerphone may include a speaker and a microphone array. The microphone array can be installed around the speaker to cover all directions of the conference site. In this embodiment, the wireless sound pickup device 1 not only has the ability to transmit voice, but also can synchronously transmit conference auxiliary information such as the speaker role at the conference site. The wireless sound pickup device can obtain conference auxiliary information through technologies such as voiceprint recognition and speaker position recognition. The conference auxiliary information includes but is not limited to conference speaker role information, and may also include position information of each speaker.

[0073] In this embodiment, the wireless sound pickup device 1 is a system with a processor and multiple microphones, which has certain information recognition and processing capabilities. The user roles recognized by the sound pickup device are ultimately presented on the conference processing device 3 as speaker 1, speaker 2, etc.

[0074] In this embodiment, the wireless sound pickup device 1 does not superimpose the voice and auxiliary information into the same data stream for transmission, but transmits them separately through different channels. The conference voice stream is transmitted to the wireless receiving device 2 through the first data channel (also called the audio stream channel), and the conference auxiliary information is transmitted to the wireless receiving device 2 through the second data channel (also called the auxiliary information stream channel). The two types of data do not affect each other.

[0075] The wireless receiving device 2 may include two RF transceiver systems using different protocols. One RF transceiver system corresponds to the first data channel, and the other RF transceiver system corresponds to the second data channel. The wireless connection device may automatically detect the channel status upon startup and select different channels for connection, namely, connecting the first data channel and the second data channel. The wireless receiving device 2 obtains conference voice data transmitted by the wireless sound pickup device via the first data channel and obtains conference auxiliary information transmitted by the wireless sound pickup device via the second data channel, and transmits the conference voice data and conference auxiliary information to the conference processing device.

[0076] In a specific implementation, a miniaturized wireless receiving device 2 can be connected to a conference processing device 3 via a universal serial bus (USB). The wireless receiving device 2 can be a USB device, which can be a composite device, such as one that includes audio, video, and HID (Human Interface Device) control. The wireless receiving device 2 can transmit conference voice data to the conference processing device using the USB audio class protocol and transmit auxiliary conference information to the conference processing device using the HID (Human Interface Device) protocol.

[0077] In one example, the first data channel can utilize a proprietary wireless protocol, enabling ultra-low latency (e.g., less than 10 seconds) for transmitting the audio stream from the remote microphone (wireless pickup device) to the computer, further facilitating processing by the acoustic echo cancellation (AEC) module in the conference call device. Because the conference auxiliary information is not sensitive to latency, the second data channel can utilize a wireless mobile hotspot (wireless WIFI) protocol, making its transmission more flexible.

[0078] The conference processing device 3 is a computer-based device, which can be a personal computer (PC) or an Android terminal. The conference processing device 3 can recognize common protocols, such as the UAC (USB Audio Class) audio protocol and the HID (Human Interface Device) protocol. After receiving independent audio and auxiliary information streams transmitted using different protocols, the conference processing device 3 can perform data processing in two ways. One of the processing methods is: because the wireless receiving device 2 uses an audio transmission protocol to connect to the conference processing device 3, the conference processing device 3 can identify the wireless sound pickup device 1 as a universal sound card device (standard sound card). This allows for easy access to the conference call device (conference software) for multi-party calls. The conference software can directly use standard sound card data (local conference voice data), eliminating the need for separate software development on the conference processing device. The other processing method involves the computer-based voice recognition device performing various voice recognition processes based on the audio and auxiliary information streams. In specific implementations, the computer-based voice recognition device can perform voice transcription on the conference voice data collected by the local wireless sound pickup device, as well as voice data from remote conference sites. The voice data of the remote conference site can be obtained through the conference call device.

[0079] In one example, auxiliary meeting information includes the role of the conference speaker. The speaker can be at either the local or remote venue. In this case, the computer's voice recognition device can support multi-person speech-to-text, intelligently distinguishing between speakers and enabling role-based transcription. This provides clearer transcripts, allowing for a clearer understanding of who said which statement when reviewing the transcript. For example, [Zhang San] Welcome, Mr. Chen, to our company today. [Mr. Chen] We have long hoped to collaborate with your company. [Zhang San] I hope today's meeting will lead to a consensus. [Mr. Chen] Yes, that's what we're looking forward to.

[0080] In another example, the conference auxiliary information includes speaker location information. In this case, the pronunciation information of each speaker in the meeting can be recorded by a voice recognition device on the computer to form a meeting minutes.

[0081] like Figure 3As shown, in this embodiment, the wireless sound pickup device 1 (sound receiving and playback end) can be connected to the wireless receiving device 2 (receiving end) in a wireless manner, and the wireless receiving device 2 can be connected to the conference processing device 3 (PC end / or Android terminal) via a universal serial bus USB. The wireless sound pickup device 1 may include a microphone array, a speaker and a processor. The wireless sound pickup device 1 collects conference voice data and can obtain conference auxiliary information through voiceprint recognition and speaker orientation recognition technology. In this embodiment, the wireless sound pickup device 1 transmits the conference voice data to the wireless receiving device 2 through a first data channel based on a wireless private protocol (such as 2.4G / 5.8G private protocol radio frequency), and transmits the conference user role information to the wireless receiving device 2 through a second data channel based on a wireless WIFI protocol (such as 2.4G / 5GWIFI protocol radio frequency). Wireless receiving device 2 includes two RF transceiver systems using different protocols. The RF transceiver system based on the wireless private protocol uses the UAC format to send conference voice data to conference processing device 3. The RF transceiver system based on the wireless WIFI protocol uses the HID / CDC (Communication Device Class) format to send conference auxiliary information to conference processing device 3. These two types of data do not affect each other. The conference software of conference processing device 3 uses the UAC format voice data as standard sound card data and transmits the local voice data to the remote venue via the network. The speech recognition device (ASR software) of conference processing device 3 performs various speech recognition processes based on the conference auxiliary information.

[0082] It can be seen from the above embodiments that the conference data processing system provided by the embodiments of the present application transmits the conference voice stream and the conference auxiliary information stream in different channels at the wireless pickup device end, and transmits these two types of data to the local conference processing device through the wireless receiving device using a general protocol, such as using the USB audio class protocol (USB Audio Class) to transmit audio, and using other protocols (such as the human-machine interface device HID protocol and the communication equipment class CDC protocol) to transmit control information, so that the two types of data do not affect each other. The local conference processing device can directly recognize the voice stream transmitted using the audio transmission protocol as standard sound card data, and the voice recognition device of the local conference processing device can use the data of the conference auxiliary information stream to realize local role-based voice transcription and other functions.

[0083] Second embodiment

[0084] In the above-mentioned embodiments, a conference data processing system is provided. Correspondingly, this application also provides a conference data processing method. This method corresponds to the above-mentioned system embodiments and can be applied to wireless sound pickup devices. Because the method embodiments are generally similar to the system embodiments, their description is relatively simple. For relevant details, please refer to the description of the system embodiments. The method embodiments described below are merely illustrative.

[0085] Please refer to Figure 4 , which is a flow chart of the conference data processing method of the present application. In this embodiment, the method may include the steps of:

[0086] Step S401: Collect conference voice data and obtain conference auxiliary information.

[0087] The conference auxiliary information includes, but is not limited to, conference user role information, and may also include basic information such as conference name, time, and location.

[0088] Step S403: Transmit the voice data to the wireless receiving device through the first data channel, and transmit the conference auxiliary information to the wireless receiving device through the second data channel, so that the wireless receiving device can transmit the conference voice data and conference auxiliary information to the conference processing device; the conference processing device transmits the conference voice data as sound card data to the conference call device, and realizes a remote conference call through the conference call device; perform voice recognition processing based on the conference voice data and conference auxiliary information.

[0089] The first data channel may use a wireless private protocol, and the second data channel may use a wireless mobile hotspot protocol.

[0090] In one example, the wireless receiving device transmits conference voice data to the conference processing device via the first data channel and transmits conference auxiliary information to the conference processing device via the second data channel. The first data channel can be an RF transceiver system based on a wireless proprietary protocol, which can use the USB audio class UAC protocol to transmit conference voice data to the conference processing device. The second data channel can be an RF transceiver system based on a wireless WiFi protocol, which can use the human interface device HID protocol or the communication device class CDC protocol to transmit conference auxiliary information to the conference processing device.

[0091] In one example, the conference auxiliary information includes conference user role information; performing speech recognition processing based on conference voice data and conference auxiliary information can be implemented in the following manner: generating role-based transcription text based on conference voice data and conference user role information.

[0092] Third embodiment

[0093] In the above-mentioned embodiments, a conference data processing method is provided. Correspondingly, this application also provides a conference data processing device, which can be deployed on a wireless sound pickup device. This device corresponds to the above-mentioned method embodiment. Since the device embodiment is substantially similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the description of the method embodiment. The device embodiment described below is merely illustrative.

[0094] The present application further provides a conference data processing device, including: a data acquisition unit, a voice data transmission unit, and an auxiliary information transmission unit.

[0095] The data acquisition unit is used to collect conference voice data and obtain conference auxiliary information; the voice data transmission unit is used to transmit the voice data to the wireless receiving device through the first data channel; the auxiliary information transmission unit is used to transmit the conference auxiliary information to the wireless receiving device through the second data channel, so that the wireless receiving device can transmit the conference voice data and conference auxiliary information to the conference processing device; the conference processing device transmits the conference voice data as sound card data to the conference call device, and realizes remote conference calls through the conference call device; and performs voice recognition processing based on the conference voice data and conference auxiliary information.

[0096] The first data channel may adopt a wireless private protocol, and the second data channel may adopt a wireless mobile hotspot protocol.

[0097] The conference auxiliary information may be conference user role information; performing speech recognition processing based on the conference voice data and the conference auxiliary information includes: generating role-based transcription text based on the conference voice data and the conference user role information.

[0098] Fourth embodiment

[0099] In the above-mentioned embodiments, a conference data processing system is provided. Correspondingly, this application also provides a conference data processing method. This method corresponds to the above-mentioned system embodiment and can be applied to a wireless receiving device. Since the method embodiment is generally similar to the system embodiment, the description is relatively simple. For relevant details, please refer to the description of the system embodiment. The method embodiment described below is merely illustrative.

[0100] Please refer to Figure 5 , which is a flow chart of the conference data processing method of the present application. In this embodiment, the method may include the steps of:

[0101] Step S501: obtaining conference voice data transmitted by the wireless sound pickup device through the first data channel, and obtaining conference auxiliary information transmitted by the wireless sound pickup device through the second data channel.

[0102] Step S503: Transmit the conference voice data and conference auxiliary information to the conference processing device, so that the conference processing device transmits the conference voice data as sound card data to the conference call device, and realizes remote conference call through the conference call device; perform voice recognition processing based on the conference voice data and conference auxiliary information.

[0103] The wireless receiving device 2 may include two RF transceiver systems using different protocols. One RF transceiver system corresponds to the first data channel, and the other RF transceiver system corresponds to the second data channel. The wireless connection device may automatically detect the channel status upon startup and select a different channel for connection, namely, connecting the first data channel to the second data channel.

[0104] The wireless receiving device 2 obtains conference voice data transmitted by the wireless sound pickup device through the first data channel, obtains conference auxiliary information transmitted by the wireless sound pickup device through the second data channel, and transmits the conference voice data and conference auxiliary information to the conference processing device.

[0105] In a specific implementation, a miniaturized wireless receiving device 2 can be connected to a conference processing device 3 via a universal serial bus (USB). The wireless receiving device 2 can be a USB device, which can be a composite device, such as one that includes audio, video, and HID (Human Interface Device) control. The wireless receiving device 2 can transmit conference voice data to the conference processing device using the USB audio class protocol and transmit auxiliary conference information to the conference processing device using the HID (Human Interface Device) protocol.

[0106] In one example, the conference voice data is transmitted to the conference processing device through the first data channel, and the conference auxiliary information is transmitted to the conference processing device through the second data channel.

[0107] In one example, the USB audio class UAC protocol is used to transmit conference voice data to the conference processing device; the human interface device HID protocol or the communication device class CDC protocol is used to transmit conference auxiliary information to the conference processing device.

[0108] In one example, the first data channel is a radio frequency transceiver system based on a wireless private protocol, and the first data channel uses the USB audio class UAC protocol to transmit the conference voice data to the conference processing device; the second data channel is a radio frequency transceiver system based on a wireless WIFI protocol, and the second data channel uses the human interface device HID protocol or the communication device class CDC protocol to transmit the conference auxiliary information to the conference processing device.

[0109] Fifth embodiment

[0110] In the above-mentioned embodiments, a conference data processing method is provided. Correspondingly, this application also provides a conference data processing apparatus, which can be deployed on a wireless receiving device. This apparatus corresponds to the above-mentioned method embodiments. Since the apparatus embodiments are generally similar to the method embodiments, the description is relatively brief. For relevant details, please refer to the description of the method embodiments. The apparatus embodiments described below are merely illustrative.

[0111] The present application further provides a conference data processing device, including: a voice data acquisition unit, an auxiliary information acquisition unit, and a data transmission unit.

[0112] The voice data acquisition unit is used to acquire conference voice data transmitted by the wireless sound pickup device through the first data channel; the auxiliary information acquisition unit is used to acquire conference auxiliary information transmitted by the wireless sound pickup device through the second data channel; the data transmission unit is used to transmit the conference voice data and conference auxiliary information to the conference processing device, so that the conference processing device can transmit the conference voice data as sound card data to the conference call device, and realize remote conference call through the conference call device; based on the conference voice data and conference auxiliary information, voice recognition processing is performed.

[0113] In one example, the conference voice data is transmitted to the conference processing device through the first data channel, and the conference auxiliary information is transmitted to the conference processing device through the second data channel.

[0114] In one example, the USB audio class UAC protocol is used to transmit conference voice data to the conference processing device; the human interface device HID protocol or the communication device class CDC protocol is used to transmit conference auxiliary information to the conference processing device.

[0115] In one example, the first data channel is a radio frequency transceiver system based on a wireless private protocol, and the first data channel uses the USB audio class UAC protocol to transmit the conference voice data to the conference processing device; the second data channel is a radio frequency transceiver system based on a wireless WIFI protocol, and the second data channel uses the human interface device HID protocol or the communication device class CDC protocol to transmit the conference auxiliary information to the conference processing device.

[0116] In one example, the apparatus may further include: a startup connection unit, configured to connect the first data channel and the second data channel when the wireless connection device is started.

[0117] Sixth embodiment

[0118] In the above-mentioned embodiments, a conference data processing system is provided. Correspondingly, this application also provides a conference data processing method. This method corresponds to the above-mentioned system embodiments and can be applied to conference processing devices. Because the method embodiments are generally similar to the system embodiments, their description is relatively simple. For relevant details, please refer to the description of the system embodiments. The method embodiments described below are merely illustrative.

[0119] Please refer to Figure 6 , which is a flow chart of the conference data processing method of the present application. In this embodiment, the method may include the steps of:

[0120] Step S601: Acquire conference voice data and conference auxiliary information transmitted by a wireless receiving device; the wireless receiving device acquires conference voice data transmitted by a wireless sound pickup device through a first data channel and acquires conference auxiliary information transmitted by the wireless sound pickup device through a second data channel.

[0121] The conference voice data and conference auxiliary information are transmitted from the wireless receiving device to the conference processing device through different channels, and the two types of data do not affect each other.

[0122] In one example, the wireless receiving device transmits the conference voice data to the conference processing device through the first data channel, and transmits the conference auxiliary information to the conference processing device through the second data channel.

[0123] In one example, the wireless receiving device uses the USB audio class UAC protocol to transmit conference voice data to the conference processing device; and uses the human interface device HID protocol or the communication device class CDC protocol to transmit conference auxiliary information to the conference processing device.

[0124] In one example, the first data channel is a radio frequency transceiver system based on a wireless private protocol, and the first data channel uses the USB audio class UAC protocol to transmit the conference voice data to the conference processing device; the second data channel is a radio frequency transceiver system based on a wireless WIFI protocol, and the second data channel uses the human interface device HID protocol or the communication device class CDC protocol to transmit the conference auxiliary information to the conference processing device.

[0125] Step S603: The conference voice data is transmitted as sound card data to the conference call device, and a remote conference call is realized through the conference call device.

[0126] The conference processing device recognizes the wireless sound pickup device 1 as a universal sound card device and simply connects it to the conference call device (conference software) for multi-party calls. The conference software uses standard sound card data.

[0127] Step S605: Perform speech recognition processing based on the conference speech data and the conference auxiliary information.

[0128] The speech recognition device on the conference processing device performs various speech recognition processes based on the audio stream and auxiliary information stream. In specific implementations, the speech recognition device can transcribe the conference speech data collected by the local wireless pickup device, as well as the speech data from the remote conference site. The speech data from the remote conference site can be obtained through the conference call device.

[0129] Seventh embodiment

[0130] In the above-mentioned embodiments, a conference data processing method is provided. Correspondingly, this application also provides a conference data processing device, which can be deployed on a conference processing device. This device corresponds to the above-mentioned method embodiment. Since the device embodiment is generally similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the description of the method embodiment. The device embodiment described below is merely illustrative.

[0131] The present application further provides a conference data processing device, including: a data acquisition unit, a voice data transmission unit, and a voice recognition unit.

[0132] A data acquisition unit is used to acquire conference voice data and conference auxiliary information transmitted by a wireless receiving device; the wireless receiving device acquires conference voice data transmitted by a wireless sound pickup device through a first data channel, and acquires conference auxiliary information transmitted by the wireless sound pickup device through a second data channel; a voice data transmission unit is used to transmit the conference voice data as sound card data to a conference call device, and realize a remote conference call through the conference call device; a voice recognition unit is used to perform voice recognition processing based on the conference voice data and conference auxiliary information.

[0133] Eighth embodiment

[0134] In the above-mentioned embodiments, a conference data processing method is provided. Correspondingly, this application also provides a conference terminal, which can be a wireless sound pickup device. This device corresponds to the above-mentioned method embodiments. Since the device embodiments are generally similar to the method embodiments, the description is relatively simple. For relevant details, please refer to the description of the method embodiments. The device embodiments described below are merely illustrative.

[0135] A conference terminal in this embodiment is an electronic device comprising: a sound collection device, a processor and a memory; the memory is used to store a program for implementing a conference data processing method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: collecting conference voice data and obtaining conference auxiliary information; transmitting the voice data to a wireless receiving device through a first data channel, and transmitting the conference auxiliary information to the wireless receiving device through a second data channel, so that the wireless receiving device can transmit the conference voice data and conference auxiliary information to a conference processing device; the conference processing device transmits the conference voice data as sound card data to a conference call device, and implements a remote conference call through the conference call device; and performing voice recognition processing based on the conference voice data and conference auxiliary information.

[0136] Ninth embodiment

[0137] In the above-mentioned embodiments, a conference data processing method is provided. Correspondingly, this application also provides an electronic device. This device corresponds to the above-mentioned method embodiment. Since the device embodiment is substantially similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the description of the method embodiment. The device embodiment described below is merely illustrative.

[0138] An electronic device of this embodiment includes: a first communication device, a second communication device, a processor and a memory; the memory is used to store a program for implementing a conference data processing method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: conference voice data transmitted by the wireless sound pickup device is obtained through the first data channel, and conference auxiliary information transmitted by the wireless sound pickup device is obtained through the second data channel; the conference voice data and the conference auxiliary information are transmitted to the conference processing device, so that the conference processing device can transmit the conference voice data as sound card data to the conference call device, and a remote conference call is realized through the conference call device; and voice recognition processing is performed based on the conference voice data and the conference auxiliary information.

[0139] The wireless receiving device can be a USB device, which can be a composite device, such as one that includes audio, video, and HID (Human Interface Device) control. The wireless receiving device can use the USB audio class protocol to transmit conference voice data to the conference processing device, and use the Human Interface Device HID protocol to transmit conference auxiliary information to the conference processing device.

[0140] Tenth embodiment

[0141] In the above-mentioned embodiments, a conference data processing method is provided. Correspondingly, this application also provides an electronic device. This device corresponds to the above-mentioned method embodiment. Since the device embodiment is substantially similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the description of the method embodiment. The device embodiment described below is merely illustrative.

[0142] An electronic device of this embodiment includes: a processor and a memory; the memory is used to store a program for implementing a conference data processing method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: obtaining conference voice data and conference auxiliary information transmitted by a wireless receiving device; the wireless receiving device obtains conference voice data transmitted by a wireless sound pickup device through a first data channel and obtains conference auxiliary information transmitted by the wireless sound pickup device through a second data channel; transmits the conference voice data as sound card data to a conference call device, and implements a remote conference call through the conference call device; and performs voice recognition processing based on the conference voice data and conference auxiliary information.

[0143] Although the present application is disclosed as above with the preferred embodiments, it is not intended to limit the present application. Any person skilled in the art may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.

[0144] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0145] Memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0146] 1. Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include non-transitory media such as modulated data signals and carrier waves.

[0147] 2. Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

Claims

1. A conference data processing system, characterized in that: include: A wireless sound pickup device is used to collect conference voice data and obtain conference auxiliary information, wherein the conference auxiliary information includes conference speaker role information, and the conference speaker role information is obtained through voiceprint recognition; the conference voice data is transmitted to the wireless receiving device through a first data channel, and the conference auxiliary information is transmitted to the wireless receiving device through a second data channel; A wireless receiving device, configured to connect the first data channel and the second data channel; transmit conference voice data and conference auxiliary information to the conference processing device; the wireless receiving device includes two radio frequency transceiver systems using different protocols, one radio frequency transceiver system corresponding to the first data channel and the other radio frequency transceiver system corresponding to the second data channel; The conference processing device is used to transmit conference voice data as sound card data to a conference call device, and realize remote conference calls through the conference call device; perform voice recognition processing based on the conference voice data and conference auxiliary information through a voice recognition device on the computer side; and realize role-based transcription in the voice-to-text function through the voice recognition device.

2. A conference data processing method, used for the wireless sound pickup device in the system according to claim 1, characterized in that: include: Collecting conference voice data to obtain conference auxiliary information, wherein the conference auxiliary information includes conference speaker role information, and the conference speaker role information is obtained through voiceprint recognition; Transmitting the voice data to the wireless receiving device through the first data channel and transmitting the conference auxiliary information to the wireless receiving device through the second data channel, so that the wireless receiving device can transmit the conference voice data and the conference auxiliary information to the conference processing device; The conference processing device transmits the conference voice data as sound card data to the conference call device, and realizes remote conference calls through the conference call device; and performs voice recognition processing based on the conference voice data and conference auxiliary information.

3. The method according to claim 2, characterized in that The first data channel adopts a wireless private protocol.

4. The method according to claim 2, characterized in that The second data channel uses a wireless mobile hotspot protocol.

5. The method according to claim 2, characterized in that The performing of speech recognition processing according to the conference speech data and the conference auxiliary information includes: Generate role-specific transcription text based on conference voice data and conference user role information.

6. A conference data processing method, used in the wireless receiving device of the system according to claim 1, characterized in that: include: Acquire conference voice data transmitted by the wireless sound pickup device through a first data channel, and acquire conference auxiliary information transmitted by the wireless sound pickup device through a second data channel, wherein the conference auxiliary information includes conference speaker role information, and the conference speaker role information is acquired by the wireless sound pickup device through voiceprint recognition; The conference voice data and conference auxiliary information are transmitted to the conference processing device so that the conference processing device can transmit the conference voice data as sound card data to the conference call device, and realize remote conference calls through the conference call device; based on the conference voice data and conference auxiliary information, voice recognition processing is performed.

7. The method according to claim 6, characterized in that Use USB audio class UAC protocol to transmit conference voice data to conference processing equipment; The conference auxiliary information is transmitted to the conference processing device using the human interface device HID protocol or the communication device CDC protocol.

8. A conference data processing method, used in the conference processing device of the system according to claim 1, characterized in that: include: Obtain conference voice data and conference auxiliary information transmitted by wireless receiving devices; The wireless receiving device obtains conference voice data transmitted by the wireless sound pickup device through the first data channel, and obtains conference auxiliary information transmitted by the wireless sound pickup device through the second data channel, wherein the conference auxiliary information includes conference speaker role information, and the conference speaker role information is obtained by the wireless sound pickup device through voiceprint recognition; Transmitting conference voice data as sound card data to a conference call device, and implementing remote conference calls through the conference call device; Based on the conference voice data and the conference auxiliary information, voice recognition processing is performed.

9. A conference data processing device, used for the wireless sound pickup device in the system according to claim 1, characterized in that: include: A data acquisition unit, configured to collect conference voice data and acquire conference auxiliary information, wherein the conference auxiliary information includes conference speaker role information, and the conference speaker role information is acquired through voiceprint recognition; A voice data transmission unit, configured to transmit voice data to a wireless receiving device via a first data channel; An auxiliary information transmission unit, configured to transmit the conference auxiliary information to the wireless receiving device via the second data channel, so that the wireless receiving device can transmit the conference voice data and the conference auxiliary information to the conference processing device; The conference processing device transmits the conference voice data as sound card data to the conference call device, and realizes remote conference calls through the conference call device; and performs voice recognition processing based on the conference voice data and conference auxiliary information.

10. A conference data processing device, used for the wireless receiving device in the system according to claim 1, characterized in that: include: A voice data acquisition unit, configured to acquire conference voice data transmitted by the wireless sound pickup device through the first data channel; an auxiliary information acquisition unit, configured to acquire conference auxiliary information transmitted by the wireless sound pickup device through the second data channel, wherein the conference auxiliary information includes conference speaker role information, and the conference speaker role information is acquired by the wireless sound pickup device through voiceprint recognition; The data transmission unit is used to transmit conference voice data and conference auxiliary information to the conference processing device, so that the conference processing device can transmit the conference voice data as sound card data to the conference call device, and realize remote conference calls through the conference call device; perform voice recognition processing based on the conference voice data and conference auxiliary information.

11. A conference data processing device, used for the conference processing equipment in the system according to claim 1, characterized in that: include: A data acquisition unit, configured to acquire conference voice data and conference auxiliary information transmitted by a wireless receiving device; The wireless receiving device obtains conference voice data transmitted by the wireless sound pickup device through the first data channel, and obtains conference auxiliary information transmitted by the wireless sound pickup device through the second data channel, wherein the conference auxiliary information includes conference speaker role information, and the conference speaker role information is obtained by the wireless sound pickup device through voiceprint recognition; A voice data transmission unit, used to transmit conference voice data as sound card data to a conference call device, thereby realizing a remote conference call through the conference call device; The speech recognition unit is used to perform speech recognition processing based on the conference speech data and the conference auxiliary information.

12. A wireless sound pickup device, characterized in that: include: Sound collection device, processor, memory; The memory is used to store a program for implementing the conference data processing method according to any one of claims 2 to 5. The device is powered on and runs the program of the method through the processor.

13. A wireless receiving device, characterized in that: include: a first communication device, a second communication device, a processor, and a memory; The memory is used to store a program for implementing the conference data processing method according to claim 6 or 7, and the device is powered on and runs the program of the method through the processor.

14. An electronic device, characterized in that: include: processor and memory; The memory is used to store a program for implementing the conference data processing method according to claim 8, and the device is powered on and runs the program of the method through the processor.

Images