Display devices and their audio acquisition and transmission methods, related equipment

Abstract

This disclosure provides a display device and its audio acquisition and transmission method and related equipment. The display device includes a plurality of first acquisition units disposed on a first side of the display device. The method includes: acquiring a plurality of first audio data acquired by the plurality of first acquisition units; determining whether the location of a sound source is within a preset location range based on the plurality of first audio data; and in response to determining that the location of the sound source is within the preset location range, determining target audio data based on the plurality of first audio data and sending it to a target device.

Description

Technical Field

[0001] This disclosure relates to the field of display technology, and in particular to a display device and its audio acquisition and transmission method and related equipment. Background Technology

[0002] In related technologies, the display device and the microphone are usually separate. Furthermore, the microphone is prone to feedback (howling) due to audio interference. Summary of the Invention

[0003] This disclosure proposes a display device and its audio acquisition and transmission method, as well as related equipment, to solve or partially solve the above-mentioned problems.

[0004] In a first aspect, this disclosure provides an audio acquisition and transmission method based on a display device, wherein the display device includes a plurality of first acquisition units disposed on a first side of the display device, and the method includes:

[0005] Acquire multiple first audio data collected by the multiple first acquisition units;

[0006] Based on the plurality of first audio data, determine whether the sound source location is within a preset location range; and

[0007] In response to determining that the sound source location is within a preset location range, target audio data is determined based on the plurality of first audio data and sent to the target device.

[0008] A second aspect of this disclosure provides a display device including one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and executed by the one or more processors, the programs including instructions for performing the method according to the first aspect.

[0009] A third aspect of this disclosure provides a display system, comprising:

[0010] Multiple display devices as described in the second aspect; and

[0011] The central control system is configured to: register the display device and acquire target audio data from the display device.

[0012] A fourth aspect of this disclosure provides a non-volatile computer-readable storage medium containing a computer program that, when executed by one or more processors, causes the processors to perform the method described in the first aspect.

[0013] In a fifth aspect, this disclosure provides a computer program product including computer program instructions that, when executed on a computer, cause the computer to perform the method described in the first aspect.

[0014] The display device and its audio acquisition and transmission method and related equipment disclosed herein utilize audio data acquired by multiple first acquisition units disposed on the first side of the display device to determine whether the sound source location is within a preset location range. If so, the audio data is uploaded, thereby ensuring the quality of the audio data and reducing noise. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in this disclosure or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are only embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0016] Figure 1 A schematic diagram of an exemplary system provided by an embodiment of this disclosure is shown.

[0017] Figure 2A A schematic diagram illustrating an exemplary workflow in a terminal registration mode according to an embodiment of this disclosure is shown.

[0018] Figure 2B A schematic diagram of an exemplary workflow under a data transmission mode according to an embodiment of the present disclosure is shown.

[0019] Figure 3A A schematic diagram of an exemplary display device provided in an embodiment of this disclosure is shown.

[0020] Figure 3B A schematic diagram of an exemplary display device provided in an embodiment of this disclosure is shown from another angle.

[0021] Figure 3C A schematic diagram showing the positional relationship between the first acquisition unit and the sound source according to an embodiment of the present disclosure is shown.

[0022] Figure 4A A schematic diagram illustrating the principle of effectively identifying the sound field range according to an embodiment of the present disclosure is shown.

[0023] Figure 4B A schematic diagram of the internal sound system of an exemplary display device according to an embodiment of the present disclosure is shown.

[0024] Figure 5 A flowchart illustrating an exemplary method provided in an embodiment of this disclosure is shown.

[0025] Figure 6 A schematic diagram of the hardware structure of an exemplary computer device provided in an embodiment of this disclosure is shown. Detailed Implementation

[0026] To make the objectives, technical solutions, and advantages of this disclosure clearer, the following detailed description is provided in conjunction with specific embodiments and the accompanying drawings.

[0027] It should be noted that, unless otherwise defined, the technical or scientific terms used in the embodiments of this disclosure should have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms "first," "second," and similar terms used in the embodiments of this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as "comprising" or "including" mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. Terms such as "connected" or "linked" are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. Terms such as "upper," "lower," "left," and "right" are used only to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0028] Figure 1 A schematic diagram of an exemplary system 100 provided in an embodiment of this disclosure is shown.

[0029] like Figure 1 As shown, the system 100 may include multiple terminal devices, such as terminal devices 300A to 300C. In some embodiments, the system 100 may be a display system, and the terminal devices may be display devices. As an optional embodiment, the display system 100 may be applied to a conference scenario, and the display device may be an electronic nameplate, used to provide corresponding participant information for each seat in the conference room. In some embodiments, the display device may be equipped with a data acquisition unit (e.g., a microphone) for collecting audio data, so that the display device can collect the participants' speech without the need for a separate audio pickup device, thereby reducing the number of conference devices.

[0030] In some embodiments, such as Figure 1 As shown, the system 100 may further include a central control system 200, used for registering each display device and collecting audio data from each display device. The central control system 200 and each display device can communicate via wired or wireless means. To facilitate data transmission and equipment deployment and installation, the central control system 200 and each display device can use wireless communication for data transmission.

[0031] In related technologies, due to the high real-time requirements of sound transmission, a one-to-one correspondence is typically established between the receiver and transmitter when wirelessly transmitting audio data. However, in conference scenarios, numerous microphones are usually required, necessitating the central control system 200 to have corresponding transmitter modules, making the entire system exceptionally complex. Furthermore, the addition and debugging of these devices require dedicated personnel, making them inconvenient to use.

[0032] In view of this, the present disclosure provides a system 100 that adopts a self-organizing network approach, which uses time-division power control within an acceptable latency range to complete a one-to-many topology of one central control system 200 to multiple display devices, so that the central control system only needs to be equipped with one transmitter and one receiver.

[0033] The self-organizing network system 100 mainly has two working modes: first, terminal registration mode; second, data transmission mode.

[0034] Figure 2A A schematic diagram of an exemplary workflow 202 in a terminal registration mode according to an embodiment of the present disclosure is shown.

[0035] When preparing equipment before the meeting, all display devices in system 100 (e.g., electronic nameplates 102A-102C) can be turned on. After the display devices are powered on, they will automatically enter the registration mode and receive broadcast messages from the central control system 200.

[0036] like Figure 2A As shown, the central control system 200 can broadcast registration messages to these display devices. These registration messages may include the ID of the central control system 200 and the number of display devices that have successfully registered. Optionally, the central control system 200 can broadcast the registration message at preset time intervals (e.g., 1-2 seconds), thereby enabling the registration of newly added display devices to be completed at any time.

[0037] For clarity, the following description will use display device 300A as the target display device.

[0038] After receiving the registration message, the target display device 300A can determine whether it has stored the ID of the central control system 200 locally (e.g., in a register of the display device 300A) based on the ID of the central control system 200 in the registration message. If the target display device 300A has stored the ID of the central control system 200 locally, it indicates that registration has been completed. If the target display device 300A does not have stored the ID of the central control system 200 locally, the target display device 300A can send a registration request to the central control system 200, which may include the ID of the target display device 300A.

[0039] After receiving the registration request from the target display device 300A, the central control system 200 can assign an identification code to the target display device 300A. The identification code is one-to-one with the display device and can be associated with the display device's ID, so that the corresponding display device can be identified based on the identification code.

[0040] In some embodiments, the identification code can be an Arabic numeral and can be sorted according to the number of registered devices. For example, if the number of currently registered devices is 2, then when assigning a new identification code, the corresponding identification code could be 3.

[0041] Next, the central control system 200 can broadcast the identification code of the target display device 300A along with its ID. Upon receiving the identification code and ID, the target display device 300A, by recognizing the ID, confirms that the identification code is the one assigned to it by the central control system 200. It can then save the identification code locally and send a registration success message to the central control system 200, thus confirming the completion of device registration. It can be understood that by sending messages via broadcast, the central control system 200 eliminates the need for a handshake process with each display device individually, simplifying the data transmission process and reducing latency. Furthermore, since the broadcast message includes the identification code and the corresponding device ID, when other display devices receive the broadcast message, they can recognize the ID to determine whether the corresponding identification code is the one assigned to them by the central control system 200, and thus decide whether to save the identification code.

[0042] Furthermore, after receiving the registration success message of the target display device 300A, the central control system 200 confirms that an identification code has been successfully assigned to the target display device 300A. It can store the association information between the ID of the target display device 300A and its identification code locally, and then proceed with the registration process of the next display device until all display devices are registered.

[0043] It is understandable that, since the registration process begins automatically after the display device is powered on, conflicts may occur when multiple devices register simultaneously. Therefore, in some embodiments, if the uplink channel between the display device and the central control system 200 is occupied, the display device can randomly generate a delayed registration time, and then send a registration request to the central control system 200 again at the end of that time, until all registrations are completed. In this way, each display device in the ad hoc network can automatically achieve channel allocation and automatically complete registration using this mechanism, without human intervention, thus improving system efficiency.

[0044] In some embodiments, after all display devices have completed registration and entered the working state, to ensure the addition of temporary devices, the central control system 200 can broadcast registration messages at predetermined time intervals, allowing temporary devices to complete registration based on these broadcast registration messages. Thus, even if the system 100 has entered the data acquisition phase, temporary devices can still complete registration when the central control system 200 broadcasts a registration message again. Optionally, the length of the predetermined time interval can be greater than one data acquisition cycle (i.e., the time required to complete data acquisition for all display devices), or an integer multiple of that data acquisition cycle, thereby ensuring that the normal operation of already registered display devices is not affected. In some embodiments, the data acquisition cycle is variable and can be adjusted according to the number of registered display devices, thereby improving channel utilization and reducing latency.

[0045] In some embodiments, after sending a registration success message, the target display device 300A may close the transmission channel (e.g., the wireless transmission channel) and enter a listening state, thereby reducing the occupation of the uplink channel, improving channel utilization, and reducing latency.

[0046] In this way, all registered display devices can share the same downlink channel and the same uplink channel, and the central control system 200 only needs one transmitter and one receiver to complete data transmission.

[0047] After all display devices have completed registration, system 100 can enter data transmission mode.

[0048] Figure 2B A schematic diagram of an exemplary workflow 204 under a data transmission mode according to an embodiment of the present disclosure is shown.

[0049] like Figure 2B As shown, after entering the data transmission mode, the central control system 200 can broadcast data acquisition messages sequentially according to the order of the identification codes. Each data acquisition message includes the identification code in the current sequence position. Assuming the central control system 200 adds identification codes from the beginning of the data acquisition message, for example, if the first sequential bit of the identification code is 1, corresponding to the first registered device in system 100, then the identification code included in the data acquisition message is "1".

[0050] Since the data acquisition message is broadcast, each display device in system 100 can receive the message and determine whether it is its turn to upload data based on the identification code within it.

[0051] For example, if the target display device 300A receives the data acquisition message and determines whether the identification code of the current sequence bit in the data acquisition message is the identification code of the target display device 300A.

[0052] Assuming the identification code of the target display device 300A is "1", the target display device 300A can determine that the identification code of the current sequence position is its identification code, and can send the audio data collected by the target display device 300A to the central control system 200. In some embodiments, after the target display device 300A determines that the identification code of the current sequence position is its identification code, the target display device 300A can open its transmission channel, increase the transmission power, and then send the audio data to the central control system 200.

[0053] After receiving the audio data sent by the target display device 300A, the central control system 200 uses the identification code of the next sequence bit (e.g., "2") to generate a data acquisition message and broadcast it to acquire the audio data of the display device corresponding to the identification code of the next sequence bit.

[0054] Because the data acquisition message contains an identification code instead of the IDs of each display device, data bits in the message can be saved, thereby improving communication efficiency and reducing latency. Furthermore, each display device can upload data after recognizing its own identification code, without needing to perform identity verification and authentication steps with the central control system 200. Given that the system 100 forms a self-organizing network, this ensures security while improving communication efficiency and reducing latency.

[0055] In some embodiments, since there are multiple display devices in system 100, after receiving audio data, the central control system 200 can transmit the audio data as a single channel to the subsequent stage for processing into multi-channel audio data. Simultaneously, it broadcasts the next data acquisition message in sequence according to the identification codes until all identification codes have been traversed. Then, in some embodiments, a registration message can be broadcast again to add a new device to system 100.

[0056] In some embodiments, the central control system 200 can send data acquisition messages based on a clock signal. If no uploaded audio data is received after one clock cycle following the sending of the data acquisition message, the central control system 200 can continue sending data acquisition messages based on the next identification code. At this time, the display device corresponding to the unreceived audio data is skipped, and the audio data can be re-uploaded in the next data acquisition cycle. Thus, even if there are damaged devices in the system 100 that cannot respond to the broadcast, the central control system can still normally proceed to the next identification code broadcast without affecting the normal operation of the system 100.

[0057] As an optional embodiment, when the central control system 200 does not receive the corresponding audio data in the corresponding clock cycle, it can output a prompt message or send a prompt message to a designated device. The prompt message may include the ID of the corresponding display device and the prompt content (e.g., "the device is in an abnormal state"), thereby prompting relevant personnel that a display device may have malfunctioned and needs to be dealt with in a timely manner.

[0058] In some embodiments, in addition to the display device corresponding to the identification code of the data acquisition message, other display devices can also determine how much time is left until their own upload time point based on the identification code when they receive the data acquisition message, so as to make preparations in advance.

[0059] For example, assuming the current sequence number's identification code is "1", a display device with identification code "3", upon receiving this identification code "1", can determine its upload time point as two clock cycles later and begin uploading audio data after two clock cycles, without needing to listen to the corresponding data acquisition messages or identify the identification codes within them. This further improves communication efficiency and reduces latency. Furthermore, by disabling the listening function, the display device's power consumption can be saved.

[0060] As an optional embodiment, when the display device determines, based on the identification code in the received data acquisition message, that the time difference between the current time and its own upload time is less than a preset time threshold (e.g., 1 second), it can disable the monitoring function and wait for the time difference to elapse before starting to upload audio data. If it determines that the time difference between the current time and its own upload time is greater than the preset time threshold, it can re-enable the monitoring function after the preset time threshold has elapsed, and receive new data acquisition messages to determine whether it is its turn to upload data. This avoids system errors and data upload errors or conflicts caused by the display device disabling the monitoring function for an extended period.

[0061] As described in the above embodiments, it can be seen that, due to the ample preparation time before the meeting, the central control system 200 can primarily operate in terminal registration mode, using the channel bandwidth to complete the registration of all devices. Once the meeting begins, it mainly operates in data transmission mode. This efficient use of channel bandwidth improves audio data utilization, increases throughput, and reduces latency. The uplink data from the display device is primarily audio data, while the downlink data is mainly identification codes, reducing the number of responses and non-audio data bit overhead, and also increasing the utilization rate of audio data bandwidth.

[0062] In related technologies, when using a microphone to speak in a meeting, feedback (howling) can easily occur due to the sound coming from the speaker. To avoid this, speakers typically need to turn on their microphones before speaking and turn them off afterward. When multiple people are speaking, other people's voices can also get in, causing interference and making it difficult for the other end of the video conference to hear clearly.

[0063] In view of this, the present disclosure also provides a display device with a data acquisition unit for acquiring audio data, and designs a corresponding audio acquisition and transmission method, which can improve the quality of audio data and avoid audio interference or even feedback problems.

[0064] Figure 3A A schematic diagram of an exemplary display device 300A provided in an embodiment of the present disclosure is shown.

[0065] by Figure 1 Taking the display device 300A as an example, such as Figure 3A As shown, in an optional embodiment, the display device 300A can be an electronic nameplate and may include a front shell 302 and a rear shell 304. A first display screen 306 can be disposed in the front shell 302, which can be used to display participant information, such as the relevant information (e.g., name, company, position, etc.) of the participant sitting at the corresponding position on the electronic nameplate. Optionally, four first acquisition units 308A-308D (e.g., microphones) can be disposed around the first display screen 306 to collect sound and form first audio data. The side with the first display screen 306 can face the participants during actual use, so that the four first acquisition units 308A-308D arranged in an array can better collect the participants' voices to form corresponding audio data for uploading to the central control system 200.

[0066] In some embodiments, the rear cover 304 may also be provided with an acquisition unit for acquiring audio data and a display screen.

[0067] Figure 3B A schematic diagram of an exemplary display device 300A provided in an embodiment of the present disclosure is shown from another angle.

[0068] like Figure 3BAs shown, a second display screen 310 can be installed in the rear cover 304. This second display screen 310 can also be used to display participant information. In actual use, the side with the second display screen 310 can face the opposite side of the participant, allowing others to identify the participant by observing the information displayed on the second display screen 310. As an optional embodiment, the angle between the display surface of the first display screen 306 and the display surface of the second display screen 310 can be greater than or equal to 90° and less than 180°, so that the side of the display device 300A with the first display screen 306 can better face the participant, and the side with the second display screen 310 can better face the opposite side of the participant, thus better realizing the function of an electronic nameplate.

[0069] In some embodiments, a second acquisition unit 312 (e.g., a microphone) may be disposed above the rear cover 304 for acquiring sound to form second audio data. This second audio data may be ambient sound, and thus can be used to reduce noise in the first audio data.

[0070] During the meeting, the electronic nameplate 300A completes registration with the central control system 200 according to the aforementioned embodiment, and can begin to collect sound using the first acquisition units 308A-308D. The front shell 302 of the electronic nameplate 300A faces the participants, so that the first acquisition units 308A-308D also face the participants, thus enabling the acquisition of relatively clear participants' voices, which are then used to generate the first audio data.

[0071] like Figure 3A As shown, four first acquisition units 308A to 308D are respectively arranged around the first display screen 306, so that the four first acquisition units 308A to 308D have a certain relative distance relationship. Using this relative distance relationship, combined with the speed of sound propagation, the location of the sound source can be determined based on the acquired first audio data. If the sound source location is within the preset location range, it means that the first audio data comes from the participants. The target audio data can be obtained based on these acquired first audio data and sent to the target device (e.g., the central control system 200). If the sound source location is outside the preset location range, it means that the first audio data comes from someone other than the participants. The acquired first audio data can be discarded.

[0072] Figure 3C A schematic diagram showing the positional relationship between the first acquisition unit and the sound source according to an embodiment of this disclosure is provided. Figure 3CAs shown, the first acquisition units 308B and 308D are arranged along a first direction (e.g., laterally) with a spacing of L2. Assuming the distance between the sound source 314 and the first acquisition unit 308B is l1, and the distance between the sound source 314 and the first acquisition unit 308D is l2, when the position of the sound source 314 is not on the vertical central axis, l1 ≠ l2, and the sound emitted by the sound source 314 reaches the two first acquisition units 308B and 308D at different times. For example, by comparing the first audio data acquired by the two first acquisition units 308B and 308D, the time difference Δt1 between them can be determined. Multiplying this time difference Δt1 by the speed of sound υ (approximately equal to the speed of sound in a vacuum, 340 m / s) yields the distance difference Δt1·υ between l1 and l2.

[0073] Based on the positional relationship between the sound source 314 and the first acquisition units 308B and 308D, when the sound source 314 is located on the central axis, l1 and l2 are equal. Therefore, the greater the distance difference between l1 and l2, the further the sound source 314 is from the central axis, the smaller the included angle α becomes, and Δt1·υ approaches L2. Furthermore, when the distance difference Δt1·υ is greater than a certain first distance threshold (or the ratio of Δt1·υ to L2 is greater than a certain first preset ratio), it can be considered that the sound source position exceeds the preset position range, and the acquired first audio data can be discarded.

[0074] Continue to refer to Figure 3C The first acquisition units 308A and 308C are arranged along a second direction (e.g., longitudinal) with a spacing of L1. Assuming the distance between the sound source 314 and the first acquisition unit 308A is l3, and the distance between the sound source 314 and the first acquisition unit 308C is l4, when the sound source 314 is not on the horizontal central axis, l3 ≠ l4, and the sound emitted by the sound source 314 reaches the two first acquisition units 308A and 308C at different times. For example, by comparing the first audio data acquired by the two first acquisition units 308A and 308C, the time difference Δt2 can be determined. Multiplying this time difference Δt2 by the speed of sound υ (approximately equal to the speed of sound in a vacuum, 340 m / s) yields the distance difference Δt2·υ between l3 and l4.

[0075] Based on the positional relationship between the sound source 314 and the first acquisition units 308A and 308C, it can be seen that when the sound source 314 is located on the vertical central axis, the distance difference Δt2·υ between l3 and l4 is equal to L1. Therefore, the more the sound source 314 deviates from the vertical central axis, the further away the sound source 314 is from the central axis, and the included angle β gradually increases, while Δt2·υ will become smaller and smaller. Therefore, when the distance difference Δt2·υ is less than a certain second distance threshold (or, the ratio of Δt2·υ to L1 is less than a certain second preset ratio), it can be considered that the position of the sound source exceeds the preset position range, and the acquired first audio data can be discarded.

[0076] Furthermore, based on geometric formulas, the following relationship can be obtained:

[0077]

[0078]

[0079]

[0080] |l1-l2|=Δt1·υ

[0081] |l3-l4|=Δt2·υ

[0082] In the above formula, Δt1, Δt2, υ, L1, and L2 are all known numbers, so we can solve for l1, l2, l3, l4, and D. Furthermore, we can determine whether to discard the first audio data based on the actual distance.

[0083] As an optional embodiment, the display device 300A can retain the first audio data when both the distance difference Δt1·υ and the distance difference Δt2·υ meet the threshold requirements, thereby ensuring the quality of the collected audio data of the participants.

[0084] Figure 4A A schematic diagram illustrating the principle of effectively identifying the sound field range according to an embodiment of the present disclosure is shown.

[0085] like Figure 4A As shown, in a meeting scenario, participants sit in front of the meeting table 402, and the electronic nameplate 300A is placed on the meeting table 402. The first acquisition unit of the electronic nameplate 300A faces the participants, forming a preset position range 404 of the sound source location. This range 404 is the effective sound field range for identification. According to usage habits, this range surrounds the participants. Sounds within this range will be effectively recorded, while sounds outside this range will be significantly reduced or blocked, thereby ensuring that the participants' voices are picked up, recorded, and transmitted to the central control system 200 by the system.

[0086] The second acquisition unit of the electronic nameplate 300A is positioned so that one side faces the opposite side of the attendee, and can collect noise or background sound in front of them 406.

[0087] In some embodiments, the display device 300A can acquire second audio data acquired by the second acquisition unit; then determine target audio data based on multiple first audio data and second audio data and send it to the target device (e.g., central control system 200).

[0088] like Figure 4AAs shown, when the volume of sound from the rear shell is too high, it will weaken the sound pickup effect of the front shell MIC array. Therefore, after the second audio data enters the system, it can be subtracted from the first audio data (noise reduction processing), thereby weakening the noise or background sound in the first audio data picked up by the first acquisition unit, and further achieving the purpose of noise elimination.

[0089] Figure 4B A schematic diagram of an internal sound system 408 of an exemplary display device according to an embodiment of the present disclosure is shown.

[0090] In some embodiments, such as Figure 4B As shown, the internal sound system of the display device 300A, in addition to the sound pickup, noise reduction and transmission mentioned above, also has a recording system. Through the electronic nameplate itself or an external MCU and Flash, all the speeches in the entire meeting are recorded and stored in the Flash. At the end of the meeting, the speaker signs to confirm through the screen of the nameplate. This signature label will be saved together with the recorded sound and uploaded to the central control system 200 after the meeting.

[0091] The display device with directional sound pickup and recording functions provided in this embodiment includes a nameplate display function, which can update the displayed content wirelessly. The front shell is equipped with a microphone array, which can generate a specific effective sound pickup area in front of the nameplate, accurately identifying the speaker within this area, picking up and recording the speaker's voice. Simultaneously, the rear shell microphone can be used to eliminate sound outside the effective recognition area. Furthermore, the electronic nameplate has a self-organizing network function; all nameplates share a wireless channel. The central control system broadcasts messages using the downlink channel, and the electronic nameplates complete registration by listening to the messages, uploading voice according to the order assigned in the messages, realizing sound control in meeting scenarios or similar scenarios.

[0092] The display device provided in this disclosure can accurately and clearly pick up the speaker's voice, eliminate feedback in meeting scenarios, improve meeting quality, and reduce the number of meeting devices. The display system provided in this disclosure features a self-organizing network, which reduces the difficulty of use and facilitates maintenance. Furthermore, the display device uses time-division power control to upload data, which reduces data latency.

[0093] This disclosure also provides an audio acquisition and transmission method based on a display device. Figure 5 A flowchart illustrating an exemplary method 500 provided in an embodiment of this disclosure is shown. This method 500 can be applied to... Figure 1 Display devices 300A to 300C, such as Figure 5 As shown, the method 500 may further include the following steps.

[0094] In step 502, the plurality of first acquisition units (e.g., Figure 3AMultiple first audio data collected by the first acquisition unit (308A-308D).

[0095] In step 504, based on the plurality of first audio data, it is determined whether the sound source location is within a preset location range (e.g., Figure 4A (range 404).

[0096] In some embodiments, the plurality of first acquisition units includes two first acquisition units arranged along a first direction (e.g., Figure 3C The first acquisition units 308B and 308D); determining whether the sound source location is within a preset location range based on the plurality of first audio data, including: determining a first distance difference between the sound source location and the two first acquisition units arranged along the first direction based on the two first audio data corresponding to the two first acquisition units arranged along the first direction; and determining whether the sound source location is within a preset location range based on the relationship between the first distance difference and a first distance threshold.

[0097] In some embodiments, determining a first distance difference between the sound source location and the two first acquisition units arranged along the first direction based on the two first audio data corresponding to the two first acquisition units arranged along the first direction includes: determining a first time difference between the acquisition of the two first audio data corresponding to the two first acquisition units arranged along the first direction by the two first acquisition units arranged along the first direction; and determining the first distance difference based on the first time difference and the speed of sound.

[0098] In some embodiments, the plurality of first acquisition units includes two first acquisition units arranged along the second direction (e.g., Figure 3C The first acquisition units 308A and 308C); determining whether the sound source location is within a preset location range based on the plurality of first audio data, including: determining a second distance difference between the sound source location and the two first acquisition units arranged along the second direction based on the two first audio data corresponding to the two first acquisition units arranged along the second direction; and determining whether the sound source location is within a preset location range based on the relationship between the second distance difference and a second distance threshold.

[0099] In some embodiments, determining a second distance difference between the sound source location and the two first acquisition units arranged along the second direction based on the two first audio data corresponding to the two first acquisition units arranged along the second direction includes: determining a second time difference between the two first audio data acquired by the two first acquisition units arranged along the second direction based on the two first audio data corresponding to the two first acquisition units arranged along the second direction; and determining the second distance difference based on the second time difference and the speed of sound.

[0100] In some embodiments, the display device further includes a second acquisition unit disposed on the second side of the display device (e.g., Figure 3B The method further includes: acquiring second audio data acquired by the second acquisition unit; the step of determining target audio data based on the plurality of first audio data and sending it to the target device includes: determining target audio data based on the plurality of first audio data and the second audio data and sending it to the target device.

[0101] In some embodiments, the angle between the orientation of the first side (e.g., the side where the first display screen 306 is located) and the second side (e.g., the side where the second display screen 310 is located) is greater than or equal to 90° and less than 180°.

[0102] In step 506, in response to determining that the sound source location is within a preset location range, target audio data is determined based on the plurality of first audio data and sent to the target device (e.g., Figure 1 Central control system 200).

[0103] The audio acquisition and transmission method based on a display device provided in this disclosure includes a microphone array on the front shell of the display device. This array generates a specific effective pickup area in front of the sign, accurately identifying speakers within this area and capturing and recording their voices. Simultaneously, the microphone on the rear shell can be used to eliminate sounds outside the effective recognition area. Furthermore, the electronic signboard has a self-organizing network function, with all signboards sharing a wireless channel. The central control system broadcasts messages using the downlink channel, and the electronic signboards register by listening to these messages, uploading audio according to the order assigned in the messages, thus enabling sound control in meeting scenarios or similar situations.

[0104] It should be noted that the method of this disclosure embodiment can be executed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario, where multiple devices cooperate to complete the task. In such a distributed scenario, one of these devices may execute only one or more steps of the method of this disclosure embodiment, and the multiple devices will interact with each other to complete the method described.

[0105] It should be noted that the above description describes some embodiments of this disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in a different order than that shown in the above embodiments and still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0106] This disclosure also provides a computer device for implementing the above-described method 500. Figure 6 A schematic diagram of the hardware structure of an exemplary computer device 600 provided in an embodiment of this disclosure is shown. The computer device 600 can be used to implement... Figure 1 The display devices 300A to 300C. In some scenarios, this computer device 600 can also be used to implement... Figure 1 The central control system 200.

[0107] like Figure 6 As shown, the computer device 600 may include: a processor 602, a memory 604, a network module 606, a peripheral interface 608, and a bus 610. The processor 602, memory 604, network module 606, and peripheral interface 608 are interconnected within the computer device 600 via the bus 610.

[0108] Processor 602 may be a central processing unit (CPU), image processor, neural network processor (NPU), microcontroller (MCU), programmable logic device, digital signal processor (DSP), application-specific integrated circuit (ASIC), or one or more integrated circuits. Processor 602 can be used to perform functions related to the techniques described in this disclosure. In some embodiments, processor 602 may also include multiple processors integrated as a single logic component. For example, such as... Figure 6 As shown, processor 602 may include multiple processors 602a, 602b and 602c.

[0109] Memory 604 can be configured to store data (e.g., instructions, computer code, etc.). Figure 6As shown, the data stored in memory 604 may include program instructions (e.g., program instructions for implementing the methods of embodiments of this disclosure) and data to be processed (e.g., the memory may store configuration files of other modules, etc.). Processor 602 may also access the program instructions and data stored in memory 604 and execute the program instructions to operate on the data to be processed. Memory 604 may include volatile or non-volatile storage devices. In some embodiments, memory 604 may include random access memory (RAM), read-only memory (ROM), optical disk, magnetic disk, hard disk, solid-state drive (SSD), flash memory, memory stick, etc.

[0110] Network interface 606 can be configured to provide communication with other external devices to computer device 600 via a network. This network can be any wired or wireless network capable of transmitting and receiving data. For example, the network can be a wired network, a local wireless network (e.g., Bluetooth, WiFi, Near Field Communication (NFC), etc.), a cellular network, the Internet, or a combination thereof. It is understood that the type of network is not limited to the specific examples described above.

[0111] The peripheral interface 608 can be configured to connect the computer device 600 to one or more peripheral devices to enable information input and output. For example, peripheral devices may include input devices such as keyboards, mice, touchpads, touch screens, microphones, and various sensors, as well as output devices such as displays, speakers, vibrators, and indicator lights.

[0112] Bus 610 can be configured to transfer information between various components of computer device 600 (e.g., processor 602, memory 604, network interface 606, and peripheral interface 608), such as internal buses (e.g., processor-memory bus), external buses (USB port, PCI-E bus), etc.

[0113] It should be noted that although the architecture of the computer device 600 described above only shows the processor 602, memory 604, network interface 606, peripheral interface 608, and bus 610, in specific implementations, the architecture of the computer device 600 may also include other components necessary for normal operation. Furthermore, those skilled in the art will understand that the architecture of the computer device 600 described above may only include the components necessary for implementing the embodiments of this disclosure, and does not necessarily include all the components shown in the figures.

[0114] Based on the same inventive concept, corresponding to the methods of any of the above embodiments, this disclosure also provides a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the method 500 as described in any of the above embodiments.

[0115] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transfer medium that can be used to store information accessible by a computing device.

[0116] The computer instructions stored in the storage medium of the above embodiments are used to cause the computer to perform the method 500 as described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0117] Based on the same inventive concept, corresponding to the method 500 of any of the above embodiments, this disclosure also provides a computer program product, which includes a computer program. In some embodiments, the computer program is executable by one or more processors to cause the processors to perform the method 500. Corresponding to the execution entity for each step in each embodiment of method 500, the processor executing the corresponding step may belong to the corresponding execution entity.

[0118] The computer program product of the above embodiments is used to cause the processor to execute the method 500 as described in any of the above embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0119] Those skilled in the art should understand that the discussion of any of the above embodiments is merely exemplary and is not intended to imply that the scope of this disclosure (including the claims) is limited to these examples; within the framework of this disclosure, the technical features of the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations of different aspects of the embodiments of this disclosure as described above, which are not provided in detail for the sake of brevity.

[0120] Additionally, to simplify the description and discussion, and to avoid obscuring the embodiments of this disclosure, the provided drawings may or may not show well-known power / ground connections to integrated circuit (IC) chips and other components. Furthermore, the apparatus may be shown in block diagram form to avoid obscuring the embodiments of this disclosure, and this also takes into account the fact that the details of implementation of these block diagram apparatuses are highly dependent on the platform on which the embodiments of this disclosure will be implemented (i.e., these details should be fully understood by those skilled in the art). While specific details (e.g., circuitry) have been set forth to describe exemplary embodiments of this disclosure, it will be apparent to those skilled in the art that the embodiments of this disclosure may be implemented without these specific details or with variations thereof. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0121] Although this disclosure has been described in conjunction with specific embodiments thereof, many substitutions, modifications, and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may be used with the embodiments discussed.

[0122] This disclosure is intended to cover all such substitutions, modifications, and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A display system comprising: a plurality of display devices, each of which is arranged in a meeting place; and a central control system configured to register the display devices and collect target audio data from the display devices; wherein each of the display devices stores a corresponding identification code, the identification code being generated by the central control system for the display device according to the number of registered display devices when the display device is registered, the identification codes of the plurality of display devices being different from each other and the plurality of identification codes corresponding to the plurality of display devices having an order, the plurality of display devices including a target display device; wherein the order of the plurality of identification codes is in the arrangement order of natural numbers; the central control system is further configured to broadcast data collection messages in turn according to the order of the identification codes, the data collection message including the identification code at the current order position; the target display device is further configured to receive the data collection message and determine whether the identification code at the current order position is the identification code of the target display device, and in response to determining that the identification code at the current order position is the identification code of the target display device, send the collected target audio data to the central control system; the display devices other than the target display device among the plurality of display devices are further configured to determine a time difference between the current time and the upload time point of itself according to the identification code in the received data collection message, in response to determining that the time difference is less than a preset time threshold, close the listening function and start uploading audio data after the time difference elapses; in response to determining that the time difference is greater than the preset time threshold, then close the listening function for the preset time threshold, and then open the listening function again and receive a new data collection message to determine whether the time for uploading audio data has arrived; wherein determining the time difference between the current time and the upload time point of itself according to the identification code in the received data collection message comprises calculating the difference between the identification code in the data collection message and the identification code stored locally, and determining the time difference according to the difference and a data collection clock period; wherein the target display device is further configured to close the transmission channel and enter a listening state after sending a registration success message; wherein the display device includes one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and executed by the one or more processors, and the programs include instructions for executing a display device-based audio collection and transmission method; wherein the display device includes a plurality of first collection units arranged on a first side of the display device, and the display device-based audio collection and transmission method comprises: obtaining a plurality of first audio data collected by the plurality of first collection units; determining whether a sound source position is within a preset position range according to the plurality of first audio data; and in response to determining that the sound source position is within the preset position range, determining target audio data according to the plurality of first audio data and sending the target audio data to a target device. ​ 2. The display system of claim 1, wherein, The first plurality of collecting units comprises two first collecting units arranged along a first direction. The method further comprises: determining whether the sound source position is in the preset position range according to the first plurality of audio data, comprising: determining a first distance difference between the sound source position and the two first collecting units arranged along the first direction according to two first audio data corresponding to the two first collecting units arranged along the first direction; and determining whether the sound source position is in the preset position range according to a relationship between the first distance difference and a first distance threshold. The first plurality of collecting units comprises two first collecting units arranged along a second direction.

3. The display system of claim 1 or 2, wherein, The method further comprises: determining whether the sound source position is in the preset position range according to the first plurality of audio data, comprising: determining a second distance difference between the sound source position and the two first collecting units arranged along the second direction according to two first audio data corresponding to the two first collecting units arranged along the second direction; and determining whether the sound source position is in the preset position range according to a relationship between the second distance difference and a second distance threshold. The method further comprises: determining a first distance difference between the sound source position and the two first collecting units arranged along the first direction according to two first audio data corresponding to the two first collecting units arranged along the first direction, comprising: determining a first time difference of collecting the two first audio data corresponding to the two first collecting units arranged along the first direction according to the two first audio data corresponding to the two first collecting units arranged along the first direction; and 4. The display system of claim 2, wherein, determining the first distance difference according to the first time difference and a sound speed. The method further comprises: determining a second distance difference between the sound source position and the two first collecting units arranged along the second direction according to two first audio data corresponding to the two first collecting units arranged along the second direction, comprising: determining a second time difference of collecting the two first audio data corresponding to the two first collecting units arranged along the second direction according to the two first audio data corresponding to the two first collecting units arranged along the second direction; and 5. The display system of claim 3, wherein, determining the second distance difference according to the second time difference and a sound speed. The display device further comprises a second collecting unit arranged on a second side of the display device; the method further comprises: acquiring second audio data collected by the second collecting unit; The method further comprises: determining target audio data according to the first plurality of audio data and the second audio data, and sending the target audio data to a target device.

6. The display system of claim 1, wherein, An included angle between the first side and a direction of the second side is greater than or equal to 90° and less than 180°. The display device is an electronic table card.

7. The display system of claim 6, wherein, The central control system is configured to: broadcast a registration message to a plurality of display devices, the registration message comprising an ID of the central control system and a number of display devices that have successfully registered; and receive a registration response message from the plurality of display devices.

8. The display system of claim 1 or 7, wherein, The target display device is configured to: receive the registration message and determine whether to store the ID of the central control system.

9. The display system of claim 1, wherein, ​ ​ and in response to determining that the ID of the control system is not stored, sending a registration request to the control system, the registration request including the ID of the target display device; the control system is further configured to: receive the registration request, and assign an identification code to the target display device; and send the identification code to the target display device together with the ID of the target display device; the target display device is further configured to: receive the identification code and the ID of the target display device; and store the identification code and send a registration success message to the control system.

Images