Multi-source audio adaptive switching device and method

Abstract

This invention proposes a multi-source audio adaptive switching device and method. The method includes: receiving an audio signal; extracting multiple sampling points from the audio signal, wherein one of the multiple sampling points is defined as a first sampling point and the rest are defined as multiple second sampling points; when it is determined that the absolute difference between each of the second sampling points and the first sampling point is greater than a first threshold, accumulating an effective value; and when it is determined that the effective value is greater than a second threshold, outputting the audio signal.

Description

Technical Field

[0001] This invention relates to an audio device and method, and more particularly to a device and method suitable for performing audio detection. Background Technology

[0002] Most multi-screen display devices allow users to manually switch between different audio sources. For example, users can manually switch between various audio sources through an on-screen display (OSD) menu; alternatively, they can switch audio sources through software settings; or they can switch audio sources using hardware buttons on the display device.

[0003] While the manual switching method is intuitive for users, it still has shortcomings. For example, when multiple screens are displayed on the same monitor, and the screen menu sets a specific screen as the audio source, even if that specific screen doesn't actually require audio playback at that moment, the user must manually switch to receive the call request or notification tone when another screen displays one, instead of receiving the audio signal instantly. Another example: if the current screen is playing an audio signal, and the user manually switches to another screen, the display device cannot automatically switch the audio source back to the original screen, requiring the user to manually switch again. Summary of the Invention

[0004] In view of this, the applicant proposes a multi-source audio adaptive switching method, comprising: receiving an audio signal; extracting multiple sampling points from the audio signal, wherein one of the multiple sampling points is defined as a first sampling point and the rest are defined as multiple second sampling points; when it is determined that the absolute difference between each of the second sampling points and the first sampling point is greater than a first threshold, accumulating an effective value; and when it is determined that the effective value is greater than a second threshold, outputting the audio signal.

[0005] The applicant also proposes a multi-source audio adaptive switching device, comprising a multiplexer and an audio detector. The multiplexer is used to receive multiple audio signals and output one of the multiple audio signals; and the audio detector is used to: receive one of the audio signals; extract multiple sampling points from the one audio signal, one of the multiple sampling points is defined as a first sampling point, and the rest are defined as multiple second sampling points; when it is determined that the absolute difference between each of the second sampling points and the first sampling point is greater than a first threshold, accumulate an effective value; and when it is determined that the effective value is greater than a second threshold, output the one audio signal. Attached Figure Description

[0006] Figure 1This is a block diagram of a multi-source audio adaptive switching system based on some embodiments.

[0007] Figure 2 This is a flowchart of a multi-source audio adaptive switching method based on some embodiments.

[0008] Figure 3 This is a flowchart of the steps for detecting audio validity in a multi-source audio adaptive switching method according to some embodiments.

[0009] Figure 4A It is a waveform diagram of timing data of sound signals based on some embodiments.

[0010] Figure 4B It is a waveform diagram of the timing data of the sound signal after taking the absolute value, based on some embodiments.

[0011] Figure 4C It is a waveform diagram of the timing data of the sound signal to be sampled according to some embodiments.

[0012] Figure 5 This is a block diagram of a multi-source audio adaptive switching system according to other embodiments. Detailed Implementation

[0013] Figure 1 This is a block diagram of a multi-source audio adaptive switching system based on some embodiments. Please refer to it. Figure 1 In this embodiment, the multi-source audio adaptive switching system 10 includes a multi-source audio adaptive switching device 11, a playback device 12, and multiple signal sources, namely a first signal source 131, a second signal source 132, and an Nth signal source 133. The multiple signal sources are respectively coupled to the multi-source audio adaptive switching device 11, and the multi-source audio adaptive switching device 11 is coupled to the playback device 12. This coupling allows information transmission between the devices, not limited to direct connection or indirect connection through other systems, modules, devices, or components, nor limited to wired or wireless connection. In this embodiment, the first signal source 131 sends audio signal A1 and video signal V1 to the multi-source audio adaptive switching device 11; the second signal source 132 sends audio signal A2 and video signal V2 to the multi-source audio adaptive switching device 11; and the Nth signal source 133 sends audio signal A3 and video signal V3 to the multi-source audio adaptive switching device 11.

[0014] Multiple signal sources can refer to two or more signal sources; in other words, the Nth signal source 133 may not exist. The audio signals A1, A2, A3 and video signals V1, V2, V3 transmitted by the signal sources correspond to each other. For example, video signal V1 corresponds to audio signal A1. For instance, video signal V1 might be a scene from a play, and audio signal A1 might be the sound synchronized with that scene; or video signal V1 might be a pop-up notification window, and audio signal A1 might be a telephone ringtone. Multiple signal sources are not limited to distinctions based on physical devices or software interfaces. For example, the first signal source 131 might be a TV box, and the second signal source 132 might be the user's mobile phone. Another example is that the first signal source 131 might be a video website, and the second signal source 132 might be communication software. Yet another example is that the first signal source 131 might be the first webpage address of a video website, and the second signal source 132 might be the second webpage address of the video website.

[0015] The communication interface used by the signal source of the physical device can be an Ethernet interface, audio cable / jack, bus, Digital Visual Interface (DVI), Video Graphics Array (VGA), Musical Instrument Digital Interface (MIDI), USB-A (Universal Serial Bus Type-A), USB-B, USB-C, Micro USB, Mini USB, USB 2.0, USB 3.0, Lightning, HDMI-A (High-Definition Multimedia Interface Type-A), HDMI-B, HDMI-C, HDMI-D, or DisplayPort (DP). The multi-source audio adaptive switching device 11 may include input ports for one or more communication interfaces. The signal source of the software interface can be a website page, an application, or a foreground / background program.

[0016] In this embodiment, the playback device 12 includes an audio receiver 121 and a video receiver 122. The audio receiver 121 is coupled to the audio detector 112, and the video receiver 122 is coupled to the video transmitter 113. The playback device 12 can be a display system, including a screen and speakers, with the speakers either independent or integrated into the screen. In some embodiments, the playback device 12 can divide the user interface 123 into multiple sub-interfaces based on multi-task processing (MTP), such as windows, pagination, picture-by-picture (PBP), picture-in-picture (PIP), OSD, or partitioned screens, with each sub-interface corresponding to a signal source.

[0017] In this embodiment, the multi-source audio adaptive switching device 11 includes a multiplexer 111, an audio detector 112, and a video transmitter 113. The multiplexer 111 is coupled to the audio detector 112, and the audio detector 112 is coupled to the video transmitter 113. The multiplexer 111 receives multiple audio signals, such as audio signals A1, A2, and A3, and outputs one of these audio signals to the audio receiver 121 of the playback device 12. The multiple signal sources can be digital signal sources or analog signal sources. In some embodiments, the multi-source audio adaptive switching device 11 may include a line-in port to receive external audio sources. Furthermore, the multi-source audio adaptive switching device 11 may further include an analog-to-digital converter (not shown) coupled between the signal source and the multiplexer 111, or coupled between the multiplexer 111 and the audio detector 112. In some embodiments, the multiplexer 111 can cyclically switch within the acquisition range formed by multiple signal sources to receive multiple audio signals A1, A2, A3. For example, the first signal source 131, the third signal source (not shown), and the sixth signal source (not shown) simultaneously emit audio signals. The multiplexer 111 switches to the first signal source 131 at a first time point, switches to the third signal source at a second time point, switches to the sixth signal source at a third time point, switches to the first signal source 131 at a fourth time point, and so on.

[0018] The audio detector 112 can be used to execute the multi-source audio adaptive switching method of one or more embodiments of this disclosure. The video transmitter 113 is used to receive multiple video signals, such as video signals V1, V2, V3, and output one or more video signals V1, V2, V3 to the video receiver 122 of the playback device 12. The audio detector 112 and the video transmitter 113 can be implemented by an integrated or separate processor, which can be a SoC chip, a central processing unit (CPU), a microcontroller unit (MCU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or logic circuits.

[0019] Figure 2 This is a flowchart of a multi-source audio adaptive switching method according to some embodiments. To facilitate understanding of the possible operation of the audio detector 112 and the video transmitter 113, Figure 2 An embodiment of a multi-source audio adaptive switching method (hereinafter referred to as the "switching method") is presented. It should be understood that other configurations that modify, omit, and refine the flowcharts of the various embodiments are contemplated without departing from the spirit and scope of this disclosure.

[0020] In this embodiment, the switching method obtains the number of signal sources (step S1) and switches the signal sources one by one (step S2). In some embodiments, the video transmitter 113 receives multiple video signals V1, V2, V3 and defines the range and number of signal sources according to the sources of the received video signals V1, V2, V3. For example, if the video transmitter 113 only receives video signals V1 and V2 and not video signal V3, it determines that the signal source acquisition range is the first signal source 131 and the second signal source 132, and the number of signal sources is 2. Based on the fact that each video signal V1, V2 corresponds to each audio signal A1, A2, when the existence of video signals V1, V2 is confirmed, the acquisition range of each audio signal A1, A2 is also defined. In this embodiment, the video transmitter 113 can send the capture range to the audio detector 112. The audio detector 112 can sort multiple audio signals within the capture range and control the multiplexer 111 to cyclically switch within the capture range to receive multiple audio signals. Therefore, the audio detector 112 can control the multiplexer 111 to cyclically switch within the capture range formed by audio signal A1 and audio signal A2, regardless of whether the output state of audio signal A1 and / or audio signal A2 is valid or invalid when the switching method determines that video signals V1 and V2 exist. In other embodiments, the multiplexer 111 can also switch between all audio input terminals of the multi-source audio adaptive switching device 11 (e.g., Figure 1 If the audio input terminals of the sound signals A1, A2, and A3 are shown, then step S1 can be omitted. The switching method can determine the presence status of video signals V1, V2, and V3 based on the signal pin potential changes of the video input terminals, the hot-plug detection (HPD) signal, the request signal sent by the signal terminal, or the clock signal.

[0021] In step S3, the audio packets are decrypted using a different method. In some embodiments, the audio detector 112 can decrypt the audio signals A1, A2, and A3 according to the communication interface protocol corresponding to the signal source to obtain the data of the audio signals A1, A2, and A3. In addition to the data, the packets may also include sampling rate, compression rate, number of channels, sequence number, synchronization bit, mute status, or encoding format. For example, the audio format is set according to the digital audio interface requirements of IEC 60958. In other embodiments, the audio signal is an analog signal, and step S3 can be omitted. Figure 4A These are waveform diagrams of timing data for sound signals based on some embodiments; please refer to them as well. Figure 2 and Figure 4A . Figure 4AThe timing data of audio signals A1, A2, and A3 are presented, with the horizontal axis representing time and the vertical axis representing the amplitude (voltage or data point) of timing data 91. In some embodiments, the switching method can obtain the original sampling rate by reading the sampling rate of the data within the packet (step S4). In other embodiments, the switching method can obtain the original sampling rate by detecting the timing data 91 (step S4). For example, the audio detector 112 can perform Audio Frequency Detection (AFD) to determine the frequency components of the data to estimate the original sampling rate. After confirming the number of channels of the current audio signal (e.g., stereo or multi-channel), the AFD calculates the number of packets received per unit time to estimate the original sampling rate. In other embodiments, the original sampling rate can also be estimated using Fast Fourier Transform (FFT), bandpass filtering, or autocorrelation analysis. For example, the audio detector 112 performs an FFT on the data to be tested to obtain the peak frequency, calculates the product of the peak frequency and the number of FFT sample points, and estimates the original sampling rate by dividing by an integer. In other embodiments, the multi-source audio adaptive switching device 11 uses an analog-to-digital converter to sample the analog sound signal, and the switching method obtains the original sampling rate based on the sampling rate setting of the analog-to-digital converter (step S4).

[0022] In step S5, the switching method determines whether the original sampling rate is 0. For example, if the audio output of the signal source is not connected to the audio input of the multi-source audio adaptive switching device 11, or the audio source of the signal source is damaged, or the signal source only has a video source, then the audio detector 112 determines that the original sampling rate should be 0. When the switching method determines that the original sampling rate is 0 (step S5, determined to be "yes"), it returns to step S2 to switch to the next signal source within the capture range, and performs steps S2 to S5 for the next audio signal A1, A2, A3. In some other embodiments, when step S5 determines to be "yes", the audio detector 112 notifies the video transmitter 113 to acquire the number of signal sources again (step S1) to redefine the capture range. When the switching method determines that the original sampling rate is not 0 (step S5, determined to be "no"), it detects the validity of the audio (step S6).

[0023] Figure 3 This is a flowchart of the audio validity detection step in a multi-source audio adaptive switching method according to some embodiments; Figure 4B This is a waveform diagram of the time sequence data of the sound signal after taking the absolute value, based on some embodiments. Please refer to it as well. Figure 3 , Figure 4A and Figure 4B In step S61, the method is switched to obtain the absolute value of the audio. For example, binary two's complement processing is performed on data with a sign bit of 1. Figure 4A and Figure 4B Data with original negative values ​​is represented by dashed lines. Figure 4A The time series data 91, after taking the absolute value, presents as follows: Figure 4B Timing data 92. In this embodiment, the peak values ​​of timing data 92 are all positive, which is beneficial for the audio detector 112 to compare the relative intensity of each data point on timing data 92.

[0024] Figure 4C This is a waveform diagram of the timing data of the sound signal to be sampled according to some embodiments. Please refer to it as well. Figure 3 and Figure 4C The switching method samples multiple sampling points from the audio (step S62). The switching method samples the timing data 92 within sampling range T1, another group of sampling points within sampling range T2, and yet another group of sampling points within sampling range T3. The starting point of sampling range T1 is time point t1, the starting point of sampling range T2 is time point t2, the starting point of sampling range T3 is time point t3, and the sampling pattern continues after time point t4. In this embodiment, the ending point of sampling range T1 is the same as the starting point of sampling range T2, i.e., time point t1. In other embodiments, the two time points may be different, i.e., there may be a time interval between each sampling range. The sampling range can be a moving time pane to sample multiple sampling points within a similar time range. In some embodiments, the timing data 92 itself is a digital signal containing multiple sampling points, and the switching method samples all sampling points within sampling range T1. For example, when the original sampling rate of timing data 92 is 48kHz and the sampling range T1, T2, T3 is 20 milliseconds, the switching method can capture 960 sampling points within the sampling range T1. In other words, in some embodiments, the sampling rate of audio detector 112 can be set to be less than or equal to the original sampling rate of timing data 92.

[0025] Subsequently, the switching method sets the baseline (step S63). Figure 4C In one embodiment, the switching method samples 256 sampling points within the sampling range T1, and selects the amplitude of one sampling point (hereinafter referred to as the "first sampling point") from among the 256 sampling points as the amplitude of the baseline. In this embodiment, the switching method uses the starting point of each sampling range as the first sampling point. Therefore, the amplitude of the time series data 92 at time point t1 is set as the baseline BT1, the amplitude of the time series data 92 at time point t2 is set as the baseline BT2, and the amplitude of the time series data 92 at time point t3 is set as the baseline BT3. In other embodiments, any sampling point within the sampling range T1 can be used as the first sampling point. For example... Figure 4C As shown, the amplitudes of the baselines BT1, BT2, and BT3 can fluctuate, depending on the amplitude of the first sampling point.

[0026] In step S64, the switching method compares the absolute difference between each sampling point and the baseline. For example, among the 256 sampling points within the sampling range T1, one sampling point is designated as the first sampling point, and the absolute difference between the amplitudes of the remaining 255 sampling points (hereinafter referred to as "second sampling points") and the amplitude of the first sampling point is calculated, i.e., the absolute value is obtained by subtracting them. Then, the switching method determines whether the absolute difference is greater than a first threshold TH1 (step S65). When the switching method determines that the absolute difference between any second sampling point and the first sampling point is less than the first threshold TH1, it indicates that this second sampling point is invalid. The first threshold TH1 reflects the permissible variation between the sampling points of the time series data 92, or more precisely, the permissible variation between the second sampling point and the first sampling point. Figure 4C As shown, dashed lines are drawn above and below the baselines BT1, BT2, and BT3, and these lines are separated from the baselines BT1, BT2, and BT3 by a first threshold TH1. For example, even in silent mode, the signal source may still output timing data 92 with an amplitude of 0. This timing data 92 is still sampled according to the preset original sampling rate; therefore, step S5 determines "No". However, the audio signals A1, A2, and A3 may still be determined as invalid audio. The first threshold TH1 can be defined based on the allowable amplitude variation of invalid audio signals or based on the minimum amplitude variation of valid audio signals.

[0027] When the switching method determines that the absolute difference is greater than the first threshold TH1 (step S65, determined to be "yes"), the effective values ​​are accumulated (step S66). For example, if the amplitude of the first sampling point is 60, and the amplitudes after the second sampling point are [57, 32, 72, 8, 66, 105] in sequence, and the first threshold TH1 is 10, then the effective values ​​after the second sampling point are [0, 1, 2, 3, 3, 4] in sequence. The effective value of 4 indicates that 4 out of the 6 second sampling points are effective. In this embodiment, the effective value refers to a valid integer value. In other embodiments, the effective value refers to an effective proportion value, and its numerator and denominator can be accumulated separately. For example, the effective value can refer to the ratio of valid second sampling points to invalid second sampling points within the sampling range T1, T2, T3. The effective values ​​would then be [0 / 1, 1 / 1, 2 / 1, 3 / 1, 3 / 2, 4 / 2], or [0, 1, 2, 3, 1.5, 2]. As another example, the effective value can refer to the ratio of valid second sampling points to all sampling points within the sampling range T1, T2, T3. The effective values ​​would then be [0 / 256, 1 / 256, 2 / 256, 3 / 256, 3 / 256, 4 / 256].

[0028] When the accumulation of valid values ​​is completed (step S66), or when the switching method determines that the absolute difference is not greater than the first threshold TH1 (step S65, determined as "No"), the switching method determines whether all sampling points have been compared (step S67). When the switching method determines that all sampling points have not been compared (step S67, determined as "No"), it returns to step S64 to compare the next second sampling point; when the switching method determines that all sampling points have been compared (step S67, determined as "Yes"), the audio validity detection procedure is completed (step S68).

[0029] Based on the valid value generated in step S6, the switching method determines whether the valid value is greater than the second threshold (step S7). In this embodiment, when the switching method determines that the valid value is not greater than the second threshold (step S7, determined to be "No"), it returns to step S2 to switch to the next signal source within the acquisition range, and performs steps S2 to S7 for the next audio signal A1, A2, A3. In other embodiments, when step S7 determines to be "No", the audio detector 112 notifies the video transmitter 113 to acquire the number of signal sources again (step S1) to redefine the acquisition range. When the switching method determines that the valid value is greater than the second threshold (step S7, determined to be "Yes"), it outputs audio (step S8). The second threshold reflects the allowable number of valid or invalid sampling points within the sampling range T1, T2, T3.

[0030] The following describes possible applications of the multi-source audio adaptive switching system 10 according to different embodiments. It should be understood that other use cases are contemplated by modifying, substituting, repurposing, and simplifying the possible applications of the various embodiments without departing from the spirit and scope of this disclosure.

[0031] In some embodiments, please refer to Figure 1 The playback device 12 executes PBP mode, where the user watches a video through the first screen, and the background program of the second screen includes communication software. Therefore, the first signal source 131 corresponds to the first screen (video signal V1 and audio signal A1 can come from a video website), and the second signal source 132 corresponds to the second screen (video signal V2 and audio signal A2 can come from communication software or other foreground / background programs). At this time, the communication software in the second screen suddenly pops up a call notification, and the audio detector 112 detects that the audio signal A2 in the second screen is valid, and outputs the audio signal A2 in the second screen to the playback device 12. Figure 5 This is a block diagram of a multi-source audio adaptive switching system according to some other embodiments. Please refer to... Figure 5The playback device 12 includes an audio receiver 121, a video receiver 122, and a user interface 123. An audio detector 112 is coupled to the user interface 123 to receive user control signals or send user notification signals. In this embodiment, the audio detector 112 can respond to the logic value of the user control signal (selecting / not selecting to answer incoming calls) to determine whether to output the audio signal A2 of the second screen to the playback device 12. In another embodiment, if the audio detector 112 detects that the audio signal A2 of the second screen is valid, it sends a user notification signal to the user interface 123, and the playback device 12 generates a pop-up notification window. The audio detector 112 can respond to the logic value of the user clicking the notification window (switching / not switching audio sources) to determine whether to output the audio signal A2 of the second screen to the playback device 12.

[0032] In some embodiments, when a user watches a video through the first screen in PBP mode and makes a call using communication software through the second screen, the call on the second screen ends, and the audio detector 112 detects that the effective value of the audio signal A2 on the second screen has switched and is less than the second threshold. In this embodiment, when the audio detector 112 determines that the currently output audio signal A2 is invalid, it re-executes the switching method (e.g., steps S1 to S8, or steps S2 to S8). At this time, the audio detector 112 detects that the audio signal A1 on the first screen is valid and outputs the audio signal A1 on the first screen to the playback device 12. Similarly, the audio detector 112 can respond to the logical value of the user control signal (switch / not switch audio source) to determine whether to output the audio signal A1 on the first screen to the playback device 12. Alternatively, in another embodiment, the audio detector 112 can respond to the selection value of the user control signal (select the first screen / second screen, such as clicking or moving the cursor to the screen) to determine whether to output the audio signal A1 on the first screen to the playback device 12.

[0033] In some embodiments, please refer to Figure 1 The playback device 12 executes PIP mode, where the user watches the first video through the master screen and the second video through the sub-screen. Therefore, the first signal source 131 corresponds to the master screen (video signal V1 and audio signal A1 can come from the first URL of the video website), and the second signal source 132 corresponds to the sub-screen (video signal V2 and audio signal A2 can come from the second URL of the video website). At this time, the user zooms in on the sub-screen through the user interface 123 to replace the master screen, and the multi-source audio adaptive switching device 11 receives a control command and interrupts receiving the first signal source 131. At this time, the audio detector 112 detects that the audio signal A1 from the first signal source 131 is invalid, and the switching method can be re-executed.

[0034] In some embodiments, the multiple audio signals A1, A2, A3 within the capture range include a primary audio signal and a secondary audio signal. When the effective value of the primary audio signal is determined to be greater than a second threshold during the output of the secondary audio signal, the primary audio signal is output. For example, in PIP mode, the main screen corresponds to the primary audio signal, and the child screen corresponds to the secondary audio signal. At this time, the audio detector 112 detects that the effective values ​​of both the primary and secondary audio signals are greater than the second threshold, and outputs the primary audio signal. If the audio detector 112 determines that the effective value of the primary audio signal has switched to less than the second threshold (e.g., the user mutes the main screen), the switching method is re-executed. If the audio detector 112 determines that the effective value of the secondary audio signal is greater than the second threshold, the output audio is switched from the primary audio signal to the secondary audio signal. In some embodiments, the audio detector 112 continuously executes the switching method during the output of audio signals A1, A2, A3. When it determines that the effective value of the primary audio signal has switched to greater than the second threshold (e.g., the user unmutes the main screen), the output audio is switched from the secondary audio signal to the primary audio signal.

[0035] In some embodiments, the primary audio signal is defined according to a selection signal. For example, a user controls the cursor to click or move to the screen corresponding to a video signal V1, V2, V3 via user interface 123 to generate a selection value. User interface 123 generates a control signal containing the selection value and sends it to audio detector 112. Audio detector 112 can define the corresponding audio signal A1, A2, A3 as the primary audio signal in response to the selection value of the user's control signal. Alternatively, the user can designate audio signals A1, A2, A3 generated by any signal source as the primary audio signal via user interface 123 and send a control signal containing the selection value to audio detector 112. In some embodiments, the primary audio signal is defined according to the input terminals of the multi-source audio adaptive switching device 11. For example, the multi-source audio adaptive switching device 11 may include multiple digital input terminals and an external audio source port input terminal. The audio signals A1, A2, A3 received by the external audio source port input terminal can be defined as the primary audio signal, and the remaining digital input terminals are defined as secondary audio signals. Alternatively, the multi-source audio adaptive switching device 11 includes multiple digital input terminals, and the audio signals A1, A2, A3 received by any one of them can be defined as the main audio signal.

[0036] Although the present invention has been disclosed above with reference to embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the art may make some modifications and refinements without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the claims defined in the appended patent application.

[0037] [Symbol Explanation]

[0038] 10: Multi-source audio adaptive switching system

[0039] 11: Multi-source audio adaptive switching device

[0040] 111: Multiplexer

[0041] 112: Audio Detector

[0042] 113: Video transmitter

[0043] 12: Playback device

[0044] 121: Audio Receiver

[0045] 122: Video Receiver

[0046] 123: User Interface

[0047] 131: First Signal Source

[0048] 132: Second signal source

[0049] 133: Nth signal source

[0050] A1, A2, A3: Sound signals

[0051] V1, V2, V3: Video Signals

[0052] S1~S8: Steps

[0053] S61~S68: Steps

[0054] 91, 92: Time Series Data

[0055] t1, t2, t3, t4: Time points

[0056] T1, T2, T3: Sampling range

[0057] BT1, BT2, BT3: Baseline

[0058] TH1: First threshold

Claims

1. A multi-source audio adaptive switching method, comprising: Receive an audio signal; Multiple sampling points are sampled from the sound signal, one of which is defined as a first sampling point, and the rest are defined as multiple second sampling points. When the absolute difference between each second sampling point and the first sampling point is greater than a first threshold, an effective value is accumulated; and When the effective value is determined to be greater than a second threshold, the sound signal is output.

2. The multi-source audio adaptive switching method according to claim 1 further includes receiving multiple audio signals, the multiple audio signals including a main audio signal and a secondary audio signal, and determining that the effective value of the main audio signal is greater than the second threshold during the output of the secondary audio signal, and outputting the main audio signal.

3. The multi-source audio adaptive switching method according to claim 2 further comprises: Receive multiple video signals, each of which corresponds to a specific audio signal; Receive a selection signal that specifies one of the video signals included in the plurality of video signals; and The main audio signal is defined based on the audio signal corresponding to one of the video signals.

4. The multi-source audio adaptive switching method according to claim 1 further comprises: Receive multiple of this sound signal; and During the output of one of the plurality of audio signals, if the effective value of the audio signal is determined to be less than the second threshold, another plurality of audio signals are received and the effective value of the other audio signal is determined.

5. The multi-source audio adaptive switching method according to claim 4, further comprising: Receive multiple video signals, each of which corresponds to a specific audio signal; The existence state of each audio signal is defined based on the multiple video signals to define the capture range of one of the multiple audio signals; and The capture range is cyclically switched to receive the multiple audio signals.

6. The multi-source audio adaptive switching method according to claim 1 further comprises: Receive multiple of this audio signal; Detect the original sampling rate of one of the sound signals; and When it is determined that the original sampling rate of one of the audio signals is zero, another audio signal is received and the original sampling rate of the other audio signal is determined.

7. The multi-source audio adaptive switching method according to claim 1 further includes sampling the plurality of sampling points from the audio signal according to the moving time pane, wherein the first of the plurality of sampling points is defined as the first sampling point, and the remainder are defined as the plurality of second sampling points.

8. A multi-source audio adaptive switching device, comprising: A multiplexer for receiving multiple audio signals and outputting one of the multiple audio signals; and An audio detector, used to: Receive one of its audio signals; Multiple sampling points are sampled from one of the sound signals, one of which is defined as a first sampling point, and the rest are defined as multiple second sampling points; When the absolute difference between each second sampling point and the first sampling point is greater than a first threshold, an effective value is accumulated; and When the effective value is determined to be greater than a second threshold, an audio signal is output.

9. The multi-source audio adaptive switching device according to claim 8, further comprising: A video transmitter, used for: Receive multiple video signals, each of which corresponds to a specific audio signal; The existence state of each audio signal is defined based on the multiple video signals to define the capture range of one of the multiple audio signals; and Send the capture range to the audio detector; and This audio detector is also used for: The capture range is cyclically switched to receive the multiple audio signals.

10. The multi-source audio adaptive switching device according to claim 8, further comprising: A user interface for receiving a selection signal; A video transmitter, used for: Receive multiple video signals, each of which corresponds to a specific audio signal; Receive the selection signal, which specifies one of the video signals included in the plurality of video signals; Define a main audio marker for the audio signal corresponding to a video signal; and Send the main audio tag to the audio detector; as well as This audio detector is also used for: Based on the main audio marker, a main audio signal and a secondary audio signal other than the main audio signal are defined within the multiple audio signals; as well as When the effective value of the main sound signal is determined to be greater than the second threshold during the output of the sound signal, the main sound signal is output.

Images