Signal enhancement method and apparatus, vehicle, electronic device, storage medium, and chip
By dividing the signal acquisition space into regions by the angle between the signal pickup point and the region division, the desired signal is identified and filtered, which solves the problem of signal distortion in video recording and improves signal quality and recording experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- BEIJING X RING TECHNOLOGY CO LTD
- Filing Date
- 2025-09-22
- Publication Date
- 2026-06-05
AI Technical Summary
During video recording, the signals captured by image and audio acquisition devices may be distorted, affecting the user's recording experience.
The signal acquisition space is divided into regions based on the signal pickup point and the angle between the regions, the regions of desired signal sources and undesired signal sources are identified, and the candidate desired signal is filtered by the target undesired signal to enhance the desired signal.
It improves the recognition accuracy and signal-to-noise ratio of the desired signal, optimizes the image and audio quality in video recording, and enhances the user's recording experience.
Smart Images
Figure CN120881225B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of beamforming technology, and more particularly to a signal enhancement method, apparatus, vehicle, electronic device, storage medium, and chip. Background Technology
[0002] With the development of technology, people have increasingly higher requirements for video recording. These requirements can be met by deploying image acquisition devices and audio acquisition devices.
[0003] During video recording, the signals collected by sensors such as image acquisition devices and audio acquisition devices may be distorted to some extent, which may affect the user's recording experience. Summary of the Invention
[0004] This disclosure aims to at least partially address one of the technical problems in the related art.
[0005] Therefore, the first aspect of this disclosure proposes a signal enhancement method.
[0006] The second aspect of this disclosure provides a signal enhancement device.
[0007] The third aspect of this disclosure proposes a vehicle.
[0008] The fourth aspect of this disclosure proposes an electronic device.
[0009] The fifth aspect of this disclosure provides for a computer-readable storage medium.
[0010] The sixth aspect of this disclosure proposes a chip.
[0011] The first aspect of this disclosure proposes a signal enhancement method, comprising: dividing the signal acquisition space where the signal pickup point is located into regions based on a signal pickup point and the included angle of the region division, to obtain a set of candidate regions after division; determining a first target region where a desired signal source is located and a second target region where an undesired signal source is located from the set of candidate regions, wherein the second target region is the sum of all remaining candidate regions in the set of candidate regions except the first target region where the desired signal source is located; acquiring a candidate desired signal corresponding to the first target region and a target undesired signal of the second target region; and filtering the candidate desired signal based on the target undesired signal to obtain a target desired signal enhanced from the candidate desired signal.
[0012] A second aspect of this disclosure provides a signal enhancement device, comprising: a segmentation module, configured to segment the signal acquisition space where the signal pickup point is located based on a signal pickup point and a segmentation angle, to obtain a set of candidate segmentation regions; a determination module, configured to determine from the set of candidate segmentation regions a first target region where a desired signal source is located and a second target region where an undesired signal source is located, wherein the second target region is the sum of all remaining candidate segmentation regions in the set of candidate segmentation regions, excluding the first target region where the desired signal source is located; an acquisition module, configured to acquire a candidate desired signal corresponding to the first target region and a target undesired signal of the second target region; and a filtering module, configured to filter the candidate desired signal based on the target undesired signal to obtain a target desired signal enhanced from the candidate desired signal.
[0013] A third aspect of this disclosure provides a vehicle capable of performing the signal enhancement method as described in the first aspect above.
[0014] This disclosure provides a fourth aspect of an electronic device, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute instructions to implement the signal enhancement method as described in the first aspect above.
[0015] The fifth aspect of this disclosure provides a computer-readable storage medium that, when executed by a processor of an electronic device, enables the electronic device to perform the signal enhancement method as described in the first aspect above.
[0016] A sixth aspect of this disclosure provides a chip including one or more interface circuits and one or more processors; the interface circuits are configured to receive signals and send the signals to the processors, the signals including computer instructions stored in a memory, which, when executed by the processors, cause the chip to perform the signal enhancement method as described in the first aspect above.
[0017] The signal enhancement method and apparatus proposed in this disclosure divide the signal acquisition space into regions based on signal pickup points and the included angle of region division. This improves the positioning accuracy of the respective regions where desired and unwanted signal sources are located within the signal acquisition space. By dividing the desired signal and unwanted signal into a first target region and a second target region within the signal acquisition space, the recognition accuracy of the desired signal is improved, thereby enhancing the accuracy of downstream signal enhancement tasks. Based on the desired signal in the first target region, the desired signal is filtered using the desired signal in the second target region to obtain the desired signal. This improves the signal-to-noise ratio of the desired signal, reduces the influence of the unwanted signal in the second target region on the desired signal in the first target region, enhances the practicality and applicability of the signal enhancement method for the desired signal, and improves the signal quality of the desired signal. In video recording scenarios, this improves the image and audio quality in the video obtained based on the desired signal, optimizing the user's recording experience.
[0018] It should be understood that the description herein is not intended to identify key or essential features of the embodiments thereof, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description
[0019] The above and / or additional aspects and advantages of this disclosure will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, in which:
[0020] Figure 1 This is a schematic flowchart of a signal enhancement method according to an embodiment of the present disclosure;
[0021] Figure 2 This is a schematic flowchart of a signal enhancement method according to another embodiment of the present disclosure;
[0022] Figure 3 This is a schematic diagram of the spatial division of signal acquisition area according to an embodiment of the present disclosure;
[0023] Figure 4 This is a schematic flowchart of a signal enhancement method according to another embodiment of the present disclosure;
[0024] Figure 5 This is a schematic diagram of the structure of a signal enhancement device according to an embodiment of the present disclosure;
[0025] Figure 6 This is a block diagram of an electronic device according to an embodiment of the present disclosure. Detailed Implementation
[0026] Embodiments of this disclosure are described in detail below. Examples of these embodiments are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this disclosure, and should not be construed as limiting this disclosure.
[0027] The present disclosure provides a signal enhancement method, apparatus, vehicle, electronic device, storage medium, and chip, with reference to the accompanying drawings.
[0028] Figure 1 This is a schematic flowchart of a signal enhancement method according to an embodiment of the present disclosure, as shown below. Figure 1 As shown, the method includes:
[0029] S101, based on the signal pickup point and the angle between the regions, divide the signal acquisition space where the signal pickup point is located into regions to obtain a set of candidate regions after division.
[0030] In this embodiment of the disclosure, the space where signal acquisition is required can be defined as the signal acquisition space. During the signal acquisition process, the acquired signals may contain the desired signal to be acquired, as well as the undesired signal that affects the desired signal.
[0031] In this scenario, it is necessary to distinguish between desired and undesired signals from the signals acquired in the signal acquisition space, so as to perform downstream signal enhancement processing on the desired signals.
[0032] In some possible implementations, the desired signal and the undesired signal can be distinguished by dividing the signal acquisition space. The location where the signal acquisition device is deployed in the signal acquisition space can be obtained, and this location can be determined as the signal pickup point in the signal acquisition space.
[0033] In this process, the included angle corresponding to each region can be determined, which can be defined as the division angle. The signal pickup point is taken as the origin. Based on the division angle and the signal pickup point, the signal acquisition space can be divided into regions, and each region obtained is determined as a candidate division region, thus obtaining a set of candidate division regions composed of each candidate division region.
[0034] S102, determine the first target region where the desired signal source is located and the second target region where the undesired signal source is located in the signal acquisition space from the candidate region division set, wherein the second target region is the sum of all remaining candidate regions in the candidate region division set except for the first target region where the desired signal source is located.
[0035] In this embodiment of the disclosure, the signal source corresponding to the desired signal can be determined as the desired signal source, and the signal source corresponding to the undesired signal can be determined as the undesired signal source.
[0036] It should be noted that undesired signal sources may include at least one of the signal sources of interference signals and noise signals within the signal acquisition space.
[0037] In some possible implementations, the region where the desired signal source is located can be determined from the set of candidate regions obtained after dividing the signal acquisition space into regions, and this region can be determined as the first target region within the signal acquisition space.
[0038] In this embodiment of the disclosure, the signal transmitted by the desired signal source in the first target area carries the corresponding desired signal. In this scenario, the signals transmitted by other signal sources in the signal acquisition space besides the desired signal source can be regarded as non-desired signals that may have a certain impact on the signal transmission quality of the desired signal.
[0039] In this scenario, the region containing the unwanted signal source (excluding the first target signal source where the desired signal source is located) within the signal acquisition space can be determined as the second target region, which is the merged region of the remaining candidate regions in the candidate region set excluding the first target region.
[0040] In other words, in a video recording scenario, the signal source corresponding to the object to be recorded can be identified as the desired signal source. The candidate partitioning area where the desired signal source is located is the first target area to be recorded during video recording. Furthermore, objects that do not need to be recorded are identified as undesired objects, and the signal source of the undesired object is identified as the undesired signal source. The area obtained by merging the remaining candidate partitioning areas where the undesired signal source is located can be identified as the second target area within the signal acquisition space.
[0041] S103, acquire the candidate desired signal corresponding to the first target region and the target undesired signal of the second target region.
[0042] In this embodiment of the present disclosure, a signal can be acquired from a desired signal source within a first target area using a preset signal acquisition device to obtain the acquired signal within the first target area, and then the desired signal corresponding to the first target area can be obtained based on the acquired signal as a candidate desired signal.
[0043] This can be understood as follows: the signals acquired by the signal acquisition device may include signals sent by undesired signal sources in the second target area, which is in addition to the first target area. In this scenario, based on a preset signal processing strategy, the signals sent by the desired signal sources in the first target area can be retained from the acquired signals, while the signals sent by undesired signal sources in the second target area can be filtered out, thereby obtaining the processed candidate desired signal. In other words, the candidate desired signal only includes the signals acquired in the first target area.
[0044] Accordingly, the signal acquisition device acquires the signal sent by the unwanted signal source in the second target area, obtains the acquired signal in the second target area, and then obtains the unwanted signal corresponding to the second target area based on the acquired signal, which is used as the target unwanted signal.
[0045] Specifically, the signals collected in the second target area can be processed using a similar processing method to the candidate desired signals mentioned above, thereby obtaining the target undesired signals in the second target area. In other words, the target undesired signals only contain the signals collected in the second target area.
[0046] S104, the candidate desired signal is filtered based on the target undesired signal to obtain the target desired signal after the candidate desired signal is enhanced.
[0047] In this embodiment of the disclosure, the obtained candidate expected signal may still contain some signals belonging to the second target region. In this scenario, the candidate expected signal needs to be filtered and then further enhanced to obtain the enhanced signal as the target expected signal.
[0048] In some possible implementations, the portion of the candidate desired signal that needs to be filtered can be determined based on the target undesired signal within the second target region, and the candidate desired signal can be filtered based on the portion of the signal that needs to be filtered out, and the filtered signal can be determined as the enhanced target signal.
[0049] The signal enhancement method proposed in this disclosure divides the signal acquisition space into regions based on the signal pickup point and the included angle of the region division. This improves the positioning accuracy of the regions where desired and unwanted signal sources are located within the signal acquisition space. By dividing the desired signal and unwanted signal into a first target region and a second target region within the signal acquisition space, the recognition accuracy of the desired signal is improved, thereby enhancing the accuracy of downstream signal enhancement tasks. Based on the desired signal in the first target region, the desired signal is filtered using the desired signal in the second target region to obtain the desired signal. This improves the signal-to-noise ratio of the desired signal, reduces the influence of the unwanted signal in the second target region on the desired signal in the first target region, and enhances the practicality and applicability of the signal enhancement method for the desired signal. It also improves the signal quality of the desired signal. In video recording scenarios, it improves the image and audio quality in the video obtained based on the desired signal, optimizing the user's recording experience.
[0050] In the above embodiments, the acquisition of the target desired signal can also be combined with... Figure 2 To understand further, Figure 2 This is a schematic flowchart of a signal enhancement method according to another embodiment of the present disclosure, as shown below. Figure 2 As shown, the method includes:
[0051] S201, determine the first target area where the desired signal source is located and the second target area where the undesired signal source is located in the signal acquisition space.
[0052] In some possible implementations, the signal acquisition point in the signal acquisition space is taken as the origin, and based on the region division angle, each region division ray with the signal acquisition point as the endpoint is obtained. The signal acquisition space is divided into regions based on each region division ray to obtain a set of candidate division regions in the signal acquisition space.
[0053] As an example, such as Figure 3 As shown, it can be Figure 3 The signal pickup point shown is taken as the origin, and... Figure 3 The 45° angle shown is determined as the region division angle. Therefore, based on the 45° region division angle, we can obtain... Figure 3 The region dividing rays 1, 2, 3 and 4 are shown.
[0054] like Figure 3 As shown, regions can be divided based on ray 1, ray 2, ray 3, and ray 4. Figure 3 The signal acquisition space shown is divided into regions to obtain... Figure 3The regions shown are 1, 2, ..., 7, and 8. In this example, regions 1, 2, ..., 7, and 8 can be identified as... Figure 3 The candidate regions obtained after dividing the signal acquisition space into regions are shown, and the set consisting of region 1, region 2, ..., region 7 and region 8 is determined as... Figure 3 The set of candidate regions corresponding to the signal acquisition space is shown.
[0055] In some possible implementations, a first target region to which the desired signal source belongs is determined from a set of candidate region divisions.
[0056] In this embodiment of the disclosure, the location of the desired signal source can be obtained, and the region where the signal source is located can be selected from each candidate division region. Then, the region can be determined as the region where the desired signal source is located in the candidate division region set, i.e., the first target region.
[0057] As an example, such as Figure 3 As shown, set in Figure 3 Among the regions 1, 2, ..., 7 and 8 shown, the region to which the desired signal source is located is region 6. Therefore, region 6 can be determined as the first target region to which the desired signal source belongs.
[0058] In some possible implementations, the remaining candidate regions in the candidate region set, excluding the first target region, are determined as the unwanted sub-regions where the unwanted signal source is located, and the unwanted sub-regions are integrated to obtain the second target region where the unwanted signal source is located.
[0059] In this embodiment of the disclosure, there are other regions in the candidate region set besides the first target region. The signal source in these regions is the undesired signal source in the signal acquisition space. In this scenario, all regions in the candidate region set besides the first target region can be identified as the regions where the undesired signal source is located, i.e., each undesired sub-region.
[0060] In some possible implementations, the unwanted sub-regions are integrated, and the integrated region can be determined as the second target region where the unwanted signal source is located.
[0061] As an example, such as Figure 3 As shown, settings Figure 3 In the candidate region set consisting of Region 1, Region 2, ..., Region 7 and Region 8 shown, Region 6 is the first target region. Therefore, the remaining Regions 1, 2, 3, 4, 5, 7, and 8, excluding Region 6, can be determined as... Figure 3 The diagram shows the unwanted sub-regions in the signal acquisition space.
[0062] In this example, regions 1, 2, 3, 4, 5, 7, and 8 are integrated, and the integrated region is the second target region in the signal acquisition space.
[0063] S202, acquire the spatial input signal picked up in the signal acquisition space.
[0064] In some possible implementations, the acquisition input signal picked up within the signal acquisition space is acquired, and the acquisition input signal is processed by a short-time Fourier transform to obtain the spatial input signal of the signal acquisition space.
[0065] In this embodiment of the disclosure, the signal acquisition device deployed at the signal acquisition point can acquire signals sent by each signal source within the signal acquisition space. In this scenario, the signal acquired by the signal acquisition device can be identified as the acquisition input signal picked up within the signal acquisition space.
[0066] In some possible implementations, in order to achieve filtering and enhancement of subsequent input signals, the acquired input signals can be processed by algorithms based on short-time Fourier transform algorithms in related technologies, and then the signal after short-time Fourier transform can be obtained based on the results of the algorithm processing. This signal can be used as the spatial input signal of the signal acquisition space.
[0067] S203, obtain the first spatial filter weight coefficient corresponding to the first target region, and obtain the second spatial filter weight coefficient of the second target region.
[0068] In some possible implementations, the input signal covariance matrix corresponding to the spatial input signal is obtained.
[0069] In this embodiment of the disclosure, the spatial input signal can be processed by an algorithm for obtaining the covariance matrix in related technologies, and then the covariance matrix corresponding to the spatial input signal, i.e., the input signal covariance matrix, can be obtained based on the algorithm processing result.
[0070] In some possible implementations, a first signal steering vector of the initial signal corresponding to the first target region is obtained, and a first spatial filtering weight coefficient corresponding to the first target region is obtained based on the first signal steering vector and the input signal covariance matrix.
[0071] In this embodiment of the disclosure, the signal sent by the desired signal source in the first target area acquired at the signal pickup point can be determined as the initial signal in the first target area.
[0072] Among them, the initial signal collected in the first target area can be processed by the algorithm of signal steering vector in related technologies, and the steering vector corresponding to the initial signal can be obtained according to the result of the algorithm processing. This steering vector is the first signal steering vector corresponding to the initial signal.
[0073] In some possible implementations, based on the spatial filtering weight coefficient acquisition algorithm in related technologies, the first signal steering vector and the input signal covariance matrix of the spatial input signal are processed by the algorithm, and the spatial filtering weight coefficient corresponding to the first target region is obtained according to the result of the algorithm processing, which is used as the first spatial filtering weight coefficient.
[0074] In some possible implementations, the second signal steering vector of the initial unwanted signal of each unwanted sub-region in the second target region is obtained, and the second spatial filtering weight coefficient of each unwanted sub-region in the second target region is obtained based on the second signal steering vector and the input signal covariance matrix.
[0075] In this embodiment of the disclosure, for any unwanted sub-region, the signal sent by the signal source within the unwanted sub-region acquired at the signal pickup point can be determined as the initial unwanted signal of the unwanted sub-region.
[0076] In some possible implementations, related processing can be performed based on the initial undesired signal to obtain the spatial filter weight coefficients corresponding to the initial undesired signal, i.e., the second spatial filter weight coefficients corresponding to the initial undesired signal. The process of obtaining the second spatial filter weight coefficients can be understood in conjunction with the process of obtaining the first spatial filter weight coefficients as described above, and will not be repeated here.
[0077] S204. Based on the first spatial filtering weight coefficient and the spatial input signal, the candidate expected signal corresponding to the first target region is obtained.
[0078] In some possible implementations, the spatial input signal is filtered based on the first spatial filtering weight coefficient to obtain the candidate desired signal.
[0079] In this embodiment of the present disclosure, based on the filtering algorithm in the related technology, the first spatial filtering weight coefficient and the spatial input signal are processed by the filtering algorithm. Based on the processing of the filtering algorithm, the first spatial filtering weight coefficient is implemented on the spatial input signal, thereby filtering out the part of the spatial input signal that does not belong to the first target region, and obtaining the remaining signal that belongs to the first target region, i.e., the candidate expected signal.
[0080] As an example, such as Figure 4 As shown, it can be Figure 4The microphone array shown is identified as a signal acquisition device deployed at the signal pickup point. The microphone array picks up the input signal from the signal acquisition space to obtain... Figure 4 The spatial input signal is shown.
[0081] like Figure 4 As shown, based on Figure 4 The first spatial filter weight coefficients corresponding to the first target region are shown, and Figure 4 The input signal covariance matrix of the spatial input signal shown can be used to filter the spatial input signal based on the first spatial filtering weight coefficients, thereby filtering out signals that do not belong to the first target region from the spatial input signal, and thus obtaining... Figure 4 The candidate expected signals are shown.
[0082] S205, based on the second spatial filter weight coefficient and the spatial input signal, obtain the target non-desired signal corresponding to the second target region.
[0083] In some possible implementations, for any unwanted sub-region of the second target region, the spatial input signal is filtered based on the second spatial filtering weight coefficient of the unwanted sub-region to obtain the candidate unwanted signal of the unwanted sub-region.
[0084] In this embodiment of the disclosure, for any undesirable sub-region, signals sent by signal sources that do not belong to the undesirable sub-region can be filtered out from the spatial input signal based on the spatial input signal and the second spatial filtering weight coefficient, and these signals are filtered out from the spatial input signal to obtain the filtered and retained signals, which are the candidate undesirable signals of the undesirable sub-region.
[0085] In some possible implementations, candidate unwanted signals of each unwanted sub-region within the second target region are superimposed to obtain the target unwanted signal of the second target region.
[0086] In this embodiment of the disclosure, the candidate unwanted signals of each unwanted sub-region can be superimposed based on the signal superposition method in the related technology. The signal obtained after superposition is the unwanted signal in the second target region, which can be determined as the target unwanted signal of the second target region.
[0087] As an example, such as Figure 4 As shown, with Figure 4 Taking the undesired sub-region 1 shown as an example, based on Figure 4 The second spatial filter weight coefficient 1 corresponding to the unwanted sub-region 1 is shown, and Figure 4The input signal covariance matrix of the spatial input signal shown can be used to filter the spatial input signal based on the second spatial filter weight coefficient 1, thereby filtering out signals that do not belong to the undesired sub-region 1 from the spatial input signal, and thus obtaining... Figure 4 The candidate undesirable signal 1 corresponding to the undesirable sub-region 1 is shown.
[0088] In this example, candidate unwanted signal 2 corresponding to unwanted sub-region 2 and candidate unwanted signal 3 corresponding to unwanted sub-region 3 are obtained based on the same method, and candidate unwanted signal 1, candidate unwanted signal 2 and candidate unwanted signal 3 are superimposed.
[0089] S206, the candidate desired signal is filtered based on the target undesired signal to obtain the target desired signal after the candidate desired signal is enhanced.
[0090] In some possible implementations, the candidate desired signal is calibrated based on the target undesired signal to obtain the calibration redundancy signal in the candidate desired signal, and the candidate desired signal is filtered based on the calibration redundancy signal to obtain the target desired signal after the candidate desired signal is enhanced.
[0091] In this embodiment of the disclosure, a portion of the candidate desired signal that is associated with the target undesired signal can be calibrated based on the signal calibration method in the related art. The calibrated portion of the signal can then be identified as the calibration redundant signal in the candidate desired signal.
[0092] In some possible implementations, the unwanted signal features of the target unwanted signal and the desired signal features of the candidate desired signal are extracted. From the desired signal features, the calibration signal feature segments that match the unwanted signal features are obtained, and the signal segments corresponding to the calibration signal feature segments in the candidate desired signal are used as calibration redundant signals in the candidate desired signal.
[0093] In this embodiment of the disclosure, the target undesirable signal and the candidate desired signal can be processed by the signal feature extraction algorithm in the related technology, and then the signal features of the target undesirable signal extracted by the algorithm are determined as undesirable signal features, and the signal features of the candidate desired signal are determined as desired signal features.
[0094] In some possible implementations, based on the feature segment matching degree algorithm in related technologies, the feature segments included in the undesired signal features and the desired signal features can be processed by the algorithm. Then, from the feature segments included in the desired signal features, some feature segments with a matching degree greater than or equal to a preset reference matching degree can be selected. These feature segments can be used as the signal feature segments calibrated by the undesired signal features in the desired signal features, that is, the calibrated signal feature segments.
[0095] In this scenario, the signal segment corresponding to the feature segment of the calibration signal can be obtained from the expected signal. This signal segment can then be identified as the calibration redundancy signal calibrated by the target non-expected signal in the candidate expected signal.
[0096] In some possible implementations, the candidate desired signal is filtered based on the calibration redundancy signal to obtain the target desired signal after the candidate desired signal is enhanced.
[0097] In this embodiment of the disclosure, the calibration redundancy signal in the candidate expectation signal can be filtered out based on the filtering method in the related technology to obtain the retained part of the candidate expectation signal. The retained part of the signal can be determined as the target expectation signal after the candidate expectation signal is enhanced.
[0098] As an example, it can be achieved through Figure 4 The post-filtering module shown calibrates the redundant part of the candidate desired signal in the input post-filtering module based on the target undesired signal, thereby obtaining the calibrated redundant signal in the candidate desired signal.
[0099] And, through Figure 4 The filtering algorithm deployed by the post-filtering module shown filters out the calibration redundancy signal in the candidate desired signal, thereby obtaining the enhanced target desired signal.
[0100] It should be noted that the filtering algorithm for filtering candidate desired signals based on target undesired signals can be derived from Wiener filtering algorithm in related technologies, or from other filtering algorithms; no specific limitation is made here.
[0101] It should be noted that this disclosure does not impose any restrictions on the execution sequence of steps S201 to S206. Figure 2 The example only demonstrates the sequential execution of steps S201 to S206.
[0102] The signal enhancement method proposed in this disclosure divides the signal acquisition space into regions based on the signal pickup point and the included angle of the region division. This improves the positioning accuracy of the regions where desired and unwanted signal sources are located within the signal acquisition space. By dividing the desired signal and unwanted signal into a first target region and a second target region within the signal acquisition space, the recognition accuracy of the desired signal is improved, thereby enhancing the accuracy of downstream signal enhancement tasks. Based on the desired signal in the first target region, the desired signal is filtered using the desired signal in the second target region to obtain the desired signal. This improves the signal-to-noise ratio of the desired signal, reduces the influence of the unwanted signal in the second target region on the desired signal in the first target region, and enhances the practicality and applicability of the signal enhancement method for the desired signal. It also improves the signal quality of the desired signal. In video recording scenarios, it improves the image and audio quality in the video obtained based on the desired signal, optimizing the user's recording experience.
[0103] Corresponding to the signal enhancement methods proposed in the above embodiments, one embodiment of this disclosure also proposes a signal enhancement device. Since the signal enhancement device proposed in this disclosure corresponds to the signal enhancement methods proposed in the above embodiments, the implementation methods of the above signal enhancement methods are also applicable to the signal enhancement device proposed in this disclosure, and will not be described in detail in the following embodiments.
[0104] Figure 5 This is a schematic diagram of the structure of a signal enhancement device according to an embodiment of the present disclosure, as shown below. Figure 5 As shown, the signal enhancement device 500 includes a division module 51, a determination module 52, an acquisition module 53, and a filtering module 54, wherein:
[0105] The partitioning module 51 is used to partition the signal acquisition space where the signal pickup point is located based on the signal pickup point and the included angle of the partitioning, so as to obtain a set of candidate partitioning regions after partitioning.
[0106] The determining module 52 is used to determine, from the candidate partitioning region set, a first target region where the desired signal source is located and a second target region where the undesired signal source is located, wherein the second target region is the sum of all remaining candidate partitioning regions in the candidate partitioning region set, excluding the first target region where the desired signal source is located;
[0107] The acquisition module 53 is used to acquire the candidate expected signal corresponding to the first target region and the target undesired signal of the second target region;
[0108] The filtering module 54 is used to filter the candidate desired signal based on the target undesired signal to obtain the target desired signal after the candidate desired signal is enhanced.
[0109] In this embodiment of the disclosure, the acquisition module 53 is further configured to: acquire the spatial input signal picked up in the signal acquisition space; acquire the first spatial filtering weight coefficient corresponding to the first target region, and acquire the second spatial filtering weight coefficient of the second target region; obtain the candidate desired signal corresponding to the first target region based on the first spatial filtering weight coefficient and the spatial input signal; and obtain the target undesired signal corresponding to the second target region based on the second spatial filtering weight coefficient and the spatial input signal.
[0110] In this embodiment of the disclosure, the acquisition module 53 is further configured to: acquire the input signal covariance matrix corresponding to the spatial input signal; acquire the first signal steering vector of the initial signal corresponding to the first target region, and obtain the first spatial filtering weight coefficient corresponding to the first target region based on the first signal steering vector and the input signal covariance matrix; acquire the second signal steering vector of the initial undesired signal of each undesired sub-region in the second target region, and obtain the second spatial filtering weight coefficient of each undesired sub-region in the second target region based on the second signal steering vector and the input signal covariance matrix.
[0111] In this embodiment of the disclosure, the acquisition module 53 is further configured to: filter the spatial input signal based on the first spatial filtering weight coefficient to obtain the candidate desired signal.
[0112] In this embodiment of the disclosure, the acquisition module 53 is further configured to: filter the spatial input signal based on the second spatial filtering weight coefficient of the undesired sub-region for any undesired sub-region of the second target region to obtain the candidate undesired signal of the undesired sub-region; and superimpose the candidate undesired signals of each undesired sub-region within the second target region to obtain the target undesired signal of the second target region.
[0113] In this embodiment of the disclosure, the acquisition module 53 is further configured to: acquire the acquisition input signal picked up in the signal acquisition space, and perform short-time Fourier transform processing on the acquisition input signal to obtain the spatial input signal of the signal acquisition space.
[0114] In this embodiment of the disclosure, the filtering module 54 is further configured to: calibrate the candidate desired signal based on the target undesired signal to obtain the calibration redundancy signal in the candidate desired signal; and filter the candidate desired signal based on the calibration redundancy signal to obtain the target desired signal after the candidate desired signal is enhanced.
[0115] In this embodiment of the disclosure, the filtering module 54 is further configured to: extract the unwanted signal features of the target unwanted signal and the desired signal features of the candidate desired signal; obtain the calibration signal feature segment matching the unwanted signal features from the selected desired signal features, and use the signal segment corresponding to the calibration signal feature segment in the candidate desired signal as the calibration redundant signal in the candidate desired signal.
[0116] In this embodiment of the disclosure, the partitioning module 51 is further configured to: take the signal pickup point as the origin of the signal acquisition space, and obtain each region partitioning ray with the signal pickup point as the endpoint based on the region partitioning angle; and partition the signal acquisition space based on each region partitioning ray to obtain a set of candidate partitioning regions in the signal acquisition space.
[0117] In this embodiment of the disclosure, the partitioning module 51 is further configured to: determine the first target region to which the desired signal source belongs from the candidate partitioning region set; determine each of the remaining candidate partitioning regions in the candidate partitioning region set other than the first target region as each of the undesired sub-regions where the undesired signal source is located, and integrate each of the undesired sub-regions to obtain the second target region where the undesired signal source is located.
[0118] The signal enhancement device proposed in this disclosure divides the signal acquisition space into regions based on the signal pickup point and the included angle of the region division. This improves the positioning accuracy of the respective regions where desired and unwanted signal sources are located within the signal acquisition space. By dividing the desired signal and unwanted signal into a first target region and a second target region within the signal acquisition space, the recognition accuracy of the desired signal is improved, thereby enhancing the accuracy of downstream signal enhancement tasks. Based on the desired signal in the first target region, the desired signal is filtered using the desired signal in the second target region to obtain the desired signal. This improves the signal-to-noise ratio of the desired signal, reduces the influence of the unwanted signal in the second target region on the desired signal in the first target region, enhances the practicality and applicability of the signal enhancement method for the desired signal, and improves the signal quality of the desired signal. In video recording scenarios, this improves the image and audio quality in the video obtained based on the desired signal, optimizing the user's recording experience.
[0119] To achieve the above embodiments, this disclosure also proposes a vehicle capable of performing the signal enhancement method provided in the above embodiments.
[0120] To achieve the above embodiments, this disclosure also provides an electronic device, a computer-readable storage medium, and a computer program product.
[0121] Figure 6 This is a block diagram of an electronic device 600 according to an embodiment of the present disclosure, as follows: Figure 6 As shown, the electronic device 600 includes a memory 601, a processor 602, and a computer program stored in the memory 601 and executable on the processor 602. When the processor 602 executes program instructions, it implements the signal enhancement method provided in the above embodiments.
[0122] To implement the above embodiments, this disclosure also proposes a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the signal enhancement method provided in the above embodiments.
[0123] To implement the above embodiments, this disclosure also proposes a computer program product on which a computer program is stored, wherein when the computer program is executed by a processor, it implements the signal enhancement method provided in the above embodiments.
[0124] To implement the above embodiments, this disclosure also proposes a chip, including one or more interface circuits and one or more processors; the interface circuits are used to receive signals and send the signals to the processors, the signals including computer instructions stored in a memory, and when the processor executes the computer instructions, the chip causes the chip to execute the signal enhancement method provided in the above embodiments.
[0125] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.
[0126] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "multiple" means at least two, such as two, three, etc., unless otherwise explicitly specified.
[0127] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.
[0128] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-including system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and compact disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.
[0129] It should be understood that various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (FPGAs), field-programmable gate arrays (FPGAs), etc.
[0130] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.
[0131] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.
[0132] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.
[0133] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.
[0134] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.
Claims
1. A signal enhancement method, characterized in that, The method includes: Based on the signal pickup point and the included angle of the region division, the signal acquisition space where the signal pickup point is located is divided into regions to obtain a set of candidate regions after division. From the candidate region set, a first target region where the desired signal source is located and a second target region where the undesired signal source is located are determined, wherein the second target region is the sum of all remaining candidate regions in the candidate region set, excluding the first target region where the desired signal source is located; Obtain the candidate desired signal corresponding to the first target region, and the target undesired signal of the second target region; The candidate desired signal is filtered based on the target undesired signal to obtain the target desired signal enhanced by the candidate desired signal; The step of obtaining the candidate desired signal corresponding to the first target region and the target undesired signal of the second target region includes: Acquire the spatial input signal picked up in the signal acquisition space; Obtain the first spatial filter weight coefficient corresponding to the first target region, and obtain the second spatial filter weight coefficient of the second target region; Based on the first spatial filtering weight coefficients and the spatial input signal, the candidate expected signal corresponding to the first target region is obtained; Based on the second spatial filtering weight coefficient and the spatial input signal, the target undesired signal corresponding to the second target region is obtained.
2. The method according to claim 1, characterized in that, The step of obtaining the first spatial filter weight coefficient corresponding to the first target region and obtaining the second spatial filter weight coefficient of the second target region includes: Obtain the input signal covariance matrix corresponding to the spatial input signal; Obtain the first signal steering vector of the initial signal corresponding to the first target region, and obtain the first spatial filter weight coefficient corresponding to the first target region based on the first signal steering vector and the input signal covariance matrix; Obtain the second signal steering vector of the initial unwanted signal of each unwanted sub-region in the second target region, and obtain the second spatial filter weight coefficient of each unwanted sub-region in the second target region based on the second signal steering vector and the input signal covariance matrix.
3. The method according to claim 1, characterized in that, The step of obtaining the candidate expected signal corresponding to the first target region based on the first spatial filter weight coefficient and the spatial input signal includes: The spatial input signal is filtered based on the first spatial filtering weight coefficient to obtain the candidate desired signal.
4. The method according to claim 3, characterized in that, The step of obtaining the target undesired signal corresponding to the second target region based on the second spatial filter weight coefficients and the spatial input signal includes: For any unwanted sub-region of the second target region, the spatial input signal is filtered based on the second spatial filtering weight coefficient of the unwanted sub-region to obtain the candidate unwanted signal of the unwanted sub-region; The candidate unwanted signals of each unwanted sub-region within the second target region are superimposed to obtain the target unwanted signal of the second target region.
5. The method according to claim 1, characterized in that, The acquisition of the spatial input signal picked up in the signal acquisition space includes: The acquisition input signal picked up within the signal acquisition space is acquired, and the acquisition input signal is processed by short-time Fourier transform to obtain the spatial input signal of the signal acquisition space.
6. The method according to any one of claims 1-5, characterized in that, The step of filtering the candidate desired signal based on the target undesired signal to obtain the enhanced target desired signal includes: Based on the target undesired signal, the candidate desired signal is calibrated to obtain the calibration redundancy signal in the candidate desired signal; The candidate desired signal is filtered based on the calibration redundancy signal to obtain the target desired signal after the candidate desired signal is enhanced.
7. The method according to claim 6, characterized in that, The step of calibrating the candidate desired signal based on the target undesired signal to obtain the calibration redundancy signal in the candidate desired signal includes: Extract the unwanted signal features of the target unwanted signal and the desired signal features of the candidate desired signal; From the desired signal features, obtain the calibration signal feature segment that matches the undesired signal features, and take the signal segment corresponding to the calibration signal feature segment in the candidate desired signal as the calibration redundancy signal in the candidate desired signal.
8. The method according to claim 1, characterized in that, The signal acquisition space where the signal pickup point is located is divided into regions based on the signal pickup point and the included angle of the region division, resulting in a set of candidate regions after division, including: Using the signal pickup point as the origin of the signal acquisition space, and based on the included angle of the region division, ray divisions of each region with the signal pickup point as the endpoint are obtained. The signal acquisition space is divided into regions based on the region division rays described above, resulting in a set of candidate division regions within the signal acquisition space.
9. The method according to claim 1, characterized in that, The step of determining the first target region where the desired signal source is located and the second target region where the undesired signal source is located from the candidate region set, wherein the second target region is the sum of all remaining candidate regions in the candidate region set excluding the first target region where the desired signal source is located, includes: From the set of candidate regions, determine the first target region to which the desired signal source belongs; The remaining candidate regions in the candidate region set, excluding the first target region, are determined as the unwanted sub-regions where the unwanted signal source is located, and the unwanted sub-regions are integrated to obtain the second target region where the unwanted signal source is located.
10. A signal enhancement device, characterized in that, The device includes: The partitioning module is used to partition the signal acquisition space where the signal pickup point is located based on the signal pickup point and the included angle of the partitioning, so as to obtain a set of candidate partitioning regions after partitioning. The determining module is used to determine, from the candidate partitioning region set, a first target region where the desired signal source is located and a second target region where the undesired signal source is located, wherein the second target region is the sum of all remaining candidate partitioning regions in the candidate partitioning region set, excluding the first target region where the desired signal source is located; The acquisition module is used to acquire the candidate desired signal corresponding to the first target region and the target undesired signal of the second target region; A filtering module is used to filter the candidate desired signal based on the target undesired signal to obtain the target desired signal enhanced by the candidate desired signal; The acquisition module is also used for: Acquire the spatial input signal picked up in the signal acquisition space; Obtain the first spatial filter weight coefficient corresponding to the first target region, and obtain the second spatial filter weight coefficient of the second target region; Based on the first spatial filtering weight coefficients and the spatial input signal, the candidate expected signal corresponding to the first target region is obtained; Based on the second spatial filtering weight coefficient and the spatial input signal, the target undesired signal corresponding to the second target region is obtained.
11. The apparatus according to claim 10, characterized in that, The acquisition module is also used for: Obtain the input signal covariance matrix corresponding to the spatial input signal; Obtain the first signal steering vector of the initial signal corresponding to the first target region, and obtain the first spatial filter weight coefficient corresponding to the first target region based on the first signal steering vector and the input signal covariance matrix; Obtain the second signal steering vector of the initial unwanted signal of each unwanted sub-region in the second target region, and obtain the second spatial filter weight coefficient of each unwanted sub-region in the second target region based on the second signal steering vector and the input signal covariance matrix.
12. The apparatus according to claim 10, characterized in that, The acquisition module is also used for: The spatial input signal is filtered based on the first spatial filtering weight coefficient to obtain the candidate desired signal.
13. The apparatus according to claim 12, characterized in that, The acquisition module is also used for: For any unwanted sub-region of the second target region, the spatial input signal is filtered based on the second spatial filtering weight coefficient of the unwanted sub-region to obtain the candidate unwanted signal of the unwanted sub-region; The candidate unwanted signals of each unwanted sub-region within the second target region are superimposed to obtain the target unwanted signal of the second target region.
14. The apparatus according to claim 10, characterized in that, The partitioning module is also used for: Using the signal pickup point as the origin of the signal acquisition space, and based on the included angle of the region division, ray divisions of each region with the signal pickup point as the endpoint are obtained. The signal acquisition space is divided into regions based on the region division rays described above, resulting in a set of candidate division regions within the signal acquisition space.
15. A vehicle, characterized in that, The vehicle may include the device as described in any one of claims 10-14.
16. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute instructions to implement the method as described in any one of claims 1-9.
17. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is able to perform the method as described in any one of claims 1-9.
18. A chip, characterized in that, The device includes one or more interface circuits and one or more processors; the interface circuits are used to receive signals and send the signals to the processors, the signals including computer instructions stored in a memory, which, when executed by the processor, cause the chip to perform the steps of the method according to any one of claims 1-9.