Sound wave propagation spatial distribution and sound source position control method

Abstract

The invention provides a sound wave propagation spatial distribution and sound source position control method, and relates to the technical field of loudspeaker control, and the method comprises the steps: building an analysis control model based on a sound source and a propagation auxiliary object; constructing a first area of sound wave propagation of the sound source in the analysis control model, and marking a second area of spatial distribution of sound wave propagation of the current sound source; mapping the target position to an analysis control model to generate a mapping point location; when the mapping point is in the second area or the mapping point is not in any first area, the sound source position is not controlled; and when the mapping point location is not in the second area but is in any first area, determining a target sound source in the first area, and determining a sound source position control parameter based on the control library correspondingly associated with the target sound source and the mapping point location. According to the sound wave propagation spatial distribution and sound source position control method, sound delivery is carried out according to the position of a film viewer, and the viewing experience of the film viewer is guaranteed.

Description

Technical Field

[0001] This invention relates to the field of sound field control technology, and in particular to a method for controlling the spatial distribution of sound wave propagation and the location of sound sources. Background Technology

[0002] Currently, LED cinema screens, due to their fully enclosed enclosures, have almost no sound transmission. This prevents the main speaker system from being installed behind the screen in the traditional way; instead, it must be deployed around the perimeter of the LED projection screen. This results in technical problems such as excessive sound image deviation from the main picture and poor sound quality. Installing directional speakers behind the display screen, using the LED wall as a reflector to reflect sound waves, can achieve a certain degree of audio-visual synchronization and better sound quality. However, because the sound propagation of directional speakers is directional and convergent, there is an urgent need for a method to control the spatial distribution of sound wave propagation and the location of the sound source, enabling sound projection based on the viewer's position to ensure a better viewing experience. Summary of the Invention

[0003] One of the objectives of this invention is to provide a method for controlling the spatial distribution of sound wave propagation and the location of sound sources, so as to deliver sound according to the location of the viewers, thereby forming an immersive sound field for the target and ensuring the viewing experience of the viewers.

[0004] This invention provides a method for controlling the spatial distribution of sound wave propagation and the location of sound sources, comprising: An analysis and control model is constructed based on the sound source and propagation aids. In the analysis and control model, a first region of sound wave propagation of the sound source is constructed, and a second region of the spatial distribution of sound wave propagation of the current sound source is marked. The target location is mapped to the analysis and control model to generate mapping points; When the mapping point is located in the second region or is not located in any of the first regions, the sound source location is not controlled. When the mapping point is not in the second region but in any of the first regions, the target sound source is determined by the first region in which it is located, and the sound source position control parameters are determined based on the control library and mapping point associated with the target sound source.

[0005] Preferably, the sound source includes at least one directional loudspeaker; the propagation aid includes a display screen; The directional speaker is positioned in front of the display screen near the bottom.

[0006] Preferably, the position adjustment device includes: an electrically controlled telescopic mechanism and a dual-axis gimbal disposed at the end of the electrically controlled telescopic mechanism; a directional speaker is disposed on the dual-axis gimbal.

[0007] Preferably, the steps for constructing the analytical control model are as follows: Based on the usage scenario where the sound source is located, construct a scenario model space; Based on the parameters of the sound source and the propagation aids, the corresponding components are retrieved from the pre-configured component library; Based on the location data of the sound source and propagation aids, the retrieved components are placed into the scene model space to obtain the analysis and control model.

[0008] Preferably, the second region includes the area covered by the sound wave propagation after the sound source emits a sound wave in the current state; the first region includes the sum of the areas covered by the sound wave propagation after the sound source emits a sound wave in all states.

[0009] Preferably, the steps for determining the target location are as follows: Images are obtained by photographing the associated region of the sound source; Image analysis is used to determine the relative positional relationship between the target and the imaging device; The target position is determined based on the initial position and relative positional relationship of the shooting device.

[0010] Preferably, the target sound source is determined based on the first region where it is located, and the sound source location control parameters are determined based on the control library and mapping points associated with the target sound source, including: When there is only one target in the first region and there are no other targets in the first region, the target parameters of the sound source location are obtained by querying the control library with the identification code of the grid where the mapping point is located. The control parameters are determined based on the target parameters and the current parameters of the sound source location.

[0011] Preferably, the target sound source is determined based on the first region where it is located, and the sound source location control parameters are determined based on the control library and mapping points associated with the target sound source, including: When there are other targets within a first region, the location grid is determined by mapping the grid where the point is located and the grids where other targets are located. Based on the identification code of the positioning grid, the target parameters of the sound source location are obtained by querying the control library; The control parameters are determined based on the target parameters and the current parameters of the sound source location.

[0012] Preferably, the target sound source is determined based on the first region where it is located, and the sound source location control parameters are determined based on the control library and mapping points associated with the target sound source, including: When the control terminal is in the first region corresponding to multiple sound sources, it determines whether there are other targets in each first region; When there is only one first region without other targets, the sound source corresponding to the first region without other targets is taken as the target sound source; when there are multiple first regions without other targets, the sound source corresponding to the one with the smallest lateral distance from the mapping point to the central axis of the corresponding second region is taken as the target sound. The target parameters of the sound source location are obtained by querying the control library corresponding to the grid where the mapping point is located using the identification code of the grid. The control parameters are determined based on the target parameters and the current parameters of the sound source location.

[0013] Other features and advantages of the invention will be set forth in the following description, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the written description and the accompanying drawings.

[0014] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0015] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings: Figure 1 This is a schematic diagram of a method for controlling the spatial distribution of sound wave propagation and the location of sound sources in an embodiment of the present invention; Figure 2 This is a cross-sectional schematic diagram in the vertical direction of a device for propagating sound waves after reflection, according to an embodiment of the present invention. Figure 3 This is a schematic diagram of another method for controlling the spatial distribution of sound wave propagation and the location of the sound source in an embodiment of the present invention; Figure 4 This is a cross-sectional schematic diagram in the horizontal direction of a device for propagating sound waves after reflection, as described in another embodiment of the present invention. Figure 5 This is a cross-sectional schematic diagram in the vertical direction of a device for propagating sound waves after reflection, as described in another embodiment of the present invention. Figure 6 This is a schematic diagram of the position adjustment device in an embodiment of the present invention; Figure 7 This is a schematic diagram of a segmentation network for sound sources in an unobstructed propagation scenario. Figure 8 This is a schematic diagram of a segmentation network for a sound source in a reflection scenario. Detailed Implementation

[0016] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.

[0017] Example 1: This embodiment of the invention provides a method for controlling the spatial distribution of sound wave propagation and the location of sound sources, such as... Figure 1 As shown, it includes: Step S1: Construct an analysis and control model based on the sound source and propagation aids; Step S2: Construct the first region of sound wave propagation of the sound source in the analysis and control model and mark the second region of the spatial distribution of sound wave propagation of the current sound source; Step S3: Map the target location to the analysis and control model to generate mapping points; Step S4: When the mapping point is in the second region or the mapping point is not in any of the first regions, the sound source position is not controlled; Step S5: When the mapping point is not in the second region but in any of the first regions, determine the target sound source based on the first region and determine the sound source position control parameters based on the control library and mapping point associated with the target sound source.

[0018] The sound source includes at least one directional loudspeaker; the propagation aids include: a display screen; The directional speaker is positioned in front of the display screen near the bottom.

[0019] The position adjustment device includes: an electrically controlled telescopic mechanism and a dual-axis gimbal mounted at the end of the electrically controlled telescopic mechanism; a directional speaker is mounted on the dual-axis gimbal.

[0020] The steps for constructing the analysis and control model are as follows: Based on the usage scenario where the sound source is located, construct a scenario model space; Based on the parameters of the sound source and the propagation aids, the corresponding components are retrieved from the pre-configured component library; Based on the location data of the sound source and propagation aids, the retrieved components are placed into the scene model space to obtain the analysis and control model.

[0021] The second region includes the area covered by the sound waves emitted by the sound source in the current state; the first region includes the sum of the areas covered by the sound waves emitted by the sound source in all states.

[0022] The steps for determining the target location are as follows: Images are obtained by photographing the associated region of the sound source; Image analysis is used to determine the relative positional relationship between the target and the imaging device; The target position is determined based on the initial position and relative positional relationship of the shooting device.

[0023] The target sound source is identified based on the first region it is located in, and the sound source location control parameters are determined based on the control library and mapping points associated with the target sound source, including: When there is only one target in the first region and there are no other targets in the first region, the target parameters of the sound source location are obtained by querying the control library with the identification code of the grid where the mapping point is located. The control parameters are determined based on the target parameters and the current parameters of the sound source location.

[0024] The target sound source is identified based on the first region it is located in, and the sound source location control parameters are determined based on the control library and mapping points associated with the target sound source, including: When there are other targets within a first region, the location grid is determined by mapping the grid where the point is located and the grids where other targets are located. Based on the identification code of the positioning grid, the target parameters of the sound source location are obtained by querying the control library; The control parameters are determined based on the target parameters and the current parameters of the sound source location.

[0025] The target sound source is identified based on the first region it is located in, and the sound source location control parameters are determined based on the control library and mapping points associated with the target sound source, including: When the control terminal is in the first region corresponding to multiple sound sources, it determines whether there are other targets in each first region; When there is only one first region without other targets, the sound source corresponding to the first region without other targets is taken as the target sound source; when there are multiple first regions without other targets, the sound source corresponding to the one with the smallest lateral distance from the mapping point to the central axis of the corresponding second region is taken as the target sound. The target parameters of the sound source location are obtained by querying the control library corresponding to the grid where the mapping point is located using the identification code of the grid. The control parameters are determined based on the target parameters and the current parameters of the sound source location.

[0026] This embodiment is mainly applied in cinema settings, such as... Figure 2 As shown, there is a display screen 1 in front of the tiered seats in the cinema, and a directional speaker 13 located in front of the lower part of the display screen. The sound waves emitted by the directional speaker 13 are reflected by the display screen 1 to the position of the people in the scene on the tiered seats. Furthermore, by determining the position of the people in the scene, the position of the directional speaker 13 emitted to the display screen 1 can be adjusted based on the determined position, thereby achieving accurate sound delivery.

[0027] Example 2: This embodiment of the invention provides a method for controlling the spatial distribution of sound wave propagation and the location of sound sources, such as... Figure 3 As shown, it includes: Step 1: Construct an analysis and control model based on the sound source, propagation interference objects, and propagation aids; First, an analysis and control model is constructed based on the analysis of the sound source, propagation interference, and propagation aids. This model controls the sound source location based on the analysis of the actual situation. The construction steps of the analysis and control model are as follows: 1. Construct a scene model space based on the usage scenario where the sound source is located; 2. Retrieve corresponding components from a pre-configured component library based on the parameters of the sound source, propagation interference, and propagation aids; 3. Place the retrieved components into the scene model space based on the positioning data of the sound source, propagation interference, and propagation aids to obtain the analysis and control model. Step 2: Construct the first region of sound wave propagation of the sound source in the analysis and control model, and mark the second region of the spatial distribution of sound wave propagation of the current sound source. The second region includes the area covered by the sound waves emitted by the sound source in the current state; the first region includes the sum of the areas covered by the sound waves emitted by the sound source in all states. The second region represents the propagation area of ​​the sound waves emitted by the sound source in the current state, that is, the area where people in the second region can currently receive the sound emitted by the sound source; the first region represents the area where the sound waves emitted by the sound source can propagate by controlling the position of the sound source, and the second region is usually included within the first region. Step 3: Map the target location to the analysis and control model to generate mapping points; Step three, mapping, involves mapping the target location of the object to which the sound is to be projected in the usage scenario to the analysis and control model, facilitating the analysis of sound source location control. The most crucial aspect of mapping is determining the reference point. Different reference points can be used depending on how the object (target) is determined. For example, in image capture analysis, the location of the image acquisition device in the usage scenario and the corresponding reference point pre-determined in the analysis and control model can be used. In this case, the steps for determining the target location are as follows: First, capture images of the associated region of the sound source; second, analyze the images to determine the relative positional relationship between the target and the capturing device; third, determine the target location based on the initial position configured on the capturing device and the relative positional relationship. Step 4: When the mapping point is located in the second region or is not located in any of the first regions, the sound source location is not controlled. The mapping point being in the second area indicates that the object can receive the sound from the sound source at this time; while the control terminal not being in any of the first areas indicates that the object is not in any location where the sound source can project sound. That is, no matter how the position of the sound source is controlled, the object will not receive the sound from the sound source. In these two cases, there is no need or necessity to control the position of the sound source. Step 5: When the mapping point is not in the second region but in any of the first regions, determine the target sound source based on the first region it is in and determine the sound source location control parameters based on the control library and mapping point associated with the target sound source.

[0028] The system includes multiple control libraries, each corresponding to a sound source. When deploying for use scenarios, the control libraries are built based on manual testing and analysis. The control libraries can query the target parameters of the sound source by the location of the object. Guided by the target parameters and the current parameters, the control parameters are determined, and then the corresponding sound source position is adjusted. The spatial distribution of sound wave propagation and sound source location control method of the present invention, based on a pre-constructed control analysis module, maps the location of the object (viewer) to the model to determine the mapping point, analyzes the target parameters of the sound source by comprehensively analyzing the mapping point and the control library corresponding to the sound source, and then combines the current parameters to control and adjust the sound position so that the viewer's location can receive the sound projected by the sound source, thereby realizing sound projection based on the viewer's location and ensuring the viewer's viewing experience.

[0029] Example 3: This embodiment of the invention provides a method for controlling the spatial distribution of sound wave propagation and the location of sound sources, including: An analysis and control model is constructed based on the sound source, the interference object, and the propagation aid. In the analysis and control model, a first region of sound wave propagation of the sound source is constructed, and a second region of the spatial distribution of sound wave propagation of the current sound source is marked. The target location is mapped to the analysis and control model to generate mapping points; When the mapping point is located in the second region or is not located in any of the first regions, the sound source location is not controlled. When the mapping point is not in the second region but in any of the first regions, the target sound source is determined by the first region in which it is located, and the sound source position control parameters are determined based on the control library and mapping point associated with the target sound source.

[0030] Among them, such as Figures 4 to 6 As shown, the sound source includes at least one directional speaker 13; the propagation interference includes: display screen 1; the propagation aid includes: background wall 2; in this embodiment, since the directional speaker 13 is placed behind the display screen 1, the display screen 1 is the propagation interference; while the background wall 2 is the propagation aid. The display screen 1 is positioned in front of the background wall 2 and the two are at a preset distance apart; the directional speaker 13 is positioned between the display screen 1 and the background wall 2 and is fixedly connected to the back of the display screen 1 through a position adjustment device.

[0031] The position adjustment device includes: an electrically controlled telescopic mechanism 11 and a dual-axis gimbal 12 disposed at the end of the electrically controlled telescopic mechanism 11; a directional speaker 13 is disposed on the dual-axis gimbal 12.

[0032] An arc-shaped curved surface 4 is provided on the background wall 2 above and / or on both sides of the display screen 1.

[0033] The steps for constructing the analysis and control model are as follows: Based on the usage scenario where the sound source is located, a scene model space is constructed; that is, a hemispherical space with a preset radius around the directional speaker, display screen and background wall is used as the usage scenario, and each object in the scenario is modeled and placed into the pre-configured initial model space to obtain the scene model space. Based on the parameters of the sound source, the interference object, and the propagation aid, the corresponding component is retrieved from the pre-configured component library; the parameters include: size, whether it is movable, and the range of movable parts; among which, the movable parts include horizontal movement and / or rotation. Based on the location data of the sound source, propagation interference objects, and propagation aids, the retrieved components are placed into the scene model space to obtain the analysis and control model. The location data includes: the location within the usage scenario and the relative positional relationships between the sound source and / or propagation interference objects and propagation aids; The second region includes the area covered by the sound wave propagating after the sound source emits a sound wave in the current state; the first region includes the sum of the areas covered by the sound wave propagating after the sound source emits a sound wave in all states.

[0034] Example 4: This embodiment of the invention provides a method for controlling the spatial distribution of sound wave propagation and the location of sound sources, including: An analysis and control model is constructed based on the sound source, the interference object, and the propagation aid. In the analysis and control model, a first region of sound wave propagation of the sound source is constructed, and a second region of the spatial distribution of sound wave propagation of the current sound source is marked. The target location is mapped to the analysis and control model to generate mapping points; When the mapping point is located in the second region or is not located in any of the first regions, the sound source location is not controlled. When the mapping point is not in the second region but in any of the first regions, the target sound source is determined by the first region in which it is located, and the sound source position control parameters are determined based on the control library and mapping point associated with the target sound source.

[0035] Before adjusting the location of the sound source, it is necessary to accurately determine the target location. The steps for determining the target location are as follows: Images are obtained by photographing the associated region of the sound source; Image analysis is used to determine the relative positional relationship between the target and the imaging device; The target position is determined based on the initial position and relative positional relationship of the shooting device.

[0036] To determine the control parameters, the target sound source is identified within the first region, and the sound source location control parameters are determined based on the control library and mapping points associated with the target sound source. This includes: When there is only one target in the first region and there are no other targets in the first region, the target parameters of the sound source location are obtained by querying the control library with the identification code of the grid where the mapping point is located. The control parameters are determined based on the target parameters and the current parameters of the sound source location.

[0037] And / or, When there are other targets within a first region, the location grid is determined by mapping the grid where the point is located and the grids where other targets are located. Based on the identification code of the positioning grid, the target parameters of the sound source location are obtained by querying the control library; The control parameters are determined based on the target parameters and the current parameters of the sound source location.

[0038] And / or, When the control terminal is in the first region corresponding to multiple sound sources, it determines whether there are other targets in each first region; When there is only one first region without other targets, the sound source corresponding to the first region without other targets is taken as the target sound source; when there are multiple first regions without other targets, the sound source corresponding to the one with the smallest lateral distance from the mapping point to the central axis of the corresponding second region is taken as the target sound. The target parameters of the sound source location are obtained by querying the control library corresponding to the grid where the mapping point is located using the identification code of the grid. The control parameters are determined based on the target parameters and the current parameters of the sound source location.

[0039] The central axis is a ray formed by connecting the center points of line segments that connect the points where audio signals arrive at the sound source at the same time along the direction of sound wave propagation. For the first region segmentation step, the central axes are obtained by adjusting the sound source position (equal angle step or equal length step), and sampling points are performed at equal intervals along these central axes to obtain sampling points. These sampling points are then connected laterally. The lateral line segments formed by these lateral connections, together with the central axes, form a segmentation network to segment the first region. The lateral distance from the mapped point to the corresponding central axis of the second region refers to the number of grid cells required for the grid containing the mapped point to move laterally to the side of the central axis. Figure 7 The diagram shows a segmentation network for a sound source in an unobstructed environment during propagation. Adjusting the sound source position to two extreme positions yields two extreme edges 23 for sound wave propagation. Central axes 22 are obtained by adjusting the sound source position at these extreme positions (using equal angular or equal length steps). Equidistant sampling points are then performed along these central axes to obtain sampling points. These sampling points are then horizontally connected. The horizontal line segments formed by these connections, along with the central axes, create a segmentation network that divides the first region, resulting in individual grids 21. Figure 8 As shown, this is a schematic diagram of the segmentation network of a sound source in a reflection scenario. After the sound source position is adjusted to two extreme positions, the sound wave can be emitted through the reflective surface to obtain two extreme edges 23. By adjusting the sound source position at the two extreme positions (equal angle step or equal length step), and then reflecting through the reflective surface, each central axis 22 is obtained. Equal distance points are sampled on the central axis to obtain sampling points. The sampling points are connected laterally. The horizontal line segments formed by the horizontal connection and each central axis form a segmentation network to segment the first region, which can obtain individual grids 21.

[0040] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A method for controlling the spatial distribution of sound wave propagation and the location of sound sources, characterized in that, include: An analysis and control model is constructed based on the sound source and propagation aids. In the analysis and control model, a first region of sound wave propagation of the sound source is constructed, and a second region of the spatial distribution of sound wave propagation of the current sound source is marked. The target location is mapped to the analysis and control model to generate mapping points; When the mapping point is located in the second region or is not located in any of the first regions, the sound source location is not controlled. When the mapping point is not in the second region but in any of the first regions, the target sound source is determined by the first region in which it is located, and the sound source position control parameters are determined based on the control library and mapping point associated with the target sound source.

2. The method for controlling the spatial distribution of sound wave propagation and the location of the sound source as described in claim 1, characterized in that, The sound source includes at least one directional loudspeaker; the propagation aids include: a display screen; The directional speaker is positioned in front of the display screen near the bottom.

3. The method for controlling the spatial distribution of sound wave propagation and the location of the sound source as described in claim 2, characterized in that, The position adjustment device includes: an electrically controlled telescopic mechanism and a dual-axis gimbal mounted at the end of the electrically controlled telescopic mechanism; a directional speaker is mounted on the dual-axis gimbal.

4. The method for controlling the spatial distribution of sound wave propagation and the location of the sound source as described in claim 1, characterized in that, The steps for constructing the analysis and control model are as follows: Based on the usage scenario where the sound source is located, construct a scenario model space; Based on the parameters of the sound source and the propagation aids, the corresponding components are retrieved from the pre-configured component library; Based on the location data of the sound source and propagation aids, the retrieved components are placed into the scene model space to obtain the analysis and control model.

5. The method for controlling the spatial distribution of sound wave propagation and the location of the sound source as described in claim 1, characterized in that, The second region includes the area covered by the sound waves emitted by the sound source in the current state; the first region includes the sum of the areas covered by the sound waves emitted by the sound source in all states.

6. The method for controlling the spatial distribution of sound wave propagation and the location of the sound source as described in claim 4, characterized in that, The steps for determining the target location are as follows: Images are obtained by photographing the associated region of the sound source; Image analysis is used to determine the relative positional relationship between the target and the imaging device; The target position is determined based on the initial position and relative positional relationship of the shooting device.

7. The method for controlling the spatial distribution of sound wave propagation and the location of the sound source as described in claim 4, characterized in that, The target sound source is identified based on the first region it is located in, and the sound source location control parameters are determined based on the control library and mapping points associated with the target sound source, including: When there is only one target in the first region and there are no other targets in the first region, the target parameters of the sound source location are obtained by querying the control library with the identification code of the grid where the mapping point is located. The control parameters are determined based on the target parameters and the current parameters of the sound source location.

8. The method for controlling the spatial distribution of sound wave propagation and the location of the sound source as described in claim 4, characterized in that, The target sound source is identified based on the first region it is located in, and the sound source location control parameters are determined based on the control library and mapping points associated with the target sound source, including: When there are other targets within a first region, the location grid is determined by mapping the grid where the point is located and the grids where other targets are located. Based on the identification code of the positioning grid, the target parameters of the sound source location are obtained by querying the control library; The control parameters are determined based on the target parameters and the current parameters of the sound source location.

9. The method for controlling the spatial distribution of sound wave propagation and the location of the sound source as described in claim 4, characterized in that, The target sound source is identified based on the first region it is located in, and the sound source location control parameters are determined based on the control library and mapping points associated with the target sound source, including: When the control terminal is in the first region corresponding to multiple sound sources, it determines whether there are other targets in each first region; When there is only one first region without other targets, the sound source corresponding to the first region without other targets is taken as the target sound source; when there are multiple first regions without other targets, the sound source corresponding to the one with the smallest lateral distance from the mapping point to the central axis of the corresponding second region is taken as the target sound. The target parameters of the sound source location are obtained by querying the control library corresponding to the grid where the mapping point is located using the identification code of the grid. The control parameters are determined based on the target parameters and the current parameters of the sound source location.

Images