Method for supporting the placement design of audio equipment, information processing device, and program

Abstract

This invention provides a method for supporting the design of audio equipment placement, which makes it easy to determine the optimal placement of audio equipment in an acoustic space. [Solution] The method for supporting the placement design of sound equipment receives input conditions including an acoustic space and the positions of multiple objects in the acoustic space, calculates the placement distribution of sound equipment corresponding to the received input conditions in the received acoustic space, and outputs the calculated placement distribution. Each of the multiple objects includes information on installation conditions. When the placement design support method receives a modification to the input conditions, it modifies the positions of the other objects in conjunction with the modification of the position of at least one of the multiple objects, based on the information on installation conditions.

Description

Technical Field

[0001] One embodiment of the present invention relates to a method for assisting in the layout design of acoustic devices, an information processing apparatus, and a program.

Background Art

[0002] Patent Document 1 discloses an acoustic simulator that simulates how sound from a predetermined sound source in a sound field is heard at a predetermined sound receiving point based on design data of the sound field and forms a simulated sound field in an audible room.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For those without specialized knowledge, it is very difficult to determine the optimal arrangement of acoustic devices for appropriately picking up the voice of a speaker in an acoustic space.

[0005] One aspect of the present disclosure aims to provide a method for assisting in the layout design of acoustic devices that can easily determine the optimal arrangement of acoustic devices in an acoustic space.

Means for Solving the Problems

[0006] An acoustic equipment placement design support method according to one embodiment of the present invention receives input conditions including an acoustic space and the positions of a plurality of objects in the acoustic space, calculates the placement distribution of acoustic equipment corresponding to the received input conditions in the received acoustic space, and outputs the calculated placement distribution. Each of the plurality of objects includes information on installation conditions. When the placement design support method receives a modification to the input conditions, it modifies the positions of the other objects in conjunction with the modification of the position of at least one of the plurality of objects, based on the information on installation conditions. [Effects of the Invention]

[0007] According to one embodiment of the present invention, users can easily determine the optimal placement of acoustic equipment in an acoustic space from input information that does not require acoustic technology or knowledge. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing the configuration of the information processing device 1. [Figure 2] This is a flowchart showing the operation of the display method performed by processor 12. [Figure 3] This figure shows an example of a graphical user interface (GUI) screen for an application program that displays the placement distribution of microphones. [Figure 4] This figure shows an example of a graphical user interface (GUI) screen for an application program that displays the placement distribution of microphones. [Figure 5] This figure shows an example of the results output screen. [Figure 6] This figure shows an example of the results output screen. [Figure 7] This figure shows an example of the results output screen. [Figure 8] This figure shows an example of the results output screen. [Figure 9] This figure shows an example of the results output screen. [Figure 10] This figure shows an example of the results output screen. [Figure 11] It is a diagram showing an example of a GUI according to Modification Example 3. [Figure 12] It is a diagram showing an example of a GUI according to Modification Example 5. [Figure 13] It is a diagram showing an example of a GUI according to other examples. [Figure 14] It is a diagram showing an example of a GUI according to other examples. [Figure 15] It is a diagram showing an example of a GUI according to other examples. [Figure 16] It is a diagram showing an example of a GUI according to other examples. [Figure 17] It is a diagram showing an example of a GUI according to other examples. [Figure 18] It is a diagram showing an example of a GUI according to other examples. [Figure 19] It is a flowchart showing the operation of a display method executed by the processor 12. [Figure 20] It is a flowchart showing the operation of a display method executed by the processor 12. [Figure 21] It is a flowchart showing the operation of a display method executed by the processor 12. [Figure 22] It is a diagram showing an example of a screen (GUI) of an application program. [Figure 23] It is a flowchart showing the operation of a display method executed by the processor 12. [Figure 24] It is a diagram showing an example of a screen (GUI) of an application program. [Figure 25] It is a diagram showing an example of a GUI using an interactive natural language processing model. [Figure 26] It is a diagram (plan view) showing an example of a modification operation screen for input conditions. [Figure 27] It is a diagram (plan view) showing an example of a modification operation screen for input conditions. [Figure 28] It is a diagram (elevation view) showing an example of a modification operation screen for input conditions. [Figure 29] It is a diagram (elevation view) showing an example of a modification operation screen for input conditions. [Figure 30] This is a diagram (elevation view) showing an example of the screen for modifying input conditions. [Figure 31] This is a diagram (plan view) showing an example of the screen for modifying input conditions. [Figure 32] This is a diagram (plan view) showing an example of the screen for modifying input conditions. [Figure 33] This is a diagram (plan view) showing an example of the screen for modifying input conditions. [Figure 34] This is a diagram (plan view) showing an example of the screen for modifying input conditions. [Figure 35] This figure shows an example of a GUI for explaining how to change the size of an acoustic space. [Figure 36] This figure shows an example of a GUI for explaining how to change the size of an acoustic space. [Figure 37] This figure shows an example of a GUI for explaining how to change the size of an acoustic space. [Modes for carrying out the invention]

[0009] Figure 1 is a block diagram showing the configuration of the information processing device 1. The information processing device 1 is implemented using an information processing device such as a PC (personal computer), smartphone, set-top box, or audio receiver.

[0010] The information processing device 1 includes a communication unit 11, a processor 12, RAM 13, flash memory 14, a display unit 15, and a user interface 16.

[0011] The communication unit 11 has wireless communication functions such as Bluetooth® or Wi-Fi®, or wired communication functions such as USB or LAN.

[0012] The display unit 15 consists of an LCD, OLED, or the like. The display unit 15 displays the video output by the processor 12.

[0013] User I / F16 is an example of an operating unit. User I / F16 consists of a mouse, keyboard, or touch panel, etc. User I / F16 accepts user input. The touch panel may be stacked on the display unit 15.

[0014] The processor 12 consists of a CPU, DSP, or SoC (System on a Chip), etc. The processor 12 performs various operations by reading programs from the flash memory 14, which is a storage medium, and temporarily storing them in RAM 13. Note that the programs do not need to be stored in the flash memory 14. The processor 12 may, for example, download programs from other devices such as servers when necessary and temporarily store them in RAM 13.

[0015] Figure 2 is a flowchart showing the operation of the display method executed by the processor 12. The processor 12 executes the display method shown in Figure 2 using the application program read from the flash memory 14.

[0016] First, the processor 12 receives the acoustic space and the positions of the sound source and noise source within the acoustic space (S11). Figures 3 and 4 show an example of a GUI screen for an application program that displays the microphone placement distribution. The processor 12 displays a settings screen like the one shown in Figure 3 on the display unit 15 and receives the acoustic space settings from the user via the user interface 16.

[0017] The GUI shown in Figure 3 includes an acoustic space interface 101 and an acoustic space setting box 102. The user sets the acoustic space via the acoustic space interface 101 or the acoustic space setting box 102. For example, the user sets the acoustic space by entering the width, depth, and ceiling height of the room into the acoustic space setting box 102. Alternatively, the user may modify the width, depth, and ceiling height of the room by moving the mouse cursor on the GUI to a certain position on the acoustic space interface 101, clicking, and dragging. Alternatively, if the information processing device 1 is equipped with a sensor such as a LiDar, the processor 12 may scan the shape of the room via the sensor and accept the width, depth, and ceiling height. If there is a light-transmitting material such as glass, the processor 12 can estimate the shape of the room by assuming the shape of the acoustic space to be, for example, a rectangular parallelepiped, and supplementing the light-transmitting parts.

[0018] In this embodiment, an example of setting a three-dimensional acoustic space is shown, but a two-dimensional acoustic space viewed from a planar perspective may also be set, or a one-dimensional acoustic space along a certain direction may be set. The user may set a straight line or a curve as the one-dimensional acoustic space. The user may set a two-dimensional plane formed by straight lines, a two-dimensional plane formed by curves, or a composite two-dimensional plane formed by straight lines and curves as the two-dimensional acoustic space. The user may set a polyhedron formed by polygons, a prism or cone shape including curved surfaces, or a sphere as the three-dimensional acoustic space.

[0019] Note that the acoustic space setting shown in Figure 3 is just one example, and the application program may accept the acoustic space through any interface. For example, the user may input the name of a real concert hall, and the application program may accept the shape of the acoustic space based on 3D CAD data corresponding to the input concert hall.

[0020] Furthermore, the processor 12 displays a GUI screen, as shown in Figure 4, on the display unit 15 and receives information from the user via the user interface 16 regarding the location of sound sources and noise sources in the acoustic space.

[0021] The GUI shown in Figure 4 includes an acoustic space interface 101 and object icons 103. In the example in Figure 4, object icons 103 include objects for a desk 103A, a chair 103B, an air conditioner 103C, a fan 103D, and a projector 103E. The user may input the dimensions of the objects numerically or adjust them using drag-and-drop. By dragging and dropping, any object from object icons 103 is placed on the acoustic space interface 101. At this time, the processor 12 may display the coordinates of any point on the object within that acoustic space. Among the object icons 103, the objects for desk 103A and chair 103B correspond to the positions of the meeting participants (speakers). The meeting participants sit in the chairs and emit sound towards the desk 103A or the screen (the projection direction of the projector 103E). In other words, the processor 12 estimates the position of the sound source and the direction of its directivity (forward direction) from the positional relationship between the desk 103A, chair 103B and the screen. The forward direction may be entered by the user on the GUI screen. Also, the air conditioner 103C, fan 103D, and projector 103E correspond to the location of the noise source. Alternatively, if the information processing device 1 is equipped with a camera, the processor 12 may estimate the location of the sound source (chair 103B) and the locations of the noise sources (air conditioner 103C, fan 103D, and projector 103E) by image recognition processing based on the image acquired by the camera.

[0022] Next, the processor 12 calculates the microphone placement distribution in the received acoustic space based on the received sound source location and noise source location, using a predetermined model (S12). The microphone placement distribution includes information on what type of microphone, what input characteristics it has, and where it should be placed. The processor 12 determines the microphone placement distribution using a mathematical model or a trained model. The trained model is a model trained using a DNN (Deep Neural Network) to understand the relationship between the sound source location, the noise source location, and the microphone placement distribution.

[0023] A computer that generates a trained model (for example, a microphone manufacturer's server) acquires numerous datasets during the training phase that show the correspondence between the location of a sound source, the location of a noise source, and the placement distribution of microphones in a real acoustic space. The server uses these numerous datasets to train a given model using a predetermined algorithm to output the placement distribution of microphones for given input conditions (location of sound source, location of noise source, etc.).

[0024] Any algorithm can be used to train the model. For example, any machine training algorithm such as a CNN (Convolutional Neural Network) or an RNN (Recurrent Neural Network) can be used.

[0025] The processor 12 obtains the trained model, which has been trained in the manner described above, from the server via the communication unit 11. In the execution phase, the processor 12 takes the received acoustic space and the positions of sound sources and noise sources within that acoustic space as input from the trained model and determines the corresponding microphone placement distribution.

[0026] The processor 12 then displays the calculated microphone placement distribution on the display unit 15 (S13). Figure 5 shows an example of the result output screen. The processor 12 displays the microphone placement distribution calculated in the S12 process within the acoustic space set by the acoustic space interface 101. The displayed microphone placement distribution includes at least the number and position of microphones in the set acoustic space. In the example in Figure 5, the processor 12 displays two microphones 151A and 151B within the acoustic space interface 101. Microphones 151A and 151B are displayed at the ceiling position of the acoustic space interface 101.

[0027] This allows users to easily determine how many microphones to place and where to position them, taking into account not only the placement of desks and chairs in the set acoustic space, but also the constraints of the location of noise sources specific to that room, as part of a new customer experience. Therefore, even users without product knowledge of microphones or know-how in system design for acoustic spaces can select the necessary microphones and design the system according to their needs.

[0028] The processor 12 may also display the microphone input characteristics (input sensitivity) as the microphone placement distribution. The microphone input characteristics are expressed, for example, as the no-load voltage value (dBV) when a sound pressure of 1 kHz and 1 Pa is applied from the direction with the highest sensitivity.

[0029] This allows users to easily understand what kind of microphone input characteristics are necessary to create a new customer experience. Furthermore, it allows them to visually confirm whether the microphone in their designed system can capture sound in the required area (hereinafter referred to as the coverage area).

[0030] The processor 12 may accept not only the location of the sound source and the location of the noise source, but also the sound pressure of each sound source and the sound pressure of the noise source. The sound pressure of the sound source corresponds to the sound pressure level and directivity of the average speaker's voice. The sound pressure of the noise source is obtained by measuring information about the sound pressure of each noise source (air conditioner 103C, fan 103D, and projector 103E) in advance. The processor 12 may record the pre-measured data in flash memory 14 or RAM 13 and recall it in response to placement operations from the user. A computer that generates a trained model (e.g., a microphone manufacturer's server) acquires a large number of datasets showing the correspondence between the location and sound pressure of the sound source, the location and sound pressure of the noise source, and the placement distribution of the microphones in a real acoustic space as part of the training phase, and trains a predetermined model using a predetermined algorithm.

[0031] The processor 12 may also determine the signal-to-noise ratio (SNR) for each position (X,Y,Z) in the acoustic space based on the position and sound pressure of the noise source and the position and sound pressure of the sound source (i.e., the SNR distribution A(X,Y,Z)), and use this SNR distribution A(X,Y,Z) as input to a predetermined model to determine the microphone placement distribution. This microphone placement distribution can be represented, for example, as a sphere of radius R corresponding to the sound pickup range when omnidirectional microphones are placed at each position (X,Y,Z) in the acoustic space (i.e., a function of the SNR distribution A(X,Y,Z)).

[0032] Furthermore, the processor 12 determines the desired sound pickup range based on the positions of the desks 103A and chairs 103B that it has received. As described above, meeting participants sit in chairs and emit sounds towards the desks 103A or the screen (the projection direction of the projector 103E). The desired sound pickup range is a rectangular area M that includes all the desks 103A and chairs 103B, as shown in Figure 6, for example. Alternatively, the user may specify the sound pickup range by moving the mouse cursor on the GUI to a certain position in the acoustic space interface 101, clicking, and dragging.

[0033] The processor 12 inputs the above-mentioned signal-to-noise ratio distribution A(X,Y,Z) and the desired sound pickup range into a predetermined model (trained model) to determine the microphone placement distribution.

[0034] The processor 12 may display the calculated microphone placement distribution, including the position of each microphone and its pickup range (for example, a sphere with radius R). The processor 12 may also display the signal-to-noise ratio (SNR) distribution A(X,Y,Z). For example, in the example in Figure 7, the microphone input characteristics are shown using spherical pickup range icons 171A and 171B. Alternatively, the microphone placement distribution may be represented on a two-dimensional plane, as shown in Figure 8. This allows users to easily understand the SNR distribution based on the calculated microphone placement distribution, providing a new customer experience.

[0035] Furthermore, the processor 12 may accept modifications to the input conditions on the results output screen. For example, as shown in Figure 9, the processor 12 may display additional object icons 103 for condition input on the results output screen. Users can also add more objects to the acoustic spatial interface 101 by dragging and dropping each object from the object icons 103. Also, as shown in Figure 9, users can delete an object (chair 103B) already placed in the acoustic spatial interface 101 by dragging and dropping it outside the acoustic spatial interface 101. The processor 12 recalculates the microphone placement distribution based on the modified input conditions. The processor 12 displays the recalculated microphone placement distribution as shown in Figure 10. When recalculating, the processor 12 may specify the number of audio devices and recalculate the placement that covers the widest possible area within the constraint of that number of devices. This allows users to easily find the optimal placement within a certain budget and predict its performance as a new customer experience.

[0036] This allows users to improve design accuracy by referring to the results for the initially entered conditions and modifying the input conditions. The GUI may display a list of input conditions, microphones, audio equipment, and microphone placement or coverage area diagrams on the results output screen. The placement or coverage area diagrams can be easily switched by the user. Alternatively, it may be switched to a block diagram.

[0037] (Variation 1) The processor 12 in Modification 1 determines the reflected sound distribution in the acoustic space. The processor 12 further determines the microphone placement distribution using the reflected sound distribution as input. The reflected sound distribution includes information on the location where the reflected sound is generated and the sound pressure. The location of the reflected sound is determined by the location of the sound source and the location of the wall, and the location of the noise source and the location of the wall.

[0038] The processor 12 accepts the material of the walls in the acoustic space (board, glass, concrete, tile, carpet, rock wool sound-absorbing board, etc.) via a GUI. If the information processing device 1 is equipped with a camera, the processor 12 may estimate the material of the walls by image recognition processing based on the image acquired by the camera. The processor 12 estimates the sound pressure and distribution of reflected sound based on the shape of the acoustic space and the sound absorption coefficient corresponding to the material of the walls. In this case, the processor 12 may determine the signal-to-noise ratio (SNR) for each direction at an arbitrary microphone position based on the positional relationship between the microphone, sound source, noise source, and reflected sound, calculate the non-spherical sound-collecting range using the SNR for each direction as an input argument, and calculate the optimal microphone placement distribution. The optimal microphone placement distribution may be defined as "an arrangement that can cover the required sound-collecting area with the fewest number of microphones," or it may be defined as "an arrangement that can cover the required sound-collecting area with the lowest-cost microphone" by accepting price information for each microphone.

[0039] Processor 12 considers the reflected sound calculated in this way as a noise source. Processor 12 inputs the received acoustic space, sound source location, and noise source location into the trained model and determines the corresponding microphone placement distribution.

[0040] This allows users to easily learn about more optimal microphone placement that takes into account room reflections, as part of a new customer experience.

[0041] (Modification 2) The processor 12 according to the modified example 2 receives information about the directivity of the microphones and further calculates the microphone placement distribution based on the information about the directivity of the microphones.

[0042] In this case, as part of the training phase, the server acquires numerous signal-to-noise ratio (SNR) distributions when microphones with certain input characteristics and directivity are placed in a certain acoustic space. The server then trains a predetermined model using a predetermined algorithm to understand the relationship between the microphone placement distribution, microphone directivity, and SNR distribution.

[0043] The processor 12 obtains the trained model, which has been trained in the manner described above, from the server via the communication unit 11. In the execution phase, the processor 12 receives information about the received acoustic space, the signal-to-noise ratio distribution in the acoustic space, and the directivity of the microphones from the trained model and determines the corresponding microphone placement distribution.

[0044] This allows users to easily learn about the optimal microphone placement, taking directional characteristics into account, as part of a new customer experience.

[0045] (Variation 3) The processor 12 according to the modified example 3 receives the number, position, and input characteristics of fixed microphones that are pre-installed in the room, and further calculates the necessary microphone placement distribution based on the number, position, and input characteristics of the fixed microphones.

[0046] Figure 11 shows an example of the screen (GUI) of an application program according to Modification 3. The user further sets the number and position of fixed microphones within the acoustic space interface 101. In the example in Figure 11, the processor 12 receives two ceiling-mounted fixed microphones 191A and 191B within the acoustic space via the acoustic space interface 101.

[0047] The processor 12 uses the input characteristics of the received fixed microphones 191A and 191B as constraints, and uses a trained model to input the received acoustic space and the target signal-to-noise ratio distribution within that acoustic space, and determines the corresponding microphone placement distribution.

[0048] The processor 12 displays the fixed microphones 191A and 191B, as well as any other microphones necessary to obtain the target signal-to-noise ratio distribution.

[0049] This allows users to easily determine the optimal microphone placement within a set acoustic space, taking into account microphones already installed in the room, as part of a new customer experience.

[0050] (Modification 4) The processor 12 according to the modified example 4 receives information on locations in the acoustic space where microphones cannot be installed, and further calculates the microphone placement distribution based on these locations where installation is impossible.

[0051] For example, in a real room, glass surfaces such as windows cannot be used to place microphones. Users can specify locations in the actual room where microphones cannot be placed (unsuitable locations) using the GUI.

[0052] The processor 12 uses the accepted unsuitable placement locations as constraints to determine the microphone placement distribution using a trained model. Alternatively, the processor 12 may also accept the speaker locations in the acoustic space. Microphones cannot be placed at speaker locations. The processor 12 may further add a constraint that speaker locations are unsuitable placement locations and then determine the placement distribution.

[0053] This allows users to easily determine the optimal microphone placement within a set acoustic space, taking into account locations where microphones cannot be placed, as part of a new customer experience.

[0054] (Variation 5) The processor 12 according to the modified example 5 records the calculated placement distribution, receives information from microphones installed in the actual acoustic space, compares the recorded design placement distribution with the microphone information, and outputs the comparison result.

[0055] For example, the processor 12 records the calculated placement distribution in the flash memory 14. The processor 12 also connects to microphones installed in the actual acoustic space and receives information such as the microphone model name. For example, the processor 12 compares the number of microphones in the calculated placement distribution with the number of microphones based on the acquired microphone information. Alternatively, the processor 12 may compare the microphone model names in the calculated placement distribution with the microphone model names based on the acquired microphone information. If the number of microphones in the calculated placement distribution differs from the number of microphones in the recorded design placement distribution, or if the microphone model names in the calculated placement distribution differ from the microphone model names based on the acquired microphone information, the processor 12 displays information about microphones that are not installed on the comparison output screen, as shown in Figure 12.

[0056] This allows users to know before use if a microphone with the wrong specifications has been installed, if there are too few microphones, or if there are too many microphones installed.

[0057] Furthermore, the above-mentioned past placement distribution may refer to the placement distribution when the microphones were first placed in the acoustic space. In this case, if a malfunction occurs after actual use, the processor 12 compares the placement distribution at the time of initial placement with the information of the currently placed microphones and outputs the comparison result. If the placement distribution at the time of initial placement matches the information of the currently placed microphones, the user can understand that the microphones were installed according to specifications at the time of installation, but the malfunction occurred after use due to a product failure or other reason. Therefore, the user can easily determine whether the malfunction was caused by the microphones not being installed according to specifications at the time of installation, by changes in wiring after use, or by a product failure or other reason. Also, if the acoustic characteristics of the installation space were measured when the microphones were first installed, the user can easily determine whether the malfunction was caused by a change in the characteristics of the installation space by comparing the results with the results of a remeasurement when a problem occurs. Furthermore, if the operation was checked according to a certain sequence when the microphones were first installed, the user can easily identify the malfunctioning operation by comparing it with the results of a re-check. This allows even users without acoustic technology or knowledge to isolate the cause of a malfunction.

[0058] For example, the calculation results do not need to be displayed on the display unit 15 of the information processing device 1. The processor 12 may output the calculation results to another device.

[0059] For example, the processor 12 may store a large amount of data as a database in flash memory 14, RAM 13, or a server (not shown) by associating it with multiple acoustic spaces and multiple placement distributions as past calculation results. In this case, the processor 12 refers to the database to determine the placement distribution corresponding to the received acoustic space. Alternatively, the processor 12 can determine the placement distribution of microphones by referring to and reading the placement distribution of microphones corresponding to input conditions such as desk 103A or chair 103B from the database. In this case, the processor 12 can also determine the placement distribution of microphones without using the above model.

[0060] Furthermore, as shown in Figure 13, the processor 12 may accept requirements for the acoustic space where the system will be installed (for example, the layout needs to be changed frequently, microphones should not be placed on tables, or installation on ceilings and walls should be avoided as much as possible) and select microphone models (part numbers, etc.) based on these requirements. In this case, the processor 12 can determine the optimal microphone part numbers and number of units. Similarly, the processor 12 may also accept settings for the desired sound emission area and select the speaker placement distribution and part numbers. The processor 12 can determine the part numbers and number of units for the microphones and speakers, and further determine the required number of ports and power consumption for peripheral equipment such as processors, amplifiers, and network switches for necessary sound signal processing. The processor 12 may also select part numbers and number of units from a predetermined set of part numbers for processors, amplifiers, and network switches that meet the required number of ports and power consumption. This provides a new customer experience, allowing users without product knowledge of audio equipment or know-how in system design for acoustic spaces to easily design an entire system that meets their needs. Furthermore, as shown in Figure 14, the processor 12 may display a list of part numbers and quantities of all the equipment required for the entire system. The processor 12 may also display a layout diagram of the microphones and speakers in the acoustic space, as shown in Figure 15. The processor 12 may also display a microphone coverage area diagram in the acoustic space, as shown in Figure 16. When the processor 12 receives an operation on the "microphone coverage area" switch icon in the results output screen of Figure 15, it displays the microphone coverage area diagram shown in Figure 16. The processor 12 may also display a speaker coverage area diagram, as shown in Figure 17. When the processor 12 receives an operation on the "speaker coverage area" switch icon in the results output screen of Figure 15, it displays the speaker coverage area diagram shown in Figure 17. When the processor 12 receives operations on both the "microphone coverage area" and "speaker coverage area" switch icons in the results output screen of Figure 15, it may display the microphone and speaker coverage areas overlaid on top of each other.Furthermore, as shown in Figure 18, the processor 12 may display a block diagram of all the equipment required for the entire system. In this case, the processor 12 may switch between displaying a layout diagram of microphones and speakers in the acoustic space and displaying the block diagram by accepting a selection from a tab displayed at the top of the results output screen. The processor 12 may also output an estimate of the purchase price of all the equipment required for the entire system.

[0061] Furthermore, the processor 12 may accept instructions from the user on the results output screen to add or remove desired microphones and speakers, or to move them using drag-and-drop operations. In this case, the processor 12 may modify the list of part numbers and quantities of all the equipment required for the entire system, the block diagram, the layout diagram of microphones and speakers in the acoustic space, the coverage area diagram of microphones or speakers in the acoustic space, and the purchase price estimate for all the equipment required for the entire system, in response to the instruction to add or remove microphones or speakers, and display the results of the changes in real time.

[0062] Figure 19 is a flowchart showing the operation of the display method performed by processor 12. Operations common to Figure 2 are denoted by the same reference numerals and their explanations are omitted.

[0063] After receiving the acoustic space, the location of the sound source, and the location of the noise source in S11, the processor 12 further accepts the setting of a priority sound pickup area in the acoustic space (S101). A priority sound pickup area is, for example, the area where important participants in a meeting, such as the company president, are located. In this example, the target signal-to-noise ratio (SNR) of the priority sound pickup area is set higher than that of other areas. For example, the target SNR of the priority sound pickup area is about 10 dB higher than the target SNR of other areas.

[0064] The processor 12 takes the received acoustic space and the target signal-to-noise ratio distribution as input, for example, using a predetermined trained model, and calculates the corresponding microphone placement distribution (S102). The processor 12 displays the microphones necessary to obtain the target signal-to-noise ratio distribution as calculated (S13).

[0065] This creates a new customer experience where even users without expertise in acoustic system design can determine the optimal microphone placement and distribution, taking into account the areas where key participants are located during a meeting.

[0066] Figure 20 is a flowchart showing the operation of the display method performed by processor 12. Operations common to Figure 19 are denoted by the same reference numerals and their explanations are omitted.

[0067] In the example shown in Figure 20, the processor 12 first accepts the acoustic space, the location of the sound source, and the location of the noise source, and then accepts the setting of a normal sound pickup area or a priority sound pickup area (S100). The priority sound pickup area is, as mentioned above, the area where important participants in a meeting are located, such as the company president. The user sets the priority sound pickup area using the GUI. The normal sound pickup area corresponds to, for example, the desired sound pickup range (rectangular area M) shown in Figure 6. The user sets the normal sound pickup area by, for example, using the GUI in Figure 6 to move the mouse cursor to a certain position on the acoustic space interface 101, clicking, and performing a drag operation.

[0068] The processor 12 determines whether or not a priority sound pickup area is set (S101). If the processor 12 determines that a priority sound pickup area is set (S101 is YES), it calculates a first placement distribution using only the priority sound pickup area (S102). If the processor 12 determines that there is no priority sound pickup area set (S101 is NO), it skips the process in S102 and proceeds to S103.

[0069] Next, the processor 12 determines whether or not a normal sound pickup area is set (S103). If the processor 12 determines that a normal sound pickup area is set (S103 is YES), it calculates the first sound pickup area, which is the area where sound can be picked up with the currently calculated placement distribution (S104). For example, the processor 12 calculates the area that satisfies the target signal-to-noise ratio in the placement distribution calculated in S102 as the first sound pickup area.

[0070] Next, the processor 12 determines the second sound pickup area, which is the normal sound pickup area excluding the first sound pickup area calculated in S104 (S105). Then, the processor 12 calculates the second placement distribution, which is the placement distribution in the remaining normal sound pickup area (second sound pickup area) (S106).

[0071] If processor 12 determines that there is no setting for the normal sound pickup area (if S103 is NO), it skips processing S104 to S106 and proceeds to S103.

[0072] The processor 12 displays the calculated result (S13). This allows the processor 12 to calculate an appropriate placement distribution according to the user's input settings for the normal sound pickup area and the priority sound pickup area.

[0073] Figure 21 is a flowchart showing the operation of the display method performed by the processor 12. Operations common to Figure 20 are denoted by the same reference numerals, and their explanations are omitted.

[0074] In the example shown in Figure 21, when the processor 12 receives the acoustic space, the location of the sound source, and the location of the noise source, it also receives the settings for a normal sound pickup area, a priority sound pickup area, or an emergency sound pickup area (S200). An emergency sound pickup area is an area that does not always need to be sound-collected during a meeting. An emergency sound pickup area corresponds to the location of the other area when a large room is divided into a main area and other areas by, for example, a sliding wall.

[0075] After processing in S106, or if the processor 12 determines in S103 that there is no setting for a normal sound pickup area (if S103 is NO), it determines whether or not there is a setting for an emergency sound pickup area (S201). If the processor 12 determines that there is a setting for an emergency sound pickup area (if S201 is YES), it calculates a second sound pickup area, which is an area where sound can be picked up using the currently calculated placement distribution (S202). For example, the processor 12 calculates the area that satisfies the target signal-to-noise ratio in the placement distribution calculated in S102 or S106 as the second sound pickup area.

[0076] Next, processor 12 determines the third sound collection area, which is the emergency sound collection area excluding the second sound collection area calculated in S202 (S203). Then, processor 12 calculates the third placement distribution, which is the placement distribution of the remaining emergency sound collection area (third sound collection area) (S204). If processor 12 determines that there is no emergency sound collection area set (if S201 is NO), it skips processing S202 to S204 and proceeds to S13.

[0077] The processor 12 displays the calculated result (S13). This allows the processor 12 to calculate an appropriate placement distribution according to the user's input settings for the normal sound pickup area, priority sound pickup area, and emergency sound pickup area.

[0078] In the example shown in Figure 21, an example of calculating the first, second, and third placement distributions is presented. However, the processor 12 may calculate only the first placement distribution, only the second placement distribution, or only the third placement distribution. Furthermore, the processor 12 may calculate the second and third placement distributions without calculating the first placement distribution, or calculate the first and third placement distributions without calculating the second placement distribution, or calculate the first and second placement distributions without calculating the third placement distribution.

[0079] Figure 22 shows an example of an application program's graphical user interface (GUI). Processor 12 accepts the acoustic space through a simple settings screen as shown in Figure 22. Processor 12 displays several (three in Figure 22) acoustic space templates, "Web Conference," "Seminar," and "Store," as the acoustic space the user wants to build. Processor 12 accepts the selection of one of these acoustic space templates.

[0080] The processor 12 stores a large amount of data, such as past calculation results, as a database in flash memory 14, RAM 13, or a server (not shown), associating data related to multiple acoustic spaces and multiple placement distributions. The processor 12 refers to this database to calculate the placement distribution corresponding to the received acoustic space.

[0081] This allows the processor 12 to easily receive requests for acoustic spaces from the user. After displaying the placement distribution calculated from the simple requests, the processor 12 then receives more detailed requests for the sound environment from the user and calculates the placement distribution again. Figure 23 is a flowchart showing the operation of the display method performed by the processor 12. Operations common to Figure 2 are denoted by the same reference numerals and their explanations are omitted.

[0082] After displaying the calculated placement distribution (after S13), the processor 12 receives request data related to the user's requests for the sound environment in relation to the calculated placement distribution (S51). For example, as shown in Figure 24, the processor 12 displays a diagram of the microphone coverage area in the acoustic space as the placement distribution, and further displays a box for receiving request data on the screen. The user inputs text data as request data into this box. In the example in Figure 24, the user inputs the text data, "The speaker may move along the wall, so please position the microphones so that all sounds from along the wall can be captured." The processor 12 uses a natural language processing model to find information (keywords) related to the user's requests for the sound environment contained in the input text data. The natural language processing model is a model trained to output the keywords of the request data corresponding to a sentence using a large number of datasets consisting of combinations of text data and keywords of the request data. The processor 12 inputs the received sentence into the natural language processing model and obtains the corresponding request data.

[0083] Then, the processor 12 recalculates the microphone placement distribution (S52) and displays the recalculated placement information (S53). In particular, in the process of S52, the processor 12 prepares a trained model that has been trained to output the placement of audio equipment such as microphones in response to input data, and inputs the requested data to the trained model to obtain the placement information of the corresponding audio equipment.

[0084] This allows users without product knowledge of audio equipment or expertise in system design for acoustic spaces to design the entire system more easily and accurately by first making simple requests via a GUI and then making further requests via text input based on the calculated placement distribution.

[0085] Figure 25 shows an example of a GUI using an interactive natural language processing model. The GUI shown in Figure 25 receives request data using an interactive natural language processing model. The GUI asks for requests regarding the sound environment, and the user inputs answers to the questions.

[0086] The processor 12 receives text data related to the request data using the interactive natural language processing model, inputs the text data of the request data to the trained model described above, and obtains the arrangement information of the corresponding audio equipment.

[0087] This allows users to design the entire system more simply and accurately by simply providing answers to questions.

[0088] The arrangement distribution of audio equipment may include wiring information between multiple audio devices. The processor 12 may prepare a trained model that is trained to output wiring information between multiple audio devices as an arrangement distribution corresponding to the requested data, and input the received requested data to the trained model to obtain the corresponding wiring information. The processor 12 may display the calculated wiring information in a GUI.

[0089] This allows users to connect multiple audio devices by viewing the wiring information displayed on the GUI, making it easy to connect audio devices without making wiring mistakes.

[0090] The arrangement distribution of audio equipment may include information on the parameters of the signal processing performed by the audio equipment. The processor 12 may prepare a trained model that is trained to output information on the parameters of the signal processing performed by the audio equipment as an arrangement distribution corresponding to the requested data, and may input the received requested data to the trained model to obtain the corresponding parameter information. The processor 12 may display the calculated parameter information in a GUI.

[0091] This allows users to easily set the signal processing parameters performed by the audio equipment by viewing the displayed signal processing parameters.

[0092] The processor 12 may accept current information indicating the current installation status of the audio equipment. The processor 12 may also calculate correction information for the current information as the placement distribution of the audio equipment. The correction information includes any of the following: information that points out errors in the current information, information that shows the result of correct wiring, and updated information that adds new information to the current information.

[0093] This allows users to easily adjust the settings of their audio equipment by viewing the displayed correction information.

[0094] (Other examples of operations related to modifying input conditions) Figure 26 is a diagram (plan view) showing an example of the input condition modification operation screen. Each of the multiple objects contains information about the installation conditions. The installation condition information is stored, for example, in the flash memory 14.

[0095] When the processor 12 receives a modification to the input conditions, it modifies the positions of other objects in conjunction with the modification of the position of at least one of the multiple objects, based on the information of the installation conditions.

[0096] For example, as shown in Figure 27, the user moves the object icon of desk 103A to the left within the acoustic spatial interface 101 by dragging and dropping it. At this time, the processor 12 refers to the information regarding the placement conditions of the object of desk 103A.

[0097] The installation condition information is defined by a predefined table that shows the relationships between multiple objects. For example, for the object of desk 103A, the table identifies the projector 103E, which is installed on the top surface of desk 103A, as the object to be linked. Alternatively, the installation condition information may be defined based on a pre-trained model that has been trained in advance using a DNN, which shows the relationships between multiple objects. The computer (e.g., server) that generates the pre-trained model acquires a large number of datasets in the training phase that show the correspondence between the relationships between multiple objects and the installation condition information in a real acoustic space. The server uses the acquired datasets to train a predetermined model using a predetermined algorithm to output the installation condition information corresponding to multiple objects. Any algorithm can be used to train the model. For example, any machine training algorithm such as CNN or RNN can be used. The processor 12, in the implementation phase, inputs the relationship information of the multiple objects specified as input conditions into the pre-trained model to obtain the installation condition information for each object.

[0098] Based on the installation conditions information, the processor 12 moves the projector 103E to the left within the acoustic spatial interface 101 by a predetermined amount (the same amount of movement as the desk 103A) in conjunction with the correction of the desk 103A's position.

[0099] Alternatively, the processor 12 may determine which object to link on a case-by-case basis. For example, the object for desk 103A may have a record indicating, for instance, "Link objects placed on the desk." In this case as well, the processor 12 identifies the projector 103E, which is an object in contact with the top surface of desk 103A, as the object to be linked.

[0100] The processor 12 may then recalculate the placement distribution of the audio equipment based on the modified input conditions. In this case, other objects that should be modified in conjunction with the modified object's position are automatically modified, and the optimal placement distribution of the audio equipment is recalculated based on the modified input conditions. Therefore, the placement design support method of this embodiment allows users with little knowledge of acoustic design to prevent omissions in modifications and obtain a more appropriate placement distribution of audio equipment.

[0101] Modifying input conditions includes moving, deleting, adding, or resizing objects. Figure 28 is an example of an input condition modification operation screen (elevation view). The user deletes the object of desk 103A by, for example, dragging and dropping the object icon of desk 103A outside the acoustic space interface 101. At this time, the processor 12 refers to the installation condition information of the object desk 103A. The installation condition information identifies the projector 103E as the target of the linkage. Therefore, as shown in Figure 29, the processor 12 moves the projector 103E to the floor surface within the acoustic space interface 101 in conjunction with the modification (deletion) of the position of desk 103A.

[0102] This allows the processor 12 to prevent the projector 103E from being positioned in an unrealistic way, such as floating in mid-air.

[0103] Furthermore, as shown in Figure 29, when the projector 103E is installed on the floor, the processor 12 may also add an object, such as a desk 103A, to the acoustic spatial interface 101. In this case as well, the processor 12 refers to the installation condition information for the desk 103A object to be added. The installation condition information identifies the projector 103E as the target for synchronization. Therefore, as shown in Figure 28, the processor 12 moves the projector 103E onto the desk 103A in conjunction with the correction (addition) of the desk 103A's position.

[0104] This allows the processor 12 to prevent unnatural situations where, even after adding the desk 103A, objects placed on the desk, such as the projector 103E, remain on the floor.

[0105] Figure 30 is an elevation view showing an example of an input condition modification operation screen. The user changes the height as an example of changing the size of the object of desk 103A. When the height of desk 103A is changed, the position of the desk surface of desk 103A is changed. At this time, the processor 12 refers to the installation condition information of the object of desk 103A whose height has been changed. In the installation condition information, the projector 103E is identified as the target of the linkage. Therefore, as shown in Figures 28 and 30, the processor 12 changes the position of the projector 103E in the height direction to the position of the desk surface of desk 103A after the change in height.

[0106] The above movements include rotational movements. As shown in Figure 31, for example, the desk 103A is rotated. The processor 12 may also rotate the projector 103E on the same axis of rotation in conjunction with the rotational movement of the desk 103A.

[0107] When the processor 12 receives an object selection, it may also notify other linked objects. For example, as shown in Figure 32, when the user selects the object on the desk 103A, the processor 12 makes the linked projector 103E stand out by changing its color or making it blink. This allows the user to see the objects whose positions are being changed in conjunction with the selected projector.

[0108] The processor 12 may issue a warning if the coordinated adjustment of the positions of other objects would result in the installation conditions not being met. For example, as shown in Figure 33, when a user moves the object of desk 103A to the left, the processor 12 moves the object of projector 103E in conjunction, but if the left edge of projector 103E goes outside the acoustic spatial interface 101, the processor 12 issues a warning. This prevents users with little knowledge of acoustic design from making incorrect adjustments.

[0109] If the installation conditions are not met, the processor 12 may present input conditions to satisfy those installation conditions. The input conditions to satisfy the installation conditions are predetermined for each object, for example. For example, the input condition to satisfy the installation conditions of projector 103E is defined as "1m from the wall." Therefore, the processor 12 displays an image of projector 103E moved to a position 1m from the wall, as an input condition to satisfy the installation conditions of projector 103E, for example, as shown by the dashed line in Figure 34. At this time, the processor 12 displays an image of the desk 103A moved in conjunction with projector 103E.

[0110] This allows even users with little knowledge of acoustic design to easily understand what modifications are necessary.

[0111] The input conditions required to satisfy the installation conditions may be defined based on a trained model. The computer (e.g., server) that generates the trained model acquires a large number of datasets in a real acoustic space during the training phase, showing the correspondence between installation condition information and input conditions. The server uses the acquired datasets to train a predetermined model using a predetermined algorithm to output input conditions for the installation condition information. Any algorithm can be used to train the model. For example, any machine training algorithm such as CNN or RNN can be used.

[0112] Figures 35 and 36 show examples of GUIs for illustrating changes in the size of the acoustic space. When the processor 12 receives a request to change the size of the acoustic space, it changes the scale of the acoustic space while maintaining the margins in the GUI.

[0113] In the floor plan of Figure 35, a room with a width of 4m, a depth of 3m, and a ceiling height of 3m is specified as the acoustic space. The GUI creates a margin with a width:height ratio of 4:3 as an example in the upper left corner of the acoustic space interface 101. The aspect ratio of this margin matches the aspect ratio of the entire GUI.

[0114] Here, if the user changes, for example, the size of the room, the processor 12 resizes the acoustic spatial interface 101 so that it fits within the entire GUI while maintaining the margins in the GUI, as shown in Figure 36. In the example in Figure 36, the width of the room has been changed to 8m, so the processor 12 resizes it to 1 / 2 the size of the example in Figure 3. This allows the acoustic spatial interface 101 to fit within the entire GUI. Furthermore, even if the aspect ratio of the acoustic spatial interface 101 is changed, the margins in the GUI are maintained at the overall aspect ratio of the GUI, which is 4:3. Therefore, even if the scale of the acoustic spatial interface 101 is changed, the user can see the entire acoustic spatial interface 101 and intuitively grasp the aspect ratio of the acoustic spatial interface 101 by comparing it with the margins in the GUI.

[0115] Furthermore, as shown in Figure 37, if the user changes the size of the room and the installation conditions are no longer met, the processor 12 may present input conditions to meet the installation conditions, or modify the position of objects to meet the input conditions. In the example in Figure 37, as a result of modifying the acoustic space to a width of 3.5m, one of the chairs 103B on the right is outside the acoustic space, and the installation conditions are no longer met. Therefore, the processor 12 moves the position of chair 103B to the left by a predetermined amount as an input condition to meet the installation conditions. For example, the processor 12 makes the distance between chair 103B and the right end of the acoustic space interface 101 the same as the distance before the acoustic space was changed. Then, the processor 12 moves the object of desk 103A to the left by a predetermined amount in conjunction with the object of chair 103B. In this way, when the processor 12 receives a modification of the acoustic space as a change in input conditions, it may modify the position of an object that no longer meets the installation conditions, and also modify the position of other objects in conjunction with that object.

[0116] (Other examples) The movement of objects linked to a drag operation does not need to be performed in real time. For example, the processor 12 may perform the movement of the linked objects at predetermined intervals (e.g., every second).

[0117] The linked objects may be temporarily disconnected. For example, if a user taps and selects the object of desk 103A, and at the same time taps and selects the object of projector 103E, the processor 12 will temporarily disconnect the projector 103E. The user can also move only the object of desk 103A without moving the projector 103E by dragging only the object of desk 103A while both the object of desk 103A and the object of projector 103E are selected simultaneously.

[0118] Modifying input conditions includes Undo, Redo, and copy-and-paste operations. For example, if the processor 12 moves the object of desk 103A and moves the object of projector 103E in conjunction with it, and then receives an Undo operation, it returns the object of desk 103A to its original position and also returns the object of projector 103E to its original position.

[0119] The description of this embodiment should be considered in all respects to be illustrative and not restrictive. The scope of the present invention is indicated by the claims, rather than by the embodiments described above. Furthermore, the scope of the present invention includes the scope equivalent to the claims. [Explanation of Symbols]

[0120] 1: Information processing unit, 11: Communication unit, 12: Processor, 13: RAM, 14: Flash memory, 15: Display unit, 16: User I / F, 101: Acoustic space interface, 102: Acoustic space setting box, 103: Object icon, 103A: Desk, 103B: Chair, 103C: Air conditioner, 103D: Fan, 103E: Projector, 151A: Microphone, 151B: Microphone, 171A: Sound pickup range icon, 171B: Sound pickup range icon, 191A: Fixed microphone, 191B: Fixed microphone

Claims

1. It accepts input conditions including an acoustic space and the positions of multiple objects within that acoustic space, In the received acoustic space, the arrangement distribution of acoustic equipment corresponding to the received input conditions is calculated. Output the calculated distribution. A method for supporting the placement design of audio equipment, Each of the aforementioned objects includes information on installation conditions, When a modification to the input conditions is accepted, the positions of the other objects are modified in conjunction with the modification of the position of at least one of the multiple objects, based on the information of the installation conditions. Layout design support method.

2. Modifying the aforementioned input conditions includes moving, deleting, adding, or resizing the aforementioned object. The layout design support method according to claim 1.

3. In the movement of the object, the other objects are moved in conjunction with the movement of at least one object. The arrangement design support method according to claim 2.

4. The aforementioned movement includes rotational movement, In conjunction with the rotational movement of at least one of the aforementioned objects, the other objects are rotated on the same axis of rotation. The arrangement design support method according to claim 3.

5. When a modification to the input conditions is accepted, the system notifies the other linked objects when the selection of at least one of the multiple objects is accepted based on the installation condition information. The layout design support method according to any one of claims 1 to 4.

6. If adjusting the position of at least one of the aforementioned multiple objects causes the position of other objects to be inconsistent with the installation conditions, a warning is issued. The layout design support method according to any one of claims 1 to 4.

7. If modifying the position of at least one of the aforementioned multiple objects in conjunction with modifying the positions of the other objects does not satisfy the installation conditions, then input conditions for satisfying the installation conditions are presented. The layout design support method according to any one of claims 1 to 4.

8. Based on a trained model trained to output the input conditions that satisfy the installation conditions for correcting the position of at least one object of the plurality of objects, the corresponding input conditions are output for correcting the position of at least one object of the plurality of objects. The arrangement design support method according to claim 7.

9. The information regarding the installation conditions is defined by a table that pre-defines the relationships between the multiple objects. The layout design support method according to any one of claims 1 to 4.

10. The information regarding the installation conditions is defined based on a pre-trained model that describes the relationships between the multiple objects. The layout design support method according to any one of claims 1 to 4.

11. The GUI for receiving the aforementioned acoustic space and the aforementioned input conditions is displayed on the display. When a change in the size of the acoustic space is accepted, the scale of the acoustic space is changed while maintaining the margins in the GUI. The layout design support method according to any one of claims 1 to 4.

12. It accepts input conditions including an acoustic space and the positions of multiple objects within that acoustic space, In the received acoustic space, the arrangement distribution of acoustic equipment corresponding to the received input conditions is calculated. Output the calculated distribution. Processor and An information processing device equipped with, Each of the aforementioned objects includes information on installation conditions, When the processor receives a modification to the input conditions, it modifies the positions of other objects in conjunction with the modification of the position of at least one of the multiple objects, based on the information of the installation conditions. Information processing device.

13. It accepts input conditions including an acoustic space and the positions of multiple objects within that acoustic space, In the received acoustic space, the arrangement distribution of acoustic equipment corresponding to the received input conditions is calculated. Output the calculated distribution. A program that causes an information processing device to execute a process, Each of the aforementioned objects includes information on installation conditions, When the information processing device receives a modification to the input conditions, it is instructed to perform a process to modify the positions of other objects in conjunction with the modification of the position of at least one of the multiple objects, based on the information of the installation conditions. program.

Images