A method and system for optimizing the layout of a wireless home theater

Abstract

This invention relates to the field of home theater technology, specifically to a layout optimization method and system for wireless home theaters. The method includes: an environmental sensor performing a 3D scan of the room to generate point clouds and boundary models, extracting room length, width, height, and furniture occlusion parameters; based on the scanned indoor parameters and furniture parameters, generating an editable model in virtual space corresponding to the real scene at a 1:1 scale, setting constraints, and obtaining a furniture layout diagram; using acoustic, visual, and wireless performance as constraints, and the poses of furniture and audio-visual equipment as variables, optimizing the furniture layout based on the layout diagram to obtain the optimal layout scheme, or manually adjusting until the error is less than a set threshold; repeating steps S1-S3 when new furniture is added or the number of viewers changes to complete incremental optimization. The advantages of this invention are: it can prevent high frequencies from being absorbed by soft packaging and low frequencies from being reflected by cabinets, prevent signal attenuation by metal or glass, and reduce the workload of subsequent manual adjustments.

Description

Technical Field

[0001] This invention relates to the field of home theater technology, and specifically to a layout optimization method and system for a wireless home theater. Background Technology

[0002] In general, home theaters can be understood by combining two concepts: "home theater standards" and "the playback system for playing movies in a home environment." The playback system mainly consists of three parts: audio / video player, AV amplifier, and speaker system. Existing wireless home theater layout methods are all based on "fixed furniture," only optimizing the position of audio-visual equipment such as speakers and screens. If the furniture is large or has a special style, high frequencies are often absorbed by soft materials, low frequencies are reflected by cabinets, the bottom edge of the screen is blocked by sofa backs, and 2.4 GHz / 5 GHz / 6 GHz signals are attenuated by metal / glass. Users are often forced to rearrange the furniture, but manual attempts are time-consuming and lack quantitative data. Therefore, we propose a layout optimization method for wireless home theaters. Summary of the Invention

[0003] To address the shortcomings of existing technologies, this invention provides a layout optimization method for wireless home theaters, comprising:

[0004] S1: The environmental sensor performs a 3D scan of the interior, generates point cloud and boundary model, and extracts the room's length, width, height, and furniture occlusion parameters;

[0005] S2: Based on the indoor and furniture parameters obtained from the scan, generate an editable model in the virtual space that corresponds to the real scene in a 1:1 ratio, set constraints, and obtain the furniture layout diagram;

[0006] S3: With acoustic, visual, and wireless performance as constraints and the poses of furniture and audio-visual equipment as variables, it optimizes the furniture layout based on the furniture layout diagram to obtain the optimal layout scheme, drives the electric slide rails of the furniture / speaker rails, or manually adjusts them until the error is less than the set threshold.

[0007] S4: When new furniture is added or the number of viewers changes, repeat S1-S3 to complete incremental optimization.

[0008] Furthermore, the extraction of room length, width, height, and furniture occlusion parameters includes,

[0009] A1: Use radar equipment to acquire room parameters and take photos of the room furniture. The method for taking the furniture photos is to take a set of photos every five degrees around the furniture.

[0010] A2: Label the photos, indicating the material of the furniture in the photos and marking the movable parts of the furniture;

[0011] A3: Segment the photo, construct a large Swin Transformer model, and use the large Swin Transformer model to extract features from the segmented photo to obtain multi-size feature maps.

[0012] A4: Classify the multi-size feature maps, then merge the classified images, and use the features from the classification as labels to concatenate them to obtain a furniture report.

[0013] Furthermore, the method for obtaining the furniture layout diagram is as follows:

[0014] The multi-size feature map classification is as follows: the pixels of the multi-size feature map are classified to obtain the category of the feature map, then different individuals of the same category are separated and labeled, the material of each area is determined, and finally the movable distance of the furniture is determined based on the pre-labeled movable parts of the furniture.

[0015] Furthermore, the method for obtaining the furniture layout diagram is as follows:

[0016] B1: Obtain the center coordinates and orientation of all furniture, create a cuboid bounding box for all furniture, the bounding box can surround the furniture, and place all furniture in the room;

[0017] B2: Calculate the distance d between any two pieces of furniture, and calculate the quadratic incremental penalty value, where the calculation formula is: ;

[0018] B3: The formula for calculating the optimal distance between the sofa and the screen is:

[0019]

[0020] in, As weight, This is the actual distance from the center of the sofa to the screen. ideal

[0021] The baseline value for comfortable sight distance:

[0022] B4: Calculate the angle θ between each piece of furniture (R) and the wall. The total penalty value for all furniture is:

[0023]

[0024] Where k is a proportionality constant, It is the angle between the i-th piece of furniture and the wall;

[0025] B5: Will The three values ​​are added together to get the total value E, and the angle E of the furniture is adjusted to be minimized.

[0026] Furthermore, the optimized furniture layout includes,

[0027] C1: Randomly generate a population P, each representing a layout scheme for a shadow device. Calculate the objective function for each individual x. ;

[0028] in, Total acoustic energy, Total visual energy Total wireless performance energy;

[0029] C2: Perform non-dominated sorting on population P, dividing individuals into different frontier layers. The first layer consists of all non-dominated individuals, the second layer consists of non-dominated individuals after removing the first layer, and so on. Calculate the crowding degree for individuals within each frontier layer.

[0030] C3: Select individuals from population P to generate offspring population Q, prioritizing non-dominant individuals, and perform crossover and mutation operations on offspring population Q to generate new individuals;

[0031] C4: Merge the parent population P and the offspring population Q into R, perform non-dominated sorting and crowding calculation on R, select the top N individuals as the new parent population P, select individuals from the non-dominated front layer of the final population P, and output the optimal layout scheme, including the position and angle of the audio-visual equipment.

[0032] Furthermore, the method for driving the furniture's electric slide rail / speaker track, or manually adjusting it, until the error is less than a set threshold, is as follows:

[0033] Obtain the optimal layout by centering the center positions and angles of all furniture and audio equipment. If the furniture can be automatically adjusted, ensure that all motorized slides and speaker tracks are in their initial positions. Activate sensors and measuring devices to measure the acoustic, visual, and wireless performance parameters under the current layout and calculate the error for each parameter. If all errors are less than the set threshold, the adjustment is complete, and the current layout is recorded. If any error is greater than the threshold, adjust the position of the motorized slides or speaker tracks according to the direction and magnitude of the error. Repeat the above steps until all errors are less than the set threshold.

[0034] If the furniture cannot be automatically adjusted, mark key positions on the floor or wall, use a level and angle measuring tools to ensure the equipment angle is correct, remeasure and record the data after each adjustment, and make gradual fine adjustments based on the error to avoid over-adjustment.

[0035] The present invention also provides a layout optimization system for a wireless home theater, comprising:

[0036] Acquisition module: Acquires real-time 3D point clouds of the room and furniture through cameras and millimeter-wave radar;

[0037] Semantic parsing module: Collects the size, style, material, and mobility tags for each piece of furniture;

[0038] Digital twin module: Generates an editable model in virtual space that corresponds 1:1 to the real scene;

[0039] Joint optimization steps: Constrained by acoustic, visual, and wireless performance, and based on the orientation of furniture and audio-visual equipment.

[0040] Variables are used to run a multi-objective optimization algorithm to obtain the Pareto optimal layout;

[0041] Adjustment module: Drives the furniture's electric slide rails / speaker tracks, or adjusts them manually until the error is less than the set threshold.

[0042] The beneficial effects of this invention are reflected in:

[0043] 1. Utilize radar equipment to acquire room and furniture parameters, and mark the furniture's material and movable parts. Extract features from the furniture, classify pixels in multi-size feature maps to obtain feature map categories, separate and label different individuals of the same category, determine the material of each area, and finally determine the movable distance of the furniture based on the pre-labeled movable parts to facilitate subsequent furniture placement and ensure that furniture does not overlap. Place all furniture in the indoor model and calculate the total penalty value of the furniture. Adjust the furniture positions based on the penalty value to obtain the optimal furniture layout. Then, based on the optimal furniture layout, adjust the positions of audio-visual equipment with acoustic, visual, and wireless performance constraints to obtain the optimal layout scheme. Optimizing the furniture layout first and then the audio-visual equipment layout reduces computational pressure and complexity, ensuring the accuracy of the optimal layout scheme. Adjust and install furniture and audio-visual equipment according to the optimal layout scheme to prevent high frequencies from being absorbed by soft packaging, low frequencies from being reflected by cabinets, and signals from being attenuated by metal or glass, reducing the workload of subsequent manual adjustments. Attached Figure Description

[0044] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. The elements or parts in the drawings are not necessarily drawn to scale.

[0045] Figure 1 This is a flowchart illustrating a layout optimization method for a wireless home theater according to the present invention. Detailed Implementation

[0046] The embodiments of the technical solution of the present invention will now be described in detail with reference to the accompanying drawings. These embodiments are merely illustrative of the technical solution of the present invention and are therefore intended to limit the scope of protection of the present invention.

[0047] It should be noted that, unless otherwise stated, the technical or scientific terms used in this application should have the ordinary meaning as understood by one of ordinary skill in the art to which this invention pertains.

[0048] like Figure 1 As shown, a layout optimization method for a wireless home theater includes,

[0049] S1: The environmental sensor performs a 3D scan of the interior, generates point cloud and boundary model, and extracts the room's length, width, height, and furniture occlusion parameters;

[0050] S2: Based on the indoor and furniture parameters obtained from the scan, generate an editable model in the virtual space that corresponds to the real scene in a 1:1 ratio, set constraints, and obtain the furniture layout diagram;

[0051] S3: With acoustic, visual, and wireless performance as constraints and the poses of furniture and audio-visual equipment as variables, it optimizes the furniture layout based on the furniture layout diagram to obtain the optimal layout scheme, drives the electric slide rails of the furniture / speaker rails, or manually adjusts them until the error is less than the set threshold.

[0052] S4: When new furniture is added or the number of viewers changes, repeat S1-S3 to complete incremental optimization.

[0053] In this embodiment, the extraction of room length, width, height, and furniture occlusion parameters includes,

[0054] A1: Use radar equipment to acquire room parameters and take photos of the room furniture. The method for taking the furniture photos is to take a set of photos every five degrees around the furniture.

[0055] A2: Label the photos, indicating the material of the furniture in the photos and marking the movable parts of the furniture;

[0056] A3: Segment the photo, construct a large Swin Transformer model, and use the large Swin Transformer model to extract features from the segmented photo to obtain multi-size feature maps.

[0057] A4: Classify the multi-size feature maps, then merge the classified images, and use the features from the classification as labels to concatenate them to obtain a furniture report.

[0058] In this embodiment, the method for obtaining the furniture layout diagram is as follows:

[0059] The multi-size feature map classification is as follows: the pixels of the multi-size feature map are classified to obtain the category of the feature map, then different individuals of the same category are separated and labeled, the material of each area is determined, and finally the movable distance of the furniture is determined based on the pre-labeled movable parts of the furniture.

[0060] In this embodiment, the method for obtaining the furniture layout diagram is as follows:

[0061] B1: Obtain the center coordinates and orientation of all furniture, create a cuboid bounding box for all furniture, the bounding box can surround the furniture, and place all furniture in the room;

[0062] B2: Calculate the distance d between any two pieces of furniture, and calculate the quadratic incremental penalty value, where the calculation formula is: ;

[0063] B3: The formula for calculating the optimal distance between the sofa and the screen is:

[0064]

[0065] in, As weight, This is the actual distance from the center of the sofa to the screen. ideal

[0066] The baseline value for comfortable sight distance:

[0067] B4: Calculate the angle θ between each piece of furniture (R) and the wall. The total penalty value for all furniture is:

[0068]

[0069] Where k is a proportionality constant, It is the angle between the i-th piece of furniture and the wall;

[0070] B5: Will The three values ​​are added together to get the total value E, and the angle E of the furniture is adjusted to be minimized.

[0071] In this embodiment, the optimized furniture layout includes,

[0072] C1: Randomly generate a population P, each representing a layout scheme for a shadow device. Calculate the objective function for each individual x. ;

[0073] in, Total acoustic energy, Total visual energy Total wireless performance energy;

[0074] C2: Perform non-dominated sorting on population P, dividing individuals into different frontier layers. The first layer consists of all non-dominated individuals, the second layer consists of non-dominated individuals after removing the first layer, and so on. Calculate the crowding degree for individuals within each frontier layer.

[0075] C3: Select individuals from population P to generate offspring population Q, prioritizing non-dominant individuals, and perform crossover and mutation operations on offspring population Q to generate new individuals;

[0076] C4: Merge the parent population P and the offspring population Q into R, perform non-dominated sorting and crowding calculation on R, select the top N individuals as the new parent population P, select individuals from the non-dominated front layer of the final population P, and output the optimal layout scheme, including the position and angle of the audio-visual equipment.

[0077] In this embodiment, the method for driving the electric slide rail / speaker track of the furniture, or adjusting it manually, until the error is less than a set threshold, is as follows:

[0078] Obtain the optimal layout by centering the center positions and angles of all furniture and audio equipment. If the furniture can be automatically adjusted, ensure that all motorized slides and speaker tracks are in their initial positions. Activate sensors and measuring devices to measure the acoustic, visual, and wireless performance parameters under the current layout and calculate the error for each parameter. If all errors are less than the set threshold, the adjustment is complete, and the current layout is recorded. If any error is greater than the threshold, adjust the position of the motorized slides or speaker tracks according to the direction and magnitude of the error. Repeat the above steps until all errors are less than the set threshold.

[0079] If the furniture cannot be automatically adjusted, mark key positions on the floor or wall, use a level and angle measuring tools to ensure the equipment angle is correct, remeasure and record the data after each adjustment, and make gradual fine adjustments based on the error to avoid over-adjustment.

[0080] A layout optimization system for a wireless home theater, characterized in that it includes:

[0081] Acquisition module: Acquires real-time 3D point clouds of the room and furniture through cameras and millimeter-wave radar;

[0082] Semantic parsing module: Collects the size, style, material, and mobility tags for each piece of furniture;

[0083] Digital twin module: Generates an editable model in virtual space that corresponds 1:1 to the real scene;

[0084] Joint optimization steps: Constrained by acoustic, visual, and wireless performance, and based on the orientation of furniture and audio-visual equipment.

[0085] Variables are used to run a multi-objective optimization algorithm to obtain the Pareto optimal layout;

[0086] Adjustment module: Drives the furniture's electric slide rails / speaker tracks, or adjusts them manually until the error is less than the set threshold.

[0087] This embodiment discloses a computer-readable storage medium, including a memory, a processor, and a computer program stored on the memory and running on the processor. When the processor executes the computer program, it implements a layout optimization method for a wireless home theater as described in any of the above methods.

[0088] The above formulas are all dimensionless calculations. The formulas are derived from software simulations based on a large amount of collected data to obtain the most recent real-world results. The preset parameters, weights, and thresholds in the formulas are set by those skilled in the art according to the actual situation.

[0089] The above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any other combination thereof. When implemented using software, the above embodiments can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, all or part of the flow or function according to the embodiments of the present invention is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. Computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired or wireless network. A computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more sets of available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. A semiconductor medium can be a solid-state drive.

[0090] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed in this invention can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0091] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0092] In the several embodiments provided by this invention, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only one method, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0093] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0094] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0095] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be covered within the scope of the claims and specification of the present invention.

Claims

1. A layout optimization method for a wireless home theater, characterized in that: include, S1: The environmental sensor performs a 3D scan of the interior, generates point cloud and boundary model, and extracts the room's length, width, height, and furniture occlusion parameters; S2: Based on the indoor and furniture parameters obtained from the scan, generate an editable model in the virtual space that corresponds to the real scene in a 1:1 ratio, set constraints, and obtain the furniture layout diagram; S3: With acoustic, visual, and wireless performance as constraints and the poses of furniture and audio-visual equipment as variables, it optimizes the furniture layout based on the furniture layout diagram to obtain the optimal layout scheme, drives the electric slide rails of the furniture / speaker rails, or manually adjusts them until the error is less than the set threshold. S4: When new furniture is added or the number of viewers changes, repeat S1-S3 to complete incremental optimization.

2. The layout optimization method for a wireless home theater according to claim 1, characterized in that: The extraction of room length, width, height, and furniture occlusion parameters includes, A1: Use radar equipment to acquire room parameters and take photos of the room furniture. The method for taking the furniture photos is to take a set of photos every five degrees around the furniture. A2: Label the photos, indicating the material of the furniture in the photos and marking the movable parts of the furniture; A3: Segment the photo, construct a large Swin Transformer model, and use the large Swin Transformer model to extract features from the segmented photo to obtain multi-size feature maps. A4: Classify the multi-size feature maps, then merge the classified images, and use the features from the classification as labels to concatenate them to obtain a furniture report.

3. The layout optimization method for a wireless home theater according to claim 2, characterized in that: The method for obtaining the furniture layout diagram is as follows: The multi-size feature map classification is as follows: the pixels of the multi-size feature map are classified to obtain the category of the feature map, then different individuals of the same category are separated and labeled, the material of each area is determined, and finally the movable distance of the furniture is determined based on the pre-labeled movable parts of the furniture.

4. The layout optimization method for a wireless home theater according to claim 1, characterized in that: The method for obtaining the furniture layout diagram is as follows: B1: Obtain the center coordinates and orientation of all furniture, create a cuboid bounding box for all furniture, the cuboid bounding box can surround the furniture, and place all furniture in the room; B2: Calculate the distance d between any two pieces of furniture, and calculate the quadratic incremental penalty value, where the calculation formula is: ; B3: The formula for calculating the optimal distance between the sofa and the screen is: in, As weight, This is the actual distance from the center of the sofa to the screen. ideal The baseline value for comfortable sight distance: B4: Calculate the angle θ between each piece of furniture (R) and the wall. The total penalty value for all furniture is: Where k is a proportionality constant, It is the angle between the i-th piece of furniture and the wall; B5: Will The three values ​​are added together to get the total value E, and the angle E of the furniture is adjusted to be minimized.

5. The layout optimization method for a wireless home theater according to claim 3, characterized in that: The optimized furniture layout include, C1: Randomly generate a population P, where each scheme represents a layout scheme for an audio-visual device. Calculate the objective function for each individual x. ; in, Total acoustic energy, Total visual energy Total wireless performance energy; C2: Perform non-dominated sorting on population P, dividing individuals into different frontier layers. The first layer consists of all non-dominated individuals, the second layer consists of non-dominated individuals after removing the first layer, and so on. Calculate the crowding degree for individuals within each frontier layer. C3: Select individuals from population P to generate offspring population Q, prioritizing non-dominant individuals, and perform crossover and mutation operations on offspring population Q to generate new individuals; C4: Merge the parent population P and the offspring population Q into R, perform non-dominated sorting and crowding calculation on R, select the top N individuals as the new parent population P, select individuals from the non-dominated front layer of the final population P, and output the optimal layout scheme, including the position and angle of the audio-visual equipment.

6. The layout optimization method for a wireless home theater according to claim 4, characterized in that: The method for achieving the goal of driving the furniture's electric slide rail / speaker track, or adjusting it manually until the error is less than a set threshold, is as follows: Obtain the optimal layout by centering the center positions and angles of all furniture and audio equipment. If the furniture can be automatically adjusted, ensure that all motorized slides and speaker tracks are in their initial positions. Activate sensors and measuring devices to measure the acoustic, visual, and wireless performance parameters under the current layout and calculate the error for each parameter. If all errors are less than the set threshold, the adjustment is complete, and the current layout is recorded. If any error is greater than the threshold, adjust the position of the motorized slides or speaker tracks according to the direction and magnitude of the error. Repeat the above steps until all errors are less than the set threshold. If the furniture cannot be automatically adjusted, mark key positions on the floor or wall, use a level and angle measuring tools to ensure the equipment angle is correct, remeasure and record the data after each adjustment, and make gradual fine adjustments based on the error to avoid over-adjustment.

7. A layout optimization system for a wireless home theater, characterized in that, The layout optimization method for a wireless home theater according to any one of claims 1-6 includes: Acquisition module: Acquires real-time 3D point clouds of the room and furniture through cameras and millimeter-wave radar; Semantic parsing module: Collects the size, style, material, and mobility tags for each piece of furniture; Digital twin module: Generates an editable model in virtual space that corresponds 1:1 to the real scene; Joint optimization steps: Constrained by acoustic, visual, and wireless performance, and based on the orientation of furniture and audio-visual equipment. Variables are used to run a multi-objective optimization algorithm to obtain the Pareto optimal layout; Adjustment module: Drives the furniture's electric slide rails / speaker tracks, or allows for manual adjustment until the error is less than the set value. Threshold.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, When the processor executes the computer program, it implements the layout optimization method for a wireless home theater as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed, implements the layout optimization method for a wireless home theater as described in any one of claims 1 to 6.

Images