Audio-video system based on uwb positioning and viewing position adaptive method thereof

Abstract

The application provides a video and audio system based on UWB positioning and a viewing position adaptive method thereof, the method comprising: generating a three-dimensional coordinate set by detecting the three-dimensional coordinates of all viewers in a preset space in real time through a UWB sensing module; obtaining the size parameters of a display device and analyzing to obtain viewing adaptation parameters in reference to a preset audio-visual standard; counting the number of current viewers based on the three-dimensional coordinate set and determining a unified reference point coordinate according to the number of viewers; determining the position deviation between the unified reference point coordinate and the regional reference coordinate and performing adaptive correction; generating sound field adjustment instructions and picture adjustment instructions based on the position deviation after adaptive correction and sending them to a sound equipment and a display device respectively; detecting the attention state and the motion state of the viewers based on the time sequence change data of the three-dimensional coordinate set to obtain a state detection result, dynamically adjusting the generation and update of the sound field adjustment instructions and / or the picture adjustment instructions, or performing a playing control operation on the video and audio system.

Description

Technical Field

[0001] This application relates to the field of smart home technology, and in particular to an audio-visual system based on UWB positioning and a method for adaptive viewing position. Background Technology

[0002] With the intelligent development of home audio-visual equipment, audio-visual systems equipped with display and audio devices have been widely used in home viewing scenarios. Traditional audio-visual systems only use fixed picture and sound field configurations, which cannot be adaptively adjusted according to the actual position of the viewer. Users need to manually adjust parameters, resulting in poor operation convenience.

[0003] Existing audio-visual systems with adaptive adjustment capabilities generally lack UWB high-precision sensing capabilities, making it impossible to collect and generate a set of three-dimensional coordinates of viewers in real time. Furthermore, they can only make rough two-dimensional position judgments and cannot determine viewing adaptation parameters based on display device specifications and common preset audio-visual standards, nor can they define a reasonable range for regional reference coordinates and viewing angle boundaries. In addition, existing audio-visual systems cannot determine a unified reference point coordinate based on the number of viewers, making it difficult to determine the positional deviation between the unified reference point coordinate and the regional reference coordinate, thus failing to generate appropriate sound field adjustment commands and picture adjustment commands. Summary of the Invention

[0004] This application provides an audio-visual system based on UWB positioning and its adaptive viewing position method. It can accurately acquire the three-dimensional coordinates of the viewer within a preset space, and obtain viewing adaptation parameters by combining the display device size specifications and preset audio-visual standards. It can differentiate and determine the coordinates of a unified reference point and complete the position deviation solution and adaptation correction. At the same time, it identifies the attention state and motion state based on the viewer's temporal position data, dynamically controls the generation and update of sound field adjustment commands and picture adjustment commands, and links them to execute intelligent audio-visual playback control. This achieves accurate adaptation of the audio-visual system's audio-visual parameters with the viewing position and viewing state, improving the intelligence level and audio-visual experience of home viewing.

[0005] In a first aspect, embodiments of this application provide a viewing position adaptation method for an audio-visual system based on UWB positioning. The audio-visual system includes a display device and an audio device deployed in a preset space. The viewing position adaptation method for the UWB-based audio-visual system includes: real-time detection of the three-dimensional coordinates of all viewers within the preset space using a UWB sensing module, generating a set of three-dimensional coordinates of the viewers; obtaining the size parameters of the display device and resolving them with reference to a preset audio-visual standard to obtain viewing adaptation parameters, the viewing adaptation parameters including regional reference coordinates and viewing angle boundaries, the regional reference coordinates being the coordinates of the viewing center position adapted to the display device within the preset space, and the viewing angle boundaries being used to define the spatial viewing angle range for comfortable viewing; counting the current number of viewers based on the set of three-dimensional coordinates, and determining the coordinates of a unified reference point based on the number of viewers; wherein... When the number of viewers is 1, the 3D coordinates of the viewer are used as the unified reference point coordinates. When the number of viewers is greater than 1, the geometric center of the 3D coordinates of all viewers is fitted and used as the unified reference point coordinates. The positional deviation between the unified reference point coordinates and the regional reference coordinates is determined, and the positional deviation is adapted and corrected in conjunction with the viewpoint boundary. A sound field adjustment command is generated based on the adapted and corrected positional deviation and sent to the audio equipment for execution. A picture adjustment command is generated based on the adapted and corrected positional deviation and sent to the display device for execution. Based on the temporal change data of the 3D coordinate set, the viewer's attention state and motion state are detected, and a state detection result is obtained. According to the state detection result, the generation and updating of the sound field adjustment command and / or picture adjustment command are dynamically adjusted, or playback control operations are performed on the audio-visual system.

[0006] Secondly, embodiments of this application provide an audio-visual system based on UWB positioning. The audio-visual system includes a display device and an audio device deployed in a preset space, as well as a main control device. The main control device is communicatively connected to the display device and the audio device, and includes a memory and a processor. The memory is used to store computer programs, and the processor is used to execute the computer programs to implement the above-mentioned viewing position adaptive method of the UWB positioning-based audio-visual system.

[0007] The aforementioned UWB-based audio-visual system and its adaptive viewing position method utilize a UWB sensing module to acquire the viewer's three-dimensional coordinates. Combined with display device parameters and preset audio-visual standards, it analyzes viewing adaptation parameters to determine a unified reference point coordinate, solve for positional deviations, and perform adaptation correction. It then adaptively generates sound field and image adjustment commands. This solution can identify the viewer's state based on temporal coordinate data, dynamically update commands, and link them to playback and energy-saving control. It also supports multi-user preference fusion and multi-scene adaptation, coupled with auxiliary sensing, module start / stop, and local privacy protection mechanisms. This achieves fully automatic matching of viewing position, state, user preferences, and audio-visual parameters, reducing manual operation and effectively improving device positioning accuracy, adaptive capabilities, and the home viewing experience. Attached Figure Description

[0008] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on the structures shown in these drawings without creative effort.

[0009] Figure 1 The first flowchart illustrates the viewing position adaptation method for an audio-visual system based on UWB positioning provided in this application embodiment.

[0010] Figure 2 A flowchart of step S102 provided in the embodiments of this application.

[0011] Figure 3 A flowchart of step S103 provided in the embodiments of this application.

[0012] Figure 4 A flowchart of step S104 provided in the embodiments of this application.

[0013] Figure 5 A flowchart of step S105 provided in the embodiments of this application.

[0014] Figure 6 A flowchart of step S106 provided in the embodiments of this application.

[0015] Figure 7 A flowchart of step S107 provided in the embodiments of this application.

[0016] Figure 8 The first flowchart of step S108 provided in the embodiments of this application.

[0017] Figure 9The second flowchart of step S108 provided in the embodiments of this application.

[0018] Figure 10 The second flowchart illustrates the viewing position adaptation method for an audio-visual system based on UWB positioning provided in this application embodiment.

[0019] Figure 11 This is a schematic diagram of the viewing adaptation parameters provided in the embodiments of this application.

[0020] Figure 12 This is a structural block diagram of an audio-visual system based on UWB positioning provided in an embodiment of this application.

[0021] Figure 13 A schematic diagram of the internal structure of the main control device for the UWB-based positioning-based audio-visual system viewing position adaptive method provided in the embodiments of this application.

[0022] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0023] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.

[0024] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar planned objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data are interchangeable where appropriate; in other words, the described embodiments are implemented according to a sequence other than that illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, may also include other content; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0025] It should be noted that the use of terms such as "first" and "second" in this application is for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. Furthermore, the technical solutions of the various embodiments can be combined with each other, but this must be based on the ability of a person skilled in the art to implement them. If the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed in this application.

[0026] Please refer to Figure 1 This is a first flowchart of the viewing position adaptation method for an audio-visual system based on UWB positioning provided in this application embodiment. This application provides a viewing position adaptation method for an audio-visual system based on UWB positioning. It relies on UWB positioning technology to achieve high-precision personnel position perception within a preset space. Viewing position adaptation refers to the intelligent adaptation logic that automatically adjusts the audio-visual parameters of the audio-visual system and executes playback control based on the viewer's real-time position, attention, and movement state. The preset space is a home audio-visual enclosed / semi-enclosed space such as a family living room or a dedicated home theater. The audio-visual system includes a display device 300 and an audio device 400 deployed in the preset space. The display device 300 includes, but is not limited to, visual output devices such as LCD TVs, OLED TVs, laser projectors, and LED large screens. The audio device 400 can be an audio output device such as a multi-channel home theater system or stereo speakers. The viewing position adaptation method includes steps S101-S108.

[0027] Step S101: The UWB sensing module detects the three-dimensional coordinates of all viewers in the preset space in real time and generates a set of three-dimensional coordinates of the viewers.

[0028] In step S101, the UWB sensing module is deployed within a preset space. The UWB sensing module 200 is an ultra-wideband positioning sensing unit used to detect the three-dimensional coordinates of people within the space in real time. Specifically, the UWB sensing module 200 performs a full-domain positioning scan of the preset space at a fixed update frequency of no less than 10Hz, collecting the spatial position information of each viewer in real time to obtain the corresponding viewer's real-time three-dimensional coordinates. The UWB sensing module 200 can detect and generate sets of three-dimensional coordinates in different ways for different numbers of viewers. Specifically, for a single viewer, the system continuously collects their temporally changing 3D coordinates and categorizes them into a subset of 3D coordinates specific to that viewer. For multiple viewers, the UWB sensing module 200 distinguishes different viewers based on signal characteristics and spatial independence, assigns an independent identification tag to each viewer, and stores the temporally changing 3D coordinates of each viewer as an independent subset of 3D coordinates. By aggregating the 3D coordinate subsets of all viewers, a set of 3D coordinates for each viewer is formed, achieving a one-to-one correspondence between a single viewer and a subset of 3D coordinates, and between all viewers and the overall set of 3D coordinates. This provides complete temporally changing positional data for subsequent viewer counts, attention state detection, and motion state detection.

[0029] In some feasible embodiments, the UWB sensing module 200 can flexibly select its deployment method according to the preset space's decoration layout and audio-visual system hardware configuration, specifically including the following deployment methods: 1. Embedded and integrated inside the display device 300 or audio device 400, it is integrated with the audio-visual system hardware, saving installation space; 2. It can be detachably connected to the display device 300 in the form of a USB peripheral, adapting to different models of display devices 300 and improving installation versatility; 3. Independently deployed on walls, ceilings, and other locations within a pre-defined space to expand the overall positioning scanning range and ensure positioning without blind spots.

[0030] Under any of the above deployment methods, the positioning accuracy of the UWB sensing module 200 is no less than ±15cm, and the position update frequency is no less than 10Hz, ensuring the accuracy and real-time performance of the viewer's three-dimensional coordinate detection.

[0031] In other feasible embodiments, the UWB sensing module 200 can be paired with at least one auxiliary sensor selected from barometers, passive infrared sensors, microphone arrays, and millimeter-wave radar to improve positioning accuracy. When the UWB signal is blocked, auxiliary sensor data is used to complete the location. The UWB sensing module 200 is only activated when the audio-visual system is in playback mode and is completely turned off during non-use periods to reduce system power consumption. All 3D coordinate sets of viewers collected by the UWB sensing module 200 are processed only within the local home network and are not uploaded to the cloud without explicit user authorization, ensuring user data privacy. Different viewers can also be uniquely identified through UWB tag IDs, improving the accuracy of multi-user differentiation.

[0032] Step S102: Obtain the size parameters of the display device and analyze them with reference to the preset audiovisual standards to obtain the viewing adaptation parameters.

[0033] In step S102, the size parameters are core indicators characterizing the physical specifications of the display device 300, including screen size, screen height, screen width, and diagonal length. The preset audiovisual standard adopts the audiovisual layout and image quality specifications commonly used in the home audiovisual field, and can be formulated according to the ITU-R BT.2020 color gamut standard and IEC 62481 audiovisual standard, used to unify the calculation basis for the optimal viewing area. Viewing adaptation parameters include regional reference coordinates and viewing angle boundaries. The regional reference coordinates are the coordinates of the viewing center position of the adapted display device within the preset space, and the viewing angle boundaries are used to define the spatial viewing angle range for comfortable viewing.

[0034] like Figure 11 As shown, the regional reference coordinates 31 correspond to the center point where the viewing visual effect is optimal for each viewer 2 within the preset space 1, and are determined by the corresponding values ​​on the X-axis, Y-axis, and Z-axis. The viewing angle boundary 32 is used to define a comfortable viewing range without distortion or glare. The optimal viewing area 300' enclosed by the viewing angle boundary 32 together defines the standard viewing area that conforms to the viewing habits of the human eye. In other words, the viewing adaptation parameter 33 is the ideal viewing area limit value that adapts to the physical specifications of the display device 300 and the preset audiovisual standards, and is used to determine the optimal viewing position range within the preset space 1.

[0035] Please refer to Figure 2 This is a flowchart of step S102, a sub-step provided in the embodiments of this application. Obtaining viewing adaptation parameters by referring to preset audiovisual standards includes steps S1021-S1022.

[0036] Step S1021: Obtain the type parameter of the display device.

[0037] In step S1021, the type parameters include at least LCD TVs, OLED TVs, laser projectors, and LED screens, with different type parameters corresponding to different preset audiovisual standards. The preset audiovisual standards can be matched to display devices 300 corresponding to different type parameters, such as LCD TVs, OLED TVs, laser projectors, and LED screens, for differentiated adaptation, and the corresponding standard parameters are called according to the device's display characteristics to complete the calculation.

[0038] Step S1022: Based on the size parameters, type parameters, and corresponding preset audiovisual standards, the viewing adaptation parameters are obtained.

[0039] In step S1022, the type parameter is used to distinguish the light-emitting principle and image presentation characteristics of the display device 300.

[0040] For example, when the display device 300 is an LCD TV, it adopts a backlight emission mode, with fixed brightness uniformity and viewing angle attenuation characteristics. The optimal viewing distance, as specified by the preset audiovisual standard, is 1.5-4 times the screen height, with a horizontal viewing angle range of ±60° and a vertical viewing angle range of ±30°. Based on this, the depth position of the region reference coordinate 31 obtained from the analysis corresponds to the median of the optimal viewing distance, and the coordinates of the viewing angle boundary 32 correspond to the boundary set of the aforementioned viewing angle range.

[0041] When the display device 300 is an OLED TV, it is a self-emissive panel with high color fidelity and a wider viewing angle. The optimal viewing distance, as specified by the preset audiovisual standards, is 1.2-3 times the screen height, and the horizontal viewing angle can be extended to ±70°. Based on this analysis, the depth position of the regional reference coordinate 31 is closer to the screen, and the semi-apex angle of the viewing angle boundary coordinate 32 is larger, resulting in a wider range of comfortable viewing.

[0042] When the display device 300 is a laser projector, it relies on diffuse reflection imaging, resulting in a wider range of viewing distance and angle adaptation. The optimal viewing distance, as specified by the preset audiovisual standards, is 3-6 times the screen width, and the viewing angle range is not limited by the panel's viewing angle. Simultaneously, the three-dimensional positional relationship between the laser projector and the projection screen can be detected in real time. When a positional shift is detected, the regional reference coordinates 31 in the viewing adaptation parameter 3 are dynamically adjusted, and a keystone correction instruction is generated simultaneously to ensure the geometric regularity of the projected image.

[0043] When the display device 300 is an LED large screen, it is mostly a large-size spliced ​​display, mainly designed for long-distance multi-person viewing scenarios. The optimal viewing distance specified by the preset audiovisual standards is 5-10 times the screen height, and the horizontal viewing angle range can be extended to ±80°. Based on this, the depth position of the area reference coordinate 31 obtained by analysis is farther, and the coverage of the viewing angle boundary coordinate 32 is wider, which is suitable for the needs of multiple people watching movies at the same time.

[0044] It should be noted that different types of display devices correspond to different resolution rules. This ensures that the final viewing adaptation parameter 3 matches the actual usage characteristics of the device, providing an accurate benchmark for the adaptation and correction of positional deviations and the adaptive adjustment of sound field and picture in subsequent steps.

[0045] Step S103: Count the number of viewers based on the three-dimensional coordinate set, and determine the coordinates of a unified reference point based on the number of viewers.

[0046] In step S103, the current number of viewers is counted by reading the number of independent 3D coordinate sets in the 3D coordinate set. Each independent 3D coordinate set corresponds to one viewer 2, thus obtaining the number of viewers in the current preset space 1. The unified reference point coordinates are the baseline coordinates representing the overall viewing position of all viewers 2, serving as the core reference point for subsequent calculation of positional deviation. When the current number of viewers is 1, the 3D coordinates of viewer 2 are used as the unified reference point coordinates. When the current number of viewers is greater than 1, the geometric center of the 3D coordinates of all viewers 2 is fitted, and the geometric center is used as the unified reference point coordinates.

[0047] Please refer to Figure 3 This is a flowchart of step S103 provided in the embodiments of this application. Determining the coordinates of a unified reference point based on the number of viewers includes steps S1031-S1033.

[0048] Step S1031: When the number of current viewers is greater than 1, assign a preset weight to each viewer based on the distance and viewing angle between each viewer and the display device.

[0049] In step S1031, the preset weight is a proportional coefficient used to adjust the degree of influence of each viewer's position. The preset weight allocation rule is that the closer the viewer 2 is to the display device 300 and the better the viewing angle directly facing the screen, the higher the preset weight is assigned; conversely, the farther the distance and the more oblique the viewing angle, the lower the preset weight is assigned. For example, the preset weight allocation rule can be: a preset weight of 0.4 corresponds to a distance less than or equal to 1.5 times the screen height, a preset weight of 0.3 corresponds to a distance between 1.5 and 4 times the screen height, and a weight of 0.2 corresponds to a distance greater than 4 times the screen height; the preset weight for a viewing angle directly facing the screen is 0.5, and the preset weight for an oblique angle greater than 30° is 0.2. By allocating weights, the reference value of the core viewing position is highlighted, making the unified reference point more consistent with the actual viewing experience.

[0050] Step S1032: Based on the preset weights and the three-dimensional coordinates of all viewers, the weighted center of the three-dimensional coordinates of all viewers is fitted, and the weighted center is determined as the unified reference point coordinates.

[0051] In step S1032, the weighting center is a comprehensive coordinate point that takes into account the positions and viewing priorities of multiple viewers 2, providing a unified reference benchmark for subsequent determination and correction of positional deviations and generation of audio-visual instructions. The preset weights can be pre-set based on factors such as the distance between the viewer 2 and the display device 300, viewing angle, and viewing priority. Different viewers 2 can correspond to different weight values ​​to reflect the importance of their viewing positions. Methods for fitting the weighting center include, but are not limited to, weighted summation, model fitting, and rule matching; weighted summation is a typical implementation method. For example, taking two viewers 2 as an example, the weighted summation is implemented as follows: multiply each component of the three-dimensional coordinates of each viewer 2 by its corresponding preset weight, sum the results, and then divide by the sum of the preset weights to obtain the comprehensive coordinate values ​​for each dimension. The three-dimensional coordinates of the viewer 2 include horizontal offset on the X-axis, vertical offset on the Y-axis, and depth offset on the Z-axis. Each offset corresponds to... Figure 11 The three-dimensional spatial coordinate axes are shown. Among them, the Z-axis depth offset component can directly reflect the actual viewing distance between the viewer 2 and the display device 300, providing a core basis for subsequent determination of positional deviation, adaptation correction, and generation of sound field adjustment commands and image adjustment commands.

[0052] Understandably, compared to a geometric center that only takes the average of positions, a weighted center can take into account the viewing position priorities of different viewers, making the unified reference point coordinates more in line with the core needs of multi-viewing scenarios. Using the weighted center as the unified reference point coordinates ensures that subsequent sound field adjustment commands and picture adjustment commands generated based on these coordinates can adapt to multi-viewing scenarios, allowing all viewers to obtain a balanced audiovisual experience.

[0053] Step S104: Determine the positional deviation between the coordinates of the unified reference point and the regional reference coordinates, and perform adaptation correction on the positional deviation in conjunction with the viewpoint boundary.

[0054] In step S104, the positional deviation characterizes the overall offset of the unified reference point coordinates relative to the regional reference coordinates 31 in three-dimensional space. Based on the three-dimensional coordinate system of the preset space 1, the correspondence between the unified reference point coordinates and the regional reference coordinates 31 in each dimension is compared to obtain the positional deviation caused by the spatial offset. At the same time, the comfortable viewing space range defined by the viewing angle boundary 32 is used as a constraint to adapt and correct the initial positional deviation, so that the deviation amount on which the subsequent sound field and picture adjustment are based conforms to the constraints of the comfortable viewing angle of the human eye, providing a reasonable benchmark for adaptive audio-visual adjustment.

[0055] Please refer to Figure 4 The flowchart below shows step S104, which is a sub-step provided in the embodiment of this application. Determining the position between the unified reference point coordinates and the regional reference coordinates, and adapting and correcting the position deviation in combination with the viewpoint boundary, includes steps S1041-S1042.

[0056] Step S1041: Determine the spatial offset between the unified reference point and the regional reference coordinates to obtain the positional deviation.

[0057] In step S1041, using the three-dimensional orientation within the preset space 1 as a reference, the coordinates of the unified reference point and the regional baseline coordinates 31 are compared in each dimension to analyze their spatial offsets in the horizontal, vertical, and depth directions. The initial positional deviation is formed by combining the offsets in each dimension, providing the original offset basis for subsequent adaptation and correction. This application only makes an overall determination of spatial offset and does not limit the specific difference calculation method; it can be adapted to various implementation forms such as coordinate comparison and fitting deduction.

[0058] Step S1042: Based on the spatial viewing angle range defined by the viewing angle boundary, perform adaptation and correction processing on the position deviation.

[0059] In step S1042, the comfortable viewing space enclosed by the viewing angle boundary 32 is used as a limiting range to adapt and correct the initial positional deviation. When the coordinates of the unified reference point fall within the viewing angle boundary 32, a reasonable offset is retained; when it exceeds the limiting range of the viewing angle boundary 32, the positional deviation is converged and adapted so that the corrected positional deviation always matches the viewing angle constraint for comfortable viewing, avoiding audio-visual adjustment distortion caused by exceeding the viewing angle, and ensuring the rationality of subsequent sound field adjustment commands and picture adjustment commands.

[0060] Step S105: Generate a sound field adjustment command based on the adapted and corrected position deviation, and send it to the audio equipment for execution.

[0061] In step S105, the position deviation reflects the degree of three-dimensional spatial offset of the current viewing position relative to the optimal viewing reference. The system matches the corresponding sound field adjustment strategy according to the position deviation value and generates a sound field adjustment command that fits the actual viewing position. The sound field adjustment command is used to control the audio output state of the audio equipment 400, including but not limited to the configuration of Head-Related Transfer Function (HRTF) parameters, adjustment of sound field rendering parameters, adjustment of low-frequency sound effect parameters, control of speaker gain matrix, matching of sound pressure level and phase difference, and calibration of dialogue sound image positioning. It can correct the sound field output effect according to the viewing position deviation to ensure that stable and clear sound image positioning and balanced sound effects can be obtained in different viewing positions.

[0062] In some feasible embodiments, the sound field adjustment command may further include a distance linkage adjustment parameter for the subwoofer. Based on the distance between the subwoofer and the coordinates of a unified reference point, the distance linkage adjustment parameter is dynamically adjusted to adjust the low-frequency channel gain, ensuring that the low-frequency sound effect is balanced and full at different locations.

[0063] Please refer to Figure 5 This is a flowchart of step S105 provided in the embodiments of this application. Generating a sound field adjustment command based on the adapted and corrected position deviation includes steps S1051-S1055.

[0064] Step S1051: Based on the coordinates of the unified reference point, dynamically select the HRTF parameters corresponding to the viewing direction to match the dialogue audio-visual image with the viewing direction.

[0065] In step S1051, the HRTF parameters are used to simulate the sound perception characteristics of the human ear in different spatial orientations. The horizontal and vertical azimuth angles of the current viewing position are calculated based on the coordinates of a unified reference point, and the corresponding HRTF parameters are dynamically matched. For example, the horizontal azimuth angle ranges from -90° to 90°, and the vertical azimuth angle ranges from -45° to 45°, ensuring that the dialogue sound image naturally adapts to the viewing orientation, enhancing the immersive sound field.

[0066] Step S1052: Adjust the sound field rendering parameters of the audio equipment according to the positional deviation after adaptation and correction.

[0067] In step S1052, the sound field rendering parameters include, but are not limited to, sound field width, surround sound ratio, reverberation intensity, and sound image diffusion. The X-axis horizontal offset of the adapted and corrected position deviation is used to adjust the left-right balance of the sound field, and the Z-axis depth offset, i.e., the viewing distance, is used to adjust the distance and immersion of the sound field. For example, when the viewing distance is less than 1.5 times the screen height, the sound field width is reduced, while when the viewing distance is greater than 4 times the screen height, the surround sound ratio is increased to make the sound field effect fit the actual viewing position.

[0068] Step S1053: Based on HRTF parameters and sound field rendering parameters, dynamically adjust the positioning of the dialogue sound image so that the dialogue sound image is locked in the center of the display device screen.

[0069] In step S1053, the sound transmission characteristics are corrected by the HRTF parameters, and the sound image offset caused by the position deviation is compensated by the sound field rendering parameters. The sound image offset is calibrated in real time. For example, the compensation value corresponding to the position deviation is in the range of -10dB to 10dB. No matter where the viewer 2 is in the preset space 1, the dialogue sound image can be stably locked in the center of the screen of the display device 300, avoiding the sound image from being out of sync with the screen.

[0070] Step S1054: Adjust the low-frequency sound effect parameters of the audio equipment according to the spatial position corresponding to the coordinates of the unified reference point.

[0071] In step S1054, the low-frequency sound effect parameters include bass gain, low-frequency cutoff frequency, and subwoofer output intensity, which are adjusted in conjunction with the viewing distance corresponding to the coordinates of a unified reference point. Specifically, the closer the viewing distance, the lower the bass gain to avoid overwhelming the viewer with low frequencies; while the farther the viewing distance, the higher the bass gain to enhance the sound atmosphere. At the same time, the low-frequency channel gain is adjusted to match the distance between the subwoofer and the viewer 2, ensuring a balanced and full low-frequency output.

[0072] Step S1055: Generate sound field adjustment instructions based on HRTF parameters, sound field rendering parameters, and low-frequency sound effect parameters.

[0073] In step S1055, the calibrated HRTF parameters, sound field rendering parameters, and low-frequency sound effect parameters are integrated, and the speaker gain matrix, sound pressure level, and phase difference matching data are embedded to generate digital control commands. The commands are then sent to each channel unit of the audio device 400 to drive the audio device 400 to complete the full-range sound field adjustment.

[0074] Step S106: Generate a screen adjustment command based on the adapted and corrected position deviation, and send it to the display device for execution.

[0075] In step S106, the Z-axis depth offset corresponds to the actual viewing distance between viewer 2 and display device 300, serving as the core basis for generating screen adjustment instructions. These instructions are used to adapt to the visual display effect of the current viewing position, including but not limited to brightness parameters, color saturation parameters, contrast parameters, subtitle font size parameters, and screen display ratio parameters. A corresponding screen adjustment strategy is matched based on the actual viewing distance. For example, when the viewing distance is less than 1.5 times the screen height, the brightness is reduced by 20%-30%, while when the viewing distance is greater than 4 times the screen height, the brightness is increased by 10%-20%. Color, contrast, and subtitle font size are adjusted simultaneously to ensure a clear and comfortable visual experience for different viewing positions.

[0076] Please refer to Figure 6 This is a flowchart of step S106, provided in an embodiment of this application. Generating a screen adjustment instruction based on the adapted and corrected positional deviation includes steps S1061-S1065.

[0077] Step S1061: Determine the viewing distance between the viewer and the display device based on the coordinates of the unified reference point.

[0078] In step S1061, the viewing distance is calculated using the difference between the coordinates of the unified reference point and the Z-axis coordinates of the regional reference coordinates 31. The absolute value of the Z-axis depth offset is the current actual viewing distance, which is the core basis for subsequent image parameter adaptation and adjustment.

[0079] Step S1062: When the viewing distance is less than the first preset distance, reduce the brightness and color saturation of the display device.

[0080] In step S1062, the first preset distance can be 1.5 times the screen height. For example, when the viewing distance is less than 1.5 times the screen height, the brightness of the display device 300 will be reduced by 20% to 30%, and the color saturation will be reduced simultaneously to avoid eye glare and excessive color saturation when viewing at close range, thus ensuring visual comfort when watching movies at close range.

[0081] Step S1063: When the viewing distance is greater than the second preset distance, increase the brightness and contrast of the display device.

[0082] In step S1063, the second preset distance is greater than the first preset distance. The second preset distance can be 4 times the screen height. For example, when the viewing distance is greater than 4 times the screen height, the brightness of the display device will be increased by 10% to 20%, and the contrast will be increased simultaneously to compensate for the visual attenuation of the image when viewed from a distance, making the image details clear and distinct.

[0083] Step S1064: Adjust the font size of the subtitles output by the display device according to the viewing distance.

[0084] In step S1064, the font size of the subtitles dynamically adapts to the viewing distance, with the font size being positively correlated with the viewing distance. For example, small subtitles are used when the viewing distance is less than 1.5 times the screen height; medium subtitles are used when the viewing distance is between 1.5 and 4 times the screen height; and large subtitles are used when the viewing distance is greater than 4 times the screen height, ensuring that the subtitles can be clearly read at different viewing distances.

[0085] Step S1065: Generate image adjustment instructions based on the adjusted brightness, color saturation, contrast, and subtitle font size.

[0086] In step S1065, the brightness, color saturation, contrast and subtitle font size parameters after viewing distance calibration are integrated to generate a complete screen control command. The command is transmitted to the control unit of the display device 300 to drive the display device 300 to complete the real-time adaptive adjustment of the screen parameters.

[0087] Step S107: Based on the temporal change data of the three-dimensional coordinate set, detect the viewer's attention state and motion state, and obtain the state detection results.

[0088] In step S107, the temporal change data is continuously collected by the UWB sensing module 200 at an update frequency of no less than 10Hz. This data represents the position sequence of the three-dimensional coordinates of the same viewer 2 at consecutive time points. It can be extracted from the corresponding set of three-dimensional coordinates of the viewer 2 by recording the spatial position change trajectory of the viewer 2 over time. Attention state is used to determine whether the viewer 2 is focused on watching the film while facing the display device 300. It includes focused and unfocused states. For example, if the viewer 2's head turns at an angle exceeding 45° for more than 30 seconds, it is considered unfocused; otherwise, it is focused. Motion state characterizes the spatial movement amplitude and speed of the viewer 2. It includes stationary, slow-moving, and fast-moving states. For example, a position change rate of 0 for more than 10 seconds is considered stationary, and a movement speed exceeding 0.5m / s is considered fast-moving. The state detection result is a comprehensive judgment of attention state and motion state, serving as the core basis for subsequent dynamic adjustment of audio-visual commands and execution of playback control.

[0089] Please refer to Figure 7 This is a flowchart of step S107, provided in the embodiments of this application. Detecting the viewer's attention state and motion state based on the temporal change data of the three-dimensional coordinate set includes steps S1071-S1076.

[0090] Step S1071: Based on the time-series change data, determine whether the viewer's head is facing the display device.

[0091] In step S1071, the temporal change data records the spatial orientation and direction information of the viewer 2 at consecutive time points. By comparing the angle between the current viewing position and the normal direction of the display device 300 screen, it is determined whether the head is facing the display device 300. In this application, the smaller the angle, the higher the degree of facing, which is the basic judgment step for attention state detection.

[0092] Step S1072: When the viewer's head turns beyond a preset angle and the duration exceeds a first preset duration, the viewer's attention state is determined to be in an out-of-focus state.

[0093] In step S1072, the preset angle can be 45°, and the first preset duration can be 30 seconds. For example, when the angle at which the viewer 2's head deviates from the normal direction of the display device 300 screen exceeds 45°, and this deviation continues for more than 30 seconds, the attention state is determined to be an away state; otherwise, it is a focused viewing state.

[0094] Step S1073: When the number of current viewers is greater than 1 and all viewers are determined to be out of attention, determine that the attention state of all viewers is out of attention.

[0095] In step S1073, in a multi-viewer scenario, the attention state of each viewer 2 needs to be determined independently. Only when all viewers 2 meet the conditions of turning their heads beyond a preset angle and the duration exceeding a first preset duration, the overall state is determined to be in a state of leaving, which is used to trigger the subsequent unified playback control logic.

[0096] Step S1074: Determine the motion state of the viewer based on the rate of change of the viewer's three-dimensional coordinates.

[0097] In step S1074, the position change rate is characterized by the continuous positional changes of the three-dimensional coordinates of the viewer 2 in the time-series change data. It can reflect the overall speed of the viewer 2's movement within the preset space 1 and is the core criterion for distinguishing between the three types of motion states of the viewer 2: stationary, slow movement, and fast movement.

[0098] Step S1075: When the rate of change of position is less than or equal to a preset speed threshold, the viewer's motion state is determined to be a slow movement state.

[0099] In step S1075, the preset speed threshold can be 0.5 m / s. For example, when the rate of change of position is ≤0.5 m / s, it is determined to be a slow movement state. More specifically, if the rate of change of position is 0 and lasts for more than 10 seconds, it is determined to be a stationary state.

[0100] Step S1076: When the rate of change of position is greater than the preset speed threshold, the viewer's motion state is determined to be a fast movement state.

[0101] In step S1076, the audio and video parameters are locked during rapid movement to prevent frequent adjustments caused by rapid movement from affecting the user experience.

[0102] Step S108: Based on the status detection results, dynamically adjust the generation and update of sound field adjustment commands and / or picture adjustment commands, or perform playback control operations on the audio-visual system.

[0103] In step S108, the state detection result includes two types of information: attention state and motion state. Based on the detection result, differentiated control logic is executed, including three adjustment scenarios: dynamically adjusting only the sound field adjustment command, dynamically adjusting only the picture adjustment command, and dynamically adjusting both the sound field adjustment command and the picture adjustment command simultaneously. The playback control operation is an active management behavior of the audio-visual system in response to changes in the viewing state, used to optimize the user experience and reduce device power consumption.

[0104] For example, when viewer 2 is moving rapidly, the generation and updating of sound field adjustment commands and picture adjustment commands are paused, and the current audio and video parameters are locked to avoid frequent fluctuations. When viewer 2 is moving slowly or stationary, the sound field adjustment commands are updated separately, the picture adjustment commands are updated separately, or both types of commands are updated simultaneously, depending on the viewing needs. When viewer 2's attention is off for more than 10 minutes, playback control is executed, directly reducing the volume of the audio device 400 by 50%, pausing audio and video playback, and turning off the backlight of the display device 300; when only some of viewer 2's attention is off, only the volume is lowered without triggering a pause, thus accommodating the viewing needs of the remaining viewer 2.

[0105] In some feasible embodiments, the system can automatically switch between single-person viewing mode and family viewing mode based on the number of viewers 2, and recommend content based on viewers 2's age information. Specifically, during late-night hours when outdoor activity is detected, the system automatically increases the intensity of conversations and reduces low-frequency sound effects to avoid disturbing others' rest; it can also automatically identify different viewing scenarios such as home theater, watching alone, exercising, and gaming, and match corresponding preset audio-visual modes to improve scene adaptability.

[0106] Please refer to Figure 8 This is the first flowchart of sub-step S108 provided in the embodiments of this application. The generation and updating of dynamic adjustment sound field adjustment instructions and / or screen adjustment instructions include steps S108a1-S108a3.

[0107] Step S108a1: When the movement is determined to be slow, a low-pass filter with a preset time constant is used to smooth the timing change data, and new sound field adjustment instructions and picture adjustment instructions are generated.

[0108] In step S108a1, the preset time constant can be 500ms. For example, a low-pass filtering algorithm with a 500ms time constant is used to smooth and reduce noise in the time-varying data, eliminating minor positional jitter caused by slow movement and avoiding frequent jumps in sound field and picture parameters. Based on the smoothed position data, stable and adapted new sound field adjustment instructions and picture adjustment instructions are generated to ensure a smooth transition of audio and video effects.

[0109] In step S108a2, when the state is determined to be fast movement, stop generating new sound field adjustment commands and picture adjustment commands, and lock the current sound field adjustment parameters and picture adjustment parameters.

[0110] In step S108a2, if the position of the viewer 2 changes drastically in a short period of time while in a fast-moving state, the acquisition of new position data will be stopped automatically and the generation of new instructions will be terminated. The currently locked sound field adjustment parameters and image adjustment parameters will remain unchanged. The parameter update logic will be restored after the viewer 2 resumes a slow-moving or stationary state.

[0111] In step S108a3, when the viewer leaves the preset space for more than the second preset time, the video playback of the audio-visual system is paused and the light output of the display device is reduced.

[0112] In step S108a3, the second preset duration can be 10 minutes. For example, after the viewer 2 leaves the preset space 1 and the timeout exceeds 10 minutes, the video playback will be automatically paused, the volume of the audio device 400 will be reduced by 50%, and the backlight of the display device 300 will be turned off. This replaces simply reducing the light output, which improves the viewing experience while reducing the energy consumption of the device and realizing intelligent energy-saving management.

[0113] In some feasible embodiments, reducing the light output of the display device 300 includes directly turning off the backlight of the display device 300, further reducing standby power consumption.

[0114] Please refer to Figure 9 This is the second flowchart of sub-step S108 provided in the embodiments of this application. Performing playback control operations on the audio-visual system includes steps S108b1-S108b2.

[0115] Step S108b1: When it is determined that all viewers' attention is focused away, pause the video playback of the audio-visual system and adjust the volume of the audio equipment from the default volume to the preset volume ratio.

[0116] In step S108b1, all viewers 2 are in an "away" state, meaning that none of them can receive video and audio information normally. At this time, energy-saving noise reduction control logic is executed. For example, the preset volume ratio is 50% of the original default volume. Lowering the volume can reduce unnecessary sound interference in the preset space 1, and pausing video playback can reduce the power consumption of the display device by 300 watts, avoiding unnecessary operation and wasting hardware resources.

[0117] Step S108b2: When it is detected that any viewer is facing the display device again, resume video playback of the audio-visual system and restore the volume of the audio equipment from the preset volume ratio to the default volume.

[0118] In step S108b2, as soon as the viewer 2's head is detected facing the return screen normal direction, the viewing state is immediately restarted. At this time, the video content from the paused node continues to play, the audio volume is simultaneously raised back to the initial default level, and the audio and video parameters are also simultaneously adapted to match the current viewing position to ensure a natural and smooth viewing experience.

[0119] In some feasible embodiments, the system can automatically switch between single-person / family viewing modes and provide content-based recommendations based on the number of viewers. Specifically, during late-night hours and when outdoor activity is detected, the system automatically enhances conversations and reduces low-frequency sound effects; it can also automatically identify different viewing scenarios such as home theater, watching alone, exercising, and gaming, and match corresponding preset audio-visual modes.

[0120] Please refer to Figure 10 This is a second flowchart of the viewing position adaptation method for an audio-visual system based on UWB positioning provided in this application embodiment. The viewing position adaptation method further includes steps S201-S202.

[0121] In step S201, the UWB sensing module distinguishes different viewers and records the historical brightness, volume and seat preference information of each viewer to obtain the corresponding viewer's preference parameters.

[0122] In step S201, the UWB sensing module 200 uses the unique identifier of the UWB tag combined with signal feature differences to distinguish the identity of viewer 2, binding a corresponding identification number to each user and accurately classifying different viewer identities. Historical brightness refers to the screen brightness value that viewer 2 habitually sets during previous viewings; historical volume refers to the preferred audio output volume; and seat preference information refers to the viewing position that viewer 2 has consistently chosen. By continuously archiving and retaining various personalized usage data, these are aggregated and integrated to form the corresponding preference parameters for viewer 2, which are then used for subsequent personalized audiovisual adjustments.

[0123] Step S202: According to the preset weight ratio, the viewer's preference parameters are integrated with the sound field adjustment parameters and the picture adjustment parameters to generate sound field adjustment instructions and picture adjustment instructions.

[0124] In step S202, the preset weight ratio adopts a fixed proportion. For example, the personal preference parameter accounts for 40%, and the sound field adjustment parameter and picture adjustment parameter calculated based on the viewing position account for 60% in total. The mutual integration is based on the weight coefficient. The viewer 2's preference parameter, sound field adjustment parameter and picture adjustment parameter are weighted and calculated separately and then superimposed and integrated. This not only preserves the viewer 2's daily viewing habits, but also matches the optimal audiovisual standard corresponding to the current actual viewing position. After the integration is completed, more adaptable sound field adjustment command and picture adjustment command are output.

[0125] Please refer to Figure 12This is a structural block diagram of an audio-visual system based on UWB positioning provided in an embodiment of this application. This application also provides an audio-visual system 1000 based on UWB positioning. The audio-visual system 1000 includes a display device 300 and an audio device 400 deployed in a preset space 1, as well as a main control device 100. The main control device 100 is communicatively connected to both the display device 300 and the audio device 400. The main control device 100 can be any one of the following: a stand-alone computer device, a main control chip built into a smart TV, a network set-top box, a home theater amplifier, a whole-house smart central control unit, a laptop computer, or a tablet computer; or it can be a dedicated control unit integrated within the display device 300 or the audio device 400.

[0126] In this embodiment, the audio-visual system 1000 also includes a UWB sensing module 200. The main control device 100 and the UWB sensing module 200 are communicatively connected, so that the main control device 100, in conjunction with the UWB sensing module 200, can complete all core functions such as UWB positioning data parsing and processing, audio-visual parameter calculation and instruction generation, playback control logic execution, and user preference data storage and fusion.

[0127] Please refer to Figure 13 This is a schematic diagram of the internal structure of the main control device for the UWB-based audio-visual system viewing position adaptive method provided in the embodiments of this application.

[0128] like Figure 13 As shown, the main control device 100 includes a memory 901 and a processor 902. The processor 902 is used to run computer program instructions stored in the memory 901 to implement a viewing position adaptive method for an audio-visual system based on UWB positioning.

[0129] The memory 901 includes at least one type of readable storage medium, including flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 901 can be an internal storage unit of a computer device, such as a hard disk. In other embodiments, the memory 901 can be an external storage device of a computer device, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, Flash Card, etc., configured in the computer device. Furthermore, the memory 901 can include both internal and external storage units of a computer device. The memory 901 can be used not only to store application software and various types of data installed on the computer device, such as code for a viewing position adaptation method of an audio-visual system based on UWB positioning, but also to temporarily store data that has been output or will be output.

[0130] Furthermore, the main control device 100 also includes a bus 903. The bus 903 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. This bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 13 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0131] Furthermore, the main control device 100 may also include a display component 904. The display component 904 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, or an organic light-emitting diode (OLED) touch screen, etc. The display component 904 may also be appropriately referred to as a display device or display unit, used to display information processed in the main control device 100 and to display a visual user interface.

[0132] Furthermore, the main control device 100 may also include a communication component 905. The communication component 905 may optionally include a wired communication component and / or a wireless communication component (such as a Wi-Fi communication component, a Bluetooth communication component, etc.), which is typically used to establish a communication connection between the main control device 100 and other computer devices.

[0133] Figure 13 Only a partial view position adaptation method for an audio-visual system based on UWB positioning is shown. Those skilled in the art will understand that... Figure 13 The structure shown does not constitute a limitation on the main control device 100, and may include fewer or more components than shown, or combine certain components, or have different component arrangements.

[0134] In the above embodiments, the implementation can be achieved, in whole or in part, through software, hardware, or any combination thereof. When implemented using software, it can be implemented, in whole or in part, in the form of a computer program product.

[0135] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to embodiments of the present invention is generated. The computer device may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).

[0136] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0137] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between devices or units through some interfaces, and may be electrical, mechanical, or other forms.

[0138] The unit described as a separate component may or may not be physically separate. The component shown as a unit may or may not be a physical unit; that is, it may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0139] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist independently, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0140] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes: USB flash drives, portable hard disks, read-only storage media (ROM), random access storage media (RAM), magnetic disks, optical disks, and other media capable of storing program code.

[0141] In the above embodiments, the UWB sensing module is used to acquire the viewer's three-dimensional coordinates. Combined with display device parameters and preset audiovisual standards, viewing adaptation parameters are analyzed to complete the determination of unified reference point coordinates, position deviation calculation, and adaptation correction, adaptively generating sound field and picture adjustment commands. This solution can identify the viewer's state based on time-series coordinate data, dynamically update commands, and link them to achieve playback and energy-saving control. It also supports multi-user preference fusion and multi-scene adaptation. With auxiliary sensing, module start / stop, and local privacy protection mechanisms, it can achieve fully automatic matching of viewing position, state, user preferences, and audiovisual parameters, reducing manual operation and effectively improving device positioning accuracy, adaptability, and home viewing experience.

[0142] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

[0143] It should be understood that although the steps in the flowcharts of the accompanying figures are shown sequentially as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the accompanying figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0144] The above-listed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.

Claims

1. A viewing position adaptive method for an audio-visual system based on UWB positioning, the audio-visual system comprising a display device and an audio device deployed in a preset space, characterized in that, The viewing position adaptive method for the UWB-based audio-visual system includes: The UWB sensing module detects the three-dimensional coordinates of all viewers in the preset space in real time and generates a set of three-dimensional coordinates of the viewers. The UWB sensing module is deployed in the preset space. The size parameters of the display device are obtained, and the viewing adaptation parameters are obtained by referring to the preset audiovisual standards. The viewing adaptation parameters include regional reference coordinates and viewing angle boundaries. The regional reference coordinates are the coordinates of the viewing center position of the display device within the preset space, and the viewing angle boundaries are used to define the spatial viewing angle range for comfortable viewing. The number of current viewers is counted based on the set of three-dimensional coordinates, and a unified reference point coordinate is determined based on the number of viewers. Specifically, when the number of current viewers is 1, the three-dimensional coordinates of the viewer are used as the unified reference point coordinates. When the number of current viewers is greater than 1, the geometric center of the three-dimensional coordinates of all viewers is fitted and used as the unified reference point coordinates. Determine the positional deviation between the coordinates of the unified reference point and the coordinates of the regional reference point, and adapt and correct the positional deviation in conjunction with the viewpoint boundary; A sound field adjustment command is generated based on the adapted and corrected positional deviation and sent to the audio equipment for execution; Based on the adapted and corrected positional deviation, a screen adjustment command is generated and sent to the display device for execution; Based on the temporal change data of the three-dimensional coordinate set, the viewer's attention state and motion state are detected, and the state detection results are obtained. Based on the status detection results, dynamically adjust the generation and updating of the sound field adjustment command and / or picture adjustment command, or perform playback control operations on the audio-visual system.

2. The viewing position adaptive method as described in claim 1, characterized in that, The viewing adaptation parameters are obtained by referring to the preset audiovisual standards, including: Obtain the type parameters of the display device, which include at least LCD TV, OLED TV, laser projector and LED large screen, and different type parameters correspond to different preset audio-visual standards; The viewing adaptation parameters are obtained by analyzing the size parameters, type parameters, and corresponding preset audiovisual standards.

3. The viewing position adaptive method as described in claim 1, characterized in that, Determine the coordinates of a unified reference point based on the number of viewers, including: When the number of current viewers is greater than 1, a preset weight is assigned to each viewer based on the distance and viewing angle between each viewer and the display device. Based on the preset weights and the three-dimensional coordinates of all viewers, a weighted center of the three-dimensional coordinates of all viewers is fitted, and the weighted center is determined as the coordinates of the unified reference point.

4. The viewing position adaptive method as described in claim 1, characterized in that, Determine the positional deviation between the coordinates of the unified reference point and the coordinates of the regional reference point, and perform adaptation correction on the positional deviation in conjunction with the viewpoint boundary, including: Determine the spatial offset between the unified reference point and the regional reference coordinates to obtain the positional deviation; Based on the spatial viewpoint range defined by the viewpoint boundary, the positional deviation is adapted and corrected.

5. The viewing position adaptive method as described in claim 1, characterized in that, Sound field adjustment commands are generated based on the adapted and corrected positional deviation, including: Based on the coordinates of the unified reference point, the HRTF parameters corresponding to the viewing position are dynamically selected to match the dialogue audio-visuals with the viewing position. The sound field rendering parameters of the audio equipment are adjusted according to the adapted and corrected positional deviation. Based on the HRTF parameters and sound field rendering parameters, the positioning of the dialogue sound image is dynamically adjusted so that the dialogue sound image is locked in the center of the screen of the display device. Adjust the low-frequency sound effect parameters of the audio equipment according to the spatial position corresponding to the coordinates of the unified reference point; The sound field adjustment command is generated based on the HRTF parameters, sound field rendering parameters, and low-frequency sound effect parameters.

6. The viewing position adaptive method as described in claim 1, characterized in that, Based on the adapted and corrected positional deviation, image adjustment instructions are generated, including: The viewing distance between the viewer and the display device is determined based on the coordinates of the unified reference point. When the viewing distance is less than a first preset distance, reduce the brightness and color saturation of the display device; When the viewing distance is greater than the second preset distance, the brightness and contrast of the display device are increased, where the second preset distance is greater than the first preset distance; Adjust the font size of the subtitles output by the display device according to the viewing distance; The image adjustment instructions are generated based on the adjusted brightness, color saturation, contrast, and subtitle font size.

7. The viewing position adaptive method as described in claim 1, characterized in that, Based on the temporal variation data of the aforementioned three-dimensional coordinate set, the viewer's attention state and motion state are detected, including: Based on the time-series change data, it is determined whether the viewer's head is facing the display device; When a viewer's head turns beyond a preset angle and the duration exceeds a first preset duration, the viewer's attention state is determined to be in an detached state. When the number of current viewers is greater than 1 and all viewers are determined to be out of attention, the attention state of all viewers is determined to be out of attention. The motion state of the viewer is determined based on the rate of change of the viewer's three-dimensional coordinates. When the rate of change of position is less than or equal to a preset speed threshold, the viewer's motion state is determined to be a slow movement state. When the rate of change of position is greater than a preset speed threshold, the viewer's motion state is determined to be a rapid movement state.

8. The viewing position adaptive method as described in claim 7, characterized in that, Dynamically adjusting the generation and updating of the sound field adjustment commands and / or image adjustment commands, including: When the movement is determined to be slow, a low-pass filter with a preset time constant is used to smooth the time-series change data, generating new sound field adjustment instructions and image adjustment instructions. When a rapid movement state is detected, stop generating new sound field adjustment commands and image adjustment commands, and lock the current sound field adjustment parameters and image adjustment parameters. When a viewer leaves the preset space for more than a second preset time, the video playback of the audio-visual system is paused, and the light output of the display device is reduced.

9. The viewing position adaptive method as described in claim 7, characterized in that, Performing playback control operations on the audio-visual system includes: When it is determined that all viewers' attention has left the video, the video playback of the audio-visual system is paused, and the volume of the audio equipment is adjusted from the default volume to a preset volume ratio. When any viewer is detected to be facing the display device again, the video playback of the audio-visual system is resumed, and the volume of the audio device is restored from the preset volume ratio to the default volume.

10. The viewing position adaptive method as described in claim 1, characterized in that, The viewing position adaptive method further includes: The UWB sensing module distinguishes different viewers and records the historical brightness, volume, and seating preference information of each viewer to obtain the viewer's preference parameters. According to a preset weight ratio, the viewer's preference parameters are integrated with the sound field adjustment parameters and the picture adjustment parameters to generate the sound field adjustment command and the picture adjustment command.

11. An audio-visual system based on UWB positioning, characterized in that, The audio-visual system includes: Display and audio equipment deployed in a pre-defined space; and The main control device, which is communicatively connected to the display device and the audio device respectively, includes: Memory, used to store computer programs; and A processor for executing the computer program to implement the viewing position adaptive method for an audio-visual system based on UWB positioning as described in any one of claims 1-10.

Images