Multimedia display system

Abstract

The invention provides a multimedia display system, which relates to the technical field of multimedia display, and comprises a multimedia display device and a control module, obtaining the depth distance, the shoulder and neck position estimation height and the vertical pitch angle between each user directly facing the target touch display and the touch display; determining a dynamic weight corresponding to each user; determining the height of the target touch display; dividing the users into a primary user group and a secondary user group according to the appearing area and frame number of each user in the detection video; determining the pitch angle of the target touch display according to the number of users in the main user group and the normal direction of the sight line of each user; determining a distance between the target touch display and a main user group center according to the size of the target touch display and the type of the display content; according to the method, the parameters of the touch display are accurately adjusted in real time, and the interactive experience, the system efficiency and the equipment reliability in a multi-user environment are remarkably improved.

Description

Technical Field

[0001] The present invention relates to the technical field of multimedia display, and particularly to a multimedia display system. Background Art

[0002] In the field of multimedia display, traditional touch display adjustment systems mostly adopt fixed installation or simple mechanical adjustment methods, which have the following significant defects: Lack of multi-user adaptability: Existing systems cannot dynamically adjust touch display parameters according to the real-time distribution and personalized needs (such as height, viewing angle) of multiple users, resulting in a degraded experience when multiple users use it simultaneously. For example, a touch display with a fixed height cannot accommodate users of different heights, and manual adjustment devices are cumbersome to operate and have a lag in response.

[0003] Insufficient line-of-sight interaction ability: Most systems do not integrate user line-of-sight tracking technology and cannot identify the focus of users' attention, resulting in a disconnection between touch display parameter adjustment and users' actual needs. For example, although hydraulic devices support height adjustment, they cannot sense whether the user is actually looking at the touch display, causing waste of resources.

[0004] Low maintenance and intelligence level: Existing solutions rely on manual intervention for maintenance and lack intelligent decision-making algorithms, making it difficult to efficiently handle complex scenarios (such as the dynamic flow of users in exhibition, education, etc. scenarios).

[0005] In view of the above problems, there is an urgent need for a display system that can real-time sense the user state, make intelligent decisions, and automatically adjust touch display parameters to improve the interaction experience and system efficiency in a multi-user environment. Summary of the Invention

[0006] For the above technical problems, the technical solution adopted by the present invention is as follows: According to the first aspect of the present application, there is provided a multimedia display system, the system comprising: a multimedia display device and a control module; wherein, the control module is communicatively connected to the multimedia display device; the multimedia display device includes a plurality of touch displays, and the rotation angle and height of each touch display are adjustable; The control module is configured to perform the following steps: S100, obtaining the depth distance between each user facing the target touch display and the touch display, estimating the height based on the shoulder and neck positions, and the vertical pitch angle; the target touch display is any one of the touch displays; S200, obtaining the residence time ratio and line-of-sight focus degree of each user's line of sight on the target touch display, and determining the dynamic weight corresponding to each user; S300. Determine the height of the target touch display according to the depth distance between each user and the target touch display, the estimated height, the vertical pitch angle of the user, and the dynamic weight corresponding to each user, based on the shoulder and neck positions of the user. S400. Divide the users into a primary user group and a secondary user group according to the area and number of frames in which each user appears in the detection video. S500. Determine the pitch angle of the target touch display according to the number of users in the primary user group and the normal direction of the line of sight of each user. S600. Determine the distance between the target touch display and the center of the primary user group according to the size of the target touch display and the type of the displayed content.

[0007] Furthermore, the height of the target touch display satisfies the following relationship: H target =∑ n i=1 (η×h i +γ×z i ×tanβ i ) / ∑ n i=1 ω i +Δh; Where, H target is the height of the target touch display, η is the preset estimated height weight, h i is the estimated height of the shoulder and neck position of the i-th user, γ is the preset depth distance weight, z i is the depth distance between the i-th user and the target touch display, β i is the vertical pitch angle of the i-th user, ω i is the dynamic weight of the i-th user, Δh is the preset environmental compensation factor, and n is the number of users corresponding to the target touch display.

[0008] Furthermore, η = 0.92 and γ = 0.15.

[0009] Furthermore, step S400 includes the following steps: S410. Obtain the three-dimensional coordinates, timestamps, and unique identifiers of each user. S420. Set parameters, including: Spatial density threshold: ≤ 3 people per square meter, and the neighborhood radius ε is determined by on-site measurement of the scene; Temporal continuity: The user needs to stay in the same area for 5 consecutive frames; Minimum number of cluster points MinPts: Set according to the density threshold; S430. Maintain a sliding window of length 5 frames for each user to record their historical positions. S440, if the user is in the same neighborhood in the current frame and the past four frames, mark as a stable user.

[0010] Further, step S500 includes the following steps: S510, if the number of users in the primary user group is 1, adjust the pitch angle of the target touch display so that the target touch display faces the normal direction of the user's line of sight; S520, if the number of users in the primary user group is greater than 1, obtain the average normal of the lines of sight of all users in the primary user group; proceed to S530; S530, adjust the pitch angle of the target touch display so that the target touch display faces the average normal direction of the lines of sight of the users.

[0011] Further, step S600 includes the following steps: S610, if the content displayed on the target touch display is of the text reading type, determine the distance L between the target touch display and the center of the primary user group optimal = 1.2D × 2.54; where D is the size of the target touch display; S620, if the content displayed on the target touch display is of the audio-visual viewing type, determine the distance L between the target touch display and the center of the primary user group optimal = 0.8D × 2.54.

[0012] Further, the multimedia display device further includes: a chassis, the upper surface of the chassis is fixedly connected to the bottom end of the column, the upper end of the column is fixedly connected to the bottom surface of the fixed disk, and the upper surface of the fixed disk is connected to the display mechanism; A plurality of screw holes five are provided on the fixed disk, and the plurality of screw holes five are respectively threadedly connected to the bottom ends of a plurality of bolts two, and the upper ends of the plurality of bolts two are all connected to the display mechanism. A plurality of universal wheels are provided on the bottom surface of the chassis.

[0013] Further, the display mechanism includes: an installation box, a plurality of screw holes two are provided on the bottom surface of the installation box, and the plurality of screw holes two are respectively threadedly connected to the upper ends of a plurality of bolts two, and the bottom surface of the installation box is lapped on the upper surface of the fixed disk.

[0014] Further, through grooves are provided on four vertical surfaces of the installation box, and lifting plates are sleeved in the four through grooves; Screw holes three are provided at the opposite ends of the four lifting plates, and the four screw holes three are respectively threadedly connected to four screw rods one; The bottom ends of the four screw rods I are respectively fixedly connected to the output shafts of four motors, the bottoms of the four motors are fixedly connected to the inner bottom surface of the installation box, the input ends of the four motors are respectively electrically connected to the output ends of four controllers, and the four controllers are respectively fixedly arranged on the four vertical surfaces of the column; The opposite ends of the four lifting plates are respectively fixedly connected to the outer sides of four placing disks, and each placing disk internally places a touch display.

[0015] Furthermore, the bottom end of the touch display abuts against the inner side surface of the baffle, the bottom surface of the baffle is fixedly connected to the inner bottom surface of the placing disk, and the upper end of the touch display abuts against the inner side surface of the limiting plate; The upper end of the limiting plate is sleeved in the groove, the groove is opened on the upper inner side surface of the placing disk, and the middle part of the upper surface of the limiting plate is rotationally connected to the bottom end of the screw rod II through a bearing; The screw rod II is in threaded connection with the screw hole IV, and the screw hole IV is opened on the upper surface of the placing disk and is communicated with the groove through; The upper surface of the installation box abuts against the bottom surface of the cover plate, screw holes I are opened at the four corners of the cover plate and the four corners of the upper surface of the installation box, and the two upper and lower corresponding screw holes I are in threaded connection with the same bolt I. An inspection groove corresponding to the cover plate is opened on the upper surface of the installation box.

[0016] The present invention has at least the following beneficial effects: The multimedia display system of the present invention, by obtaining the user's depth distance, height estimation and vertical pitch angle in real time, combining dynamic weight distribution, accurately calculates the height of the touch display, ensures that users of different heights can obtain the best viewing angle, and avoids the problem of viewing angle occlusion; based on the division of the main user group and the secondary user group, it gives priority to responding to the needs of core users, while taking into account secondary users, and improves the collaborative experience in multi-user scenarios; quantifies the user priority through the proportion of the user's line-of-sight residence time and focus degree, and the dynamic weight mechanism ensures that resources are tilted towards core users; adjusts the pitch angle of the touch display according to the line-of-sight normal direction of the main user group, makes the touch display face the user's line of sight directly, reduces visual fatigue, and improves the readability of the content; combines the size of the touch display and the content type, dynamically adapts the optimal viewing distance, and enhances the display effect; distinguishes stable users and temporary users, avoids interference with the parameter adjustment of the touch display by passers-by, and improves the system stability. The present invention realizes the real-time and accurate adjustment of the touch display parameters by integrating multi-modal perception, intelligent decision-making and electromechanical linkage technologies, and significantly improves the interaction experience, system efficiency and equipment reliability in multi-user environments. Description of the Drawings

[0017] To more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0018] Figure 1 is a front view structural schematic diagram of the multimedia display device provided by the embodiment of the present invention; Figure 2 is a structural schematic diagram of the column provided by the embodiment of the present invention; Figure 3 is a front view structural schematic diagram of the display mechanism provided by the embodiment of the present invention; Figure 4 is a front view sectional structural schematic diagram of the display mechanism provided by the embodiment of the present invention; Figure 5 is a structural schematic diagram provided by the embodiment of the present invention; Figure 6 is a flowchart of the steps executed by the control module of the multimedia display system provided by the embodiment of the present invention; Symbol description: 1, chassis; 2, universal wheel; 3, controller; 4, column; 5, display mechanism; 51, installation box; 52, placement tray; 53, baffle; 54, touch display; 55, bolt one; 56, cover plate; 57, screw hole one; 58, screw hole two; 59, limiting plate; 510, groove; 511, maintenance slot; 512, screw hole three; 513, lifting plate; 514, through slot; 515, screw rod one; 516, motor; 517, screw rod two; 518, screw hole four; 6, screw hole five; 7, fixed plate; 8, bolt two. Detailed implementation manners

[0019] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present invention.

[0020] It should be noted that based on the present disclosure, those skilled in the art should understand that one aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects described herein can be used to implement the device and / or practice the method. Additionally, this device can be implemented and this method can be practiced using other structures and / or functions in addition to one or more of the aspects described herein.

[0021] The following will introduce a multimedia display system with reference to Figure 1 the flowchart of the steps executed by the control module of the multimedia display system shown.

[0022] As Figures 1 to 5 shown, the multimedia display system includes: a multimedia display device and a control module; wherein, the control module is communicatively connected to the multimedia display device; the multimedia display device includes a plurality of touch displays, and the rotation angle and height of each touch display are adjustable.

[0023] Furthermore, the multimedia display device further includes: a chassis 1, the upper surface of the chassis 1 is fixedly connected to the bottom end of a column 4, the upper end of the column 4 is fixedly connected to the bottom surface of a fixed disk 7, and the upper surface of the fixed disk 7 is connected to a display mechanism 5.

[0024] A plurality of fifth screw holes 6 are formed in the fixed disk 7, the plurality of fifth screw holes 6 are respectively threadedly connected to the bottom ends of a plurality of second bolts 8, the upper ends of the plurality of second bolts 8 are all connected to the display mechanism 5, and a plurality of universal wheels 2 are arranged on the bottom surface of the chassis 1. By providing the fifth screw holes 6, the second screw holes 58 and the second bolts 8, the fixed disk 7 is connected to the installation box 51, so as to facilitate maintenance personnel to disassemble and assemble the installation box 51, and remove the installation box 51 to facilitate maintenance operations on the display mechanism 5.

[0025] Furthermore, the display mechanism 5 includes an installation box 51, a plurality of second screw holes 58 are formed in the bottom surface of the installation box 51, the plurality of second screw holes 58 are respectively threadedly connected to the upper ends of a plurality of second bolts 8, and the bottom surface of the installation box 51 abuts against the upper surface of the fixed disk 7.

[0026] Furthermore, through grooves 514 are formed in four vertical surfaces of the installation box 51, and lifting plates 513 are sleeved in the four through grooves 514.

[0027] Furthermore, third screw holes 512 are formed at the opposite ends of the four lifting plates 513, and the four third screw holes 512 are respectively threadedly connected to four first screws 515.

[0028] Further, the bottom ends of the four first screws 515 are respectively fixedly connected to the output shafts of the four motors 516. The bottom ends of the four motors 516 are fixedly connected to the inner bottom surface of the mounting box 51. The input ends of the four motors 516 are respectively electrically connected to the output ends of the four controllers 3. The four controllers 3 are respectively fixedly arranged on the four vertical surfaces of the column 4. When a user uses this device, they can stand in front of one of the touch displays 54 and can, according to their own needs, use the controller 3 in front of them to control the corresponding motor 516 to work and drive the first screw 515 to rotate. When the first screw 515 rotates, it drives the lifting plate 513, the placement plate 52 and the touch display 54 to move up and down through the third screw hole 512, so that when this device is in use, the height of multiple touch displays 54 can be adjusted individually according to the user's needs, avoiding affecting other users when multiple users use it simultaneously, and effectively improving the practicability of this device.

[0029] Further, the opposite ends of the four lifting plates 513 are respectively fixedly connected to the outer sides of the four placement plates 52. Each placement plate 52 houses a touch display 54 inside.

[0030] Further, the bottom end of the touch display 54 abuts against the inner side surface of the baffle 53. The bottom surface of the baffle 53 is fixedly connected to the inner bottom surface of the placement plate 52. The upper end of the touch display 54 abuts against the inner side surface of the limiting plate 59. By providing the baffle 53 and the limiting plate 59 inside the placement plate 52, the touch display 54 is fixed inside the placement plate 52 by the baffle 53 and the limiting plate 59. When the touch display 54 needs to be repaired and replaced later, the user can rotate the second screw 517 so that the second screw 517 moves upward along the fourth screw hole 518 and drives the limiting plate 59 to move upward and separate from the touch display 54, thus facilitating the user to disassemble and assemble the touch display 54.

[0031] Further, the upper end of the limiting plate 59 is sleeved inside the groove 510. The groove 510 is opened on the upper inner side surface of the placement plate 52. The middle of the upper surface of the limiting plate 59 is rotatably connected to the bottom end of the second screw 517 by a bearing.

[0032] Further, the second screw 517 is threadedly connected to the fourth screw hole 518. The fourth screw hole 518 is opened on the upper surface of the placement plate 52 and is in through communication with the groove 510.

[0033] Furthermore, the upper surface of the installation box 51 abuts against the bottom surface of the cover plate 56. Screw holes 57 are provided at the four corners of the cover plate 56 and the four corners of the upper surface of the installation box 51. Two vertically corresponding screw holes 57 are threadedly connected to the same bolt 55. A maintenance slot 511 corresponding to the cover plate 56 is provided on the upper surface of the installation box 51. By providing the maintenance slot 511 above the installation box 51 and setting the screw holes 57 and bolts 55 to connect the cover plate 56 to the installation box 51 to close the maintenance slot 511, during subsequent maintenance work, the maintenance personnel can remove the cover plate 56 and perform maintenance on the internal structure of the installation box 51 through the maintenance slot 511.

[0034] The specific working principle is as follows: When the device is working, multiple touch displays 54 can be used to display the content. When the user uses the device, the user can stand in front of one of the touch displays 54, and can control the corresponding motor 516 to work according to their own needs to drive the rotation of the first screw 515. When the first screw 515 rotates, it drives the lifting plate 513, the placement plate 52 and the touch display 54 to move up and down through the third screw hole 512. When the touch display 54 in front is adjusted to the appropriate height, the motor 516 can be turned off.

[0035] When the maintenance personnel need to perform maintenance on the touch display 54, at this time, the maintenance personnel can rotate the second screw 517 so that the second screw 517 moves upward along the fourth screw hole 518 to drive the limiting plate 59 to move upward. When the limiting plate 59 completely moves into the groove 510 and disengages from the touch display 54, stop rotating the second screw 517. At this time, the maintenance personnel can lift the touch display 54 upward so that the bottom end of the touch display 54 moves above the baffle 53, and then take out the touch display 54 from the placement plate 52. And the maintenance personnel can take out the bolt 55 from the screw hole 57 to remove the cover plate 56, and take out the bolt 8 from the screw holes 58 and 5 to remove the installation box 51, and perform maintenance on the internal structure of the installation box 51 through the maintenance slot 511.

[0036] As Figure 6 shown, the control module is used to execute the following steps: S100, obtain the depth distance, estimated height of the shoulder and neck position, and vertical pitch angle between each user facing the target touch display and the touch display; the target touch display is any touch display.

[0037] In this embodiment, a hybrid detection system composed of a binocular camera and a TOF (Time of Flight) sensor is mounted on the top of the multimedia display device. The binocular camera obtains the three-dimensional coordinates of the user (horizontal position on the X-axis, vertical height on the Y-axis, and depth distance on the Z-axis) through the principle of parallax, while the TOF sensor measures the precise distance between the user and the screen (accuracy ±1 cm) through laser pulses. The system scans once every 0.1 second and can track the spatial coordinates of 10 users simultaneously.

[0038] Based on the OpenPose skeleton recognition algorithm, the height of the user is estimated (error ≤ 3 cm) by analyzing the relative positions of the user's shoulder and neck parts. At the same time, the pupil tracking technology is used to detect whether the user's line of sight focus falls within the effective display area of the screen, and the line of sight projection angles (horizontal deflection angle α, vertical pitch angle β) are recorded.

[0039] S200. Obtain the residence time ratio and line of sight focus degree of each user's line of sight on the target touch display, and determine the dynamic weight corresponding to each user.

[0040] In this embodiment, the system generates a dynamic weight coefficient for each user, which is composed of two dimensions: "residence time ratio (0 - 100%)" and "line of sight focus degree (0 - 1)". For example, the weight of a user who continuously gazes at the screen for 5 minutes is 6 times that of a user who passes by briefly, ensuring that parameter adjustment gives priority to serving core users.

[0041] S300. Determine the height of the target touch display according to the depth distance between each user and the target touch display, the estimated height of the user's shoulder and neck position, the user's vertical pitch angle, and the dynamic weight corresponding to each user.

[0042] Furthermore, the height of the target touch display satisfies the following relationship: H target =∑ n i=1 (η×h i +γ×z i ×tanβ i ) / ∑ n i=1 ω i +Δh; where, H target is the height of the target touch display, η is the preset estimated height weight, h i is the estimated height of the shoulder and neck position of the i-th user, γ is the preset depth distance weight, z i is the depth distance between the i-th user and the target touch display, β i is the vertical pitch angle of the i-th user, ω iis the dynamic weight of the i-th user, Δh is a preset environmental compensation factor, and n is the number of users corresponding to the target touch display. Δh is an empirical value that can be obtained through a large number of experiments.

[0043] Further, η = 0.92 and γ = 0.15.

[0044] S400. Divide users into a primary user group and a secondary user group according to the area and number of frames in which each user appears in the detection video.

[0045] In this embodiment, an improved DBSCAN density clustering algorithm is used to divide the users in the detection area into an effective audience group: Spatial density threshold: Taking the center of the screen as the origin, a maximum of 3 people are allowed per square meter.

[0046] Temporal continuity: Appearing in the same area for 5 consecutive frames (about 0.5 seconds) is regarded as a stable user.

[0047] Clustering output: Generate a primary user group (>60% weight) and a secondary user group (<40% weight).

[0048] Further, step S400 includes the following steps: S410. Obtain the three-dimensional coordinates, timestamps, and unique identifiers of each user.

[0049] S420. Set parameters, including: Spatial density threshold: ≤3 people per square meter, and the neighborhood radius ε is determined through on-site measurement of the scene; Temporal continuity: The user needs to stay in the same area for 5 consecutive frames; Minimum number of clustering points MinPts: Set according to the density threshold; S430. Maintain a sliding window with a length of 5 frames for each user to record their historical positions. S440. If the user is in the same neighborhood in the current frame and the past 4 frames, mark it as a stable user.

[0050] In this embodiment, a detailed explanation of the implementation steps of the improved DBSCAN clustering: 1. Data preprocessing and parameter setting: Input data: The real-time three-dimensional coordinates (X, Y, Z), timestamps, and unique user identifiers of users in each frame.

[0051] Parameter definition: Spatial density threshold: ≤3 people per square meter, corresponding to the neighborhood radius ε (calibrated through on-site measurement of the scene).

[0052] Temporal continuity: Staying for 5 consecutive frames (0.5 seconds) is regarded as a stable user.

[0053] Weight threshold: The total weight of the primary user group > 60%, and the secondary user group < 40%.

[0054] 2. Temporal continuity detection: User trajectory tracking: Maintain a sliding window of length 5 for each user to record their positions in the last 5 frames. If the user has been continuously in the same neighborhood (spatial distance < ε) in the current frame and the past 4 frames, mark as a stable user.

[0055] Dynamic update: Update the window data for each frame and remove expired frame information.

[0056] 3. Improved DBSCAN algorithm process: Neighborhood expansion rule: Only consider the points of stable users for clustering.

[0057] Neighborhood query range: Points that satisfy temporal continuity in the current frame and the past 4 frames.

[0058] Core point determination: If the ε-neighborhood of a point contains at least MinPts stable users (MinPts is set according to the density threshold, e.g., MinPts = 3), mark as a core point.

[0059] Cluster expansion and merging: Starting from the core point, recursively merge all density-reachable stable user points. If two clusters overlap in space-time (spatial distance < ε and time window is continuous), merge them into the same cluster.

[0060] Noise filtering: Non-stable user points that cannot be assigned to any cluster are regarded as noise (such as passers-by).

[0061] 4. Weight calculation and cluster classification: Weight aggregation: The weight of each user is calculated by the residence duration ratio and the line-of-sight focus degree (e.g., Weight = Residence duration × Focus degree).

[0062] Total cluster weight = The sum of the weights of all users within the cluster.

[0063] Primary and secondary user group division: Primary user group: Total cluster weight > 60% and the number of users ≥ 1.

[0064] Secondary user group: Total cluster weight < 40% or user density is lower than the threshold.

[0065] Dynamic adjustment: Recalculate the weights and update the cluster classification for each frame.

[0066] 5. Output and execution: Output results: The coordinate range, average height, and line-of-sight focus area of the primary user group. Distribution statistics of the secondary user group.

[0067] Screen adjustment strategy: The core adjustment of the screen height and pitch angle is driven by the main user group. The secondary user group is only used as a reference to avoid over-responding to temporary users.

[0068] 6. Key implementation details: Algorithm optimization: Spatial indexing (such as KD-Tree) is adopted to accelerate neighborhood queries. Multiple frames of data are processed in parallel to improve real-time performance.

[0069] Exception handling: When a user suddenly leaves the scene, clear their historical trajectory data. For trajectory breaks caused by short-term occlusion, complete them through interpolation or prediction.

[0070] 7. Example scenario: Suppose there are 5 users in the scenario: Users A and B continuously gaze at the screen for 5 frames, with weights of 0.9 and 0.8 respectively; Users C and D stay briefly for 2 frames, with a weight of 0.3; User E passes by for 1 frame, with a weight of 0.1.

[0071] Clustering process: Users A and B are marked as stable users and form the main cluster (total weight = 0.9 + 0.8 = 1.7, accounting for 85%); Users C and D are grouped into the secondary cluster due to discontinuous time (total weight = 0.3 + 0.3 = 0.6, accounting for 30%); User E is regarded as noise.

[0072] Execution effect: The screen preferentially adapts to the needs of Users A and B, and secondary adjustments take into account C and D.

[0073] Through the improved DBSCAN algorithm that fuses spatio-temporal constraints and combines dynamic weight calculation, accurate division of the primary and secondary user groups is achieved. This method not only ensures real-time performance but also significantly improves the accuracy of screen adaptive adjustment and the user experience in multi-user scenarios.

[0074] S500, Determine the pitch angle of the target touch display according to the number of users in the main user group and the line-of-sight normal direction of each user.

[0075] Further, step S500 includes the following steps: S510, If the number of users in the main user group is 1, then adjust the pitch angle of the target touch display so that the target touch display faces the user's line-of-sight normal direction.

[0076] S520, If the number of users in the main user group is greater than 1, then obtain the average user line-of-sight normal of all users in the main user group; enter S530.

[0077] S530, Adjust the pitch angle of the target touch display so that the target touch display faces the average user line-of-sight normal direction.

[0078] Through the above steps, the pitch angle of the target screen can cover the vast majority of the main users, providing a better viewing experience for the main users.

[0079] S600. Determine the distance between the target touch display and the center of the main user group according to the size of the target touch display and the type of content to be displayed.

[0080] Further, step S600 includes the following steps: S610. If the content displayed on the target touch display is of the text reading type, determine the distance L between the target touch display and the center of the main user group optimal = 1.2D × 2.54; where D is the size of the target touch display.

[0081] S620. If the content displayed on the target touch display is of the audio-visual viewing type, determine the distance L between the target touch display and the center of the main user group optimal = 0.8D × 2.54.

[0082] In this embodiment, by combining the screen size and the content type, the optimal viewing distance is dynamically adapted (for example, 1.2 times the screen width viewing distance is adopted in the text reading mode, and 0.8 times in the video mode), enhancing the display effect.

[0083] In this embodiment, the vertical lifting module: uses a planetary roller screw (lead 5 mm), in cooperation with an absolute encoder (resolution 0.01 mm), with a maximum stroke of 800 mm.

[0084] The pitch adjustment mechanism: a harmonic reducer (reduction ratio 1:120) + a worm and worm gear, with an angle range of -15° to +30°.

[0085] The yaw rotation base: a crossed roller bearing + a servo motor, with a rotation speed of 0.1 to 1.2 rad / s.

[0086] The core of this system lies in the deep integration of traditional mechanical adjustment and intelligent sensing technology. By establishing a closed-loop control system of "acquisition - decision - execution - optimization", the multi-screen interaction device is enabled to have the ability to adapt to the environment.

[0087] In this embodiment, by obtaining the user's depth distance, height estimation, and vertical pitch angle in real time, and combining dynamic weight allocation, the height of the touch display is accurately calculated to ensure that users of different heights can obtain the best viewing angle and avoid the problem of viewing angle occlusion. Based on the division of the primary user group and the secondary user group, the core user needs are preferentially responded to, while the secondary users are taken into account to improve the collaborative experience in multi-user scenarios. The user priority is quantified by the proportion of the user's gaze residence time and focus, and the dynamic weight mechanism ensures that resources are tilted towards the core users. The pitch angle of the touch display is adjusted according to the line-of-sight normal direction of the primary user group, so that the touch display faces the user's line of sight directly, reducing visual fatigue and improving the readability of the content. Combining the size of the touch display and the content type, the optimal viewing distance is dynamically adapted to enhance the display effect. Stable users and temporary users are distinguished to avoid interference with the parameter adjustment of the touch display by passers-by, improving the system stability. Through the integration of multi-modal perception, intelligent decision-making, and electromechanical linkage technologies, the present invention realizes the real-time and accurate adjustment of the parameters of the touch display, significantly improving the interaction experience, system efficiency, and device reliability in multi-user environments.

[0088] In addition, although the steps of the methods in the present disclosure are described in a specific order in the drawings, this does not require or imply that these steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step for execution, and / or one step may be decomposed into multiple steps for execution, etc.

[0089] Although some specific embodiments of the present invention have been described in detail by way of examples, those skilled in the art should understand that the above examples are only for illustration purposes and not for limiting the scope of the present invention. Those skilled in the art should also understand that various modifications can be made to the embodiments without departing from the scope and spirit of the present invention.

Claims

1. A multimedia display system, characterized in that, The system includes: a multimedia display device and a control module; wherein, the control module is communicatively connected to the multimedia display device; the multimedia display device includes a plurality of touch displays, and the rotation angle and height of each touch display are adjustable; The control module is used to perform the following steps: S100. Obtain the depth distance between each user facing the target touch display and the touch display, estimate the height based on the shoulder and neck positions of the user, and the vertical pitch angle; the target touch display is any one of the touch displays; S200. Obtain the dwell time ratio and line-of-sight focus degree of each user's line of sight on the target touch display, and determine the dynamic weight corresponding to each user; S300. Determine the height of the target touch display according to the depth distance between each user and the target touch display, the estimated height of the user based on the shoulder and neck positions of the user, the user's vertical pitch angle, and the dynamic weight corresponding to each user; S400. Divide the users into a primary user group and a secondary user group according to the area and number of frames where each user appears in the detection video; S500. Determine the pitch angle of the target touch display according to the number of users in the primary user group and the line-of-sight normal direction of each user; S600. Determine the distance between the target touch display and the center of the primary user group according to the size of the target touch display and the type of the displayed content.

2. The multimedia display system according to claim 1, wherein The height of the target touch display satisfies the following relationship: H target =∑ n i=1 (η×h i +γ×z i ×tanβ i ) / ∑ n i=1 ω i +Δh; Among them, H target is the height of the target touch display, η is the preset estimated height weight, h i is the estimated height of the shoulder and neck position of the i-th user, γ is the preset depth distance weight, z i is the depth distance between the i-th user and the target touch display, β i is the vertical pitch angle of the i-th user, ω i is the dynamic weight of the i-th user, Δh is the preset environmental compensation factor, and n is the number of users corresponding to the target touch display.

3. The multimedia display system according to claim 2, characterized in that η = 0.92, γ = 0.

15.

4. The multimedia display system according to claim 1, characterized in that Step S400 includes the following steps: S410. Obtain the three-dimensional coordinates, time stamps, and unique identifiers of each user; S420. Set parameters, including: Spatial density threshold: ≤3 people per square meter, and the neighborhood radius ε is determined by on-site measurement of the scene; Temporal continuity: The user needs to stay in the same area for 5 consecutive frames; Minimum number of clustering points MinPts: Set according to the density threshold; S430. Maintain a sliding window with a length of 5 frames for each user to record their historical positions; S440. If the user is in the same neighborhood in the current frame and the past 4 frames, mark it as a stable user.

5. The multimedia display system according to claim 1, wherein, Step S500 includes the following steps: S510. If the number of users in the primary user group is 1, adjust the pitch angle of the target touch display so that the target touch display faces the line-of-sight normal direction of the user; S520. If the number of users in the primary user group is greater than 1, obtain the average line-of-sight normal of all users in the primary user group; proceed to S530; S530. Adjust the pitch angle of the target touch display so that the target touch display faces the average line-of-sight normal direction.

6. The multimedia display system according to claim 1, wherein Step S600 includes the following steps: S610, if the content displayed on the target touch display is of the text reading type, determine the distance L between the target touch display and the center of the main user group optimal = 1.2D × 2.54; where D is the size of the target touch display For S620, if the content displayed on the target touch display is of the audio-visual viewing type, determine the distance L between the target touch display and the center of the main user group optimal = 0.8D × 2.

54.

7. The multimedia display system according to claim 1, characterized in that The multimedia display device further includes: a chassis, the upper surface of the chassis is fixedly connected to the bottom end of a column, the upper end of the column is fixedly connected to the bottom surface of a fixed disk, and the upper surface of the fixed disk is connected to a display mechanism; A plurality of screw holes five are formed in the fixed disk, and the bottom ends of a plurality of second bolts are respectively threadedly connected to the plurality of screw holes five, the upper ends of the plurality of second bolts are all connected to the display mechanism, and a plurality of universal wheels are arranged on the bottom surface of the chassis.

8. The multimedia display system according to claim 7, wherein The display mechanism includes: an installation box, on the bottom surface of which a number of second screw holes are provided, and the upper ends of a number of second bolts are respectively threadedly connected to the second screw holes, and the bottom surface of the installation box is lapped on the upper surface of the fixed disk.

9. The multimedia display system according to claim 8, characterized in that, Through grooves are provided on the four vertical surfaces of the installation box, and lifting plates are sleeved in the four through grooves; On the opposite ends of the four lifting plates, third screw holes are respectively provided, and the four third screw holes are respectively threadedly connected to the four first screws; The bottom ends of the four first screws are respectively fixedly connected to the output shafts of four motors, the bottom ends of the four motors are fixedly connected to the inner bottom surface of the installation box, the input ends of the four motors are respectively electrically connected to the output ends of four controllers, and the four controllers are respectively fixedly arranged on the four vertical surfaces of the column; On the opposite ends of the four lifting plates, they are respectively fixedly connected to the outer sides of four placement disks, and a touch display is placed inside each placement disk.

10. The multimedia display system according to claim 9, characterized in that, The bottom end of the touch display is lapped on the inner side surface of the baffle, the bottom surface of the baffle is fixedly connected to the inner bottom surface of the placement disk, and the upper end of the touch display is lapped on the inner side surface of the limiting plate; The upper end of the limiting plate is sleeved in the groove, the groove is provided on the upper inner side surface of the placement disk, and the middle of the upper surface of the limiting plate is rotatably connected to the bottom end of the second screw through a bearing; The second screw is threadedly connected to the fourth screw hole, and the fourth screw hole is provided on the upper surface of the placement disk and is in through communication with the groove; The upper surface of the installation box is lapped on the bottom surface of the cover plate. First screw holes are provided at the four corners of the cover plate and at the four corners of the upper surface of the installation box, and the two upper and lower corresponding first screw holes are threadedly connected to the same first bolt. An inspection slot corresponding to the cover plate is provided on the upper surface of the installation box.

Images