Display screen assembly and control method thereof

Abstract

The invention provides a display screen assembly and a control method thereof, the display screen assembly comprises a display screen support, the height and angle of the display screen support are adjustable, and the control method comprises the step of detecting the sitting posture of a human body to obtain the sitting posture form. The sitting posture forms of the user in different application scenes are different, and the sitting posture forms of the user can influence the user to receive the information of the display screen. A deviation angle between the position of the display screen and the position of the human body is detected, and one sitting posture form of the user corresponds to a specific angle error range. And detecting whether the deviation angle is within an angle error range corresponding to the sitting posture form, and if not, adjusting the height and angle of the display screen bracket according to the sitting posture form and the deviation angle so as to change the relative distance and included angle between the display screen and the user until the deviation angle is within the angle error range. According to the control method, the height and angle of the display screen can be automatically adjusted, a laser camera does not need to be used, and the cost of the display screen assembly is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of display screens, and in particular to a display screen assembly and a control method thereof. Background Art

[0002] With the advancement of display technology, display screens have been widely used in recent years. For example, display screens are used for explanations and demonstrations. When the position and angle of the display screen are fixed, users at different positions have different observation effects. For example, compared with users on both sides of the display screen, users in front of the display screen can better receive the information on the display screen. Therefore, it is necessary to adjust the angle of the display screen.

[0003] Traditional display adjustment brackets rely on manual operation, such as using telescopic rods and / or mechanical arms for adjustment, and lack automation capabilities. Some existing products use laser cameras to estimate the optimal position of the display, which are expensive and have limited functions, such as only being able to adjust the height.

[0004] Therefore, there is a need for a control method for a display screen assembly that can automatically adjust the height and angle of a display screen and does not rely on laser camera positioning. Summary of the invention

[0005] In order to overcome the problems existing in the related art, an object of the present invention is to provide a display screen assembly and a control method thereof, wherein the control method can automatically adjust the height and angle of the display screen and does not rely on laser camera positioning.

[0006] A control method for a display screen assembly, wherein the display screen assembly comprises a display screen bracket, wherein the height and angle of the display screen bracket are adjustable, and the control method comprises:

[0007] Get the sitting posture of the human body and the position of the display screen;

[0008] Performing sitting posture detection on the sitting posture of the human body to obtain a sitting posture form;

[0009] Detecting a deviation angle between the position of the display screen and the position of a human body;

[0010] Detect whether the deviation angle is within the angle error range corresponding to the sitting posture; if not, adjust the height and angle of the display screen bracket according to the sitting posture and the deviation angle until the deviation angle is within the angle error range.

[0011] In a preferred technical solution of the present invention, the method of performing sitting posture detection on the sitting posture of the human body to obtain the sitting posture form includes:

[0012] Use a depth camera to shoot the scene to obtain a scene image;

[0013] Extracting a face region from the scene image;

[0014] Determine a limb area according to the face area; wherein the limb area is a human body area below the face;

[0015] A sitting posture morphology is extracted from the limb region.

[0016] In a preferred technical solution of the present invention, the step of extracting the sitting posture from the limb area includes:

[0017] A DeepPose algorithm is used to extract a plurality of key points of the human body in the limb area;

[0018] Connect adjacent key points of the human body to obtain a pose graph;

[0019] The posture graph is matched with a sitting posture template to obtain a sitting posture form.

[0020] In a preferred technical solution of the present invention, before detecting the deviation angle between the position of the display screen and the position of the human body, the method further includes:

[0021] Detect the relative distance between the human body and the radar;

[0022] The position of the human body is determined according to the relative distance and the radar coordinates.

[0023] In a preferred technical solution of the present invention, the detecting the relative distance between the human body and the radar comprises:

[0024] Control the radar to emit electromagnetic waves to the human body and record the emission time of the electromagnetic waves;

[0025] The radar receives the electromagnetic waves returned by the human body and records the return time of the electromagnetic waves;

[0026] Subtract the emission time of the electromagnetic wave from the return time of the electromagnetic wave to obtain the time difference;

[0027] The relative distance between the human body and the radar is obtained by multiplying the electromagnetic wave speed by the time difference.

[0028] In a preferred technical solution of the present invention, the method of determining the position of a human body according to the relative distance and the radar coordinates includes:

[0029] Acquire radar coordinates and radar orientation, wherein the radar coordinates include radar x-axis coordinates and radar y-axis coordinates;

[0030] The radar orientation is taken as the first reference axis, and the direction perpendicular to the radar orientation is taken as the second reference axis;

[0031] Decomposing the relative distance onto the first reference axis to obtain an x-axis offset;

[0032] Separating the relative distance to the second reference axis to obtain a y-axis offset;

[0033] Add the x-axis offset to the x-axis coordinate of the radar to obtain the x-axis coordinate of the human body;

[0034] The radar y-axis coordinate is added with the y-axis offset to obtain the human body y-axis coordinate; wherein the human body x-axis coordinate and the human body y-axis coordinate constitute the human body position.

[0035] In a preferred technical solution of the present invention, the step of detecting the deviation angle between the position of the display screen and the position of the human body comprises:

[0036] Calculate the azimuth angle according to the following formula:

[0037]

[0038] Wherein, θ represents the azimuth angle, arctan represents the inverse tangent function, Δx represents the x-axis difference between the display screen and the human body position, and Δy represents the y-axis difference between the display screen and the human body position;

[0039] The pitch angle is calculated according to the following formula:

[0040]

[0041] in, represents the pitch angle, Δz represents the z-axis difference between the display screen and the human body position, and the azimuth angle and the pitch angle constitute a deviation angle.

[0042] In a preferred technical solution of the present invention, the step of carrying out the step of: until the deviation angle is within the angle error range further comprises:

[0043] Analyze user behavior data to obtain the user's current status; wherein the behavior data includes working hours and fatigue level;

[0044] Screen parameters are adjusted according to the current state of the user, where the screen parameters include color temperature and brightness.

[0045] In a preferred technical solution of the present invention, the step of carrying out the step of: until the deviation angle is within the angle error range further comprises:

[0046] Use head tracking algorithm to dynamically calculate the optimal angle;

[0047] The angle of the display screen is adjusted to the optimal angle.

[0048] In a preferred technical solution of the present invention, the step of adjusting the height and angle of the display screen bracket according to the sitting posture and the deviation angle includes:

[0049] Using a gyro sensor to detect the center of gravity of the display screen;

[0050] Determining an optimal position according to the center of gravity of the display screen;

[0051] Adjusting the multi-axis motor according to the optimal position to adjust the height and angle of the display screen;

[0052] The multi-axis motor is locked to fix the height and angle of the display screen.

[0053] A display screen assembly is used to implement a control method for the display screen assembly, the display screen assembly includes a display screen bracket, the display screen bracket includes a base, the base extends N sections of support arms in a direction close to the display screen, N ≥ 2; axial holes are provided at the connection between adjacent support arms, each of the axial holes is connected to a motor; the first end of the Nth section of the support arm is connected to the display screen, and the second end is connected to the N-1th section of the support arm.

[0054] In a preferred technical solution of the present invention, a 3D photosensitive device is provided at one end of the display screen away from the support arm of the Nth section, and the 3D photosensitive device is wirelessly connected to the base.

[0055] The beneficial effects of the present invention are:

[0056] The present invention provides a control method for a display screen assembly, wherein the display screen assembly includes a display screen bracket, wherein the height and angle of the display screen bracket are adjustable, and the control method includes obtaining a human body sitting posture and a display screen position, performing a sitting posture detection on the human body sitting posture, and obtaining a sitting posture form. The sitting posture forms of users in different application scenarios are different, and the sitting posture forms of different users in the same application scenario are also different, and the sitting posture forms of users will affect the information received by users from the display screen. The deviation angle between the position of the display screen and the position of the human body is detected, and a sitting posture form of the user corresponds to a specific angle error range. It is detected whether the deviation angle is within the angle error range corresponding to the sitting posture form. If not, it means that the deviation between the current human body position and the display screen position is large, and the height and angle of the display screen bracket are adjusted according to the sitting posture form and the deviation angle, thereby changing the relative distance and angle between the display screen and the user, until the deviation angle is within the angle error range. At this time, the human body sitting posture of the user is suitable for the position of the display screen, so that the user can more easily observe the content displayed on the display screen. The above control method can automatically adjust the height and angle of the display screen, and does not need to use a laser camera, thereby reducing the number of display screen assemblies and reducing the cost of the display screen assemblies. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 is a flow chart of a method for controlling a display screen assembly of the present invention;

[0058] Figure 2It is a flow chart of the present invention for detecting the sitting posture of a human body;

[0059] Figure 3 is a front view of the display screen assembly of the present invention;

[0060] Figure 4 It is a side view of the display screen assembly of the present invention.

[0061] Figure numerals: 1. base; 2. first axial hole; 3. second axial hole; 4. third axial hole; 5. fourth axial hole; 6. fifth axial hole; 7. sixth axial hole; 8. first support arm; 9. second support arm; 10. third support arm; 11. fourth support arm; 12. fifth support arm; 13. sixth support arm; 14. display screen; 15. 3D photosensitive device. DETAILED DESCRIPTION

[0062] The preferred embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the preferred embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to make the present invention more thorough and complete, and to fully convey the scope of the present invention to those skilled in the art.

[0063] Example 1

[0064] like Figure 1 As shown, this embodiment provides a control method for a display screen assembly, wherein the display screen assembly includes a display screen bracket, wherein the height and angle of the display screen bracket are adjustable, and the control method includes:

[0065] S1: Get the sitting posture of the human body and the position of the display screen.

[0066] S2: Performing sitting posture detection on the sitting posture of the human body to obtain a sitting posture shape.

[0067] S3: Detecting a deviation angle between the position of the display screen and the position of the human body.

[0068] S4: Detect whether the deviation angle is within the angle error range corresponding to the sitting posture; if not, adjust the height and angle of the display screen bracket according to the sitting posture and the deviation angle until the deviation angle is within the angle error range.

[0069] The display screen 14 is widely used in home office environments, medical equipment, industrial control and other fields. The display screen assembly of the present invention includes a display screen 14 and a display screen bracket, and the display screen 14 is mounted on the display screen bracket. This embodiment takes the application scenario of using the display screen assembly in an office to display work content as an example, and the relative distance and angle between different users and the display screen 14 are different.

[0070] When receiving information from the display screen 14, the user will change the sitting posture of the human body. The sitting posture includes holding the chin with one hand, placing both hands on the knees, crossing the two arms, and holding the glasses with one hand. When the display screen 14 and the human body are fixed, the user's change of sitting posture will affect the user's reception of information from the display screen 14.

[0071] The human body contour is extracted, and the sitting posture is detected according to the human body contour and the key points of the human body to obtain the sitting posture. The height and angle of the display screen bracket corresponding to different sitting postures are different. The deviation angle between the position of the display screen 14 and the human body is detected, that is, the angle between the display screen 14 and the human body in different planes in the three-dimensional space, and the deviation angle includes the azimuth angle and the pitch angle.

[0072] It is detected whether the deviation angle is within the angle error range corresponding to the sitting posture, and the lower limit of the angle error range is 0. If not, it means that the user's sitting posture is not suitable for observing the display screen 14, and the relative position between the display screen 14 and the user needs to be adjusted. Therefore, the height and angle of the display screen bracket are adjusted in combination with the sitting posture and the deviation angle to reduce the deviation angle until the deviation angle is within the angle error range.

[0073] This embodiment provides a control method for a display screen assembly, including obtaining a human sitting posture and a position of a display screen 14, performing a sitting posture detection on the human sitting posture, and obtaining a sitting posture form. The sitting posture forms of users in different application scenarios are different, and the sitting posture forms of different users in the same application scenario are also different. The sitting posture forms of users will affect the information received by users from the display screen 14. The deviation angle between the position of the display screen 14 and the position of the human body is detected, and a sitting posture form of the user corresponds to a specific angle error range. It is detected whether the deviation angle is within the angle error range corresponding to the sitting posture form. If not, it means that the deviation between the current human body position and the position of the display screen 14 is large. The height and angle of the display screen bracket are adjusted according to the sitting posture form and the deviation angle, thereby changing the relative distance and angle between the display screen 14 and the user until the deviation angle is within the angle error range. At this time, the user's human sitting posture is suitable for the position of the display screen 14, so that the user can more easily observe the content displayed on the display screen 14. The above control method can automatically adjust the height and angle of the display screen 14, and does not require the use of a laser camera, thereby reducing the number of display screen assemblies and reducing the cost of the display screen assemblies.

[0074] Example 2

[0075] like Figure 1 As shown, this embodiment provides a control method for a display screen assembly, wherein the display screen assembly includes a display screen bracket, wherein the height and angle of the display screen bracket are adjustable, and the control method includes:

[0076] S1: Get the sitting posture of the human body and the position of the display screen.

[0077] S2: Performing sitting posture detection on the sitting posture of the human body to obtain a sitting posture shape.

[0078] S3: Detecting a deviation angle between the position of the display screen and the position of the human body.

[0079] S4: Detect whether the deviation angle is within the angle error range corresponding to the sitting posture; if not, adjust the height and angle of the display screen bracket according to the sitting posture and the deviation angle until the deviation angle is within the angle error range.

[0080] like Figure 2 As shown, the sitting posture detection of the human body is performed to obtain the sitting posture form, including:

[0081] S21: Use a depth camera to shoot the scene to obtain a scene image.

[0082] S22: Extracting a face region from the scene image.

[0083] S23: Determine a limb area according to the face area; wherein the limb area is the human body area below the face.

[0084] S24: Extracting a sitting posture from the limb region.

[0085] The depth camera can detect the distance information of the shooting space, that is, the depth camera can not only record all objects within the camera's field of view, but also detect the distance between the object and the depth camera. The scene is photographed with a depth camera to obtain a scene image. The scene image is segmented using an image segmentation algorithm such as a U-Net model or an FCN model to obtain multiple image regions, from which the face region is screened.

[0086] The human body region includes a face region and a limb region. The limb region is located below the face region. The face region has more details and higher recognition. Therefore, the present invention first screens out the face region, and then determines the position of the limb region based on the position of the face region.

[0087] The step of extracting the sitting posture from the limb region comprises:

[0088] S241: Using the DeepPose algorithm to extract multiple human key points in the limb area.

[0089] S242: Connect adjacent key points of the human body to obtain a posture graph.

[0090] S243: Match the posture graph with the sitting posture template to obtain the sitting posture form.

[0091] DeepPose is an algorithm framework that applies deep neural networks to human key point detection. It converts the problem of human posture estimation into a regression problem, and calculates the coordinate values ​​of human joint points by cascading multiple deep neural networks using regression.

[0092] The human body posture is decomposed into multiple human body key points, such as the head, shoulders and elbows, and each human body key point has a two-dimensional coordinate. Human body posture estimation includes three types, the first is a skeleton-based model, the second is a contour-based model, and the third is a volume-based model. The present invention connects all the human body key points end to end to obtain the human body skeleton, that is, the human body posture graph. The postures corresponding to the posture graph include sitting posture, standing posture and motion posture. The present invention is only for the case where the user's posture is a sitting posture. The sitting posture template includes a variety of sitting postures. The posture graph is matched with the sitting posture template to obtain the sitting posture form.

[0093] The detecting the deviation angle between the position of the display screen and the position of the human body comprises:

[0094] Calculate the azimuth angle according to the following formula:

[0095]

[0096] Wherein, θ represents the azimuth angle, arctan represents the inverse tangent function, Δx represents the x-axis difference between the display screen and the human body position, and Δy represents the y-axis difference between the display screen and the human body position;

[0097] The pitch angle is calculated according to the following formula:

[0098]

[0099] in, represents the pitch angle, Δz represents the z-axis difference between the display screen and the human body position, and the azimuth angle and the pitch angle constitute a deviation angle.

[0100] The position of the display screen and the position of the human body are both three-dimensional coordinates. The position of the display screen is expressed as (x 1 ,y 1 ,z 1 ), the human body position is expressed as (x 2 ,y 2 ,z 2 ), Δx=x 2 -x 1 , Δy=y 2 -y 1 , Δz=z 2 -z 1 .

[0101] The azimuth angle refers to the angle of the target above the horizontal plane, with the position of the display screen 14 or the human body as a reference. The pitch angle is the angle between the line between the display screen 14 and the human body and the horizontal plane. If the display screen 14 is above the human body, the pitch angle is positive; if the display screen 14 is below the human body, the pitch angle is negative.

[0102] The present embodiment extracts the sitting posture form from the limb area, including extracting the human body key points of the limb area by using the DeepPose algorithm, connecting the adjacent human body key points, and obtaining a posture graph. The posture graph is matched with the sitting posture template to obtain the sitting posture form. DeepPose is an algorithm framework that applies deep neural networks to human body key point detection, converts the human body posture estimation problem into a regression problem, and calculates the coordinate values ​​of the human body joint points by regression through cascading multiple deep neural networks. The human body posture is decomposed into multiple human body key points, such as the head, shoulders and elbows, and each human body key point has a two-dimensional coordinate. Human body posture estimation includes three types, the first is a skeleton-based model, the second is a contour-based model, and the third is a volume-based model. The present invention connects all human body key points end to end to obtain the skeleton of the human body, that is, the posture graph of the human body. The posture corresponding to the posture graph includes sitting posture, standing posture and motion posture. The present invention is only for the case where the user's posture is a sitting posture. The sitting posture template includes multiple sitting postures. The posture graph is matched with the sitting posture template to obtain the sitting posture form.

[0103] Example 3

[0104] like Figure 1 As shown, this embodiment provides a control method for a display screen assembly, wherein the display screen assembly includes a display screen bracket, wherein the height and angle of the display screen bracket are adjustable, and the control method includes:

[0105] S1: Get the sitting posture of the human body and the position of the display screen.

[0106] S2: Performing sitting posture detection on the sitting posture of the human body to obtain a sitting posture shape.

[0107] S3: Detecting a deviation angle between the position of the display screen and the position of the human body.

[0108] S4: Detect whether the deviation angle is within the angle error range corresponding to the sitting posture; if not, adjust the height and angle of the display screen bracket according to the sitting posture and the deviation angle until the deviation angle is within the angle error range.

[0109] Before detecting the deviation angle between the position of the display screen and the position of the human body, the method further includes:

[0110] S21': Detect the relative distance between the human body and the radar.

[0111] S22': Determine the position of the human body according to the relative distance and the radar coordinates.

[0112] The radar coordinates are known. The radar emits electromagnetic waves outward, which are reflected when encountering obstacles such as the human body. The relative distance between the human body and the radar can be determined based on the length of time the electromagnetic waves propagate.

[0113] The detecting the relative distance between the human body and the radar comprises:

[0114] S211': Control the radar to emit electromagnetic waves to the human body and record the emission time of the electromagnetic waves.

[0115] S212': The radar receives the electromagnetic waves returned by the human body and records the return time of the electromagnetic waves.

[0116] S213': Subtract the emission time of the electromagnetic wave from the return time of the electromagnetic wave to obtain the time difference.

[0117] S214': Multiply the speed of the electromagnetic wave by the time difference to obtain the relative distance between the human body and the radar.

[0118] Adjust the angle of the radar so that it points toward the human body. In this embodiment, the radar is a millimeter wave radar. Start the millimeter wave radar, control the millimeter wave radar to emit electromagnetic waves toward the human body, and record the emission time t of the electromagnetic waves. 1 . Record the time t when the millimeter wave radar receives the electromagnetic wave returned by the human body 2 , Δt=t 2 -t 1 , Δt is the time difference. Multiply the speed v of the electromagnetic wave by the time difference Δt to get the relative distance between the human body and the radar.

[0119] The determining the position of the human body according to the relative distance and the radar coordinates comprises:

[0120] S221': Acquire radar coordinates and radar orientation, where the radar coordinates include radar x-axis coordinates and radar y-axis coordinates.

[0121] S222': The radar orientation is used as a first reference axis, and a direction perpendicular to the radar orientation is used as a second reference axis.

[0122] S223': Decompose the relative distance onto the first reference axis to obtain an x-axis offset.

[0123] S224': Separate the relative distance onto the second reference axis to obtain a y-axis offset.

[0124] S225': Add the x-axis offset to the x-axis coordinate of the radar to obtain the x-axis coordinate of the human body.

[0125] S226': Add the radar y-axis coordinate to the y-axis offset to obtain the human body y-axis coordinate; wherein the human body x-axis coordinate and the human body y-axis coordinate constitute the human body position.

[0126] The radar and the human body are taken as two points, and a plane is determined based on the two points. The two points representing the radar and the human body are connected in the plane. The first reference axis and the second reference axis are set in the plane, and the first reference axis and the second reference axis are perpendicular. The radar x-axis coordinate is the coordinate of the radar on the first reference axis, and the radar y-axis coordinate is the coordinate of the radar on the second reference axis.

[0127] Decompose the relative distance to the first reference axis to obtain the x-axis offset. Decompose the relative distance to the second reference axis to obtain the y-axis offset. The x-axis offset is a positive number, a negative number, or 0, and the y-axis is a positive number, a negative number, or 0. As an example, the radar x-axis coordinate is 5, the x-axis offset is -3, the human body x-axis coordinate is 2, the radar y-axis coordinate is 10, the y-axis offset is 8, and the human body y-axis coordinate is 18. The human body position is expressed as (2,18) in the form of coordinates.

[0128] In this embodiment, the human body position is determined according to the relative distance and the radar coordinates, including obtaining the radar coordinates and the radar orientation, wherein the radar coordinates include the radar x-axis coordinates and the radar y-axis coordinates. The radar orientation is used as the first reference axis, and the direction perpendicular to the radar orientation is used as the second reference axis. The relative distance is decomposed onto the first reference axis to obtain the x-axis offset. The relative distance is separated onto the second reference axis to obtain the y-axis offset. The x-axis offset is added to the radar x-axis coordinate to obtain the human body x-axis coordinate. The y-axis offset is added to the radar y-axis coordinate to obtain the human body y-axis coordinate, wherein the human body x-axis coordinate and the human body y-axis coordinate constitute the human body position. The radar and the human body are taken as two points, a plane is determined based on the two points, and two points representing the radar and the human body are connected in the plane. A first reference axis and a second reference axis are set in the plane, and the first reference axis and the second reference axis are perpendicular. The radar x-axis coordinate is the coordinate of the radar on the first reference axis, and the radar y-axis coordinate is the coordinate of the radar on the second reference axis. The above method determines the human body position in the plane where the radar is located, and only involves the distance operation of the two points and the distance projection operation, and has a high operation efficiency.

[0129] Example 4

[0130] like Figure 1 As shown, this embodiment provides a control method for a display screen assembly, wherein the display screen assembly includes a display screen bracket, wherein the height and angle of the display screen bracket are adjustable, and the control method includes:

[0131] S1: Get the sitting posture of the human body and the position of the display screen.

[0132] S2: Performing sitting posture detection on the sitting posture of the human body to obtain a sitting posture shape.

[0133] S3: Detecting a deviation angle between the position of the display screen and the position of the human body.

[0134] S4: Detect whether the deviation angle is within the angle error range corresponding to the sitting posture; if not, adjust the height and angle of the display screen bracket according to the sitting posture and the deviation angle until the deviation angle is within the angle error range.

[0135] After the deviation angle is within the angle error range, the method further comprises:

[0136] S51: Analyze user behavior data to obtain the user's current status; wherein the behavior data includes working hours and fatigue level.

[0137] S52: Adjust screen parameters according to the current state of the user, where the screen parameters include color temperature and brightness.

[0138] The depth camera captures a scene image, which includes a user in a specific sitting posture, and sends the scene image to the base 1 of the display screen assembly. The base 1 has a processor integrated therein. The base 1 performs a preliminary analysis on the scene image and sends the results of the preliminary analysis to the cloud.

[0139] The cloud analyzes the user's behavior data such as working hours and fatigue, determines the user's current state based on the working hours and fatigue, and the user's current state includes fatigue state, interested state and normal state, and dynamically adjusts screen parameters such as color temperature and brightness based on the user's current state to relieve visual fatigue. For example, when the user is in an interested state, the color temperature of the display screen 13 is lowered until the display screen 13 changes from warm to cool, and the brightness of the display screen 13 is increased; when the user is in a fatigued state, the color temperature of the display screen 13 is increased until the display screen 13 changes from cool to warm, and the brightness of the display screen 13 is reduced.

[0140] The screen control software, the local decision-making system of the base 1 and the cloud model are combined to make decisions, thereby automatically adjusting the display status of the display screen 14.

[0141] Preferably, user preferences such as lunchtime viewing angle and focus mode distance are recorded, and personalized adjustment strategies are adopted according to the habits of different users. When the device is used for the first time, the device will adopt an angle that conforms to the habits of most users based on the built-in reference parameters. When the user is not satisfied with the current angle and manually adjusts the display stand, the local algorithm model will automatically learn, and the next time the user is in the same or similar human posture, the local algorithm model will automatically adjust the display stand according to the last learned angle.

[0142] After the deviation angle is within the angle error range, the method further comprises:

[0143] S53: Use head tracking algorithm to dynamically calculate the optimal angle.

[0144] S54: adjusting the angle of the display screen to the optimal angle.

[0145] Step S53 and step S51 are two parallel steps, that is, after executing step S4, you can first execute steps S51-S52, and then execute steps S53-S54, or you can execute steps S51-S52 and steps S53-S54 at the same time. In this embodiment, a head detector is used to detect the head of the user in the scene. After identifying the head of the user, a head tracking and re-identification module is used to verify the position of the user's head. The head tracking and re-identification module is based on particle filtering and color histogram. The sitting posture recognition algorithm and the head tracking algorithm are integrated to dynamically calculate the optimal angle of the display screen 14. The optimal angle includes a horizontal viewing angle and a vertical viewing angle. In this embodiment, the horizontal viewing angle is ±30° and the vertical viewing angle is ±15° as an example.

[0146] When it is detected that the operator's seat is raised and the head is tilted downward, the system automatically lowers the height of the display screen 14 through calculation, so that the display screen 14 is at an upward angle, which is convenient for the operator to watch; when it is detected that the operator lowers the seat and leans back to lie on his back, the support arm 2 automatically rises, so that the display screen 14 is at an inclined angle. When the operator moves left and right, the support arm 2 opens or contracts to automatically adjust the horizontal position of the display screen 14.

[0147] The adjusting the height and angle of the display screen bracket according to the sitting posture and the deviation angle comprises:

[0148] S41: Using a gyro sensor to detect the center of gravity of the display screen.

[0149] S42: Determine the optimal position according to the center of gravity of the display screen.

[0150] S43: adjusting the multi-axis motor according to the optimal position to adjust the height and angle of the display screen.

[0151] S44: Locking the multi-axis motor to fix the height and angle of the display screen.

[0152] The present invention uses a dynamic load balancing algorithm to adjust the relevant parameters of the six-axis motor built into the base in real time, such as the rotation angle, maximum load bearing and locking torque, and realizes the joint dynamic adjustment of the display screen bracket according to the parameters of each axis, so as to quickly adjust the height and angle of the display screen 14 and avoid failure caused by excessive load of a single motor. The gyroscope sensor in the 3D photosensitive device 15 is used to detect the center of gravity of the display screen 14 in real time, automatically find the optimal position of the display screen 14, and lock the six-axis motor to prevent the display screen 14 from shaking.

[0153] The method of this embodiment until the deviation angle is within the angle error range also includes analyzing user behavior data to obtain the current state of the user, wherein the behavior data includes working hours and fatigue. The screen parameters are adjusted according to the current state of the user, and the screen parameters include color temperature and brightness. The cloud analyzes the user's behavior data such as working hours and fatigue, and dynamically adjusts screen parameters such as color temperature and brightness according to working hours and fatigue to relieve visual fatigue. Decisions are made in combination with the screen control software, the local decision-making system of the base 1, and the cloud model to automatically adjust the display state of the display screen 14. The cloud model provides sitting posture correction reminders and intermittent screen offset prompts. The screen control software can implement custom operation functions, such as setting the cloud server to communicate with the processor of the base 1 when the screen control software is detected to be turned on, and the processor of the base 1 controls the movement of the display screen bracket to adjust the display screen 14 to a vertical screen state.

[0154] Example 5

[0155] like Figure 3-Figure 4 As shown, this embodiment provides a display screen assembly for implementing the control method of the display screen assembly in Embodiments 1 to 4, wherein the display screen assembly includes a display screen bracket, the display screen bracket includes a base 1, and the base 1 extends N sections of support arms 2 in a direction close to a display screen 14, N ≥ 2; axial holes are provided at the connection between adjacent support arms 2, and each of the axial holes is connected to a motor; the first end of the support arm 2 of the Nth section is connected to the display screen 14, and the second end is connected to the support arm 2 of the N-1th section.

[0156] A 3D photosensitive device 15 is provided at one end of the display screen 14 away from the support arm 2 of the Nth section. The 3D photosensitive device 15 is wirelessly connected to the base 1. In this embodiment, the wireless connection is taken as a Bluetooth connection as an example.

[0157] The present invention adopts a six-axis motor, and a total of six end support arms are provided, namely, a first support arm 8, a second support arm 9, a third support arm 10, a fourth support arm 11, a fifth support arm 12 and a sixth support arm 13, and all the support arms are connected end to end. Axial holes are provided between adjacent support arms, namely, a first axial hole 2, a second axial hole 3, a third axial hole 4, a fourth axial hole 5, a fifth axial hole 6 and a sixth axial hole 7.

[0158] The six-axis motor can translate horizontally, lift vertically, pitch, rotate, roll, and move forward and backward, thus achieving omnidirectional adjustment. Compared with single-axis telescopic rods and dual-axis robotic arms, the six-axis motor can meet various types of ergonomic requirements.

[0159] Preferably, near-field charging technology is used to charge the 3D photosensitive device 15 to avoid the constraints of wires. At present, there are relatively mature near-field charging technologies on the market. This embodiment mainly uses microwave energy transmission technology to achieve near-field charging of the 3D photosensitive device 15. The base 1 converts energy to the connected power supply and radiates the energy through the antenna, which is transmitted through space to reach the 3D photosensitive device 15. The 3D photosensitive device 15 converts microwave energy into electrical energy through the antenna and energy collection circuit to power the device.

[0160] The six-axis motor group adopts a stepper motor with an accuracy of 0.1°. The six-axis motor is combined with a harmonic reducer, with a load-bearing capacity of 15kg and is compatible with a 30-inch display. The 3D photosensitive device is set on the top of the display, covering a circular area or a fan-shaped area within a radius of two meters. The present invention uses a wireless 3D photosensitive device to replace a high-cost laser camera, which can reduce the cost of the equipment.

[0161] This embodiment provides a display screen assembly, the display screen assembly includes a display screen bracket, the display screen bracket includes a base 1, the base 1 extends N sections of support arms in the direction close to the display screen 14, N ≥ 2; the connection between adjacent support arms is provided with an axial hole, each of the axial holes is connected to a motor; the first end of the support arm of the Nth section is connected to the display screen 14, and the second end is connected to the support arm of the N-1th section. Through the six-axis motor control technology, the display screen bracket can achieve multi-angle adjustment, allowing users to flexibly adjust the angle and position of the screen according to their needs. This not only improves work efficiency, but also enhances the user experience.

[0162] Unless otherwise specifically stated, the relative arrangement, numerical expressions and numerical values ​​of the parts and steps set forth in these embodiments do not limit the scope of the application. In all examples shown and discussed here, any specific value should be interpreted as being merely exemplary, rather than as a restriction. Therefore, other examples of exemplary embodiments can have different values. It should be noted that similar reference numerals and letters represent similar items in the following drawings, and therefore, once a certain item is defined in an accompanying drawing, it does not need to be further discussed in the subsequent accompanying drawings.

[0163] It should be understood that spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is inverted, a device described as "above" or "above" other devices or structures would then be positioned "below" or "below" the other devices or structures. Thus, the exemplary term "above" can include both the orientations of "above" and "below." The device may also be positioned in other different ways (rotated 90 degrees or in other orientations), and the spatially relative descriptions used herein should be interpreted accordingly.

[0164] In addition, it should be noted that the use of terms such as "first" and "second" to limit components is only for the convenience of distinguishing the corresponding components. Unless otherwise stated, the above terms have no special meaning and therefore cannot be understood as limiting the scope of protection of this application.

[0165] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for controlling a display screen assembly, characterized in that: The display screen assembly includes a display screen bracket, the height and angle of the display screen bracket are adjustable, and the control method includes: Get the sitting posture of the human body and the position of the display screen; Performing sitting posture detection on the sitting posture of the human body to obtain a sitting posture form; Detecting a deviation angle between the position of the display screen and the position of a human body; Detect whether the deviation angle is within the angle error range corresponding to the sitting posture; if not, adjust the height and angle of the display screen bracket according to the sitting posture and the deviation angle until the deviation angle is within the angle error range.

2. A control method for a display screen assembly according to claim 1, characterized in that: The performing sitting posture detection on the sitting posture of the human body to obtain the sitting posture form includes: Use a depth camera to shoot the scene to obtain a scene image; Extracting a face region from the scene image; Determine a limb area according to the face area; wherein the limb area is a human body area below the face; A sitting posture morphology is extracted from the limb region.

3. A control method for a display screen assembly according to claim 2, characterized in that: The step of extracting the sitting posture from the limb region comprises: A DeepPose algorithm is used to extract a plurality of key points of the human body in the limb area; Connect adjacent key points of the human body to obtain a pose graph; The posture graph is matched with a sitting posture template to obtain a sitting posture form.

4. The control method of a display screen assembly according to claim 1, characterized in that: Before detecting the deviation angle between the position of the display screen and the position of the human body, the method further includes: Detect the relative distance between the human body and the radar; The position of the human body is determined according to the relative distance and the radar coordinates.

5. A control method for a display screen assembly according to claim 4, characterized in that: The detecting the relative distance between the human body and the radar comprises: Control the radar to emit electromagnetic waves to the human body and record the emission time of the electromagnetic waves; The radar receives the electromagnetic waves returned by the human body and records the return time of the electromagnetic waves; Subtract the emission time of the electromagnetic wave from the return time of the electromagnetic wave to obtain the time difference; The relative distance between the human body and the radar is obtained by multiplying the electromagnetic wave speed by the time difference.

6. A control method for a display screen assembly according to claim 4, characterized in that: The determining the position of the human body according to the relative distance and the radar coordinates comprises: Acquire radar coordinates and radar orientation, wherein the radar coordinates include radar x-axis coordinates and radar y-axis coordinates; The radar orientation is taken as the first reference axis, and the direction perpendicular to the radar orientation is taken as the second reference axis; Decomposing the relative distance onto the first reference axis to obtain an x-axis offset; Separating the relative distance to the second reference axis to obtain a y-axis offset; Add the x-axis offset to the x-axis coordinate of the radar to obtain the x-axis coordinate of the human body; The radar y-axis coordinate is added with the y-axis offset to obtain the human body y-axis coordinate; wherein the human body x-axis coordinate and the human body y-axis coordinate constitute the human body position.

7. The control method of a display screen assembly according to claim 1, characterized in that: The detecting the deviation angle between the position of the display screen and the position of the human body comprises: Calculate the azimuth angle according to the following formula: Wherein, θ represents the azimuth angle, arctan represents the inverse tangent function, Δx represents the x-axis difference between the display screen and the human body position, and Δy represents the y-axis difference between the display screen and the human body position; The pitch angle is calculated according to the following formula: in, represents the pitch angle, Δz represents the z-axis difference between the display screen and the human body position, and the azimuth angle and the pitch angle constitute a deviation angle.

8. The control method of the display screen assembly according to claim 1, characterized in that: After the deviation angle is within the angle error range, the method further comprises: Analyze user behavior data to obtain the user's current status; wherein the behavior data includes working hours and fatigue level; Screen parameters are adjusted according to the current state of the user, where the screen parameters include color temperature and brightness.

9. The control method of the display screen assembly according to claim 1, characterized in that: After the deviation angle is within the angle error range, the method further comprises: Use head tracking algorithm to dynamically calculate the optimal angle; The angle of the display screen is adjusted to the optimal angle.

10. The control method of the display screen assembly according to claim 1, characterized in that: The adjusting the height and angle of the display screen bracket according to the sitting posture and the deviation angle comprises: Using a gyro sensor to detect the center of gravity of the display screen; Determining an optimal position according to the center of gravity of the display screen; Adjusting the multi-axis motor according to the optimal position to adjust the height and angle of the display screen; The multi-axis motor is locked to fix the height and angle of the display screen.

11. A display screen assembly, characterized in that: A control method for a display screen assembly for implementing any one of claims 1 to 10, wherein the display screen assembly comprises a display screen bracket, the display screen bracket comprises a base, the base extends N support arms in a direction close to the display screen, N ≥ 2; axial holes are provided at the connection between adjacent support arms, each of the axial holes is connected to a motor; the first end of the support arm of the Nth segment is connected to the display screen, and the second end is connected to the support arm of the N-1th segment.

12. The display screen assembly according to claim 11, characterized in that: A 3D photosensitive device is provided at one end of the display screen away from the support arm of the Nth section, and the 3D photosensitive device is wirelessly connected to the base.

Images