A display terminal dynamic adjustment system and method based on user behavior

Abstract

The present invention relates to the field of display adjustment technology, specifically to a display terminal dynamic adjustment system and method based on user behavior, in which a picture adaptation adjustment module in the system analyzes a display position adaptation adjustment coefficient based on each picture interaction position in a set of spliced ​​pictures to be displayed, and the difference between a set of interactively associated pictures and a set of spliced ​​pictures to be displayed; and calibrates the picture adaptation of each picture splicing scheme based on the display position adaptation adjustment coefficient. In the process of managing the display terminal pictures, the present invention combines the user's position information and behavior information to lock the user's viewing angle, and dynamically generates different picture splicing schemes based on historical viewing data; at the same time, it also takes into account the picture interaction position in the picture to be displayed and the difference between a set of interactively associated pictures and a set of spliced ​​pictures to be displayed, to analyze and calibrate the adaptation of each picture splicing scheme, and achieve the purpose of dynamically adjusting the spliced ​​pictures to be displayed on the display terminal.

Description

Technical Field

[0001] The present invention relates to the field of display adjustment technology, and in particular to a display terminal dynamic adjustment system and method based on user behavior. Background Art

[0002] With the popularization of smart terminals and the increasing demand of users for personalized and intelligent experience, the dynamic adjustment system of the display terminal based on user behavior has gradually become the research and development focus of the industry. The existing splicing of multi-screen display images is often aimed at the splicing of multi-screen images on the same plane. For the splicing of multi-screen images in different planes, or even the 3D presentation of the display images, when realizing the splicing of images, usually only the perfectly spliced ​​images can be seen at specific positions. When the position is offset, the visual perception of the spliced ​​images will be significantly reduced, and the visual angle of the image content presented at the joint of the spliced ​​images will have a large deviation; the existing technology cannot combine the behavioral information and the interactive content of the screen to realize the dynamic adjustment of the spliced ​​images to be displayed on the display end. Therefore, the existing technology has a large defect. Summary of the invention

[0003] The purpose of the present invention is to provide a display terminal dynamic adjustment system and method based on user behavior to solve the problems raised in the above background technology.

[0004] In order to solve the above technical problems, the present invention provides the following technical solutions: a method for dynamically adjusting a display terminal based on user behavior, the method comprising the following steps:

[0005] S1. Using sensors arranged around the display terminal, real-time location feature information and user behavior information of the user based on the display terminal are obtained, and user behavior reference feature information is constructed;

[0006] S2, obtaining a set of spliced ​​pictures to be displayed corresponding to the display terminal at different times, a picture interaction position corresponding to each element in the corresponding set, and an interactive associated picture set corresponding to each picture interaction position, and generating picture splicing schemes corresponding to the set of spliced ​​pictures to be displayed, and an interactive sensing identification area corresponding to each picture interaction position in each picture splicing scheme;

[0007] S3, analyzing the picture adaptability of each picture splicing solution based on user behavior reference feature information;

[0008] S4, analyzing the display position adaptation adjustment coefficient based on the interactive position of each picture in the set of spliced ​​pictures to be displayed, and the difference between the interactively associated picture set and the set of spliced ​​pictures to be displayed; and calibrating the picture adaptation of each picture splicing scheme based on the display position adaptation adjustment coefficient;

[0009] S5. Select the display end picture corresponding to the picture splicing scheme with the largest picture adaptability after calibration to adjust it, and calibrate the interactive sensing recognition area of ​​the display end based on the interactive sensing recognition area corresponding to each picture interactive position in the adjusted picture splicing scheme.

[0010] Furthermore, the position feature information includes the position of the user's head relative to the display terminal and the angle of the head; the user behavior information includes the user's limb movements, positions and change vectors of each limb at a corresponding time point, the vector direction in the change vector of the limb represents the movement direction of the limb; the vector modulus in the change vector of the limb represents the movement speed of the limb;

[0011] The user behavior reference characteristic information includes an array consisting of display terminal-based position characteristic information and user behavior information corresponding to the corresponding user at the corresponding time point.

[0012] The purpose of obtaining the user's position feature information in the present invention is to determine the user's viewing position and provide data support for locking the corresponding viewing angle mapping points when generating the picture splicing schemes corresponding to each element in the picture set to be displayed in the subsequent process; and the purpose of obtaining the user's behavior information is to facilitate the calculation of the picture adaptability corresponding to each picture splicing scheme in the subsequent steps.

[0013] Further, each element in the set of spliced ​​pictures to be displayed corresponds to a picture to be spliced; if each picture to be spliced ​​has a picture interaction position, the corresponding picture interaction position is one or more, and the picture interaction position is a picture area preset in the database; when the user triggers an interactive behavior for a certain picture interaction position, the displayed picture jumps to the spliced ​​picture composed of the interactive associated picture set corresponding to the corresponding picture interaction position; the number of elements in the set of spliced ​​pictures to be displayed is the same as the number of screens of the display terminal, and each element corresponds to a screen of the display terminal;

[0014] The method for generating a picture splicing scheme corresponding to each element in a set of spliced ​​pictures to be displayed comprises the following steps:

[0015] S211, obtaining a set of spliced ​​images to be displayed corresponding to the display terminal at different times, and user behavior reference feature information;

[0016] S212, obtaining each screen position in the display terminal and a preset viewing angle reference position in a database, and respectively obtaining position feature information of the preset viewing angle reference position compared with each screen position, wherein the position feature information represents a vector formed by the preset viewing angle reference position and a corresponding screen center point;

[0017] S213, using the preset viewing angle reference position compared to the position characteristic information of each screen position as the viewing angle, respectively completing content mapping of the content of the spliced ​​picture to be displayed on the corresponding screen on a plane perpendicular to the viewing angle, to obtain a mapping picture of the spliced ​​picture to be displayed;

[0018] S214, constructing a 3D model of the picture content by using the mapping pictures of each to-be-displayed spliced ​​picture respectively corresponding to the 2D picture to-be-displayed spliced ​​picture tool, and summarizing the 3D models of the picture content corresponding to the to-be-displayed spliced ​​pictures in combination with the direction and module length of the vector corresponding to the position feature information of the preset viewing angle reference position compared to each screen position, to generate a view-end 3D model corresponding to the to-be-displayed spliced ​​picture set;

[0019] S215, obtaining a position of a head of position feature information in the user behavior reference feature information relative to the display end, recording the position as first position information, and generating a perspective mapping point of the first position information in the viewing end three-dimensional model according to a positional relationship between the first position information and a preset perspective reference position;

[0020] S216, according to the number of interactions corresponding to the user in each viewing data of the corresponding spliced ​​picture set to be displayed in the historical data and the change distance between each viewing position and the user position during the interaction; the obtained maximum change distance is used as the perspective position fluctuation radius of the perspective mapping point of the first position information in the three-dimensional model of the viewer; extracting the position feature information of all users in the area surrounded by the perspective mapping point of the first position information in the three-dimensional model of the viewer and the corresponding perspective position fluctuation radius in each viewing data of the corresponding spliced ​​picture set to be displayed in the historical data, taking the head position in the obtained position feature information relative to the display end as an associated perspective mapping point, and taking the set consisting of each obtained associated perspective mapping point and the perspective mapping point of the first position information in the three-dimensional model of the viewer as the perspective mapping set of the splicing scheme;

[0021] S217, generating picture splicing schemes corresponding to the set of splicing pictures to be displayed respectively according to the splicing scheme perspective mapping set, wherein each element in the splicing scheme perspective mapping set corresponds to a picture splicing scheme; taking the elements in the splicing scheme perspective mapping set as perspective mapping points, extracting a perspective picture that is the same as the 3D model of the picture to be displayed corresponding to the corresponding screen, mapping and stretching the extracted perspective picture on the plane where the corresponding screen is located, and obtaining a splicing picture to be displayed on the corresponding screen corresponding to the picture splicing scheme of the corresponding perspective mapping point, and the picture contents of the same 3D model at the splicing position of adjacent splicing pictures to be displayed are connected;

[0022] In the process of obtaining the picture splicing solution in the present invention, not only the perspective mapping point of the first position information in the viewing end three-dimensional model is obtained, but also its associated perspective mapping point is considered. This is because the difference in user behavior reference feature information may cause the user's position to change when the user views the display end picture or generates interactive behavior, and then the perspective mapping point fluctuates during viewing. This method realizes dynamic screening of the fluctuation range of the perspective mapping point.

[0023] The method for obtaining the interactive sensing recognition area corresponding to each picture interactive position in each picture splicing scheme comprises the following steps:

[0024] S221, obtaining a sensing recognition area set between the display terminal and the user, recorded as a first sensing area;

[0025] S222, obtain each picture splicing scheme, and i Each splicing picture to be displayed in the picture splicing scheme is projected on the corresponding screen. k Any point in the area corresponding to the interaction position of the first screen i The set of position areas that the lines connecting the view mapping points of the picture splicing scheme pass through are recorded as i In the picture splicing scheme k The area to be sensed corresponding to the interactive position of each screen;

[0026] S223, the first perception area and the i In the picture splicing scheme k The intersection of the areas to be sensed corresponding to the interactive positions of the screens is recorded as i In the picture splicing scheme k The interactive perception recognition area corresponds to the interactive position of each screen.

[0027] Further, the S3 includes:

[0028] S31, obtaining reference characteristic information of user behavior at that time, and picture splicing schemes corresponding to the sets of spliced ​​pictures to be displayed;

[0029] S32, obtain user behavior reference feature information i The picture adaptability of the picture splicing solution is calculated as follows:

[0030] ,

[0031] in, P i Indicates the user behavior reference feature information for the i The picture adaptability of the picture splicing solution; LD iIndicates that the user's limb position moves along the direction of the corresponding limb change vector and the first i The shortest distance between the corresponding interactive perception recognition areas of the to-be-displayed images in the image splicing scheme; H Indicates the height of the head center point from the ground compared to the position of the display end in the user behavior reference feature information; μ represents the arm length conversion coefficient; Indicates that in each viewing data of the corresponding set of spliced ​​images to be displayed in the historical data, the corresponding arm span distance fluctuation coefficient is less than or equal to The percentage of times the user's position changes by a distance greater than or equal to the preset distance in the total number of views; the arm span distance fluctuation coefficient is equal to the shortest distance between the user's limb position in the corresponding viewing data and the corresponding interactive perception recognition area of ​​the image to be displayed in the display end when the limb position moves in the direction of the corresponding limb change vector, divided by the height of the head center point identified in the display end position from the ground in the corresponding user behavior reference feature information. μ The quotient of the product of .

[0032] Furthermore, the method for analyzing and displaying the position adaptation adjustment coefficient in S4 includes the following steps:

[0033] S41, obtaining the interaction position of each screen in the set of spliced ​​screens to be displayed, the difference between the set of interactively associated screens and the set of spliced ​​screens to be displayed, and the user behavior data corresponding to each screen interaction behavior in the historical data;

[0034] S42, obtaining the display position adaptation adjustment coefficient, the calculation formula is as follows:

[0035] ,

[0036] AF i Indicates i The display position adaptation adjustment coefficient corresponding to each screen splicing solution; LTD i Indicates that the head angle in the user behavior reference feature information corresponds to the direction of the first i The distance between the overlapping area of ​​the to-be-displayed images and the nearest image interaction position in the image splicing scheme; DS i express LTD i Similarity between the interactively associated picture set corresponding to the picture interactive position and the elements in the spliced ​​picture set to be displayed at the current time; DS i The value is equal to LTD iThe average value of the percentage of pixels with the same pixel value in the interactively associated picture set corresponding to the picture interactive position and the spliced ​​picture set to be displayed at the current time in the picture corresponding to the same screen; DS i Greater than or equal to the preset threshold M When Otherwise, it is judged ;

[0037] The calculation formula for calibrating the screen adaptation of each screen splicing solution based on the display position adaptation adjustment coefficient is as follows: ,in, PC i Indicates the adjustment factor based on the display position adaptation i The picture adaptation calibration results of the picture splicing scheme.

[0038] Furthermore, the display end determines the interactive behavior triggering mode of the corresponding screen interactive position with respect to the calibrated interactive sensing recognition area. If the display end detects the user's triggering behavior information within the calibrated interactive sensing recognition area, it determines that the interactive behavior corresponding to the corresponding screen interactive position is triggered, and jumps the screen of the display end to the spliced ​​screen composed of the interactive associated screen set corresponding to the corresponding screen interactive position; if the display end does not detect the user's triggering behavior information within the calibrated interactive sensing recognition area, it determines that the interactive behavior corresponding to the corresponding screen interactive position is not triggered, keeps the displayed screen unchanged, and does not jump to the spliced ​​screen composed of the interactive associated screen set corresponding to the corresponding screen interactive position.

[0039] A display terminal dynamic adjustment system based on user behavior, the system includes a behavior reference feature acquisition module, a screen splicing interaction analysis module, a screen scheme adaptation analysis module, a screen adaptation adjustment module and a display terminal dynamic control management module.

[0040] The behavior reference feature acquisition module acquires the user's location feature information and user behavior information based on the display terminal in real time through sensors arranged around the display terminal, and constructs user behavior reference feature information;

[0041] The screen splicing interaction analysis module obtains the set of spliced ​​screens to be displayed corresponding to the display terminal at different times, the screen interaction position corresponding to each element in the corresponding set, and the interactive associated screen set corresponding to each screen interaction position, and generates screen splicing schemes corresponding to the set of spliced ​​screens to be displayed, and the interactive sensing identification area corresponding to each screen interaction position in each screen splicing scheme;

[0042] The picture scheme adaptation analysis module analyzes the picture adaptability of each picture splicing scheme based on user behavior reference feature information;

[0043] The picture adaptation adjustment module analyzes the display position adaptation adjustment coefficient based on each picture interaction position in the set of spliced ​​pictures to be displayed, and the difference between the interactively associated picture set and the set of spliced ​​pictures to be displayed; and calibrates the picture adaptation of each picture splicing scheme based on the display position adaptation adjustment coefficient;

[0044] The display end dynamic control management module selects the display end picture corresponding to the picture splicing scheme with the largest calibrated picture adaptability for control, and calibrates the interactive sensing recognition area of ​​the display end based on the interactive sensing recognition area corresponding to each picture interactive position in the controlled picture splicing scheme.

[0045] Furthermore, the picture adaptation and adjustment module includes an adaptation and adjustment coefficient analysis unit and a picture adaptation and calibration unit.

[0046] The adaptation adjustment coefficient analysis unit analyzes the display position adaptation adjustment coefficient based on the interactive position of each picture in the set of spliced ​​pictures to be displayed, and the difference between the interactive associated picture set and the set of spliced ​​pictures to be displayed;

[0047] The picture adaptation calibration unit calibrates the picture adaptation of each picture splicing solution based on the display position adaptation adjustment coefficient.

[0048] Compared with the prior art, the beneficial effects achieved by the present invention are as follows: in the process of managing the display end screen, the present invention combines the user's location information and behavior information to lock the user's viewing angle, and dynamically generates different screen splicing schemes based on historical viewing data; at the same time, it also takes into account the differences between the screen interaction position in the screen to be displayed and the interactively associated screen set and the set of spliced ​​screens to be displayed, and realizes the analysis and calibration of the adaptability of each screen splicing scheme, so as to achieve the purpose of dynamically adjusting the spliced ​​screen to be displayed on the display end. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0050] Figure 1 It is a structural schematic diagram of a display terminal dynamic adjustment system based on user behavior of the present invention;

[0051] Figure 2 It is a flow chart of a method for dynamically adjusting a display terminal based on user behavior according to the present invention. DETAILED DESCRIPTION

[0052] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0053] See also Figure 1 The present invention provides a technical solution: a display terminal dynamic adjustment system based on user behavior, the system includes a behavior reference feature acquisition module, a screen splicing interaction analysis module, a screen scheme adaptation analysis module, a screen adaptation adjustment module and a display terminal dynamic control management module,

[0054] The behavior reference feature acquisition module acquires the user's location feature information and user behavior information based on the display terminal in real time through sensors arranged around the display terminal, and constructs user behavior reference feature information;

[0055] The screen splicing interaction analysis module obtains the set of spliced ​​screens to be displayed corresponding to the display terminal at different times, the screen interaction position corresponding to each element in the corresponding set, and the interactive associated screen set corresponding to each screen interaction position, and generates screen splicing schemes corresponding to the set of spliced ​​screens to be displayed, and the interactive sensing identification area corresponding to each screen interaction position in each screen splicing scheme;

[0056] The picture scheme adaptation analysis module analyzes the picture adaptability of each picture splicing scheme based on user behavior reference feature information;

[0057] The picture adaptation and adjustment module includes an adaptation and adjustment coefficient analysis unit and a picture adaptation and calibration unit.

[0058] The adaptation adjustment coefficient analysis unit analyzes the display position adaptation adjustment coefficient based on the interactive position of each picture in the set of spliced ​​pictures to be displayed, and the difference between the interactive associated picture set and the set of spliced ​​pictures to be displayed;

[0059] The picture adaptation calibration unit calibrates the picture adaptation of each picture splicing solution based on the display position adaptation adjustment coefficient;

[0060] The display end dynamic control management module selects the display end picture corresponding to the picture splicing scheme with the largest calibrated picture adaptability for control, and calibrates the interactive sensing recognition area of ​​the display end based on the interactive sensing recognition area corresponding to each picture interactive position in the controlled picture splicing scheme.

[0061] like Figure 2 As shown, a method for dynamic adjustment of a display terminal based on user behavior comprises the following steps:

[0062] S1. Using sensors arranged around the display terminal, real-time location feature information and user behavior information of the user based on the display terminal are obtained, and user behavior reference feature information is constructed;

[0063] The position feature information includes the position of the user's head relative to the display terminal and the head facing angle; the user behavior information includes the user's limb movements, positions and change vectors of each limb at a corresponding time point, the vector direction in the limb change vector represents the movement direction of the limb; the vector modulus in the limb change vector represents the movement speed of the limb;

[0064] In this embodiment, the user behavior information is obtained by calculating the recognition result of the image information collected by the sensor, wherein the limb position and action in the collected image are recognized by image recognition technology, and the recognized limb position and action are mapped in the spatial model constructed based on the display end position. The spatial model constructed based on the display end position is Metashape The collected images are analyzed and obtained; when obtaining the user behavior information, the mapping position of the user's limb position in the space model at the current time and the mapping position of the user's limb position in the space model at the unit time point before the current time are extracted, and the vector direction formed by the corresponding two mapping position points is used as the corresponding limb movement direction, and the quotient of the modulus length of the vector formed by the corresponding two mapping position points divided by the unit time is used as the corresponding limb movement speed;

[0065] The user behavior reference characteristic information includes an array consisting of display terminal-based position characteristic information and user behavior information corresponding to the corresponding user at the corresponding time point.

[0066] S2, obtaining a set of spliced ​​pictures to be displayed corresponding to the display terminal at different times, a picture interaction position corresponding to each element in the corresponding set, and an interactive associated picture set corresponding to each picture interaction position, and generating picture splicing schemes corresponding to the set of spliced ​​pictures to be displayed, and an interactive sensing identification area corresponding to each picture interaction position in each picture splicing scheme;

[0067] Each element in the set of spliced ​​images to be displayed corresponds to a picture to be spliced; if each picture to be spliced ​​has a picture interaction position, the corresponding picture interaction position is one or more, and the picture interaction position is a picture area preset in the database; when the user triggers an interactive behavior for a certain picture interaction position, the display screen jumps to the spliced ​​screen composed of the interactive associated picture set corresponding to the corresponding picture interaction position; the number of elements in the set of spliced ​​images to be displayed is the same as the number of screens of the display terminal, and each element corresponds to a screen of the display terminal;

[0068] The method for generating a picture splicing scheme corresponding to each element in a set of spliced ​​pictures to be displayed comprises the following steps:

[0069] S211, obtaining a set of spliced ​​images to be displayed corresponding to the display terminal at different times, and user behavior reference feature information;

[0070] S212, obtaining each screen position in the display terminal and a preset viewing angle reference position in a database, and respectively obtaining position feature information of the preset viewing angle reference position compared with each screen position, wherein the position feature information represents a vector formed by the preset viewing angle reference position and a corresponding screen center point;

[0071] S213, using the preset viewing angle reference position compared to the position characteristic information of each screen position as the viewing angle, respectively completing content mapping of the content of the spliced ​​picture to be displayed on the corresponding screen on a plane perpendicular to the viewing angle, to obtain a mapping picture of the spliced ​​picture to be displayed;

[0072] S214, constructing a 3D model of the picture content by using the mapping pictures of each to-be-displayed spliced ​​picture respectively corresponding to the 2D picture to-be-displayed spliced ​​picture tool, and summarizing the 3D models of the picture content corresponding to the to-be-displayed spliced ​​pictures in combination with the direction and module length of the vector corresponding to the position feature information of the preset viewing angle reference position compared to each screen position, to generate a view-end 3D model corresponding to the to-be-displayed spliced ​​picture set;

[0073] S215, obtaining a position of a head of position feature information in the user behavior reference feature information relative to the display end, recording the position as first position information, and generating a perspective mapping point of the first position information in the viewing end three-dimensional model according to a positional relationship between the first position information and a preset perspective reference position;

[0074] S216, according to the number of interactions corresponding to the user in each viewing data of the corresponding spliced ​​picture set to be displayed in the historical data and the change distance between each viewing position and the user position during the interaction; the obtained maximum change distance is used as the perspective position fluctuation radius of the perspective mapping point of the first position information in the three-dimensional model of the viewer; extracting the position feature information of all users in the area surrounded by the perspective mapping point of the first position information in the three-dimensional model of the viewer and the corresponding perspective position fluctuation radius in each viewing data of the corresponding spliced ​​picture set to be displayed in the historical data, taking the head position in the obtained position feature information relative to the display end as an associated perspective mapping point, and taking the set consisting of each obtained associated perspective mapping point and the perspective mapping point of the first position information in the three-dimensional model of the viewer as the perspective mapping set of the splicing scheme;

[0075] S217, generating picture splicing schemes corresponding to the set of splicing pictures to be displayed respectively according to the splicing scheme perspective mapping set, wherein each element in the splicing scheme perspective mapping set corresponds to a picture splicing scheme; taking the elements in the splicing scheme perspective mapping set as perspective mapping points, extracting a perspective picture that is the same as the 3D model of the picture to be displayed corresponding to the corresponding screen, mapping and stretching the extracted perspective picture on the plane where the corresponding screen is located, and obtaining a splicing picture to be displayed on the corresponding screen corresponding to the picture splicing scheme of the corresponding perspective mapping point, and the picture contents of the same 3D model at the splicing position of adjacent splicing pictures to be displayed are connected;

[0076] The method for obtaining the interactive sensing recognition area corresponding to each picture interactive position in each picture splicing scheme comprises the following steps:

[0077] S221, obtaining a sensing recognition area set between the display terminal and the user, recorded as a first sensing area;

[0078] S222, obtain each picture splicing scheme, and i Each splicing picture to be displayed in the picture splicing scheme is projected on the corresponding screen. k Any point in the area corresponding to the interaction position of the first screen i The set of position areas that the lines connecting the view mapping points of the picture splicing scheme pass through are recorded as i In the picture splicing scheme k The area to be sensed corresponding to the interactive position of each screen;

[0079] S223, the first perception area and the i In the picture splicing scheme k The intersection of the areas to be sensed corresponding to the interactive positions of the screens is recorded as i In the picture splicing scheme k The interactive perception recognition area corresponds to the interactive position of each screen.

[0080] S3, analyzing the picture adaptability of each picture splicing solution based on user behavior reference feature information;

[0081] The S3 includes:

[0082] S31, obtaining reference characteristic information of user behavior at that time, and picture splicing schemes corresponding to the sets of spliced ​​pictures to be displayed;

[0083] S32, obtain user behavior reference feature information i The picture adaptability of the picture splicing solution is calculated as follows:

[0084] ,

[0085] in, P i Indicates the user behavior reference feature information for the i The picture adaptability of the picture splicing solution; LD i Indicates that the user's limb position moves along the direction of the corresponding limb change vector and the first i The shortest distance between the corresponding interactive perception recognition areas of the to-be-displayed images in the image splicing scheme; H Indicates the height of the head center point from the ground compared to the position of the display end in the user behavior reference feature information; μ represents the arm length conversion coefficient; Indicates that in each viewing data of the corresponding set of spliced ​​images to be displayed in the historical data, the corresponding arm span distance fluctuation coefficient is less than or equal to The percentage of times the user's position changes by a distance greater than or equal to the preset distance in the total number of views; the arm span distance fluctuation coefficient is equal to the shortest distance between the user's limb position in the corresponding viewing data and the corresponding interactive perception recognition area of ​​the image to be displayed in the display end when the limb position moves in the direction of the corresponding limb change vector, divided by the height of the head center point identified in the display end position from the ground in the corresponding user behavior reference feature information. μ The quotient of the product of .

[0086] S4, analyzing the display position adaptation adjustment coefficient based on the interactive position of each picture in the set of spliced ​​pictures to be displayed, and the difference between the interactively associated picture set and the set of spliced ​​pictures to be displayed; and calibrating the picture adaptation of each picture splicing scheme based on the display position adaptation adjustment coefficient;

[0087] The method for analyzing and displaying the position adaptation adjustment coefficient in S4 comprises the following steps:

[0088] S41, obtaining the interaction position of each screen in the set of spliced ​​screens to be displayed, the difference between the set of interactively associated screens and the set of spliced ​​screens to be displayed, and the user behavior data corresponding to each screen interaction behavior in the historical data;

[0089] S42, obtaining the display position adaptation adjustment coefficient, the calculation formula is as follows:

[0090] ,

[0091] AF i Indicates i The display position adaptation adjustment coefficient corresponding to each screen splicing solution; LTD i Indicates that the head angle in the user behavior reference feature information corresponds to the direction of the first iThe distance between the overlapping area of ​​the to-be-displayed images and the nearest image interaction position in the image splicing scheme; DS i express LTD i Similarity between the interactively associated picture set corresponding to the picture interactive position and the elements in the spliced ​​picture set to be displayed at the current time; DS i The value is equal to LTD i The average value of the percentage of pixels with the same pixel value in the interactively associated picture set corresponding to the picture interactive position and the spliced ​​picture set to be displayed at the current time in the picture corresponding to the same screen; DS i Greater than or equal to the preset threshold M When Otherwise, it is judged ;

[0092] In this embodiment, if there is no screen interaction position in the screen to be displayed, then LTD i Does not exist and LTD i There is no interactive associated screen set corresponding to the screen interaction position, that is, DS i The corresponding similarity is 0;

[0093] In this embodiment M is a preset constant greater than 0;

[0094] Therefore, it is determined ,but AF i =1;

[0095] The calculation formula for calibrating the screen adaptation of each screen splicing solution based on the display position adaptation adjustment coefficient is as follows: ,in, PC i Indicates the adjustment factor based on the display position adaptation i The picture adaptation calibration results of the picture splicing scheme.

[0096] S5, selecting the display end picture corresponding to the picture splicing scheme with the largest picture adaptability after calibration to adjust, and calibrating the interactive sensing recognition area of ​​the display end based on the interactive sensing recognition area corresponding to each picture interactive position in the adjusted picture splicing scheme;

[0097] The display end determines the interactive behavior triggering mode of the corresponding screen interactive position with respect to the calibrated interactive sensing recognition area; if the display end detects the user's triggering behavior information within the calibrated interactive sensing recognition area, it determines that the interactive behavior corresponding to the corresponding screen interactive position is triggered, and jumps the screen of the display end to a spliced ​​screen consisting of the interactive associated screen set corresponding to the corresponding screen interactive position; if the display end does not detect the user's triggering behavior information within the calibrated interactive sensing recognition area, it determines that the interactive behavior corresponding to the corresponding screen interactive position is not triggered, keeps the displayed screen unchanged, and does not jump to the spliced ​​screen consisting of the interactive associated screen set corresponding to the corresponding screen interactive position.

[0098] In this embodiment, the user's triggering behavior information is obtained through the user's body image monitoring screen or the radar wave feedback interval duration.

[0099] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0100] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for dynamically adjusting a display terminal based on user behavior, characterized in that: The method comprises the following steps: S1. Using sensors arranged around the display terminal, real-time location feature information and user behavior information of the user based on the display terminal are obtained, and user behavior reference feature information is constructed; S2, obtaining a set of spliced ​​pictures to be displayed corresponding to the display terminal at different times, a picture interaction position corresponding to each element in the corresponding set, and an interactive associated picture set corresponding to each picture interaction position, and generating picture splicing schemes corresponding to the set of spliced ​​pictures to be displayed, and an interactive sensing identification area corresponding to each picture interaction position in each picture splicing scheme; S3, analyzing the picture adaptability of each picture splicing solution based on user behavior reference feature information; S4, analyzing the display position adaptation adjustment coefficient based on the interactive position of each picture in the set of spliced ​​pictures to be displayed, and the difference between the interactively associated picture set and the set of spliced ​​pictures to be displayed; and calibrating the picture adaptation of each picture splicing scheme based on the display position adaptation adjustment coefficient; S5. Select the display end picture corresponding to the picture splicing scheme with the largest picture adaptability after calibration to adjust it, and calibrate the interactive sensing recognition area of ​​the display end based on the interactive sensing recognition area corresponding to each picture interactive position in the adjusted picture splicing scheme.

2. The method for dynamic adjustment of a display terminal based on user behavior according to claim 1, characterized in that: The position feature information includes the position of the user's head relative to the display terminal and the head facing angle; the user behavior information includes the user's limb movements, positions and change vectors of each limb at a corresponding time point, the vector direction in the limb change vector represents the movement direction of the limb; the vector modulus in the limb change vector represents the movement speed of the limb; The user behavior reference characteristic information includes an array consisting of display terminal-based position characteristic information and user behavior information corresponding to the corresponding user at the corresponding time point.

3. The method for dynamic adjustment of a display terminal based on user behavior according to claim 2, characterized in that: Each element in the set of spliced ​​images to be displayed corresponds to a picture to be spliced; if each picture to be spliced ​​has a picture interaction position, the corresponding picture interaction position is one or more, and the picture interaction position is a picture area preset in the database; when the user triggers an interactive behavior for a certain picture interaction position, the display screen jumps to the spliced ​​screen composed of the interactive associated picture set corresponding to the corresponding picture interaction position; the number of elements in the set of spliced ​​images to be displayed is the same as the number of screens of the display terminal, and each element corresponds to a screen of the display terminal; The method for generating a picture splicing scheme corresponding to each element in a set of spliced ​​pictures to be displayed comprises the following steps: S211, obtaining a set of spliced ​​images to be displayed corresponding to the display terminal at different times, and user behavior reference feature information; S212, obtaining each screen position in the display terminal and a preset viewing angle reference position in a database, and respectively obtaining position feature information of the preset viewing angle reference position compared with each screen position, wherein the position feature information represents a vector formed by the preset viewing angle reference position and a corresponding screen center point; S213, using the preset viewing angle reference position compared to the position characteristic information of each screen position as the viewing angle, respectively completing content mapping of the content of the spliced ​​picture to be displayed on the corresponding screen on a plane perpendicular to the viewing angle, to obtain a mapping picture of the spliced ​​picture to be displayed; S214, constructing a 3D model of the picture content by using the mapping pictures of each to-be-displayed spliced ​​picture respectively corresponding to the 2D picture to-be-displayed spliced ​​picture tool, and summarizing the 3D models of the picture content corresponding to the to-be-displayed spliced ​​pictures in combination with the direction and module length of the vector corresponding to the position feature information of the preset viewing angle reference position compared to each screen position, to generate a view-end 3D model corresponding to the to-be-displayed spliced ​​picture set; S215, obtaining a position of a head of position feature information in the user behavior reference feature information relative to the display end, recording the position as first position information, and generating a perspective mapping point of the first position information in the viewing end three-dimensional model according to a positional relationship between the first position information and a preset perspective reference position; S216, according to the number of interactions corresponding to the user in each viewing data of the corresponding spliced ​​picture set to be displayed in the historical data and the change distance between each viewing position and the user position during the interaction; the obtained maximum change distance is used as the perspective position fluctuation radius of the perspective mapping point of the first position information in the three-dimensional model of the viewer; extracting the position feature information of all users in the area surrounded by the perspective mapping point of the first position information in the three-dimensional model of the viewer and the corresponding perspective position fluctuation radius in each viewing data of the corresponding spliced ​​picture set to be displayed in the historical data, taking the head position in the obtained position feature information relative to the display end as an associated perspective mapping point, and taking the set consisting of each obtained associated perspective mapping point and the perspective mapping point of the first position information in the three-dimensional model of the viewer as the perspective mapping set of the splicing scheme; S217, generating picture splicing schemes corresponding to the set of splicing pictures to be displayed respectively according to the splicing scheme perspective mapping set, wherein each element in the splicing scheme perspective mapping set corresponds to a picture splicing scheme; taking the elements in the splicing scheme perspective mapping set as perspective mapping points, extracting a perspective picture that is the same as the 3D model of the picture to be displayed corresponding to the corresponding screen, mapping and stretching the extracted perspective picture on the plane where the corresponding screen is located, and obtaining a splicing picture to be displayed on the corresponding screen corresponding to the picture splicing scheme of the corresponding perspective mapping point, and the picture contents of the same 3D model at the splicing position of adjacent splicing pictures to be displayed are connected; The method for obtaining the interactive sensing recognition area corresponding to each picture interactive position in each picture splicing scheme comprises the following steps: S221, obtaining a sensing recognition area set between the display terminal and the user, recorded as a first sensing area; S222, obtain each picture splicing scheme, and i Each splicing picture to be displayed in the picture splicing scheme is projected on the corresponding screen. k Any point in the area corresponding to the interaction position of the first screen i The set of position areas that the lines connecting the view mapping points of the picture splicing scheme pass through are recorded as i In the picture splicing scheme k The area to be sensed corresponding to the interactive position of each screen; S223, the first perception area and the i In the picture splicing scheme k The intersection of the areas to be sensed corresponding to the interactive positions of the screens is recorded as i In the picture splicing scheme k The interactive perception recognition area corresponds to the interactive position of each screen.

4. The method for dynamic adjustment of a display terminal based on user behavior according to claim 2, characterized in that: The S3 includes: S31, obtaining reference characteristic information of user behavior at that time, and picture splicing schemes corresponding to the sets of spliced ​​pictures to be displayed; S32, obtain user behavior reference feature information i The picture adaptability of the picture splicing solution is calculated as follows: ， in, P i Indicates the user behavior reference feature information for the i The picture adaptability of the picture splicing solution; LD i Indicates that the user's limb position moves along the direction of the corresponding limb change vector and the first i The shortest distance between the corresponding interactive perception recognition areas of the to-be-displayed images in the image splicing scheme; H Indicates the height of the head center point from the ground compared to the position of the display end in the user behavior reference feature information; μ represents the arm length conversion coefficient; Indicates that in each viewing data of the corresponding set of spliced ​​images to be displayed in the historical data, the corresponding arm span distance fluctuation coefficient is less than or equal to The percentage of times the user's position changes by a distance greater than or equal to the preset distance in the total number of views; the arm span distance fluctuation coefficient is equal to the shortest distance between the user's limb position in the corresponding viewing data and the corresponding interactive perception recognition area of ​​the image to be displayed in the display end when the limb position moves in the direction of the corresponding limb change vector, divided by the height of the head center point identified in the display end position from the ground in the corresponding user behavior reference feature information. μ The quotient of the product of .

5. The method for dynamic adjustment of a display terminal based on user behavior according to claim 4, characterized in that: The method for analyzing and displaying the position adaptation adjustment coefficient in S4 comprises the following steps: S41, obtaining the interaction position of each screen in the set of spliced ​​screens to be displayed, the difference between the set of interactively associated screens and the set of spliced ​​screens to be displayed, and the user behavior data corresponding to each screen interaction behavior in the historical data; S42, obtaining the display position adaptation adjustment coefficient, the calculation formula is as follows: ， AF i Indicates i The display position adaptation adjustment coefficient corresponding to each screen splicing solution; LTD i Indicates that the head angle in the user behavior reference feature information corresponds to the direction of the first i The distance between the overlapping area of ​​the to-be-displayed images and the nearest image interaction position in the image splicing scheme; DS i express LTD i Similarity between the interactively associated picture set corresponding to the picture interactive position and the elements in the spliced ​​picture set to be displayed at the current time; DS i The value is equal to LTD i The average value of the percentage of pixels with the same pixel value in the interactively associated picture set corresponding to the picture interactive position and the spliced ​​picture set to be displayed at the current time in the picture corresponding to the same screen; DS i Greater than or equal to the preset threshold M When Otherwise, it is judged ; The calculation formula for calibrating the screen adaptation of each screen splicing solution based on the display position adaptation adjustment coefficient is as follows: ,in, PC i Indicates the adjustment factor based on the display position adaptation i The picture adaptation calibration results of the picture splicing scheme.

6. The method for dynamic adjustment of a display terminal based on user behavior according to claim 5, characterized in that: The display terminal determines the interactive behavior triggering mode of the corresponding screen interactive position according to the calibrated interactive sensing recognition area. If the display terminal detects the user's triggering behavior information in the calibrated interactive sensing recognition area, it determines to trigger the interactive behavior corresponding to the corresponding screen interactive position, and jumps the screen of the display terminal to the spliced ​​screen composed of the interactive associated screen set corresponding to the corresponding screen interactive position; If the display end does not detect the user's trigger behavior information in the calibrated interactive sensing identification area, it is determined that the interactive behavior corresponding to the corresponding screen interaction position is not triggered, the displayed screen remains unchanged, and the spliced ​​screen composed of the interactive associated screen set corresponding to the corresponding screen interaction position is not jumped.

7. A display terminal dynamic adjustment system based on user behavior, characterized in that: The system includes a behavior reference feature acquisition module, a screen splicing interaction analysis module, a screen scheme adaptation analysis module, a screen adaptation adjustment module and a display terminal dynamic control management module. The behavior reference feature acquisition module acquires the user's location feature information and user behavior information based on the display terminal in real time through sensors arranged around the display terminal, and constructs user behavior reference feature information; The screen splicing interaction analysis module obtains the set of spliced ​​screens to be displayed corresponding to the display terminal at different times, the screen interaction position corresponding to each element in the corresponding set, and the interactive associated screen set corresponding to each screen interaction position, and generates screen splicing schemes corresponding to the set of spliced ​​screens to be displayed, and the interactive sensing identification area corresponding to each screen interaction position in each screen splicing scheme; The picture scheme adaptation analysis module analyzes the picture adaptability of each picture splicing scheme based on user behavior reference feature information; The picture adaptation adjustment module analyzes the display position adaptation adjustment coefficient based on each picture interaction position in the set of spliced ​​pictures to be displayed, and the difference between the interactively associated picture set and the set of spliced ​​pictures to be displayed; and calibrates the picture adaptation of each picture splicing scheme based on the display position adaptation adjustment coefficient; The display end dynamic control management module selects the display end picture corresponding to the picture splicing scheme with the largest calibrated picture adaptability for control, and calibrates the interactive sensing recognition area of ​​the display end based on the interactive sensing recognition area corresponding to each picture interactive position in the controlled picture splicing scheme.

8. The display terminal dynamic adjustment system based on user behavior according to claim 7, characterized in that: The picture adaptation and adjustment module includes an adaptation and adjustment coefficient analysis unit and a picture adaptation and calibration unit. The adaptation adjustment coefficient analysis unit analyzes the display position adaptation adjustment coefficient based on the interactive position of each picture in the set of spliced ​​pictures to be displayed, and the difference between the interactive associated picture set and the set of spliced ​​pictures to be displayed; The picture adaptation calibration unit calibrates the picture adaptation of each picture splicing solution based on the display position adaptation adjustment coefficient.

Images