Multi-screen display collaborative control method and system

Abstract

The present application relates to the field of computer technology, and discloses a multi-screen display collaborative control method and system, the method comprising: collecting device features of multiple display terminals for collaborative display; calculating the device features of the multiple display terminals according to a preset method, obtaining weight values ​​of the multiple display terminals, used to indicate the display priority of the multiple display terminals during collaborative display; adjusting the display parameters of the multiple display terminals according to the weight values ​​of the multiple display terminals; generating a rendering matrix according to the display parameters of the multiple display terminals; and rendering the images displayed by the multiple display terminals according to the rendering matrix. The present invention can accurately control the rendering process of images on multiple display terminals by generating and applying a rendering matrix, thereby ensuring high-quality image output effects. The entire collaborative control process has a high degree of automation, so that non-professionals can easily complete complex multi-screen display settings.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and more specifically, to a multi-screen display collaborative control method and system. Background Art

[0002] With the popularization of smart terminal devices and the growing demand for multi-screen interaction, multi-screen collaborative display technology has gradually become an important research direction in the field of human-computer interaction. Traditional multi-screen display control methods mainly rely on signal synchronization technology at the hardware level, for example, multi-screen content mirroring display is achieved through HDMI distributors or wireless projection protocols. However, this simple signal replication mode cannot adapt to the heterogeneity of different display terminals in terms of physical characteristics, spatial layout, and environmental conditions, resulting in uneven display effects, which seriously restricts the application value of multi-screen systems in professional visualization, immersive interaction and other scenarios. In addition, most existing systems adopt a uniform rendering strategy without considering the performance differences of different display terminals.

[0003] Therefore, a new multi-screen display collaborative control technology solution is needed to effectively adapt to the heterogeneity of different display terminals in terms of physical characteristics, spatial layout and environmental conditions, realize nonlinear optimization configuration of cross-screen rendering resources, improve the display quality of multi-screen systems, and optimize energy efficiency. Summary of the invention

[0004] In order to solve the above-mentioned technical problems, the present application is proposed to provide a new multi-screen display collaborative control method and system, which can effectively adapt to the heterogeneity of different display terminals in terms of physical characteristics, spatial layout and environmental conditions, realize nonlinear optimization configuration of cross-screen rendering resources, improve the display quality of the multi-screen system, and optimize energy efficiency.

[0005] In a first aspect, the present invention provides a multi-screen display collaborative control method, comprising: collecting device characteristics of multiple display terminals used for collaborative display; calculating the device characteristics of the multiple display terminals according to a preset method to obtain weight values ​​of the multiple display terminals, which are used to indicate the display priorities of the multiple display terminals during collaborative display; adjusting display parameters of the multiple display terminals according to the weight values ​​of the multiple display terminals; generating a rendering matrix according to the display parameters of the multiple display terminals; and rendering images displayed by the multiple display terminals according to the rendering matrix.

[0006] Optionally, in the aforementioned multi-screen display collaborative control method, the device characteristics of the multiple display terminals include the physical screen sizes, resolution matrices, and screen curvature coefficients of the multiple display terminals.

[0007] Optionally, in the aforementioned multi-screen display collaborative control method, according to a preset method, the device characteristics of the multiple display terminals are calculated to obtain weight values ​​of the multiple display terminals, including: collecting the ambient illumination of the environment where the multiple display terminals are located; detecting the viewing distance of the multiple display terminals relative to the user; calculating the weight values ​​of the multiple display terminals, wherein the weight value of the i-th display terminal among the multiple display terminals is ,in, is the physical screen size of the i-th display terminal, , are the horizontal resolution and the vertical resolution in the resolution matrix of the i-th display terminal, is the screen curvature coefficient of the i-th display terminal, is the viewing distance of the i-th display terminal relative to the user, is the average viewing distance of the plurality of display terminals relative to the user, is an exponential function with the natural constant e as base, is the ambient illumination of the environment where the i-th display terminal is located, For the preset optimal illumination, is the preset maximum illumination, is the interaction priority of the i-th display terminal.

[0008] Optionally, in the aforementioned multi-screen display collaborative control method, before obtaining the weight values ​​of the multiple display terminals, the multi-screen display collaborative control method also includes: detecting the images displayed by the multiple display terminals; calculating the possibility of the multiple display terminals interacting with the user based on the images displayed by the multiple display terminals; and calculating the interaction priority of the multiple display terminals based on the possibility of the multiple display terminals interacting with the user.

[0009] Optionally, in the aforementioned multi-screen display collaborative control method, before obtaining the weight values ​​of the multiple display terminals, the multi-screen display collaborative control method further includes: detecting the pupil diameter of the user in real time ; According to the pupil diameter of the user , calculate the optimal illumination correction value ,in, , is the preset coefficient, is the preset target illumination, Indicates the time; using the optimal illumination correction value , for the preset optimal illumination Make corrections.

[0010] Optionally, in the aforementioned multi-screen display collaborative control method, adjusting the display parameters of the multiple display terminals according to the weight values ​​of the multiple display terminals includes: obtaining a preset reference dynamic refresh rate ; Detect the horizontal spatial coordinates of the multiple display terminals; calculate the dynamic refresh rate, display scale factor, and backlight intensity of the multiple display terminals, wherein the dynamic refresh rate of the i-th display terminal , is the average weight value of the multiple display terminals, represents the hyperbolic tangent function, represents a hyperbolic secant function, the display scale coefficient of the i-th display terminal , , the maximum value of the horizontal resolution and the maximum value of the vertical resolution in the resolution matrix of the plurality of display terminals, is the sum of the weight values ​​of the multiple display terminals, and the backlight intensity of the i-th display terminal , is the preset compensation factor, is the preset spatial attenuation coefficient, is the horizontal space coordinate of the i-th display terminal, It is the preset reference horizontal space coordinate.

[0011] Optionally, in the aforementioned multi-screen display collaborative control method, generating a rendering matrix according to the display parameters of the multiple display terminals includes: detecting the longitudinal spatial coordinates of the multiple display terminals; calculating the longitudinal distribution standard deviation of the multiple display terminals according to the longitudinal spatial coordinates of the multiple display terminals; ; Construct the rendering matrix ,in, is the preset lateral attenuation factor, is the horizontal spatial coordinate of the preset visual focus, is the Gaussian error function, is the vertical spatial coordinate of the i-th display terminal, is the average value of the longitudinal spatial coordinates of the multiple display terminals.

[0012] Optionally, in the aforementioned multi-screen display collaborative control method, the images displayed by the multiple display terminals are rendered according to the rendering matrix, including: detecting whether the images displayed by the multiple display terminals are cross-screen images; when the judgment result is yes, allocating video memory resources to the images displayed by the multiple display terminals according to the rendering matrix, and using the allocated video memory resources for image rendering; when the judgment result is no, rendering the image according to a preset single-screen optimization strategy.

[0013] In a second aspect, the present invention provides a multi-screen display collaborative control system, comprising: a feature acquisition module, which acquires device features of multiple display terminals used for collaborative display; a weight calculation module, which calculates the device features of the multiple display terminals according to a preset method, and obtains weight values ​​of the multiple display terminals, which are used to indicate the display priorities of the multiple display terminals during collaborative display; a parameter adjustment module, which adjusts the display parameters of the multiple display terminals according to the weight values ​​of the multiple display terminals; a matrix generation module, which generates a rendering matrix according to the display parameters of the multiple display terminals; and an image rendering module, which renders the images displayed by the multiple display terminals according to the rendering matrix.

[0014] The above one or more technical solutions of the present invention have at least one or more of the following beneficial effects:

[0015] According to the technical solution of the present invention, by generating and applying the rendering matrix, this method can accurately control the rendering process of images on multiple display terminals, thereby ensuring high-quality image output effects. This is particularly important for applications that pursue high-definition image quality. The entire collaborative control process has a high degree of automation, which reduces the need for manual intervention and reduces the complexity of operation, so that non-professionals can easily complete complex multi-screen display settings. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] By describing the embodiments of the present application in more detail in conjunction with the accompanying drawings, the above and other purposes, features and advantages of the present application will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0017] Figure 1 is a flowchart of a multi-screen display collaborative control method according to an embodiment of the present application;

[0018] Figure 2 is a partial flow chart of a multi-screen display collaborative control method according to an embodiment of the present application;

[0019] Figure 3 is another layout flow chart of the multi-screen display collaborative control method according to an embodiment of the present application;

[0020] Figure 4 is another partial flow chart of the multi-screen display collaborative control method according to an embodiment of the present application;

[0021] Figure 5 A partial schematic diagram of a multi-screen display collaborative control method according to an embodiment of the present application;

[0022] Figure 6It is a block diagram of a multi-screen display collaborative control system according to an embodiment of the present application. DETAILED DESCRIPTION

[0023] Some embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0024] like Figure 1 As shown, in one embodiment of the present invention, a multi-screen display collaborative control method is provided, comprising:

[0025] Step S110 , collecting device characteristics of multiple display terminals used for collaborative display, wherein the device characteristics of the multiple display terminals include the physical screen sizes, resolution matrices, and screen curvature coefficients of the multiple display terminals.

[0026] In this embodiment, the introduction of the screen curvature coefficient enables the system to optimize and adjust screens with different curvatures, especially for curved displays, which can provide a more immersive viewing experience. At the same time, the adjustment based on the resolution matrix ensures that the image details can be optimally displayed at any resolution.

[0027] Step S120, calculating the device characteristics of the multiple display terminals according to a preset method to obtain weight values ​​of the multiple display terminals, which are used to indicate the display priorities of the multiple display terminals during collaborative display.

[0028] In this embodiment, since the method supports calculating weight values ​​according to the characteristics of different display terminals, and thus performing personalized settings, it is very suitable for use in occasions that require high flexibility and strong adaptability, such as remote conferencing, education and training, advertising display, etc., to provide users with more customized services.

[0029] Step S130: adjusting display parameters of the multiple display terminals according to the weight values ​​of the multiple display terminals.

[0030] In this embodiment, by calculating the weight value according to the device characteristics of the display terminal and adjusting the display parameters accordingly, it can be ensured that the content of each screen can be presented in the best way when multiple screens are displayed collaboratively. This not only improves the visual experience, but also enhances the convenience and satisfaction of user interaction. In addition, the method can dynamically adjust the display parameters of each display terminal according to its specific performance indicators (such as resolution, refresh rate, etc.), thereby achieving effective management and optimal allocation of system resources, avoiding waste of resources while improving the operating efficiency of the overall system.

[0031] Step S140: generating a rendering matrix according to display parameters of a plurality of display terminals.

[0032] Step S150: Rendering images displayed by multiple display terminals according to the rendering matrix.

[0033] According to the technical solution of this embodiment, by generating and applying the rendering matrix, this method can accurately control the rendering process of images on multiple display terminals, thereby ensuring high-quality image output effects. This is especially important for applications that pursue high-definition image quality. The entire collaborative control process has a high degree of automation, which reduces the need for manual intervention and reduces the complexity of operation, so that non-professionals can easily complete complex multi-screen display settings.

[0034] like Figure 2 As shown, an embodiment of the present invention provides a multi-screen display collaborative control method. Compared with the previous embodiment, the multi-screen display collaborative control method of this embodiment, step S120 includes:

[0035] Step S210: collecting the ambient illumination of the environment where the multiple display terminals are located.

[0036] In this embodiment, by considering the ambient illumination and combining the preset optimal illumination and maximum illumination, the method can dynamically adjust the display parameters of each display terminal. This ensures that the screen content can be presented with optimal brightness and contrast under different lighting conditions, avoiding the problem of overbrightness or overdarkness, thereby improving the visual comfort of the user.

[0037] Step S220: detecting the viewing distances of the plurality of display terminals relative to the user.

[0038] In this embodiment, the display parameters are adjusted according to the viewing distance of the display terminal relative to the user and the average viewing distance of all display terminals. This method is particularly suitable for scenes such as conference rooms or exhibitions, ensuring that users can get a clear and comfortable viewing experience no matter where they stand. At the same time, taking into account factors such as the physical size of the screen and the resolution matrix, the adaptation accuracy is further enhanced.

[0039] Step S230, calculating weight values ​​of multiple display terminals, wherein the weight value of the i-th display terminal among the multiple display terminals is ,in, is the physical screen size of the i-th display terminal, , is the horizontal resolution and vertical resolution in the resolution matrix of the i-th display terminal, is the screen curvature coefficient of the i-th display terminal, is the viewing distance of the i-th display terminal relative to the user, is the average viewing distance of multiple display terminals relative to the user, is an exponential function with the natural constant e as base, is the ambient illumination of the environment where the i-th display terminal is located, For the preset optimal illumination, is the preset maximum illumination, is the interaction priority of the i-th display terminal.

[0040] According to the technical solution of this embodiment, by introducing the screen curvature coefficient and interaction priority, a more personalized display effect can be provided to the user. For terminals with high interaction requirements, higher weight values ​​are given so that these terminals can occupy a more important position in collaborative work, improving the convenience and efficiency of user operations. The method of comprehensively calculating the weight value based on the above-mentioned multiple factors enables the system to allocate resources more intelligently. For example, in the case of limited processing power, the performance requirements of important display terminals are given priority to ensure that key information can be conveyed to users in a timely and accurate manner, thereby improving the operating efficiency of the overall system.

[0041] like Figure 3 As shown, an embodiment of the present invention provides a multi-screen display collaborative control method. Compared with the previous embodiment, the multi-screen display collaborative control method of this embodiment, before step S230, further includes:

[0042] Step S310: detecting images displayed by multiple display terminals.

[0043] Step S320: calculating the likelihood of the multiple display terminals interacting with the user based on the images displayed by the multiple display terminals.

[0044] Step S330: Calculate the interaction priorities of the multiple display terminals according to the possibility of the multiple display terminals interacting with the user.

[0045] In this embodiment, by detecting the images displayed by multiple display terminals and calculating the possibility of interaction with the user, the interaction priority of each display terminal can be dynamically adjusted according to the actual usage scenario. This means that when necessary, key information or operation interfaces can respond to user operations more quickly, improving work efficiency and user experience.

[0046] Step S340: Real-time detection of the user's pupil diameter .

[0047] Step S350, based on the user's pupil diameter , calculate the optimal illumination correction value ,in, , is the preset coefficient, is the preset target illumination, Indicates time.

[0048] In this embodiment, the user's pupil diameter is detected in real time, and the optimal illumination correction value is calculated accordingly. This method utilizes the natural response mechanism of the human visual system to light sensitivity, ensuring that the screen brightness is always at the most appropriate state, reducing eye fatigue and improving comfort for long-term use.

[0049] Step S360, using the optimal illumination correction value , for the preset optimal illumination Make corrections.

[0050] According to the technical solution of this embodiment, not only the instantaneous change of pupil diameter is taken into account, but also the long-term cumulative effect is taken into account, thereby achieving fine control of ambient lighting conditions, so that the best visual experience can be provided in both short and long periods of time. By incorporating the user interaction possibility and the optimal illumination correction value into the weight value calculation, the method further improves the intelligence of the system. This enables the multi-screen display system to more accurately predict user needs and make corresponding adjustments, enhancing the system's adaptability and flexibility.

[0051] like Figure 4 As shown, an embodiment of the present invention provides a multi-screen display collaborative control method. Compared with the previous embodiment, the multi-screen display collaborative control method of this embodiment, step S130 includes:

[0052] Step S410, obtaining a preset reference dynamic refresh rate .

[0053] Step S420: detecting the horizontal spatial coordinates of multiple display terminals.

[0054] Step S430, calculating the dynamic refresh rate, display scale factor, and backlight intensity of multiple display terminals, wherein the dynamic refresh rate of the i-th display terminal is , is the average weight value of the multiple display terminals, represents the hyperbolic tangent function, Represents the hyperbolic secant function, the display scale factor of the i-th display terminal , , the maximum value of the horizontal resolution and the maximum value of the vertical resolution in the resolution matrix of multiple display terminals, is the sum of the weight values ​​of multiple display terminals, and the backlight intensity of the i-th display terminal , is the preset compensation factor, is the preset spatial attenuation coefficient, is the horizontal spatial coordinate of the i-th display terminal, It is the preset reference horizontal space coordinate.

[0055] In this embodiment, by obtaining a preset benchmark dynamic refresh rate and calculating the dynamic refresh rate of each display terminal according to its weight value, the method can ensure the best visual fluency in different application scenarios. For example, in applications that require high frame rates (such as games or video editing), key display terminals can automatically increase the refresh rate, thereby reducing screen tearing and freezes, and improving user experience.

[0056] In this embodiment, the backlight intensity of each display terminal is calculated based on the spatial attenuation coefficient and the horizontal spatial coordinate. This method can effectively avoid the problem of uneven brightness caused by the difference in distance between screens, and ensure that all screens can present content at the most appropriate brightness, which is particularly important in large-size multi-screen splicing scenarios.

[0057] In this embodiment, by calculating the display scale coefficient of each display terminal, the method can reasonably allocate display resources according to the importance of each display terminal while ensuring image clarity. This not only improves the overall display effect, but also enhances the flexibility and adaptability of the system, and is suitable for a variety of complex application environments.

[0058] According to the technical solution of this embodiment, by introducing the benchmark dynamic refresh rate, spatial position perception and dynamic adjustment mechanism based on weight value, the intelligence level and user experience of the multi-screen display system are greatly improved. It can not only provide smoother and clearer visual effects, but also can be flexibly adjusted according to the needs of different application scenarios. It is suitable for a wide range of application scenarios, from home entertainment to professional meetings and other occasions, and can achieve significant performance improvement and experience improvement.

[0059] like Figure 5 As shown, an embodiment of the present invention provides a multi-screen display collaborative control method. Compared with the previous embodiment, the multi-screen display collaborative control method of this embodiment, step S140 includes:

[0060] Step S510: detecting the longitudinal spatial coordinates of a plurality of display terminals.

[0061] Step S520, calculating the longitudinal distribution standard deviation of the plurality of display terminals according to the longitudinal spatial coordinates of the plurality of display terminals .

[0062] In this embodiment, by detecting the longitudinal spatial coordinates of multiple display terminals and calculating their longitudinal distribution standard deviation, the system can more accurately perceive the vertical position relationship of each display terminal. This allows more accurate display parameter adjustments based on user perspective and physical layout in a multi-screen collaborative environment, ensuring consistency and coordination of content across different screens.

[0063] Step S530: construct a rendering matrix ,in, is the preset lateral attenuation factor, is the horizontal spatial coordinate of the preset visual focus, is the Gaussian error function, is the vertical spatial coordinate of the i-th display terminal, is the average of the longitudinal spatial coordinates of multiple display terminals.

[0064] According to the technical solution of this embodiment, by introducing the lateral attenuation factor and the lateral spatial coordinates of the visual focus, the system can better simulate the changes in the human eye's attention to visual information, ensure that the content in the key area is presented with higher quality, and enhance the user's visual experience. The Gaussian error function is used to process the changes in the longitudinal spatial coordinates, so that the system can smoothly adjust the display effects between different screens to avoid visual inconsistency problems caused by differences in screen positions.

[0065] In one embodiment of the present invention, a multi-screen display collaborative control method is provided. Compared with the above-mentioned embodiment, in the multi-screen display collaborative control method of this embodiment, step S150 includes:

[0066] (1) Detect whether the images displayed by multiple display terminals are cross-screen images.

[0067] (2) When the judgment result is yes, video memory resources are allocated to the images displayed by the multiple display terminals according to the rendering matrix, and the allocated video memory resources are used to render the images.

[0068] In this embodiment, when it is detected that the images displayed by multiple display terminals are cross-screen images, the system will allocate video memory resources to these display terminals according to the rendering matrix. This demand-based video memory resource allocation method ensures seamless connection and efficient rendering of cross-screen images on multiple screens, avoids problems such as screen tearing and delay caused by insufficient resources, and improves the overall visual experience.

[0069] (3) When the judgment result is no, the image is rendered according to the preset single-screen optimization strategy.

[0070] In this embodiment, if the detection result shows that the image is not a cross-screen image, the system will render the image according to the preset single-screen optimization strategy. This method can optimize the content of a single screen according to the needs of a specific application scenario, such as adjusting parameters such as contrast and brightness to ensure the best single-screen display effect.

[0071] According to the technical solution of this embodiment, by introducing a cross-screen image detection mechanism and a dynamic resource allocation strategy, the intelligence level and user experience of the multi-screen display system are greatly improved. It can not only provide smoother and clearer visual effects, but also can be flexibly adjusted according to the needs of different application scenarios, and is suitable for a wide range of application scenarios. Especially for occasions requiring high-precision multi-screen collaboration, this method can significantly improve the display effect and ease of operation, and also provide a high-quality optimization solution for single-screen applications, ensuring that each display requirement can be optimally met.

[0072] like Figure 6 As shown, in one embodiment of the present invention, a multi-screen display collaborative control system is provided, comprising:

[0073] The feature collection module 610 collects device features of multiple display terminals used for collaborative display, wherein the device features of the multiple display terminals include the physical screen sizes, resolution matrices, and screen curvature coefficients of the multiple display terminals.

[0074] In this embodiment, the introduction of the screen curvature coefficient enables the system to optimize and adjust screens with different curvatures, especially for curved displays, which can provide a more immersive viewing experience. At the same time, the adjustment based on the resolution matrix ensures that the image details can be optimally displayed at any resolution.

[0075] The weight calculation module 620 calculates the device characteristics of the multiple display terminals according to a preset method to obtain weight values ​​of the multiple display terminals, which are used to indicate the display priorities of the multiple display terminals during collaborative display.

[0076] In this embodiment, since the method supports calculating weight values ​​according to the characteristics of different display terminals, and thus performing personalized settings, it is very suitable for use in occasions that require high flexibility and strong adaptability, such as remote conferencing, education and training, advertising display, etc., to provide users with more customized services.

[0077] The parameter adjustment module 630 adjusts the display parameters of the multiple display terminals according to the weight values ​​of the multiple display terminals.

[0078] In this embodiment, by calculating the weight value according to the device characteristics of the display terminal and adjusting the display parameters accordingly, it can be ensured that the content of each screen can be presented in the best way when multiple screens are displayed collaboratively. This not only improves the visual experience, but also enhances the convenience and satisfaction of user interaction. In addition, the method can dynamically adjust the display parameters of each display terminal according to its specific performance indicators (such as resolution, refresh rate, etc.), thereby achieving effective management and optimal allocation of system resources, avoiding waste of resources while improving the operating efficiency of the overall system.

[0079] The matrix generation module 640 generates a rendering matrix according to display parameters of multiple display terminals.

[0080] The image rendering module 650 renders the images displayed by the multiple display terminals according to the rendering matrix.

[0081] According to the technical solution of this embodiment, by generating and applying the rendering matrix, this method can accurately control the rendering process of images on multiple display terminals, thereby ensuring high-quality image output effects. This is especially important for applications that pursue high-definition image quality. The entire collaborative control process has a high degree of automation, which reduces the need for manual intervention and reduces the complexity of operation, so that non-professionals can easily complete complex multi-screen display settings.

[0082] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.

[0083] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.

[0084] It should also be noted that in the apparatus, device and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.

[0085] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0086] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A multi-screen display collaborative control method, characterized in that: include: Collecting device characteristics of multiple display terminals for collaborative display; Calculating device features of the multiple display terminals according to a preset manner to obtain weight values ​​of the multiple display terminals, which are used to indicate display priorities of the multiple display terminals during collaborative display; According to the weight values ​​of the multiple display terminals, adjusting the display parameters of the multiple display terminals, wherein the display parameters include a dynamic refresh rate, a display scale factor, and a backlight intensity of the display terminals; Generate a rendering matrix according to display parameters of the multiple display terminals; Rendering the images displayed by the plurality of display terminals according to the rendering matrix, The step of generating a rendering matrix according to the display parameters of the plurality of display terminals includes: Detecting the longitudinal spatial coordinates of the plurality of display terminals; Calculate the longitudinal distribution standard deviation of the plurality of display terminals according to the longitudinal spatial coordinates of the plurality of display terminals ; Construct the rendering matrix ,in, is the preset lateral attenuation factor, is the horizontal spatial coordinate of the preset visual focus, is the Gaussian error function, is the vertical spatial coordinate of the i-th display terminal, is the average value of the longitudinal spatial coordinates of the multiple display terminals, is the display scale factor of the i-th display terminal, is the backlight intensity of the i-th display terminal, is the dynamic refresh rate of the i-th display terminal, is the horizontal spatial coordinate of the i-th display terminal, The step of rendering the images displayed by the plurality of display terminals according to the rendering matrix includes: Detecting whether the images displayed by the multiple display terminals are cross-screen images; When the judgment result is yes, allocating video memory resources to the images displayed by the multiple display terminals according to the rendering matrix, and using the allocated video memory resources to perform image rendering; When the judgment result is no, the image rendering is performed according to the preset single-screen optimization strategy.

2. The multi-screen display collaborative control method according to claim 1, characterized in that: The device characteristics of the multiple display terminals include the physical screen sizes, resolution matrices, and screen curvature coefficients of the multiple display terminals.

3. The multi-screen display collaborative control method according to claim 2, characterized in that: Calculating the device features of the plurality of display terminals according to a preset manner to obtain weight values ​​of the plurality of display terminals includes: Collecting the ambient illumination of the environment where the multiple display terminals are located; Detecting the viewing distances of the plurality of display terminals relative to a user; Calculate the weight values ​​of the multiple display terminals, wherein the weight value of the i-th display terminal among the multiple display terminals is ,in, is the physical screen size of the i-th display terminal, , are the horizontal resolution and the vertical resolution in the resolution matrix of the i-th display terminal, is the screen curvature coefficient of the i-th display terminal, is the viewing distance of the i-th display terminal relative to the user, is the average viewing distance of the plurality of display terminals relative to the user, is an exponential function with the natural constant e as base, is the ambient illumination of the environment where the i-th display terminal is located, For the preset optimal illumination, is the preset maximum illumination, is the interaction priority of the i-th display terminal.

4. The multi-screen display collaborative control method according to claim 3, characterized in that: Before obtaining the weight values ​​of the multiple display terminals, the multi-screen display collaborative control method further includes: detecting images displayed by the plurality of display terminals; Calculating, based on the images displayed by the multiple display terminals, the likelihood of the multiple display terminals interacting with the user; The interaction priorities of the multiple display terminals are calculated according to the possibility of the multiple display terminals interacting with the user.

5. The multi-screen display collaborative control method according to claim 3, characterized in that: Before obtaining the weight values ​​of the multiple display terminals, the multi-screen display collaborative control method further includes: Real-time detection of the user's pupil diameter ; According to the pupil diameter of the user , calculate the optimal illumination correction value ,in, , is the preset coefficient, is the preset target illumination, Indicates time; Use the optimal illumination correction value , for the preset optimal illumination Make corrections.

6. The multi-screen display collaborative control method according to claim 3, characterized in that: Adjusting display parameters of the plurality of display terminals according to the weight values ​​of the plurality of display terminals includes: Get the preset baseline dynamic refresh rate ; detecting the horizontal spatial coordinates of the plurality of display terminals; Calculate the dynamic refresh rate, display scale factor, and backlight intensity of the multiple display terminals, wherein the dynamic refresh rate of the i-th display terminal , is the average weight value of the multiple display terminals, represents the hyperbolic tangent function, represents a hyperbolic secant function, the display scale coefficient of the i-th display terminal , , the maximum value of the horizontal resolution and the maximum value of the vertical resolution in the resolution matrix of the plurality of display terminals, is the sum of the weight values ​​of the multiple display terminals, and the backlight intensity of the i-th display terminal , is the preset compensation factor, is the preset spatial attenuation coefficient, is the horizontal space coordinate of the i-th display terminal, It is the preset reference horizontal space coordinate.

7. A multi-screen display cooperative control system, executing a multi-screen display cooperative control method according to any one of claims 1 to 6, characterized in that: include: A feature collection module, which collects device features of multiple display terminals for collaborative display; A weight calculation module, which calculates the device characteristics of the multiple display terminals according to a preset method to obtain weight values ​​of the multiple display terminals, which are used to indicate the display priorities of the multiple display terminals during collaborative display; a parameter adjustment module, adjusting display parameters of the plurality of display terminals according to weight values ​​of the plurality of display terminals; A matrix generation module, generating a rendering matrix according to display parameters of the plurality of display terminals; An image rendering module renders the images displayed by the multiple display terminals according to the rendering matrix.

Images