Multi-screen physical deformation visual presentation system and method based on brightness mapping

Abstract

The invention relates to the technical field of visual design equipment, in particular to a multi-screen physical deformation visual presentation system and method based on brightness mapping, and the system comprises a display module which is composed of M * N sub-display units which are physically independent from each other and are arranged in a rectangular array mode; the driving module comprises M * N driving mechanisms, and the execution end of each driving mechanism is fixedly connected with one sub-display unit and used for driving the sub-display unit to do translational motion in the direction perpendicular to the display plane of the sub-display unit; the control module is in communication connection with the display module and the driving module, the control module comprises an image processing unit, a displacement calculation unit and a driving control unit, and the driving control unit is used for controlling the corresponding driving mechanism to act according to the target displacement, so that each sub-display unit moves to a target position, and the image processing unit is used for processing the target displacement. Therefore, all the sub-display units jointly form a three-dimensional embossment visual effect corresponding to the brightness distribution of the target image frame in a physical space.

Description

Technical Field

[0001] This invention relates to the field of visual design equipment technology, specifically to a multi-screen physical deformation visual presentation system and method based on brightness mapping. Background Technology

[0002] In order to provide vivid and high-resolution images, the traditional field of visual design uses liquid crystal displays (LCDs) and organic light-emitting diode (OLEDs) displays to compress the scenes of the three-dimensional world onto a two-dimensional plane. However, this lacks real physical depth and a sense of three-dimensionality, which limits the immersive experience of the audience.

[0003] To create stereoscopic visual effects, the industry has developed technologies such as naked-eye 3D and light field displays. These technologies attempt to create a sense of depth through optical means, but their effects have significant limitations. On the one hand, their stereoscopic effect is highly dependent on the observer's perspective; when viewed from the side, the stereoscopic effect weakens or even disappears rapidly, greatly diminishing the sense of depth and failing to provide an immersive experience from all angles. On the other hand, these technologies are essentially still visual illusions presented on a two-dimensional plane, unable to construct realistic physical surface undulations, and therefore completely lack the possibility of tactile interaction. Currently, the market lacks a technical solution that can combine high-resolution electronic displays with precise, smooth, and dynamic physical deformation, making it difficult to achieve a visual presentation effect that can display rich image details while presenting a stable and realistic three-dimensional physical structure from any viewing angle. Summary of the Invention

[0004] To address the shortcomings of existing technologies, this invention provides a multi-screen physical deformation visual presentation system and method based on brightness mapping, which overcomes the deficiencies of existing technologies and can display more realistic and artistic three-dimensional physical visual presentation effects.

[0005] To achieve the above objectives, the present invention provides the following technical solution:

[0006] This invention provides a multi-screen physical deformation visual presentation system based on brightness mapping, comprising:

[0007] The display module consists of M×N physically independent sub-display units arranged in a rectangular array, where M and N are both positive integers not less than 2;

[0008] The driving module includes M×N driving mechanisms, and the execution end of each driving mechanism is fixedly connected to one of the sub-display units, for driving the sub-display unit to perform translational movement in a direction perpendicular to its display plane;

[0009] A control module, communicatively connected to the display module and the drive module, includes:

[0010] an image processing unit configured to acquire a target image frame and divide the image frame into M×N image regions in the same arrangement as the sub-display units, and extract luminance information of each image region;

[0011] a displacement calculation unit configured to calculate target displacement amounts of the sub-display units according to the luminance information based on a preset luminance-displacement mapping relationship;

[0012] a driving control unit configured to control the corresponding driving mechanisms to move the sub-display units to target positions according to the target displacement amounts, so that all the sub-display units collectively form a three-dimensional relief visual effect corresponding to the luminance distribution of the target image frame in the physical space.

[0013] Preferably, the luminance-displacement mapping relationship is that the higher the luminance value of an image region, the greater the displacement amount of the corresponding sub-display unit protruding forward; and the lower the luminance value of an image region, the greater the displacement amount of the corresponding sub-display unit retracting backward.

[0014] Preferably, the image processing unit is further configured to perform regional gamma correction on the target image frame before extracting the luminance information.

[0015] Preferably, the displacement calculation unit is further configured to:

[0016] calculate luminance similarity between adjacent image regions;

[0017] if the luminance similarity is higher than a preset threshold, perform smooth fitting processing on the target displacement amounts of the sub-display units corresponding to the adjacent image regions, so that the final physical positions of the two adjacent sub-display units are smoothly transitioned.

[0018] Preferably, the control module is further configured to:

[0019] receive a sequence of continuous image frames as a video input;

[0020] calculate displacement amounts in real time based on the luminance information of each image frame and control the driving mechanisms to move the sub-display units continuously to present a dynamic three-dimensional relief animation effect.

[0021] Preferably, the driving control unit is further configured to generate a smooth movement path according to the target displacement amounts by using an interpolation algorithm, and control the driving mechanisms to move along the path to suppress movement overshoot and mechanical oscillation.

[0022] Preferably, the sub-display units are OLED display units or LCD display units equipped with backlight modules.

[0023] A multi-screen physical deformation visual presentation method based on brightness mapping, comprising the following steps:

[0024] Obtaining a target image frame;

[0025] Logically dividing the target image frame into MxN image regions, which correspond to physical sub-display units respectively;

[0026] Extracting a brightness feature value of each image region;

[0027] According to a preset brightness-displacement mapping relationship, converting each brightness feature value into a target displacement value of the corresponding sub-display unit;

[0028] Controlling a driving mechanism to drive each sub-display unit to move to a physical position specified by the target displacement value.

[0029] The present application provides a multi-screen physical deformation visual presentation system and method based on brightness mapping. The following beneficial effects are provided:

[0030] The present application directly maps image brightness information to physical displacement to drive an array of independent sub-display units to construct a real three-dimensional physical surface. The three-dimensional shape is an objective entity structure that can provide stable, real and consistent stereoscopic visual effects from any angle of view, completely solving the problem of limited viewing angle in naked eye 3D technology and rapid decrease in depth perception when viewed from the side. The system can intelligently adjust the brightness extraction strategy according to the light and dark of the image content, making the restoration of dark details and bright levels more consistent with human visual characteristics, ensuring that the data for physical deformation is highly accurate, and thus generating extremely realistic relief details. BRIEF DESCRIPTION OF DRAWINGS

[0031] Fig. 1 A structural schematic diagram of a multi-screen physical deformation visual presentation system based on brightness mapping provided by the present application;

[0032] Fig. 2 A step schematic diagram of a multi-screen physical deformation visual presentation method based on brightness mapping provided by the present application;

[0033] Fig. 3 A connection relationship diagram of a driving mechanism and a sub-display unit in the present application;

[0034] In the figure: 1, display module; 11, sub-display unit; 2, driving module; 21, driving mechanism; 3, control module; 31, image processing unit; 32, displacement calculation unit; 33, driving control unit. DETAILED DESCRIPTION

[0035] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0036] Referring to Figs. 1-3 The present application provides a multi-screen physical deformation visual presentation system based on brightness mapping, comprising:

[0037] A display module, which is composed of MxN physically independent sub-display units arranged in a rectangular array, wherein M and N are both positive integers not less than 2, and the sub-display unit is an OLED display unit or an LCD display unit equipped with a backlight module;

[0038] A driving module, which comprises MxN driving mechanisms, and the execution end of each driving mechanism is fixedly connected with a sub-display unit, for driving the sub-display unit to move in a direction perpendicular to its display plane; wherein the driving mechanism is any one of a linear motor, a steering engine, a crank linkage combination mechanism, a pneumatic push rod or a hydraulic push rod;

[0039] A control module, which is in communication connection with the display module and the driving module, and the control module comprises an image processing unit, a displacement calculation unit and a driving control unit.

[0040] The image processing unit is used for acquiring a target image frame, and dividing the image frame into MxN image regions which are the same as the arrangement structure of the sub-display units, and extracting the brightness information of each image region.

[0041] For example, the image processing unit first acquires the resolution of the target image frame (for example, 3840x2160 pixels), and logically divides it into 8x12 image tiles according to the physical arrangement of the display module (for example, 8x12 sub-display units). Each tile contains 480x180 pixels (3840 / 8=480, 2160 / 12=180), and corresponds to a physical sub-display unit.

[0042] The present application can use the average method or weighted center calculation to extract the brightness characteristic value L of each image tile.

[0043] The calculation formula of the average method is as follows:

[0044]

[0045] wherein, Total number of pixels in the image block, The gray value of the i-th pixel is calculated by the gray fitting formula from the RGB color space: V = 0.299R + 0.587G + 0.114B (R, G, B respectively correspond to the intensity of red, green and blue three colors, and each value usually ranges from 0 to 255).

[0046] In addition, the image processing unit can also be configured to perform regional gamma correction on the target image frame before extracting the brightness information, so as to more accurately extract the brightness conforming to the human eye perception. Specifically, the image control unit calculates the average brightness L_avg of the block, and then corrects each pixel in the block according to the following formula:

[0047]

[0048] Wherein, V refers to the gray value of a single pixel in the input image, is the gray value after gamma correction, and γ can be dynamically selected according to L_avg. For example, when L_avg is low (dark field), a smaller γ value (such as 0.6) is selected to enhance the dark details; when L_avg is high (bright field), a larger γ value (such as 1.2) is selected to suppress overexposure. After correction, the final block brightness feature value is calculated using the corrected pixel value.

[0049] For images with complex content, the unit can use an image segmentation algorithm to separate the foreground subject and the background in the image first. Then, the brightness features of the region where the foreground subject is located can be extracted or weighted preferentially to ensure that the most important visual elements are most prominent in their deformation performance.

[0050] The displacement calculation unit is configured to calculate the target displacement amount of each sub-display unit according to the preset brightness-displacement mapping relationship based on the brightness information.

[0051] The brightness-displacement mapping relationship is that the higher the brightness value of the image region, the greater the displacement amount of the corresponding sub-display unit protruding forward; the lower the brightness value of the image region, the greater the displacement amount of the corresponding sub-display unit retracting backward; and the mapping formula of the brightness-displacement mapping is:

[0052]

[0053] Wherein:

[0054] : the brightness feature value of the current image block;

[0055] , : the maximum and minimum values of all image block brightness values, or a system preset fixed range (0-255);

[0056] : the displacement of the sub-display unit when the brightness is the brightest (the maximum protruding position), in millimeters (mm);

[0057] : the displacement of the sub-display unit when the brightness is the darkest (the maximum retracted position), in millimeters (mm).

[0058] In the present application, the displacement calculation unit is further configured to: calculate the brightness similarity between adjacent image regions, for example, for any one sub-display unit, calculate the absolute value of the difference between the brightness feature values of the image blocks corresponding to the four adjacent units above, below, left and right ; if the brightness similarity is higher than a preset threshold , then the target displacement amount of the sub-display unit corresponding to the adjacent image region is subjected to smooth fitting processing, so that the final physical positions of the two adjacent sub-display units are smoothly transitioned; that is, if < , then it is considered that the two adjacent regions belong to "continuous surface" and the original target displacement amount thereof needs to be smoothed, and specifically, the bilinear interpolation can be used as the means of smooth fitting, the adjacent units subjected to threshold judgment are regarded as an integral region, and the displacement amount of each point in the region is calculated using the interpolation algorithm, so that the displacement field changes continuously, which is a conventional means in graphics and will not be described here.

[0059] The drive control unit is configured to control the corresponding drive mechanism to move according to the target displacement amount, convert the calculated target displacement amount into accurate motion instructions of the drive mechanism, and move each sub-display unit to the target position, so that all sub-display units collectively form a three-dimensional relief visual effect corresponding to the brightness distribution of the target image frame in the physical space.

[0060] The drive control unit is further configured to generate a smooth moving path according to the target displacement amount using an interpolation algorithm, and control the drive mechanism to move along the path to suppress motion overshoot and mechanical oscillation; specifically, the drive control unit does not directly instruct the drive mechanism to move to the target position, but uses an S-shaped acceleration and deceleration curve for path planning, and the moving path of the drive sub-display unit driven by the drive mechanism includes three processes: an acceleration stage, a constant speed stage and a deceleration stage; for example, when the drive mechanism is a linear motor, in the acceleration stage, the motor accelerates to the maximum allowed speed at a preset maximum acceleration, in the constant speed stage, the motor runs at the maximum speed, and in the deceleration stage, the motor decelerates at a preset maximum deceleration until it stops exactly at the target position. The drive control unit calculates the theoretical position of the motor at each time point in real time and sends it to the drive mechanism, thereby achieving smooth, stable and efficient movement.

[0061] In one embodiment of the present invention, the control module is further configured to: receive a continuous sequence of image frames as video input; calculate the displacement in real time based on the brightness information of each frame and control the drive mechanism to move continuously, so that each sub-display unit moves continuously to present a dynamic three-dimensional relief animation effect. When the input is a video stream, in order to ensure the smoothness of the animation effect, the system must ensure that the total time for calculation and movement is less than or equal to the duration of each frame; for example, for a 30fps video, it must be completed within 33.3ms.

[0062] Taking an 8×12 sub-display unit array, where each sub-display unit is a 5.5-inch LCD screen, and the driving mechanism is a linear motor with a stroke of 50mm as an example, when the system receives a close-up image of a lion, the image processing unit divides the image into 8×12 blocks and extracts the brightness of each block. The brightness value of the block in the highlight area of ​​the lion's nose is L=240 (range 0-255), and the brightness value of the block in the dark background is L=15. The displacement calculation unit uses linear mapping (assuming...) =0mm, The target displacement of the nose tip region was calculated using the formula (=50mm). =50mm, background area The thickness is approximately 3mm. Then, the brightness difference between adjacent blocks is calculated, and bilinear interpolation is used to smooth continuous areas such as the lion's face, resulting in a smooth transition of facial deformation rather than a stepped appearance. The drive control unit controls each linear motor, which moves smoothly to the calculated position via an S-curve. Ultimately, all sub-display units physically present a lifelike lion head relief image, with a prominent nose, sunken eye sockets, and rich details.

[0063] This invention proposes a multi-screen physical deformation visual presentation method based on brightness mapping, comprising the following steps:

[0064] Acquire the target image frame;

[0065] The target image frame is logically divided into M×N image regions, each corresponding to a physical sub-display unit;

[0066] Extract the brightness feature value of each image region;

[0067] Based on the preset brightness-displacement mapping relationship, each brightness feature value is converted into the target displacement value of the corresponding sub-display unit;

[0068] The control drive mechanism drives each sub-display unit to move to the physical position specified by the target displacement value.

[0069] It is to be noted that, in the present text, relational terms such as first and second and the like can be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0070] The above examples are merely used to illustrate the technical solutions of the present application, but not to limit it; although the present application has been described in detail with reference to the foregoing examples, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing examples, or make equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A multi-screen physical deformation visual presentation system based on brightness mapping, characterized in that, include: The display module consists of M×N physically independent sub-display units arranged in a rectangular array, where M and N are both positive integers not less than 2; The driving module includes M×N driving mechanisms, and the execution end of each driving mechanism is fixedly connected to one of the sub-display units, for driving the sub-display unit to perform translational movement in a direction perpendicular to its display plane; A control module, communicatively connected to the display module and the drive module, includes: An image processing unit is used to acquire a target image frame, divide the image frame into M×N image regions with the same arrangement structure as the sub-display unit, and extract the brightness information of each image region. The displacement calculation unit is used to calculate the target displacement of each sub-display unit according to the preset brightness-displacement mapping relationship and the brightness information. The drive control unit is used to control the corresponding drive mechanism to move each sub-display unit to the target position according to the target displacement, so that all sub-display units together form a three-dimensional relief visual effect in physical space corresponding to the brightness distribution of the target image frame.

2. The multi-screen physical deformation visual presentation system based on brightness mapping as described in claim 1, characterized in that, The brightness-displacement mapping relationship is as follows: the higher the brightness value of the image area, the greater the forward displacement of its corresponding sub-display unit; the lower the brightness value of the image area, the greater the backward displacement of its corresponding sub-display unit.

3. The multi-screen physical deformation visual presentation system based on brightness mapping as described in claim 1, characterized in that, Before extracting brightness information, the image processing unit is also configured to perform regional gamma correction on the target image frame.

4. The multi-screen physical deformation visual presentation system based on brightness mapping as described in claim 1, characterized in that, The displacement calculation unit is further configured to: Calculate the brightness similarity between adjacent image regions; If the brightness similarity is higher than a preset threshold, the target displacement of the sub-display unit corresponding to the adjacent image region is smoothed and fitted so that the final physical position of the two adjacent sub-display units transitions smoothly.

5. A multi-screen physical deformation visual presentation system based on brightness mapping as described in claim 1, characterized in that, The control module is also configured to: Receives a continuous sequence of image frames as video input; The displacement is calculated in real time based on the brightness information of each frame of the image, and the driving mechanism is controlled to make each sub-display unit move continuously to present a dynamic three-dimensional relief animation effect.

6. The multi-screen physical deformation visual presentation system based on brightness mapping as described in claim 1, characterized in that, The drive control unit is further configured to generate a smooth movement path using an interpolation algorithm based on the target displacement, and control the drive mechanism to move along the path to suppress motion overshoot and mechanical oscillation.

7. A multi-screen physical deformation visual presentation system based on brightness mapping as described in claim 1, characterized in that, The sub-display unit is an OLED display unit or an LCD display unit equipped with a backlight module.

8. A multi-screen physical deformation visual presentation method based on brightness mapping, applied to the system described in any one of claims 1-7, characterized in that, Includes the following steps: Acquire the target image frame; The target image frame is logically divided into M×N image regions, each corresponding to a physical sub-display unit; Extract the brightness feature value of each image region; Based on the preset brightness-displacement mapping relationship, each brightness feature value is converted into the target displacement value of the corresponding sub-display unit; The control drive mechanism drives each sub-display unit to move to the physical position specified by the target displacement value.

Images