A millimeter-wave-based image magnification display device and control method

Abstract

This invention relates to a millimeter-wave-based image magnification display device and control method, comprising: acquiring human head features using millimeter-wave radar; calculating and generating a safety frame parameter matching the human head contour based on the acquired human head contour data; displaying the safety frame on a display module according to the safety frame parameter; determining whether there is input for adjusting the size and position of the safety frame, and if so, making the corresponding size and position adjustments, proceeding to the next step after adjustment; otherwise, directly proceeding to the next step; and the display module performing local magnification processing on the area of ​​the image selected by the safety frame. This invention incorporates millimeter-wave radar and FPGA into the display, mainly solving the problem of millimeter-wave radar identifying the distance between the human body and the display, mapping the area that needs to be magnified based on the size of the human head, and then using FPGA algorithms to magnify the selected area, thereby improving the user's visual experience and effectively solving visual fatigue.

Description

Technical Field

[0001] This invention relates to the field of image magnification and display technology, and more specifically, to an image magnification and display device and control method based on millimeter waves. Background Technology

[0002] As an indispensable terminal device in modern work, entertainment, and life, monitors play a crucial role in transforming digital information into visual images. Whether processing documents, browsing web pages, creating presentations, or engaging in high-intensity gaming, users have increasingly higher demands for the visual experience of monitors. However, existing monitors still have significant technological shortcomings in meeting the intelligent and user-friendly needs of diverse usage scenarios.

[0003] In everyday office scenarios, users often experience visual fatigue when processing documents, browsing articles, or creating PowerPoint presentations due to changes in viewing distance from the monitor. For example, when users are far from the monitor, text or details on the screen may be difficult to read due to their small size, forcing users to frequently adjust their posture or manually zoom in and out. This not only disrupts the continuity of the workflow but also adds unnecessary operational burden. Although PC operating systems or applications provide zoom functions, these functions usually rely on physical operations of the mouse and keyboard, and the zoom range is fixed, unable to adaptively adjust according to the user's real-time viewing distance and visual needs.

[0004] In existing technologies, the interaction between a monitor and a signal source (such as a PC) largely relies on unidirectional signal transmission. The monitor acts only as a passive display device and lacks the ability to perceive user behavior and the environment. Although some high-end monitors integrate cameras or sensors to achieve functions such as facial recognition and brightness adjustment, these technologies are usually limited to basic ambient light adaptation or user authentication. They cannot accurately identify the relative position of the user and the screen and their observation intentions, let alone achieve intelligent magnification for specific display areas.

[0005] In addition, traditional displays rely primarily on signal sources (such as a PC's GPU) or built-in general-purpose image processing chips for image processing. While these methods can achieve basic scaling and image adjustment, they suffer from high processing latency and cannot precisely match the user's real-time viewing needs. For example, software scaling on a PC requires multiple layers of processing through the operating system and applications, resulting in a slow response time and the inability to be completed directly on the display, leading to a lag between the zoom operation and the user's actual viewing behavior.

[0006] In summary, existing displays have significant shortcomings in intelligently sensing user viewing needs and dynamically adjusting displayed content, especially in long-distance viewing scenarios. There is a lack of intelligent solutions that can automatically recognize user viewing intentions and zoom in on key areas in real time without the need for external device intervention. Therefore, there is an urgent need for a display solution that integrates advanced sensing technology and low-latency image processing capabilities to improve the user's visual experience and operational efficiency in office, entertainment, and other scenarios. Summary of the Invention

[0007] The technical problem to be solved by the present invention is to provide a millimeter-wave-based image magnification display device and a control method for the millimeter-wave-based image magnification display device, in view of the above-mentioned defects of the prior art.

[0008] The technical solution adopted by this invention to solve its technical problem is:

[0009] A control method for a millimeter-wave-based image magnification display device is constructed, wherein the method includes:

[0010] Define an effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module.

[0011] Detect the human body's position. If the human body is within the standard display area, proceed directly to the next step; otherwise, guide the human body into the standard display area before proceeding to the next step.

[0012] The system uses millimeter-wave radar to acquire human head features, calculates and generates safety frame parameters that match the human head contour based on the acquired human head contour data, and displays the safety frame on the display module based on the safety frame parameters.

[0013] Determine if there is any input for adjusting the size and position of the safety outline. If yes, make the corresponding size and position adjustments and proceed to the next step after the adjustments are completed; otherwise, proceed directly to the next step.

[0014] The selected area of ​​the image within the safety frame is magnified.

[0015] The control method for a millimeter-wave-based image magnification display device of the present invention, wherein the step of acquiring human head features using millimeter-wave radar and calculating and generating a safety frame parameter matching the human head contour based on the acquired human head contour data includes:

[0016] The pixel set of the human head contour is obtained using millimeter-wave radar, and noise reduction processing is performed to obtain image A.

[0017] Image B is obtained by calculating and processing the cross markers of the pixel set of the human head contour. The center of the cross markers is the signal weighted centroid.

[0018] The C-frame is obtained by calculating the effective pixels of the package header and the dynamically expanded rectangle of the cross marker;

[0019] The safety frame D is obtained by generating a safety frame parameter based on the physical display characteristics of the adaptive display module using a dynamically expanding rectangle. The safety frame D is the safety frame.

[0020] The control method for a millimeter-wave-based image magnification display device according to the present invention, wherein the step of acquiring a pixel set of human head contour using millimeter-wave radar and performing noise reduction processing to obtain image A includes:

[0021] Filter the millimeter-wave radar scan data to find only the effective pixels belonging to the head, forming the head outline in image A:

[0022] Let the original pixel set be , This represents the original number of pixels. Define the valid header pixel set for pixel coordinates:

[0023]

[0024] in For pixels millimeter wave signal strength, This is a specific threshold for the millimeter-wave reflection characteristics of the head.

[0025] The millimeter-wave-based image magnification display device control method of the present invention, wherein obtaining image B by calculating and processing the crosshair marker of the human head contour pixel set includes:

[0026] Cross-shaped marker center: Set the effective head pixel set The number of pixels is Then the center of mass The formula is:

[0027]

[0028] The endpoints of the crosshair are determined by calculating the boundary extrema of the effective pixel set.

[0029]

[0030]

[0031] Horizontal axis: left endpoint right endpoint

[0032] Vertical axis: upper end point lower endpoint

[0033] The axis and the centroid together form the cross symbol in Figure B.

[0034] The millimeter-wave-based image magnification display device control method of the present invention, wherein calculating the dynamically expanded rectangle of the effective pixels of the head and the cross mark to obtain the C-frame includes:

[0035] Define dynamic expansion amount:

[0036]

[0037] Coordinates of the C-frame boundary after dynamic expansion:

[0038]

[0039] in, A specific expansion coefficient designed for the non-rigid characteristics of the head;

[0040] Center and dimensions of frame C:

[0041]

[0042] Where Δx is the dynamic expansion in the horizontal direction, and Δy is the dynamic expansion in the vertical direction. The horizontal coordinates of the left boundary of box C. The horizontal coordinates of the right boundary of box C. The vertical coordinates of the upper boundary of box C. The vertical coordinates of the bottom boundary of box C. The horizontal coordinates of the center of box C. The vertical coordinates of the center of box C. The horizontal width of box C. This is the vertical height of box C.

[0043] The millimeter-wave-based image magnification display device control method of the present invention, wherein the step of obtaining the D-frame by generating safety frame parameters of the physical display characteristics of the adaptive display module based on the dynamically expanded rectangle includes:

[0044] Calculate the field of view resolution corresponding to each pixel:

[0045]

[0046] in, The horizontal pixel field of view, Vertical pixel field of view;

[0047] Calculate the minimum bounding circle of the convex hull of the effective pixel set:

[0048] Set the center of frame C Effective pixel set convex hull The radius of the outer circle of the pixel domain is , , If the value is the Euclidean norm, then the corresponding actual physical radius is:

[0049]

[0050] Radius of the D-frame in the calibrated pixel domain:

[0051]

[0052] Among them, the expansion coefficient ;

[0053] Base dimensions of frame D:

[0054]

[0055] Initial coordinates of box D:

[0056]

[0057]

[0058] in, The baseline horizontal width of frame D. The reference vertical height of frame D. The initial horizontal coordinates of the left boundary of the D-box. The initial vertical coordinates of the upper boundary of the D-box. The initial horizontal coordinates of the right boundary of box D. The initial vertical coordinates of the lower boundary of the D-frame.

[0059] The millimeter-wave-based image magnification display device control method of the present invention, wherein the step of displaying a safety frame on the display module according to safety frame parameters includes:

[0060] Boundary constraints based on the display module's field of view:

[0061] Calculate the effective display pixel boundary corresponding to the field of view:

[0062]

[0063] The final coordinates of the D-shape after constraints are:

[0064]

[0065] The actual size of the square after field-of-view calibration is:

[0066]

[0067] The area in box D is a rectangular region. The specific coordinates are:

[0068] Top left corner coordinates:

[0069] Bottom right corner coordinates:

[0070] in, The left coordinate of the effective horizontal display boundary of the monitor. The right coordinate of the effective horizontal display boundary of the monitor. The upper coordinates of the effective vertical display boundary of the monitor. The lower coordinate of the effective vertical display boundary of the monitor. To determine the final left boundary horizontal coordinates of the constrained D-frame, The final right boundary horizontal coordinates of the constrained D-frame The final upper boundary vertical coordinates of the constrained D-frame The final lower boundary vertical coordinates of the constrained D-frame. This represents the final horizontal width of box D. This represents the final vertical height of box D.

[0071] The control method for the millimeter-wave-based image magnification display device of the present invention wherein the size and position adjustment input of the safety frame is achieved by inputting through an input device or by human body movements acquired by millimeter waves.

[0072] The millimeter-wave-based image magnification display device control method of the present invention further includes:

[0073] Three secondary adjustment modes are set to avoid text truncation by the safety border:

[0074] Mode 1: Search by black and white up and down; Mode 2: Search by black and white left and right; Mode 3: Search by black and white up, down, left and right.

[0075] Adjust the position of the safety border according to the mode selected by the user to eliminate text truncation.

[0076] A millimeter-wave-based image magnification display device is provided for implementing the control method of the millimeter-wave-based image magnification display device as described above, wherein the device includes a Scaler module, an FPGA module, a millimeter-wave module, a button module, and a display module.

[0077] The millimeter-wave module is used to detect the position of the human body and to acquire the contour data of the human head.

[0078] The Scaler module is used to set the effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module. If the human body is not located in the standard display area, the display module guides the human body into the standard display area. It is also used to calculate and generate a safety frame parameter that matches the human head contour based on the acquired human head contour data, and send the safety frame parameter to the display module for displaying the safety frame. The size and position of the safety frame are adjusted according to the input information.

[0079] The FPGA module is used to perform local magnification processing on the selected area of ​​the image within the safety frame and output a screen-dotting signal to the display module to display the final image.

[0080] The button module is used for input control of the Scaler module.

[0081] The beneficial effects of this invention are as follows: This invention adds a millimeter-wave module and an FPGA module to the display. The main solution is that after the millimeter-wave module identifies the distance between the human body and the display, it measures the area that needs to be enlarged according to the size of the human head. Then, the algorithm of the FPGA module enlarges the selected area, which improves the visual experience for the user and can also effectively solve visual fatigue. Attached Figure Description

[0082] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the present invention will be further described below in conjunction with the accompanying drawings and embodiments. The drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0083] Figure 1 This is a flowchart of a control method for a millimeter-wave-based image magnification display device according to a preferred embodiment of the present invention;

[0084] Figure 2 This is a schematic diagram of the partition of the control method for the millimeter-wave-based image magnification display device according to a preferred embodiment of the present invention;

[0085] Figure 3 This is a schematic diagram of the D-frame generation of the control method for a millimeter-wave-based image magnification display device according to a preferred embodiment of the present invention;

[0086] Figure 4 This is a schematic diagram of the first type of text truncation in the control method of the millimeter-wave-based image magnification display device according to a preferred embodiment of the present invention;

[0087] Figure 5This is a schematic diagram of the second type of text truncation in the control method of the millimeter-wave-based image magnification display device according to a preferred embodiment of the present invention;

[0088] Figure 6 This is a magnified comparison diagram of the control method for the millimeter-wave-based image magnification display device according to a preferred embodiment of the present invention;

[0089] Figure 7 This is a block diagram of a millimeter-wave-based image magnification display device according to a preferred embodiment of the present invention. Detailed Implementation

[0090] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, a clear and complete description will be provided below in conjunction with the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the protection scope of the present invention.

[0091] A preferred embodiment of the control method for a millimeter-wave-based image magnification display device of the present invention, such as... Figure 1 As shown, see also Figures 2-6 The methods include:

[0092] S01: Set the effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module.

[0093] See Figure 2 Points A to J are the display module, E is the millimeter-wave radar installation location, F and I are invalid areas, G is the reduced area, H is the magnified area, and C is the standard display area.

[0094] a is the start point of the effective area, b is the end point of the effective area, ab is the entire effective area, and area C is set to start detecting human bodies.

[0095] S02: Detect the human body position. If the human body is within the standard display area, proceed directly to the next step; otherwise, guide the human body into the standard display area before proceeding to the next step.

[0096] See Figure 2 When the button is pressed to activate (or activated in other ways), the millimeter-wave "safety frame function" begins to detect the human body and reports the distance data to the FPGA module, which then displays the current area and distance and guides the human body to zone C.

[0097] Assuming ab is 70 cm, G zone is 30 cm, H zone is 30 cm, and C zone is 10 cm, when the human body is detected in G zone, the millimeter wave module measures the specific distance and informs the FPGA module, which then displays OSD on the display module screen: "Currently in G zone, distance 25 cm, please move back 5 cm," and so on.

[0098] When a human body is detected in zone H, the millimeter-wave module measures the specific distance and informs the FPGA module, which then displays OSD on the screen: "Currently in zone G, distance 45 cm, please move forward 5 cm," and so on.

[0099] When a human body is detected in zone C, the millimeter-wave module measures the specific distance and informs the FPGA module, which then displays the OSD on the monitor: "Currently in zone C, distance 35 cm. Please hold. Starting to map the safety outline."

[0100] S03: Use millimeter-wave radar to acquire human head features, calculate and generate safety frame parameters that match the human head contour based on the acquired human head contour data, and display the safety frame on the display module according to the safety frame parameters.

[0101] See Figure 3 The specific method adopted is as follows:

[0102] When millimeter waves detect a human head, they will form a shape like... Figure 3 Figure A in the image is calculated based on the resolution. Figure 3 The cross in Figure B is then drawn based on the cross. Figure 3 The outer frame of diagram C in the final generation Figure 3 The D-map is transmitted back to the FPGA, and the algorithm formula for plotting the safety outline is as follows:

[0103] When plotting the D-frame using the millimeter-wave module, it is necessary to determine the size and position of the D-frame within the 1920×1080 image.

[0104] Reason 1: It is to prevent the safety frame from exceeding the actual resolution size.

[0105] Reason 2: It can inform the FPGA of the size and position of the captured coordinates.

[0106] Reason 3: Human heads vary in size, just as monitors with the same resolution vary in size, so coordinate mapping is necessary.

[0107] The derivation process roughly involves four steps: extraction of head parameters for millimeter-wave detection, calculation of the C-box, coordinate mapping, and generation of the D-box. The corresponding formulas are as follows:

[0108] Figure 3 In Figure A, the waveform emitted by the millimeter wave is plotted using a "point-plotting" method based on the returned waveform. Scene parameters are defined as follows:

[0109] Basic monitor parameters: Monitor level Vertical resolution Horizontal field of view Vertical field of view

[0110] Millimeter-wave module parameters: The pixel-level signal strength of millimeter-wave output (1 is the strongest, corresponding to the core area of ​​the head).

[0111] The distance d (in cm) between the user and the monitor is detected synchronously.

[0112] Scene-specific parameters: , , Head signal filtering threshold, head contour dynamic expansion coefficient, D-frame expansion coefficient (customized for head detection and display).

[0113] Step 1: Figure 3 Figure A in the diagram shows the construction of the effective head contour pixel set for millimeter waves (to resolve noise interference).

[0114] The raw pixel set obtained from millimeter-wave scanning contains environmental noise. First, valid pixels belonging only to the head are filtered out to form... Figure 3 The head outline of image A in the image: Let the original pixel set be... ( This represents the original number of pixels. (For pixel coordinates), define the effective head pixel set (innovation: based on millimeter-wave signal strength screening):

[0115]

[0116] in For pixels millimeter wave signal strength, To address the specific threshold for millimeter-wave reflection characteristics of the head, only valid head pixels with acceptable signal strength are retained, while background noise is excluded.

[0117] Step 2: Figure 3 Figure B in the diagram – Construction of the cross (signal weighting centroid + axis) (to solve the problem of uneven signal distribution in the head);

[0118] The crosshair consists of a weighted centroid (center) and extreme axes. Unlike the general equal-weighted centroid, it uses millimeter-wave signal strength weighting calculation to improve the accuracy of center positioning.

[0119] Cross center (weighted centroid): Define the effective pixel set The number of pixels is Then the center of mass The formula is:

[0120]

[0121] Using millimeter-wave signal strength as a weighting factor, the centroid is more biased towards the core area where the head signal is strongest, avoiding positioning deviation of the equal-weighted centroid;

[0122] Cross axis (based on effective pixel extrema): Calculate the boundary extrema of the effective pixel set to determine the endpoints of the axis.

[0123]

[0124] Horizontal axis: left endpoint right endpoint

[0125] Vertical axis: upper end point lower endpoint

[0126] The aforementioned axis and the center of mass together constitute Figure 3 The cross in Figure B.

[0127] Step 3: Figure 3 Figure C in the diagram – Dynamic expansion of the outer frame (to resolve head contour fluctuations);

[0128] The C-frame is a dynamically expanding rectangle that encloses the effective pixels of the header and the crosshair, adapting to the non-rigid nature of the header and avoiding outline overflow caused by "tight wrapping".

[0129] Define dynamic expansion amount (proportional to head contour size, adaptively adjusted):

[0130]

[0131] Coordinates of the C-frame boundary after dynamic expansion:

[0132]

[0133] in A special expansion coefficient is designed for the non-rigid characteristics of the head, ensuring complete coverage of the head while avoiding redundancy.

[0134] Center and dimensions of frame C:

[0135]

[0136] Where Δx is the dynamic expansion in the horizontal direction, and Δy is the dynamic expansion in the vertical direction. The horizontal coordinates of the left boundary of box C. The horizontal coordinates of the right boundary of box C. The vertical coordinates of the upper boundary of box C. The vertical coordinates of the bottom boundary of box C. The horizontal coordinates of the center of box C. The vertical coordinates of the center of box C. The horizontal width of box C. This is the vertical height of box C.

[0137] The above parameters constitute Figure 3 The outer frame of diagram C in the diagram.

[0138] Step 4: Figure 3 The D-frame in the image is the final frame adapted to a 1920×1080 resolution image (combined with monitor field of view calibration).

[0139] The D-frame needs to be adapted to the physical display characteristics of the monitor. Through physical domain-pixel domain calibration and field of view boundary constraints, it is ensured that the display ratio is reasonable and within the user's visible range.

[0140] Calculate the field of view resolution corresponding to each pixel (associated with the physical parameters of the display):

[0141]

[0142] Calculate the minimum circumcircle of the convex hull of the effective pixel set (calibrate physical dimensions): Let the center of the C-frame be... Effective pixel set convex hull The radius of the outer circle of the pixel domain is ( , If the Euclidean norm is used, then the corresponding actual physical radius is:

[0143]

[0144] Radius of the D-frame in the calibrated pixel domain (introducing the expansion factor) (To ensure the head is fully displayed)

[0145]

[0146] The baseline dimensions of frame D (square design to ensure aesthetic display):

[0147]

[0148] Initial coordinates of box D (aligned with the center of box C to ensure positional correlation):

[0149]

[0150]

[0151] in, The baseline horizontal width of frame D. The reference vertical height of frame D. The initial horizontal coordinates of the left boundary of the D-box. The initial vertical coordinates of the upper boundary of the D-box. The initial horizontal coordinates of the right boundary of box D. The initial vertical coordinates of the lower boundary of the D-frame.

[0152] S04: Determine if there is any input for adjusting the size and position of the safety frame. If yes, make the corresponding size and position adjustments and proceed to the next step after the adjustments are completed; otherwise, proceed directly to the next step.

[0153] Boundary constraints based on the display's field of view (ensuring the D-frame is within the effective display area): First, calculate the effective display pixel boundary corresponding to the field of view:

[0154]

[0155] The final coordinates of the D-shape after constraints are:

[0156]

[0157] Final size and position of the D-frame (adapted to 1920×1080 resolution):

[0158] D-frame size:

[0159] The final D-frame size is calculated from the constrained boundary coordinates, with the reference being the size of the square after field-of-view calibration. The actual size is: ;

[0160] Where the reference dimension is (Formula 11) If the initial D frame exceeds the effective area of ​​the display's field of view, it will be cropped using formula (16) to ensure that it is completely within the 1920×1080 screen.

[0161] Position of frame D:

[0162] In a 1920×1080 monitor display, the D-frame is located in a rectangular area. The specific coordinates are:

[0163] Top left corner coordinates: ;

[0164] Bottom right corner coordinates: ;

[0165] in, The left coordinate of the effective horizontal display boundary of the monitor. The right coordinate of the effective horizontal display boundary of the monitor. The upper coordinates of the effective vertical display boundary of the monitor. The lower coordinate of the effective vertical display boundary of the monitor. To determine the final left boundary horizontal coordinates of the constrained D-frame, The final right boundary horizontal coordinates of the constrained D-frame The final upper boundary vertical coordinates of the constrained D-frame The final lower boundary vertical coordinates of the constrained D-frame. This represents the final horizontal width of box D. This represents the final vertical height of box D.

[0166] This position is precisely aligned with the head detection results and is within the effective display range covered by the monitor's field of view, ensuring that the user can see it.

[0167] Signal characteristic adaptation: Introducing millimeter-wave signal threshold Signal weighting factor It solves the problems of noise interference and uneven head signal in millimeter wave detection, which is different from general point set calculation;

[0168] Display scene adaptation: combined with the display's field of view Resolution This enables bidirectional calibration between the physical domain and the pixel domain, avoiding display ratio distortion caused by general formulas;

[0169] Head feature adaptation: design of dynamic expansion coefficient Expansion coefficient Exclusive parameters are used to adapt to the non-rigid contour fluctuation characteristics of the head, ensuring the accuracy of detection and display.

[0170] The following is the derivation using substituting data, with the parameters defined as follows:

[0171] I. Basic Monitor Parameters: Monitor Level Vertical resolution Horizontal field of view Vertical field of view

[0172] Millimeter-wave module parameters: Millimeter wave signal strength range; distance between user and display ;

[0173] Scene-specific parameters: , , Head signal filtering threshold, head contour dynamic expansion coefficient, D-frame expansion coefficient

[0174] two, Figure 3 Figure A in the image: Effective head contour pixel set for millimeter waves.

[0175] Raw data:

[0176] Millimeter-wave detection yielded 30 effective head pixels (signal strength). (Partial pixel example:)

[0177] (See the calculation process for the coordinates and signal strength of the complete 30 pixels);

[0178] Substituting into the effective pixel selection formula:

[0179]

[0180] Number of valid pixels after filtering ,form Figure 3 The head outline in Figure A.

[0181] three, Figure 3 Figure B in the diagram: Calculation of the cross (signal-weighted centroid + axis).

[0182] Signal weighted centroid (substitute into formula):

[0183]

[0184] Profile extreme value calculation

[0185]

[0186] Cross parameter results:

[0187] Center of the cross (weighted center of mass):

[0188] Horizontal axis:

[0189] Vertical axis:

[0190] Four, Figure 3 Figure C in the diagram: Calculation of the dynamically expanded outer frame

[0191] Calculation of dynamic expansion:

[0192]

[0193] C-frame boundary coordinates (substitute into the formula):

[0194]

[0195] C-frame center and dimensions:

[0196]

[0197] Final parameters for box C:

[0198] Boundary coordinates:

[0199] Center coordinates:

[0200] Size: Pixels

[0201] five, Figure 3 Image D in the image: Final frame calculation for adapting to a 1920×1080 resolution screen.

[0202] Pixel field of view resolution:

[0203]

[0204] Calculation of circumcircle radius:

[0205]

[0206] Physical domain-pixel domain calibration:

[0207]

[0208] D-frame baseline dimensions:

[0209]

[0210] Initial coordinates of frame D:

[0211]

[0212] Field of view boundary constraints:

[0213] (1) Effectively display boundary calculation:

[0214]

[0215] (2) Coordinates after boundary constraints:

[0216] Due to the initial D-frame coordinates The coordinates remain unchanged after constraints, as the entire area is within the valid display range.

[0217]

[0218] VI. Summary of Final Parameters for Frame D

[0219] D-frame size:

[0220] Pixels

[0221] D-frame location (within a 1920×1080 image):

[0222] Top left corner coordinates:

[0223] Bottom right corner coordinates:

[0224] Rectangular area:

[0225] Verification results:

[0226] The D-frame is completely within the effective display area of ​​the 1920×1080 monitor. Its square size ensures complete coverage of the head while meeting the monitor's aspect ratio requirements, achieving precise adaptation between millimeter-wave head detection and the monitor screen.

[0227] After the derivation is complete, the millimeter-wave module will send the calculated data to the FPGA module. Once the millimeter-wave module provides the coordinate and size data to the FPGA module, if the user deems it necessary to adjust the size and position of the safety frame, the following steps can be taken:

[0228] After the safety frame is displayed on the screen, it flashes. Outside the safety frame area, the OSD displays "Do you want to adjust the size and position?" Simultaneously, the FPGA instructs the millimeter-wave module to begin re-acquiring data. This data acquisition differs from surveying the "safety frame," which requires area C. Re-acquiring data can occur within the GCH range. If the user's head shakes during this process, it indicates no adjustment is needed. The head-shaking angle is set to 15 degrees to the left and right, considered unnecessary; less than 15 degrees is considered a misoperation (this angle can be changed in the menu according to user preference). The FPGA is then notified to display the left and right angles via the OSD. When the angle is correct, the OSD display changes from red to green to indicate compliance. Once confirmed, the FPGA proceeds according to... Figure 3 The size and coordinates of the D-image in the image are used to extract the size and coordinates of the image to be enlarged, and then enlarge it frame by frame.

[0229] When a person's head moves up and down, it is considered that adjustment is needed. The head tilt angle is set to 15 degrees up and down as required. If it is less than 15 degrees, it is considered an incorrect operation (this angle can be changed according to the user's preference in the menu). The FPGA is notified to display the tilt angle via OSD. When the angle is correct, the OSD display color changes from red to green to indicate compliance to the user. When the change is confirmed, the OSD displays "Adjust position". At this time, the "safety frame" color changes from black to red and flashes. The FPGA notifies the millimeter wave to collect data for the third time. At this time, the head tilts to the right by 15 degrees. The head tilt angle is set to 15 degrees as a rightward movement. If it is less than 15 degrees, it is considered an incorrect operation (this angle can be changed according to the user's preference in the menu). The FPGA is notified to display the tilt angle via OSD. When the angle is correct, the OSD display color changes from red to green to indicate compliance to the user. If it is compliant, the "safety frame" moves horizontally to the right. The OSD displays "Moving to the right, please straighten your head to stop." This process repeats for other directions. After adjusting all directions and straightening the head, the red box flashes three times to confirm. Simultaneously, a 3-second confirmation countdown appears on the OSD. Once the position is confirmed, the "safety frame" color returns to black, and the OSD displays "Starting to adjust size," with the top edge of the "safety frame" starting to flash. The OSD indicates that the top edge is being adjusted. The FPGA then notifies the millimeter-wave unit to perform its fourth data acquisition. At this point, the head is tilted upwards by 15 degrees. A tilting angle of 15 degrees is considered an upward movement of the top edge; a tilt less than 15 degrees is considered a misoperation (this angle can be changed in the menu according to user preference), and the FPGA is notified to display the upward angle via the OSD. When the angle is correct, the OSD color changes from red to green to indicate compliance. Once the angle is correct, the top edge begins to move upwards, and the OSD displays "Expanding upwards, please straighten your head to stop." This process repeats for the other three sides.

[0230] After adjusting all directions and straightening your head, the red box will flash three times to indicate confirmation. Simultaneously, a 3-second confirmation countdown will appear on the OSD. After the screenshot is taken, the following J and K scenarios may occur: text may be truncated in any direction (see...). Figure 4 and Figure 5 The FPGA will then set three modes: Mode 1: up and down black and white search, Mode 2: left and right black and white search, and Mode 3: up, down, left and right black and white search. Users can set the mode according to their own habits. The setting method can be to select the mode by pressing the button, or the three modes can be displayed on the OSD in sequence after the expansion part is completed. A certain mode can be confirmed by shaking the head, nodding or shaking the head.

[0231] The specific implementation method is as follows: when the FPGA finds that a row or column of the left, right or top and bottom boundary points of the "safety frame" is not the same color when taking a screenshot, it is considered that the text has been cut off. Then, it searches for the cutting point outward: line by line or column by column until a row or column of solid color is found, and the screenshot range is considered to be finally confirmed.

[0232] S05: Perform local magnification processing on the area of ​​the image selected by the safety frame;

[0233] Finally, the FPGA is based on... Figure 3 The size and coordinates of the D-image in the image are used to extract the size and coordinates of the image to be enlarged and then enlarge it frame by frame, such as... Figure 6 As shown, Figure 6 Image A in the image is the original image without any magnification. Figure 6 Image B in the image is the result of being magnified by the FPGA at a certain set ratio. The letter C is clearly visible in the image. This scaling ratio can be adjusted by the buttons on the Scaler and then sent to the FPGA by the Scaler.

[0234] This invention incorporates millimeter waves and FPGA into the display. The main solution is to use millimeter waves to detect the distance between the human body and the display, and then to measure the area that needs to be magnified based on the size of the human head. The selected area is then magnified using FPGA algorithms, which improves the user's visual experience and can also effectively solve visual fatigue.

[0235] A millimeter-wave-based image magnification display device is provided for implementing the control method for the millimeter-wave-based image magnification display device described above. Figure 7 As shown, it includes a Scaler module 100, an FPGA module 101, a millimeter-wave module 102, a button module 103, and a display module 104;

[0236] The millimeter-wave module 102 is used to detect the position of the human body and acquire the contour data of the human head.

[0237] The Scaler module 100 is used to set the effective viewing area located in front of the display module. The effective viewing area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module.

[0238] If the human body is not located within the standard display area, the display module will guide the human body into the standard display area.

[0239] It is also used to calculate and generate safety frame parameters that match the human head contour based on the acquired human head contour data, and send the safety frame parameters to the display module for display of the safety frame.

[0240] Adjust the size and position of the safety frame based on the input information;

[0241] FPGA module 101 is used to perform local magnification processing on the selected area of ​​the image within the safety frame and output a screen dot signal to the display module to display the final image;

[0242] The button module 103 is used for input control of the Scaler module 100;

[0243] This invention incorporates millimeter waves and FPGA into the display. The main solution is to use millimeter waves to detect the distance between the human body and the display, and then to measure the area that needs to be magnified based on the size of the human head. The selected area is then magnified using FPGA algorithms, which improves the user's visual experience and can also effectively solve visual fatigue.

[0244] It should be understood that those skilled in the art can make improvements or modifications based on the above description, and all such improvements and modifications should fall within the protection scope of the appended claims.

Claims

1. A control method for a millimeter-wave-based image magnification display device, the display device comprising a display module, characterized in that, The methods include: Define an effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module. Detect the human body's position. If the human body is within the standard display area, proceed directly to the next step; otherwise, guide the human body into the standard display area before proceeding to the next step. The system uses millimeter-wave radar to acquire human head contour data, calculates and generates safety frame parameters that match the human head contour based on the acquired human head contour data, and displays the safety frame on the display module according to the safety frame parameters. Determine if there is any input for adjusting the size and position of the safety outline. If yes, make the corresponding size and position adjustments and proceed to the next step after the adjustments are completed; otherwise, proceed directly to the next step. The selected area of ​​the image within the safety frame is magnified. The process of acquiring human head contour data using millimeter-wave radar and calculating and generating safety outline parameters that match the human head contour based on the acquired human head contour data includes: Select the set of valid head pixels that belong only to the head from the millimeter-wave radar scan data to form the head outline in Figure A; Image B is obtained by calculating the cross marker of the effective head pixel set, and the center of the cross marker is the weighted centroid of the millimeter-wave signal; The C-frame is obtained by calculating the effective pixel set of the package header and the dynamically expanded rectangle of the cross icon; The safety frame D-frame is obtained by generating a safety frame parameter that adapts to the physical display characteristics of the display module based on the dynamically expanding rectangle. The safety frame D-frame includes: calculating the field of view resolution corresponding to the pixel based on the horizontal resolution, vertical resolution, horizontal field of view, and vertical field of view of the display module; and obtaining the reference size and initial coordinates of the D-frame based on the field of view resolution, the distance between the human body and the display module, and the effective head pixel set.

2. The control method for a millimeter-wave-based image magnification display device according to claim 1, characterized in that, The set of valid head pixels belonging only to the head in the millimeter-wave radar scan data, selected to form the head contour of Image A, includes: Let the original pixel set be , This represents the original number of pixels. Define the valid header pixel set for pixel coordinates: in For pixels millimeter wave signal strength, This is a specific threshold for the millimeter-wave reflection characteristics of the head.

3. The control method for a millimeter-wave-based image magnification display device according to claim 2, characterized in that, The cross-shaped markers of the human head contour pixel set after calculation and processing result in Image B, which includes: Cross-shaped marker center: Set the effective head pixel set The number of pixels is Then the center of mass The formula is: The endpoints of the crosshair are determined by calculating the boundary extrema of the effective pixel set. Horizontal axis: left endpoint right endpoint Vertical axis: upper end point lower endpoint The axis and the center of mass together form the cross symbol in Figure B.

4. The control method for a millimeter-wave-based image magnification display device according to claim 3, characterized in that, The calculation of the effective pixel set of the package header and the dynamically expanded rectangle of the cross marker to obtain the C-frame includes: Define dynamic expansion amount: Coordinates of the C-frame boundary after dynamic expansion: in, A specific expansion coefficient designed for the non-rigid characteristics of the head; Center and dimensions of frame C: Where Δx is the dynamic expansion in the horizontal direction, and Δy is the dynamic expansion in the vertical direction. The horizontal coordinates of the left boundary of box C. The horizontal coordinates of the right boundary of box C. The vertical coordinates of the upper boundary of box C. The vertical coordinates of the bottom boundary of box C. The horizontal coordinates of the center of box C. The vertical coordinates of the center of box C. The horizontal width of box C. This is the vertical height of box C.

5. The control method for a millimeter-wave-based image magnification display device according to claim 4, characterized in that, Calculating the field of view resolution includes: in, The horizontal pixel field of view. Where is the vertical pixel field of view, W is the horizontal resolution, and H is the vertical resolution. For horizontal field of view, This refers to the vertical field of view. Based on the field of view resolution, the distance between the human body and the display module, and the effective head pixel set, the baseline size and initial coordinates of the D-frame are obtained, including: Let the center of frame C be... Effective head pixel set convex hull The radius of the outer circle of the pixel domain is , , If the value is the Euclidean norm, then the corresponding actual physical radius is: d is the distance between the human body and the display module; Radius of the D-frame in the calibrated pixel domain: Among them, the expansion coefficient ; Base dimensions of frame D: Initial coordinates of box D: in, This is the baseline horizontal width of frame D. The reference vertical height of frame D. Let the initial left horizontal coordinates of the D-boundary be... The initial vertical coordinates of the upper boundary of the D-box. Let the initial right boundary horizontal coordinates of box D be... The initial vertical coordinates of the lower boundary of the D-frame.

6. The control method for a millimeter-wave-based image magnification display device according to claim 5, characterized in that, The step of displaying a safety frame on the display module based on the safety frame parameters includes: Boundary constraints based on the display module's field of view: Calculate the effective display pixel boundary corresponding to the field of view: The final coordinates of the D-shape after constraints are: The actual size of the square after field-of-view calibration is: The D box is located in a rectangular area. The specific coordinates are: Top left corner coordinates: Bottom right corner coordinates: in, To display the left coordinate of the effective horizontal display boundary of the module, To display the right coordinates of the effective horizontal display boundary of the module, To display the upper coordinates of the vertical effective display boundary of the module, To display the lower coordinates of the vertical effective display boundary of the module, To determine the final left boundary horizontal coordinates of the bounding box after constraint, The final right boundary horizontal coordinates of the constrained D-frame. The final upper boundary vertical coordinates of the constrained D-frame. The final lower boundary vertical coordinates of the constrained D-frame This is the final horizontal width of box D. This represents the final vertical height of box D.

7. The control method for a millimeter-wave-based image magnification display device according to claim 1, characterized in that, The size and position adjustment of the safety frame are input via an input device or through human body movements captured by millimeter waves.

8. The control method for a millimeter-wave-based image magnification display device according to claim 1, characterized in that, The method further includes: Three secondary adjustment modes are set to avoid text truncation by the safety border: Mode 1: Search by black and white up and down; Mode 2: Search by black and white left and right; Mode 3: Search by black and white up, down, left and right. Adjust the position of the safety border according to the mode selected by the user to eliminate text truncation.

9. A millimeter-wave-based image magnification display device, used to implement the control method for a millimeter-wave-based image magnification display device as described in any one of claims 1-8, characterized in that, Includes a Scaler module, an FPGA module, a millimeter-wave module, a button module, and a display module; The millimeter-wave module is used to detect the position of the human body and to acquire the contour data of the human head. The Scaler module is used to set the effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module. If the human body is not located in the standard display area, the display module guides the human body into the standard display area. It is also used to calculate and generate a safety frame parameter that matches the human head contour based on the acquired human head contour data, and send the safety frame parameter to the display module for displaying the safety frame. The size and position of the safety frame are adjusted according to the input information. The FPGA module is used to perform local magnification processing on the selected area of ​​the image within the safety frame and output a screen-dotting signal to the display module to display the final image. The button module is used for input control of the Scaler module.

Images