Local amplification display device based on millimeter waves and control method
By combining millimeter-wave radar and FPGA chips, a magnified local display matching the player's head is generated, solving the problems of field of view obstruction and operation lag caused by high-magnification scopes in FPS games. This achieves a balance between high-precision aiming and global field of view, improving the gaming experience and fairness.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- SHENZHEN XINLONGPENG TECH CO LTD
- Filing Date
- 2026-02-10
- Publication Date
- 2026-05-26
AI Technical Summary
In existing FPS games, high-magnification scopes cause obstruction of vision, sluggish operation, and limited applicability, making it difficult to help players clearly identify distant targets while ensuring game fairness and maintaining the same screen layout.
A millimeter-wave-based local magnification display device is adopted. The position and outline of the human head are detected by millimeter-wave radar, and a circular frame matching the head is generated. The local area is processed in real time using an FPGA chip to achieve local magnification and superimposed display.
Improve aiming accuracy and win rate, maintain global vision, avoid tunnel vision effect, support personalized adaptation and convenient operation, hardware-level real-time processing with low latency, and maintain game fairness.
Smart Images
Figure CN122076028A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of image magnification and display technology, and more specifically, to a local magnification display device and control method based on millimeter waves. Background Technology
[0002] With the booming development of the e-sports industry, the performance of the monitor, as the core window for human-computer interaction, directly determines the user's gaming experience and competitive level. Among the many game types, first-person shooter games have the most stringent requirements for monitors. Players need to accurately and quickly identify tiny targets on the screen (such as distant enemies, weapon crosshairs, etc.), and any visual delay or blur can lead to defeat.
[0003] In existing FPS games, to cope with long-range combat, weapons are usually designed with optical sights such as "8x scopes" and "4x scopes." The principle behind this is that the game engine renders the central area of the player's view (i.e., the scope's field of view) at a high magnification, while switching the game screen to the scope's dedicated view. Although this design can effectively magnify distant targets, it has obvious inherent flaws: 1. Field of vision obstruction: When a high-powered scope is activated, the player's field of vision will shrink drastically, and most of the screen area will be covered by the magnified local image; this causes the player to completely lose the ability to perceive the situation of the surrounding environment, making them extremely vulnerable to attacks from the flanks or close-range enemies, commonly known as the "telescope effect".
[0004] 2. Operation delay: Switching sights is usually accompanied by a scope-in animation and a change in perspective, which causes a brief delay in operation. In a high-intensity gunfight, this delay of a few tenths of a second is often fatal.
[0005] 3. Limited applicability: Not all weapons are equipped with high-magnification scopes. In matches involving rifles and submachine guns other than sniper rifles, players often have to rely on the weapon's built-in mechanical crosshair (Iron Sights) or the basic 1x magnification of the red dot sight. In long-range firefights, the enemy and the crosshair only occupy a few pixels on the screen, making them extremely difficult to identify with the naked eye and severely affecting shooting accuracy.
[0006] To address these issues, some games offer auxiliary functions such as image sharpening and brightness adjustment, but their effectiveness is limited. Some third-party software attempts to magnify specific areas of the screen through software algorithms, but this is considered "cheating" and will be detected and banned by the game's anti-cheating system, thus undermining the fairness of the game. In addition, purely software-based magnification usually leads to image stretching and pixel blurring, which actually reduces image quality.
[0007] On the other hand, modern display technology is developing towards higher resolution and higher refresh rates. Although 4K and 8K resolutions can provide more detailed images and make distant targets clearer, this also places extremely high demands on graphics card performance. Most mainstream gamers are still using 1080P or 2K resolutions for gaming. When observing at a distance, the physical limitations of pixels make targets still difficult to identify. At the same time, without special optimization, the relative size of the UI interface and crosshair will become smaller at high resolutions, further increasing the difficulty of aiming.
[0008] In conclusion, a solution is needed that can effectively assist players (especially at medium to long ranges) in clearly identifying the crosshair and enemies while ensuring game fairness and not disrupting the original game screen layout and field of view. Summary of the Invention
[0009] The technical problem to be solved by the present invention is to provide a millimeter-wave-based local magnification display device and a control method for the millimeter-wave-based local magnification display device, in view of the above-mentioned defects of the prior art.
[0010] The technical solution adopted by this invention to solve its technical problem is: A control method for a millimeter-wave-based local magnification display device is constructed, wherein the method includes: Define an effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module. The system uses millimeter-wave radar to detect the real-time distance between the human head and the display module, and determines whether the human body is within the standard display area based on the real-time distance. If the human body is within the standard display area, it proceeds directly to the next step. If the human body is within the zoomed-out or zoomed-out area, the system guides the user to adjust their sitting posture through graphical interface prompts or sound prompts until the human head enters the standard display area, and then proceeds to the next step. The system uses millimeter-wave radar to scan and acquire three-dimensional point cloud data of the human head. It then extracts the contour features of the human head based on the three-dimensional point cloud data and calculates and generates circular frame parameters that match the contour of the human head. The circular frame parameters include at least the center coordinates, width, and height of the outer frame. The circular frame is then overlaid and displayed on the display module based on the circular frame parameters. The circular frame is used to define the boundary of the local magnified area. Determine if there is any adjustment input for the size and / or position of the circular frame, triggered by the user through an external input device; if yes, adjust the size and / or center position of the circular frame in real time according to the adjustment input, and proceed to the next step after the adjustment is completed; if no, proceed directly to the next step. The FPGA chip performs real-time image processing on the selected area of the circular frame, including: capturing the original image within the circular frame, magnifying it to a preset magnification factor, and displaying the magnified image as a picture-in-picture overlay at a preset position on the original image, while ensuring that the center point of the circular frame coincides with the crosshair position in the game screen.
[0011] The control method for a millimeter-wave-based local magnification display device of the present invention includes the following steps: acquiring three-dimensional point cloud data of a human head using millimeter-wave radar scanning; extracting contour features of the human head based on the three-dimensional point cloud data; and calculating and generating circular frame parameters matching the contour of the human head based on the contour features. Three-dimensional point cloud data of the human head is obtained by scanning with millimeter-wave radar. The pixel set of the human head contour is extracted from the three-dimensional point cloud data and noise reduction is performed to obtain image A. Image B is obtained by calculating and processing the cross marker of the human head contour pixel set, with the center of the cross marker being the centroid of the head contour. The circle in diagram C is obtained by robustly fitting the circumcircle radius with the centroid of the head outline as the center. The circle in diagram D is obtained by performing display coordinate mapping and dynamic visual compensation based on the circle in diagram C.
[0012] The millimeter-wave-based local magnification display device control method of the present invention includes the following steps: acquiring three-dimensional point cloud data of a human head using millimeter-wave radar scanning, extracting the human head contour pixel set from the three-dimensional point cloud data, and performing noise reduction processing to obtain image A. Let the set of head contour pixels for millimeter-wave detection be... ; Define adaptive density weights to reduce noise point interference. : ; ; ; in, The number of contour points, Let be the initial geometric center of the contour point set. Let be the standard deviation of the distance between point sets. These are the pixel coordinates.
[0013] The millimeter-wave-based local magnification display device control method of the present invention, wherein the cross-shaped marker of the pixel set of the human head contour after calculation and processing is used to obtain Image B, and the center of the cross-shaped marker is the centroid of the head contour, includes: Calculate weighted robust centroid coordinates The robust centroid is the center of the cross symbol; ; ; Principal component analysis was used to determine the natural orientation of the cross to fit the head contour, and the covariance matrix was constructed: ; right Eigenvalue decomposition, taking the eigenvector corresponding to the largest eigenvalue. This refers to the horizontal / vertical main direction of the cross symbol.
[0014] The millimeter-wave-based local magnification display device control method of the present invention, wherein the robust fitting calculation of the circumscribed circle radius to obtain the circle of image C with the head contour centroid as the center includes: The initial radius is estimated using the median: ; The radius is iteratively optimized using M-estimation with weights, excluding contour noise such as hair and ears. The iterative weights are defined as follows: ; The distance from the point to the center Standard deviation of distance ; Iterative update radius: ; Convergence condition: ; in, Pixels, to balance accuracy and efficiency; final fitting radius , This represents the number of iterations.
[0015] The millimeter-wave-based local magnification display device control method of the present invention, wherein the process of obtaining the circle in the D image by performing display coordinate mapping and dynamic visual compensation based on the circle in the C image includes: For a 1920×1080 monitor, define the screen coordinate system: the top left corner is the origin. The bottom right corner is pixel coordinates , ; Center coordinate clamping: , ; in Ensure that the center is always within the screen's visible range; Physical-Pixel Adaptive Transformation: Let the physical radius of the head for millimeter-wave detection be... The display pixel density is 1 inch = 25.4 mm, therefore the basic pixel radius is: ; in 1 represents the scene adaptive scaling factor; Dynamic boundary constraints: ; Ensure that the top, bottom, left, and right boundaries of the circle do not exceed the 1920×1080 screen. Visual compensation gamma correction: For any angle on a circle Display coordinates with edge compensation added: ; ; in This is the visual compensation coefficient, used to correct the human eye's perception of distortion at the edges of the screen.
[0016] The millimeter-wave-based local magnification display device control method of the present invention further includes determining the size and position of the D-shaped circle in a 1920×1080 image: Location: From the centroid after clamping Uniquely determined, the coordinate range is constrained to arrive Between these points, ensure that the center of the circle is always within the visible area of the screen; Size: The radius after dynamic adjustment Sure.
[0017] The millimeter-wave-based local magnification display device control method of the present invention wherein the size and position adjustment input of the circular frame is achieved by inputting through an input device, or by human body movements collected by millimeter waves, or by voice input control.
[0018] A millimeter-wave-based local magnification display device is used to implement the millimeter-wave-based local magnification display device control method described above, wherein the device includes a Scaler module, an FPGA module, a millimeter-wave module, a button module, a voice module, and a display module. The millimeter-wave module is used to detect the real-time distance between the human head and the display module, and to acquire three-dimensional point cloud data of the human head, and to extract the contour features of the human head based on the three-dimensional point cloud data. The Scaler module is used to set the effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module. If the human body is not located within the standard display area, the display module guides the human body into the standard display area. It is also used to calculate and generate circular frame parameters that match the human head contour based on contour features. The circular frame parameters include at least the center coordinates, width, and height of the outer frame. The circular frame is superimposed on the display module according to the circular frame parameters. The circular frame is used to define the boundary of the local magnified area. The size and position of the circular frame are adjusted according to the input information. The FPGA module is used to perform real-time image processing on the screen within the area selected by the circular frame, including: capturing the original screen within the circular frame, magnifying it to a preset magnification factor, and displaying the magnified screen in a picture-in-picture format overlaid on the original screen at a preset position, while ensuring that the center point of the circular frame coincides with the crosshair position in the game screen. The button module is used to control the Scaler module via button input. The voice module is used to perform voice input control on the FPGA module and the millimeter-wave module.
[0019] The beneficial effects of this invention are as follows: applying the methods of this application can not only improve aiming accuracy and game win rate, maintain global vision and avoid the "tunnel vision" effect, but also adapt to each person's own head shape for personalized adaptation, which can effectively improve comfort, and is convenient to operate and supports fine adjustment; in addition, the solution is based on hardware-level real-time processing, with low latency and high smoothness, avoiding stuttering or ghosting caused by processing delay; the non-intrusive design can maintain the fairness of the game. Attached Figure Description
[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the present invention will be further described below in conjunction with the accompanying drawings and embodiments. The drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort: Figure 1 This is a flowchart of a control method for a millimeter-wave-based local magnification display device according to a preferred embodiment of the present invention. Figure 2 This is a schematic diagram of the partitioning of a millimeter-wave-based local magnification display device control method according to a preferred embodiment of the present invention; Figure 3 This is a schematic diagram of D-frame generation for a millimeter-wave-based local magnification display device control method according to a preferred embodiment of the present invention. Figure 4This is a schematic diagram of two magnification modes of the millimeter-wave-based local magnification display device control method according to a preferred embodiment of the present invention; Figure 5 This is a block diagram illustrating the principle of a millimeter-wave-based local magnification display device according to a preferred embodiment of the present invention. Detailed Implementation
[0021] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, a clear and complete description will be provided below in conjunction with the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the protection scope of the present invention.
[0022] The preferred embodiment of the present invention provides a control method for a millimeter-wave-based local magnification display device, such as... Figure 1 As shown, see also Figures 2-4 The methods include: S01: Set the effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module. like Figure 2 As shown, points A to J represent the display, E is the installation location of the millimeter-wave radar, and F and I are invalid areas. Area G is the reduced area, and area H is the magnified area. Area C is the standard display area, a is the start point of the valid area, b is the end point of the valid area, and ab is the entire valid area. The system is set to activate human detection in area C.
[0023] S02: Use millimeter-wave radar to detect the real-time distance between the human head and the display module, and determine whether the human body is within the standard display area based on the real-time distance; if the human body is within the standard display area, proceed directly to the next step; if the human body is within the zoomed-out or zoomed-out area, guide the user to adjust their sitting posture through graphical interface prompts or sound prompts until the human head enters the standard display area, and then proceed to the next step. When the keyboard input or voice module notifies the millimeter wave to activate the "safety frame function" to start detecting the human body, it reports the distance data to the FPGA, allowing the FPGA to display the current area and distance, and guide the human body to area C. Assuming ab is 70 cm, area G is 30 cm, H is 30 cm, and area C is 10 cm, when the human body is detected in area G, the millimeter wave measures the specific distance and informs the FPGA, which then displays OSD on the screen: "Currently in area G, distance 25 cm, please move back 5 cm," and so on. When a human body is detected in zone H, the FPGA is informed of the specific distance measured in millimeters. The OSD is then displayed on the screen, indicating that the human body is currently in zone G, at a distance of 45 centimeters. The OSD will then indicate that the human body is to move forward by 5 centimeters. This process is repeated for each human body. When a human body is detected in zone C, the distance is measured in millimeters and communicated to the FPGA. The OSD is then displayed on the monitor: "Currently in zone C, distance 35 cm. Please hold. Starting to draw the safety frame."
[0024] S03: Use millimeter-wave radar to scan and obtain three-dimensional point cloud data of the human head, extract the contour features of the human head based on the three-dimensional point cloud data, and calculate and generate circular frame parameters that match the contour of the human head based on the contour features. The circular frame parameters include at least the center coordinates, width and height of the outer frame. The circular frame is superimposed and displayed on the display module according to the circular frame parameters. The circular frame is used to define the boundary of the local magnified area. When plotting the D-frame using the millimeter-wave module, it's crucial to determine its size and position within the 1920×1080 resolution image. Reason one: to prevent the safety frame from exceeding the actual resolution. Reason two: to inform the FPGA of the captured coordinates and position. Reason three: because human heads vary in size, and display sizes for the same resolution also differ, coordinate mapping is necessary. The process can be roughly deduced from four steps: extraction of head parameters from millimeter-wave detection → C-frame calculation → coordinate mapping → D-frame generation. Figure 3 As shown, the specific method used is: 1. Using millimeter-wave radar scanning, 3D point cloud data of the human head is acquired. The pixel set of the human head contour is extracted from the 3D point cloud data, and noise reduction processing is performed to obtain Image A: Scene parameter definition: Basic monitor parameters: Monitor level Vertical resolution ; Let the set of head contour pixels for millimeter-wave detection be... ; Define adaptive density weights to reduce noise point interference. :
[0025] ; ; in, The number of contour points, Let be the initial geometric center of the contour point set. Let be the standard deviation of the distance between point sets. These are the pixel coordinates.
[0026] 2. Image B is obtained by calculating the crosshair marker of the processed human head contour pixel set, with the center of the crosshair marker being the centroid of the head contour: Calculate weighted robust centroid coordinates The robust centroid is the center of the cross symbol; ; ; Principal component analysis was used to determine the natural orientation of the cross to fit the head contour, and the covariance matrix was constructed: ; right Eigenvalue decomposition, taking the eigenvector corresponding to the largest eigenvalue. This refers to the horizontal / vertical main direction of the cross symbol.
[0027] 3. Using the centroid of the head outline as the center, a robust fitting calculation of the circumcircle radius is performed to obtain the circle in diagram C: The initial radius is estimated using the median: ; The iterative weighted optimization radius is estimated using M, and contour noise such as hair and ears is eliminated. The iterative weights are defined as follows: ; The distance from the point to the center Standard deviation of distance ; Iterative update radius: ; Convergence condition: ; in, Pixels, to balance accuracy and efficiency; final fitting radius , This represents the number of iterations.
[0028] 4. Based on the circle in graph C, perform display coordinate mapping and dynamic visual compensation to obtain the circle in graph D: For a 1920×1080 monitor, define the screen coordinate system: the top left corner is the origin. The bottom right corner is pixel coordinates , ; Center coordinate clamping: , ; in Ensure that the center is always within the screen's visible range; Physical-Pixel Adaptive Transformation: Let the physical radius of the head for millimeter-wave detection be... The display pixel density is 1 inch = 25.4 mm, therefore the basic pixel radius is: ; in 1 represents the scene adaptive scaling factor; Dynamic boundary constraints: ; Ensure that the top, bottom, left, and right boundaries of the circle do not exceed the 1920×1080 screen. Visual compensation gamma correction: For any angle on a circle Display coordinates with edge compensation added:
[0029] in This is the visual compensation coefficient, used to correct the human eye's perception of distortion at the edges of the screen.
[0030] Determine the size and position of circle D in the 1920×1080 image: Location: From the centroid after clamping Uniquely determined, the coordinate range is constrained to arrive Between these points, ensure that the center of the circle is always within the visible area of the screen; Size: The radius after dynamic adjustment Sure.
[0031] The above steps, with numerical substitution, provide a complete calculation example: Scenario setting (close to real-world applications); Display resolution: 1920×1080 (pixels), DPI=96. Millimeter wave detection head contour point set (simulating real data, containing a small amount of noise):
[0032] Right now The point set is distributed in the area of the screen (simulating the head in the center of the screen). Head physical radius (Average adult); Scene scaling factor (The head occupies a moderate proportion of the image); Visual compensation coefficient ; Step 1: Calculate the initial geometric center ; Right now ; Step 2: Calculate the adaptive density weights ; First calculate each point :
[0033] calculate ; but :
[0034] Step 3: Calculate the robust centroid ;
[0035] Robust centroid (Noise points have extremely low weights and no centroid shift); Step 4: Calculate the covariance matrix and principal directions;
[0036] Substitute the numerical values into the calculation:
[0037] therefore The eigenvalue is 528 (corresponding to the eigenvector). ) and 78.4 (corresponding to ), main direction (Horizontal / Vertical, the crosshair is parallel to the screen coordinate axis).
[0038] Step 5: Robust radius fitting; Initial radius: Pixel calculation After one iteration (convergence has been achieved): The calculation yields:
[0039] ; Pixel convergence ( ),final Pixel.
[0040] Step 6: Coordinate mapping and visual compensation; Center clamp: , ; Base pixel radius: ; Pixel dynamic boundary constraints: ; Pixel (without exceeding screen) visual compensation (with) (Taking the top vertex as an example):
[0041] Final result (Circle D); Location: Center coordinates are (10 pixels below the center of the 1920×1080 screen, which corresponds to the natural position of the human head). Size: Display radius is 302.4 pixels, circle boundary coordinate range: Pixel left boundary: ; Pixel right boundary: ; Pixel upper boundary:
[0042] Pixel lower boundary: Pixels (all within the 1920×1080 screen area, with no out-of-range pixels); Visual compensation effect: After gamma correction, the visual distortion in the edge area of the screen is reduced, and the circle perceived by the human eye is more regular.
[0043] S04: Determine if there is any adjustment input for the size and / or position of the circular frame, triggered by the user through an external input device; if yes, adjust the size and / or center position of the circular frame in real time according to the adjustment input, and proceed to the next step after the adjustment is completed; if no, proceed directly to the next step. The size and position of the circular frame can be adjusted via input devices, human body movements captured by millimeter waves, or voice input control.
[0044] Taking voice input control as an example, it can be operated in the following way: The safety frame circle is displayed on the screen and flashes. Outside the safety frame, the OSD displays "Enable voice adjustment of size and position? If needed, please say the wake-up word 'Hello XX'" or "Hello HH". At this time, the voice module is awakened, and the OSD disappears. After awakening, the circle is adjusted by default. When "Next Page" or "Confirm" is available, the position is adjusted. When "Exit" is available, it directly goes to FPGA amplification (the size and position are not adjusted by default). When "Next Page" or "Confirm" is available, the position is adjusted. When "Previous Page" or "Cancel" is available, the size is adjusted.
[0045] The following options are available: "Shrink the circle slightly", "Shrink the circle slightly", "Move the circle slightly to the left", "Move the circle slightly to the right", "Move the circle slightly up", and "Move the circle slightly down". Follow the normal operating procedure.
[0046] Assume that when resizing, after the first command "shrink the circle a little" is executed, the command "cancel" is executed a second time. The first command is then canceled and restored, and this process is repeated inwards. The same logic applies when adjusting the position.
[0047] The voice module has several pre-set voice commands: "Activate safety box function," "Exit safety box function," "Shrink the circle slightly," "Enlarge the circle slightly," "Move the circle slightly to the left," "Move the circle slightly to the right," "Move the circle slightly up," "Move the circle slightly down," "Cancel," "Confirm," "Exit." The following are the corresponding code instructions (distance) for each specified instruction. "Exit security box function": 0XF6; "Enable security box function": 0XF5; "Shrink the circle slightly": 0XFA; "Make the circle a little bigger": 0XFB; "Shift the circle slightly to the left": 0XFC; "Shift the circle slightly to the right": 0XFD; "Move the circle up a little": 0XFE; "Move the circle down a little": 0XFF; "Cancel": 0XF0; "Confirmed": 0XF1; "Exit": 0XF2; Previous Page: 0XF3; Previous Page: 0XF4; The voice module recognizes the voice command, converts it into a corresponding code command, and sends it to the millimeter wave to adjust the size and position. The millimeter wave performs the following actions: Code instruction: 0XF5 mmWave activates "Security Frame Function"; Code instruction: 0XF6 mmWave exits "Security Frame Function"; Code instruction: 0XFA millimeter wave reduces the radius of the circle by 50 pixels (preset, can be adjusted multiple times if the size is not suitable); Code instruction: 0XFB millimeter wave enlarges the radius of the circle by 50 pixels (preset, can be adjusted multiple times if the size is not suitable); Code instruction: 0XFC Millimeter wave shifts the radius of the circle to the left by 50 pixels (preset, can be adjusted multiple times if the position is not suitable); Code instruction: 0XFD millimeter wave shifts the radius of the circle 50 pixels to the right (preset, can be adjusted multiple times if the position is not suitable); Code instruction: 0XFE millimeter wave moves the circle radius up by 50 pixels (preset, can be adjusted multiple times if the position is not suitable); Code instruction: 0XFF millimeter wave will shift the radius of the circle down by 50 pixels (preset, can be adjusted multiple times if the position is not suitable); Code instruction: 0XF0 millimeter wave cancels the previous action; Code instruction: 0XF1 millimeter wave enters the next adjustment action; Code command: 0XF2 Exit voice function; Code instruction: 0XF3 If the position is being adjusted, return to the resizing state; if the position is already being adjusted, do not perform any action. Code instruction: 0XF4 If resizing is in progress, return to the resizing position; if resizing is already in progress, do not perform any action. After the appeal is processed, the data is sent to the FPGA to extract the size and coordinates of the image to be enlarged and then enlarge it frame by frame, while the circle disappears. There are two zoom modes, such as Figure 4 As shown: It's worth noting that the black circle in the image doesn't actually appear on the screen; it's just for display purposes. Mode 2's position isn't fixed (it can be set according to user needs). Both modes are well-suited to user habits. To enter Mode 2, say "Hello HH," the voice module is activated. The voice module recognizes the voice command, converts it into corresponding code commands, and notifies the FPGA to adjust the size and position. "Hello XX" and "Hello HH" correspond to millimeter wave and FPGA, respectively. Without activating the FPGA, it defaults to Mode 1 for magnification. After activation, it enters Mode 2 to adjust the size of the circle in the magnified area. Wait for "Next Page" or "Confirm" to adjust the position. An "Exit" command directly takes you to the FPGA for magnification (by default, no size or position adjustment). "Next Page" or "Confirm" allows you to adjust the position, while "Previous Page" or "Cancel" takes you to the previous page to adjust the size. Options include "Shrink the circle slightly," "Enlarge the circle slightly," "Move the circle slightly to the left," "Move the circle slightly to the right," "Move the circle slightly up," and "Move the circle slightly down," which can be used normally.
[0048] Assume that when resizing, after the first command "shrink the circle a little" is executed, the command "cancel" is executed a second time. The first command is then canceled and restored, and this process is repeated inwards. The same logic applies when adjusting the position.
[0049] The voice module has some pre-set voice commands: "Shrink the circle a little", "Enlarge the circle a little", "Move the circle a little to the left", "Move the circle a little to the right", "Move the circle a little up", "Move the circle a little down", "Cancel", "Confirm", "Exit"; The following are the corresponding code instructions (distance) for each specified instruction. "Shrink the circle slightly": 0XFFA; "Make the circle bigger": 0XFFB; "Shift the circle slightly to the left": 0XFFC; "Shift the circle slightly to the right": 0XFFD; "Move the circle up a little": 0XFFE; "Move the circle down a little": 0XFFF; "Cancel": 0XFF0; "Confirmed": 0XFF1; "Exit": 0XFF2; Previous Page: 0XFF3; Previous Page: 0XFF4; The voice module recognizes the voice command, converts it into a corresponding code command, and notifies the millimeter wave to adjust the size and position of the magnified area circle. The millimeter wave performs the following actions: Code instruction: 0XFA millimeter wave reduces the radius of the circle by 50 pixels (preset, can be adjusted multiple times if the size is not suitable); Code instruction: 0XFB millimeter wave enlarges the radius of the circle by 50 pixels (preset, can be adjusted multiple times if the size is not suitable); Code instruction: 0XFC Millimeter wave shifts the radius of the circle to the left by 50 pixels (preset, can be adjusted multiple times if the position is not suitable); Code instruction: 0XFD millimeter wave shifts the radius of the circle 50 pixels to the right (preset, can be adjusted multiple times if the position is not suitable); Code instruction: 0XFE millimeter wave moves the circle radius up by 50 pixels (preset, can be adjusted multiple times if the position is not suitable); Code instruction: 0XFF millimeter wave will shift the radius of the circle down by 50 pixels (preset, can be adjusted multiple times if the position is not suitable); Code instruction: 0XF0 millimeter wave cancels the previous action; Code instruction: 0XF1 millimeter wave enters the next adjustment action; Code command: 0XF2 Exit voice function; Code instruction: 0XF3 If the position is being adjusted, return to the resizing state; if the position is already being adjusted, do not perform any action. Code instruction: 0XF4 If resizing is in progress, return to the resizing position; if resizing is already in progress, do not perform any action. After the above processing is completed, the data is sent to the FPGA to extract the size and coordinates of the image to be enlarged and then enlarge it frame by frame, while the circle disappears.
[0050] S05: Perform real-time image processing on the screen within the selected area of the circular frame using the FPGA chip, including: capturing the original screen within the circular frame, magnifying it to a preset magnification factor, and displaying the magnified screen as a picture-in-picture overlay at a preset position on the original screen, while ensuring that the center point of the circular frame coincides with the crosshair position in the game screen.
[0051] The method described in this application not only improves aiming accuracy and win rate, maintains global vision, and avoids the "tunnel vision" effect, but also adapts to each person's head shape for personalized optimization, effectively improving comfort. It is easy to operate and supports fine-tuning. In addition, the solution is based on hardware-level real-time processing, with low latency and high smoothness, avoiding stuttering or ghosting caused by processing delays. The non-intrusive design maintains the fairness of the game. Specifically: 1. Improved aiming accuracy and game win rate: The core advantage lies in solving the problem of distant enemies and the crosshair being too small and difficult to identify in FPS games; it uses millimeter-wave radar to intelligently identify the head position and automatically generate a circular frame that matches the head contour, which can accurately lock the user's visual focus area; then, through FPGA, it performs real-time local magnification, which significantly magnifies the crosshair and distant targets without switching the game view or using a traditional scope, allowing users to aim more clearly and quickly, thereby directly improving shooting accuracy and game win rate.
[0052] 2. Maintain a global field of view and avoid the "tunnel vision" effect: Unlike traditional high-magnification scopes (such as 8x scopes) that cover the entire screen, this method uses a "picture-in-picture" or partial overlay display. While observing magnified details (crosshair, enemies), users can still see the original image of the rest of the screen, preserving situational awareness of the surrounding environment. This effectively prevents blind spots caused by using high-magnification scopes, allowing users to detect flank threats in time, greatly enhancing survivability and tactical flexibility in the game.
[0053] 3. Adaptive and Personalized Fit for Enhanced Comfort: By acquiring 3D point cloud data of the human head using millimeter-wave radar to generate a circular frame, the display area is intelligently matched to the user's physiological characteristics. Different users have different head sizes and posture habits; this method can automatically calculate the magnified area that best suits the current user's field of vision, providing personalized visual assistance. This reduces the hassle of frequent manual adjustments and improves the comfort and naturalness of use.
[0054] 4. Convenient operation and support for fine-tuning: The solution provides a combination of automatic detection and manual fine-tuning. After the system automatically completes the initial positioning and selection, users can still finely adjust the size and position of the circular frame through external input devices (such as mouse and keyboard) and voice modules to adapt to the needs of different game scenarios (such as sniping and assault) or personal operating habits, thus balancing the convenience of automation with the user's degree of customization.
[0055] 5. Hardware-level real-time processing, low latency and high smoothness: Image magnification is performed using FPGA (Field-Programmable Gate Array). Compared to traditional software algorithms or GPU processing, FPGA has parallel processing capabilities, enabling extremely low processing latency. In high-speed FPS games, even millisecond-level latency differences are crucial. Hardware acceleration ensures the real-time performance and smoothness of the magnified image, avoiding stuttering or ghosting caused by processing latency, and guaranteeing the fairness of the competition.
[0056] 6. Intelligent Distance Management and Health Tips: By dividing the display into zoomed-out, standard, and zoomed-out zones and guiding users to stay in the standard zone, the display effect is optimized (avoiding image distortion or blurring caused by excessively close or far distances). At the same time, it also serves as a reminder for healthy monitor use, urging users to maintain the correct viewing distance, thus balancing gaming experience with eye health.
[0057] 7. Non-intrusive design, maintaining game fairness: This solution is entirely based on monitor hardware and external sensors, without modifying or injecting any game program code or memory data. It is a post-processing of the monitor's output signal, technically different from "cheat" software that can be detected by anti-cheat systems. While providing visual assistance, it maintains the fairness of the game to the greatest extent.
[0058] A millimeter-wave-based local magnification display device is provided for implementing the millimeter-wave-based local magnification display device control method described above. Figure 5 As shown, it includes a Scaler module 100, an FPGA module 101, a millimeter-wave module 102, a button module 103, a voice module 104, and a display module 105; The millimeter-wave module 102 is used to detect the real-time distance between the human head and the display module, and to acquire the three-dimensional point cloud data of the human head, and to extract the contour features of the human head based on the three-dimensional point cloud data. Scaler module 100 is used to define the effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module. If the human body is not located within the standard display area, the display module guides the human body into the standard display area. It is also used to calculate and generate circular frame parameters that match the human head contour based on contour features. The circular frame parameters include at least the center coordinates, width, and height of the outer frame. The circular frame is superimposed on the display module according to the circular frame parameters. The circular frame is used to define the boundary of the local magnified area. The size and position of the circular frame are adjusted according to the input information. FPGA module 101 is used to perform real-time image processing on the screen within the area selected by the circular frame, including: capturing the original screen within the circular frame, magnifying it to a preset magnification factor, and displaying the magnified screen in a picture-in-picture format at a preset position on the original screen, while ensuring that the center point of the circular frame coincides with the crosshair position in the game screen. The button module 103 is used to control the button input of the Scaler module; Voice module 104 is used for voice input control of FPGA module and millimeter wave module; The method described in this application not only improves aiming accuracy and win rate, maintains global vision, and avoids the "tunnel vision" effect, but also adapts to each person's head shape for personalized optimization, effectively improving comfort. It is easy to operate and supports fine-tuning. In addition, the solution is based on hardware-level real-time processing, with low latency and high smoothness, avoiding stuttering or ghosting caused by processing delays. The non-intrusive design maintains the fairness of the game.
[0059] It should be understood that those skilled in the art can make improvements or modifications based on the above description, and all such improvements and modifications should fall within the protection scope of the appended claims.
Claims
1. A control method for a millimeter-wave-based local magnification display device, characterized in that the method... include: Define an effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module. The system uses millimeter-wave radar to detect the real-time distance between the human head and the display module, and determines whether the human body is within the standard display area based on the real-time distance. If the human body is within the standard display area, it proceeds directly to the next step. If the human body is within the zoomed-out or zoomed-out area, the system guides the user to adjust their sitting posture through graphical interface prompts or sound prompts until the human head enters the standard display area, and then proceeds to the next step. The system uses millimeter-wave radar to scan and acquire three-dimensional point cloud data of the human head. It then extracts the contour features of the human head based on the three-dimensional point cloud data and calculates and generates circular frame parameters that match the contour of the human head. The circular frame parameters include at least the center coordinates, width, and height of the outer frame. The circular frame is then overlaid and displayed on the display module based on the circular frame parameters. The circular frame is used to define the boundary of the local magnified area. Determine if there is any adjustment input for the size and / or position of the circular frame, triggered by the user through an external input device; if yes, adjust the size and / or center position of the circular frame in real time according to the adjustment input, and proceed to the next step after the adjustment is completed; if no, proceed directly to the next step. The FPGA chip performs real-time image processing on the selected area of the circular frame, including: capturing the original image within the circular frame, magnifying it to a preset magnification factor, and displaying the magnified image as a picture-in-picture overlay at a preset position on the original image, while ensuring that the center point of the circular frame coincides with the crosshair position in the game screen.
2. The control method for a millimeter-wave-based local magnification display device according to claim 1, characterized in that, The process of acquiring three-dimensional point cloud data of the human head using millimeter-wave radar scanning, extracting contour features of the human head based on the three-dimensional point cloud data, and calculating and generating circular frame parameters that match the contour of the human head based on the contour features includes: Three-dimensional point cloud data of the human head is obtained by scanning with millimeter-wave radar. The pixel set of the human head contour is extracted from the three-dimensional point cloud data and noise reduction is performed to obtain image A. Image B is obtained by calculating and processing the cross marker of the human head contour pixel set, with the center of the cross marker being the centroid of the head contour. The circle in diagram C is obtained by robustly fitting the circumcircle radius with the centroid of the head outline as the center. The circle in diagram D is obtained by performing display coordinate mapping and dynamic visual compensation based on the circle in diagram C.
3. The control method for a millimeter-wave-based local magnification display device according to claim 2, characterized in that, The process of acquiring three-dimensional point cloud data of the human head using millimeter-wave radar scanning, extracting the human head contour pixel set from the three-dimensional point cloud data, and performing noise reduction processing to obtain image A includes: Let the set of head contour pixels for millimeter-wave detection be... ; Define adaptive density weights to reduce noise point interference. : ； ； ； in, The number of contour points, Let be the initial geometric center of the contour point set. Let be the standard deviation of the distance between point sets. These are the pixel coordinates. Let be the scalar Euclidean distance from the i-th contour point to the initial geometric center.
4. The control method for a millimeter-wave-based local magnification display device according to claim 3, characterized in that, Image B is obtained by calculating and processing the cross-shaped marker of the human head contour pixel set. The center of the cross-shaped marker is the centroid of the head contour, including: Calculate weighted robust centroid coordinates The robust centroid is the center of the cross symbol; ； ； Principal component analysis was used to determine the natural orientation of the cross to fit the head contour, and the covariance matrix was constructed: ; right Eigenvalue decomposition, taking the eigenvector corresponding to the largest eigenvalue. This refers to the horizontal / vertical main direction of the cross symbol.
5. The control method for a millimeter-wave-based local magnification display device according to claim 4, characterized in that, The circle in Figure C obtained by robustly fitting the circumcircle radius with the centroid of the head contour as the center includes: Initial radius estimated using median : ； The iterative weighted optimization radius is estimated using M, and contour noise such as hair and ears is eliminated. The iterative weights are defined as follows: ； The distance from the point to the center Standard deviation of distance ; Iterative update radius : ； Convergence condition: ； in, Pixels, to balance accuracy and efficiency; final fitting radius , This represents the number of iterations.
6. The control method for a millimeter-wave-based local magnification display device according to claim 5, characterized in that, The circle in the D image obtained by performing display coordinate mapping and dynamic visual compensation based on the circle in the C image includes: For a 1920×1080 monitor, define the screen coordinate system: the top left corner is the origin. The bottom right corner is pixel coordinates , ; Center coordinate clamping: , ; in Ensure that the center is always within the screen's visible range; Physical-Pixel Adaptive Transformation: Let the physical radius of the head for millimeter-wave detection be... The display pixel density is 1 inch = 25.4 mm, therefore the basic pixel radius is: ； in 1 represents the scene adaptive scaling factor; Dynamic boundary constraints : ； Ensure that the top, bottom, left, and right boundaries of the circle do not exceed the 1920×1080 screen. Visual compensation gamma correction: For any angle on a circle Display coordinates with edge compensation added: ; ; in The visual compensation coefficient is used to correct the perceptual distortion of the human eye at the edges of the screen. () represents the displayed coordinates of a point on the circle after visual compensation.
7. The control method for a millimeter-wave-based local magnification display device according to claim 6, characterized in that, The method also includes determining the size and position of the circle in the 1920×1080 image: Location: From the centroid after clamping Uniquely determined, the coordinate range is constrained to arrive Between these points, ensure that the center of the circle is always within the visible area of the screen; Size: The radius after dynamic adjustment Sure.
8. The control method for a millimeter-wave-based local magnification display device according to claim 1, characterized in that, The size and position adjustment of the circular frame can be achieved through input devices, human body movements captured by millimeter waves, or voice input control.
9. A millimeter-wave-based local magnification display device, used to implement the control method for a millimeter-wave-based local magnification display device as described in any one of claims 1-8, characterized in that, It includes a Scaler module, an FPGA module, a millimeter-wave module, a button module, a voice module, and a display module; The millimeter-wave module is used to detect the real-time distance between the human head and the display module, and to acquire three-dimensional point cloud data of the human head, and to extract the contour features of the human head based on the three-dimensional point cloud data. The Scaler module is used to set the effective observation area located in front of the display module. The effective observation area consists of a reduced area, a standard display area, and a magnified area along the direction away from the display module. If the human body is not located within the standard display area, the display module guides the human body into the standard display area. It is also used to calculate and generate circular frame parameters that match the human head contour based on contour features. The circular frame parameters include at least the center coordinates, width, and height of the outer frame. The circular frame is superimposed on the display module according to the circular frame parameters. The circular frame is used to define the boundary of the local magnified area. The size and position of the circular frame are adjusted according to the input information. The FPGA module is used to perform real-time image processing on the screen within the area selected by the circular frame, including: capturing the original screen within the circular frame, magnifying it to a preset magnification factor, and displaying the magnified screen in a picture-in-picture format overlaid on the original screen at a preset position, while ensuring that the center point of the circular frame coincides with the crosshair position in the game screen. The button module is used to control the Scaler module via button input. The voice module is used to perform voice input control on the FPGA module and the millimeter-wave module.