A method and system for realizing multi-screen display screen control of an unmanned aerial vehicle

Through dynamic comparison and mapping adjustment of multi-parameters, the problem of low path planning and collaboration efficiency in multi-screen display of drones is solved, and more efficient obstacle avoidance and task execution are achieved.

CN119811334BActive Publication Date: 2025-07-11SHENZHEN HUIYUAN INNOVATION TECHNOLOGY CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202510285444.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-03-11
Publication Date
2025-07-11
Estimated Expiration
2045-03-11

AI Technical Summary

Technical Problem

The existing technology has insufficient comprehensive comparison capabilities for path planning in multi-screen display of UAVs, low reliability of obstacle avoidance in dynamic environments, incoherent information display, insufficient power consumption management of display equipment, low energy utilization efficiency, limited environmental data processing capabilities, low multi-machine collaboration efficiency, difficult to meet the needs of fast response.

Method used

Through dynamic comparison of flight altitude, obstacle position, speed and direction, path planning safety factors are generated, flight picture data of VR headsets and remote controls are allocated, multi-screen display mapping is performed, refresh rate and brightness are adjusted, environmental data processing and task information priority are optimized, and multi-machine collaborative monitoring is realized.

Benefits of technology

It improves the flexibility of path adjustment and obstacle avoidance accuracy, realizes efficient allocation of multiple devices, optimizes navigation data display and multi-machine collaboration efficiency, and improves task execution reliability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119811334B_ABST
    Figure CN119811334B_ABST
Patent Text Reader

Abstract

The present invention relates to the technical field of multi-screen display, and specifically provides a method and system for controlling multi-screen display images of an unmanned aerial vehicle, including the following steps: comparing the flight altitude with the obstacle position parameters according to the flight path planning data and real-time obstacle information of the unmanned aerial vehicle, calculating the path segmentation of adjacent areas in combination with the speed and flight direction of the unmanned aerial vehicle, evaluating the minimum safety distance of the obstacle, and outputting the safety coefficient of path planning. In the present invention, through the dynamic comparison of multiple parameters such as flight altitude, obstacle position, speed, and direction, the flexibility of path adjustment and the accuracy of obstacle avoidance are improved. The dynamic distribution of flight images and status information is combined with the position parameters of perspective switching to achieve efficient allocation of multiple devices. The real-time environmental data processing is combined with image frame feature extraction and regional division scheduling to optimize the priority distribution of navigation data. The information synchronization is optimized through path overlap parameters and communication delay, improving the multi-aircraft cooperation efficiency and the reliability of task execution.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of multi-screen display, and in particular to a method and system for controlling multi-screen display images of an unmanned aerial vehicle (UAV). Background Art

[0002] The technical field of multi-screen display involves methods and systems for using multiple display units to provide visual output, which are widely applied in various devices and scenarios, including computer workstations, advertising screens, aviation control centers, and UAV control systems, etc. Multi-screen display can enhance information processing capabilities and the interactivity of the user interface. By presenting data or images from multiple perspectives, it effectively improves the user's operation experience and decision-making efficiency. In UAV applications, multi-screen display enables operators to simultaneously monitor the flight status, environmental information, and other key mission indicators of the UAV, supporting the execution of complex tasks such as search and rescue, geographical mapping, and environmental monitoring.

[0003] Among them, the method for controlling multi-screen display images of an unmanned aerial vehicle is a solution for managing and controlling the image output of the UAV on multiple display interfaces, which involves hardware design such as the layout and interfaces of the display screens, as well as software aspects such as image processing algorithms and the development of user interaction interfaces. Its main purpose is to improve the visibility and flexibility of UAV operations, enabling operators to more effectively monitor and control multiple tasks of the UAV. Especially when precise operations are required or tasks are executed in visually complex environments, it increases the safety and efficiency of UAV tasks, and is particularly valuable in emergency response and precision operation scenarios.

[0004] The existing technology has a weak ability to comprehensively compare multiple parameters in path planning, and it is difficult to quickly complete path adjustment in a dynamic and complex environment, resulting in a reduced reliability of obstacle avoidance. The lack of a dynamic distribution mechanism for multi-screen information display leads to insufficient content coordination between display screens, and the problem of discontinuous information display significantly increases the complexity of task operations. The insufficient power consumption management of display devices limits the endurance ability. The single strategy for refresh rate and brightness adjustment cannot adapt to task scenario changes, and the energy utilization efficiency is low. The limitation of environmental data processing ability results in poor display effects of real-time navigation data in complex scenarios. The lack of refinement in priority scheduling makes it difficult to meet the rapid response requirements of multiple tasks. The monitoring mechanism for multi-aircraft cooperation lags behind in optimizing path overlap parameters and information synchronization, and the efficiency of collaborative task execution is low, resulting in frequent problems such as extended task completion time and unstable execution results. Summary of the Invention

[0005] The purpose of the present invention is to solve the disadvantages existing in the prior art, and to propose a method and system for controlling multi-screen display images of an unmanned aerial vehicle.

[0006] To achieve the above object, the present invention adopts the following technical solutions: A method for controlling multi-screen display images of an unmanned aerial vehicle, comprising the following steps:

[0007] S1: According to the flight path planning data of the unmanned aerial vehicle and real-time obstacle information, compare the flight altitude with the obstacle position parameters, perform path segmentation calculation of adjacent areas in combination with the speed and flight direction of the unmanned aerial vehicle, evaluate the minimum safety distance of the obstacle, and output the path planning safety factor;

[0008] S2: Based on the path planning safety factor, allocate the flight image data displayed by the VR headset and the flight status information of the remote controller with a screen, perform dynamic distribution matching on the flight direction, speed, and perspective switching position parameters, synchronously map the flight images to different display devices, and generate a multi-screen display mapping matrix;

[0009] S3: Based on the multi-screen display mapping matrix, obtain the remaining battery levels of the VR headset and the remote controller with a screen, calculate the adjustment range of the refresh rate of each display screen, perform hierarchical processing on the screen brightness and image resolution, perform associated control of the display frequency and power output, and generate display dynamic frequency division adjustment parameters;

[0010] S4: Based on the display dynamic frequency division adjustment parameters, perform real-time processing on the environmental data collected during the flight of the unmanned aerial vehicle, extract the key feature values of the image frame sequence, perform environmental navigation data display scheduling in combination with the flight area division, and generate task information priority distribution parameters;

[0011] S5: Based on the task information priority distribution parameters, compare the monitoring parameters in the overlapping interval of the flight path with the task distribution parameters, and perform monitoring screen allocation for multi-aircraft collaborative tasks in combination with the communication delay and data synchronization rate of the unmanned aerial vehicle, and generate a multi-aircraft collaborative monitoring allocation plan.

[0012] As a further solution of the present invention, the path planning safety factor includes an obstacle safety distance threshold, a flight path segmentation coefficient, and an adjacent area path connection coefficient. The multi-screen display mapping matrix includes flight image allocation parameters, perspective switching matching parameters, and device display synchronization parameters. The display dynamic frequency division adjustment parameters include the adjustment range of the screen refresh rate, the screen brightness hierarchical parameters, and the image resolution hierarchical parameters. The task information priority distribution parameters include the feature value distribution parameters of the image frame sequence, the flight area division priority parameters, and the environmental navigation scheduling parameters. The multi-aircraft collaborative monitoring allocation plan includes the monitoring parameters in the overlapping interval of the flight path, the communication delay allocation parameters, and the data synchronization rate distribution parameters.

[0013] As a further solution of the present invention, according to the UAV flight path planning data and real-time obstacle information, the flight altitude is compared with the obstacle position parameters, and the path segmentation calculation of adjacent areas is carried out in combination with the UAV speed and flight direction. The specific steps for evaluating the minimum safety distance of obstacles and outputting the safety factor of path planning are as follows:

[0014] S111: Based on the UAV flight path planning data, extract the flight path altitude parameter, analyze the real-time obstacle information and identify the position parameter. By comparing the spatial range relationship between the flight altitude parameter and the obstacle position parameter, judge the obstacle interference area and generate the comparison result of flight altitude and obstacle position;

[0015] S112: Based on the comparison result of flight altitude and obstacle position, call the UAV speed parameter to calculate the displacement range within a unit time, and combine the flight direction parameter to judge the path change trend of adjacent areas, and segmentally calculate the adjustment range of each area of the flight path to generate the matching result of path segmentation and dynamic parameters;

[0016] S113: Based on the matching result of path segmentation and dynamic parameters, combine the segmented path information of adjacent areas to evaluate the minimum safety distance of obstacles, match the altitude parameter of the flight path with the obstacle safety range, measure the comprehensive safety factor of each section of the path, and output the safety factor of path planning.

[0017] As a further solution of the present invention, based on the safety factor of path planning, distribute the flight picture data displayed on the VR headset and the flight status information of the screen-equipped remote controller, perform dynamic distribution matching on the flight direction, speed and perspective switching position parameters, and synchronously map the flight picture to different display devices. The specific steps for generating the multi-screen display mapping matrix are as follows:

[0018] S211: Based on the safety factor of path planning, obtain the flight picture data corresponding to the path, segmentally call the speed change and direction change parameters in the flight path, match the distribution parameters of the display range of the VR headset, and distribute the picture data to the display device by region to generate the picture distribution result of the VR headset;

[0019] S212: Based on the picture distribution result of the VR headset, extract the display parameters of the screen-equipped remote controller, call the real-time flight direction and speed parameters in the flight status information, and map the flight status information to the remote controller display screen according to the parameter distribution of the display status compared by region to generate the flight status mapping result of the screen-equipped remote controller;

[0020] S213: Based on the flight status mapping result of the screen-equipped remote controller, extract the synchronization parameters of the VR headset picture and the remote controller display information, match the perspective switching position parameters and the real-time path display area, and integrate the flight path picture data and the display device distribution parameters to output the multi-screen display mapping matrix.

[0021] As a further solution of the present invention, based on the multi-screen display mapping matrix, obtain the remaining battery power values of the VR headset and the screen-equipped remote controller, calculate the adjustment amplitude of the refresh rate of each display screen, perform hierarchical processing on the screen brightness and image resolution, and perform associated control of the display frequency and power output. The specific steps for generating the display dynamic frequency division adjustment parameters are as follows:

[0022] S311: Based on the multi-screen display mapping matrix, collect the real-time remaining battery power value parameters of the VR headset and the screen-equipped remote controller, synchronously extract the current refresh rate, analyze the correlation between the power status of each device and the refresh rate, calculate the display refresh rate adjustment value, and generate the display refresh rate adjustment result;

[0023] S312: Based on the display refresh rate adjustment result, extract the screen brightness and image resolution parameters of the device, hierarchically calculate the power consumption corresponding to the brightness level and resolution, match the remaining battery power with the hierarchical brightness and resolution relationship, and generate the display brightness and resolution hierarchical result;

[0024] S313: Based on the display brightness and resolution hierarchical result, extract the dynamic adjustment ranges of the display frequency parameter and the power output parameter, calculate the power output demand according to the refresh rate distribution, and associate the matching rule of the frequency change and the power output to generate the display dynamic frequency division adjustment parameter.

[0025] As a further solution of the present invention, the display refresh rate adjustment value is calculated according to the formula:

[0026] ;

[0027] where, represents the real-time remaining battery power value of the VR headset, in percentage, reflecting the current available power of the device, represents the real-time remaining battery power value of the screen-equipped remote controller, in percentage, reflecting the current available power of the device, represents the current refresh rate of the VR headset, in Hz, reflecting the running refresh rate status of the device, represents the current refresh rate of the screen-equipped remote controller, in Hz, reflecting the running refresh rate status of the device, represents the final display refresh rate adjustment value, in Hz, used to optimize the unified refresh rate of the display screen.

[0028] As a further solution of the present invention, based on the display dynamic frequency division adjustment parameter, perform real-time processing on the environmental data collected during the flight of the drone, extract the key feature values of the image frame sequence, combine the flight area division to perform environmental navigation data display scheduling, and the specific steps for generating the task information priority distribution parameter are as follows:

[0029] S411: Based on the display dynamic frequency division adjustment parameters, analyze the environmental data collected during the flight of the drone, extract the color distribution, edge intensity, and motion trajectory information in the image sequence frame by frame. By matching the dynamic change characteristics of each frame of data, screen the key feature values, and generate the image frame feature extraction result;

[0030] S412: Based on the image frame feature extraction result, match the flight area division information, call the spatial distribution parameters related to the regional coordinates and dynamic features in the environmental data, integrate the environmental feature data by flight area segments, analyze the feature differences and dynamic relationships between regions, and generate the environmental navigation data distribution result;

[0031] S413: Based on the environmental navigation data distribution result, extract the environmental change parameters and the dynamic values of image features in the flight path, prioritize the task data according to the feature importance, map the task priority to the scheduling range of the display device, and generate the task information priority distribution parameters.

[0032] As a further solution of the present invention, based on the task information priority distribution parameters, compare the monitoring parameters in the overlapping intervals of the flight path with the task distribution parameters, and combine the communication delay and data synchronization rate of the drone to allocate the monitoring screens for the multi - drone collaborative tasks. The specific steps for generating the multi - drone collaborative monitoring allocation plan are as follows:

[0033] S511: Based on the task information priority distribution parameters, extract the monitoring parameters in the overlapping intervals of the flight path, segmentally call the regional priority data in the task distribution parameters, analyze the regional matching degree between the monitoring parameters and the task distribution, obtain the corresponding relationship of the tasks in the overlapping intervals, and generate the monitoring comparison result for the path overlapping intervals;

[0034] S512: Based on the monitoring comparison result for the path overlapping intervals, collect the communication delay parameters and data synchronization rate parameters between the drones, calculate the influence amplitude of the delay on the task handover, dynamically adjust the distribution priority of the communication tasks, and generate the multi - drone communication and synchronization matching result;

[0035] S513: Based on the multi - drone communication and synchronization matching result, extract the screen distribution parameters for the multi - drone collaborative monitoring, match the monitoring screen task priority with the overlapping tasks in the flight path area, allocate the monitoring tasks to the display areas of each device, and adjust the display screen distribution order to generate the multi - drone collaborative monitoring allocation plan.

[0036] As a further solution of the present invention, the influence amplitude of the delay on the task handover is calculated according to the formula

[0037] ;

[0038] where, Indicates the influence amplitude value, Indicates the communication delay between drones, in milliseconds, and is collected in real time by the communication protocol delay monitoring module. Indicates the time required for data synchronization between drones, in milliseconds, and is calculated from the transmission time of synchronization data packets. Indicates the data synchronization rate, in percentage, and is calculated by monitoring the ratio of successfully synchronized data packets to the total transmitted data packets. Indicates the transmission rate of the communication link, in Mbps, and is obtained through the rate detection of the real-time communication module. Indicates the length of the path overlap interval, in meters, and is obtained through geometric calculations of the flight route planning data.

[0039] A multi-screen display control system for drones, comprising:

[0040] The path planning analysis module analyzes real-time obstacle information and identifies position parameters based on the drone flight path planning data, determines the obstacle interference area, judges the path change trend in adjacent areas in combination with the flight direction parameters, matches the height parameters of the flight path with the safe range of obstacles, and outputs the path planning safety factor;

[0041] The multi-screen mapping module segmentally calls the speed change and direction change parameters in the flight path based on the path planning safety factor, compares the parameter distribution of the display status by region, matches the perspective switching position parameters and the real-time path display area, integrates the flight path picture data and the display device distribution parameters, and outputs the multi-screen display mapping matrix;

[0042] The refresh rate adjustment module analyzes the correlation between the power status of each device and the refresh rate based on the multi-screen display mapping matrix, calculates the display refresh rate adjustment value, matches the remaining power value with the hierarchical brightness and resolution relationship, calculates the power output demand according to the refresh rate distribution, associates the matching rule of frequency change and power output, and generates the display dynamic frequency division adjustment parameters;

[0043] The task priority sorting module analyzes the environmental data collected during the drone flight based on the display dynamic frequency division adjustment parameters, matches the dynamic change characteristics of each frame of data, screens the key characteristic values, analyzes the characteristic differences and dynamic relationships between regions, prioritizes the task data according to the characteristic importance, maps the task priority to the scheduling range of the display device, and generates the task information priority distribution parameters;

[0044] Based on the task information priority distribution parameter, the task distribution optimization module analyzes the matching degree between the monitoring parameters and the task distribution area, obtains the corresponding relationship of tasks in the overlapping interval, calculates the influence degree of delay on task handover, dynamically adjusts the distribution priority of communication tasks, allocates monitoring tasks to the display areas of each device, adjusts the distribution order of display screens, and generates a multi-machine collaborative monitoring allocation plan.

[0045] Compared with the prior art, the advantages and positive effects of the present invention are as follows:

[0046] In the present invention, through the dynamic comparison of multiple parameters such as flight altitude, obstacle position, speed, and direction, the flexibility of path adjustment and the accuracy of obstacle avoidance are improved. The dynamic distribution of flight images and status information combined with the perspective switching position parameters realizes efficient allocation of multiple devices. The real-time environmental data processing combined with image frame feature extraction and regional division scheduling optimizes the priority distribution of navigation data. Through path overlap parameters and communication delay, information synchronization is optimized, and the multi-machine cooperation efficiency and task execution reliability are improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 It is a schematic diagram of the step flow of the present invention;

[0048] Figure 2 It is a flowchart of step S1 of the present invention;

[0049] Figure 3 It is a flowchart of step S2 of the present invention;

[0050] Figure 4 It is a flowchart of step S3 of the present invention;

[0051] Figure 5 It is a flowchart of step S4 of the present invention;

[0052] Figure 6 It is a flowchart of step S5 of the present invention;

[0053] Figure 7 It is a system module diagram of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0054] In order to make the objectives, technical solutions, and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0055] In the description of the present invention, it should be understood that the orientation or positional relationship indicated by terms such as "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as a limitation to the present invention. In addition, in the description of the present invention, the meaning of "a plurality of" is two or more, unless otherwise specifically defined.

[0056] Please refer to Figure 1 , a method for implementing multi-screen display screen control of an unmanned aerial vehicle, comprising the following steps:

[0057] S1: According to the unmanned aerial vehicle flight path planning data and real-time obstacle information, compare the flight altitude with the obstacle position parameters, perform path segmentation calculation of adjacent areas in combination with the unmanned aerial vehicle speed and flight direction, evaluate the minimum safety distance of the obstacle, and output the path planning safety factor;

[0058] S2: Based on the path planning safety factor, allocate the flight screen data displayed on the VR headset and the flight status information of the screen-equipped remote controller, perform dynamic distribution matching on the flight direction, speed, and perspective switching position parameters, synchronously map the flight screen to different display devices, and generate a multi-screen display mapping matrix;

[0059] S3: Based on the multi-screen display mapping matrix, obtain the remaining battery power values of the VR headset and the screen-equipped remote controller, calculate the refresh rate adjustment amplitude of each display screen, perform hierarchical processing on the screen brightness and image resolution, perform associated control of the display frequency and power output, and generate display dynamic frequency division adjustment parameters;

[0060] S4: Based on the display dynamic frequency division adjustment parameters, perform real-time processing on the environmental data collected during the flight of the unmanned aerial vehicle, extract the key feature values of the image frame sequence, combine the flight area division to perform display scheduling of the environmental navigation data, and generate task information priority distribution parameters;

[0061] S5: Based on the task information priority distribution parameters, compare the monitoring parameters in the overlapping interval of the flight path with the task distribution parameters, combine the communication delay and data synchronization rate between unmanned aerial vehicles, perform monitoring screen allocation for multi-aircraft collaborative tasks, and generate a multi-aircraft collaborative monitoring allocation scheme.

[0062] The path planning safety factor includes the obstacle safety distance threshold, the flight path segmentation factor, and the adjacent area path connection factor. The multi-screen display mapping matrix includes the flight screen allocation parameter, the viewing angle switching matching parameter, and the device display synchronization parameter. The display dynamic frequency division adjustment parameter includes the screen refresh rate adjustment range, the screen brightness grading parameter, and the image resolution grading parameter. The task information priority distribution parameter includes the image frame sequence eigenvalue distribution parameter, the flight area division priority parameter, and the environmental navigation scheduling parameter. The multi-aircraft collaborative monitoring allocation scheme includes the path overlap interval monitoring parameter, the communication delay allocation parameter, and the data synchronization rate distribution parameter.

[0063] Please refer to Figure 2 , and the specific steps of S1 are as follows:

[0064] S111: Based on the UAV flight path planning data, extract the flight path height parameter, analyze the real-time obstacle information and identify the position parameter. By comparing the spatial range relationship between the flight height parameter and the obstacle position parameter, judge the obstacle interference area and generate the comparison result of the flight height and the obstacle position.

[0065] Based on the UAV flight path planning data, first, the height information of the flight path is recorded in real time through the height sensor installed on the UAV. These data are segmented according to the time axis. The height parameter at each time point is compared with the standard flight height in the path planning. The flight height interval on the path is obtained through the method of segmented statistics. Then, environmental detection devices such as laser rangefinders and cameras are used to scan the surrounding obstacles in real time. The position information of the obstacles is recorded in the form of three-dimensional coordinates, including the distance, angle, and height of the obstacles. The recorded three-dimensional position information is compared with the flight height data of the UAV to calculate the interference area range in the flight path. The interference area is determined by judging whether the area where the UAV flight height is located is covered by the height, width, and depth range of the obstacles. Finally, the comparison results are recorded, including the coordinate range of all affected areas in the flight path, the interference degree and other information, as the basic data for flight path adjustment.

[0066] S112: Based on the comparison result of the flight height and the obstacle position, call the UAV speed parameter to calculate the displacement range per unit time, and combine the flight direction parameter to judge the change trend of the adjacent area path. Segmentally calculate the adjustment range of each area of the flight path and generate the matching result of the path segment and the dynamic parameter.

[0067] Based on the comparison result of the flight altitude and the obstacle position, further analyze the possibility of dynamic adjustment of the path. First, segment and organize the obstacle areas in the comparison result, combine the obstacle position information with the current speed and flight direction of the UAV, use the speed sensor of the UAV to record the speed data every second, calculate the displacement range within a unit time through the time interval, and then analyze the change trend of the path based on the flight direction. Each path segment will judge its adjustable space range according to the flight altitude and displacement range. Specifically, through the detection of the real-time displacement range, calculate the possible deviation angle and height change value of the path segment, and at the same time record the overlapping situation between the adjusted area of the path and the obstacle, and successively determine the feasibility of adjusting each segmented path, record the direction, amplitude and spatial position of the path adjustment, save all the adjusted area data one by one, and generate a detailed record of the matching of each segmented path with the dynamic adjustment parameters for subsequent comprehensive analysis and path optimization.

[0068] S113: Based on the result of path segmentation and dynamic parameter matching, combine the segmented path information of adjacent areas to evaluate the minimum safety distance of obstacles, match the height parameter of the flight path with the safety range of obstacles, calculate the comprehensive safety factor of each segment of the path, and output the safety factor of path planning;

[0069] Based on the result of path segmentation and dynamic parameter matching, start a detailed evaluation of the minimum safety distance of obstacles. During the evaluation process, it is necessary to use the real-time measured data to calculate the shortest distance from each obstacle to the UAV path. The calculation method analyzes the spatial distance between the three-dimensional position coordinates of the obstacle and the current position of the UAV in the path through the spatial geometry formula, and compares the distance value with the safety threshold. At the same time, measure the size of the obstacle, combine the width, height and depth data of the obstacle with the flight path of the UAV, calculate the maximum range that the UAV may touch the obstacle, record the shortest distance from each segmented path to the obstacle, and check whether it meets the safety range. Finally, combine and analyze the segmented path and the safety factor, complete the global safety evaluation of the path planning by comprehensively evaluating the overall safety of the path, and record the risk level of each segment of the path to guide the subsequent adjustment and optimization of the flight path planning.

[0070] Please refer to Figure 3 , the specific steps of S2 are as follows:

[0071] S211: Based on the safety factor of path planning, obtain the flight picture data corresponding to the path, segmentally call the speed change and direction change parameters in the flight path, match the distribution parameters of the display range of the VR headset, and allocate the picture data to the display device by region to generate the VR headset picture allocation result;

[0072] Based on the safety factor of path planning, obtain the frame data corresponding to the flight path. First, correspond the safety factor of path planning to the flight path segments. After the safety factor value of each segment is extracted from the path planning data, it is marked on the corresponding flight path. At the same time, the real-time camera device during the flight of the UAV collects frame data, which is cut and sorted according to the path segments. Each segment of frame data is associated and stored with the height and safety factor information of the path. Then, perform display adaptation on the flight frame data, measure the frame resolution and the display range of the VR headset, determine the specific proportion in which the frame data can be correctly distributed in the display device, crop or expand each segment of frame data to the resolution and range that conform to the display area in turn, and adjust the display priority and distribution area of the frame according to the real-time parameters of flight speed change and direction change to ensure the dynamics and accuracy of the display. Finally, generate the allocation result of the flight path frame in the VR headset.

[0073] S212: Based on the frame allocation result of the VR headset, extract the display parameters of the remote controller with a screen, call the real-time flight direction and speed parameters in the flight status information, compare the parameter distribution of the display status by region, and map the flight status information to the display screen of the remote controller to generate the flight status mapping result of the remote controller with a screen;

[0074] Based on the frame allocation result of the VR headset, extract the display parameters of the remote controller with a screen, including physical characteristics such as the size, resolution, and refresh rate of the remote controller screen. At the same time, obtain the real-time flight speed and direction information from the flight status data, sort out the data of each path segment in turn, associate the display parameters of the remote controller with the flight status data, calculate the display content distribution in each area by measuring the range of flight status information (such as speed change range, direction angle change range, etc.), map the flight speed and direction data to different positions in proportion within the display area of the screen, adjust the mapping ratio so that the information can completely cover the screen display range, and finely adjust the text and graphic ratio of the display content to ensure its clear presentation on the display screen of the remote controller. Finally, generate the flight status mapping result of the remote controller with a screen and record the flight status display content corresponding to each segmented path.

[0075] S213: Based on the flight status mapping result of the remote controller with a screen, extract the synchronization parameters of the VR headset frame and the remote controller display information, match the perspective switching position parameters and the real-time path display area, integrate the flight path frame data and the display device distribution parameters, and output the multi-screen display mapping matrix;

[0076] Based on the flight status mapping results of the remote control with a screen, further extract the synchronization data between the VR headset screen and the display information of the remote control, analyze the time synchronization relationship of the display content between the two devices, compare and sort the flight path screen data and the area parameters involved in the display information respectively, determine the adjustment range of each section of the path screen during the perspective change by reading the perspective switching parameters, and divide different screen content distribution areas according to the real-time flight path display area during perspective switching. Compare the display area of the VR headset with the size and resolution of the remote control display screen, measure the display coverage of different display devices, and integrate the screen data of the flight path according to the device distribution parameters in turn to generate a screen distribution matrix that can be simultaneously displayed on multiple display devices, ensuring that the two display devices can maintain consistency in the display content, and finally output a multi-screen display mapping matrix for realizing the requirement of synchronous display.

[0077] Please refer to Figure 4 , the specific steps of S3 are as follows:

[0078] S311: Based on the multi-screen display mapping matrix, collect the real-time remaining battery power parameters of the VR headset and the remote control with a screen, synchronously extract the current refresh rate, analyze the correlation between the power status and the refresh rate of each device, calculate the display refresh rate adjustment value, and generate the display refresh rate adjustment result;

[0079] The display refresh rate adjustment value is calculated according to the formula:

[0080] ;

[0081] Perform the calculation, where represents the real-time remaining battery power of the VR headset, in percentage, reflecting the current available power of the device, represents the real-time remaining battery power of the remote control with a screen, in percentage, reflecting the current available power of the device, represents the current refresh rate of the VR headset, in Hz, reflecting the running refresh rate status of the device, represents the current refresh rate of the remote control with a screen, in Hz, reflecting the running refresh rate status of the device, represents the final display refresh rate adjustment value, in Hz, used to optimize the unified refresh rate of the display screen.

[0082] represents the real-time remaining battery power of the VR headset, in percentage. By monitoring the real-time battery parameters of the VR headset, its remaining battery power is obtained, and its current power is detected as 76% through the device power management module.

[0083] Indicates the remaining real-time power of the remote control with a screen, in percentage. By monitoring the remote control's battery management system, the current power is obtained as 54%.

[0084] Indicates the current refresh rate of the VR headset, in Hz. By obtaining real-time refresh rate data through the display refresh rate detection system of the VR device, the current refresh rate is obtained as 90 Hz.

[0085] Indicates the current refresh rate of the remote control with a screen, in Hz. By obtaining its refresh rate data through the display refresh rate monitoring module of the remote control, the current refresh rate is obtained as 60 Hz.

[0086] Substitute the known parameters into the formula:

[0087] ;

[0088] Calculate the square of the difference between the power and the refresh rate:

[0089] ;

[0090] ;

[0091] Substitute the squared difference into the formula:

[0092] ;

[0093] Calculate the sum and average of the squared differences:

[0094] ;

[0095] ;

[0096] Calculate the square root:

[0097] ;

[0098] The results show that the adjusted display refresh rate should be 10.77 Hz. Since this value represents the balanced adjustment result between the device power and the refresh rate, this value should be used as a reference to coordinate the display refresh rate adjustment of the VR headset and the remote control with a screen. The calculation results show that by synchronizing the differences in device power and refresh rate, the refresh rate matching state of multiple devices can be effectively optimized, thus achieving a smoother multi-screen display experience.

[0099] S312: Based on the display refresh rate adjustment result, extract the device screen brightness and image resolution parameters, calculate the power consumption corresponding to the brightness level and resolution in grades, match the remaining power value with the graded brightness and resolution relationship, and generate the display brightness and resolution grading result;

[0100] Based on the display refresh rate adjustment results, further extract the screen brightness and image resolution parameters of the device. Divide the brightness data of the device into several levels according to the actual measured values, such as the lowest brightness, medium brightness, and highest brightness, etc. At the same time, classify the image resolution of the device according to different display modes, such as low resolution, medium resolution, and high definition resolution. Then, adjust the combination of brightness and resolution one by one, and measure the power consumption of the device under each combination. The specific steps include fixing the screen brightness at a certain level, measuring the power consumption reduction rates of low, medium, and high resolutions in sequence, and recording the power consumption values corresponding to the brightness and resolution combinations. After that, associate each power state in the refresh rate adjustment results with the combination of brightness and resolution, generate a relationship table of the remaining power value with brightness and resolution, analyze the recommended brightness and resolution combinations under different power states, and finally generate the classification results of the display brightness and resolution and organize them into a clear matching relationship.

[0101] S313: Based on the classification results of the display brightness and resolution, extract the dynamic adjustment ranges of the display frequency parameter and the power output parameter, calculate the power output requirements according to the refresh rate distribution, associate the matching rules of the frequency change and the power output, and generate the display dynamic frequency division adjustment parameters;

[0102] Based on the classification results of the display brightness and resolution, extract the dynamic adjustment frequency range of the device display screen, which is divided into a low-frequency range, a medium-frequency range, and a high-frequency range, and record the time interval and display conditions corresponding to the frequency change. At the same time, extract the actual measured values of the power output parameters, and divide the dynamic association of the power output and the frequency range into multiple intervals, such as the low-frequency range corresponding to a lower power output, the medium-frequency range corresponding to a medium power output, etc. The specific operations include: for different frequency ranges, measure the instantaneous value of the device power output, calculate the matching rules of the power change range and the frequency change range, and organize these rules into dynamic adjustment suggestions corresponding to the power and frequency. Combining the current display conditions of the device, calculate the power output amount required for the current display according to the refresh rate distribution, record the display dynamic frequency division adjustment suggestions of the device as a parameter table, clarify the power output requirements and adjustment ranges of each frequency range, complete the generation of the display dynamic frequency division adjustment parameters and synchronize them to the relevant records.

[0103] Please refer to Figure 5 , the specific steps of S4 are as follows:

[0104] S411: Based on the display dynamic frequency division adjustment parameters, analyze the environmental data collected during the flight of the drone, extract the color distribution, edge intensity, and motion trajectory information in the image sequence frame by frame, screen the key feature values by matching the dynamic change characteristics of each frame of data, and generate the image frame feature extraction results;

[0105] Based on the display dynamic frequency division adjustment parameters, first analyze the environmental data collected in real time during the flight of the drone, and extract the image sequence in the flight video frame by frame into image files. Analyze each frame of the image, gradually decompose it into pixel units, and by analyzing the pixel color values, statistically calculate the distribution ratio of different colors in the image and mark the coverage range of the main colors. Next, use the image processing device to detect the edge intensity information in the frame, calculate the change amount of the pixel brightness gradient point by point, identify the areas with obvious edges in the image, and record the intensity values and position coordinates of these areas. At the same time, analyze the movement trajectory of the objects in the picture according to the continuous changes between frames, extract the starting point, direction and displacement of the movement trajectory, save the information of color distribution, edge intensity and movement trajectory respectively and compare them, screen out the frames with obvious change amplitude or characteristic significance, mark them as key frames, and record the characteristic values of each frame in detail, and finally generate the image frame feature extraction result.

[0106] S412: Based on the image frame feature extraction result, match the flight area division information, call the spatial distribution parameters associated with the regional coordinates and dynamic features in the environmental data, integrate the environmental feature data by flight area segments, analyze the feature differences and dynamic relationships between regions, and generate the environmental navigation data distribution result;

[0107] Based on the image frame feature extraction result, associate the extracted color distribution, edge intensity and movement trajectory data with the division information of the flight area. First, analyze the spatial coordinate range of the flight area, divide the drone flight path by area, and mark each area in three-dimensional space. Then, classify the feature data of each frame by area, and match the characteristic values corresponding to the image frame with the regional coordinates according to the spatial position where the object appears in the image. By comparing the distribution of characteristic values in different regions, gradually analyze the differences in color, edge and movement trajectory of each region, record the change amplitude and change direction of the features between regions, and at the same time calculate the correlation degree between regions according to the dynamic change characteristics of the characteristic values, and summarize the dynamic relationships between regions. Finally, integrate the environmental feature data of all flight areas, generate the environmental navigation data distribution result including dynamic feature association and regional feature differences, and record the detailed description of the features of each region.

[0108] S413: Based on the environmental navigation data distribution result, extract the environmental change parameters and the dynamic values of image features in the flight path, sort the task data according to the feature importance, map the task priority to the scheduling range of the display device, and generate the task information priority distribution parameter;

[0109] Based on the environmental navigation data distribution results, extract the environmental change parameters and dynamic values of image features recorded in the flight path. Organize the environmental parameters and image feature values into a list and sort them according to their change amplitudes and occurrence frequencies. First, extract the dynamic change data of each region in the flight path, analyze item by item the color distribution, edge intensity, and motion trajectory parameters of each region, calculate the change amount and fluctuation amplitude of the parameters at different times, and mark the parameters with larger changes as high-priority. Subsequently, according to the priority sorting results, combined with the real-time requirements of the UAV flight mission, map the task priorities to the scheduling range of the display device. Corresponding the high-priority task data to the main display device or the main display range, and allocate the medium- and low-priority tasks to the secondary display areas. At the same time, record the priority level of each task data and the display device allocation results, and finally generate the task information priority distribution parameters and sort out the detailed task scheduling range records.

[0110] Please refer to Figure 6 , and the specific steps of S5 are as follows:

[0111] S511: Based on the task information priority distribution parameters, extract the monitoring parameters in the overlapping intervals of the flight path, segmentally call the regional priority data in the task distribution parameters, analyze the regional matching degree between the monitoring parameters and the task distribution, obtain the corresponding relationship of tasks in the overlapping intervals, and generate the monitoring comparison result of the path overlapping intervals;

[0112] Based on the task information priority distribution parameters, first analyze the specific data with overlapping intervals in the UAV flight path. Mark the path segment by segment according to time periods and spatial positions, and make detailed marks on the start time, end time, and corresponding spatial range of each overlapping interval. At the same time, extract the monitoring parameters in the overlapping area, and these parameters include flight altitude, speed, direction change, and real-time environmental characteristics in the task area, such as temperature, humidity, and light intensity. Then, read the regional priority of each task from the task information priority distribution parameters, compare the monitoring parameters in the overlapping intervals with the task priority data one by one, score each task according to the matching degree. The specific process is to record the degree of fit between the change range of the monitoring parameters in the overlapping area and the task requirements, calculate the matching level of each task in different regions, and generate a priority ranking list of the task areas according to these matching levels. Finally, summarize the corresponding relationship of tasks in the overlapping intervals to form the monitoring comparison result of the path overlapping intervals.

[0113] S512: Based on the monitoring comparison result of the path overlapping intervals, collect the communication delay parameters and data synchronization rate parameters between the UAVs, calculate the influence amplitude of the delay on the task handover, dynamically adjust the distribution priority of the communication tasks, and generate the multi-UAV communication and synchronization matching result;

[0114] The influence amplitude of the delay on the task handover, according to the formula

[0115] ;

[0116] Perform calculations, where represents the influence amplitude value, represents the communication delay between drones, in milliseconds, and is collected in real time by the communication protocol delay monitoring module. represents the time required for data synchronization between drones, in milliseconds, and is calculated from the transmission time of the synchronization data packet. represents the data synchronization rate, in percentage, and is calculated by monitoring the ratio of successfully synchronized data packets to the total transmitted data packets. represents the transmission rate of the communication link, in Mbps, and is obtained through the rate detection of the real-time communication module. represents the length of the path overlap interval, in meters, and is obtained through geometric calculations of the flight route planning data.

[0117] The value is obtained by monitoring the communication protocol delay between drones. For example, the measured communication delay in the test environment is 40 milliseconds.

[0118] The value is obtained by calculating the time required for drones to complete data synchronization. For example, the time taken to monitor the synchronization data packet is 25 milliseconds.

[0119] The value is obtained by counting the number of successfully synchronized data packets in the total transmitted data packets. For example, if 450 out of 500 transmitted data packets are successfully synchronized, the calculated synchronization rate is .

[0120] The value is obtained by real-time detecting the transmission rate of the communication link. For example, the current rate is 10 Mbps.

[0121] The value is obtained by geometrically calculating the length of the path overlap interval. For example, the calculated path overlap length is 500 meters through the flight route data.

[0122] Substitute specific parameters:

[0123] ;

[0124] Calculate the absolute value of the difference between the communication delay and the synchronization time:

[0125] ;

[0126] Calculate the square root of the product of the data synchronization rate and the communication rate:

[0127] ;

[0128] Calculate the sum of the numerators:

[0129] ;

[0130] Calculate the final result:

[0131] ;

[0132] The calculation result of the impact amplitude of task handover is 0.09, indicating the actual impact degree of communication delay on task handover. The lower impact amplitude value indicates that the current communication and data synchronization efficiency is relatively high. The dynamic communication synchronization optimization algorithm can further adjust the task priorities to improve the overall task collaboration efficiency.

[0133] S513: Based on the multi-machine communication and synchronization matching results, extract the screen distribution parameters of multi-machine collaborative monitoring, match the overlapping tasks of the monitoring screen task priorities and the flight path areas, allocate the monitoring tasks to the display areas of each device, adjust the display screen distribution order, and generate a multi-machine collaborative monitoring allocation plan;

[0134] Based on the multi-machine communication and synchronization matching results, further extract the distribution parameters of the multi-machine collaborative monitoring screen. Mark each part of the monitoring screen as areas with high, medium, and low task priorities, and conduct a detailed classification of the display content in each area. First, extract the overlapping tasks in the flight path, match the areas where the screen is displayed according to the priorities, and measure the display ratio of each monitoring screen on the screen. According to the task priorities, the monitoring screens of high-priority tasks are arranged in the main display area to ensure that the UAV operator can observe the real-time information of important tasks first. At the same time, measure the distribution order of each monitoring screen on different display screens, adjust the display order of the medium- and low-priority task screens so that they are arranged in sequence without affecting the high-priority monitoring screens, record the corresponding relationship between the distribution order of all monitoring screens and the task display areas, and finally generate a multi-machine collaborative monitoring allocation plan to clarify the display areas of each device and the allocated content of the task screens.

[0135] Please refer to Figure 7 , a multi-screen display control system for realizing UAVs, including:

[0136] Based on the UAV flight path planning data, the path planning analysis module analyzes the real-time obstacle information and identifies the position parameters, judges the obstacle interference area, combines the flight direction parameters to judge the path change trend of adjacent areas, matches the height parameter of the flight path with the safe range of obstacles, and outputs the path planning safety factor;

[0137] The multi-screen mapping module calls the speed change and direction change parameters in the flight path in segments based on the path planning safety factor, compares the parameter distribution of the display status by region, matches the perspective switching position parameters and the real-time path display area, integrates the flight path picture data and the display device distribution parameters, and outputs a multi-screen display mapping matrix;

[0138] The refresh rate adjustment module analyzes the correlation between the power status of each device and the refresh rate based on the multi-screen display mapping matrix, calculates the display refresh rate adjustment value, matches the remaining power value with the hierarchical brightness and resolution relationship, calculates the power output requirement according to the refresh rate distribution, associates the matching rule of frequency change and power output, and generates display dynamic frequency division adjustment parameters;

[0139] The task priority sorting module analyzes the environmental data collected during the UAV flight based on the display dynamic frequency division adjustment parameters, matches the dynamic change characteristics of each frame of data, screens the key characteristic values, analyzes the characteristic differences and dynamic relationships between regions, sorts the task data according to the importance of the characteristics, maps the task priority to the scheduling range of the display device, and generates task information priority distribution parameters;

[0140] The task distribution optimization module analyzes the regional matching degree of the monitoring parameters and the task distribution based on the task information priority distribution parameters, obtains the corresponding relationship of the tasks in the overlapping interval, calculates the influence range of the delay on the task handover, dynamically adjusts the distribution priority of the communication tasks, allocates the monitoring tasks to the display areas of each device, adjusts the display picture distribution order, and generates a multi-aircraft collaborative monitoring distribution plan.

[0141] The above is only a preferred embodiment of the present invention, and does not limit the present invention in other forms. Any person skilled in the art may use the disclosed technical content to make changes or modifications into equivalent embodiments with equivalent changes and apply them to other fields. However, as long as it does not depart from the technical solution content of the present invention, any simple modification, equivalent change and modification made to the above embodiments based on the technical essence of the present invention still belong to the protection scope of the technical solution of the present invention.

Claims

1. A method for realizing multi-screen display screen control of a drone, characterized in that, It includes the following steps: S1: According to the drone flight path planning data and real-time obstacle information, compare the flight altitude with the obstacle position parameters, calculate the path segmentation of adjacent areas in combination with the drone speed and flight direction, evaluate the minimum safety distance of the obstacles, and output the path planning safety factor; S2: Based on the path planning safety factor, allocate the flight screen data displayed by the VR headset and the flight status information of the screen-equipped remote controller, perform dynamic distribution matching on the flight direction, speed, and perspective switching position parameters, synchronously map the flight screen to different display devices, and generate a multi-screen display mapping matrix; S3: Based on the multi-screen display mapping matrix, obtain the remaining battery levels of the VR headset and the screen-equipped remote controller, calculate the adjustment range of the refresh rate of each display screen, perform hierarchical processing on the screen brightness and image resolution, perform associated control on the display frequency and power output, and generate display dynamic frequency division adjustment parameters; S4: Based on the display dynamic frequency division adjustment parameters, perform real-time processing on the environmental data collected during the drone flight, extract the key feature values of the image frame sequence, perform environmental navigation data display scheduling in combination with the flight area division, and generate task information priority distribution parameters; S5: Based on the task information priority distribution parameters, compare the monitoring parameters in the overlapping interval of the flight path with the task distribution parameters, and in combination with the drone communication delay and data synchronization rate, perform the monitoring screen allocation for the multi-aircraft collaborative task, and generate a multi-aircraft collaborative monitoring allocation plan; Based on the task information priority distribution parameters, compare the monitoring parameters in the overlapping interval of the flight path with the task distribution parameters, and in combination with the drone communication delay and data synchronization rate, perform the monitoring screen allocation for the multi-aircraft collaborative task. The specific steps for generating a multi-aircraft collaborative monitoring allocation plan are as follows: S511: Based on the task information priority distribution parameters, extract the monitoring parameters in the overlapping interval of the flight path, segmentally call the area priority data in the task distribution parameters, analyze the area matching degree between the monitoring parameters and the task distribution, obtain the corresponding relationship of the tasks in the overlapping interval, and generate the monitoring comparison result of the path overlapping interval; S512: Based on the monitoring comparison result of the path overlapping interval, collect the communication delay parameters and data synchronization rate parameters between the drones, calculate the influence range of the delay on the task handover, dynamically adjust the distribution priority of the communication tasks, and generate the multi-aircraft communication and synchronization matching result; S513: Based on the multi-aircraft communication and synchronization matching result, extract the screen distribution parameters of the multi-aircraft collaborative monitoring, match the monitoring screen task priority with the overlapping tasks in the flight path area, allocate the monitoring tasks to the display areas of each device, and adjust the display screen distribution order to generate a multi-aircraft collaborative monitoring allocation plan.

2. The method for implementing multi-screen display screen control of a drone according to claim 1, wherein: The path planning safety factor includes an obstacle safety distance threshold, a flight path segmentation factor, and an adjacent area path connection factor. The multi-screen display mapping matrix includes flight screen allocation parameters, perspective switching matching parameters, and device display synchronization parameters. The display dynamic frequency division adjustment parameter includes a screen refresh rate adjustment range, a screen brightness grading parameter, and an image resolution grading parameter. The task information priority distribution parameter includes an image frame sequence eigenvalue distribution parameter, a flight area division priority parameter, and an environmental navigation scheduling parameter. The multi-aircraft collaborative monitoring allocation scheme includes path overlap interval monitoring parameters, communication delay allocation parameters, and data synchronization rate distribution parameters.

3. The method for implementing multi-screen display screen control of a drone according to claim 1, wherein According to the UAV flight path planning data and real-time obstacle information, compare the flight altitude with the obstacle position parameters, calculate the path segmentation of adjacent areas in combination with the UAV speed and flight direction, evaluate the minimum safety distance of the obstacle, and the specific steps for outputting the path planning safety factor are as follows: S111: Based on the UAV flight path planning data, extract the flight path altitude parameter, analyze the real-time obstacle information and identify the position parameter, judge the obstacle interference area by comparing the spatial range relationship between the flight altitude parameter and the obstacle position parameter, and generate a comparison result of the flight altitude and the obstacle position; S112: Based on the comparison result of the flight altitude and the obstacle position, call the UAV speed parameter to calculate the displacement range per unit time, and combine the flight direction parameter to judge the path change trend of adjacent areas, calculate the adjustment range of each area of the flight path segment by segment, and generate a matching result of path segmentation and dynamic parameters; S113: Based on the matching result of the path segmentation and the dynamic parameters, combine the segmented path information of adjacent areas to evaluate the minimum safety distance of the obstacle, match the altitude parameter of the flight path with the obstacle safety range, measure the comprehensive safety factor of each segment of the path, and output the path planning safety factor.

4. The method for implementing multi-screen display screen control of a drone according to claim 1, wherein, Based on the path planning safety factor, allocate the flight screen data displayed by the VR headset and the flight status information of the remote controller with a screen, perform dynamic distribution matching on the flight direction, speed, and perspective switching position parameters, and synchronously map the flight screen to different display devices. The specific steps for generating the multi-screen display mapping matrix are as follows: S211: Based on the path planning safety factor, obtain the flight screen data corresponding to the path, call the speed change and direction change parameters in the flight path segment by segment, match the distribution parameters of the display range of the VR headset, and allocate the screen data to the display device by area to generate a VR headset screen allocation result; S212: Based on the VR headset screen allocation result, extract the display parameters of the remote controller with a screen, call the real-time flight direction and speed parameters in the flight status information, and map the flight status information to the remote controller display screen according to the parameter distribution of the display status compared by area to generate a flight status mapping result of the remote controller with a screen; S213: Based on the flight status mapping result of the remote controller with a screen, extract the synchronization parameters of the VR headset screen and the display information of the remote controller, match the perspective switching position parameters and the real-time path display area, integrate the flight path screen data and the display device distribution parameters, and output the multi-screen display mapping matrix.

5. The method for implementing multi-screen display screen control of a drone according to claim 1, wherein Based on the multi-screen display mapping matrix, the specific steps for obtaining the remaining battery power values of the VR headset and the remote controller with a screen, calculating the adjustment range of the refresh rate of each display screen, performing hierarchical processing on the screen brightness and image resolution, and performing associated control of the display frequency and power output to generate the display dynamic frequency division adjustment parameters are as follows: S311: Based on the multi-screen display mapping matrix, collect the real-time remaining battery power value parameters of the VR headset and the remote controller with a screen, synchronously extract the current refresh rate, analyze the correlation between the power status and the refresh rate of each device, calculate the display refresh rate adjustment value, and generate the display refresh rate adjustment result; S312: Based on the display refresh rate adjustment result, extract the screen brightness and image resolution parameters of the device, hierarchically calculate the power consumption corresponding to the brightness level and resolution, match the remaining power value with the relationship between the hierarchical brightness and resolution, and generate the display brightness and resolution hierarchical result; S313: Based on the display brightness and resolution hierarchical result, extract the dynamic adjustment range of the display frequency parameter and the power output parameter, calculate the power output requirement according to the refresh rate distribution, and associate the matching rule between the frequency change and the power output to generate the display dynamic frequency division adjustment parameter.

6. The method for realizing multi-screen display screen control of a drone according to claim 5, wherein The display refresh rate adjustment value is calculated according to the formula: ; Perform calculations, where represents the remaining real-time power of the VR headset, represents the remaining real-time power of the screen-equipped remote control, represents the current refresh rate of the VR headset, represents the current refresh rate of the screen-equipped remote control, represents the final display refresh rate adjustment value.

7. The method for implementing multi-screen display screen control of a drone according to claim 1, wherein Based on the display dynamic frequency division adjustment parameter, the specific steps for real-time processing of the environmental data collected during the flight of the drone, extracting the key feature values of the image frame sequence, combining the flight area division for environmental navigation data display scheduling, and generating the task information priority distribution parameter are as follows: S411: Based on the display dynamic frequency division adjustment parameter, analyze the environmental data collected during the flight of the drone, extract the color distribution, edge intensity, and motion trajectory information in the image sequence frame by frame, screen the key feature values by matching the dynamic change features of each frame of data, and generate the image frame feature extraction result; S412: Based on the image frame feature extraction result, match the flight area division information, call the spatial distribution parameter associated with the regional coordinates and dynamic features in the environmental data, integrate the environmental feature data by flight area segments, and analyze the feature differences and dynamic relationships between regions to generate the environmental navigation data distribution result; S413: Based on the environmental navigation data distribution result, extract the environmental change parameters and the dynamic values of the image features in the flight path, sort the task data according to the feature importance, map the task priority to the scheduling range of the display device, and generate the task information priority distribution parameter.

8. The multi-screen display screen control method for implementing an unmanned aerial vehicle according to claim 1, wherein The influence degree of the delay on the task handover is calculated according to the formula ; Perform calculations, where, represents the influence amplitude value, represents the communication delay between drones, represents the time required for data synchronization between drones, represents the data synchronization rate, represents the transmission rate of the communication link, represents the length of the path overlap interval.

9. A multi-screen display control system for implementing an unmanned aerial vehicle, characterized in that, According to the method for realizing the multi-screen display screen control of the drone according to any one of claims 1-8, the system includes: Based on the UAV flight path planning data, the path planning analysis module analyzes real-time obstacle information, identifies position parameters, determines the obstacle interference area, judges the path change trend of adjacent areas in combination with the flight direction parameters, matches the height parameters of the flight path with the safe range of obstacles, and outputs the path planning safety factor; Based on the path planning safety factor, the multi-screen mapping module segmentally calls the speed change and direction change parameters in the flight path, compares and displays the parameter distribution in the divided areas, matches the perspective switching position parameters and the real-time path display area, integrates the flight path picture data and the display device distribution parameters, and outputs the multi-screen display mapping matrix; Based on the multi-screen display mapping matrix, the refresh rate adjustment module analyzes the correlation between the power status of each device and the refresh rate, calculates the display refresh rate adjustment value, matches the remaining power value with the hierarchical brightness and resolution relationship, calculates the power output requirement according to the refresh rate distribution, associates the matching rule of frequency change and power output, and generates the display dynamic frequency division adjustment parameter; Based on the display dynamic frequency division adjustment parameter, the task priority sorting module analyzes the environmental data collected during the UAV flight, matches the dynamic change characteristics of each frame of data, screens the key characteristic values, analyzes the characteristic differences and dynamic relationships between regions, prioritizes the task data according to the characteristic importance, maps the task priority to the scheduling range of the display device, and generates the task information priority distribution parameter; Based on the task information priority distribution parameter, the task distribution optimization module analyzes the regional matching degree between the monitoring parameters and the task distribution, obtains the corresponding relationship of tasks in the overlapping interval, calculates the influence range of delay on task handover, dynamically adjusts the distribution priority of communication tasks, allocates monitoring tasks to the display areas of each device, adjusts the display picture distribution order, and generates the multi-aircraft collaborative monitoring distribution plan.

Citation Information

Patent Citations

  • POMDP model-based APF unmanned aerial vehicle path planning method

    CN115793709A

  • Unmanned platform cluster network connection management and control system and method

    CN116125976A

  • Unmanned aerial vehicle task automatic planning and situation display system based on artificial intelligence

    CN119512164A