Technical activity visualization panoramic preview device and use method thereof

Abstract

The invention relates to the technical field of visual panoramic preview of technical activities, in particular to a visual panoramic preview device for technical activities and a use method thereof, and the method comprises the following steps: step 1, initializing the device: constructing a three-dimensional digital model # imgabs0 # in an activity site, and recording the layout and coverage range of acquisition equipment; initializing multi-source acquisition equipment, wherein the multi-source acquisition equipment comprises an unmanned aerial vehicle, a fixed camera and a mobile sensor; according to the panoramic preview device and method, the problem that data collection is incomplete or not timely in the prior art is solved through a multi-source data collection and optimization method, a redundancy mechanism, efficient data processing and intelligent task scheduling optimization, the real-time performance and accuracy of the panoramic preview device are greatly improved, and the real-time performance of the panoramic preview device is improved by ensuring comprehensive coverage of all key areas. The device can respond to scene changes in time and display field activities in real time, the risk of missing key events is avoided, and more comprehensive and accurate activity full-view real-time preview is provided for users.

Description

Technical Field

[0001] The present invention relates to the technical field of visual panoramic preview of technical activities, and in particular to a visual panoramic preview device of technical activities and a use method thereof. Background Art

[0002] The technology activity visualization panoramic preview device is a device that uses advanced computer vision technology to intuitively display the data and information of technology activities or projects in the form of panoramic images. This device can provide an immersive visual experience, allowing users to observe and analyze the details of technology activities from multiple angles and dimensions; This device has a wide range of applications in scientific research, education, engineering and design. It makes complex technical data and concepts more intuitive and easier to understand. Through scientific computing visualization, researchers can observe, simulate and calculate complex technical problems, thereby improving research efficiency and depth. The panoramic preview device needs to rely on high-quality acquisition equipment and sensors. If the acquisition equipment cannot cover all areas of the event site or update data in real time, the preview content may be incomplete or delayed, thereby limiting the user's real-time understanding of the overall picture of the event, and there is a possibility of missing key events or being unable to fully assess the site conditions. Therefore, in response to the above problems, a technical activity visualization panoramic preview device and a method of using the same are proposed. Summary of the invention

[0003] The purpose of the present invention is to provide a visual panoramic preview device for technical activities and a method for using the same, so as to solve the problem that the panoramic preview device needs to rely on high-quality acquisition equipment and sensors. If the acquisition equipment cannot cover all areas of the activity site or update data in real time, the preview content may be incomplete or delayed, thereby limiting the user's real-time understanding of the overall picture of the activity, resulting in the problem of missing key events or being unable to fully evaluate the site conditions.

[0004] To achieve the above object, the present invention provides the following technical solutions: A device for visualizing and previewing a technical activity and a method for using the same include the following steps: Step 1: Installation initialization: Building a 3D digital model at the event venue , record the layout and coverage of the collection equipment; Initialize multi-source acquisition equipment, including drones, fixed cameras, and mobile sensors; Step 2: Dynamic collection and optimization: Real-time collection of environmental data at the event site through drones, fixed cameras and mobile sensors , including images, videos and dynamic parameters; The device senses key environmental data in real time ,in: is the temperature, For humidity, is the gas concentration, is the noise intensity; Combined with scene heat Calculate and dynamically adjust the collection task priority. The heat calculation formula is:

[0005] In the formula, The density of human traffic, is the activity level, is the rate of change of temperature and humidity, is the temperature change rate, is the humidity change rate, , and is the weight coefficient used for the impact of parallel crowd density, activity level and environmental changes; Priority of collection tasks Determined by the following formula:

[0006] In the formula, is the distance from the region to the center of the scene, is the obstacle factor, which is measured by lidar or image recognition algorithm; Step 3: Data fusion and processing: align the timestamps and perform spatial mapping on the collected multi-source data, remove redundancy, denoise and unify the format; Use convolutional neural networks to enhance image details; Step 4: Real-time panoramic generation: Generate high-precision panoramic images based on fused data and support hot spot area annotation; Use deep learning image stitching algorithm to achieve seamless image stitching; Step 5: Panoramic viewing and control: Users view the panoramic content in real time through the interactive interface; The acquisition equipment can be remotely controlled to adjust the viewing angle and acquisition range to achieve fixed-point tracking and dynamic area coverage; Step 6: Task scheduling and redundancy mechanism: The device allocates collection equipment according to priority and gives priority to covering areas with higher heat; When a single-point device fails, redundant devices are triggered to cover the target area to ensure the continuity of the collection task.

[0007] As a further optimization of the present invention, in the dynamic collection and optimization step, the collection device dynamically adjusts the collection frequency according to the heat monitoring, and the heat priority calculation formula is:

[0008] In the formula, and is the weight coefficient used to adjust the impact of crowd density and activity level, is the flow density per unit area in the region, is an activity level indicator, is the distance from the current area to the center of the scene, and 1 is a constant.

[0009] As a further optimization of the present invention, in the data fusion and processing step, an image enhancement algorithm based on a convolutional neural network is used to optimize the details of multi-source data to reduce noise and improve picture clarity.

[0010] As further optimized content of the present invention, in the panoramic viewing and control step, the user interface supports dynamic interactive functions of hotspot annotation, including area marking, data zooming in and out operations, and provides detailed analysis of hotspot areas in real time.

[0011] As a further optimization of the present invention, the task scheduling and redundancy mechanism allocates tasks to devices by introducing a dynamic priority queue model, and the formula is as follows:

[0012] In the formula, Prioritize the tasks; It is the predicted value of equipment failure probability, which is used to evaluate equipment reliability.

[0013] As further optimized content of the present invention, the device collects temperature and humidity changes, gas concentration and noise intensity in real time through mobile sensors, combines regional dynamic data to perform multi-source information fusion, and generates an optimized collection task configuration plan according to scene changes.

[0014] As a further optimized content of the present invention, in the real-time panoramic generation step, the formula of the panoramic picture fusion model is:

[0015] In the formula, For the The coverage area of ​​the acquisition equipment, is the overlap weight factor, and the formula is as follows:

[0016] and The acquisition quality scores of the i-th and j-th devices are usually evaluated based on factors such as device performance, image resolution, and stability, and the value range is [0, 1].

[0017] As further optimized content of the present invention, it includes: a multi-source acquisition module: composed of a drone, a fixed camera and a mobile sensor, used to collect environmental data at the event site; Data fusion and processing module: used to time align and format the collected data and generate optimized multi-source data; Real-time panoramic generation module: Generates high-precision panoramic images based on optimized data, and supports hotspot annotation and multi-terminal viewing.

[0018] As a further optimization of the present invention, the multi-source acquisition module allocates acquisition devices and adjusts the acquisition frequency according to the scene heat priority through an adaptive dynamic adjustment algorithm.

[0019] As further optimized content of the present invention, the real-time panoramic generation module supports a layered display function based on regions, and users can view detailed images of different regions and perform hot spot analysis operations.

[0020] Compared with the prior art, the present invention has the following beneficial effects: 1. In the present invention, the problem of incomplete or untimely data collection in the prior art is solved by optimizing the multi-source data collection and optimization method, redundancy mechanism, efficient data processing and intelligent task scheduling, which greatly improves the real-time performance and accuracy of the panoramic preview device. By ensuring full coverage of all key areas, the device can respond to scene changes in a timely manner and display on-site activities in real time, avoiding the risk of missing key events, and providing users with a more comprehensive and accurate real-time preview of the entire activity; 2. In the present invention, by combining the multi-source acquisition module and the dynamic acquisition and optimization module, it is possible to achieve all-round and real-time activity scene monitoring, ensuring that each area can be accurately collected. The modular design not only improves the comprehensiveness and accuracy of data collection, but also dynamically adjusts the collection tasks through scene heat calculation and priority adjustment mechanism to ensure that the most important and active areas receive priority attention. This enables the device to effectively avoid data blind spots and ensure that all key events and changes can be recorded and fed back in real time, greatly improving the efficiency of event site management and decision-making support capabilities; 3. In the present invention, by adopting an intelligent scheduling module and a redundancy mechanism, the stability and reliability of the panoramic preview device in a complex environment are greatly improved. The intelligent scheduling module optimizes the resource allocation of the acquisition equipment based on real-time data analysis on site to ensure that high-priority tasks can get timely responses at critical moments. The redundancy mechanism ensures seamless switching to backup equipment in the event of equipment failure, preventing data loss or task interruption due to equipment failure. Through these optimizations, the reliability, sustainability and responsiveness of the device are effectively improved, greatly reducing the potential risks caused by equipment failure, improper resource allocation and other problems. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A flowchart of a method for using a device for visualizing a panoramic preview of a technical activity according to the present invention; Figure 2 The present invention is a system block diagram of a device for visualizing a panoramic preview of a technical activity. DETAILED DESCRIPTION

[0022] See also Figure 1-2 , the present invention provides a technical solution: A visual panoramic preview device for technical activities and a method for using the same include the following steps: Step 1: Device initialization: Constructing a three-dimensional digital model at the activity site , record the layout and coverage of the collection equipment; Initialize multi-source acquisition equipment, including drones, fixed cameras, and mobile sensors; Step 2: Dynamic collection and optimization: Real-time collection of environmental data at the event site through drones, fixed cameras and mobile sensors , including images, videos and dynamic parameters; The device senses key environmental data in real time ,in: is the temperature, For humidity, is the gas concentration, is the noise intensity; Combined with scene heat Calculate and dynamically adjust the collection task priority. The heat calculation formula is:

[0023] In the formula, The flow density, is the activity level, is the rate of change of temperature and humidity, is the temperature change rate, is the humidity change rate, , and is the weight coefficient used for the impact of parallel crowd density, activity level and environmental changes; First, different factors (people density, activity level and environmental changes) are weighted and calculated to obtain the heat value of each area. Then, according to the heat value, the device dynamically adjusts the priority of data collection to ensure that the areas that need the most attention in the activity venue can get priority collection resources, reasonably allocate resources in complex environments, and improve data collection efficiency; Priority of collection tasks Determined by the following formula:

[0024] In the formula, is the distance from the region to the center of the scene, is the obstacle factor, which is measured by lidar or image recognition algorithm; By combining scene heat with regional distance and obstacle factors, the device dynamically optimizes the collection tasks. In areas far from the center and with more obstacles, the priority is automatically adjusted to avoid over-concentration in certain areas, improve the balance of global resources, and at the same time ensure that areas with complex environments can obtain sufficient collection resources. Step 3: Data fusion and processing: align the timestamps and perform spatial mapping on the collected multi-source data, remove redundancy, denoise and unify the format; Use convolutional neural networks to enhance image details; Step 4: Real-time panoramic generation: Generate high-precision panoramic images based on fused data and support hot spot area annotation; Use deep learning image stitching algorithm to achieve seamless image stitching; Step 5: Panoramic viewing and control: Users view the panoramic content in real time through the interactive interface; The acquisition equipment can be remotely controlled to adjust the viewing angle and acquisition range to achieve fixed-point tracking and dynamic area coverage; Step 6: Task scheduling and redundancy mechanism: The device allocates collection equipment according to priority and gives priority to covering areas with higher heat; When a single-point device fails, redundant equipment is triggered to cover the target area to ensure the continuity of the collection task. Through real-time heat perception and dynamic collection optimization, all-round monitoring and efficient coverage of the event site are ensured, reducing blind spots in data collection, improving resource utilization efficiency and the accuracy of on-site management. At the same time, by dynamically adjusting the collection priority, the device can flexibly respond to changes in the scene and provide real-time, high-quality data support.

[0025] As a technical solution for further implementation of this solution, in the dynamic collection and optimization step, the collection device dynamically adjusts the collection frequency according to heat monitoring, and the heat priority calculation formula is:

[0026] In the formula, and is the weight coefficient used to adjust the impact of crowd density and activity level, is the flow density per unit area in the region, is an activity level indicator, is the distance from the current area to the center of the scene, 1 is a constant term, and the introduction of weight coefficients and dynamic adjustment mechanisms can prioritize resource allocation according to the needs of different scenes, improve the responsiveness of the device in complex scenes, ensure that high-density and high-activity areas can receive priority attention, and optimize the efficiency of data collection and resource allocation; As a technical solution for further implementation of this solution, in the data fusion and processing step, an image enhancement algorithm based on a convolutional neural network is used to optimize the details of multi-source data to reduce noise and improve picture clarity. The use of a convolutional neural network algorithm for image processing can significantly improve the clarity and accuracy of the data and reduce noise interference, thereby providing a higher quality real-time panoramic image, which is crucial for detail display and accurate judgment of the conditions at the event site, and enhances the reliability and availability of the device; As a technical solution for further implementation of this solution, in the panoramic viewing and control step, the user interface supports dynamic interactive functions of hotspot annotation, including area marking, data zooming in and out operations, and provides detailed analysis of hotspot areas in real time. Through the dynamic interactive function, users can view and analyze hotspot areas in real time, which improves the convenience and flexibility of operation. Hotspot annotation and zooming operations enhance the user's control over on-site data and optimize the rapid location and decision support of on-site problems. As a technical solution for further implementing this solution, the task scheduling and redundancy mechanism allocates tasks to devices by introducing a dynamic priority queue model, and the formula is as follows:

[0027] In the formula, Prioritize the tasks; It is the predicted value of equipment failure probability, which is used to evaluate equipment reliability. The dynamic priority queue model combined with equipment reliability prediction improves the intelligence level of task scheduling. The redundancy mechanism ensures the reliability of the device in the event of equipment failure, reduces task interruption caused by single point failure, and enhances the stability of the device and the continuity of task execution. As a technical solution for further implementation of this solution, the device collects temperature and humidity changes, gas concentration and noise intensity in real time through mobile sensors, combines regional dynamic data for multi-source information fusion, and generates optimized collection task configuration solutions according to scene changes. Through multi-source information fusion, the device can fully monitor the environmental changes on site in real time to ensure that the collection tasks can meet the needs of dynamic changes. The introduction of environmental data improves the accuracy and adaptability of task configuration, thereby enhancing the intelligence and responsiveness of the entire device; As a technical solution for further implementing this solution, in the real-time panoramic generation step, the formula of the panoramic picture fusion model is:

[0028] In the formula, For the The coverage area of ​​the acquisition equipment, is the overlap weight factor, and the formula is as follows:

[0029] and The acquisition quality scores of the i-th and j-th devices are usually evaluated based on factors such as device performance, image resolution, and stability, and the value range is [0, 1]. Through difference set and weight factor optimization, the impact of overlapping areas on the final panoramic image is reduced, ensuring the priority acquisition area of ​​high-quality devices, improving the clarity of the panoramic image and the authenticity of the data, and ensuring efficient display without redundancy and interference; As a further technical solution for the implementation of this plan, it includes: Multi-source acquisition module: composed of drones, fixed cameras and mobile sensors, used to collect environmental data at the event site; Data fusion and processing module: used to time align and format the collected data and generate optimized multi-source data; Real-time panoramic generation module: Generates high-precision panoramic images based on optimized data, supports hotspot annotation and multi-terminal viewing, and ensures comprehensive coverage of the event site and real-time data collection through the collaborative work of multiple acquisition devices. The data fusion and processing module optimizes the integration of different data sources, making the generation of panoramic images more accurate, and supports real-time viewing and subsequent analysis, greatly improving the operating experience and data analysis capabilities; As a technical solution for further implementation of this solution, the multi-source acquisition module allocates acquisition devices and adjusts the acquisition frequency according to the scene heat priority through an adaptive dynamic adjustment algorithm. Through heat perception and adaptive adjustment algorithms, the device can optimize resource allocation according to the needs of different scenes, thereby improving the accuracy and efficiency of acquisition. This function improves the adaptability of the device in a dynamically changing environment, ensuring that high-priority areas can receive rapid response and resource coverage; As a technical solution for further implementation of this scheme, the real-time panoramic generation module supports a layered display function based on regions. Users can view detailed pictures of different regions and perform hotspot analysis operations. Through the layered display and hotspot analysis functions, users can view each area of ​​the site in detail and analyze the situation in key areas in real time. This not only improves the user's operating efficiency, but also helps managers better understand and deal with complex situations on site, and promotes the timeliness and accuracy of on-site decision-making.

[0030] This article uses specific examples to illustrate the principles and implementation methods of the present invention. The above examples are only used to help understand the method and core ideas of the present invention. The above is only a preferred implementation of the present invention. It should be pointed out that due to the limitations of textual expression and the objective existence of infinite specific structures, ordinary technicians in this technical field can make several improvements, modifications or changes without departing from the principles of the present invention, and can also combine the above technical features in an appropriate manner; these improvements, modifications, changes or combinations, or the direct application of the inventive concept and technical solution to other occasions without improvement, should be regarded as the protection scope of the present invention.

Claims

1. A method for using a device for visualizing a panoramic preview of a technical activity, characterized in that: The following steps are involved: Step 1: Installation initialization: Building a 3D digital model at the event venue , record the layout and coverage of the collection equipment; Initialize multi-source acquisition equipment, including drones, fixed cameras, and mobile sensors; Step 2: Dynamic collection and optimization: Real-time collection of environmental data at the event site through drones, fixed cameras and mobile sensors , including images, videos and dynamic parameters; The device senses key environmental data in real time ,in: is the temperature, For humidity, is the gas concentration, is the noise intensity; Combined with scene heat Calculate and dynamically adjust the collection task priority. The heat calculation formula is: In the formula, The flow density, is the activity level, is the rate of change of temperature and humidity, is the temperature change rate, is the humidity change rate, , and is the weight coefficient used for the impact of parallel crowd density, activity level and environmental changes; Priority of collection tasks Determined by the following formula: In the formula, is the distance from the region to the center of the scene, is the obstacle factor, which is measured by lidar or image recognition algorithm; Step 3: Data fusion and processing: align the timestamps and perform spatial mapping on the collected multi-source data, remove redundancy, denoise and unify the format; Use convolutional neural networks to enhance image details; Step 4: Real-time panoramic generation: Generate high-precision panoramic images based on fused data and support hot spot area annotation; Use deep learning image stitching algorithm to achieve seamless image stitching; Step 5: Panoramic viewing and control: Users view the panoramic content in real time through the interactive interface; The acquisition equipment can be remotely controlled to adjust the viewing angle and acquisition range to achieve fixed-point tracking and dynamic area coverage; Step 6: Task scheduling and redundancy mechanism: The device allocates collection equipment according to priority and gives priority to covering areas with higher heat; When a single-point device fails, redundant devices are triggered to cover the target area to ensure the continuity of the collection task.

2. The method for using the device for visualizing panoramic preview of technical activities according to claim 1, characterized in that: In the dynamic collection and optimization step, the collection device dynamically adjusts the collection frequency according to heat monitoring, and the heat priority calculation formula is: In the formula, and is the weight coefficient used to adjust the impact of crowd density and activity level. is the flow density per unit area in the region, is an activity level indicator, is the distance from the current area to the center of the scene, and 1 is a constant.

3. The method for using the device for visualizing panoramic preview of technical activities according to claim 1 is characterized by: In the data fusion and processing step, an image enhancement algorithm based on a convolutional neural network is used to optimize the details of multi-source data to reduce noise and improve picture clarity.

4. The method for using the device for visualizing panoramic preview of technical activities according to claim 1, characterized in that: In the panoramic viewing and control step, the user interface supports dynamic interactive functions for hotspot annotation, including area marking, data zooming in and out operations, and provides detailed analysis of hotspot areas in real time.

5. The method for using the device for visualizing panoramic preview of technical activities according to claim 1, characterized in that: The task scheduling and redundancy mechanism allocates tasks to devices by introducing a dynamic priority queue model. The formula is as follows: In the formula, Prioritize the tasks; It is the predicted value of equipment failure probability, which is used to evaluate equipment reliability.

6. The method for using the device for visualizing panoramic preview of technical activities according to claim 1, characterized in that: The device uses mobile sensors to collect temperature and humidity changes, gas concentration and noise intensity in real time, combines regional dynamic data to fuse multi-source information, and generates optimized collection task configuration plans based on scene changes.

7. The method for using the device for visualizing panoramic preview of technical activities according to claim 1, characterized in that: In the real-time panoramic generation step, the formula of the panoramic picture fusion model is: In the formula, For the The coverage area of ​​the acquisition equipment, is the overlap weight factor, and the formula is as follows: and The acquisition quality scores of the i-th and j-th devices are usually evaluated based on factors such as device performance, image resolution, and stability, and the value range is [0, 1].

8. A visual panoramic preview device for technical activities according to any one of claims 1 to 9, characterized in that: include: Multi-source acquisition module: It consists of drones, fixed cameras and mobile sensors to collect environmental data at the event site; Data fusion and processing module: used to time align and format the collected data and generate optimized multi-source data; Real-time panoramic generation module: Generates high-precision panoramic images based on optimized data, and supports hotspot annotation and multi-terminal viewing.

9. The device for visualizing and previewing a technical activity according to claim 8, characterized in that: The multi-source acquisition module allocates acquisition devices and adjusts the acquisition frequency according to the scene heat priority through an adaptive dynamic adjustment algorithm.

10. The device for visualizing and previewing a technical activity according to claim 8, characterized in that: The real-time panoramic generation module supports a layered display function based on regions, and users can view detailed images of different regions and perform hot spot analysis operations.

Images